[2025-09-24T17:00:01.969773] [INFO ] [MAIN ] Using last completed trading day: 2025-09-24 [2025-09-24T17:00:01.970442] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-24T17:00:01.970588] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-24T17:00:01.970670] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-24T17:00:03.626206] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-09-24T17:00:03.626602] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-24T17:00:03.626861] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-24T17:00:03.627570] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-09-24T17:00:03.627628] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-24T17:00:03.627697] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-24T17:00:03.627768] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-24T17:00:03.627863] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-24T17:00:03.628422] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-09-24T17:00:03.628460] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-24T17:00:03.628629] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-24T17:00:03.628708] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-09-24T17:00:03.628747] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-24T17:00:03.628779] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-24T17:00:03.654498] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-24T17:00:03.680039] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-24T17:00:03.680098] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-24T17:00:03.680132] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-24T17:00:03.680160] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-24T17:00:03.680456] [WARN ] [STATE ] State set to: RUNNING [2025-09-24T17:00:03.680567] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-24T17:00:03.680968] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-09-24T17:00:03.681021] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-24T17:00:03.681053] [INFO ] [MAIN ] Starting incremental update for 2373 symbols. [2025-09-24T17:00:03.681081] [INFO ] [MAIN ] Running in parallel mode [2025-09-24T17:00:03.681258] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2373 symbols [2025-09-24T17:00:04.304427] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:04.338848] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:04.366957] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-24T17:00:04.387815] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:04.383720] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-24T17:00:04.366899] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-24T17:00:04.433628] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:04.434133] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-24T17:00:04.434413] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-24T17:00:04.434516] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-24T17:00:04.434832] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-24T17:00:04.434699] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-24T17:00:04.434951] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-24T17:00:04.436580] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-24T17:00:04.441938] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-24T17:00:04.441995] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-24T17:00:04.450382] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-24T17:00:04.469981] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-24T17:00:04.469913] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-24T17:00:04.563780] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-24T17:00:04.612811] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-24T17:00:04.647116] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-24T17:00:05.128770] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-24T17:00:05.177079] [INFO ] [MAIN ] AA: Loaded 53614 existing records. [2025-09-24T17:00:05.552615] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:05.628701] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:05.615942] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-24T17:00:05.648335] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-24T17:00:05.845302] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:05.885723] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:05.886258] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-24T17:00:05.886783] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-24T17:00:05.887716] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-24T17:00:05.889940] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-24T17:00:05.890023] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-24T17:00:06.252385] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:06.252728] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-24T17:00:06.283139] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-24T17:00:06.284210] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-24T17:00:06.366104] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-24T17:00:06.367040] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-24T17:00:06.579925] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-24T17:00:06.581060] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-24T17:00:06.846460] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T17:00:06.847449] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-24T17:00:07.161006] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-24T17:00:07.162000] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-24T17:00:07.180638] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T17:00:07.181519] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-24T17:00:07.494970] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-24T17:00:07.495931] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-24T17:00:07.739705] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T17:00:07.741812] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-24T17:00:07.918679] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T17:00:07.919667] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-24T17:00:08.258376] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-24T17:00:08.259274] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-24T17:00:08.431526] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-24T17:00:08.442614] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-24T17:00:08.496065] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-24T17:00:08.497341] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-24T17:00:08.519458] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T17:00:08.522040] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-24T17:00:08.563547] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-24T17:00:08.574383] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-24T17:00:08.910173] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-24T17:00:08.911142] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-24T17:00:09.295693] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T17:00:09.298354] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-24T17:00:09.350372] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T17:00:09.351440] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-24T17:00:09.961135] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T17:00:09.962461] [INFO ] [REMOTE ] AAM: Full fetch complete (978 records). [2025-09-24T17:00:09.962548] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-24T17:00:10.101298] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T17:00:10.163538] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-24T17:00:10.178171] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T17:00:10.206723] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-24T17:00:10.210474] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-24T17:00:10.209996] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:10.211439] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:10.211548] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-24T17:00:10.211686] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-24T17:00:10.211760] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-24T17:00:10.211813] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-24T17:00:10.211879] [INFO ] [MAIN ] Update Progress: 1/2373 symbols completed. AAM took 6.5s. Estimated remaining: 4h 18m 11s. Rate: 9.2 symbols/min [2025-09-24T17:00:10.397414] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:10.397752] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-24T17:00:10.398010] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-24T17:00:10.398911] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-24T17:00:10.399077] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-24T17:00:10.399394] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-24T17:00:10.399548] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-24T17:00:10.579846] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T17:00:10.713935] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-24T17:00:10.832965] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:10.833296] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-24T17:00:11.108476] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:11.108858] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-24T17:00:11.109410] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-24T17:00:11.408936] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:00:11.412216] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-24T17:00:12.063358] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T17:00:12.073782] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-24T17:00:12.091692] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:00:12.095916] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-24T17:00:12.231843] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T17:00:12.234858] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-24T17:00:12.772160] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T17:00:12.783578] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-24T17:00:12.815804] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T17:00:12.819806] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-24T17:00:13.419749] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T17:00:13.423790] [INFO ] [REMOTE ] AACT: Full fetch complete (11304 records). [2025-09-24T17:00:13.423878] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-24T17:00:13.614009] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T17:00:13.614417] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:13.614535] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:13.614610] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-24T17:00:13.614711] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-24T17:00:13.614764] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-24T17:00:13.614808] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-24T17:00:13.614893] [INFO ] [MAIN ] Update Progress: 2/2373 symbols completed. AACT took 9.9s. Estimated remaining: 3h 16m 16s. Rate: 12.1 symbols/min [2025-09-24T17:00:13.795199] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:13.795720] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-09-24T17:00:13.795821] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-09-24T17:00:13.796090] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-24T17:00:13.796138] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-24T17:00:13.796181] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-24T17:00:13.796232] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-24T17:00:14.185308] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:00:14.216790] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:14.219859] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-24T17:00:14.226862] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-24T17:00:14.271708] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-24T17:00:14.284395] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-24T17:00:14.967953] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-24T17:00:14.982902] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-24T17:00:15.291005] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T17:00:15.298451] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-24T17:00:17.107824] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T17:00:17.113678] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-24T17:00:17.149106] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-24T17:00:17.161705] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-24T17:00:17.313100] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (3.09 seconds). [2025-09-24T17:00:17.323811] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-24T17:00:17.870034] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-09-24T17:00:17.882346] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-24T17:00:19.406928] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-24T17:00:19.418059] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-24T17:00:19.899343] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T17:00:19.919211] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-24T17:00:21.139993] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T17:00:21.154888] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-24T17:00:21.887044] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (4.77 seconds). [2025-09-24T17:00:21.892467] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-24T17:00:22.922246] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T17:00:22.928154] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-24T17:00:23.148073] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (5.82 seconds). [2025-09-24T17:00:23.159326] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-24T17:00:24.177513] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (4.26 seconds). [2025-09-24T17:00:24.188705] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-24T17:00:24.493919] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-09-24T17:00:24.507413] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-24T17:00:24.525566] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T17:00:24.531277] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-24T17:00:24.639505] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T17:00:24.649520] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-24T17:00:25.757135] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T17:00:25.762266] [INFO ] [REMOTE ] AAMI: Full fetch complete (30468 records). [2025-09-24T17:00:25.762387] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-24T17:00:25.958417] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-24T17:00:25.959289] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:25.959572] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:25.959738] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-24T17:00:25.960030] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-24T17:00:25.960098] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-24T17:00:25.960148] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-24T17:00:25.960234] [INFO ] [MAIN ] Update Progress: 3/2373 symbols completed. AAMI took 15.7s. Estimated remaining: 4h 53m 20s. Rate: 8.1 symbols/min [2025-09-24T17:00:26.142852] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:26.173084] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:00:26.184240] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-24T17:00:26.211328] [DEBUG] [LOCAL ] AAT: Loaded 30651 existing records from primary storage. [2025-09-24T17:00:26.211477] [INFO ] [MAIN ] AAT: Loaded 30651 existing records. [2025-09-24T17:00:26.413535] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:26.433754] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-24T17:00:26.434151] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-24T17:00:26.438263] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-24T17:00:26.447069] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-24T17:00:26.447173] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-24T17:00:26.471525] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-24T17:00:26.663404] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T17:00:26.786081] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-24T17:00:26.860050] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:26.860428] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-24T17:00:27.829268] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T17:00:27.842672] [INFO ] [REMOTE ] A: Full fetch complete (73061 records). [2025-09-24T17:00:27.842832] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-24T17:00:28.050523] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T17:00:28.115922] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-24T17:00:28.295365] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-24T17:00:28.295897] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-24T17:00:28.297197] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-24T17:00:28.297387] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-24T17:00:28.300081] [DEBUG] [LOCAL ] A: Trimmed 73061 records to 50780 (keeping 200 days of data) [2025-09-24T17:00:28.494920] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T17:00:28.506713] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T17:00:28.520378] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-24T17:00:28.520758] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-24T17:00:28.743741] [DEBUG] [LOCAL ] A: Primary data saved (50780 records). [2025-09-24T17:00:28.743900] [INFO ] [MAIN ] A: Full history saved. [2025-09-24T17:00:28.744358] [INFO ] [MAIN ] Update Progress: 4/2373 symbols completed. A took 25.1s. Estimated remaining: 4h 7m 24s. Rate: 9.6 symbols/min [2025-09-24T17:00:28.923851] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:28.924321] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-24T17:00:28.924379] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-24T17:00:28.924545] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-24T17:00:28.924613] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-24T17:00:28.924707] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-24T17:00:28.924761] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-24T17:00:29.286948] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:29.287266] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-24T17:00:29.552218] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:00:29.558386] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-24T17:00:29.564026] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:29.564212] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-24T17:00:29.564478] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-24T17:00:30.302367] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:30.302700] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-24T17:00:30.303193] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-24T17:00:31.268363] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:31.271592] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-24T17:00:31.272626] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-24T17:00:31.273467] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-24T17:00:31.284807] [INFO ] [REMOTE ] AA: Full fetch complete (77527 records). [2025-09-24T17:00:31.284961] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-24T17:00:31.720280] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-24T17:00:31.720678] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-24T17:00:31.731697] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-24T17:00:31.742236] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-24T17:00:31.766176] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-24T17:00:31.765686] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-24T17:00:31.783000] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-24T17:00:31.785202] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-24T17:00:31.785413] [DEBUG] [LOCAL ] AA: Trimmed 77527 records to 53614 (keeping 200 days of data) [2025-09-24T17:00:31.865144] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:31.874777] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-24T17:00:31.902278] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-24T17:00:32.119522] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:32.120870] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-24T17:00:32.121828] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-24T17:00:32.145991] [DEBUG] [LOCAL ] AA: Primary data saved (53614 records). [2025-09-24T17:00:32.146163] [INFO ] [MAIN ] AA: Full history saved. [2025-09-24T17:00:32.146395] [INFO ] [MAIN ] Update Progress: 5/2373 symbols completed. AA took 28.5s. Estimated remaining: 3h 44m 41s. Rate: 10.5 symbols/min [2025-09-24T17:00:32.335001] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:32.377488] [DEBUG] [LOCAL ] AB: Loaded 28399 existing records from primary storage. [2025-09-24T17:00:32.377683] [INFO ] [MAIN ] AB: Loaded 28399 existing records. [2025-09-24T17:00:32.474823] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:00:32.488247] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-24T17:00:32.499413] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-24T17:00:32.579153] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:32.580126] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-24T17:00:32.580184] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-24T17:00:32.581971] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-24T17:00:32.582032] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-24T17:00:32.975290] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:32.976311] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-24T17:00:32.979422] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T17:00:32.988592] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-24T17:00:33.340747] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:00:33.343392] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-24T17:00:33.591305] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T17:00:33.602103] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-24T17:00:33.925430] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T17:00:33.928221] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-24T17:00:34.214258] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T17:00:34.222497] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-24T17:00:34.445254] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T17:00:34.454080] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-24T17:00:34.951242] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T17:00:34.955611] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-24T17:00:35.134376] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:00:35.146399] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-24T17:00:35.477862] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:00:35.486381] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-24T17:00:35.545293] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T17:00:35.554038] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-24T17:00:35.743477] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T17:00:35.747035] [INFO ] [REMOTE ] AAUC: Full fetch complete (7322 records). [2025-09-24T17:00:35.747107] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-24T17:00:35.747505] [FATAL] [VALIDATOR ] AAUC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:00:35.747588] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:35.747631] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:35.747710] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-24T17:00:35.747828] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-24T17:00:35.747871] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-24T17:00:35.747912] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-24T17:00:35.747966] [INFO ] [MAIN ] Update Progress: 6/2373 symbols completed. AAUC took 7.0s. Estimated remaining: 3h 30m 50s. Rate: 11.2 symbols/min [2025-09-24T17:00:35.924598] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:35.981050] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-09-24T17:00:35.981223] [INFO ] [MAIN ] ABBV: Loaded 53686 existing records. [2025-09-24T17:00:36.159012] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:36.159290] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-24T17:00:36.159348] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-24T17:00:36.161044] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-24T17:00:36.161114] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-24T17:00:36.519858] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:36.520198] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-24T17:00:36.799084] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:00:36.818205] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-24T17:00:36.820211] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:00:36.833138] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-24T17:00:37.156586] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T17:00:37.166340] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-24T17:00:38.091417] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T17:00:38.099884] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-24T17:00:38.598322] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T17:00:38.607155] [INFO ] [REMOTE ] AAP: Full fetch complete (75166 records). [2025-09-24T17:00:38.607297] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-24T17:00:38.974727] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-24T17:00:39.016046] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-24T17:00:39.143430] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T17:00:39.143820] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-24T17:00:39.153148] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-24T17:00:39.154578] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-24T17:00:39.154856] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-24T17:00:39.155180] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-24T17:00:39.175099] [DEBUG] [LOCAL ] AAP: Trimmed 75166 records to 52097 (keeping 200 days of data) [2025-09-24T17:00:39.179910] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T17:00:39.189021] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-24T17:00:39.518797] [DEBUG] [LOCAL ] AAP: Primary data saved (52097 records). [2025-09-24T17:00:39.518960] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-24T17:00:39.519042] [INFO ] [MAIN ] Update Progress: 7/2373 symbols completed. AAP took 25.9s. Estimated remaining: 3h 21m 53s. Rate: 11.7 symbols/min [2025-09-24T17:00:39.689748] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:39.724043] [DEBUG] [LOCAL ] ABCB: Loaded 30812 existing records from primary storage. [2025-09-24T17:00:39.724282] [INFO ] [MAIN ] ABCB: Loaded 30812 existing records. [2025-09-24T17:00:39.921128] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:39.921444] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-24T17:00:39.921496] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-24T17:00:39.922679] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-24T17:00:39.922744] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-24T17:00:40.300873] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:40.301311] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-24T17:00:40.635608] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T17:00:40.644036] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-24T17:00:40.746279] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T17:00:40.757228] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-24T17:00:40.771539] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T17:00:40.777170] [INFO ] [REMOTE ] AAT: Full fetch complete (42697 records). [2025-09-24T17:00:40.777269] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-24T17:00:41.170561] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-24T17:00:41.170791] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-24T17:00:41.171286] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-24T17:00:41.171363] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-24T17:00:41.172687] [DEBUG] [LOCAL ] AAT: Trimmed 42697 records to 30649 (keeping 200 days of data) [2025-09-24T17:00:41.283830] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T17:00:41.291395] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-24T17:00:41.383457] [DEBUG] [LOCAL ] AAT: Primary data saved (30649 records). [2025-09-24T17:00:41.383581] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-24T17:00:41.383684] [INFO ] [MAIN ] Update Progress: 8/2373 symbols completed. AAT took 15.4s. Estimated remaining: 3h 5m 46s. Rate: 12.7 symbols/min [2025-09-24T17:00:41.559593] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:41.576222] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T17:00:41.582601] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-24T17:00:41.635448] [DEBUG] [LOCAL ] ABEV: Loaded 53274 existing records from primary storage. [2025-09-24T17:00:41.635593] [INFO ] [MAIN ] ABEV: Loaded 53274 existing records. [2025-09-24T17:00:41.820433] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:41.820749] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-24T17:00:41.820807] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-24T17:00:41.823770] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-24T17:00:41.823864] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-24T17:00:42.179513] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:42.179921] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-24T17:00:42.303157] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T17:00:42.309854] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-24T17:00:42.611087] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T17:00:42.616282] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-24T17:00:42.720130] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T17:00:42.732041] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-24T17:00:43.554594] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T17:00:43.560932] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-24T17:00:43.698551] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T17:00:43.708953] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-24T17:00:43.828968] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:00:43.839834] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-24T17:00:44.614144] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T17:00:44.624711] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-24T17:00:44.832374] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T17:00:44.837703] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-24T17:00:44.981147] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-24T17:00:44.992982] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-24T17:00:45.900620] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T17:00:45.913429] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-24T17:00:45.941082] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T17:00:45.950379] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-24T17:00:45.965279] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:00:45.970816] [INFO ] [REMOTE ] AB: Full fetch complete (46020 records). [2025-09-24T17:00:45.970956] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-24T17:00:46.359597] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-24T17:00:46.359735] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-24T17:00:46.360259] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-24T17:00:46.360306] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-24T17:00:46.361690] [DEBUG] [LOCAL ] AB: Trimmed 46020 records to 28323 (keeping 200 days of data) [2025-09-24T17:00:46.564082] [DEBUG] [LOCAL ] AB: Primary data saved (28323 records). [2025-09-24T17:00:46.564228] [INFO ] [MAIN ] AB: Full history saved. [2025-09-24T17:00:46.564317] [INFO ] [MAIN ] Update Progress: 9/2373 symbols completed. AB took 14.4s. Estimated remaining: 3h 7m 44s. Rate: 12.6 symbols/min [2025-09-24T17:00:46.732603] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:46.750786] [DEBUG] [LOCAL ] ABG: Loaded 18794 existing records from primary storage. [2025-09-24T17:00:46.750905] [INFO ] [MAIN ] ABG: Loaded 18794 existing records. [2025-09-24T17:00:46.939000] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:46.939669] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-24T17:00:46.939842] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-24T17:00:46.947233] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-24T17:00:46.959746] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-24T17:00:46.994075] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T17:00:47.047595] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-24T17:00:47.345496] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:47.345855] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-24T17:00:47.387928] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-24T17:00:47.399888] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-24T17:00:47.791787] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T17:00:47.802126] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-24T17:00:48.043147] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T17:00:48.048909] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-24T17:00:48.153054] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T17:00:48.156493] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-24T17:00:49.202562] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T17:00:49.207218] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-24T17:00:49.355349] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T17:00:49.362707] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-24T17:00:49.689467] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T17:00:49.700825] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-24T17:00:49.761892] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-24T17:00:49.773220] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-24T17:00:50.228298] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T17:00:50.232132] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-24T17:00:50.396128] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:00:50.403147] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-24T17:00:51.403101] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T17:00:51.408307] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-24T17:00:51.552717] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:00:51.565487] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-24T17:00:51.730488] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T17:00:51.736377] [INFO ] [REMOTE ] ABCB: Full fetch complete (44118 records). [2025-09-24T17:00:51.736488] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-24T17:00:51.737329] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:00:51.737492] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:51.737694] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:51.737803] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-24T17:00:51.737959] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-09-24T17:00:51.738021] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-09-24T17:00:51.747405] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-09-24T17:00:51.765830] [INFO ] [MAIN ] Update Progress: 10/2373 symbols completed. ABCB took 12.2s. Estimated remaining: 3h 9m 22s. Rate: 12.5 symbols/min [2025-09-24T17:00:51.800028] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T17:00:51.881556] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-24T17:00:51.951951] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:52.001374] [DEBUG] [LOCAL ] ABM: Loaded 32493 existing records from primary storage. [2025-09-24T17:00:52.001586] [INFO ] [MAIN ] ABM: Loaded 32493 existing records. [2025-09-24T17:00:52.177095] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:52.177365] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-24T17:00:52.177424] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-24T17:00:52.178396] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-24T17:00:52.178458] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-24T17:00:52.546089] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:52.546434] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-24T17:00:52.563025] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T17:00:52.569432] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-24T17:00:53.405976] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T17:00:53.417258] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-24T17:00:53.610111] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T17:00:53.613631] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-24T17:00:53.734514] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:00:53.746127] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-24T17:00:53.940555] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T17:00:53.946481] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-24T17:00:54.223852] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T17:00:54.229542] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-24T17:00:54.962202] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T17:00:54.975955] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-24T17:00:55.203693] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:00:55.216634] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T17:00:55.225713] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-24T17:00:55.228253] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-24T17:00:55.484069] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T17:00:55.496435] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-24T17:00:56.277205] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T17:00:56.282673] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-24T17:00:56.379454] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T17:00:56.384893] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-24T17:00:56.982848] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T17:00:56.995380] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-24T17:00:57.485750] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T17:00:57.488992] [INFO ] [REMOTE ] ABG: Full fetch complete (26251 records). [2025-09-24T17:00:57.489124] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-24T17:00:57.489695] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:00:57.489805] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:57.489848] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:57.489887] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-24T17:00:57.489946] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-24T17:00:57.489982] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-09-24T17:00:57.490286] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-09-24T17:00:57.490388] [INFO ] [MAIN ] Update Progress: 11/2373 symbols completed. ABG took 10.9s. Estimated remaining: 3h 12m 34s. Rate: 12.3 symbols/min [2025-09-24T17:00:57.709513] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:57.712759] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-24T17:00:57.723119] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-09-24T17:00:57.723418] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-24T17:00:57.724636] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:00:57.724767] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:00:57.724883] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:00:57.724959] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-24T17:00:57.725029] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-09-24T17:00:57.725067] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-09-24T17:00:57.725414] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-09-24T17:00:57.726605] [INFO ] [MAIN ] Update Progress: 12/2373 symbols completed. ABBV took 22.0s. Estimated remaining: 2h 57m 13s. Rate: 13.3 symbols/min [2025-09-24T17:00:57.870023] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T17:00:57.898321] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-24T17:00:57.987251] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:00:57.987828] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-09-24T17:00:57.987882] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-09-24T17:00:57.988054] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-24T17:00:57.988099] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-24T17:00:57.988141] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-24T17:00:57.988175] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-24T17:00:58.128878] [DEBUG] [LOCAL ] ABR: Loaded 52103 existing records from primary storage. [2025-09-24T17:00:58.139437] [INFO ] [MAIN ] ABR: Loaded 52103 existing records. [2025-09-24T17:00:58.537954] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:00:58.580313] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-24T17:00:58.581144] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-24T17:00:58.604012] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-24T17:00:58.636355] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-24T17:00:58.679235] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:58.692958] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-24T17:00:59.004686] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T17:00:59.063245] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-24T17:00:59.139771] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:00:59.142422] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-24T17:00:59.167722] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T17:00:59.175863] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-24T17:01:00.351772] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T17:01:00.357922] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-24T17:01:00.735396] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-24T17:01:00.746532] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-24T17:01:00.778059] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T17:01:00.789134] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-24T17:01:01.045575] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T17:01:01.057038] [INFO ] [REMOTE ] ABEV: Full fetch complete (77199 records). [2025-09-24T17:01:01.057303] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-24T17:01:01.501264] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-24T17:01:01.501432] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-24T17:01:01.502207] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-24T17:01:01.502312] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-24T17:01:01.510899] [DEBUG] [LOCAL ] ABEV: Trimmed 77199 records to 53276 (keeping 200 days of data) [2025-09-24T17:01:01.524002] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T17:01:01.591017] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-24T17:01:01.846325] [DEBUG] [LOCAL ] ABEV: Primary data saved (53276 records). [2025-09-24T17:01:01.846485] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-24T17:01:01.847529] [INFO ] [MAIN ] Update Progress: 13/2373 symbols completed. ABEV took 20.5s. Estimated remaining: 2h 55m 59s. Rate: 13.4 symbols/min [2025-09-24T17:01:02.030243] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:02.055928] [DEBUG] [LOCAL ] ACA: Loaded 23871 existing records from primary storage. [2025-09-24T17:01:02.056092] [INFO ] [MAIN ] ACA: Loaded 23871 existing records. [2025-09-24T17:01:02.239928] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:01:02.240424] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-24T17:01:02.240491] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-24T17:01:02.242083] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-24T17:01:02.242198] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-24T17:01:02.443690] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:01:02.539563] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-24T17:01:02.702970] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:02.703496] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-24T17:01:02.740066] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T17:01:02.751265] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-24T17:01:02.948382] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T17:01:02.955908] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-24T17:01:03.887977] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T17:01:03.892953] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-24T17:01:04.449786] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T17:01:04.460242] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-24T17:01:04.545102] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T17:01:04.696720] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T17:01:04.816083] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-24T17:01:05.060156] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T17:01:05.616092] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-24T17:01:06.222426] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T17:01:06.391207] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T17:01:06.416036] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-24T17:01:06.865056] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T17:01:07.216101] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-24T17:01:08.016125] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-24T17:01:08.816071] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-24T17:01:12.885828] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (4.87 seconds). [2025-09-24T17:01:12.892912] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-24T17:01:13.255539] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (6.04 seconds). [2025-09-24T17:01:13.265478] [INFO ] [REMOTE ] ABM: Full fetch complete (44313 records). [2025-09-24T17:01:13.265693] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-24T17:01:13.266529] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:01:13.266727] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:01:13.266796] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:01:13.266871] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-24T17:01:13.266994] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-09-24T17:01:13.267047] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-09-24T17:01:13.267518] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-09-24T17:01:13.267982] [INFO ] [MAIN ] Update Progress: 14/2373 symbols completed. ABM took 21.5s. Estimated remaining: 3h 15m 25s. Rate: 12.1 symbols/min [2025-09-24T17:01:13.464153] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:13.505906] [DEBUG] [LOCAL ] ACCO: Loaded 37773 existing records from primary storage. [2025-09-24T17:01:13.506043] [INFO ] [MAIN ] ACCO: Loaded 37773 existing records. [2025-09-24T17:01:13.696738] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:01:13.697670] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-24T17:01:13.697879] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-24T17:01:13.699003] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-24T17:01:13.699063] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-24T17:01:14.059610] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (5.24 seconds). [2025-09-24T17:01:14.123286] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-24T17:01:14.128801] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:14.146106] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-24T17:01:14.153893] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (7.74 seconds). [2025-09-24T17:01:14.165896] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-24T17:01:14.449004] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T17:01:14.455191] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-24T17:01:15.525673] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T17:01:15.533027] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-24T17:01:15.732388] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T17:01:15.738019] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-24T17:01:16.015911] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T17:01:16.029405] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-24T17:01:16.063671] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:01:16.075418] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-24T17:01:16.992884] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:01:16.998346] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-24T17:01:17.018111] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T17:01:17.562434] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T17:01:17.616093] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-24T17:01:17.843919] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T17:01:18.020803] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T17:01:18.416078] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-24T17:01:19.216057] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-24T17:01:19.503927] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:01:19.677076] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T17:01:20.016095] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-24T17:01:20.816068] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-24T17:01:20.912932] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:01:21.085091] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T17:01:21.088952] [INFO ] [REMOTE ] ACA: Full fetch complete (34110 records). [2025-09-24T17:01:21.089084] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-24T17:01:21.089670] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:01:21.089760] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:01:21.089806] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:01:21.089874] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-24T17:01:21.089965] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-09-24T17:01:21.090035] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-09-24T17:01:21.090422] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-09-24T17:01:21.090522] [INFO ] [MAIN ] Update Progress: 15/2373 symbols completed. ACA took 19.2s. Estimated remaining: 3h 22m 49s. Rate: 11.6 symbols/min [2025-09-24T17:01:21.271330] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:21.271532] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-24T17:01:21.271572] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-24T17:01:21.271751] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-24T17:01:21.271802] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-24T17:01:21.271845] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-24T17:01:21.271880] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-24T17:01:21.640900] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-24T17:01:21.647486] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:22.416054] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-24T17:01:22.738392] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T17:01:23.024935] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T17:01:23.216084] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-24T17:01:24.016056] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-24T17:01:24.047729] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T17:01:24.806059] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T17:01:24.818205] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-24T17:01:25.232762] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:01:25.616140] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-24T17:01:26.416120] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-24T17:01:26.750829] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:01:26.760879] [INFO ] [REMOTE ] ABT: Full fetch complete (77195 records). [2025-09-24T17:01:26.761051] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-24T17:01:26.761912] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:01:26.762023] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:01:26.762068] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:01:26.762136] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-24T17:01:26.762206] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-24T17:01:26.762243] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-24T17:01:26.762282] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-09-24T17:01:26.762345] [INFO ] [MAIN ] Update Progress: 16/2373 symbols completed. ABT took 29.0s. Estimated remaining: 3h 23m 59s. Rate: 11.6 symbols/min [2025-09-24T17:01:26.939094] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:26.939417] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-09-24T17:01:26.939538] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-09-24T17:01:26.939730] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-24T17:01:26.939791] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-24T17:01:26.939851] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-24T17:01:26.939894] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-24T17:01:27.220411] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-24T17:01:27.335562] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T17:01:27.357441] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:27.995054] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T17:01:28.004667] [INFO ] [REMOTE ] ABR: Full fetch complete (75199 records). [2025-09-24T17:01:28.004847] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-24T17:01:28.021334] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-24T17:01:28.430196] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-24T17:01:28.430350] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-24T17:01:28.431359] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-24T17:01:28.431453] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-24T17:01:28.434304] [DEBUG] [LOCAL ] ABR: Trimmed 75199 records to 52104 (keeping 200 days of data) [2025-09-24T17:01:28.663795] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:01:28.767871] [DEBUG] [LOCAL ] ABR: Primary data saved (52104 records). [2025-09-24T17:01:28.768058] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-24T17:01:28.770044] [INFO ] [MAIN ] Update Progress: 17/2373 symbols completed. ABR took 31.3s. Estimated remaining: 3h 16m 32s. Rate: 12.0 symbols/min [2025-09-24T17:01:28.827046] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-24T17:01:28.946237] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:29.022401] [DEBUG] [LOCAL ] ACI: Loaded 53272 existing records from primary storage. [2025-09-24T17:01:29.022620] [INFO ] [MAIN ] ACI: Loaded 53272 existing records. [2025-09-24T17:01:29.202767] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:01:29.203091] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-24T17:01:29.203144] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-24T17:01:29.204584] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-24T17:01:29.204667] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-24T17:01:29.564299] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:29.616039] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-24T17:01:30.363586] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:01:30.416044] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-24T17:01:30.517111] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-24T17:01:31.216039] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-24T17:01:31.459091] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:01:31.744170] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T17:01:32.016082] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-24T17:01:32.373365] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T17:01:32.816106] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-24T17:01:33.294800] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T17:01:33.616115] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-24T17:01:34.255222] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:01:34.416081] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-24T17:01:35.216143] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-24T17:01:35.907501] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-24T17:01:35.952746] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:01:36.016054] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-24T17:01:36.689225] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T17:01:36.816058] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-24T17:01:37.353610] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T17:01:37.616078] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-24T17:01:37.733101] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T17:01:38.416141] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-24T17:01:39.182888] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T17:01:39.188705] [INFO ] [REMOTE ] ACCO: Full fetch complete (53938 records). [2025-09-24T17:01:39.188825] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-24T17:01:39.190612] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:01:39.190754] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:01:39.190850] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:01:39.190947] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-24T17:01:39.191030] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-24T17:01:39.191071] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-09-24T17:01:39.191494] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-09-24T17:01:39.194221] [INFO ] [MAIN ] Update Progress: 18/2373 symbols completed. ACCO took 25.9s. Estimated remaining: 3h 28m 16s. Rate: 11.3 symbols/min [2025-09-24T17:01:39.226367] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-24T17:01:39.373160] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:39.422807] [DEBUG] [LOCAL ] ACM: Loaded 43154 existing records from primary storage. [2025-09-24T17:01:39.423019] [INFO ] [MAIN ] ACM: Loaded 43154 existing records. [2025-09-24T17:01:39.606949] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:01:39.607297] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-24T17:01:39.607355] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-24T17:01:39.608486] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-24T17:01:39.608548] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-24T17:01:39.974377] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:40.022416] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-24T17:01:40.027927] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T17:01:40.250352] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:01:40.816069] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-24T17:01:41.616108] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-24T17:01:42.416154] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-24T17:01:42.442212] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T17:01:42.581707] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-24T17:01:43.216051] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-24T17:01:43.367840] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T17:01:43.487724] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T17:01:44.016117] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-24T17:01:44.816081] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-24T17:01:45.616117] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-24T17:01:45.688330] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T17:01:45.846478] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-24T17:01:46.416061] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-24T17:01:46.607133] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T17:01:46.744475] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T17:01:47.216128] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-24T17:01:48.016132] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-24T17:01:48.700362] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T17:01:48.816099] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-24T17:01:48.891635] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T17:01:49.601947] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T17:01:49.616017] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-24T17:01:50.333889] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T17:01:50.416058] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-24T17:01:51.216069] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-24T17:01:51.375612] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T17:01:52.016085] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-24T17:01:52.404579] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T17:01:52.816046] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-24T17:01:53.207766] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T17:01:53.212636] [INFO ] [REMOTE ] ACEL: Full fetch complete (38952 records). [2025-09-24T17:01:53.212818] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-24T17:01:53.619365] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-24T17:01:53.630320] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-24T17:01:53.631520] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-24T17:01:53.632082] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-24T17:01:53.632248] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-24T17:01:53.633367] [DEBUG] [LOCAL ] ACEL: Trimmed 38952 records to 27124 (keeping 200 days of data) [2025-09-24T17:01:53.835593] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-24T17:01:53.856948] [DEBUG] [LOCAL ] ACEL: Primary data saved (27124 records). [2025-09-24T17:01:53.857099] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-24T17:01:53.857184] [INFO ] [MAIN ] Update Progress: 19/2373 symbols completed. ACEL took 32.8s. Estimated remaining: 3h 47m 30s. Rate: 10.3 symbols/min [2025-09-24T17:01:54.060544] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:01:54.137569] [DEBUG] [LOCAL ] ACN: Loaded 53424 existing records from primary storage. [2025-09-24T17:01:54.137787] [INFO ] [MAIN ] ACN: Loaded 53424 existing records. [2025-09-24T17:01:54.334978] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:01:54.335288] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-24T17:01:54.335367] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-24T17:01:54.337147] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-24T17:01:54.337238] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-24T17:01:54.423809] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-24T17:01:54.716476] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:01:54.753078] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T17:01:55.216154] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-24T17:01:55.378084] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T17:01:56.016114] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-24T17:01:56.677151] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-24T17:01:56.816050] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-24T17:01:57.181888] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:01:57.248538] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T17:01:57.616093] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-24T17:01:58.416103] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-24T17:01:59.216061] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-24T17:01:59.485987] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-24T17:01:59.550906] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T17:01:59.962884] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:01:59.972822] [INFO ] [REMOTE ] ACI: Full fetch complete (77046 records). [2025-09-24T17:01:59.973207] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-24T17:02:00.022396] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-24T17:02:00.391286] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-24T17:02:00.391397] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-24T17:02:00.392935] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-24T17:02:00.393030] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-24T17:02:00.395089] [DEBUG] [LOCAL ] ACI: Trimmed 77046 records to 53269 (keeping 200 days of data) [2025-09-24T17:02:00.748782] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:02:00.773087] [DEBUG] [LOCAL ] ACI: Primary data saved (53269 records). [2025-09-24T17:02:00.773229] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-24T17:02:00.776104] [INFO ] [MAIN ] Update Progress: 20/2373 symbols completed. ACI took 32.0s. Estimated remaining: 3h 49m 36s. Rate: 10.2 symbols/min [2025-09-24T17:02:00.821191] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-24T17:02:00.970498] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:00.970749] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-09-24T17:02:00.970808] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-09-24T17:02:00.971060] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-24T17:02:00.971126] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-24T17:02:00.971208] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-24T17:02:00.971286] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-24T17:02:01.414376] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:01.616096] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-24T17:02:02.409718] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T17:02:02.420753] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-24T17:02:02.860487] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-24T17:02:03.216099] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-24T17:02:03.587452] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T17:02:03.697826] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T17:02:04.016271] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-24T17:02:04.816169] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-24T17:02:04.860539] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T17:02:05.508705] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T17:02:05.616077] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-24T17:02:06.416082] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-24T17:02:06.925200] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T17:02:07.216073] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-24T17:02:07.652489] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-09-24T17:02:07.667630] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-24T17:02:07.667934] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-24T17:02:08.017093] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-24T17:02:08.120577] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-24T17:02:08.120939] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-24T17:02:08.122018] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-24T17:02:08.122142] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-24T17:02:08.126918] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-24T17:02:08.288693] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:02:08.380988] [INFO ] [REMOTE ] ACM: Full fetch complete (62627 records). [2025-09-24T17:02:08.402812] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-24T17:02:08.610204] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T17:02:08.804546] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-24T17:02:08.828285] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-24T17:02:08.816320] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-24T17:02:08.842408] [INFO ] [MAIN ] Update Progress: 21/2373 symbols completed. ACHR took 42.1s. Estimated remaining: 3h 53m 38s. Rate: 10.1 symbols/min [2025-09-24T17:02:09.124451] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-24T17:02:09.134891] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-24T17:02:09.156414] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-24T17:02:09.171394] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-24T17:02:09.191232] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:09.192804] [DEBUG] [LOCAL ] ACM: Trimmed 62627 records to 43152 (keeping 200 days of data) [2025-09-24T17:02:09.202092] [DEBUG] [LOCAL ] ACR: Loaded 6346 existing records from primary storage. [2025-09-24T17:02:09.202244] [INFO ] [MAIN ] ACR: Loaded 6346 existing records. [2025-09-24T17:02:09.493058] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:09.495274] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-24T17:02:09.495604] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-24T17:02:09.496855] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-24T17:02:09.497203] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-24T17:02:09.966044] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:09.967446] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-24T17:02:10.133802] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T17:02:10.189763] [DEBUG] [LOCAL ] ACM: Primary data saved (43152 records). [2025-09-24T17:02:10.189903] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-24T17:02:10.191122] [INFO ] [MAIN ] Update Progress: 22/2373 symbols completed. ACM took 31.0s. Estimated remaining: 3h 45m 19s. Rate: 10.4 symbols/min [2025-09-24T17:02:10.367121] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:10.390200] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T17:02:10.417066] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-24T17:02:10.432613] [DEBUG] [LOCAL ] ACRE: Loaded 33501 existing records from primary storage. [2025-09-24T17:02:10.432827] [INFO ] [MAIN ] ACRE: Loaded 33501 existing records. [2025-09-24T17:02:10.629686] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:10.629976] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-24T17:02:10.630026] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-24T17:02:10.630946] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-24T17:02:10.631021] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-24T17:02:10.869915] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T17:02:11.015708] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:11.216116] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-24T17:02:11.722620] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T17:02:12.016130] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-24T17:02:12.624576] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T17:02:12.744339] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T17:02:12.816043] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-24T17:02:13.616133] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-24T17:02:14.165590] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T17:02:14.346789] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:02:14.416041] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-24T17:02:15.216143] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-24T17:02:15.901419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T17:02:16.016100] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-24T17:02:16.816089] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-24T17:02:16.831151] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T17:02:17.378767] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T17:02:17.616081] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-24T17:02:18.082026] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:02:18.416122] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-24T17:02:18.433619] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T17:02:19.216086] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-24T17:02:20.016136] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-24T17:02:20.156090] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T17:02:20.204923] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T17:02:20.674140] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T17:02:20.816062] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-24T17:02:21.616091] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-24T17:02:21.628334] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T17:02:22.416094] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-24T17:02:23.163114] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T17:02:23.216113] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-24T17:02:23.702258] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T17:02:23.868347] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T17:02:24.016100] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-24T17:02:24.578354] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T17:02:24.816075] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-24T17:02:25.616098] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-24T17:02:26.174809] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T17:02:26.182964] [INFO ] [REMOTE ] ACP: Full fetch complete (47679 records). [2025-09-24T17:02:26.183224] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-24T17:02:26.421266] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-24T17:02:26.579173] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-24T17:02:26.579267] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-24T17:02:26.579772] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-24T17:02:26.579837] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-24T17:02:26.581144] [DEBUG] [LOCAL ] ACP: Trimmed 47679 records to 31136 (keeping 200 days of data) [2025-09-24T17:02:26.793038] [DEBUG] [LOCAL ] ACP: Primary data saved (31136 records). [2025-09-24T17:02:26.793186] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-24T17:02:26.793263] [INFO ] [MAIN ] Update Progress: 23/2373 symbols completed. ACP took 26.0s. Estimated remaining: 4h 3m 42s. Rate: 9.6 symbols/min [2025-09-24T17:02:26.971495] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:26.981037] [DEBUG] [LOCAL ] ACV: Loaded 6930 existing records from primary storage. [2025-09-24T17:02:26.981120] [INFO ] [MAIN ] ACV: Loaded 6930 existing records. [2025-09-24T17:02:27.168337] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:27.169029] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-24T17:02:27.169093] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-24T17:02:27.177271] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-24T17:02:27.190071] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-24T17:02:27.222153] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-24T17:02:27.223575] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:02:27.566249] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:28.016069] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-24T17:02:28.044062] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T17:02:28.045584] [INFO ] [REMOTE ] ACR: Full fetch complete (8565 records). [2025-09-24T17:02:28.045695] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-24T17:02:28.426806] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-24T17:02:28.426954] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-24T17:02:28.427180] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-24T17:02:28.427283] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-24T17:02:28.428159] [DEBUG] [LOCAL ] ACR: Trimmed 8565 records to 6297 (keeping 200 days of data) [2025-09-24T17:02:28.467542] [DEBUG] [LOCAL ] ACR: Primary data saved (6297 records). [2025-09-24T17:02:28.483576] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-24T17:02:28.494203] [INFO ] [MAIN ] Update Progress: 24/2373 symbols completed. ACR took 19.6s. Estimated remaining: 3h 56m 14s. Rate: 9.9 symbols/min [2025-09-24T17:02:28.496127] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-24T17:02:28.693998] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:28.751577] [DEBUG] [LOCAL ] ACVA: Loaded 49359 existing records from primary storage. [2025-09-24T17:02:28.751820] [INFO ] [MAIN ] ACVA: Loaded 49359 existing records. [2025-09-24T17:02:28.821300] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-24T17:02:28.934724] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:28.935001] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-24T17:02:28.935050] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-24T17:02:28.936198] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-24T17:02:28.936258] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-24T17:02:29.292798] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:29.379395] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:02:29.616108] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-24T17:02:30.416109] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-24T17:02:30.797207] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T17:02:31.216059] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-24T17:02:31.437756] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T17:02:31.471993] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T17:02:31.989596] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T17:02:32.016091] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-24T17:02:32.690809] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T17:02:32.816117] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-24T17:02:33.467701] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T17:02:33.616103] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-24T17:02:34.397861] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T17:02:34.416027] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-24T17:02:35.194406] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T17:02:35.216080] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-24T17:02:35.916332] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T17:02:36.016142] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-24T17:02:36.816108] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-24T17:02:37.097049] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T17:02:37.369371] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T17:02:37.616150] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-24T17:02:38.231501] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T17:02:38.416116] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-24T17:02:39.216134] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-24T17:02:39.943378] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:02:40.016123] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-24T17:02:40.816159] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-24T17:02:41.197037] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-24T17:02:41.616097] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-24T17:02:41.967872] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T17:02:42.118805] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T17:02:42.228060] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T17:02:42.416102] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-24T17:02:43.216061] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-24T17:02:43.286755] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T17:02:43.288838] [INFO ] [REMOTE ] ACV: Full fetch complete (9720 records). [2025-09-24T17:02:43.288919] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-24T17:02:43.728678] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-24T17:02:43.728770] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-24T17:02:43.728971] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-24T17:02:43.729012] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-24T17:02:43.729459] [DEBUG] [LOCAL ] ACV: Trimmed 9720 records to 6946 (keeping 200 days of data) [2025-09-24T17:02:43.773367] [DEBUG] [LOCAL ] ACV: Primary data saved (6946 records). [2025-09-24T17:02:43.773493] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-24T17:02:43.773578] [INFO ] [MAIN ] Update Progress: 25/2373 symbols completed. ACV took 17.0s. Estimated remaining: 4h 10m 36s. Rate: 9.4 symbols/min [2025-09-24T17:02:43.960064] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:43.960283] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-24T17:02:43.960336] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-24T17:02:43.960485] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-24T17:02:43.960529] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-24T17:02:43.960573] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-24T17:02:43.960608] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-24T17:02:44.028812] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-24T17:02:44.352001] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:44.366404] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T17:02:44.372063] [INFO ] [REMOTE ] ACRE: Full fetch complete (50551 records). [2025-09-24T17:02:44.372162] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-24T17:02:44.778356] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-24T17:02:44.778457] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-24T17:02:44.779045] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-24T17:02:44.779115] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-24T17:02:44.780584] [DEBUG] [LOCAL ] ACRE: Trimmed 50551 records to 33608 (keeping 200 days of data) [2025-09-24T17:02:44.842730] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-24T17:02:45.003703] [DEBUG] [LOCAL ] ACRE: Primary data saved (33608 records). [2025-09-24T17:02:45.003928] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-24T17:02:45.005101] [INFO ] [MAIN ] Update Progress: 26/2373 symbols completed. ACRE took 34.8s. Estimated remaining: 4h 2m 43s. Rate: 9.7 symbols/min [2025-09-24T17:02:45.156812] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:45.180202] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-24T17:02:45.208676] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:45.263586] [DEBUG] [LOCAL ] ADC: Loaded 46374 existing records from primary storage. [2025-09-24T17:02:45.263799] [INFO ] [MAIN ] ADC: Loaded 46374 existing records. [2025-09-24T17:02:45.459079] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:45.459364] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-24T17:02:45.459496] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-24T17:02:45.460850] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-24T17:02:45.460913] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-24T17:02:45.621762] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-24T17:02:45.841124] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:45.891969] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T17:02:46.053290] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:46.053602] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-24T17:02:46.416090] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-24T17:02:46.609768] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:46.610102] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-24T17:02:47.216235] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-24T17:02:48.016113] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-24T17:02:48.490461] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T17:02:48.816079] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-24T17:02:49.616148] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-24T17:02:49.883798] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:49.884173] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-24T17:02:50.213362] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T17:02:50.345874] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-24T17:02:50.358395] [INFO ] [REMOTE ] ACN: Full fetch complete (77100 records). [2025-09-24T17:02:50.358562] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-24T17:02:50.421196] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-24T17:02:50.759565] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-24T17:02:50.759682] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-24T17:02:50.760748] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-24T17:02:50.760839] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-24T17:02:50.762457] [DEBUG] [LOCAL ] ACN: Trimmed 77100 records to 53424 (keeping 200 days of data) [2025-09-24T17:02:51.113767] [DEBUG] [LOCAL ] ACN: Primary data saved (53424 records). [2025-09-24T17:02:51.113931] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-24T17:02:51.114028] [INFO ] [MAIN ] Update Progress: 27/2373 symbols completed. ACN took 57.3s. Estimated remaining: 4h 2m 28s. Rate: 9.7 symbols/min [2025-09-24T17:02:51.221806] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-24T17:02:51.302841] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:02:51.339557] [DEBUG] [LOCAL ] ADCT: Loaded 33951 existing records from primary storage. [2025-09-24T17:02:51.339732] [INFO ] [MAIN ] ADCT: Loaded 33951 existing records. [2025-09-24T17:02:51.536450] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:02:51.536788] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-24T17:02:51.536844] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-24T17:02:51.537573] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-24T17:02:51.537636] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-24T17:02:51.939341] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:02:51.962768] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T17:02:52.016034] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-24T17:02:52.816081] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-24T17:02:53.032815] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:53.033113] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-24T17:02:53.163697] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T17:02:53.598903] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T17:02:53.616031] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-24T17:02:54.416084] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-24T17:02:55.216077] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-24T17:02:55.257994] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T17:02:55.410938] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:55.411307] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-24T17:02:55.940204] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T17:02:56.016057] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-24T17:02:56.239362] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:56.239712] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-24T17:02:56.816082] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-24T17:02:57.616090] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-24T17:02:58.283226] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T17:02:58.416108] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-24T17:02:59.221270] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-24T17:02:59.241345] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T17:02:59.451743] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:02:59.452076] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-24T17:02:59.652742] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T17:03:00.016089] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-24T17:03:00.816092] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-24T17:03:01.554930] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T17:03:01.616048] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-24T17:03:02.416073] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-24T17:03:02.591324] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T17:03:03.216115] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-24T17:03:04.016144] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-24T17:03:04.426754] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-24T17:03:04.435541] [INFO ] [REMOTE ] ACVA: Full fetch complete (70182 records). [2025-09-24T17:03:04.435709] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-24T17:03:04.832727] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-24T17:03:04.832824] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-24T17:03:04.833479] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-24T17:03:04.833521] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-24T17:03:04.835064] [DEBUG] [LOCAL ] ACVA: Trimmed 70182 records to 49322 (keeping 200 days of data) [2025-09-24T17:03:04.956160] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T17:03:04.965164] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-24T17:03:05.175031] [DEBUG] [LOCAL ] ACVA: Primary data saved (49322 records). [2025-09-24T17:03:05.175188] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-24T17:03:05.176639] [INFO ] [MAIN ] Update Progress: 28/2373 symbols completed. ACVA took 36.7s. Estimated remaining: 4h 13m 20s. Rate: 9.3 symbols/min [2025-09-24T17:03:05.352395] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:05.367906] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-09-24T17:03:05.436583] [DEBUG] [LOCAL ] ADM: Loaded 53397 existing records from primary storage. [2025-09-24T17:03:05.436797] [INFO ] [MAIN ] ADM: Loaded 53397 existing records. [2025-09-24T17:03:05.617078] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-24T17:03:05.641619] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:03:05.641900] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-24T17:03:05.641953] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-24T17:03:05.643350] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-24T17:03:05.643439] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-24T17:03:06.041514] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:06.068483] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T17:03:06.416151] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-24T17:03:06.478288] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:03:06.811283] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T17:03:06.815536] [INFO ] [REMOTE ] AD: Full fetch complete (5930 records). [2025-09-24T17:03:06.815614] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-24T17:03:06.816055] [FATAL] [VALIDATOR ] AD: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:03:06.816141] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:03:06.816190] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:03:06.816230] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-24T17:03:06.816289] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-24T17:03:06.816327] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-24T17:03:06.816368] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-24T17:03:06.816470] [INFO ] [MAIN ] Update Progress: 29/2373 symbols completed. AD took 23.0s. Estimated remaining: 4h 6m 42s. Rate: 9.5 symbols/min [2025-09-24T17:03:06.994369] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:06.994579] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-09-24T17:03:06.994635] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-09-24T17:03:06.994802] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-24T17:03:06.994846] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-24T17:03:06.994888] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-24T17:03:06.994922] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-24T17:03:07.221369] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-24T17:03:07.364030] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:08.016131] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-24T17:03:08.235909] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T17:03:08.267840] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T17:03:08.816073] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-24T17:03:09.342718] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T17:03:09.616148] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-24T17:03:10.175693] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:03:10.416146] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-24T17:03:11.216083] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-24T17:03:11.538532] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-24T17:03:12.016057] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-24T17:03:12.265274] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:03:12.815035] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T17:03:12.823611] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-24T17:03:13.305113] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T17:03:13.616087] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-24T17:03:14.416124] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-24T17:03:14.658190] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T17:03:15.216065] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-24T17:03:15.378489] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T17:03:16.016175] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-24T17:03:16.563699] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T17:03:16.816070] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-24T17:03:17.616105] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-24T17:03:17.847618] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-24T17:03:17.856111] [INFO ] [REMOTE ] ADC: Full fetch complete (65635 records). [2025-09-24T17:03:17.856284] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-24T17:03:17.857185] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:03:17.857288] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:03:17.857353] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:03:17.857425] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-24T17:03:17.857494] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-24T17:03:17.857533] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-09-24T17:03:17.858259] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-09-24T17:03:17.859385] [INFO ] [MAIN ] Update Progress: 30/2373 symbols completed. ADC took 32.9s. Estimated remaining: 4h 12m 45s. Rate: 9.3 symbols/min [2025-09-24T17:03:18.039923] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:18.040121] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-09-24T17:03:18.040160] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-09-24T17:03:18.040320] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-24T17:03:18.040388] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-24T17:03:18.040453] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-09-24T17:03:18.040516] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-24T17:03:18.500818] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T17:03:18.499335] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:18.509109] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-24T17:03:18.564924] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-24T17:03:19.090553] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:03:19.216113] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-24T17:03:20.016134] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-24T17:03:20.223896] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T17:03:20.816128] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-24T17:03:20.902390] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T17:03:21.616096] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-24T17:03:21.701868] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T17:03:22.416139] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-24T17:03:22.488417] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T17:03:23.216057] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-24T17:03:23.257958] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T17:03:24.022749] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-24T17:03:24.044526] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T17:03:24.324899] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T17:03:24.333846] [INFO ] [REMOTE ] ADCT: Full fetch complete (51646 records). [2025-09-24T17:03:24.334043] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-24T17:03:24.740225] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-24T17:03:24.740306] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-24T17:03:24.740821] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-24T17:03:24.740884] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-24T17:03:24.741975] [DEBUG] [LOCAL ] ADCT: Trimmed 51646 records to 34069 (keeping 200 days of data) [2025-09-24T17:03:24.822230] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-24T17:03:24.937335] [DEBUG] [LOCAL ] ADCT: Primary data saved (34069 records). [2025-09-24T17:03:24.937472] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-24T17:03:24.937556] [INFO ] [MAIN ] Update Progress: 31/2373 symbols completed. ADCT took 33.8s. Estimated remaining: 4h 13m 25s. Rate: 9.2 symbols/min [2025-09-24T17:03:25.110836] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:25.140356] [DEBUG] [LOCAL ] ADX: Loaded 27857 existing records from primary storage. [2025-09-24T17:03:25.140490] [INFO ] [MAIN ] ADX: Loaded 27857 existing records. [2025-09-24T17:03:25.322870] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:03:25.323129] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-24T17:03:25.323178] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-24T17:03:25.324046] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-24T17:03:25.324110] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-24T17:03:25.621476] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-24T17:03:25.710684] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:25.738732] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T17:03:26.416097] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-24T17:03:26.521904] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T17:03:27.216032] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-24T17:03:27.351051] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T17:03:27.635241] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:03:28.016281] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-24T17:03:28.816048] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-24T17:03:28.982479] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T17:03:29.527269] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T17:03:29.616089] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-24T17:03:30.416132] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-24T17:03:30.457707] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T17:03:31.216086] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-24T17:03:31.413823] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T17:03:32.016071] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-24T17:03:32.196073] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:03:32.766048] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T17:03:32.816084] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-24T17:03:33.566901] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T17:03:33.616054] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-24T17:03:34.416053] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-24T17:03:34.627680] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T17:03:34.691961] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T17:03:35.216112] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-24T17:03:35.992754] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T17:03:36.016038] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-24T17:03:36.527372] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T17:03:36.816074] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-24T17:03:37.616085] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-24T17:03:37.991858] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T17:03:38.182411] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T17:03:38.192126] [INFO ] [REMOTE ] ADM: Full fetch complete (77218 records). [2025-09-24T17:03:38.192293] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-24T17:03:38.421206] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-24T17:03:38.652686] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-24T17:03:38.652797] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-24T17:03:38.653602] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-24T17:03:38.653719] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-24T17:03:38.655510] [DEBUG] [LOCAL ] ADM: Trimmed 77218 records to 53395 (keeping 200 days of data) [2025-09-24T17:03:39.015349] [DEBUG] [LOCAL ] ADM: Primary data saved (53395 records). [2025-09-24T17:03:39.015517] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-24T17:03:39.016970] [INFO ] [MAIN ] Update Progress: 32/2373 symbols completed. ADM took 33.8s. Estimated remaining: 4h 22m 33s. Rate: 8.9 symbols/min [2025-09-24T17:03:39.220135] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-24T17:03:39.225237] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:39.225991] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-09-24T17:03:39.226135] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-09-24T17:03:39.226540] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-24T17:03:39.226717] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-24T17:03:39.226789] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-24T17:03:39.226828] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-24T17:03:39.629157] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T17:03:39.706151] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:39.956948] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T17:03:39.966122] [INFO ] [REMOTE ] ADNT: Full fetch complete (68089 records). [2025-09-24T17:03:39.966254] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-24T17:03:40.022288] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-24T17:03:40.368963] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-24T17:03:40.369066] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-24T17:03:40.369803] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-24T17:03:40.369876] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-24T17:03:40.371793] [DEBUG] [LOCAL ] ADNT: Trimmed 68089 records to 47461 (keeping 200 days of data) [2025-09-24T17:03:40.656126] [DEBUG] [LOCAL ] ADNT: Primary data saved (47461 records). [2025-09-24T17:03:40.656285] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-24T17:03:40.656367] [INFO ] [MAIN ] Update Progress: 33/2373 symbols completed. ADNT took 33.8s. Estimated remaining: 4h 16m 26s. Rate: 9.1 symbols/min [2025-09-24T17:03:40.818221] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-24T17:03:40.841214] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:40.851513] [DEBUG] [LOCAL ] AEFC: Loaded 8595 existing records from primary storage. [2025-09-24T17:03:40.852164] [INFO ] [MAIN ] AEFC: Loaded 8595 existing records. [2025-09-24T17:03:41.039197] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:03:41.039820] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-24T17:03:41.039878] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-24T17:03:41.040311] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-24T17:03:41.040372] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-24T17:03:41.344050] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T17:03:41.432431] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:41.616095] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-24T17:03:41.722776] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T17:03:42.416040] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-24T17:03:42.616875] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T17:03:42.823194] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T17:03:43.216080] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-24T17:03:44.021187] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-24T17:03:44.033282] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T17:03:44.520729] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T17:03:44.816111] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-24T17:03:44.980430] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T17:03:45.616147] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-24T17:03:46.073039] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T17:03:46.416092] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-24T17:03:47.216078] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-24T17:03:47.375322] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T17:03:47.435597] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:03:48.016129] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-24T17:03:48.632877] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T17:03:48.816086] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-24T17:03:49.131115] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T17:03:49.140900] [INFO ] [REMOTE ] ADT: Full fetch complete (77204 records). [2025-09-24T17:03:49.141037] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-24T17:03:49.545851] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-24T17:03:49.545968] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-24T17:03:49.546736] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-24T17:03:49.546803] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-24T17:03:49.548394] [DEBUG] [LOCAL ] ADT: Trimmed 77204 records to 53477 (keeping 200 days of data) [2025-09-24T17:03:49.638432] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-24T17:03:49.811357] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T17:03:49.912531] [DEBUG] [LOCAL ] ADT: Primary data saved (53477 records). [2025-09-24T17:03:49.912728] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-24T17:03:49.912822] [INFO ] [MAIN ] Update Progress: 34/2373 symbols completed. ADT took 32.1s. Estimated remaining: 4h 19m 23s. Rate: 9.0 symbols/min [2025-09-24T17:03:50.082789] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:03:50.082970] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-09-24T17:03:50.083009] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-09-24T17:03:50.083156] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-24T17:03:50.083199] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-24T17:03:50.083240] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-24T17:03:50.083273] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-24T17:03:50.398374] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T17:03:50.417826] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-24T17:03:50.488867] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:03:51.216113] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-24T17:03:52.016151] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-24T17:03:52.401863] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T17:03:52.718021] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T17:03:52.816084] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-24T17:03:52.979336] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T17:03:53.616090] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-24T17:03:54.416059] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-24T17:03:54.604271] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T17:03:54.971355] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:03:55.216068] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-24T17:03:55.289379] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T17:03:56.016109] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-24T17:03:56.615899] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T17:03:56.816064] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-24T17:03:56.868003] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T17:03:57.616091] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-24T17:03:58.299206] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T17:03:58.416089] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-24T17:03:59.084811] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-24T17:03:59.216084] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-24T17:03:59.265387] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T17:03:59.834918] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T17:04:00.016082] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-24T17:04:00.731859] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T17:04:00.733682] [INFO ] [REMOTE ] AEFC: Full fetch complete (12379 records). [2025-09-24T17:04:00.733786] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-24T17:04:00.821316] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-24T17:04:01.125309] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-24T17:04:01.125399] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-24T17:04:01.125637] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-24T17:04:01.125738] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-24T17:04:01.126230] [DEBUG] [LOCAL ] AEFC: Trimmed 12379 records to 8584 (keeping 200 days of data) [2025-09-24T17:04:01.178331] [DEBUG] [LOCAL ] AEFC: Primary data saved (8584 records). [2025-09-24T17:04:01.178477] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-24T17:04:01.178620] [INFO ] [MAIN ] Update Progress: 35/2373 symbols completed. AEFC took 20.5s. Estimated remaining: 4h 24m 25s. Rate: 8.8 symbols/min [2025-09-24T17:04:01.358691] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:01.428292] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-24T17:04:01.428528] [INFO ] [MAIN ] AEM: Loaded 53465 existing records. [2025-09-24T17:04:01.621241] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-24T17:04:01.658566] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:01.659043] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-24T17:04:01.659125] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-24T17:04:01.660708] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-24T17:04:01.660783] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-24T17:04:02.060448] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:02.416061] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-24T17:04:02.496382] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T17:04:03.216073] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-24T17:04:03.515344] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:04:03.922122] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T17:04:04.016089] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-24T17:04:04.821204] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-24T17:04:04.843961] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T17:04:05.616146] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-24T17:04:05.847286] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T17:04:05.894866] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T17:04:05.905056] [INFO ] [REMOTE ] ADX: Full fetch complete (42116 records). [2025-09-24T17:04:05.905229] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-24T17:04:06.309345] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-24T17:04:06.309460] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-24T17:04:06.310260] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-24T17:04:06.310361] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-24T17:04:06.311806] [DEBUG] [LOCAL ] ADX: Trimmed 42116 records to 27783 (keeping 200 days of data) [2025-09-24T17:04:06.416069] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-24T17:04:06.508119] [DEBUG] [LOCAL ] ADX: Primary data saved (27783 records). [2025-09-24T17:04:06.508272] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-24T17:04:06.508413] [INFO ] [MAIN ] Update Progress: 36/2373 symbols completed. ADX took 41.6s. Estimated remaining: 4h 22m 44s. Rate: 8.9 symbols/min [2025-09-24T17:04:06.687880] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:06.749451] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-09-24T17:04:06.749592] [INFO ] [MAIN ] AEO: Loaded 53557 existing records. [2025-09-24T17:04:06.926256] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:06.926483] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-24T17:04:06.926530] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-24T17:04:06.928791] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-24T17:04:06.928864] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-24T17:04:07.218953] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-24T17:04:07.293165] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:07.450366] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T17:04:08.016064] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-24T17:04:08.189241] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T17:04:08.816148] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-24T17:04:09.009926] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:04:09.616115] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-24T17:04:09.850983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:04:10.416097] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-24T17:04:10.615442] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T17:04:10.624279] [INFO ] [REMOTE ] AEE: Full fetch complete (72520 records). [2025-09-24T17:04:10.624410] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-24T17:04:11.021202] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-24T17:04:11.021301] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-24T17:04:11.023288] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-24T17:04:11.023354] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-24T17:04:11.024797] [DEBUG] [LOCAL ] AEE: Trimmed 72520 records to 50147 (keeping 200 days of data) [2025-09-24T17:04:11.227821] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-24T17:04:11.424879] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:04:11.528523] [DEBUG] [LOCAL ] AEE: Primary data saved (50147 records). [2025-09-24T17:04:11.528702] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-24T17:04:11.528796] [INFO ] [MAIN ] Update Progress: 37/2373 symbols completed. AEE took 32.5s. Estimated remaining: 4h 20m 48s. Rate: 9.0 symbols/min [2025-09-24T17:04:12.016046] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-24T17:04:12.052420] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T17:04:12.816134] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-24T17:04:13.242634] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T17:04:13.616119] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-24T17:04:14.198094] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-24T17:04:14.416108] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-24T17:04:14.721919] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-24T17:04:15.216056] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-24T17:04:15.420747] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T17:04:16.016108] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-24T17:04:16.183629] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T17:04:16.816148] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-24T17:04:17.147123] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T17:04:17.371808] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:04:17.616074] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-24T17:04:18.416061] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-24T17:04:18.680365] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T17:04:19.077977] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T17:04:19.216099] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-24T17:04:20.016147] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-24T17:04:20.219538] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T17:04:20.228903] [INFO ] [REMOTE ] AEG: Full fetch complete (70274 records). [2025-09-24T17:04:20.229075] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-24T17:04:20.632047] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-24T17:04:20.632196] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-24T17:04:20.632896] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-24T17:04:20.632961] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-24T17:04:20.636146] [DEBUG] [LOCAL ] AEG: Trimmed 70274 records to 49615 (keeping 200 days of data) [2025-09-24T17:04:20.946714] [DEBUG] [LOCAL ] AEG: Primary data saved (49615 records). [2025-09-24T17:04:20.946898] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-24T17:04:20.947030] [INFO ] [MAIN ] Update Progress: 38/2373 symbols completed. AEG took 31.0s. Estimated remaining: 4h 23m 28s. Rate: 8.9 symbols/min [2025-09-24T17:04:21.049537] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T17:04:21.062211] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-24T17:04:21.984513] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-24T17:04:21.997177] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-24T17:04:22.961329] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:04:22.973566] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-24T17:04:23.742618] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T17:04:23.758369] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-24T17:04:25.151307] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-24T17:04:25.163980] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-24T17:04:25.490364] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T17:04:25.499775] [INFO ] [REMOTE ] AEM: Full fetch complete (76743 records). [2025-09-24T17:04:25.499939] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-24T17:04:25.501076] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:04:25.501211] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:04:25.501257] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:04:25.501297] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-24T17:04:25.501361] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-24T17:04:25.501446] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-24T17:04:25.502222] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-09-24T17:04:25.502328] [INFO ] [MAIN ] Update Progress: 39/2373 symbols completed. AEM took 24.3s. Estimated remaining: 4h 21m 9s. Rate: 8.9 symbols/min [2025-09-24T17:04:27.260618] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-24T17:04:27.272429] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-24T17:04:29.418395] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-24T17:04:29.436779] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-24T17:04:31.367559] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:04:31.377708] [INFO ] [REMOTE ] AEO: Full fetch complete (77055 records). [2025-09-24T17:04:31.377877] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-24T17:04:31.378741] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:04:31.378838] [FATAL] [MAIN ] AEO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:04:31.378883] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:04:31.378925] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-24T17:04:31.378986] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-09-24T17:04:31.379067] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-09-24T17:04:31.379524] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-09-24T17:04:31.379627] [INFO ] [MAIN ] Update Progress: 40/2373 symbols completed. AEO took 24.9s. Estimated remaining: 4h 20m 14s. Rate: 9.0 symbols/min [2025-09-24T17:04:31.994525] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:32.088692] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:32.089488] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:32.108760] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:32.135474] [DEBUG] [LOCAL ] AFB: Loaded 11406 existing records from primary storage. [2025-09-24T17:04:32.135723] [INFO ] [MAIN ] AFB: Loaded 11406 existing records. [2025-09-24T17:04:32.391779] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:32.406310] [DEBUG] [LOCAL ] AES: Loaded 53672 existing records from primary storage. [2025-09-24T17:04:32.406742] [INFO ] [MAIN ] AES: Loaded 53672 existing records. [2025-09-24T17:04:32.418325] [DEBUG] [LOCAL ] AER: Loaded 48687 existing records from primary storage. [2025-09-24T17:04:32.428378] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-24T17:04:32.437903] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-24T17:04:32.437834] [INFO ] [MAIN ] AER: Loaded 48687 existing records. [2025-09-24T17:04:32.495904] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-24T17:04:32.556245] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-24T17:04:32.592035] [DEBUG] [LOCAL ] AESI: Loaded 49508 existing records from primary storage. [2025-09-24T17:04:32.661634] [INFO ] [MAIN ] AESI: Loaded 49508 existing records. [2025-09-24T17:04:32.934450] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:33.093704] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-24T17:04:33.086267] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:33.125569] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-24T17:04:33.111051] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-24T17:04:33.125876] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-24T17:04:33.143289] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-24T17:04:33.148739] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-24T17:04:33.174022] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-24T17:04:33.198820] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-24T17:04:33.443477] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:33.531955] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-24T17:04:33.537283] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-24T17:04:33.585529] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-24T17:04:33.591295] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-24T17:04:33.716092] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:33.768372] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-24T17:04:34.305202] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:34.375490] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:34.370264] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-24T17:04:34.387877] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-24T17:04:34.534826] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:34.535130] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-24T17:04:34.819992] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T17:04:34.822854] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-24T17:04:35.600485] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T17:04:35.603487] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-24T17:04:36.005592] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T17:04:36.014887] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-24T17:04:36.099442] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T17:04:36.099771] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-24T17:04:36.113062] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-24T17:04:36.112539] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-24T17:04:36.392177] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T17:04:36.403203] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-24T17:04:36.991031] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-24T17:04:36.994347] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-24T17:04:37.305351] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T17:04:37.314245] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-24T17:04:37.585388] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T17:04:37.595079] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-24T17:04:37.912970] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T17:04:37.916791] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-24T17:04:38.329577] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T17:04:38.340968] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-24T17:04:38.547599] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T17:04:38.550621] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-24T17:04:38.966486] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T17:04:39.134889] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T17:04:39.177397] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T17:04:39.216049] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-24T17:04:40.016054] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-24T17:04:40.274543] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T17:04:40.619931] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T17:04:40.816102] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-24T17:04:40.870778] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T17:04:41.616088] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-24T17:04:42.416093] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-24T17:04:42.657635] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T17:04:43.216133] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-24T17:04:43.355997] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T17:04:43.933256] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:04:44.016162] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-24T17:04:44.816168] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-24T17:04:45.203762] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T17:04:45.616062] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-24T17:04:45.766142] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:04:45.848221] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:04:46.416078] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-24T17:04:47.216092] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-24T17:04:47.765764] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T17:04:48.016113] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-24T17:04:48.167486] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T17:04:48.816093] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-24T17:04:48.966550] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T17:04:49.616113] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-24T17:04:49.773607] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T17:04:50.163229] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T17:04:50.416072] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-24T17:04:50.507771] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T17:04:50.510292] [INFO ] [REMOTE ] AFB: Full fetch complete (16509 records). [2025-09-24T17:04:50.510443] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-24T17:04:50.872745] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-24T17:04:50.872831] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-24T17:04:50.873090] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-24T17:04:50.873128] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-24T17:04:50.873684] [DEBUG] [LOCAL ] AFB: Trimmed 16509 records to 11277 (keeping 200 days of data) [2025-09-24T17:04:50.941570] [DEBUG] [LOCAL ] AFB: Primary data saved (11277 records). [2025-09-24T17:04:50.941752] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-24T17:04:50.941848] [INFO ] [MAIN ] Update Progress: 41/2373 symbols completed. AFB took 19.6s. Estimated remaining: 4h 32m 19s. Rate: 8.6 symbols/min [2025-09-24T17:04:51.114015] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:51.150387] [DEBUG] [LOCAL ] AFG: Loaded 32602 existing records from primary storage. [2025-09-24T17:04:51.150530] [INFO ] [MAIN ] AFG: Loaded 32602 existing records. [2025-09-24T17:04:51.223804] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-24T17:04:51.334746] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:51.334999] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-24T17:04:51.335049] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-24T17:04:51.336100] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-24T17:04:51.336163] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-24T17:04:51.723314] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:52.016066] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-24T17:04:52.163390] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:04:52.816062] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-24T17:04:52.886506] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T17:04:53.566338] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T17:04:53.616125] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-24T17:04:54.416141] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-24T17:04:54.745284] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T17:04:55.218186] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-24T17:04:55.225240] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:04:56.016059] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-24T17:04:56.070052] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T17:04:56.816081] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-24T17:04:57.174808] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T17:04:57.187037] [INFO ] [REMOTE ] AES: Full fetch complete (77723 records). [2025-09-24T17:04:57.187212] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-24T17:04:57.590470] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-24T17:04:57.590584] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-24T17:04:57.591367] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-24T17:04:57.591489] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-24T17:04:57.593218] [DEBUG] [LOCAL ] AES: Trimmed 77723 records to 53671 (keeping 200 days of data) [2025-09-24T17:04:57.654340] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-24T17:04:57.711540] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T17:04:57.729830] [INFO ] [REMOTE ] AESI: Full fetch complete (70282 records). [2025-09-24T17:04:57.735200] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-24T17:04:58.276899] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-24T17:04:58.278386] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-24T17:04:58.280035] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-24T17:04:58.280394] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-24T17:04:58.292529] [DEBUG] [LOCAL ] AESI: Trimmed 70282 records to 49499 (keeping 200 days of data) [2025-09-24T17:04:58.325183] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T17:04:58.431275] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-24T17:04:58.543705] [DEBUG] [LOCAL ] AES: Primary data saved (53671 records). [2025-09-24T17:04:58.544372] [INFO ] [MAIN ] AES: Full history saved. [2025-09-24T17:04:58.545215] [INFO ] [MAIN ] Update Progress: 42/2373 symbols completed. AES took 27.2s. Estimated remaining: 4h 32m 45s. Rate: 8.5 symbols/min [2025-09-24T17:04:58.849600] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:58.875974] [DEBUG] [LOCAL ] AFGB: Loaded 2417 existing records from primary storage. [2025-09-24T17:04:58.876480] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:04:58.884523] [INFO ] [MAIN ] AFGB: Loaded 2417 existing records. [2025-09-24T17:04:59.084986] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:59.089772] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-24T17:04:59.091116] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-24T17:04:59.093130] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-24T17:04:59.093704] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-24T17:04:59.221009] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-24T17:04:59.543701] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:04:59.556258] [DEBUG] [LOCAL ] AESI: Primary data saved (49499 records). [2025-09-24T17:04:59.556345] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-24T17:04:59.557596] [INFO ] [MAIN ] Update Progress: 43/2373 symbols completed. AESI took 28.2s. Estimated remaining: 4h 27m 12s. Rate: 8.7 symbols/min [2025-09-24T17:04:59.733294] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:04:59.740300] [DEBUG] [LOCAL ] AFGC: Loaded 2566 existing records from primary storage. [2025-09-24T17:04:59.740409] [INFO ] [MAIN ] AFGC: Loaded 2566 existing records. [2025-09-24T17:04:59.941172] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:04:59.941538] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-24T17:04:59.941605] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-24T17:04:59.942020] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-24T17:04:59.942095] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-24T17:05:00.016349] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-24T17:05:00.326345] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:00.366163] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:05:00.367405] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T17:05:00.382344] [INFO ] [REMOTE ] AER: Full fetch complete (69480 records). [2025-09-24T17:05:00.382551] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-24T17:05:00.755570] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T17:05:00.798166] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-24T17:05:00.798254] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-24T17:05:00.798942] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-24T17:05:00.799012] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-24T17:05:00.800528] [DEBUG] [LOCAL ] AER: Trimmed 69480 records to 48631 (keeping 200 days of data) [2025-09-24T17:05:00.857724] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-24T17:05:01.107993] [DEBUG] [LOCAL ] AER: Primary data saved (48631 records). [2025-09-24T17:05:01.108147] [INFO ] [MAIN ] AER: Full history saved. [2025-09-24T17:05:01.108235] [INFO ] [MAIN ] Update Progress: 44/2373 symbols completed. AER took 29.7s. Estimated remaining: 4h 22m 23s. Rate: 8.9 symbols/min [2025-09-24T17:05:01.319998] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:01.320271] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-09-24T17:05:01.320326] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-09-24T17:05:01.320483] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-24T17:05:01.320527] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-24T17:05:01.320572] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-24T17:05:01.320608] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-24T17:05:01.549163] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T17:05:01.621277] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-24T17:05:01.755020] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:02.309008] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T17:05:02.416099] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-24T17:05:02.866497] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T17:05:03.216139] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-24T17:05:04.016159] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-24T17:05:04.572942] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:05:04.818570] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-24T17:05:04.819460] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T17:05:05.616136] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-24T17:05:06.065178] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T17:05:06.379391] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T17:05:06.416036] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-24T17:05:07.045211] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T17:05:07.216106] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-24T17:05:07.671775] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T17:05:08.016112] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-24T17:05:08.569550] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:05:08.816119] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-24T17:05:09.306166] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T17:05:09.616067] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-24T17:05:10.125930] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T17:05:10.416097] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-24T17:05:10.970034] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:05:11.216125] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-24T17:05:12.016082] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-24T17:05:12.132233] [DEBUG] [REMOTE ] AFGC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-24T17:05:12.132591] [WARN ] [REMOTE ] AFGC: No data returned for month 2025-04 [2025-09-24T17:05:12.352243] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T17:05:12.816099] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-24T17:05:13.507714] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T17:05:13.616093] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-24T17:05:14.416098] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-24T17:05:14.980975] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:05:15.047267] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T17:05:15.216123] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-24T17:05:15.828939] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T17:05:16.016104] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-24T17:05:16.653525] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T17:05:16.816094] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-24T17:05:17.342478] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-24T17:05:17.616084] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-24T17:05:18.169597] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-24T17:05:18.416087] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-24T17:05:19.216088] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-24T17:05:19.683137] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:05:19.767224] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T17:05:20.016102] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-24T17:05:20.662069] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T17:05:20.663210] [INFO ] [REMOTE ] AFGC: Full fetch complete (3444 records). [2025-09-24T17:05:20.663282] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-24T17:05:20.821946] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-24T17:05:20.866592] [WARN ] [VALIDATOR ] AFGC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T17:05:20.866857] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:05:20.866952] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:05:20.867091] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-24T17:05:20.867172] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-24T17:05:20.867244] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-09-24T17:05:20.867697] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-09-24T17:05:20.867843] [INFO ] [MAIN ] Update Progress: 45/2373 symbols completed. AFGC took 21.3s. Estimated remaining: 4h 33m 29s. Rate: 8.5 symbols/min [2025-09-24T17:05:21.045167] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:21.049454] [DEBUG] [LOCAL ] AFGE: Loaded 2518 existing records from primary storage. [2025-09-24T17:05:21.049541] [INFO ] [MAIN ] AFGE: Loaded 2518 existing records. [2025-09-24T17:05:21.225170] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:05:21.225446] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-24T17:05:21.225499] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-24T17:05:21.225784] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-24T17:05:21.225867] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-24T17:05:21.453087] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T17:05:21.602771] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:21.616034] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-24T17:05:22.416084] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-24T17:05:23.086475] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T17:05:23.111160] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:05:23.216086] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-24T17:05:23.792492] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T17:05:24.016144] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-24T17:05:24.816095] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-24T17:05:25.245871] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T17:05:25.320739] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T17:05:25.616094] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-24T17:05:26.071524] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T17:05:26.416104] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-24T17:05:26.857781] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T17:05:27.216078] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-24T17:05:27.648030] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T17:05:28.016098] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-24T17:05:28.471779] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T17:05:28.816123] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-24T17:05:29.176991] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-24T17:05:29.616131] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-24T17:05:30.047482] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T17:05:30.416078] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-24T17:05:31.216094] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-24T17:05:31.543954] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:05:31.549774] [INFO ] [REMOTE ] AFG: Full fetch complete (45715 records). [2025-09-24T17:05:31.549921] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-24T17:05:31.840042] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T17:05:31.871923] [INFO ] [REMOTE ] AFGB: Full fetch complete (3649 records). [2025-09-24T17:05:31.884111] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-24T17:05:32.017460] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-24T17:05:32.085686] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-24T17:05:32.096299] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-24T17:05:32.096974] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-24T17:05:32.126918] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-24T17:05:32.213849] [DEBUG] [LOCAL ] AFG: Trimmed 45715 records to 32578 (keeping 200 days of data) [2025-09-24T17:05:32.455699] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-24T17:05:32.457093] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-24T17:05:32.458549] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-24T17:05:32.462135] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-24T17:05:32.474687] [DEBUG] [LOCAL ] AFGB: Trimmed 3649 records to 2386 (keeping 200 days of data) [2025-09-24T17:05:32.502855] [DEBUG] [LOCAL ] AFGB: Primary data saved (2386 records). [2025-09-24T17:05:32.507717] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-24T17:05:32.507918] [INFO ] [MAIN ] Update Progress: 46/2373 symbols completed. AFGB took 34.0s. Estimated remaining: 4h 37m 14s. Rate: 8.4 symbols/min [2025-09-24T17:05:32.739553] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T17:05:32.765874] [INFO ] [REMOTE ] AFGD: Full fetch complete (3204 records). [2025-09-24T17:05:32.772834] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-24T17:05:32.770128] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:32.821707] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-24T17:05:32.839945] [DEBUG] [LOCAL ] AFG: Primary data saved (32578 records). [2025-09-24T17:05:32.898576] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-24T17:05:32.902436] [INFO ] [MAIN ] Update Progress: 47/2373 symbols completed. AFG took 42.0s. Estimated remaining: 4h 31m 33s. Rate: 8.6 symbols/min [2025-09-24T17:05:33.325678] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:33.330669] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-09-24T17:05:33.339126] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-09-24T17:05:33.339051] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T17:05:33.392509] [DEBUG] [LOCAL ] AFL: Loaded 53146 existing records from primary storage. [2025-09-24T17:05:33.397708] [INFO ] [MAIN ] AFL: Loaded 53146 existing records. [2025-09-24T17:05:33.391309] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-24T17:05:33.433380] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-24T17:05:33.458454] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-24T17:05:33.453231] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-24T17:05:33.465319] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-24T17:05:33.491369] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-24T17:05:33.509092] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-24T17:05:33.570551] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-24T17:05:33.616943] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-24T17:05:33.648228] [DEBUG] [LOCAL ] AFGD: Trimmed 3204 records to 1845 (keeping 200 days of data) [2025-09-24T17:05:33.736901] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:05:33.759554] [DEBUG] [LOCAL ] AFGD: Primary data saved (1845 records). [2025-09-24T17:05:33.770004] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-24T17:05:33.775274] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-24T17:05:33.790748] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-24T17:05:33.796057] [INFO ] [MAIN ] Update Progress: 48/2373 symbols completed. AFGD took 32.7s. Estimated remaining: 4h 26m 30s. Rate: 8.7 symbols/min [2025-09-24T17:05:33.830007] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-24T17:05:33.876891] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-24T17:05:34.335840] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:34.344484] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:34.436945] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-24T17:05:34.531892] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T17:05:34.628519] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:34.641929] [DEBUG] [LOCAL ] AGCO: Loaded 42493 existing records from primary storage. [2025-09-24T17:05:34.642057] [INFO ] [MAIN ] AGCO: Loaded 42493 existing records. [2025-09-24T17:05:34.822314] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:05:34.822586] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-24T17:05:34.822686] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-24T17:05:34.823896] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-24T17:05:34.823959] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-24T17:05:35.182888] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:35.216029] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-24T17:05:36.016067] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-24T17:05:36.486615] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T17:05:36.503794] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T17:05:36.816128] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-24T17:05:36.996319] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T17:05:37.272418] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T17:05:37.616152] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-24T17:05:38.416097] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-24T17:05:39.216114] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-24T17:05:39.606330] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T17:05:40.016051] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-24T17:05:40.103397] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T17:05:40.772615] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:05:40.816056] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-24T17:05:41.295814] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T17:05:41.616058] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-24T17:05:41.866881] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T17:05:42.416082] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-24T17:05:43.216146] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-24T17:05:43.336627] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T17:05:43.547844] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-24T17:05:44.016080] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-24T17:05:44.694240] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-24T17:05:44.816134] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-24T17:05:45.251864] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T17:05:45.616107] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-24T17:05:46.149851] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T17:05:46.150834] [INFO ] [REMOTE ] AFGE: Full fetch complete (3491 records). [2025-09-24T17:05:46.150955] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-24T17:05:46.419085] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-24T17:05:46.536108] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T17:05:46.582056] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-24T17:05:46.582539] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-24T17:05:46.582724] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-24T17:05:46.582786] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-24T17:05:46.583174] [DEBUG] [LOCAL ] AFGE: Trimmed 3491 records to 2506 (keeping 200 days of data) [2025-09-24T17:05:46.600792] [DEBUG] [LOCAL ] AFGE: Primary data saved (2506 records). [2025-09-24T17:05:46.600873] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-24T17:05:46.600953] [INFO ] [MAIN ] Update Progress: 49/2373 symbols completed. AFGE took 25.7s. Estimated remaining: 4h 31m 4s. Rate: 8.6 symbols/min [2025-09-24T17:05:46.781321] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:05:46.800126] [DEBUG] [LOCAL ] AGD: Loaded 17730 existing records from primary storage. [2025-09-24T17:05:46.800256] [INFO ] [MAIN ] AGD: Loaded 17730 existing records. [2025-09-24T17:05:46.981841] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:05:46.982106] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-24T17:05:46.982154] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-24T17:05:46.982814] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-24T17:05:46.982877] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-24T17:05:47.227603] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-24T17:05:47.356332] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:05:48.016090] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-24T17:05:48.677793] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-24T17:05:48.741482] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T17:05:48.816062] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-24T17:05:49.077302] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T17:05:49.616082] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-24T17:05:49.903200] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T17:05:50.416079] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-24T17:05:51.216059] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-24T17:05:51.290044] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T17:05:52.016061] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-24T17:05:52.105728] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T17:05:52.191680] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:05:52.816126] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-24T17:05:53.299701] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T17:05:53.616146] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-24T17:05:54.416052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-24T17:05:54.481927] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T17:05:54.597208] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T17:05:55.216071] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-24T17:05:55.623580] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:05:56.016077] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-24T17:05:56.707023] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T17:05:56.816098] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-24T17:05:56.867316] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T17:05:57.616082] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-24T17:05:57.807249] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T17:05:58.416085] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-24T17:05:59.106311] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T17:05:59.216053] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-24T17:05:59.922529] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T17:06:00.016038] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-24T17:06:00.816114] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-24T17:06:00.971675] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T17:06:01.616137] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-24T17:06:02.198951] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T17:06:02.297470] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T17:06:02.416114] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-24T17:06:03.216111] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-24T17:06:04.016100] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-24T17:06:04.584614] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T17:06:04.816175] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-24T17:06:04.829982] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (3.21 seconds). [2025-09-24T17:06:05.467165] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-09-24T17:06:05.477278] [INFO ] [REMOTE ] AFL: Full fetch complete (76923 records). [2025-09-24T17:06:05.477416] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-24T17:06:05.636523] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-24T17:06:05.925093] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T17:06:05.924284] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-24T17:06:05.929971] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-24T17:06:05.931111] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-24T17:06:05.931207] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-24T17:06:05.957384] [DEBUG] [LOCAL ] AFL: Trimmed 76923 records to 53143 (keeping 200 days of data) [2025-09-24T17:06:05.958696] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T17:06:06.308256] [DEBUG] [LOCAL ] AFL: Primary data saved (53143 records). [2025-09-24T17:06:06.308517] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-24T17:06:06.308711] [INFO ] [MAIN ] Update Progress: 50/2373 symbols completed. AFL took 33.8s. Estimated remaining: 4h 40m 48s. Rate: 8.3 symbols/min [2025-09-24T17:06:06.421194] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-24T17:06:06.483345] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:06.534402] [DEBUG] [LOCAL ] AGI: Loaded 53418 existing records from primary storage. [2025-09-24T17:06:06.534593] [INFO ] [MAIN ] AGI: Loaded 53418 existing records. [2025-09-24T17:06:06.712829] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:06.713097] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-24T17:06:06.713144] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-24T17:06:06.714562] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-24T17:06:06.714623] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-24T17:06:07.070609] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:07.216049] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-24T17:06:07.418439] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T17:06:07.962825] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T17:06:07.970347] [INFO ] [REMOTE ] AGCO: Full fetch complete (62021 records). [2025-09-24T17:06:07.970458] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-24T17:06:08.025996] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-24T17:06:08.363524] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-24T17:06:08.363613] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-24T17:06:08.364232] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-24T17:06:08.364293] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-24T17:06:08.365693] [DEBUG] [LOCAL ] AGCO: Trimmed 62021 records to 42446 (keeping 200 days of data) [2025-09-24T17:06:08.702778] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T17:06:08.716593] [DEBUG] [LOCAL ] AGCO: Primary data saved (42446 records). [2025-09-24T17:06:08.716794] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-24T17:06:08.716897] [INFO ] [MAIN ] Update Progress: 51/2373 symbols completed. AGCO took 34.9s. Estimated remaining: 4h 36m 60s. Rate: 8.4 symbols/min [2025-09-24T17:06:08.820633] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-24T17:06:08.897551] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:08.910123] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T17:06:08.915768] [INFO ] [REMOTE ] AGD: Full fetch complete (25320 records). [2025-09-24T17:06:08.915882] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-24T17:06:09.264958] [DEBUG] [LOCAL ] AGL: Loaded 52423 existing records from primary storage. [2025-09-24T17:06:09.296821] [INFO ] [MAIN ] AGL: Loaded 52423 existing records. [2025-09-24T17:06:09.446825] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-24T17:06:09.446978] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-24T17:06:09.447677] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-24T17:06:09.453173] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-24T17:06:09.506703] [DEBUG] [LOCAL ] AGD: Trimmed 25320 records to 17713 (keeping 200 days of data) [2025-09-24T17:06:09.574262] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:09.574624] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-24T17:06:09.581941] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-24T17:06:09.606264] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-24T17:06:09.607200] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-24T17:06:09.621540] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-24T17:06:10.009920] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:10.025530] [DEBUG] [LOCAL ] AGD: Primary data saved (17713 records). [2025-09-24T17:06:10.025717] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-24T17:06:10.025824] [INFO ] [MAIN ] Update Progress: 52/2373 symbols completed. AGD took 23.4s. Estimated remaining: 4h 32m 32s. Rate: 8.5 symbols/min [2025-09-24T17:06:10.226268] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:10.237582] [DEBUG] [LOCAL ] AGM: Loaded 9921 existing records from primary storage. [2025-09-24T17:06:10.237734] [INFO ] [MAIN ] AGM: Loaded 9921 existing records. [2025-09-24T17:06:10.429719] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:10.423315] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-24T17:06:10.431469] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-24T17:06:10.431544] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-24T17:06:10.432052] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-24T17:06:10.432118] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-24T17:06:10.816257] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T17:06:10.829435] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:11.216104] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-24T17:06:11.586309] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T17:06:11.867323] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T17:06:12.016093] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-24T17:06:12.816056] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-24T17:06:13.070708] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T17:06:13.616088] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-24T17:06:14.077032] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T17:06:14.416069] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-24T17:06:14.519844] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T17:06:15.216062] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-24T17:06:15.350368] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:06:16.016096] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-24T17:06:16.816092] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-24T17:06:17.710080] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-24T17:06:17.720001] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-24T17:06:17.809735] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T17:06:17.844879] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (3.43 seconds). [2025-09-24T17:06:17.854636] [INFO ] [REMOTE ] AG: Full fetch complete (77574 records). [2025-09-24T17:06:17.854923] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-24T17:06:18.273177] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-24T17:06:18.273267] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-24T17:06:18.274068] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-24T17:06:18.274140] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-24T17:06:18.275759] [DEBUG] [LOCAL ] AG: Trimmed 77574 records to 53643 (keeping 200 days of data) [2025-09-24T17:06:18.452720] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-24T17:06:18.614974] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-09-24T17:06:18.615170] [INFO ] [MAIN ] AG: Full history saved. [2025-09-24T17:06:18.615320] [INFO ] [MAIN ] Update Progress: 53/2373 symbols completed. AG took 45.7s. Estimated remaining: 4h 33m 32s. Rate: 8.5 symbols/min [2025-09-24T17:06:18.798906] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:18.832629] [DEBUG] [LOCAL ] AGO: Loaded 28103 existing records from primary storage. [2025-09-24T17:06:18.832803] [INFO ] [MAIN ] AGO: Loaded 28103 existing records. [2025-09-24T17:06:19.010471] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:19.010738] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-24T17:06:19.010795] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-24T17:06:19.011675] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-24T17:06:19.011747] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-24T17:06:19.223298] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T17:06:19.264896] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-24T17:06:19.416345] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:19.449689] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:06:19.632280] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-24T17:06:19.966715] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T17:06:20.016030] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-24T17:06:20.624249] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T17:06:20.816090] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-24T17:06:21.616087] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-24T17:06:22.416085] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-24T17:06:22.512439] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T17:06:23.012320] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T17:06:23.216112] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-24T17:06:24.016057] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-24T17:06:24.385948] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T17:06:24.413356] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:06:24.480863] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-24T17:06:24.816087] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-24T17:06:25.616054] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-24T17:06:25.677547] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T17:06:26.416092] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-24T17:06:27.216058] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-24T17:06:27.369013] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T17:06:27.418492] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:06:27.877154] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T17:06:28.016098] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-24T17:06:28.816099] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-24T17:06:28.949193] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T17:06:29.616154] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-24T17:06:30.416265] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-24T17:06:30.668439] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T17:06:31.216094] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-24T17:06:31.595553] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T17:06:31.835018] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T17:06:32.016117] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-24T17:06:32.658381] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T17:06:32.721328] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T17:06:32.816095] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-24T17:06:33.616121] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-24T17:06:34.089678] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T17:06:34.375838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T17:06:34.416120] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-24T17:06:35.216131] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-24T17:06:35.234709] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T17:06:35.237070] [INFO ] [REMOTE ] AGM: Full fetch complete (12540 records). [2025-09-24T17:06:35.237194] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-24T17:06:35.619424] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-24T17:06:35.619514] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-24T17:06:35.619745] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-24T17:06:35.619837] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-24T17:06:35.620521] [DEBUG] [LOCAL ] AGM: Trimmed 12540 records to 9961 (keeping 200 days of data) [2025-09-24T17:06:35.690454] [DEBUG] [LOCAL ] AGM: Primary data saved (9961 records). [2025-09-24T17:06:35.690622] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-24T17:06:35.690789] [INFO ] [MAIN ] Update Progress: 54/2373 symbols completed. AGM took 25.7s. Estimated remaining: 4h 40m 35s. Rate: 8.3 symbols/min [2025-09-24T17:06:35.863802] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:35.921359] [DEBUG] [LOCAL ] AGRO: Loaded 33795 existing records from primary storage. [2025-09-24T17:06:35.921684] [INFO ] [MAIN ] AGRO: Loaded 33795 existing records. [2025-09-24T17:06:36.021214] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-24T17:06:36.121420] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:36.122563] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-24T17:06:36.122755] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-24T17:06:36.124694] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-24T17:06:36.124778] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-24T17:06:36.442526] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:06:36.530316] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:36.816103] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-24T17:06:37.616084] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-24T17:06:37.875930] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:06:38.364377] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T17:06:38.416058] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-24T17:06:39.173986] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T17:06:39.216047] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-24T17:06:39.529214] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:06:40.016144] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-24T17:06:40.816051] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-24T17:06:41.155877] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T17:06:41.165977] [INFO ] [REMOTE ] AGI: Full fetch complete (76721 records). [2025-09-24T17:06:41.166114] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-24T17:06:41.567522] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-24T17:06:41.567605] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-24T17:06:41.568362] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-24T17:06:41.568448] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-24T17:06:41.570003] [DEBUG] [LOCAL ] AGI: Trimmed 76721 records to 53419 (keeping 200 days of data) [2025-09-24T17:06:41.637704] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-24T17:06:41.932770] [DEBUG] [LOCAL ] AGI: Primary data saved (53419 records). [2025-09-24T17:06:41.933022] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-24T17:06:41.933188] [INFO ] [MAIN ] Update Progress: 55/2373 symbols completed. AGI took 35.6s. Estimated remaining: 4h 39m 45s. Rate: 8.3 symbols/min [2025-09-24T17:06:42.123228] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:42.174513] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-24T17:06:42.186403] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T17:06:42.229289] [DEBUG] [LOCAL ] AGX: Loaded 33512 existing records from primary storage. [2025-09-24T17:06:42.229435] [INFO ] [MAIN ] AGX: Loaded 33512 existing records. [2025-09-24T17:06:42.408959] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:42.409262] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-24T17:06:42.409334] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-24T17:06:42.410356] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-24T17:06:42.410429] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-24T17:06:42.421595] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-24T17:06:42.806603] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:42.828495] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T17:06:43.216112] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-24T17:06:43.936468] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:06:44.016098] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-24T17:06:44.402487] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T17:06:44.816162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-24T17:06:45.165690] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T17:06:45.616097] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-24T17:06:46.267513] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T17:06:46.416100] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-24T17:06:46.724827] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T17:06:46.729631] [INFO ] [REMOTE ] AGO: Full fetch complete (39298 records). [2025-09-24T17:06:46.729806] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-24T17:06:47.114344] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-24T17:06:47.114499] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-24T17:06:47.114955] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-24T17:06:47.115016] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-24T17:06:47.116632] [DEBUG] [LOCAL ] AGO: Trimmed 39298 records to 28083 (keeping 200 days of data) [2025-09-24T17:06:47.217639] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-24T17:06:47.296938] [DEBUG] [LOCAL ] AGO: Primary data saved (28083 records). [2025-09-24T17:06:47.297071] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-24T17:06:47.297192] [INFO ] [MAIN ] Update Progress: 56/2373 symbols completed. AGO took 28.7s. Estimated remaining: 4h 38m 20s. Rate: 8.3 symbols/min [2025-09-24T17:06:47.468753] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:47.514099] [DEBUG] [LOCAL ] AHH: Loaded 41438 existing records from primary storage. [2025-09-24T17:06:47.514246] [INFO ] [MAIN ] AHH: Loaded 41438 existing records. [2025-09-24T17:06:47.717831] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:47.718125] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-24T17:06:47.718207] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-24T17:06:47.719676] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-24T17:06:47.719769] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-24T17:06:48.023275] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-24T17:06:48.095272] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:48.117891] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T17:06:48.816106] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-24T17:06:49.146263] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:06:49.160265] [INFO ] [REMOTE ] AGL: Full fetch complete (75407 records). [2025-09-24T17:06:49.160435] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-24T17:06:49.584456] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-24T17:06:49.585136] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-24T17:06:49.585908] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:06:49.586730] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-24T17:06:49.594909] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-24T17:06:49.596468] [DEBUG] [LOCAL ] AGL: Trimmed 75407 records to 52421 (keeping 200 days of data) [2025-09-24T17:06:49.657420] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-24T17:06:49.911816] [DEBUG] [LOCAL ] AGL: Primary data saved (52421 records). [2025-09-24T17:06:49.912210] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-24T17:06:49.914603] [INFO ] [MAIN ] Update Progress: 57/2373 symbols completed. AGL took 41.2s. Estimated remaining: 4h 35m 6s. Rate: 8.4 symbols/min [2025-09-24T17:06:50.091333] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:50.091786] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-24T17:06:50.091958] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-24T17:06:50.092481] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-24T17:06:50.092583] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-24T17:06:50.092866] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-24T17:06:50.093057] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-24T17:06:50.262837] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T17:06:50.421168] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-24T17:06:50.509303] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:50.898845] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T17:06:51.216083] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-24T17:06:51.545935] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T17:06:52.016051] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-24T17:06:52.466232] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T17:06:52.816094] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-24T17:06:53.579827] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T17:06:53.616047] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-24T17:06:54.162556] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T17:06:54.416081] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-24T17:06:54.641958] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:06:54.642282] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-24T17:06:55.216051] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-24T17:06:55.377727] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:06:56.016080] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-24T17:06:56.216092] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:06:56.216414] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-24T17:06:56.615805] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T17:06:56.621589] [INFO ] [REMOTE ] AGRO: Full fetch complete (49920 records). [2025-09-24T17:06:56.621735] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-24T17:06:56.816102] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-24T17:06:57.051143] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-24T17:06:57.051230] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-24T17:06:57.051781] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-24T17:06:57.051848] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-24T17:06:57.053530] [DEBUG] [LOCAL ] AGRO: Trimmed 49920 records to 33723 (keeping 200 days of data) [2025-09-24T17:06:57.115022] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:06:57.123882] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-24T17:06:57.269556] [DEBUG] [LOCAL ] AGRO: Primary data saved (33723 records). [2025-09-24T17:06:57.269735] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-24T17:06:57.271201] [INFO ] [MAIN ] Update Progress: 58/2373 symbols completed. AGRO took 21.6s. Estimated remaining: 4h 35m 8s. Rate: 8.4 symbols/min [2025-09-24T17:06:57.447229] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:06:57.508193] [DEBUG] [LOCAL ] AHR: Loaded 49330 existing records from primary storage. [2025-09-24T17:06:57.508368] [INFO ] [MAIN ] AHR: Loaded 49330 existing records. [2025-09-24T17:06:57.621149] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-24T17:06:57.687098] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:06:57.687324] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-24T17:06:57.687372] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-24T17:06:57.688896] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-24T17:06:57.688959] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-24T17:06:58.038026] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:06:58.416144] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-24T17:06:59.216082] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-24T17:06:59.310850] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T17:06:59.416165] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:06:59.416485] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-24T17:06:59.756794] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T17:07:00.016124] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-24T17:07:00.816103] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-24T17:07:01.599262] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T17:07:01.616050] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-24T17:07:02.131550] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T17:07:02.416087] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-24T17:07:03.163507] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T17:07:03.216030] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-24T17:07:03.669174] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T17:07:04.016119] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-24T17:07:04.241592] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:04.241973] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-24T17:07:04.816245] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T17:07:04.816317] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-24T17:07:05.616125] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-24T17:07:05.815916] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T17:07:06.416098] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-24T17:07:06.755462] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T17:07:07.216085] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-24T17:07:08.016051] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-24T17:07:08.057290] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T17:07:08.438917] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T17:07:08.816064] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-24T17:07:09.070885] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T17:07:09.616118] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-24T17:07:10.416055] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-24T17:07:10.519015] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:07:10.549296] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T17:07:11.216138] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-24T17:07:12.016063] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-24T17:07:12.129347] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T17:07:12.816067] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-24T17:07:12.965457] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:07:13.343908] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T17:07:13.616084] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-24T17:07:14.416132] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-24T17:07:14.600851] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T17:07:15.216093] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-24T17:07:15.270256] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T17:07:15.949939] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T17:07:16.016113] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-24T17:07:16.827790] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-24T17:07:16.833418] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T17:07:17.550533] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T17:07:17.557024] [INFO ] [REMOTE ] AGX: Full fetch complete (48928 records). [2025-09-24T17:07:17.557186] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-24T17:07:17.621174] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-24T17:07:17.986503] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-24T17:07:17.986635] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-24T17:07:17.987218] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-24T17:07:17.987266] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-24T17:07:17.988454] [DEBUG] [LOCAL ] AGX: Trimmed 48928 records to 33392 (keeping 200 days of data) [2025-09-24T17:07:18.217984] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T17:07:18.228198] [INFO ] [REMOTE ] AHL: Full fetch complete (17517 records). [2025-09-24T17:07:18.230834] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-24T17:07:18.232881] [DEBUG] [LOCAL ] AGX: Primary data saved (33392 records). [2025-09-24T17:07:18.232998] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-24T17:07:18.233115] [INFO ] [MAIN ] Update Progress: 59/2373 symbols completed. AGX took 36.3s. Estimated remaining: 4h 44m 3s. Rate: 8.1 symbols/min [2025-09-24T17:07:18.420967] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-24T17:07:18.582161] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 96 unique days, need 200 days [2025-09-24T17:07:18.587563] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:07:18.607076] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:18.607176] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:07:18.607567] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-24T17:07:18.607662] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-24T17:07:18.607726] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-24T17:07:18.607792] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-24T17:07:18.607882] [INFO ] [MAIN ] Update Progress: 60/2373 symbols completed. AHL took 28.7s. Estimated remaining: 4h 39m 26s. Rate: 8.3 symbols/min [2025-09-24T17:07:18.718347] [DEBUG] [LOCAL ] AHT: Loaded 6041 existing records from primary storage. [2025-09-24T17:07:18.734077] [INFO ] [MAIN ] AHT: Loaded 6041 existing records. [2025-09-24T17:07:18.881130] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:18.989632] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:18.989928] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-24T17:07:18.989976] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-24T17:07:18.990348] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-24T17:07:18.990408] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-24T17:07:19.311555] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-24T17:07:19.311910] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-24T17:07:19.469101] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:19.481760] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-24T17:07:19.606238] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:19.618766] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-24T17:07:19.622146] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-24T17:07:19.625182] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T17:07:19.625371] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-24T17:07:19.637192] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-24T17:07:19.933413] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T17:07:20.026722] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-24T17:07:20.072020] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:20.406964] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T17:07:20.816095] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-24T17:07:21.446944] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T17:07:21.555423] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:07:21.616071] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-24T17:07:22.416092] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-24T17:07:23.068955] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T17:07:23.216108] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-24T17:07:24.007968] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T17:07:24.016018] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-24T17:07:24.202049] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T17:07:24.213518] [INFO ] [REMOTE ] AHR: Full fetch complete (71015 records). [2025-09-24T17:07:24.213764] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-24T17:07:24.641830] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-24T17:07:24.642687] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-24T17:07:24.643509] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-24T17:07:24.643971] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-24T17:07:24.643869] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T17:07:24.647982] [DEBUG] [LOCAL ] AHR: Trimmed 71015 records to 49294 (keeping 200 days of data) [2025-09-24T17:07:24.817088] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-24T17:07:24.939993] [DEBUG] [LOCAL ] AHR: Primary data saved (49294 records). [2025-09-24T17:07:24.940136] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-24T17:07:24.940748] [INFO ] [MAIN ] Update Progress: 61/2373 symbols completed. AHR took 27.7s. Estimated remaining: 4h 38m 44s. Rate: 8.3 symbols/min [2025-09-24T17:07:25.112840] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:25.172134] [DEBUG] [LOCAL ] AIG: Loaded 53475 existing records from primary storage. [2025-09-24T17:07:25.172286] [INFO ] [MAIN ] AIG: Loaded 53475 existing records. [2025-09-24T17:07:25.361504] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:25.361857] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-24T17:07:25.361911] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-24T17:07:25.363459] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-24T17:07:25.363526] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-24T17:07:25.623136] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-24T17:07:25.739826] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:26.416086] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-24T17:07:26.878147] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T17:07:26.884516] [INFO ] [REMOTE ] AHH: Full fetch complete (60362 records). [2025-09-24T17:07:26.884686] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-24T17:07:27.221052] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-24T17:07:27.276070] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-24T17:07:27.276166] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-24T17:07:27.276920] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-24T17:07:27.277059] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-24T17:07:27.278831] [DEBUG] [LOCAL ] AHH: Trimmed 60362 records to 41386 (keeping 200 days of data) [2025-09-24T17:07:27.517706] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-24T17:07:27.561544] [DEBUG] [LOCAL ] AHH: Primary data saved (41386 records). [2025-09-24T17:07:27.561711] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-24T17:07:27.561809] [INFO ] [MAIN ] Update Progress: 62/2373 symbols completed. AHH took 40.3s. Estimated remaining: 4h 35m 45s. Rate: 8.4 symbols/min [2025-09-24T17:07:27.737722] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:27.737975] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-24T17:07:27.738020] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-24T17:07:27.738161] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-24T17:07:27.738203] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-24T17:07:27.738245] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-24T17:07:27.738277] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-24T17:07:27.851795] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T17:07:28.021514] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-24T17:07:28.117028] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:28.148359] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:07:28.816119] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-24T17:07:29.616139] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-24T17:07:30.265542] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T17:07:30.298841] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T17:07:30.416088] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-24T17:07:30.506057] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-24T17:07:31.216093] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-24T17:07:31.930972] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T17:07:32.016070] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-24T17:07:32.075753] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T17:07:32.816090] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-24T17:07:33.616164] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-24T17:07:34.091201] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T17:07:34.257248] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T17:07:34.416051] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-24T17:07:34.725271] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T17:07:35.216081] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-24T17:07:35.984294] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T17:07:36.016039] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-24T17:07:36.728859] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-24T17:07:36.816038] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-24T17:07:36.902467] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T17:07:36.904493] [INFO ] [REMOTE ] AHT: Full fetch complete (9455 records). [2025-09-24T17:07:36.904603] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-24T17:07:37.267097] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-24T17:07:37.267175] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-24T17:07:37.267370] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-24T17:07:37.267408] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-24T17:07:37.267856] [DEBUG] [LOCAL ] AHT: Trimmed 9455 records to 6070 (keeping 200 days of data) [2025-09-24T17:07:37.300829] [DEBUG] [LOCAL ] AHT: Primary data saved (6070 records). [2025-09-24T17:07:37.300910] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-24T17:07:37.300984] [INFO ] [MAIN ] Update Progress: 63/2373 symbols completed. AHT took 19.1s. Estimated remaining: 4h 37m 13s. Rate: 8.3 symbols/min [2025-09-24T17:07:37.468158] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:37.491374] [DEBUG] [LOCAL ] AIN: Loaded 24626 existing records from primary storage. [2025-09-24T17:07:37.491507] [INFO ] [MAIN ] AIN: Loaded 24626 existing records. [2025-09-24T17:07:37.630814] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-24T17:07:37.672078] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:37.672360] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-24T17:07:37.672410] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-24T17:07:37.673200] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-24T17:07:37.673261] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-24T17:07:37.899745] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:37.937723] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-24T17:07:38.036934] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:38.416086] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-24T17:07:38.680435] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:38.680817] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-24T17:07:38.816325] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T17:07:39.216080] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-24T17:07:40.016085] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-24T17:07:40.816131] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-24T17:07:41.585812] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-24T17:07:41.616156] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-24T17:07:41.738671] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T17:07:42.008364] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T17:07:42.416080] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-24T17:07:43.152698] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T17:07:43.216303] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-24T17:07:43.869605] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-24T17:07:44.016100] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-24T17:07:44.816071] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-24T17:07:45.056397] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:45.056938] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-24T17:07:45.106168] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T17:07:45.616096] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-24T17:07:46.196313] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T17:07:46.416046] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-24T17:07:46.619457] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T17:07:46.628087] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:46.628282] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-24T17:07:47.216081] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-24T17:07:47.409428] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:07:47.409743] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-24T17:07:48.016078] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-24T17:07:48.816095] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-24T17:07:49.616071] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-24T17:07:49.762358] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T17:07:50.356329] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-24T17:07:50.416118] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-24T17:07:50.932710] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T17:07:51.216129] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-24T17:07:51.259146] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:07:52.016081] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-24T17:07:52.715392] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T17:07:52.816088] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-24T17:07:53.616057] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-24T17:07:53.698267] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T17:07:53.800303] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-24T17:07:53.809871] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-24T17:07:53.810019] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-24T17:07:54.213892] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-24T17:07:54.213984] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-24T17:07:54.215306] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-24T17:07:54.215375] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-24T17:07:54.217169] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53749 (keeping 200 days of data) [2025-09-24T17:07:54.420478] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-24T17:07:54.538688] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-24T17:07:54.538914] [INFO ] [MAIN ] AI: Full history saved. [2025-09-24T17:07:54.540886] [INFO ] [MAIN ] Update Progress: 64/2373 symbols completed. AI took 35.9s. Estimated remaining: 4h 43m 8s. Rate: 8.2 symbols/min [2025-09-24T17:07:54.715041] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:54.731716] [DEBUG] [LOCAL ] AIO: Loaded 13260 existing records from primary storage. [2025-09-24T17:07:54.731847] [INFO ] [MAIN ] AIO: Loaded 13260 existing records. [2025-09-24T17:07:54.911866] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:54.912104] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-24T17:07:54.912152] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-24T17:07:54.912694] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-24T17:07:54.912755] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-24T17:07:55.221198] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-24T17:07:55.294097] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:55.597186] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T17:07:55.619556] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T17:07:55.624366] [INFO ] [REMOTE ] AII: Full fetch complete (10491 records). [2025-09-24T17:07:55.624478] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-24T17:07:55.816327] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 96 unique days, need 200 days [2025-09-24T17:07:55.816664] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:07:55.816736] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:07:55.816812] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-24T17:07:55.816906] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-24T17:07:55.816968] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-24T17:07:55.817027] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-24T17:07:55.817119] [INFO ] [MAIN ] Update Progress: 65/2373 symbols completed. AII took 28.3s. Estimated remaining: 4h 39m 24s. Rate: 8.3 symbols/min [2025-09-24T17:07:56.021513] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-24T17:07:56.024593] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:07:56.053033] [DEBUG] [LOCAL ] AIR: Loaded 27416 existing records from primary storage. [2025-09-24T17:07:56.053172] [INFO ] [MAIN ] AIR: Loaded 27416 existing records. [2025-09-24T17:07:56.237615] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:07:56.238069] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-24T17:07:56.238197] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-24T17:07:56.244362] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-24T17:07:56.252077] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-24T17:07:56.258346] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T17:07:56.626031] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:07:56.816072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-24T17:07:57.062199] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T17:07:57.616149] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-24T17:07:58.137616] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T17:07:58.367085] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T17:07:58.416062] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-24T17:07:59.216098] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-24T17:07:59.627099] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T17:08:00.016084] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-24T17:08:00.816102] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-24T17:08:01.047884] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T17:08:01.441557] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T17:08:01.616078] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-24T17:08:01.756599] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T17:08:02.416095] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-24T17:08:03.216096] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-24T17:08:03.333528] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T17:08:03.500404] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T17:08:03.510018] [INFO ] [REMOTE ] AIG: Full fetch complete (77375 records). [2025-09-24T17:08:03.510158] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-24T17:08:03.947595] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-24T17:08:03.947787] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-24T17:08:03.948555] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-24T17:08:03.948669] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-24T17:08:03.961110] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T17:08:03.965255] [DEBUG] [LOCAL ] AIG: Trimmed 77375 records to 53475 (keeping 200 days of data) [2025-09-24T17:08:04.025204] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-24T17:08:04.310679] [DEBUG] [LOCAL ] AIG: Primary data saved (53475 records). [2025-09-24T17:08:04.311068] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-24T17:08:04.312910] [INFO ] [MAIN ] Update Progress: 66/2373 symbols completed. AIG took 39.4s. Estimated remaining: 4h 40m 0s. Rate: 8.2 symbols/min [2025-09-24T17:08:04.492480] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:04.525397] [DEBUG] [LOCAL ] AIT: Loaded 28113 existing records from primary storage. [2025-09-24T17:08:04.525542] [INFO ] [MAIN ] AIT: Loaded 28113 existing records. [2025-09-24T17:08:04.715336] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:08:04.715705] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-24T17:08:04.715765] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-24T17:08:04.717053] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-24T17:08:04.717117] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-24T17:08:04.821230] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-24T17:08:05.091484] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:05.329411] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T17:08:05.616083] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-24T17:08:05.717315] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T17:08:06.416152] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-24T17:08:06.883638] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:08:07.216129] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-24T17:08:07.401028] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T17:08:07.956619] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T17:08:08.016083] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-24T17:08:08.816113] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-24T17:08:09.281418] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:08:09.616077] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-24T17:08:09.903424] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T17:08:10.416084] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-24T17:08:10.847984] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T17:08:11.216081] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-24T17:08:11.617388] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:08:12.016123] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-24T17:08:12.545476] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T17:08:12.780088] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T17:08:12.816052] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-24T17:08:13.616115] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-24T17:08:13.855172] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T17:08:13.861603] [INFO ] [REMOTE ] AIN: Full fetch complete (33238 records). [2025-09-24T17:08:13.861775] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-24T17:08:14.268981] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-24T17:08:14.269067] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-24T17:08:14.269434] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-24T17:08:14.269475] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-24T17:08:14.270255] [DEBUG] [LOCAL ] AIN: Trimmed 33238 records to 24576 (keeping 200 days of data) [2025-09-24T17:08:14.418045] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-24T17:08:14.427382] [DEBUG] [LOCAL ] AIN: Primary data saved (24576 records). [2025-09-24T17:08:14.427529] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-24T17:08:14.427618] [INFO ] [MAIN ] Update Progress: 67/2373 symbols completed. AIN took 37.1s. Estimated remaining: 4h 41m 30s. Rate: 8.2 symbols/min [2025-09-24T17:08:14.567261] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T17:08:14.622861] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:14.664953] [DEBUG] [LOCAL ] AIV: Loaded 40198 existing records from primary storage. [2025-09-24T17:08:14.665116] [INFO ] [MAIN ] AIV: Loaded 40198 existing records. [2025-09-24T17:08:14.860908] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:08:14.861205] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-24T17:08:14.861280] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-24T17:08:14.862507] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-24T17:08:14.862604] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-24T17:08:15.221076] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-24T17:08:15.236666] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:15.494568] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T17:08:16.016135] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-24T17:08:16.440753] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T17:08:16.816079] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-24T17:08:17.601941] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T17:08:17.616031] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-24T17:08:18.356220] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:08:18.416122] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-24T17:08:18.983114] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T17:08:19.134142] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T17:08:19.216119] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-24T17:08:20.016068] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-24T17:08:20.248532] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T17:08:20.816055] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-24T17:08:21.159477] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T17:08:21.616126] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-24T17:08:22.108767] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T17:08:22.416150] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-24T17:08:22.870053] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T17:08:23.216086] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-24T17:08:23.860486] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T17:08:24.016127] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-24T17:08:24.248989] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:08:24.816119] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-24T17:08:25.222031] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T17:08:25.616088] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-24T17:08:25.874630] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T17:08:25.882210] [INFO ] [REMOTE ] AIR: Full fetch complete (37899 records). [2025-09-24T17:08:25.882518] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-24T17:08:26.333860] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-24T17:08:26.333952] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-24T17:08:26.334416] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-24T17:08:26.334461] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-24T17:08:26.335473] [DEBUG] [LOCAL ] AIR: Trimmed 37899 records to 27507 (keeping 200 days of data) [2025-09-24T17:08:26.425859] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-24T17:08:26.507149] [DEBUG] [LOCAL ] AIR: Primary data saved (27507 records). [2025-09-24T17:08:26.507337] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-24T17:08:26.507480] [INFO ] [MAIN ] Update Progress: 68/2373 symbols completed. AIR took 30.7s. Estimated remaining: 4h 44m 4s. Rate: 8.1 symbols/min [2025-09-24T17:08:26.683449] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:26.718977] [DEBUG] [LOCAL ] AIZ: Loaded 30174 existing records from primary storage. [2025-09-24T17:08:26.719140] [INFO ] [MAIN ] AIZ: Loaded 30174 existing records. [2025-09-24T17:08:26.830155] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T17:08:26.873710] [INFO ] [REMOTE ] AIT: Full fetch complete (39396 records). [2025-09-24T17:08:26.890760] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-24T17:08:26.915065] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:08:26.915199] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:08:26.915460] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:08:26.915845] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:08:26.915767] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-24T17:08:26.915979] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-24T17:08:26.916045] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-24T17:08:26.916267] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-24T17:08:26.916330] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-09-24T17:08:26.917015] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-09-24T17:08:26.917144] [INFO ] [MAIN ] Update Progress: 69/2373 symbols completed. AIT took 22.6s. Estimated remaining: 4h 40m 4s. Rate: 8.2 symbols/min [2025-09-24T17:08:26.917317] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-24T17:08:26.917557] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-24T17:08:27.240899] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-24T17:08:27.293538] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:27.343134] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T17:08:27.410916] [DEBUG] [LOCAL ] AIZN: Loaded 3919 existing records from primary storage. [2025-09-24T17:08:27.421404] [INFO ] [MAIN ] AIZN: Loaded 3919 existing records. [2025-09-24T17:08:27.627174] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:27.707213] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:08:27.707515] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-24T17:08:27.707568] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-24T17:08:27.707905] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-24T17:08:27.707985] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-24T17:08:28.031522] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-24T17:08:28.073533] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:28.614206] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:08:28.816119] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-24T17:08:29.616094] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-24T17:08:30.327380] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:08:30.416060] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-24T17:08:30.654920] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-24T17:08:30.759573] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T17:08:31.216092] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-24T17:08:31.909637] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T17:08:32.016094] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-24T17:08:32.260938] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T17:08:32.263495] [INFO ] [REMOTE ] AIO: Full fetch complete (20054 records). [2025-09-24T17:08:32.263568] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-24T17:08:32.653181] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-24T17:08:32.653261] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-24T17:08:32.653553] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-24T17:08:32.653595] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-24T17:08:32.654237] [DEBUG] [LOCAL ] AIO: Trimmed 20054 records to 13261 (keeping 200 days of data) [2025-09-24T17:08:32.734499] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T17:08:32.761815] [DEBUG] [LOCAL ] AIO: Primary data saved (13261 records). [2025-09-24T17:08:32.761998] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-24T17:08:32.762154] [INFO ] [MAIN ] Update Progress: 70/2373 symbols completed. AIO took 38.2s. Estimated remaining: 4h 39m 9s. Rate: 8.3 symbols/min [2025-09-24T17:08:32.821204] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-24T17:08:32.950292] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:32.950492] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-09-24T17:08:32.950548] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-09-24T17:08:32.950728] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-24T17:08:32.950792] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-24T17:08:32.950863] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-24T17:08:32.950900] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-24T17:08:33.377847] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:33.616187] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-24T17:08:34.193778] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T17:08:34.246535] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:08:34.416135] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-24T17:08:34.870538] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T17:08:35.216086] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-24T17:08:35.901858] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T17:08:36.016081] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-24T17:08:36.508118] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T17:08:36.816334] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-24T17:08:37.616099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-24T17:08:38.182053] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T17:08:38.416081] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-24T17:08:39.216300] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-24T17:08:39.218183] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T17:08:39.746125] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T17:08:39.883032] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:08:40.016124] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-24T17:08:40.588376] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T17:08:40.816096] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-24T17:08:41.616102] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-24T17:08:42.357864] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T17:08:42.363710] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T17:08:42.416098] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-24T17:08:43.216105] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-24T17:08:43.941373] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T17:08:44.016078] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-24T17:08:44.816198] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-24T17:08:45.150695] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:08:45.294456] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T17:08:45.303621] [INFO ] [REMOTE ] AIV: Full fetch complete (59253 records). [2025-09-24T17:08:45.303851] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-24T17:08:45.500199] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T17:08:45.623412] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-24T17:08:45.728604] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-24T17:08:45.728725] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-24T17:08:45.729426] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-24T17:08:45.729520] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-24T17:08:45.730862] [DEBUG] [LOCAL ] AIV: Trimmed 59253 records to 40245 (keeping 200 days of data) [2025-09-24T17:08:45.971451] [DEBUG] [LOCAL ] AIV: Primary data saved (40245 records). [2025-09-24T17:08:45.971727] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-24T17:08:45.971954] [INFO ] [MAIN ] Update Progress: 71/2373 symbols completed. AIV took 31.5s. Estimated remaining: 4h 42m 14s. Rate: 8.2 symbols/min [2025-09-24T17:08:46.165319] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:46.165563] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-24T17:08:46.165620] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-24T17:08:46.165800] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-24T17:08:46.165857] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-24T17:08:46.165927] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-24T17:08:46.165975] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-24T17:08:46.421319] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-24T17:08:46.527674] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:47.134697] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:08:47.216171] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-24T17:08:47.738232] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T17:08:47.739409] [INFO ] [REMOTE ] AIZN: Full fetch complete (5728 records). [2025-09-24T17:08:47.739499] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-24T17:08:48.017870] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-24T17:08:48.134345] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-24T17:08:48.134489] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-24T17:08:48.134860] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-24T17:08:48.135040] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-24T17:08:48.136511] [DEBUG] [LOCAL ] AIZN: Trimmed 5728 records to 3886 (keeping 200 days of data) [2025-09-24T17:08:48.161956] [DEBUG] [LOCAL ] AIZN: Primary data saved (3886 records). [2025-09-24T17:08:48.162068] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-24T17:08:48.162166] [INFO ] [MAIN ] Update Progress: 72/2373 symbols completed. AIZN took 21.2s. Estimated remaining: 4h 39m 22s. Rate: 8.2 symbols/min [2025-09-24T17:08:48.371677] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T17:08:48.374918] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:08:48.375145] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-09-24T17:08:48.384547] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-09-24T17:08:48.384953] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-24T17:08:48.385398] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-24T17:08:48.385486] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-24T17:08:48.385844] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-24T17:08:48.739299] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:08:48.816027] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-24T17:08:49.462740] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:08:49.616038] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-24T17:08:50.416131] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-24T17:08:50.654596] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:08:50.904035] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T17:08:51.216101] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-24T17:08:51.728246] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-24T17:08:51.893225] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T17:08:52.016088] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-24T17:08:52.475481] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T17:08:52.816077] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-24T17:08:53.616114] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-24T17:08:54.128937] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T17:08:54.157587] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T17:08:54.416102] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-24T17:08:55.216154] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-24T17:08:56.016064] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-24T17:08:56.162199] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T17:08:56.319297] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-24T17:08:56.347528] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T17:08:56.816171] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-24T17:08:57.186375] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-24T17:08:57.616105] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-24T17:08:58.171513] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T17:08:58.416083] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-24T17:08:58.840225] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T17:08:59.216066] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-24T17:08:59.558628] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T17:09:00.016082] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-24T17:09:00.816154] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-24T17:09:01.616099] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-24T17:09:01.962545] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T17:09:02.416185] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-24T17:09:03.216116] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-24T17:09:03.528522] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-24T17:09:04.016107] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-24T17:09:04.106079] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-24T17:09:04.690241] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T17:09:04.816114] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-24T17:09:05.109452] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-24T17:09:05.612340] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T17:09:05.621361] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-24T17:09:05.946492] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:09:05.951958] [INFO ] [REMOTE ] AIZ: Full fetch complete (42925 records). [2025-09-24T17:09:05.952049] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-24T17:09:06.136409] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T17:09:06.157440] [INFO ] [REMOTE ] AKA: Full fetch complete (2419 records). [2025-09-24T17:09:06.218542] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-24T17:09:06.420573] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-24T17:09:06.596239] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-24T17:09:06.602180] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-24T17:09:06.602726] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-24T17:09:06.613153] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-24T17:09:06.637154] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T17:09:06.637766] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:09:06.637838] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:09:06.637910] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-24T17:09:06.637975] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-24T17:09:06.638015] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-24T17:09:06.638055] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-24T17:09:06.638171] [INFO ] [MAIN ] Update Progress: 73/2373 symbols completed. AKA took 20.7s. Estimated remaining: 4h 45m 7s. Rate: 8.1 symbols/min [2025-09-24T17:09:06.670621] [DEBUG] [LOCAL ] AIZ: Trimmed 42925 records to 30117 (keeping 200 days of data) [2025-09-24T17:09:06.923028] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:07.012356] [DEBUG] [LOCAL ] AIZ: Primary data saved (30117 records). [2025-09-24T17:09:07.012509] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-24T17:09:07.012596] [INFO ] [MAIN ] Update Progress: 74/2373 symbols completed. AIZ took 40.5s. Estimated remaining: 4h 41m 20s. Rate: 8.2 symbols/min [2025-09-24T17:09:07.213226] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:07.209881] [DEBUG] [LOCAL ] AL: Loaded 44068 existing records from primary storage. [2025-09-24T17:09:07.213377] [INFO ] [MAIN ] AL: Loaded 44068 existing records. [2025-09-24T17:09:07.224958] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-24T17:09:07.411853] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:09:07.412116] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-24T17:09:07.412166] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-24T17:09:07.413372] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-24T17:09:07.413449] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-24T17:09:07.598999] [DEBUG] [LOCAL ] ALB: Loaded 53222 existing records from primary storage. [2025-09-24T17:09:07.614608] [INFO ] [MAIN ] ALB: Loaded 53222 existing records. [2025-09-24T17:09:08.006161] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:09:08.029509] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:08.030345] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-24T17:09:08.030022] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-24T17:09:08.031818] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-24T17:09:08.033568] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-24T17:09:08.033665] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-24T17:09:08.387316] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T17:09:08.473085] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:08.816147] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-24T17:09:08.873873] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T17:09:09.616120] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-24T17:09:09.679899] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:09:10.416080] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-24T17:09:10.592767] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T17:09:10.902407] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T17:09:11.216083] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-24T17:09:11.796853] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T17:09:12.016076] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-24T17:09:12.819453] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-24T17:09:12.824815] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:09:13.616105] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-24T17:09:13.903574] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:09:14.416061] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-24T17:09:14.864526] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T17:09:15.216088] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-24T17:09:15.720724] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-24T17:09:16.016156] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-24T17:09:16.681358] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T17:09:16.816094] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-24T17:09:17.336957] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-24T17:09:17.616119] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-24T17:09:17.952985] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T17:09:18.095383] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T17:09:18.416124] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-24T17:09:19.216157] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-24T17:09:19.532799] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T17:09:20.016049] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-24T17:09:20.117169] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T17:09:20.637122] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T17:09:20.816128] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-24T17:09:21.616095] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-24T17:09:22.347920] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-24T17:09:22.416134] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-24T17:09:22.490150] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T17:09:23.216112] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-24T17:09:23.567844] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T17:09:23.578190] [INFO ] [REMOTE ] AJG: Full fetch complete (69782 records). [2025-09-24T17:09:23.578408] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-24T17:09:24.021388] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-24T17:09:24.109792] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T17:09:24.157208] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-24T17:09:24.157304] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-24T17:09:24.158010] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-24T17:09:24.158091] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-24T17:09:24.158389] [INFO ] [REMOTE ] AKR: Full fetch complete (65381 records). [2025-09-24T17:09:24.158620] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-24T17:09:24.240808] [DEBUG] [LOCAL ] AJG: Trimmed 69782 records to 47053 (keeping 200 days of data) [2025-09-24T17:09:24.685761] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-24T17:09:24.686735] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-24T17:09:24.687684] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-24T17:09:24.688352] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-24T17:09:24.693529] [DEBUG] [LOCAL ] AKR: Trimmed 65381 records to 45761 (keeping 200 days of data) [2025-09-24T17:09:24.837268] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T17:09:24.921376] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-24T17:09:25.165101] [DEBUG] [LOCAL ] AJG: Primary data saved (47053 records). [2025-09-24T17:09:25.165800] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-24T17:09:25.166200] [INFO ] [MAIN ] Update Progress: 75/2373 symbols completed. AJG took 52.4s. Estimated remaining: 4h 46m 44s. Rate: 8.0 symbols/min [2025-09-24T17:09:25.350289] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:25.351468] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-09-24T17:09:25.352065] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-09-24T17:09:25.353115] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-24T17:09:25.355431] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-24T17:09:25.355504] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-24T17:09:25.355542] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-24T17:09:25.490271] [DEBUG] [LOCAL ] AKR: Primary data saved (45761 records). [2025-09-24T17:09:25.511112] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-24T17:09:25.516338] [INFO ] [MAIN ] Update Progress: 76/2373 symbols completed. AKR took 37.4s. Estimated remaining: 4h 43m 1s. Rate: 8.1 symbols/min [2025-09-24T17:09:25.975352] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:25.994914] [DEBUG] [LOCAL ] ALE: No existing data file found in primary storage. [2025-09-24T17:09:26.000980] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:26.001818] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-24T17:09:26.001451] [WARN ] [MAIN ] ALE: No existing data found, performing full refresh instead. [2025-09-24T17:09:26.003383] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-24T17:09:26.003635] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-24T17:09:26.004053] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-09-24T17:09:26.004169] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-24T17:09:26.410665] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-24T17:09:26.489870] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-24T17:09:26.578360] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T17:09:26.690666] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:27.216139] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-24T17:09:27.519973] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T17:09:28.016146] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-24T17:09:28.641230] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-24T17:09:28.816180] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-24T17:09:28.936112] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T17:09:29.163809] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T17:09:29.616109] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-24T17:09:30.416110] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-24T17:09:30.722297] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:09:30.877185] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T17:09:31.216091] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-24T17:09:32.016098] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-24T17:09:32.233543] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T17:09:32.242475] [INFO ] [REMOTE ] AL: Full fetch complete (62167 records). [2025-09-24T17:09:32.242615] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-24T17:09:32.638075] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-24T17:09:32.638160] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-24T17:09:32.638770] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-24T17:09:32.638835] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-24T17:09:32.640082] [DEBUG] [LOCAL ] AL: Trimmed 62167 records to 44086 (keeping 200 days of data) [2025-09-24T17:09:32.822109] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-24T17:09:32.923502] [DEBUG] [LOCAL ] AL: Primary data saved (44086 records). [2025-09-24T17:09:32.923679] [INFO ] [MAIN ] AL: Full history saved. [2025-09-24T17:09:32.923789] [INFO ] [MAIN ] Update Progress: 77/2373 symbols completed. AL took 26.3s. Estimated remaining: 4h 42m 54s. Rate: 8.1 symbols/min [2025-09-24T17:09:33.231536] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T17:09:33.227904] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-24T17:09:33.616094] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-24T17:09:34.407856] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T17:09:34.417745] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-24T17:09:34.735560] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T17:09:35.216136] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-24T17:09:36.016151] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-24T17:09:36.283976] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:09:36.293229] [INFO ] [REMOTE ] ALB: Full fetch complete (76764 records). [2025-09-24T17:09:36.293362] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-24T17:09:36.691248] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-24T17:09:36.691338] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-24T17:09:36.692057] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-24T17:09:36.692123] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-24T17:09:36.693674] [DEBUG] [LOCAL ] ALB: Trimmed 76764 records to 53222 (keeping 200 days of data) [2025-09-24T17:09:36.947482] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T17:09:36.961505] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-24T17:09:36.991250] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T17:09:37.104194] [DEBUG] [LOCAL ] ALB: Primary data saved (53222 records). [2025-09-24T17:09:37.104345] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-24T17:09:37.104435] [INFO ] [MAIN ] Update Progress: 78/2373 symbols completed. ALB took 30.1s. Estimated remaining: 4h 41m 12s. Rate: 8.2 symbols/min [2025-09-24T17:09:37.616088] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-24T17:09:38.771812] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:09:38.782547] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-24T17:09:38.821227] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:09:39.216102] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-24T17:09:40.143344] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T17:09:40.149253] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-24T17:09:40.557071] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T17:09:40.816139] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-24T17:09:41.535171] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T17:09:41.616041] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-24T17:09:42.529911] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T17:09:42.541883] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-24T17:09:43.027465] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T17:09:43.216116] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-24T17:09:43.894760] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T17:09:44.016098] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-24T17:09:44.351602] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T17:09:44.358040] [INFO ] [REMOTE ] ALE: Full fetch complete (42236 records). [2025-09-24T17:09:44.358137] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-24T17:09:44.765496] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-24T17:09:44.765581] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-24T17:09:44.766053] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-24T17:09:44.766117] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-24T17:09:44.767354] [DEBUG] [LOCAL ] ALE: Trimmed 42236 records to 30136 (keeping 200 days of data) [2025-09-24T17:09:44.954861] [DEBUG] [LOCAL ] ALE: Primary data saved (30136 records). [2025-09-24T17:09:44.955015] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-24T17:09:44.955096] [INFO ] [MAIN ] Update Progress: 79/2373 symbols completed. ALE took 19.4s. Estimated remaining: 4h 41m 19s. Rate: 8.2 symbols/min [2025-09-24T17:09:45.926900] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-24T17:09:45.938281] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-24T17:09:47.727275] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T17:09:47.738453] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-24T17:09:49.790966] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T17:09:49.800393] [INFO ] [REMOTE ] ALC: Full fetch complete (72645 records). [2025-09-24T17:09:49.800528] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-24T17:09:50.209018] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-24T17:09:50.209103] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-24T17:09:50.209808] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-24T17:09:50.209911] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-24T17:09:50.211584] [DEBUG] [LOCAL ] ALC: Trimmed 72645 records to 50772 (keeping 200 days of data) [2025-09-24T17:09:50.520974] [DEBUG] [LOCAL ] ALC: Primary data saved (50772 records). [2025-09-24T17:09:50.521129] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-24T17:09:50.521211] [INFO ] [MAIN ] Update Progress: 80/2373 symbols completed. ALC took 25.4s. Estimated remaining: 4h 40m 20s. Rate: 8.2 symbols/min [2025-09-24T17:09:51.197630] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:51.231112] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:51.225102] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:51.253461] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:09:51.254636] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-09-24T17:09:51.254742] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-09-24T17:09:51.255197] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-24T17:09:51.255430] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-24T17:09:51.255738] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-24T17:09:51.255879] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-24T17:09:51.382102] [DEBUG] [LOCAL ] ALG: Loaded 10456 existing records from primary storage. [2025-09-24T17:09:51.382479] [INFO ] [MAIN ] ALG: Loaded 10456 existing records. [2025-09-24T17:09:51.642547] [DEBUG] [LOCAL ] ALEX: Loaded 31336 existing records from primary storage. [2025-09-24T17:09:51.668808] [INFO ] [MAIN ] ALEX: Loaded 31336 existing records. [2025-09-24T17:09:51.865431] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:09:51.936384] [DEBUG] [LOCAL ] ALIT: Loaded 52761 existing records from primary storage. [2025-09-24T17:09:51.956870] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-24T17:09:51.978180] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-24T17:09:51.999516] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:51.956994] [INFO ] [MAIN ] ALIT: Loaded 52761 existing records. [2025-09-24T17:09:52.000123] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-24T17:09:52.005690] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-24T17:09:52.133115] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-24T17:09:52.176362] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:09:52.239573] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-24T17:09:52.244807] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-24T17:09:52.371681] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-24T17:09:52.392495] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:09:52.392609] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-24T17:09:52.419849] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-24T17:09:52.554924] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-24T17:09:52.629786] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-24T17:09:52.635183] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-24T17:09:53.027776] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:53.058292] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-24T17:09:53.216761] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:53.253470] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-24T17:09:53.410888] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:09:53.411194] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-24T17:09:53.944304] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T17:09:53.960567] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-24T17:09:54.115573] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T17:09:54.118530] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-24T17:09:54.432158] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T17:09:54.439469] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-24T17:09:54.723442] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T17:09:54.727364] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-24T17:09:54.804313] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T17:09:54.815361] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-24T17:09:55.549388] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T17:09:55.553201] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-24T17:09:55.582462] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T17:09:55.593415] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-24T17:09:55.680793] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T17:09:55.686986] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-24T17:09:56.227461] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T17:09:56.237963] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-24T17:09:56.373967] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T17:09:56.752222] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T17:09:56.816101] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-24T17:09:57.248233] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T17:09:57.616139] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-24T17:09:57.708114] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:09:58.287104] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:09:58.416057] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-24T17:09:58.472921] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T17:09:59.216126] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-24T17:09:59.886260] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T17:10:00.016152] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-24T17:10:00.262232] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T17:10:00.816154] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-24T17:10:01.616098] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-24T17:10:01.814322] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T17:10:01.887487] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T17:10:02.416105] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-24T17:10:03.168291] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T17:10:03.216100] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-24T17:10:03.458349] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T17:10:04.016111] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-24T17:10:04.073508] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T17:10:04.816086] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-24T17:10:05.616116] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-24T17:10:06.010050] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T17:10:06.416096] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-24T17:10:06.872810] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-24T17:10:06.879565] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T17:10:06.893356] [INFO ] [REMOTE ] ALG: Full fetch complete (15858 records). [2025-09-24T17:10:06.893610] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-24T17:10:07.221253] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-24T17:10:07.263235] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-24T17:10:07.263323] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-24T17:10:07.263585] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-24T17:10:07.263626] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-24T17:10:07.264310] [DEBUG] [LOCAL ] ALG: Trimmed 15858 records to 10414 (keeping 200 days of data) [2025-09-24T17:10:07.335035] [DEBUG] [LOCAL ] ALG: Primary data saved (10414 records). [2025-09-24T17:10:07.335189] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-24T17:10:07.335283] [INFO ] [MAIN ] Update Progress: 81/2373 symbols completed. ALG took 16.8s. Estimated remaining: 4h 44m 41s. Rate: 8.1 symbols/min [2025-09-24T17:10:07.502463] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:07.553023] [DEBUG] [LOCAL ] ALL: Loaded 50241 existing records from primary storage. [2025-09-24T17:10:07.553163] [INFO ] [MAIN ] ALL: Loaded 50241 existing records. [2025-09-24T17:10:07.732141] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:07.732416] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-24T17:10:07.732464] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-24T17:10:07.734242] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-24T17:10:07.734305] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-24T17:10:08.021183] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-24T17:10:08.100300] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:08.158234] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T17:10:08.816095] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-24T17:10:09.278622] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-24T17:10:09.449921] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T17:10:09.616115] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-24T17:10:10.416146] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-24T17:10:10.511896] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T17:10:10.848821] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:10:11.216085] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-24T17:10:12.016116] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-24T17:10:12.155601] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:10:12.762154] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T17:10:12.816045] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-24T17:10:13.163267] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T17:10:13.616089] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-24T17:10:14.416056] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-24T17:10:14.687864] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T17:10:14.805102] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T17:10:15.216081] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-24T17:10:15.978463] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:10:16.016040] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-24T17:10:16.655119] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T17:10:16.660927] [INFO ] [REMOTE ] ALEX: Full fetch complete (44415 records). [2025-09-24T17:10:16.661040] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-24T17:10:16.661699] [FATAL] [VALIDATOR ] ALEX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:10:16.661789] [FATAL] [MAIN ] ALEX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:10:16.661834] [WARN ] [MAIN ] ALEX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:10:16.661902] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-24T17:10:16.661970] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-09-24T17:10:16.662009] [INFO ] [LOCAL ] ALEX: Starting deletion of derivative data. [2025-09-24T17:10:16.662525] [DEBUG] [LOCAL ] ALEX: Deleted derivative data file. [2025-09-24T17:10:16.662628] [INFO ] [MAIN ] Update Progress: 82/2373 symbols completed. ALEX took 26.1s. Estimated remaining: 4h 45m 26s. Rate: 8.0 symbols/min [2025-09-24T17:10:16.836793] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-24T17:10:16.840723] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:16.892275] [DEBUG] [LOCAL ] ALLE: Loaded 45201 existing records from primary storage. [2025-09-24T17:10:16.892422] [INFO ] [MAIN ] ALLE: Loaded 45201 existing records. [2025-09-24T17:10:17.086903] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:17.087128] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-24T17:10:17.087179] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-24T17:10:17.088783] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-24T17:10:17.088848] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-24T17:10:17.451837] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:17.616095] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-24T17:10:17.730388] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T17:10:18.279303] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T17:10:18.416065] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-24T17:10:19.216107] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-24T17:10:19.328802] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T17:10:20.016136] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-24T17:10:20.279970] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T17:10:20.589522] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:10:20.816085] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-24T17:10:21.580811] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:10:21.616033] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-24T17:10:22.416071] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-24T17:10:22.455373] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T17:10:23.132518] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T17:10:23.216086] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-24T17:10:24.016104] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-24T17:10:24.266894] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T17:10:24.818965] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-24T17:10:24.821683] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T17:10:25.616147] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-24T17:10:25.978863] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T17:10:25.990135] [INFO ] [REMOTE ] ALIT: Full fetch complete (76416 records). [2025-09-24T17:10:25.990418] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-24T17:10:26.429751] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-24T17:10:26.435311] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-24T17:10:26.435518] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-24T17:10:26.436595] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-24T17:10:26.436849] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-24T17:10:26.439372] [DEBUG] [LOCAL ] ALIT: Trimmed 76416 records to 52761 (keeping 200 days of data) [2025-09-24T17:10:26.741304] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T17:10:26.856004] [DEBUG] [LOCAL ] ALIT: Primary data saved (52761 records). [2025-09-24T17:10:26.856236] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-24T17:10:26.856354] [INFO ] [MAIN ] Update Progress: 83/2373 symbols completed. ALIT took 36.3s. Estimated remaining: 4h 46m 34s. Rate: 8.0 symbols/min [2025-09-24T17:10:27.056634] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:27.125358] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-24T17:10:27.125668] [INFO ] [MAIN ] ALLY: Loaded 53218 existing records. [2025-09-24T17:10:27.219392] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-24T17:10:27.339823] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:27.340369] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-24T17:10:27.340453] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-24T17:10:27.342254] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-24T17:10:27.342326] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-24T17:10:27.658699] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T17:10:27.721350] [INFO ] [REMOTE ] ALK: Full fetch complete (76833 records). [2025-09-24T17:10:27.759013] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-24T17:10:27.764906] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:28.026428] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-24T17:10:28.190419] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-24T17:10:28.190629] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-24T17:10:28.191638] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-24T17:10:28.191814] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-24T17:10:28.194321] [DEBUG] [LOCAL ] ALK: Trimmed 76833 records to 53068 (keeping 200 days of data) [2025-09-24T17:10:28.308463] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T17:10:28.560490] [DEBUG] [LOCAL ] ALK: Primary data saved (53068 records). [2025-09-24T17:10:28.560659] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-24T17:10:28.560764] [INFO ] [MAIN ] Update Progress: 84/2373 symbols completed. ALK took 38.0s. Estimated remaining: 4h 43m 48s. Rate: 8.1 symbols/min [2025-09-24T17:10:28.744979] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:28.778241] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T17:10:28.816098] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-24T17:10:28.840048] [DEBUG] [LOCAL ] ALSN: Loaded 43307 existing records from primary storage. [2025-09-24T17:10:28.840229] [INFO ] [MAIN ] ALSN: Loaded 43307 existing records. [2025-09-24T17:10:29.024118] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:29.024441] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-24T17:10:29.024491] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-24T17:10:29.026201] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-24T17:10:29.026270] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-24T17:10:29.385300] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:29.616051] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-24T17:10:29.850522] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T17:10:30.416089] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-24T17:10:30.456153] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T17:10:30.884844] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T17:10:31.216096] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-24T17:10:32.016089] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-24T17:10:32.284435] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T17:10:32.775497] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T17:10:32.816053] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-24T17:10:33.391880] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T17:10:33.616100] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-24T17:10:34.416087] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-24T17:10:34.496543] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T17:10:35.216069] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-24T17:10:35.305440] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T17:10:36.016055] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-24T17:10:36.305284] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T17:10:36.484277] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:10:36.816087] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-24T17:10:37.616103] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-24T17:10:37.704805] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T17:10:38.296117] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T17:10:38.416084] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-24T17:10:39.216143] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-24T17:10:39.294049] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T17:10:40.022496] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-24T17:10:40.039575] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T17:10:40.821202] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-24T17:10:40.839408] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T17:10:41.616053] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-24T17:10:41.804693] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T17:10:41.813982] [INFO ] [REMOTE ] ALL: Full fetch complete (72514 records). [2025-09-24T17:10:41.814152] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-24T17:10:42.268154] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-24T17:10:42.268406] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-24T17:10:42.269550] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-24T17:10:42.269833] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-24T17:10:42.271719] [DEBUG] [LOCAL ] ALL: Trimmed 72514 records to 50194 (keeping 200 days of data) [2025-09-24T17:10:42.409936] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T17:10:42.420208] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-24T17:10:42.644252] [DEBUG] [LOCAL ] ALL: Primary data saved (50194 records). [2025-09-24T17:10:42.644398] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-24T17:10:42.644485] [INFO ] [MAIN ] Update Progress: 85/2373 symbols completed. ALL took 35.3s. Estimated remaining: 4h 46m 39s. Rate: 8.0 symbols/min [2025-09-24T17:10:42.826553] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:42.849523] [DEBUG] [LOCAL ] ALTG: Loaded 23978 existing records from primary storage. [2025-09-24T17:10:42.849673] [INFO ] [MAIN ] ALTG: Loaded 23978 existing records. [2025-09-24T17:10:43.043439] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:43.044116] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-24T17:10:43.044211] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-24T17:10:43.045048] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-24T17:10:43.045133] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-24T17:10:43.229849] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-24T17:10:43.436029] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:43.461531] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T17:10:43.471003] [INFO ] [REMOTE ] ALLE: Full fetch complete (65041 records). [2025-09-24T17:10:43.471170] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-24T17:10:43.891911] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-24T17:10:43.892017] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-24T17:10:43.892700] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-24T17:10:43.892779] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-24T17:10:43.894520] [DEBUG] [LOCAL ] ALLE: Trimmed 65041 records to 45119 (keeping 200 days of data) [2025-09-24T17:10:44.016121] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-24T17:10:44.200532] [DEBUG] [LOCAL ] ALLE: Primary data saved (45119 records). [2025-09-24T17:10:44.200723] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-24T17:10:44.200858] [INFO ] [MAIN ] Update Progress: 86/2373 symbols completed. ALLE took 27.5s. Estimated remaining: 4h 43m 53s. Rate: 8.1 symbols/min [2025-09-24T17:10:44.395960] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:44.434220] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T17:10:44.460611] [DEBUG] [LOCAL ] ALUR: Loaded 10889 existing records from primary storage. [2025-09-24T17:10:44.460864] [INFO ] [MAIN ] ALUR: Loaded 10889 existing records. [2025-09-24T17:10:44.659769] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:44.660193] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-24T17:10:44.660280] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-24T17:10:44.660848] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-24T17:10:44.660969] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-24T17:10:44.826667] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T17:10:44.819100] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-24T17:10:45.081987] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:45.207485] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T17:10:45.616079] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-24T17:10:46.416112] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-24T17:10:46.642386] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T17:10:47.147395] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T17:10:47.216047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-24T17:10:47.640476] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:10:48.016146] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-24T17:10:48.282357] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T17:10:48.816141] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-24T17:10:49.616089] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-24T17:10:49.836304] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T17:10:50.397031] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T17:10:50.416030] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-24T17:10:50.566551] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T17:10:51.216121] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-24T17:10:52.016053] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-24T17:10:52.315772] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T17:10:52.496628] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T17:10:52.816137] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-24T17:10:53.313961] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T17:10:53.616181] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-24T17:10:54.348479] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T17:10:54.361818] [INFO ] [REMOTE ] ALLY: Full fetch complete (76888 records). [2025-09-24T17:10:54.362167] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-24T17:10:54.421269] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-24T17:10:54.799549] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-24T17:10:54.799688] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-24T17:10:54.800465] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-24T17:10:54.800519] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-24T17:10:54.802238] [DEBUG] [LOCAL ] ALLY: Trimmed 76888 records to 53218 (keeping 200 days of data) [2025-09-24T17:10:55.158116] [DEBUG] [LOCAL ] ALLY: Primary data saved (53218 records). [2025-09-24T17:10:55.158341] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-24T17:10:55.160776] [INFO ] [MAIN ] Update Progress: 87/2373 symbols completed. ALLY took 28.3s. Estimated remaining: 4h 45m 18s. Rate: 8.0 symbols/min [2025-09-24T17:10:55.230843] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-24T17:10:55.347692] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T17:10:55.377081] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:55.388832] [INFO ] [REMOTE ] ALSN: Full fetch complete (62037 records). [2025-09-24T17:10:55.389014] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-24T17:10:55.722135] [DEBUG] [LOCAL ] ALV: Loaded 42654 existing records from primary storage. [2025-09-24T17:10:55.735548] [INFO ] [MAIN ] ALV: Loaded 42654 existing records. [2025-09-24T17:10:55.910889] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:10:55.952174] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-24T17:10:55.957677] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-24T17:10:55.984639] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-24T17:10:56.008835] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-24T17:10:56.046063] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:56.041430] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-24T17:10:56.048482] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-24T17:10:56.048587] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-24T17:10:56.049180] [DEBUG] [LOCAL ] ALSN: Trimmed 62037 records to 43286 (keeping 200 days of data) [2025-09-24T17:10:56.050285] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-24T17:10:56.050406] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-24T17:10:56.608556] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:56.674145] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:10:56.710004] [DEBUG] [LOCAL ] ALSN: Primary data saved (43286 records). [2025-09-24T17:10:56.710138] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-24T17:10:56.713884] [INFO ] [MAIN ] Update Progress: 88/2373 symbols completed. ALSN took 28.2s. Estimated remaining: 4h 42m 37s. Rate: 8.1 symbols/min [2025-09-24T17:10:56.821381] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-24T17:10:56.890111] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:10:56.901059] [DEBUG] [LOCAL ] ALX: Loaded 5959 existing records from primary storage. [2025-09-24T17:10:56.901192] [INFO ] [MAIN ] ALX: Loaded 5959 existing records. [2025-09-24T17:10:57.094939] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:10:57.095456] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-24T17:10:57.095540] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-24T17:10:57.096173] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-24T17:10:57.096233] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-24T17:10:57.290237] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T17:10:57.485347] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:10:57.616040] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-24T17:10:58.269057] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T17:10:58.416058] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-24T17:10:58.619632] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T17:10:59.216106] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-24T17:10:59.772616] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:11:00.016128] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-24T17:11:00.816114] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-24T17:11:00.843925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T17:11:01.067848] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T17:11:01.198117] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-24T17:11:01.616088] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-24T17:11:02.136499] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T17:11:02.416102] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-24T17:11:03.216096] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-24T17:11:03.644769] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T17:11:03.696793] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T17:11:04.016116] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-24T17:11:04.816060] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-24T17:11:05.279009] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T17:11:05.397961] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T17:11:05.616078] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-24T17:11:06.416131] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-24T17:11:06.515203] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T17:11:07.216141] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-24T17:11:07.632355] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:11:08.016086] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-24T17:11:08.816120] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-24T17:11:09.254044] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T17:11:09.259441] [INFO ] [REMOTE ] ALTG: Full fetch complete (33684 records). [2025-09-24T17:11:09.259540] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-24T17:11:09.401846] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-24T17:11:09.588143] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T17:11:09.621139] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-24T17:11:09.687250] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-24T17:11:09.687329] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-24T17:11:09.687736] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-24T17:11:09.687817] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-24T17:11:09.690065] [DEBUG] [LOCAL ] ALTG: Trimmed 33684 records to 23914 (keeping 200 days of data) [2025-09-24T17:11:09.835561] [DEBUG] [LOCAL ] ALTG: Primary data saved (23914 records). [2025-09-24T17:11:09.835719] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-24T17:11:09.835901] [INFO ] [MAIN ] Update Progress: 89/2373 symbols completed. ALTG took 27.2s. Estimated remaining: 4h 44m 55s. Rate: 8.0 symbols/min [2025-09-24T17:11:10.010312] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:10.067210] [DEBUG] [LOCAL ] AM: Loaded 52154 existing records from primary storage. [2025-09-24T17:11:10.067354] [INFO ] [MAIN ] AM: Loaded 52154 existing records. [2025-09-24T17:11:10.253557] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:10.253824] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-24T17:11:10.253889] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-24T17:11:10.255874] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-24T17:11:10.255948] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-24T17:11:10.429831] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-24T17:11:10.619052] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:10.957634] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T17:11:11.216052] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-24T17:11:12.016050] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-24T17:11:12.121000] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T17:11:12.762512] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T17:11:12.816073] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-24T17:11:12.827178] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T17:11:13.616127] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-24T17:11:14.416080] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-24T17:11:14.449908] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T17:11:14.511283] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T17:11:15.216096] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-24T17:11:15.322879] [DEBUG] [REMOTE ] AM: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-24T17:11:15.323200] [WARN ] [REMOTE ] AM: No data returned for month 2025-02 [2025-09-24T17:11:15.927156] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:11:16.016063] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-24T17:11:16.534117] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T17:11:16.816088] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-24T17:11:17.616159] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-24T17:11:18.402106] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T17:11:18.416047] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-24T17:11:18.457737] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T17:11:19.216101] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-24T17:11:19.391503] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T17:11:20.016124] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-24T17:11:20.816089] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-24T17:11:20.834204] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T17:11:20.866318] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T17:11:21.616089] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-24T17:11:22.416117] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-24T17:11:22.516546] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T17:11:23.141858] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:11:23.216043] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-24T17:11:23.311020] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T17:11:23.312965] [INFO ] [REMOTE ] ALX: Full fetch complete (6877 records). [2025-09-24T17:11:23.313035] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-24T17:11:23.708059] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-24T17:11:23.708148] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-24T17:11:23.708320] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-24T17:11:23.708361] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-24T17:11:23.708842] [DEBUG] [LOCAL ] ALX: Trimmed 6877 records to 6011 (keeping 200 days of data) [2025-09-24T17:11:23.749729] [DEBUG] [LOCAL ] ALX: Primary data saved (6011 records). [2025-09-24T17:11:23.749866] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-24T17:11:23.749954] [INFO ] [MAIN ] Update Progress: 90/2373 symbols completed. ALX took 27.0s. Estimated remaining: 4h 47m 31s. Rate: 7.9 symbols/min [2025-09-24T17:11:23.932723] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:23.977288] [DEBUG] [LOCAL ] AMBC: Loaded 37181 existing records from primary storage. [2025-09-24T17:11:23.977511] [INFO ] [MAIN ] AMBC: Loaded 37181 existing records. [2025-09-24T17:11:24.025342] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-24T17:11:24.183184] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:24.187567] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-24T17:11:24.187764] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T17:11:24.189319] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-24T17:11:24.189723] [INFO ] [REMOTE ] ALUR: Full fetch complete (20885 records). [2025-09-24T17:11:24.189797] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-24T17:11:24.206688] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-24T17:11:24.255901] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-24T17:11:24.835960] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-24T17:11:24.937831] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-24T17:11:24.951380] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-24T17:11:24.974861] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-24T17:11:24.974974] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-24T17:11:24.981025] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:24.982454] [DEBUG] [LOCAL ] ALUR: Trimmed 20885 records to 10867 (keeping 200 days of data) [2025-09-24T17:11:25.049237] [DEBUG] [LOCAL ] ALUR: Primary data saved (10867 records). [2025-09-24T17:11:25.049386] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-24T17:11:25.049483] [INFO ] [MAIN ] Update Progress: 91/2373 symbols completed. ALUR took 40.8s. Estimated remaining: 4h 44m 47s. Rate: 8.0 symbols/min [2025-09-24T17:11:25.217124] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:25.270976] [DEBUG] [LOCAL ] AMBP: Loaded 45331 existing records from primary storage. [2025-09-24T17:11:25.271143] [INFO ] [MAIN ] AMBP: Loaded 45331 existing records. [2025-09-24T17:11:25.450173] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:25.450436] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-24T17:11:25.450494] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-24T17:11:25.451737] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-24T17:11:25.451800] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-24T17:11:25.616531] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-24T17:11:25.825152] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:25.853523] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T17:11:26.416059] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-24T17:11:26.798636] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T17:11:27.044737] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T17:11:27.216104] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-24T17:11:27.986115] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T17:11:28.016044] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-24T17:11:28.046970] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T17:11:28.816134] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-24T17:11:29.618865] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-24T17:11:29.624104] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T17:11:29.631706] [INFO ] [REMOTE ] ALV: Full fetch complete (61856 records). [2025-09-24T17:11:29.631842] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-24T17:11:30.041028] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-24T17:11:30.041114] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-24T17:11:30.041743] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-24T17:11:30.041810] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-24T17:11:30.044388] [DEBUG] [LOCAL ] ALV: Trimmed 61856 records to 42613 (keeping 200 days of data) [2025-09-24T17:11:30.327060] [DEBUG] [LOCAL ] ALV: Primary data saved (42613 records). [2025-09-24T17:11:30.327196] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-24T17:11:30.327284] [INFO ] [MAIN ] Update Progress: 92/2373 symbols completed. ALV took 35.2s. Estimated remaining: 4h 43m 44s. Rate: 8.0 symbols/min [2025-09-24T17:11:30.418613] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-24T17:11:30.502843] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:30.503049] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-24T17:11:30.503099] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-24T17:11:30.503344] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-24T17:11:30.503397] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-24T17:11:30.503441] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-24T17:11:30.503511] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-24T17:11:30.750745] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:11:30.925747] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:31.216081] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-24T17:11:31.334284] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T17:11:31.727567] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T17:11:32.016185] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-24T17:11:32.280951] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:32.281607] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-24T17:11:32.738477] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T17:11:32.816093] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-24T17:11:33.616161] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-24T17:11:34.383395] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T17:11:34.416083] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-24T17:11:34.830257] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T17:11:35.216090] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-24T17:11:35.534878] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:35.535194] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-24T17:11:35.743169] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T17:11:36.016088] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-24T17:11:36.222962] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:36.223288] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-24T17:11:36.816087] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-24T17:11:37.018414] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:37.018748] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-24T17:11:37.616085] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-24T17:11:38.416100] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-24T17:11:38.833827] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T17:11:39.216087] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-24T17:11:40.016059] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-24T17:11:40.056982] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T17:11:40.214959] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:40.215272] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-24T17:11:40.816049] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-24T17:11:40.895344] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T17:11:41.082763] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:41.083143] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-24T17:11:41.616079] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-24T17:11:42.416091] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-24T17:11:43.013482] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T17:11:43.216127] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-24T17:11:43.410619] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:11:43.410927] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-24T17:11:43.658848] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T17:11:44.016100] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-24T17:11:44.816091] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-24T17:11:45.616057] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-24T17:11:45.780586] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T17:11:45.790422] [INFO ] [REMOTE ] AM: Full fetch complete (68312 records). [2025-09-24T17:11:45.790566] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-24T17:11:46.028588] [WARN ] [VALIDATOR ] AM: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-24T17:11:46.031791] [FATAL] [MAIN ] AM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:11:46.033446] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:11:46.032486] [WARN ] [MAIN ] AM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:11:46.040776] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-24T17:11:46.041218] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-09-24T17:11:46.041288] [INFO ] [LOCAL ] AM: Starting deletion of derivative data. [2025-09-24T17:11:46.042118] [DEBUG] [LOCAL ] AM: Deleted derivative data file. [2025-09-24T17:11:46.042223] [INFO ] [MAIN ] Update Progress: 93/2373 symbols completed. AM took 36.2s. Estimated remaining: 4h 46m 59s. Rate: 7.9 symbols/min [2025-09-24T17:11:46.223304] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:46.276274] [DEBUG] [LOCAL ] AMC: Loaded 53758 existing records from primary storage. [2025-09-24T17:11:46.276444] [INFO ] [MAIN ] AMC: Loaded 53758 existing records. [2025-09-24T17:11:46.421138] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-24T17:11:46.459307] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:46.459554] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-24T17:11:46.459601] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-24T17:11:46.461538] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-24T17:11:46.461599] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-24T17:11:46.826143] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:46.977237] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:11:47.060813] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T17:11:47.216045] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-24T17:11:48.016097] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-24T17:11:48.682588] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T17:11:48.816117] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-24T17:11:49.402536] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-24T17:11:49.616139] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-24T17:11:50.177384] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:11:50.416141] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-24T17:11:50.670685] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T17:11:50.675152] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7842 records). [2025-09-24T17:11:50.675227] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-24T17:11:50.891621] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-24T17:11:50.891948] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:11:50.892039] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:11:50.892137] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-24T17:11:50.892239] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-24T17:11:50.892281] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-24T17:11:50.892322] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-24T17:11:50.892385] [INFO ] [MAIN ] Update Progress: 94/2373 symbols completed. AMBQ took 20.6s. Estimated remaining: 4h 45m 46s. Rate: 8.0 symbols/min [2025-09-24T17:11:51.063142] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:51.116931] [DEBUG] [LOCAL ] AMCR: Loaded 53668 existing records from primary storage. [2025-09-24T17:11:51.117088] [INFO ] [MAIN ] AMCR: Loaded 53668 existing records. [2025-09-24T17:11:51.217404] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-24T17:11:51.296600] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:51.296952] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-24T17:11:51.297005] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-24T17:11:51.298630] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-24T17:11:51.298736] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-24T17:11:51.676297] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:51.691820] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T17:11:51.697734] [INFO ] [REMOTE ] AMBC: Full fetch complete (51044 records). [2025-09-24T17:11:51.697918] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-24T17:11:52.021374] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-24T17:11:52.157081] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-24T17:11:52.157188] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-24T17:11:52.157779] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-24T17:11:52.157845] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-24T17:11:52.159249] [DEBUG] [LOCAL ] AMBC: Trimmed 51044 records to 37037 (keeping 200 days of data) [2025-09-24T17:11:52.369137] [DEBUG] [LOCAL ] AMBC: Primary data saved (37037 records). [2025-09-24T17:11:52.369296] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-24T17:11:52.370364] [INFO ] [MAIN ] Update Progress: 95/2373 symbols completed. AMBC took 28.6s. Estimated remaining: 4h 43m 14s. Rate: 8.0 symbols/min [2025-09-24T17:11:52.561282] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:11:52.618913] [DEBUG] [LOCAL ] AME: Loaded 48543 existing records from primary storage. [2025-09-24T17:11:52.619094] [INFO ] [MAIN ] AME: Loaded 48543 existing records. [2025-09-24T17:11:52.819119] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-24T17:11:52.823073] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:11:52.824160] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-24T17:11:52.824235] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-24T17:11:52.825840] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-24T17:11:52.825907] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-24T17:11:53.221615] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:11:53.592746] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:11:53.616039] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-24T17:11:53.716672] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-24T17:11:54.416124] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-24T17:11:54.994310] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-24T17:11:55.216158] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-24T17:11:55.381920] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T17:11:55.837295] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T17:11:56.016125] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-24T17:11:56.816099] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-24T17:11:57.320949] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T17:11:57.383729] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T17:11:57.616080] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-24T17:11:57.977466] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T17:11:58.416088] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-24T17:11:59.216084] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-24T17:11:59.858011] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-24T17:11:59.965723] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T17:12:00.016034] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-24T17:12:00.796475] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T17:12:00.804309] [INFO ] [REMOTE ] AMBP: Full fetch complete (65996 records). [2025-09-24T17:12:00.804468] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-24T17:12:00.821247] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-24T17:12:01.255760] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-24T17:12:01.255878] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-24T17:12:01.256537] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-24T17:12:01.256614] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-24T17:12:01.258126] [DEBUG] [LOCAL ] AMBP: Trimmed 65996 records to 45326 (keeping 200 days of data) [2025-09-24T17:12:01.527967] [DEBUG] [LOCAL ] AMBP: Primary data saved (45326 records). [2025-09-24T17:12:01.528106] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-24T17:12:01.528191] [INFO ] [MAIN ] Update Progress: 96/2373 symbols completed. AMBP took 36.5s. Estimated remaining: 4h 43m 46s. Rate: 8.0 symbols/min [2025-09-24T17:12:01.619964] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-24T17:12:01.704294] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:01.735915] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T17:12:01.764884] [DEBUG] [LOCAL ] AMG: Loaded 20774 existing records from primary storage. [2025-09-24T17:12:01.765051] [INFO ] [MAIN ] AMG: Loaded 20774 existing records. [2025-09-24T17:12:01.957871] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:01.958167] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-24T17:12:01.958234] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-24T17:12:01.959128] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-24T17:12:01.959192] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-24T17:12:02.346148] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:02.416080] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-24T17:12:03.216139] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-24T17:12:03.455406] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-24T17:12:04.016089] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-24T17:12:04.530007] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-24T17:12:04.816052] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-24T17:12:05.033373] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-24T17:12:05.616095] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-24T17:12:06.384387] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-09-24T17:12:06.421589] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-24T17:12:06.423861] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T17:12:06.470354] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-24T17:12:07.216049] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-24T17:12:07.319489] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-24T17:12:08.016053] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-24T17:12:08.228094] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T17:12:08.353120] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T17:12:08.816084] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-24T17:12:09.616128] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-24T17:12:10.019350] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T17:12:10.199063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T17:12:10.416091] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-24T17:12:11.216107] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-24T17:12:11.423225] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:12:12.016170] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-24T17:12:12.422033] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T17:12:12.820896] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-24T17:12:12.834802] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-24T17:12:13.553811] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:12:13.616044] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-24T17:12:14.416061] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-24T17:12:14.971359] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T17:12:15.216076] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-24T17:12:15.286080] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T17:12:16.006621] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T17:12:16.016021] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-24T17:12:16.816086] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-24T17:12:17.461824] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T17:12:17.616088] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-24T17:12:18.198731] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-24T17:12:18.416093] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-24T17:12:19.216122] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-24T17:12:19.736534] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T17:12:19.931924] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-09-24T17:12:19.948978] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:12:20.016108] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-24T17:12:20.295070] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T17:12:20.816090] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-24T17:12:21.616129] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-24T17:12:22.287471] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T17:12:22.309948] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T17:12:22.416106] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-24T17:12:22.783157] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-24T17:12:23.216129] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-24T17:12:23.292175] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T17:12:23.298194] [INFO ] [REMOTE ] AMG: Full fetch complete (29821 records). [2025-09-24T17:12:23.298361] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-24T17:12:23.694235] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-24T17:12:23.694325] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-24T17:12:23.694795] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-24T17:12:23.694861] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-24T17:12:23.695808] [DEBUG] [LOCAL ] AMG: Trimmed 29821 records to 20745 (keeping 200 days of data) [2025-09-24T17:12:23.834494] [DEBUG] [LOCAL ] AMG: Primary data saved (20745 records). [2025-09-24T17:12:23.834632] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-24T17:12:23.834759] [INFO ] [MAIN ] Update Progress: 97/2373 symbols completed. AMG took 22.3s. Estimated remaining: 4h 49m 27s. Rate: 7.9 symbols/min [2025-09-24T17:12:24.021819] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-24T17:12:24.052032] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:24.108250] [DEBUG] [LOCAL ] AMH: Loaded 51695 existing records from primary storage. [2025-09-24T17:12:24.108411] [INFO ] [MAIN ] AMH: Loaded 51695 existing records. [2025-09-24T17:12:24.398387] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:24.398786] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-24T17:12:24.398867] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-24T17:12:24.401388] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-24T17:12:24.401472] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-24T17:12:24.819795] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-24T17:12:24.960565] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:25.027151] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T17:12:25.616087] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-24T17:12:26.342487] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-24T17:12:26.351913] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-24T17:12:26.352070] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-24T17:12:26.424070] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-24T17:12:26.758439] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-24T17:12:26.758527] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-24T17:12:26.759285] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-24T17:12:26.759352] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-24T17:12:26.761062] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-24T17:12:27.087369] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-24T17:12:27.087515] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-24T17:12:27.088358] [INFO ] [MAIN ] Update Progress: 98/2373 symbols completed. AMCR took 36.2s. Estimated remaining: 4h 47m 38s. Rate: 7.9 symbols/min [2025-09-24T17:12:27.269429] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:27.312481] [DEBUG] [LOCAL ] AMN: Loaded 42049 existing records from primary storage. [2025-09-24T17:12:27.312714] [INFO ] [MAIN ] AMN: Loaded 42049 existing records. [2025-09-24T17:12:27.505587] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:27.527269] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T17:12:27.526462] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-24T17:12:27.536057] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-24T17:12:27.536543] [INFO ] [REMOTE ] AME: Full fetch complete (69396 records). [2025-09-24T17:12:27.536743] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-24T17:12:27.547416] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-24T17:12:27.537952] [FATAL] [VALIDATOR ] AME: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:12:27.552764] [FATAL] [MAIN ] AME: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:12:27.564039] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-24T17:12:27.563979] [WARN ] [MAIN ] AME: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:12:27.585755] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-24T17:12:27.601883] [DEBUG] [LOCAL ] AME: No primary data file found to delete. [2025-09-24T17:12:27.609220] [INFO ] [LOCAL ] AME: Starting deletion of derivative data. [2025-09-24T17:12:27.612493] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-24T17:12:27.639685] [DEBUG] [LOCAL ] AME: Deleted derivative data file. [2025-09-24T17:12:27.656355] [INFO ] [MAIN ] Update Progress: 99/2373 symbols completed. AME took 35.3s. Estimated remaining: 4h 44m 49s. Rate: 8.0 symbols/min [2025-09-24T17:12:27.685209] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-24T17:12:27.685798] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-24T17:12:28.219691] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:28.433174] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:28.457488] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-24T17:12:28.569926] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-24T17:12:28.570110] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-24T17:12:28.570932] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-24T17:12:28.571219] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-24T17:12:28.596431] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53759 (keeping 200 days of data) [2025-09-24T17:12:28.596184] [DEBUG] [LOCAL ] AMP: Loaded 32522 existing records from primary storage. [2025-09-24T17:12:28.614693] [INFO ] [MAIN ] AMP: Loaded 32522 existing records. [2025-09-24T17:12:28.616736] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-24T17:12:28.734348] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-24T17:12:28.917740] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:28.918811] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-24T17:12:28.919384] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-24T17:12:28.921703] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-24T17:12:28.922063] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-24T17:12:29.376854] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:29.377969] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-24T17:12:29.484733] [DEBUG] [LOCAL ] AMC: Primary data saved (53759 records). [2025-09-24T17:12:29.484880] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-24T17:12:29.484968] [INFO ] [MAIN ] Update Progress: 100/2373 symbols completed. AMC took 43.4s. Estimated remaining: 4h 42m 32s. Rate: 8.0 symbols/min [2025-09-24T17:12:29.651816] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:29.703284] [DEBUG] [LOCAL ] AMPX: Loaded 52164 existing records from primary storage. [2025-09-24T17:12:29.703427] [INFO ] [MAIN ] AMPX: Loaded 52164 existing records. [2025-09-24T17:12:29.881024] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:29.881243] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-24T17:12:29.881298] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-24T17:12:29.882967] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-24T17:12:29.883029] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-24T17:12:30.249068] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:30.249587] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-24T17:12:30.277032] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T17:12:30.347184] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:12:30.416032] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-24T17:12:30.507380] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T17:12:31.216113] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-24T17:12:31.733929] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T17:12:32.016114] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-24T17:12:32.216845] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:12:32.479633] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:12:32.816132] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-24T17:12:33.589128] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T17:12:33.616110] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-24T17:12:34.416072] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-24T17:12:34.768365] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T17:12:35.060594] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T17:12:35.216118] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-24T17:12:36.016114] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-24T17:12:36.149359] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:12:36.339262] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T17:12:36.816092] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-24T17:12:37.439275] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T17:12:37.616121] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-24T17:12:38.416114] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-24T17:12:38.598114] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T17:12:38.807214] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T17:12:39.216090] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-24T17:12:40.016091] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-24T17:12:40.214254] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T17:12:40.786819] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T17:12:40.816031] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-24T17:12:41.485835] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:12:41.616058] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-24T17:12:42.341769] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T17:12:42.416085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-24T17:12:43.145524] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T17:12:43.216034] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-24T17:12:43.841768] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T17:12:44.016109] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-24T17:12:44.378174] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T17:12:44.816083] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-24T17:12:45.544199] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:12:45.616041] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-24T17:12:46.283468] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T17:12:46.416085] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-24T17:12:47.220232] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-24T17:12:47.225825] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:12:48.016080] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-24T17:12:48.151623] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:12:48.715438] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T17:12:48.816102] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-24T17:12:49.411090] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T17:12:49.616098] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-24T17:12:50.416111] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-24T17:12:50.628180] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:12:51.216191] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-24T17:12:51.381619] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T17:12:52.016200] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-24T17:12:52.100096] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T17:12:52.108607] [INFO ] [REMOTE ] AMN: Full fetch complete (60458 records). [2025-09-24T17:12:52.108824] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-24T17:12:52.522986] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-24T17:12:52.523101] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-24T17:12:52.523757] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-24T17:12:52.523819] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-24T17:12:52.525117] [DEBUG] [LOCAL ] AMN: Trimmed 60458 records to 42019 (keeping 200 days of data) [2025-09-24T17:12:52.753876] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:12:52.811036] [DEBUG] [LOCAL ] AMN: Primary data saved (42019 records). [2025-09-24T17:12:52.811172] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-24T17:12:52.814816] [INFO ] [MAIN ] Update Progress: 101/2373 symbols completed. AMN took 25.7s. Estimated remaining: 4h 48m 22s. Rate: 7.9 symbols/min [2025-09-24T17:12:52.826453] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-24T17:12:52.988537] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:53.028375] [DEBUG] [LOCAL ] AMPY: Loaded 37407 existing records from primary storage. [2025-09-24T17:12:53.028522] [INFO ] [MAIN ] AMPY: Loaded 37407 existing records. [2025-09-24T17:12:53.209179] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:53.209481] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-24T17:12:53.209531] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-24T17:12:53.210974] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-24T17:12:53.211036] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-24T17:12:53.605280] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:53.616085] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-24T17:12:53.735187] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T17:12:53.744991] [INFO ] [REMOTE ] AMH: Full fetch complete (74752 records). [2025-09-24T17:12:53.745145] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-24T17:12:54.161933] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-24T17:12:54.162024] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-24T17:12:54.162757] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-24T17:12:54.162822] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-24T17:12:54.164324] [DEBUG] [LOCAL ] AMH: Trimmed 74752 records to 51691 (keeping 200 days of data) [2025-09-24T17:12:54.416294] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-24T17:12:54.501710] [DEBUG] [LOCAL ] AMH: Primary data saved (51691 records). [2025-09-24T17:12:54.501892] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-24T17:12:54.502050] [INFO ] [MAIN ] Update Progress: 102/2373 symbols completed. AMH took 30.7s. Estimated remaining: 4h 46m 2s. Rate: 7.9 symbols/min [2025-09-24T17:12:54.632131] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T17:12:54.747137] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T17:12:54.744516] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:12:54.791783] [DEBUG] [LOCAL ] AMR: Loaded 29107 existing records from primary storage. [2025-09-24T17:12:54.791932] [INFO ] [MAIN ] AMR: Loaded 29107 existing records. [2025-09-24T17:12:54.980607] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:12:54.980933] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-24T17:12:54.980986] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-24T17:12:54.982042] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-24T17:12:54.982106] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-24T17:12:55.228133] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-24T17:12:55.365911] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:12:55.646438] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T17:12:56.016088] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-24T17:12:56.487884] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:12:56.816137] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-24T17:12:57.616160] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-24T17:12:57.731991] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T17:12:58.350121] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T17:12:58.416059] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-24T17:12:58.468571] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T17:12:59.216160] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-24T17:13:00.016057] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-24T17:13:00.345629] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T17:13:00.688434] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T17:13:00.816038] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-24T17:13:01.549795] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T17:13:01.556356] [INFO ] [REMOTE ] AMP: Full fetch complete (47565 records). [2025-09-24T17:13:01.556619] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-24T17:13:01.628467] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-24T17:13:01.998849] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-24T17:13:01.998951] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-24T17:13:01.999504] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-24T17:13:01.999572] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-24T17:13:02.000969] [DEBUG] [LOCAL ] AMP: Trimmed 47565 records to 32444 (keeping 200 days of data) [2025-09-24T17:13:02.214490] [DEBUG] [LOCAL ] AMP: Primary data saved (32444 records). [2025-09-24T17:13:02.214665] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-24T17:13:02.214787] [INFO ] [MAIN ] Update Progress: 103/2373 symbols completed. AMP took 34.5s. Estimated remaining: 4h 45m 58s. Rate: 7.9 symbols/min [2025-09-24T17:13:02.392617] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:02.416102] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-24T17:13:02.430216] [DEBUG] [LOCAL ] AMRC: Loaded 38438 existing records from primary storage. [2025-09-24T17:13:02.430360] [INFO ] [MAIN ] AMRC: Loaded 38438 existing records. [2025-09-24T17:13:02.618280] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:13:02.618534] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-24T17:13:02.618585] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-24T17:13:02.619803] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-24T17:13:02.619877] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-24T17:13:02.998950] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:03.024145] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T17:13:03.121349] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T17:13:03.130729] [INFO ] [REMOTE ] AMPX: Full fetch complete (74555 records). [2025-09-24T17:13:03.130852] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-24T17:13:03.221793] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-24T17:13:03.532008] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-24T17:13:03.532218] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-24T17:13:03.533133] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-24T17:13:03.533267] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-24T17:13:03.535284] [DEBUG] [LOCAL ] AMPX: Trimmed 74555 records to 52169 (keeping 200 days of data) [2025-09-24T17:13:03.749998] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T17:13:03.861693] [DEBUG] [LOCAL ] AMPX: Primary data saved (52169 records). [2025-09-24T17:13:03.862050] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-24T17:13:03.862280] [INFO ] [MAIN ] Update Progress: 104/2373 symbols completed. AMPX took 34.4s. Estimated remaining: 4h 43m 41s. Rate: 8.0 symbols/min [2025-09-24T17:13:04.024716] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-24T17:13:04.042685] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:04.045026] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-24T17:13:04.045092] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-24T17:13:04.045250] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-24T17:13:04.045307] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-24T17:13:04.045400] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-24T17:13:04.045447] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-24T17:13:04.444750] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:04.445849] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:13:04.816089] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-24T17:13:05.039909] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T17:13:05.616090] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-24T17:13:06.327086] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:13:06.416134] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-24T17:13:07.015699] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T17:13:07.216111] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-24T17:13:07.951904] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:13:08.016105] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-24T17:13:08.237536] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:08.237944] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-24T17:13:08.641211] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T17:13:08.816091] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-24T17:13:09.030092] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:09.030489] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-24T17:13:09.616092] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-24T17:13:10.416094] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-24T17:13:10.639426] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T17:13:11.216089] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-24T17:13:11.488321] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:11.488636] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-24T17:13:11.954072] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T17:13:12.016074] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-24T17:13:12.816080] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-24T17:13:13.512540] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:13.512929] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-24T17:13:13.543367] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:13:13.616038] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-24T17:13:13.854155] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:13.854446] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-24T17:13:14.416119] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-24T17:13:15.216103] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-24T17:13:15.426704] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:13:15.427127] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-24T17:13:15.866548] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T17:13:16.016079] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-24T17:13:16.816129] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-24T17:13:17.625453] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-24T17:13:17.634347] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T17:13:17.647496] [INFO ] [REMOTE ] AMPY: Full fetch complete (50326 records). [2025-09-24T17:13:17.648276] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-24T17:13:18.213708] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-24T17:13:18.213831] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-24T17:13:18.214388] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-24T17:13:18.214498] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-24T17:13:18.215894] [DEBUG] [LOCAL ] AMPY: Trimmed 50326 records to 37388 (keeping 200 days of data) [2025-09-24T17:13:18.343232] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T17:13:18.434364] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-24T17:13:18.465638] [DEBUG] [LOCAL ] AMPY: Primary data saved (37388 records). [2025-09-24T17:13:18.465823] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-24T17:13:18.466613] [INFO ] [MAIN ] Update Progress: 105/2373 symbols completed. AMPY took 25.7s. Estimated remaining: 4h 46m 7s. Rate: 7.9 symbols/min [2025-09-24T17:13:18.642024] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:18.701201] [DEBUG] [LOCAL ] AMT: Loaded 52450 existing records from primary storage. [2025-09-24T17:13:18.701355] [INFO ] [MAIN ] AMT: Loaded 52450 existing records. [2025-09-24T17:13:18.881085] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:13:18.881339] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-24T17:13:18.881386] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-24T17:13:18.883196] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-24T17:13:18.883276] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-24T17:13:19.216708] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-24T17:13:19.232179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T17:13:19.282415] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:20.016054] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-24T17:13:20.052943] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T17:13:20.359961] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T17:13:20.816057] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-24T17:13:20.941510] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T17:13:21.616081] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-24T17:13:22.416060] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-24T17:13:22.517411] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:13:22.859006] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T17:13:23.216088] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-24T17:13:24.016062] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-24T17:13:24.480954] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-24T17:13:24.701761] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T17:13:24.816090] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-24T17:13:25.616058] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-24T17:13:25.810873] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T17:13:25.979429] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T17:13:26.416091] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-24T17:13:26.788334] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T17:13:27.216072] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-24T17:13:28.016128] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-24T17:13:28.240402] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T17:13:28.249736] [INFO ] [REMOTE ] AMRZ: Full fetch complete (24966 records). [2025-09-24T17:13:28.249849] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-24T17:13:28.441543] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-24T17:13:28.441966] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:13:28.442051] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:13:28.442129] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-24T17:13:28.442197] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-24T17:13:28.442253] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-24T17:13:28.442337] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-24T17:13:28.442443] [INFO ] [MAIN ] Update Progress: 106/2373 symbols completed. AMRZ took 24.6s. Estimated remaining: 4h 46m 51s. Rate: 7.9 symbols/min [2025-09-24T17:13:28.618040] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:28.642015] [DEBUG] [LOCAL ] AMTB: Loaded 20436 existing records from primary storage. [2025-09-24T17:13:28.642144] [INFO ] [MAIN ] AMTB: Loaded 20436 existing records. [2025-09-24T17:13:28.836366] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-24T17:13:28.845100] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:13:28.845532] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-24T17:13:28.845602] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-24T17:13:28.846440] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-24T17:13:28.846507] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-24T17:13:29.225160] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:29.276450] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T17:13:29.284509] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T17:13:29.616083] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-24T17:13:30.416069] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-24T17:13:30.553448] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T17:13:30.831099] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:13:31.216102] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-24T17:13:31.659087] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T17:13:31.664265] [INFO ] [REMOTE ] AMR: Full fetch complete (39657 records). [2025-09-24T17:13:31.664407] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-24T17:13:32.021235] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-24T17:13:32.073730] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-24T17:13:32.073835] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-24T17:13:32.074324] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-24T17:13:32.074388] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-24T17:13:32.075538] [DEBUG] [LOCAL ] AMR: Trimmed 39657 records to 29069 (keeping 200 days of data) [2025-09-24T17:13:32.278522] [DEBUG] [LOCAL ] AMR: Primary data saved (29069 records). [2025-09-24T17:13:32.278731] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-24T17:13:32.278931] [INFO ] [MAIN ] Update Progress: 107/2373 symbols completed. AMR took 37.8s. Estimated remaining: 4h 45m 24s. Rate: 7.9 symbols/min [2025-09-24T17:13:32.457584] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:32.464968] [DEBUG] [LOCAL ] AMTD: Loaded 3564 existing records from primary storage. [2025-09-24T17:13:32.465065] [INFO ] [MAIN ] AMTD: Loaded 3564 existing records. [2025-09-24T17:13:32.656309] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:13:32.656887] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-24T17:13:32.656982] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-24T17:13:32.657386] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-24T17:13:32.657564] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-24T17:13:32.821142] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-24T17:13:33.002807] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:13:33.087617] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:33.582840] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T17:13:33.616047] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-24T17:13:33.983860] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T17:13:34.337556] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T17:13:34.416080] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-24T17:13:35.216103] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-24T17:13:36.016056] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-24T17:13:36.323502] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T17:13:36.648168] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T17:13:36.655214] [INFO ] [REMOTE ] AMRC: Full fetch complete (52469 records). [2025-09-24T17:13:36.655335] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-24T17:13:36.818445] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-24T17:13:37.060505] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-24T17:13:37.071542] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-24T17:13:37.072615] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-24T17:13:37.073106] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T17:13:37.077850] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-24T17:13:37.079227] [DEBUG] [LOCAL ] AMRC: Trimmed 52469 records to 38324 (keeping 200 days of data) [2025-09-24T17:13:37.311714] [DEBUG] [LOCAL ] AMRC: Primary data saved (38324 records). [2025-09-24T17:13:37.311863] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-24T17:13:37.314507] [INFO ] [MAIN ] Update Progress: 108/2373 symbols completed. AMRC took 35.1s. Estimated remaining: 4h 44m 24s. Rate: 8.0 symbols/min [2025-09-24T17:13:37.488024] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:37.488225] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-09-24T17:13:37.488280] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-09-24T17:13:37.488443] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-24T17:13:37.488488] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-24T17:13:37.488531] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-24T17:13:37.488565] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-24T17:13:37.627862] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-24T17:13:37.845622] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:38.416045] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-24T17:13:38.515723] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T17:13:38.550750] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T17:13:39.016387] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T17:13:39.216118] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-24T17:13:40.016089] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-24T17:13:40.816110] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-24T17:13:41.168623] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T17:13:41.616087] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-24T17:13:41.964756] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T17:13:42.211844] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T17:13:42.416091] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-24T17:13:43.216172] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-24T17:13:43.373199] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T17:13:43.813338] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T17:13:43.847784] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T17:13:44.016058] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-24T17:13:44.816107] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-24T17:13:45.616079] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-24T17:13:45.905274] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:13:45.935900] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T17:13:46.416093] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-24T17:13:47.168695] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T17:13:47.216091] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-24T17:13:48.016126] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-24T17:13:48.161030] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:13:48.816039] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-24T17:13:48.989168] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T17:13:49.091139] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T17:13:49.283045] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T17:13:49.616093] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-24T17:13:50.416102] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-24T17:13:50.690268] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T17:13:51.216102] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-24T17:13:51.690926] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T17:13:52.016055] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-24T17:13:52.193711] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:13:52.816102] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-24T17:13:53.133337] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T17:13:53.616150] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-24T17:13:54.416078] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-24T17:13:54.476599] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T17:13:54.700140] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T17:13:55.216098] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-24T17:13:55.406071] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T17:13:55.409493] [INFO ] [REMOTE ] AMTB: Full fetch complete (30221 records). [2025-09-24T17:13:55.409571] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-24T17:13:55.783066] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-24T17:13:55.783146] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-24T17:13:55.783526] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-24T17:13:55.783569] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-24T17:13:55.784311] [DEBUG] [LOCAL ] AMTB: Trimmed 30221 records to 20392 (keeping 200 days of data) [2025-09-24T17:13:55.933923] [DEBUG] [LOCAL ] AMTB: Primary data saved (20392 records). [2025-09-24T17:13:55.934059] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-24T17:13:55.934162] [INFO ] [MAIN ] Update Progress: 109/2373 symbols completed. AMTB took 27.5s. Estimated remaining: 4h 48m 6s. Rate: 7.9 symbols/min [2025-09-24T17:13:56.021224] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-24T17:13:56.112498] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:13:56.123002] [DEBUG] [LOCAL ] AMWL: Loaded 8642 existing records from primary storage. [2025-09-24T17:13:56.123111] [INFO ] [MAIN ] AMWL: Loaded 8642 existing records. [2025-09-24T17:13:56.307727] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:13:56.308042] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-24T17:13:56.308094] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-24T17:13:56.308490] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-24T17:13:56.308551] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-24T17:13:56.605078] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T17:13:56.711721] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:13:56.816046] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-24T17:13:56.935054] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T17:13:57.616069] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-24T17:13:57.702980] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T17:13:58.416082] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-24T17:13:59.216055] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-24T17:13:59.238422] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T17:13:59.578939] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T17:13:59.588304] [INFO ] [REMOTE ] AMT: Full fetch complete (76005 records). [2025-09-24T17:13:59.588456] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-24T17:13:59.979109] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-24T17:13:59.979198] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-24T17:13:59.979946] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-24T17:13:59.980016] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-24T17:13:59.981569] [DEBUG] [LOCAL ] AMT: Trimmed 76005 records to 52448 (keeping 200 days of data) [2025-09-24T17:14:00.043958] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-24T17:14:00.320539] [DEBUG] [LOCAL ] AMT: Primary data saved (52448 records). [2025-09-24T17:14:00.320754] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-24T17:14:00.321492] [INFO ] [MAIN ] Update Progress: 110/2373 symbols completed. AMT took 41.9s. Estimated remaining: 4h 46m 52s. Rate: 7.9 symbols/min [2025-09-24T17:14:00.505599] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:00.561841] [DEBUG] [LOCAL ] AMX: Loaded 49162 existing records from primary storage. [2025-09-24T17:14:00.562060] [INFO ] [MAIN ] AMX: Loaded 49162 existing records. [2025-09-24T17:14:00.758875] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:00.759149] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-24T17:14:00.759207] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-24T17:14:00.760680] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-24T17:14:00.760747] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-24T17:14:00.825856] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-24T17:14:00.962365] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T17:14:01.170505] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:01.197862] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T17:14:01.579695] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T17:14:01.616063] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-24T17:14:02.242146] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T17:14:02.416098] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-24T17:14:03.216090] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-24T17:14:04.016043] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-24T17:14:04.131084] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T17:14:04.132740] [INFO ] [REMOTE ] AMTD: Full fetch complete (5611 records). [2025-09-24T17:14:04.132811] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-24T17:14:04.425784] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T17:14:04.611796] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-24T17:14:04.611877] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-24T17:14:04.612032] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-24T17:14:04.612070] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-24T17:14:04.612434] [DEBUG] [LOCAL ] AMTD: Trimmed 5611 records to 3560 (keeping 200 days of data) [2025-09-24T17:14:04.633452] [DEBUG] [LOCAL ] AMTD: Primary data saved (3560 records). [2025-09-24T17:14:04.633524] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-24T17:14:04.633602] [INFO ] [MAIN ] Update Progress: 111/2373 symbols completed. AMTD took 32.4s. Estimated remaining: 4h 45m 37s. Rate: 7.9 symbols/min [2025-09-24T17:14:04.803910] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:04.816079] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-24T17:14:04.848072] [DEBUG] [LOCAL ] AN: Loaded 32517 existing records from primary storage. [2025-09-24T17:14:04.848201] [INFO ] [MAIN ] AN: Loaded 32517 existing records. [2025-09-24T17:14:05.024260] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:05.024525] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-24T17:14:05.024576] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-24T17:14:05.025406] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-24T17:14:05.025468] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-24T17:14:05.394204] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:05.619732] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-24T17:14:05.625336] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T17:14:06.413170] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T17:14:06.416026] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-24T17:14:06.505798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T17:14:07.216065] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-24T17:14:07.302950] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:14:08.016091] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-24T17:14:08.757831] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T17:14:08.816036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-24T17:14:09.175564] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T17:14:09.616156] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-24T17:14:10.202623] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T17:14:10.416227] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-24T17:14:10.916052] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T17:14:11.216102] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-24T17:14:12.016162] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-24T17:14:12.172262] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T17:14:12.505147] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T17:14:12.816082] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-24T17:14:13.307818] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T17:14:13.616105] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-24T17:14:13.856482] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T17:14:14.416116] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-24T17:14:15.192620] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T17:14:15.216024] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-24T17:14:15.362299] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T17:14:16.019138] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-24T17:14:16.019998] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T17:14:16.816130] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-24T17:14:17.238414] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T17:14:17.616151] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-24T17:14:18.416091] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-24T17:14:18.667336] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T17:14:18.677754] [INFO ] [REMOTE ] AMTM: Full fetch complete (73630 records). [2025-09-24T17:14:18.677927] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-24T17:14:18.679048] [FATAL] [VALIDATOR ] AMTM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:14:18.679151] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:14:18.679196] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:14:18.679459] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-24T17:14:18.679537] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-24T17:14:18.679578] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-09-24T17:14:18.679619] [DEBUG] [LOCAL ] AMTM: No derivative data file found to delete. [2025-09-24T17:14:18.679759] [INFO ] [MAIN ] Update Progress: 112/2373 symbols completed. AMTM took 41.4s. Estimated remaining: 4h 47m 40s. Rate: 7.9 symbols/min [2025-09-24T17:14:18.813317] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T17:14:18.831455] [INFO ] [REMOTE ] AMWL: Full fetch complete (13950 records). [2025-09-24T17:14:18.852121] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-24T17:14:18.891973] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:19.218540] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-24T17:14:19.328787] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-24T17:14:19.330284] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-24T17:14:19.330774] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-24T17:14:19.330867] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-24T17:14:19.332470] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-24T17:14:19.332947] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-24T17:14:19.332863] [DEBUG] [LOCAL ] AMWL: Trimmed 13950 records to 8630 (keeping 200 days of data) [2025-09-24T17:14:19.565352] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:19.568300] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-24T17:14:19.569004] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-24T17:14:19.571290] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-24T17:14:19.571448] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-24T17:14:19.571388] [DEBUG] [LOCAL ] AMWL: Primary data saved (8630 records). [2025-09-24T17:14:19.576839] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-24T17:14:19.583829] [INFO ] [MAIN ] Update Progress: 113/2373 symbols completed. AMWL took 23.6s. Estimated remaining: 4h 45m 18s. Rate: 7.9 symbols/min [2025-09-24T17:14:19.915321] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:20.186500] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:20.187060] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-24T17:14:20.215054] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:14:20.241854] [DEBUG] [LOCAL ] ANF: Loaded 52244 existing records from primary storage. [2025-09-24T17:14:20.242030] [INFO ] [MAIN ] ANF: Loaded 52244 existing records. [2025-09-24T17:14:20.434760] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:20.435038] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-24T17:14:20.435089] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-24T17:14:20.436226] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-24T17:14:20.436346] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-24T17:14:20.820943] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-24T17:14:20.826973] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:20.855306] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T17:14:21.616096] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-24T17:14:22.321640] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T17:14:22.416055] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-24T17:14:22.574606] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-24T17:14:23.216099] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-24T17:14:23.324440] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T17:14:23.489905] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T17:14:24.016092] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-24T17:14:24.816053] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-24T17:14:24.957857] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:14:25.616104] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-24T17:14:25.793535] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T17:14:26.319894] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:14:26.416093] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-24T17:14:27.216047] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-24T17:14:27.658802] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T17:14:27.778046] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-24T17:14:28.016099] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-24T17:14:28.642754] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T17:14:28.652477] [INFO ] [REMOTE ] AMX: Full fetch complete (70770 records). [2025-09-24T17:14:28.652601] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-24T17:14:28.825781] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-24T17:14:29.043287] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-24T17:14:29.043484] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-24T17:14:29.044211] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-24T17:14:29.044275] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-24T17:14:29.045695] [DEBUG] [LOCAL ] AMX: Trimmed 70770 records to 49185 (keeping 200 days of data) [2025-09-24T17:14:29.290944] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T17:14:29.297601] [INFO ] [REMOTE ] AN: Full fetch complete (47693 records). [2025-09-24T17:14:29.298215] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-24T17:14:29.619409] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-24T17:14:29.754964] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-24T17:14:29.755365] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-24T17:14:29.756183] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-24T17:14:29.756262] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-24T17:14:29.760910] [DEBUG] [LOCAL ] AN: Trimmed 47693 records to 32414 (keeping 200 days of data) [2025-09-24T17:14:29.820361] [DEBUG] [LOCAL ] AMX: Primary data saved (49185 records). [2025-09-24T17:14:29.828439] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-24T17:14:29.855567] [INFO ] [MAIN ] Update Progress: 114/2373 symbols completed. AMX took 29.5s. Estimated remaining: 4h 46m 4s. Rate: 7.9 symbols/min [2025-09-24T17:14:30.061728] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:30.064979] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-24T17:14:30.066435] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-24T17:14:30.070378] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-24T17:14:30.075108] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-24T17:14:30.080436] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-24T17:14:30.080537] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-24T17:14:30.440417] [DEBUG] [LOCAL ] AN: Primary data saved (32414 records). [2025-09-24T17:14:30.451277] [INFO ] [MAIN ] AN: Full history saved. [2025-09-24T17:14:30.451398] [INFO ] [MAIN ] Update Progress: 115/2373 symbols completed. AN took 25.8s. Estimated remaining: 4h 43m 39s. Rate: 8.0 symbols/min [2025-09-24T17:14:30.666945] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:30.694798] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-24T17:14:30.717861] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:30.739391] [DEBUG] [LOCAL ] ANRO: Loaded 19470 existing records from primary storage. [2025-09-24T17:14:30.739553] [INFO ] [MAIN ] ANRO: Loaded 19470 existing records. [2025-09-24T17:14:30.934152] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:30.935017] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-24T17:14:30.935123] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-24T17:14:30.935877] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-24T17:14:30.936126] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-24T17:14:31.020623] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:31.039634] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-24T17:14:31.225552] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-24T17:14:31.320211] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:31.351181] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-24T17:14:31.459001] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T17:14:31.471355] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:31.471721] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-24T17:14:32.016086] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-24T17:14:32.816129] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-24T17:14:33.062492] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:33.062859] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-24T17:14:33.384547] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T17:14:33.616083] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-24T17:14:34.416083] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-24T17:14:34.623268] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:34.623592] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-24T17:14:35.216063] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-24T17:14:35.373346] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T17:14:36.016111] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-24T17:14:36.205151] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:36.205490] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-24T17:14:36.816167] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-24T17:14:37.006940] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:37.007257] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-24T17:14:37.461877] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-24T17:14:37.616085] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-24T17:14:38.416091] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-24T17:14:39.216096] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-24T17:14:39.429998] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:39.430311] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-24T17:14:39.476056] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T17:14:39.751727] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-24T17:14:40.016079] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-24T17:14:40.816084] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-24T17:14:41.616094] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-24T17:14:41.827077] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:41.827390] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-24T17:14:42.416054] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-24T17:14:42.454144] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-24T17:14:42.555962] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:14:42.701970] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:14:42.702263] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-24T17:14:43.216092] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-24T17:14:44.016081] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-24T17:14:44.816090] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-24T17:14:45.034835] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T17:14:45.465179] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T17:14:45.470265] [INFO ] [REMOTE ] ANGX: Full fetch complete (3496 records). [2025-09-24T17:14:45.470353] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-24T17:14:45.621156] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-24T17:14:45.650597] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 10 unique days, need 200 days [2025-09-24T17:14:45.650769] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:14:45.650854] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:14:45.651627] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-24T17:14:45.651731] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-24T17:14:45.651781] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-24T17:14:45.651840] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-24T17:14:45.651920] [INFO ] [MAIN ] Update Progress: 116/2373 symbols completed. ANGX took 15.8s. Estimated remaining: 4h 46m 0s. Rate: 7.9 symbols/min [2025-09-24T17:14:45.834315] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:14:45.848068] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T17:14:45.873839] [DEBUG] [LOCAL ] ANVS: Loaded 23212 existing records from primary storage. [2025-09-24T17:14:45.873971] [INFO ] [MAIN ] ANVS: Loaded 23212 existing records. [2025-09-24T17:14:46.058013] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:14:46.058254] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-24T17:14:46.058303] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-24T17:14:46.058882] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-24T17:14:46.058944] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-24T17:14:46.416228] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-24T17:14:46.448503] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:14:47.216046] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-24T17:14:47.791752] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-24T17:14:48.016074] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-24T17:14:48.316193] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T17:14:48.610123] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-24T17:14:48.816085] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-24T17:14:49.616079] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-24T17:14:49.929022] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T17:14:50.416112] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-24T17:14:51.029196] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T17:14:51.166222] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-24T17:14:51.216030] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-24T17:14:52.016123] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-24T17:14:52.235619] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T17:14:52.816209] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-24T17:14:53.429484] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T17:14:53.616053] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-24T17:14:53.732405] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-24T17:14:53.961896] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T17:14:54.416092] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-24T17:14:55.095016] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T17:14:55.216062] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-24T17:14:55.248762] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T17:14:56.016125] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-24T17:14:56.816098] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-24T17:14:57.225223] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T17:14:57.616076] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-24T17:14:57.692726] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-24T17:14:57.702371] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-24T17:14:57.702506] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-24T17:14:58.105885] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-24T17:14:58.105974] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-24T17:14:58.106828] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-24T17:14:58.106895] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-24T17:14:58.108413] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-24T17:14:58.416442] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-24T17:14:58.444638] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-24T17:14:58.444787] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-24T17:14:58.445934] [INFO ] [MAIN ] Update Progress: 117/2373 symbols completed. ANET took 39.8s. Estimated remaining: 4h 47m 33s. Rate: 7.8 symbols/min [2025-09-24T17:14:58.593427] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T17:14:58.682349] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T17:14:59.216115] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-24T17:14:59.788909] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:15:00.016125] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-24T17:15:00.816129] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-24T17:15:01.013375] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T17:15:01.204077] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T17:15:01.213056] [INFO ] [REMOTE ] ANF: Full fetch complete (75674 records). [2025-09-24T17:15:01.213193] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-24T17:15:01.610619] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-24T17:15:01.610836] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-24T17:15:01.611737] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-24T17:15:01.611806] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-24T17:15:01.613572] [DEBUG] [LOCAL ] ANF: Trimmed 75674 records to 52242 (keeping 200 days of data) [2025-09-24T17:15:01.616206] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-24T17:15:01.946996] [DEBUG] [LOCAL ] ANF: Primary data saved (52242 records). [2025-09-24T17:15:01.947164] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-24T17:15:01.947259] [INFO ] [MAIN ] Update Progress: 118/2373 symbols completed. ANF took 42.4s. Estimated remaining: 4h 46m 6s. Rate: 7.9 symbols/min [2025-09-24T17:15:02.137246] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T17:15:02.416160] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-24T17:15:03.502250] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T17:15:03.504869] [INFO ] [REMOTE ] ANRO: Full fetch complete (30462 records). [2025-09-24T17:15:03.504951] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-24T17:15:03.903632] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-24T17:15:03.903749] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-24T17:15:03.904148] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-24T17:15:03.904195] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-24T17:15:03.905042] [DEBUG] [LOCAL ] ANRO: Trimmed 30462 records to 19271 (keeping 200 days of data) [2025-09-24T17:15:04.010878] [DEBUG] [LOCAL ] ANRO: Primary data saved (19271 records). [2025-09-24T17:15:04.011030] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-24T17:15:04.011120] [INFO ] [MAIN ] Update Progress: 119/2373 symbols completed. ANRO took 33.6s. Estimated remaining: 4h 44m 13s. Rate: 7.9 symbols/min [2025-09-24T17:15:05.387300] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-24T17:15:05.393411] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-24T17:15:06.630539] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T17:15:06.637067] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-24T17:15:07.568065] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T17:15:07.574006] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-24T17:15:08.681238] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T17:15:08.686180] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-24T17:15:09.685797] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T17:15:09.689124] [INFO ] [REMOTE ] ANVS: Full fetch complete (36640 records). [2025-09-24T17:15:09.689213] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-24T17:15:10.071798] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-24T17:15:10.071920] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-24T17:15:10.072454] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-24T17:15:10.072532] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-24T17:15:10.073548] [DEBUG] [LOCAL ] ANVS: Trimmed 36640 records to 23167 (keeping 200 days of data) [2025-09-24T17:15:10.204527] [DEBUG] [LOCAL ] ANVS: Primary data saved (23167 records). [2025-09-24T17:15:10.204699] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-24T17:15:10.204805] [INFO ] [MAIN ] Update Progress: 120/2373 symbols completed. ANVS took 24.6s. Estimated remaining: 4h 43m 40s. Rate: 7.9 symbols/min [2025-09-24T17:15:10.819528] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:10.844814] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:10.945043] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:10.927787] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:10.945585] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-24T17:15:10.945901] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-24T17:15:10.946249] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-24T17:15:10.946330] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-24T17:15:10.946573] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-24T17:15:10.946691] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-24T17:15:11.110506] [DEBUG] [LOCAL ] AOD: Loaded 30169 existing records from primary storage. [2025-09-24T17:15:11.140841] [INFO ] [MAIN ] AOD: Loaded 30169 existing records. [2025-09-24T17:15:11.093946] [DEBUG] [LOCAL ] AOMR: Loaded 16714 existing records from primary storage. [2025-09-24T17:15:11.146864] [INFO ] [MAIN ] AOMR: Loaded 16714 existing records. [2025-09-24T17:15:11.544829] [DEBUG] [LOCAL ] AON: Loaded 45655 existing records from primary storage. [2025-09-24T17:15:11.588558] [INFO ] [MAIN ] AON: Loaded 45655 existing records. [2025-09-24T17:15:11.659518] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:11.812198] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:11.812348] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-24T17:15:11.837213] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-24T17:15:11.845610] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:11.845907] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-24T17:15:11.866707] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-24T17:15:11.885312] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-24T17:15:11.885528] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-24T17:15:11.885467] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-24T17:15:11.902520] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-24T17:15:11.922883] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-24T17:15:12.119160] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:12.188916] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-24T17:15:12.199344] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-24T17:15:12.260839] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-24T17:15:12.275575] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-24T17:15:12.366541] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:15:12.504242] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-24T17:15:12.549094] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-24T17:15:12.896862] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:15:12.885924] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:12.902329] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-24T17:15:12.902741] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-24T17:15:12.964460] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-24T17:15:13.007867] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:13.008279] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-24T17:15:13.092796] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:13.093394] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-24T17:15:13.388241] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:15:13.388751] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-24T17:15:13.389496] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-24T17:15:13.711066] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:15:13.711394] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-24T17:15:13.711877] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-24T17:15:14.066357] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:15:14.066743] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-24T17:15:14.067193] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-24T17:15:14.299750] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T17:15:14.303069] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-24T17:15:15.348427] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T17:15:15.349759] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-24T17:15:15.648179] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-24T17:15:15.654218] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-24T17:15:16.265808] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-24T17:15:16.278503] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-24T17:15:16.367480] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T17:15:16.567488] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:15:16.816098] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-24T17:15:17.144299] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T17:15:17.616316] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-24T17:15:17.900247] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T17:15:17.930626] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:15:18.416089] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-24T17:15:18.516031] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T17:15:19.216064] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-24T17:15:19.268455] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T17:15:20.016056] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-24T17:15:20.048706] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T17:15:20.671301] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T17:15:20.816182] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-24T17:15:21.315384] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T17:15:21.616118] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-24T17:15:22.416134] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-24T17:15:23.216057] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-24T17:15:23.330211] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T17:15:23.682607] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T17:15:23.687511] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T17:15:24.016154] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-24T17:15:24.816094] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-24T17:15:25.345609] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T17:15:25.616104] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-24T17:15:26.260849] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T17:15:26.261866] [INFO ] [REMOTE ] AOMD: Full fetch complete (1795 records). [2025-09-24T17:15:26.261935] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-24T17:15:26.432556] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-24T17:15:26.477389] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 84 unique days, need 200 days [2025-09-24T17:15:26.478959] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:15:26.479051] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:15:26.479121] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-24T17:15:26.479279] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-24T17:15:26.479388] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-24T17:15:26.479717] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-24T17:15:26.479829] [INFO ] [MAIN ] Update Progress: 121/2373 symbols completed. AOMD took 16.3s. Estimated remaining: 4h 46m 15s. Rate: 7.9 symbols/min [2025-09-24T17:15:26.590695] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T17:15:26.702219] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:26.733547] [DEBUG] [LOCAL ] AORT: Loaded 29726 existing records from primary storage. [2025-09-24T17:15:26.733755] [INFO ] [MAIN ] AORT: Loaded 29726 existing records. [2025-09-24T17:15:26.921080] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:26.921329] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-24T17:15:26.921378] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-24T17:15:26.922597] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-24T17:15:26.922706] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-24T17:15:27.221245] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-24T17:15:27.286163] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:28.016105] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-24T17:15:28.044700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T17:15:28.816107] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-24T17:15:29.229613] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T17:15:29.261463] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T17:15:29.616115] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-24T17:15:29.946283] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T17:15:30.416125] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-24T17:15:31.035786] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T17:15:31.064392] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T17:15:31.216084] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-24T17:15:32.007698] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T17:15:32.016027] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-24T17:15:32.816082] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-24T17:15:33.147924] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T17:15:33.616140] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-24T17:15:34.416107] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-24T17:15:34.482575] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T17:15:34.551118] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T17:15:34.555457] [INFO ] [REMOTE ] AOMR: Full fetch complete (23114 records). [2025-09-24T17:15:34.555692] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-24T17:15:34.962154] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-24T17:15:34.962301] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-24T17:15:34.962956] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-24T17:15:34.963036] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-24T17:15:34.963904] [DEBUG] [LOCAL ] AOMR: Trimmed 23114 records to 16701 (keeping 200 days of data) [2025-09-24T17:15:35.066854] [DEBUG] [LOCAL ] AOMR: Primary data saved (16701 records). [2025-09-24T17:15:35.067003] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-24T17:15:35.067092] [INFO ] [MAIN ] Update Progress: 122/2373 symbols completed. AOMR took 24.9s. Estimated remaining: 4h 46m 25s. Rate: 7.9 symbols/min [2025-09-24T17:15:35.224070] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-24T17:15:35.253337] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:35.304469] [DEBUG] [LOCAL ] AOS: Loaded 49194 existing records from primary storage. [2025-09-24T17:15:35.304711] [INFO ] [MAIN ] AOS: Loaded 49194 existing records. [2025-09-24T17:15:35.495501] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:35.495856] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-24T17:15:35.496008] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-24T17:15:35.498489] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-24T17:15:35.498552] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-24T17:15:35.739384] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T17:15:35.892859] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:36.016102] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-24T17:15:36.590173] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T17:15:36.816111] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-24T17:15:37.616061] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-24T17:15:37.743530] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:15:38.251395] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T17:15:38.416117] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-24T17:15:38.582630] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T17:15:39.216092] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-24T17:15:40.016100] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-24T17:15:40.112080] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:15:40.427966] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T17:15:40.434676] [INFO ] [REMOTE ] AOD: Full fetch complete (44048 records). [2025-09-24T17:15:40.434934] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-24T17:15:40.823737] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-24T17:15:40.821200] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-24T17:15:40.825205] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-24T17:15:40.825783] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-24T17:15:40.825886] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-24T17:15:40.827957] [DEBUG] [LOCAL ] AOD: Trimmed 44048 records to 30057 (keeping 200 days of data) [2025-09-24T17:15:41.021333] [DEBUG] [LOCAL ] AOD: Primary data saved (30057 records). [2025-09-24T17:15:41.021484] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-24T17:15:41.021633] [INFO ] [MAIN ] Update Progress: 123/2373 symbols completed. AOD took 30.8s. Estimated remaining: 4h 45m 46s. Rate: 7.9 symbols/min [2025-09-24T17:15:41.190527] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:41.199178] [DEBUG] [LOCAL ] AP: Loaded 6975 existing records from primary storage. [2025-09-24T17:15:41.199276] [INFO ] [MAIN ] AP: Loaded 6975 existing records. [2025-09-24T17:15:41.402569] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:41.403263] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-24T17:15:41.403383] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-24T17:15:41.404327] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-24T17:15:41.404421] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-24T17:15:41.599054] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T17:15:41.623859] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-24T17:15:41.817435] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:42.416136] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-24T17:15:42.544906] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T17:15:43.065524] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T17:15:43.216044] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-24T17:15:44.016045] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-24T17:15:44.050685] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T17:15:44.079737] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T17:15:44.816087] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-24T17:15:45.563697] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T17:15:45.616082] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-24T17:15:46.249561] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T17:15:46.416086] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-24T17:15:46.664496] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T17:15:46.672822] [INFO ] [REMOTE ] AON: Full fetch complete (64935 records). [2025-09-24T17:15:46.672988] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-24T17:15:47.017404] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T17:15:47.095637] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-24T17:15:47.095738] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-24T17:15:47.096374] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-24T17:15:47.096427] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-24T17:15:47.097758] [DEBUG] [LOCAL ] AON: Trimmed 64935 records to 45620 (keeping 200 days of data) [2025-09-24T17:15:47.216055] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-24T17:15:47.406052] [DEBUG] [LOCAL ] AON: Primary data saved (45620 records). [2025-09-24T17:15:47.406295] [INFO ] [MAIN ] AON: Full history saved. [2025-09-24T17:15:47.409695] [INFO ] [MAIN ] Update Progress: 124/2373 symbols completed. AON took 37.2s. Estimated remaining: 4h 45m 16s. Rate: 7.9 symbols/min [2025-09-24T17:15:47.586540] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:47.586807] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-24T17:15:47.586850] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-24T17:15:47.586955] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-24T17:15:47.586993] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-24T17:15:47.587034] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-24T17:15:47.587066] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-24T17:15:47.946634] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:48.016066] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-24T17:15:48.431564] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T17:15:48.816081] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-24T17:15:49.592496] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T17:15:49.616037] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-24T17:15:50.125386] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T17:15:50.416085] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-24T17:15:51.216057] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-24T17:15:51.330764] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T17:15:51.359499] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T17:15:51.770162] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:15:52.016152] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-24T17:15:52.816111] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-24T17:15:53.512315] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T17:15:53.616092] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-24T17:15:53.972780] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T17:15:54.416127] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-24T17:15:55.134440] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T17:15:55.216033] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-24T17:15:55.307401] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T17:15:56.016117] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-24T17:15:56.676040] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T17:15:56.681794] [INFO ] [REMOTE ] AORT: Full fetch complete (41645 records). [2025-09-24T17:15:56.681933] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-24T17:15:56.818219] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-24T17:15:57.006110] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T17:15:57.096702] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-24T17:15:57.096793] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-24T17:15:57.097265] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-24T17:15:57.097306] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-24T17:15:57.099099] [DEBUG] [LOCAL ] AORT: Trimmed 41645 records to 29664 (keeping 200 days of data) [2025-09-24T17:15:57.276547] [DEBUG] [LOCAL ] AORT: Primary data saved (29664 records). [2025-09-24T17:15:57.276747] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-24T17:15:57.276872] [INFO ] [MAIN ] Update Progress: 125/2373 symbols completed. AORT took 30.8s. Estimated remaining: 4h 45m 49s. Rate: 7.9 symbols/min [2025-09-24T17:15:57.446497] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:15:57.503365] [DEBUG] [LOCAL ] APD: Loaded 45379 existing records from primary storage. [2025-09-24T17:15:57.503763] [INFO ] [MAIN ] APD: Loaded 45379 existing records. [2025-09-24T17:15:57.621239] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-24T17:15:57.686784] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:15:57.687157] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-24T17:15:57.687231] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-24T17:15:57.690112] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-24T17:15:57.690218] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-24T17:15:58.058104] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:15:58.257488] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:15:58.416063] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-24T17:15:58.478288] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T17:15:59.216089] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-24T17:16:00.016111] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-24T17:16:00.215549] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:16:00.816102] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-24T17:16:01.171148] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T17:16:01.406267] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T17:16:01.427895] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T17:16:01.616082] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-24T17:16:02.416097] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-24T17:16:02.842814] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T17:16:03.141200] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T17:16:03.216083] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-24T17:16:04.016086] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-24T17:16:04.816079] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-24T17:16:04.943624] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T17:16:05.616075] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-24T17:16:05.664118] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:16:05.665969] [INFO ] [REMOTE ] AP: Full fetch complete (8701 records). [2025-09-24T17:16:05.666048] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-24T17:16:05.666943] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:16:05.667034] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:16:05.667089] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:16:05.667154] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-24T17:16:05.667215] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-24T17:16:05.667265] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-24T17:16:05.667782] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-24T17:16:05.667891] [INFO ] [MAIN ] Update Progress: 126/2373 symbols completed. AP took 24.6s. Estimated remaining: 4h 45m 55s. Rate: 7.9 symbols/min [2025-09-24T17:16:05.918662] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:05.949846] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T17:16:06.010576] [DEBUG] [LOCAL ] APG: Loaded 50228 existing records from primary storage. [2025-09-24T17:16:06.010809] [INFO ] [MAIN ] APG: Loaded 50228 existing records. [2025-09-24T17:16:06.185600] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:06.185949] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-24T17:16:06.186004] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-24T17:16:06.189589] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-24T17:16:06.189674] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-24T17:16:06.421253] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-24T17:16:06.563505] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:07.216129] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-24T17:16:07.503856] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T17:16:08.021262] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-24T17:16:08.039898] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T17:16:08.503137] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T17:16:08.816137] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-24T17:16:09.616048] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-24T17:16:09.691593] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T17:16:09.701244] [INFO ] [REMOTE ] AOS: Full fetch complete (70685 records). [2025-09-24T17:16:09.701390] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-24T17:16:10.100956] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-24T17:16:10.101062] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-24T17:16:10.101976] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-24T17:16:10.102065] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-24T17:16:10.103696] [DEBUG] [LOCAL ] AOS: Trimmed 70685 records to 49129 (keeping 200 days of data) [2025-09-24T17:16:10.419497] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-24T17:16:10.425298] [DEBUG] [LOCAL ] AOS: Primary data saved (49129 records). [2025-09-24T17:16:10.425453] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-24T17:16:10.425545] [INFO ] [MAIN ] Update Progress: 127/2373 symbols completed. AOS took 35.4s. Estimated remaining: 4h 44m 57s. Rate: 7.9 symbols/min [2025-09-24T17:16:10.609402] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:10.609695] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-09-24T17:16:10.609754] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-09-24T17:16:10.609906] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-24T17:16:10.609955] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-24T17:16:10.610000] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-24T17:16:10.610038] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-24T17:16:11.003344] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:11.053824] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:16:11.063358] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-24T17:16:11.216086] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-24T17:16:12.016135] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-24T17:16:12.323371] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T17:16:12.463284] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:16:12.816124] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-24T17:16:13.545746] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:16:13.616130] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-24T17:16:14.416156] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-24T17:16:14.925984] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T17:16:15.125569] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-24T17:16:15.216132] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-24T17:16:15.741348] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T17:16:16.016133] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-24T17:16:16.377804] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T17:16:16.816147] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-24T17:16:17.616048] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-24T17:16:17.782771] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T17:16:18.416062] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-24T17:16:18.526882] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T17:16:18.687237] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T17:16:18.693000] [INFO ] [REMOTE ] APAM: Full fetch complete (51310 records). [2025-09-24T17:16:18.693117] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-24T17:16:18.693800] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:16:18.693892] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:16:18.693958] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:16:18.694031] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-24T17:16:18.694098] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-24T17:16:18.694138] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-24T17:16:18.694205] [DEBUG] [LOCAL ] APAM: No derivative data file found to delete. [2025-09-24T17:16:18.694291] [INFO ] [MAIN ] Update Progress: 128/2373 symbols completed. APAM took 31.3s. Estimated remaining: 4h 45m 1s. Rate: 7.9 symbols/min [2025-09-24T17:16:18.879879] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:18.956370] [DEBUG] [LOCAL ] APLE: Loaded 52034 existing records from primary storage. [2025-09-24T17:16:18.956519] [INFO ] [MAIN ] APLE: Loaded 52034 existing records. [2025-09-24T17:16:19.154857] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:19.155149] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-24T17:16:19.155205] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-24T17:16:19.158247] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-24T17:16:19.158314] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-24T17:16:19.227955] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-24T17:16:19.541583] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:20.016039] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-24T17:16:20.253380] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T17:16:20.619846] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T17:16:20.816125] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-24T17:16:21.595573] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:16:21.616043] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-24T17:16:22.416057] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-24T17:16:22.828083] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T17:16:23.216150] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-24T17:16:23.372461] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T17:16:24.016073] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-24T17:16:24.176889] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T17:16:24.816063] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-24T17:16:24.997282] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T17:16:25.506194] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:16:25.616097] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-24T17:16:26.366962] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T17:16:26.416083] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-24T17:16:26.920973] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T17:16:27.216111] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-24T17:16:28.016082] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-24T17:16:28.239700] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T17:16:28.816072] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-24T17:16:28.907120] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T17:16:29.401001] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T17:16:29.408536] [INFO ] [REMOTE ] APD: Full fetch complete (66595 records). [2025-09-24T17:16:29.408729] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-24T17:16:29.621526] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-24T17:16:29.803398] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-24T17:16:29.803483] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-24T17:16:29.804167] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-24T17:16:29.804229] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-24T17:16:29.805531] [DEBUG] [LOCAL ] APD: Trimmed 66595 records to 45371 (keeping 200 days of data) [2025-09-24T17:16:30.087963] [DEBUG] [LOCAL ] APD: Primary data saved (45371 records). [2025-09-24T17:16:30.088093] [INFO ] [MAIN ] APD: Full history saved. [2025-09-24T17:16:30.088175] [INFO ] [MAIN ] Update Progress: 129/2373 symbols completed. APD took 32.8s. Estimated remaining: 4h 45m 59s. Rate: 7.8 symbols/min [2025-09-24T17:16:30.257195] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:30.311026] [DEBUG] [LOCAL ] APO: Loaded 53386 existing records from primary storage. [2025-09-24T17:16:30.311164] [INFO ] [MAIN ] APO: Loaded 53386 existing records. [2025-09-24T17:16:30.421207] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-24T17:16:30.494114] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:30.494372] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-24T17:16:30.494452] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-24T17:16:30.497357] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-24T17:16:30.497422] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-24T17:16:30.863773] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:30.892922] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T17:16:31.216099] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-24T17:16:31.414557] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:16:32.016142] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-24T17:16:32.314243] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T17:16:32.816106] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-24T17:16:32.872340] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T17:16:33.616122] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-24T17:16:34.230352] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-24T17:16:34.416079] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-24T17:16:34.612408] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T17:16:35.141484] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:16:35.216115] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-24T17:16:36.016106] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-24T17:16:36.315960] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-24T17:16:36.779558] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T17:16:36.816065] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-24T17:16:37.616136] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-24T17:16:37.814853] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T17:16:38.416151] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-24T17:16:38.742104] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T17:16:39.216053] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-24T17:16:39.313675] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T17:16:40.016078] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-24T17:16:40.429395] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T17:16:40.816131] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-24T17:16:41.034890] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T17:16:41.565749] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T17:16:41.616106] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-24T17:16:42.416131] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-24T17:16:42.835222] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T17:16:43.227492] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-24T17:16:43.230589] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:16:44.016081] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-24T17:16:44.418899] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T17:16:44.816117] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-24T17:16:45.398300] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T17:16:45.410569] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-24T17:16:45.410772] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-24T17:16:45.621077] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-24T17:16:45.866691] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-24T17:16:45.867148] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-24T17:16:45.870487] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T17:16:45.868601] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-24T17:16:45.879150] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-24T17:16:45.882080] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 53691 (keeping 200 days of data) [2025-09-24T17:16:45.883281] [INFO ] [REMOTE ] APG: Full fetch complete (71656 records). [2025-09-24T17:16:45.883422] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-24T17:16:46.415790] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-24T17:16:46.416635] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-24T17:16:46.418205] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-24T17:16:46.418556] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-24T17:16:46.424790] [DEBUG] [LOCAL ] APG: Trimmed 71656 records to 50211 (keeping 200 days of data) [2025-09-24T17:16:46.904071] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T17:16:46.921041] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-24T17:16:46.962271] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-24T17:16:46.963836] [INFO ] [MAIN ] APH: Full history saved. [2025-09-24T17:16:46.964244] [INFO ] [MAIN ] Update Progress: 130/2373 symbols completed. APH took 36.5s. Estimated remaining: 4h 48m 30s. Rate: 7.8 symbols/min [2025-09-24T17:16:47.156467] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:47.201851] [DEBUG] [LOCAL ] APOS: Loaded 7493 existing records from primary storage. [2025-09-24T17:16:47.217539] [INFO ] [MAIN ] APOS: Loaded 7493 existing records. [2025-09-24T17:16:47.422632] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:47.425324] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-24T17:16:47.425423] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-24T17:16:47.427413] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-24T17:16:47.428378] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-24T17:16:47.560067] [DEBUG] [LOCAL ] APG: Primary data saved (50211 records). [2025-09-24T17:16:47.590375] [INFO ] [MAIN ] APG: Full history saved. [2025-09-24T17:16:47.629105] [INFO ] [MAIN ] Update Progress: 131/2373 symbols completed. APG took 42.0s. Estimated remaining: 4h 46m 22s. Rate: 7.8 symbols/min [2025-09-24T17:16:47.711660] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T17:16:47.868727] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-24T17:16:48.036280] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:48.041775] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:48.042143] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-24T17:16:48.097862] [DEBUG] [LOCAL ] APTV: Loaded 52221 existing records from primary storage. [2025-09-24T17:16:48.098029] [INFO ] [MAIN ] APTV: Loaded 52221 existing records. [2025-09-24T17:16:48.277990] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:48.278229] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-24T17:16:48.278276] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-24T17:16:48.280446] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-24T17:16:48.280509] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-24T17:16:48.644264] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:48.708863] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T17:16:48.751084] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T17:16:48.816089] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-24T17:16:49.419368] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T17:16:49.616081] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-24T17:16:49.820004] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T17:16:49.829853] [INFO ] [REMOTE ] APLE: Full fetch complete (74256 records). [2025-09-24T17:16:49.830022] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-24T17:16:50.285539] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-24T17:16:50.285668] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-24T17:16:50.286440] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-24T17:16:50.286489] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-24T17:16:50.288163] [DEBUG] [LOCAL ] APLE: Trimmed 74256 records to 52015 (keeping 200 days of data) [2025-09-24T17:16:50.358747] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T17:16:50.416121] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-24T17:16:50.621182] [DEBUG] [LOCAL ] APLE: Primary data saved (52015 records). [2025-09-24T17:16:50.621338] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-24T17:16:50.622245] [INFO ] [MAIN ] Update Progress: 132/2373 symbols completed. APLE took 31.9s. Estimated remaining: 4h 44m 55s. Rate: 7.9 symbols/min [2025-09-24T17:16:50.792135] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:16:50.847435] [DEBUG] [LOCAL ] AQN: Loaded 51946 existing records from primary storage. [2025-09-24T17:16:50.847584] [INFO ] [MAIN ] AQN: Loaded 51946 existing records. [2025-09-24T17:16:51.024958] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:16:51.025229] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-24T17:16:51.025277] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-24T17:16:51.027431] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-24T17:16:51.027494] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-24T17:16:51.221254] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-24T17:16:51.389408] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:16:51.889844] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T17:16:52.016096] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-24T17:16:52.446063] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T17:16:52.799473] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T17:16:52.816018] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-24T17:16:53.507525] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T17:16:53.616094] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-24T17:16:54.416095] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-24T17:16:55.112555] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T17:16:55.216043] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-24T17:16:55.361074] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:16:56.016100] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-24T17:16:56.816121] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-24T17:16:57.190758] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-24T17:16:57.360158] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T17:16:57.616128] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-24T17:16:58.416140] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-24T17:16:58.620372] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T17:16:59.216064] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-24T17:16:59.288524] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T17:17:00.016057] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-24T17:17:00.415271] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T17:17:00.424817] [INFO ] [REMOTE ] APO: Full fetch complete (77292 records). [2025-09-24T17:17:00.424969] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-24T17:17:00.817614] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T17:17:00.817814] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-24T17:17:00.839741] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-24T17:17:00.841503] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-24T17:17:00.843566] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-24T17:17:00.844690] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-24T17:17:00.873764] [DEBUG] [LOCAL ] APO: Trimmed 77292 records to 53385 (keeping 200 days of data) [2025-09-24T17:17:00.876080] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T17:17:01.221577] [DEBUG] [LOCAL ] APO: Primary data saved (53385 records). [2025-09-24T17:17:01.221753] [INFO ] [MAIN ] APO: Full history saved. [2025-09-24T17:17:01.221851] [INFO ] [MAIN ] Update Progress: 133/2373 symbols completed. APO took 31.1s. Estimated remaining: 4h 45m 38s. Rate: 7.8 symbols/min [2025-09-24T17:17:01.400607] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:01.407023] [DEBUG] [LOCAL ] AQNB: Loaded 4213 existing records from primary storage. [2025-09-24T17:17:01.407136] [INFO ] [MAIN ] AQNB: Loaded 4213 existing records. [2025-09-24T17:17:01.590688] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:01.590939] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-24T17:17:01.590988] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-24T17:17:01.591390] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-24T17:17:01.591451] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-24T17:17:01.622748] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-24T17:17:01.973783] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:02.416694] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-24T17:17:02.433367] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T17:17:02.997999] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T17:17:03.041178] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T17:17:03.216123] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-24T17:17:03.810218] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T17:17:03.812399] [INFO ] [REMOTE ] APOS: Full fetch complete (10424 records). [2025-09-24T17:17:03.812475] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-24T17:17:04.021284] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-24T17:17:04.204084] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-24T17:17:04.204171] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-24T17:17:04.204441] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-24T17:17:04.204504] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-24T17:17:04.205012] [DEBUG] [LOCAL ] APOS: Trimmed 10424 records to 7502 (keeping 200 days of data) [2025-09-24T17:17:04.251166] [DEBUG] [LOCAL ] APOS: Primary data saved (7502 records). [2025-09-24T17:17:04.251299] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-24T17:17:04.251381] [INFO ] [MAIN ] Update Progress: 134/2373 symbols completed. APOS took 17.3s. Estimated remaining: 4h 44m 13s. Rate: 7.9 symbols/min [2025-09-24T17:17:04.433726] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:04.491494] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-24T17:17:04.491695] [INFO ] [MAIN ] AR: Loaded 53585 existing records. [2025-09-24T17:17:04.695766] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:04.696069] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-24T17:17:04.696140] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-24T17:17:04.698903] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-24T17:17:04.698968] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-24T17:17:04.821272] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-24T17:17:05.096081] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:05.616055] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-24T17:17:05.965263] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T17:17:06.207190] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T17:17:06.416150] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-24T17:17:07.216167] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-24T17:17:07.356754] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:17:08.016056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-24T17:17:08.157358] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T17:17:08.816408] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-24T17:17:08.823514] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T17:17:09.616068] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-24T17:17:09.858227] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T17:17:10.142391] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T17:17:10.416099] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-24T17:17:10.711769] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:17:10.836122] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-24T17:17:11.216140] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-24T17:17:12.016103] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-24T17:17:12.744637] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:17:12.816060] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-24T17:17:13.616053] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-24T17:17:13.954913] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T17:17:14.218300] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T17:17:14.416121] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-24T17:17:15.216062] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-24T17:17:15.294795] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T17:17:16.016106] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-24T17:17:16.442866] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T17:17:16.459372] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T17:17:16.816056] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-24T17:17:16.870212] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T17:17:17.616166] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-24T17:17:17.873354] [DEBUG] [REMOTE ] AR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-24T17:17:17.873704] [WARN ] [REMOTE ] AR: No data returned for month 2025-03 [2025-09-24T17:17:18.416047] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-24T17:17:18.543015] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T17:17:19.216104] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-24T17:17:20.016080] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-24T17:17:20.077306] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T17:17:20.086451] [INFO ] [REMOTE ] AQN: Full fetch complete (75269 records). [2025-09-24T17:17:20.086671] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-24T17:17:20.491080] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-24T17:17:20.491164] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-24T17:17:20.491918] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-24T17:17:20.491989] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-24T17:17:20.493530] [DEBUG] [LOCAL ] AQN: Trimmed 75269 records to 51928 (keeping 200 days of data) [2025-09-24T17:17:20.747828] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T17:17:20.828306] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-24T17:17:20.851056] [DEBUG] [LOCAL ] AQN: Primary data saved (51928 records). [2025-09-24T17:17:20.851220] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-24T17:17:20.851332] [INFO ] [MAIN ] Update Progress: 135/2373 symbols completed. AQN took 30.2s. Estimated remaining: 4h 46m 34s. Rate: 7.8 symbols/min [2025-09-24T17:17:21.033050] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:21.081225] [DEBUG] [LOCAL ] ARCO: Loaded 44633 existing records from primary storage. [2025-09-24T17:17:21.081436] [INFO ] [MAIN ] ARCO: Loaded 44633 existing records. [2025-09-24T17:17:21.274882] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:21.275182] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-24T17:17:21.275235] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-24T17:17:21.277304] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-24T17:17:21.277386] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-24T17:17:21.624475] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-24T17:17:21.670852] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:21.762955] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T17:17:21.772244] [INFO ] [REMOTE ] APTV: Full fetch complete (76056 records). [2025-09-24T17:17:21.772378] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-24T17:17:22.193867] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-24T17:17:22.193966] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-24T17:17:22.194737] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-24T17:17:22.194802] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-24T17:17:22.196310] [DEBUG] [LOCAL ] APTV: Trimmed 76056 records to 52216 (keeping 200 days of data) [2025-09-24T17:17:22.380634] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T17:17:22.416061] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-24T17:17:22.541561] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T17:17:22.563453] [DEBUG] [LOCAL ] APTV: Primary data saved (52216 records). [2025-09-24T17:17:22.563578] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-24T17:17:22.563680] [INFO ] [MAIN ] Update Progress: 136/2373 symbols completed. APTV took 34.9s. Estimated remaining: 4h 44m 48s. Rate: 7.9 symbols/min [2025-09-24T17:17:22.734514] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:22.751014] [DEBUG] [LOCAL ] ARDC: Loaded 14405 existing records from primary storage. [2025-09-24T17:17:22.751132] [INFO ] [MAIN ] ARDC: Loaded 14405 existing records. [2025-09-24T17:17:22.933982] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:22.934212] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-24T17:17:22.934260] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-24T17:17:22.935383] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-24T17:17:22.935452] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-24T17:17:23.063391] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T17:17:23.221169] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-24T17:17:23.313067] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:24.016093] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-24T17:17:24.816102] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-24T17:17:25.146441] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:17:25.310421] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T17:17:25.495626] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T17:17:25.616111] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-24T17:17:26.416077] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-24T17:17:26.563860] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T17:17:27.216128] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-24T17:17:28.008354] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T17:17:28.016021] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-24T17:17:28.260625] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T17:17:28.561848] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-24T17:17:28.816094] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-24T17:17:29.616102] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-24T17:17:30.416059] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-24T17:17:30.447557] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T17:17:30.713227] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T17:17:31.216088] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-24T17:17:31.708015] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T17:17:32.021157] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-24T17:17:32.035503] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T17:17:32.729367] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T17:17:32.816048] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-24T17:17:33.616061] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-24T17:17:33.739831] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T17:17:34.416083] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-24T17:17:35.216055] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-24T17:17:35.543848] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T17:17:35.658242] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T17:17:35.667798] [INFO ] [REMOTE ] AR: Full fetch complete (69346 records). [2025-09-24T17:17:35.667953] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-24T17:17:35.868261] [WARN ] [VALIDATOR ] AR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T17:17:35.869075] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:17:35.869174] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:17:35.869275] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-24T17:17:35.869369] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-09-24T17:17:35.869409] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-09-24T17:17:35.870006] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-09-24T17:17:35.870120] [INFO ] [MAIN ] Update Progress: 137/2373 symbols completed. AR took 31.6s. Estimated remaining: 4h 46m 13s. Rate: 7.8 symbols/min [2025-09-24T17:17:36.025606] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-24T17:17:36.062952] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:36.068937] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:17:36.071388] [INFO ] [REMOTE ] AQNB: Full fetch complete (5882 records). [2025-09-24T17:17:36.071691] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-24T17:17:36.379235] [DEBUG] [LOCAL ] ARDT: Loaded 28224 existing records from primary storage. [2025-09-24T17:17:36.385034] [INFO ] [MAIN ] ARDT: Loaded 28224 existing records. [2025-09-24T17:17:36.586876] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-24T17:17:36.592096] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-24T17:17:36.605319] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-24T17:17:36.605420] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-24T17:17:36.633482] [DEBUG] [LOCAL ] AQNB: Trimmed 5882 records to 4187 (keeping 200 days of data) [2025-09-24T17:17:36.646771] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:36.647631] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-24T17:17:36.647734] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-24T17:17:36.658524] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-24T17:17:36.658633] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-24T17:17:36.826398] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-24T17:17:36.905187] [DEBUG] [LOCAL ] AQNB: Primary data saved (4187 records). [2025-09-24T17:17:36.927631] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-24T17:17:36.962744] [INFO ] [MAIN ] Update Progress: 138/2373 symbols completed. AQNB took 35.7s. Estimated remaining: 4h 44m 19s. Rate: 7.9 symbols/min [2025-09-24T17:17:36.991514] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T17:17:37.129696] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:37.230499] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:37.291383] [DEBUG] [LOCAL ] ARE: Loaded 50634 existing records from primary storage. [2025-09-24T17:17:37.291612] [INFO ] [MAIN ] ARE: Loaded 50634 existing records. [2025-09-24T17:17:37.481613] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:37.481922] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-24T17:17:37.481972] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-24T17:17:37.486267] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-24T17:17:37.486379] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-24T17:17:37.621240] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-24T17:17:37.852906] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:38.396173] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T17:17:38.416024] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-24T17:17:38.520880] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T17:17:39.216080] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-24T17:17:39.996799] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T17:17:40.021134] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-24T17:17:40.037454] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T17:17:40.816077] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-24T17:17:41.359061] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T17:17:41.616147] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-24T17:17:42.162440] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T17:17:42.181860] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T17:17:42.416085] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-24T17:17:43.216079] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-24T17:17:44.016051] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-24T17:17:44.325333] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T17:17:44.816055] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-24T17:17:44.844159] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T17:17:45.181346] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T17:17:45.616088] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-24T17:17:46.418385] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-24T17:17:46.424400] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:17:46.935711] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T17:17:47.216083] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-24T17:17:48.023321] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-24T17:17:48.047346] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T17:17:48.387766] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T17:17:48.816087] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-24T17:17:49.152577] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:17:49.155736] [INFO ] [REMOTE ] ARDC: Full fetch complete (20306 records). [2025-09-24T17:17:49.155839] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-24T17:17:49.537435] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-24T17:17:49.537532] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-24T17:17:49.537878] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-24T17:17:49.537959] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-24T17:17:49.538744] [DEBUG] [LOCAL ] ARDC: Trimmed 20306 records to 14492 (keeping 200 days of data) [2025-09-24T17:17:49.617548] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-24T17:17:49.637945] [DEBUG] [LOCAL ] ARDC: Primary data saved (14492 records). [2025-09-24T17:17:49.638093] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-24T17:17:49.638225] [INFO ] [MAIN ] Update Progress: 139/2373 symbols completed. ARDC took 27.1s. Estimated remaining: 4h 45m 32s. Rate: 7.8 symbols/min [2025-09-24T17:17:49.814105] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:49.873662] [DEBUG] [LOCAL ] ARES: Loaded 49614 existing records from primary storage. [2025-09-24T17:17:49.873906] [INFO ] [MAIN ] ARES: Loaded 49614 existing records. [2025-09-24T17:17:50.077320] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:50.077791] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-24T17:17:50.077874] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-24T17:17:50.080539] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-24T17:17:50.080603] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-24T17:17:50.433089] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-24T17:17:50.518058] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:50.521437] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T17:17:50.907148] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T17:17:51.216084] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-24T17:17:52.016110] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-24T17:17:52.242736] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T17:17:52.821202] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-24T17:17:52.824547] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:17:53.252463] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T17:17:53.616098] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-24T17:17:54.424879] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-24T17:17:54.427544] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T17:17:54.459872] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:17:55.216095] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-24T17:17:56.016090] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-24T17:17:56.275886] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T17:17:56.758160] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T17:17:56.766409] [INFO ] [REMOTE ] ARCO: Full fetch complete (65672 records). [2025-09-24T17:17:56.766756] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-24T17:17:56.824684] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-24T17:17:57.191471] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-24T17:17:57.191617] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-24T17:17:57.192333] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-24T17:17:57.192387] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-24T17:17:57.193776] [DEBUG] [LOCAL ] ARCO: Trimmed 65672 records to 44642 (keeping 200 days of data) [2025-09-24T17:17:57.443300] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T17:17:57.501605] [DEBUG] [LOCAL ] ARCO: Primary data saved (44642 records). [2025-09-24T17:17:57.501789] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-24T17:17:57.501975] [INFO ] [MAIN ] Update Progress: 140/2373 symbols completed. ARCO took 36.7s. Estimated remaining: 4h 45m 27s. Rate: 7.8 symbols/min [2025-09-24T17:17:57.621195] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-24T17:17:57.680125] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:17:57.723930] [DEBUG] [LOCAL ] ARI: Loaded 43411 existing records from primary storage. [2025-09-24T17:17:57.724073] [INFO ] [MAIN ] ARI: Loaded 43411 existing records. [2025-09-24T17:17:57.901080] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:17:57.901340] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-24T17:17:57.901387] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-24T17:17:57.903398] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-24T17:17:57.903475] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-24T17:17:58.263510] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:17:58.421196] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-24T17:17:58.438797] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:17:59.216198] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-24T17:17:59.367453] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T17:17:59.647435] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T17:18:00.016143] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-24T17:18:00.703247] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T17:18:00.816084] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-24T17:18:01.246372] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T17:18:01.251241] [INFO ] [REMOTE ] ARDT: Full fetch complete (41041 records). [2025-09-24T17:18:01.251377] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-24T17:18:01.251997] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:18:01.252087] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:18:01.252165] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:18:01.252242] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-24T17:18:01.252327] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-24T17:18:01.252396] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-09-24T17:18:01.252944] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-09-24T17:18:01.253043] [INFO ] [MAIN ] Update Progress: 141/2373 symbols completed. ARDT took 25.4s. Estimated remaining: 4h 44m 18s. Rate: 7.9 symbols/min [2025-09-24T17:18:01.428121] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:01.477055] [DEBUG] [LOCAL ] ARIS: Loaded 41981 existing records from primary storage. [2025-09-24T17:18:01.477212] [INFO ] [MAIN ] ARIS: Loaded 41981 existing records. [2025-09-24T17:18:01.624209] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-24T17:18:01.668549] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:01.668840] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-24T17:18:01.668892] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-24T17:18:01.670797] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-24T17:18:01.670862] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-24T17:18:02.066457] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:02.416089] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-24T17:18:03.216149] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-24T17:18:03.374203] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-24T17:18:04.016098] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-24T17:18:05.236949] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (3.61 seconds). [2025-09-24T17:18:05.247162] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-24T17:18:05.292925] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-24T17:18:05.387577] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-24T17:18:05.616075] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-24T17:18:06.416075] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-24T17:18:06.542212] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-24T17:18:07.127896] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T17:18:07.162173] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T17:18:07.216092] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-24T17:18:07.684414] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:18:08.016144] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-24T17:18:08.816058] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-24T17:18:08.936248] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T17:18:09.616185] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-24T17:18:09.812530] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:18:10.237973] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T17:18:10.416086] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-24T17:18:11.216115] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-24T17:18:11.352627] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T17:18:11.362769] [INFO ] [REMOTE ] ARE: Full fetch complete (72607 records). [2025-09-24T17:18:11.362957] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-24T17:18:11.787217] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-24T17:18:11.787302] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-24T17:18:11.788045] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-24T17:18:11.788121] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-24T17:18:11.791020] [DEBUG] [LOCAL ] ARE: Trimmed 72607 records to 50610 (keeping 200 days of data) [2025-09-24T17:18:11.942358] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T17:18:12.041085] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-24T17:18:12.145570] [DEBUG] [LOCAL ] ARE: Primary data saved (50610 records). [2025-09-24T17:18:12.145781] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-24T17:18:12.145934] [INFO ] [MAIN ] Update Progress: 142/2373 symbols completed. ARE took 35.2s. Estimated remaining: 4h 45m 1s. Rate: 7.8 symbols/min [2025-09-24T17:18:12.317934] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:12.362073] [DEBUG] [LOCAL ] ARLO: Loaded 43939 existing records from primary storage. [2025-09-24T17:18:12.362234] [INFO ] [MAIN ] ARLO: Loaded 43939 existing records. [2025-09-24T17:18:12.542282] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:12.542506] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-24T17:18:12.542553] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-24T17:18:12.544491] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-24T17:18:12.544577] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-24T17:18:12.820687] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-24T17:18:12.935014] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:13.034976] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T17:18:13.616169] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-24T17:18:13.797501] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T17:18:14.220994] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T17:18:14.416087] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-24T17:18:15.216159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-24T17:18:15.280526] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T17:18:16.016088] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-24T17:18:16.662680] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-24T17:18:16.816141] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-24T17:18:17.616209] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-24T17:18:17.724702] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-24T17:18:18.416044] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-24T17:18:18.507736] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-24T17:18:18.969948] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T17:18:19.049226] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:18:19.216096] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-24T17:18:19.784341] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T17:18:20.016072] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-24T17:18:20.499993] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T17:18:20.816087] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-24T17:18:21.221528] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:18:21.616082] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-24T17:18:22.225889] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T17:18:22.237748] [INFO ] [REMOTE ] ARES: Full fetch complete (70275 records). [2025-09-24T17:18:22.237888] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-24T17:18:22.238817] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:18:22.238933] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:18:22.238977] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:18:22.239035] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-24T17:18:22.239118] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-09-24T17:18:22.239166] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-09-24T17:18:22.239600] [DEBUG] [LOCAL ] ARES: Deleted derivative data file. [2025-09-24T17:18:22.243100] [INFO ] [MAIN ] Update Progress: 143/2373 symbols completed. ARES took 32.6s. Estimated remaining: 4h 45m 31s. Rate: 7.8 symbols/min [2025-09-24T17:18:22.426200] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-24T17:18:22.430021] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:22.498869] [DEBUG] [LOCAL ] ARMK: Loaded 50336 existing records from primary storage. [2025-09-24T17:18:22.499015] [INFO ] [MAIN ] ARMK: Loaded 50336 existing records. [2025-09-24T17:18:22.681123] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:22.681420] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-24T17:18:22.681476] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-24T17:18:22.683807] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-24T17:18:22.683889] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-24T17:18:23.072099] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:23.097091] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T17:18:23.216049] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-24T17:18:23.827279] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T17:18:24.016140] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-24T17:18:24.816187] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-24T17:18:24.881565] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T17:18:25.317128] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T17:18:25.616087] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-24T17:18:26.085371] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T17:18:26.416099] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-24T17:18:27.216062] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-24T17:18:27.289252] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T17:18:27.986250] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:18:28.016041] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-24T17:18:28.356690] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T17:18:28.816087] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-24T17:18:29.594010] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T17:18:29.616038] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-24T17:18:30.392232] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T17:18:30.416040] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-24T17:18:31.224441] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-24T17:18:31.229971] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:18:31.911019] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T17:18:32.016047] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-24T17:18:32.528042] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T17:18:32.816107] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-24T17:18:33.517873] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T17:18:33.616062] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-24T17:18:34.417177] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T17:18:34.416396] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-24T17:18:34.425755] [INFO ] [REMOTE ] ARI: Full fetch complete (62770 records). [2025-09-24T17:18:34.425901] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-24T17:18:34.815016] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-24T17:18:34.815119] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-24T17:18:34.815794] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-24T17:18:34.815860] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-24T17:18:34.817828] [DEBUG] [LOCAL ] ARI: Trimmed 62770 records to 43442 (keeping 200 days of data) [2025-09-24T17:18:35.082597] [DEBUG] [LOCAL ] ARI: Primary data saved (43442 records). [2025-09-24T17:18:35.082758] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-24T17:18:35.082853] [INFO ] [MAIN ] Update Progress: 144/2373 symbols completed. ARI took 37.6s. Estimated remaining: 4h 46m 44s. Rate: 7.8 symbols/min [2025-09-24T17:18:35.225139] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-24T17:18:35.283759] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:35.403622] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:18:35.458106] [DEBUG] [LOCAL ] AROC: Loaded 48987 existing records from primary storage. [2025-09-24T17:18:35.458278] [INFO ] [MAIN ] AROC: Loaded 48987 existing records. [2025-09-24T17:18:35.638210] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:35.638505] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-24T17:18:35.638574] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-24T17:18:35.639898] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-24T17:18:35.639964] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-24T17:18:36.017286] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-24T17:18:36.017217] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:36.147932] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T17:18:36.156917] [INFO ] [REMOTE ] ARIS: Full fetch complete (59622 records). [2025-09-24T17:18:36.157040] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-24T17:18:36.160854] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:18:36.160943] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:18:36.160987] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:18:36.161027] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-24T17:18:36.161086] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-24T17:18:36.161123] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-24T17:18:36.161524] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-24T17:18:36.161634] [INFO ] [MAIN ] Update Progress: 145/2373 symbols completed. ARIS took 34.9s. Estimated remaining: 4h 44m 54s. Rate: 7.8 symbols/min [2025-09-24T17:18:36.333391] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:36.393613] [DEBUG] [LOCAL ] ARR: Loaded 52069 existing records from primary storage. [2025-09-24T17:18:36.393813] [INFO ] [MAIN ] ARR: Loaded 52069 existing records. [2025-09-24T17:18:36.589002] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:36.589280] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-24T17:18:36.589332] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-24T17:18:36.591059] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-24T17:18:36.591122] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-24T17:18:36.818466] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-24T17:18:36.965398] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:37.053077] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T17:18:37.359722] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T17:18:37.616091] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-24T17:18:38.416113] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-24T17:18:38.694094] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T17:18:39.216097] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-24T17:18:39.497553] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T17:18:40.016045] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-24T17:18:40.079496] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T17:18:40.788114] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T17:18:40.816097] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-24T17:18:41.616078] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-24T17:18:41.938213] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T17:18:41.946243] [INFO ] [REMOTE ] ARLO: Full fetch complete (62412 records). [2025-09-24T17:18:41.946359] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-24T17:18:42.353623] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-24T17:18:42.353791] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-24T17:18:42.354463] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-24T17:18:42.354544] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-24T17:18:42.364563] [DEBUG] [LOCAL ] ARLO: Trimmed 62412 records to 43875 (keeping 200 days of data) [2025-09-24T17:18:42.381483] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T17:18:42.436325] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-24T17:18:42.650467] [DEBUG] [LOCAL ] ARLO: Primary data saved (43875 records). [2025-09-24T17:18:42.650617] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-24T17:18:42.650733] [INFO ] [MAIN ] Update Progress: 146/2373 symbols completed. ARLO took 30.5s. Estimated remaining: 4h 44m 28s. Rate: 7.8 symbols/min [2025-09-24T17:18:42.832448] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:42.867487] [DEBUG] [LOCAL ] ARW: Loaded 33212 existing records from primary storage. [2025-09-24T17:18:42.867636] [INFO ] [MAIN ] ARW: Loaded 33212 existing records. [2025-09-24T17:18:43.050317] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:18:43.050872] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-24T17:18:43.050932] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-24T17:18:43.052292] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-24T17:18:43.052352] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-24T17:18:43.228839] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-24T17:18:43.444491] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:43.446133] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:18:44.016110] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-24T17:18:44.816084] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-24T17:18:45.195410] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-24T17:18:45.616078] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-24T17:18:45.917483] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T17:18:46.173741] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-24T17:18:46.416046] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-24T17:18:46.676955] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T17:18:47.216058] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-24T17:18:47.615180] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-24T17:18:47.776812] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T17:18:48.016113] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-24T17:18:48.543014] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T17:18:48.816112] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-24T17:18:49.467591] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T17:18:49.616141] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-24T17:18:50.273379] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T17:18:50.416102] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-24T17:18:51.216168] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-24T17:18:51.403916] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T17:18:52.016095] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-24T17:18:52.221052] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T17:18:52.774289] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T17:18:52.816116] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-24T17:18:53.051071] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T17:18:53.616100] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-24T17:18:54.421582] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-24T17:18:54.433290] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T17:18:55.216050] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-24T17:18:55.392499] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T17:18:55.401475] [INFO ] [REMOTE ] ARMK: Full fetch complete (72557 records). [2025-09-24T17:18:55.401603] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-24T17:18:55.814313] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-24T17:18:55.814439] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-24T17:18:55.815338] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-24T17:18:55.815428] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-24T17:18:55.817598] [DEBUG] [LOCAL ] ARMK: Trimmed 72557 records to 50354 (keeping 200 days of data) [2025-09-24T17:18:55.930998] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:18:56.027327] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-24T17:18:56.159924] [DEBUG] [LOCAL ] ARMK: Primary data saved (50354 records). [2025-09-24T17:18:56.160071] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-24T17:18:56.161170] [INFO ] [MAIN ] Update Progress: 147/2373 symbols completed. ARMK took 33.9s. Estimated remaining: 4h 45m 49s. Rate: 7.8 symbols/min [2025-09-24T17:18:56.335081] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:18:56.335255] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-24T17:18:56.335294] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-24T17:18:56.335440] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-24T17:18:56.335485] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-24T17:18:56.335531] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-24T17:18:56.335566] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-24T17:18:56.700918] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:18:56.756702] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:18:56.816097] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-24T17:18:57.120603] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T17:18:57.616094] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-24T17:18:57.823886] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:18:57.824313] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-24T17:18:58.416099] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-24T17:18:58.965554] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-24T17:18:59.216097] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-24T17:19:00.016043] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-24T17:19:00.295082] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:00.295407] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-24T17:19:00.485925] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-24T17:19:00.816126] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-24T17:19:01.023837] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:01.024162] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-24T17:19:01.616085] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-24T17:19:01.923740] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-24T17:19:02.416084] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-24T17:19:02.909637] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T17:19:03.216077] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-24T17:19:03.585624] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:03.586035] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-24T17:19:04.016052] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-24T17:19:04.098907] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T17:19:04.107945] [INFO ] [REMOTE ] AROC: Full fetch complete (70565 records). [2025-09-24T17:19:04.108093] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-24T17:19:04.351406] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:04.411798] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-24T17:19:04.518473] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-24T17:19:04.518600] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-24T17:19:04.519389] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-24T17:19:04.519455] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-24T17:19:04.521188] [DEBUG] [LOCAL ] AROC: Trimmed 70565 records to 48972 (keeping 200 days of data) [2025-09-24T17:19:04.816687] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-24T17:19:04.825202] [DEBUG] [LOCAL ] AROC: Primary data saved (48972 records). [2025-09-24T17:19:04.825331] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-24T17:19:04.825419] [INFO ] [MAIN ] Update Progress: 148/2373 symbols completed. AROC took 29.7s. Estimated remaining: 4h 45m 56s. Rate: 7.8 symbols/min [2025-09-24T17:19:04.997889] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:05.050257] [DEBUG] [LOCAL ] AS: Loaded 53077 existing records from primary storage. [2025-09-24T17:19:05.050424] [INFO ] [MAIN ] AS: Loaded 53077 existing records. [2025-09-24T17:19:05.236613] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:05.236961] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-24T17:19:05.237020] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-24T17:19:05.238242] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-24T17:19:05.238305] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-24T17:19:05.613349] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:05.616035] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-24T17:19:05.820126] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:05.820819] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-24T17:19:06.165945] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T17:19:06.416100] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-24T17:19:07.216082] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-24T17:19:08.016096] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-24T17:19:08.478817] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-24T17:19:08.816124] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-24T17:19:08.863544] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T17:19:08.869565] [INFO ] [REMOTE ] ARW: Full fetch complete (47799 records). [2025-09-24T17:19:08.869699] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-24T17:19:09.150123] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:19:09.164279] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-24T17:19:09.253332] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-24T17:19:09.253413] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-24T17:19:09.253943] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-24T17:19:09.254007] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-24T17:19:09.255028] [DEBUG] [LOCAL ] ARW: Trimmed 47799 records to 33201 (keeping 200 days of data) [2025-09-24T17:19:09.466486] [DEBUG] [LOCAL ] ARW: Primary data saved (33201 records). [2025-09-24T17:19:09.466677] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-24T17:19:09.466786] [INFO ] [MAIN ] Update Progress: 149/2373 symbols completed. ARW took 26.8s. Estimated remaining: 4h 45m 2s. Rate: 7.8 symbols/min [2025-09-24T17:19:09.618330] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-24T17:19:09.654398] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:09.670246] [DEBUG] [LOCAL ] ASA: Loaded 13773 existing records from primary storage. [2025-09-24T17:19:09.670434] [INFO ] [MAIN ] ASA: Loaded 13773 existing records. [2025-09-24T17:19:09.893906] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:09.894419] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-24T17:19:09.894568] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-24T17:19:09.895153] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-24T17:19:09.895223] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-24T17:19:09.999847] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T17:19:10.421266] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-24T17:19:10.533848] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:10.616903] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T17:19:11.216103] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-24T17:19:12.016078] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-24T17:19:12.295093] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-24T17:19:12.816146] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-24T17:19:12.978076] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T17:19:13.134288] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T17:19:13.616132] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-24T17:19:14.382349] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T17:19:14.416058] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-24T17:19:15.162442] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T17:19:15.216100] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-24T17:19:16.016107] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-24T17:19:16.116556] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T17:19:16.124685] [INFO ] [REMOTE ] ARX: Full fetch complete (13721 records). [2025-09-24T17:19:16.124903] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-24T17:19:16.305702] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-24T17:19:16.305994] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:19:16.306067] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:19:16.306140] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-24T17:19:16.306208] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-24T17:19:16.306246] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-24T17:19:16.306286] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-24T17:19:16.306343] [INFO ] [MAIN ] Update Progress: 150/2373 symbols completed. ARX took 20.1s. Estimated remaining: 4h 44m 42s. Rate: 7.8 symbols/min [2025-09-24T17:19:16.475631] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:16.537038] [DEBUG] [LOCAL ] ASAN: Loaded 52755 existing records from primary storage. [2025-09-24T17:19:16.537216] [INFO ] [MAIN ] ASAN: Loaded 52755 existing records. [2025-09-24T17:19:16.723720] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:16.724144] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-24T17:19:16.724375] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-24T17:19:16.725760] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-24T17:19:16.725824] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-24T17:19:16.818849] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-24T17:19:17.147322] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T17:19:17.173375] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:17.616100] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-24T17:19:17.891357] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T17:19:18.001900] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T17:19:18.416126] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-24T17:19:19.216159] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-24T17:19:19.862115] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-24T17:19:20.016059] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-24T17:19:20.203922] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T17:19:20.223855] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T17:19:20.816109] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-24T17:19:21.591127] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T17:19:21.616048] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-24T17:19:22.416056] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-24T17:19:22.506140] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T17:19:23.216097] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-24T17:19:23.404930] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:19:24.016094] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-24T17:19:24.105069] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T17:19:24.537624] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-24T17:19:24.546435] [INFO ] [REMOTE ] ARR: Full fetch complete (74736 records). [2025-09-24T17:19:24.546628] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-24T17:19:24.547518] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:19:24.547617] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:19:24.547694] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:19:24.547765] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-24T17:19:24.547834] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-09-24T17:19:24.547873] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-09-24T17:19:24.548294] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-09-24T17:19:24.548396] [INFO ] [MAIN ] Update Progress: 151/2373 symbols completed. ARR took 48.4s. Estimated remaining: 4h 44m 42s. Rate: 7.8 symbols/min [2025-09-24T17:19:24.722973] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:24.771301] [DEBUG] [LOCAL ] ASB: Loaded 49587 existing records from primary storage. [2025-09-24T17:19:24.771446] [INFO ] [MAIN ] ASB: Loaded 49587 existing records. [2025-09-24T17:19:24.825758] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-24T17:19:24.957488] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:24.957809] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-24T17:19:24.957863] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-24T17:19:24.959061] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-24T17:19:24.959126] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-24T17:19:25.331255] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:25.616039] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-24T17:19:25.810385] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T17:19:25.852036] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T17:19:26.416081] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-24T17:19:27.216092] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-24T17:19:27.369183] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T17:19:28.016063] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-24T17:19:28.167576] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T17:19:28.745499] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T17:19:28.816042] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-24T17:19:29.556925] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T17:19:29.616040] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-24T17:19:30.416079] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-24T17:19:30.831294] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T17:19:30.962194] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T17:19:31.216083] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-24T17:19:32.016088] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-24T17:19:32.170600] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T17:19:32.661416] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T17:19:32.816085] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-24T17:19:32.850598] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T17:19:33.616087] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-24T17:19:34.416087] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-24T17:19:34.557238] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:19:34.594952] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T17:19:35.216095] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-24T17:19:36.016067] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-24T17:19:36.278875] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T17:19:36.301296] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T17:19:36.816084] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-24T17:19:37.616140] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-24T17:19:37.740296] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T17:19:38.416053] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-24T17:19:38.573321] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T17:19:38.638786] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T17:19:39.216084] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-24T17:19:40.016076] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-24T17:19:40.084633] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T17:19:40.816050] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-24T17:19:41.069786] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:19:41.606362] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T17:19:41.616085] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-24T17:19:41.616388] [INFO ] [REMOTE ] AS: Full fetch complete (76525 records). [2025-09-24T17:19:41.617497] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-24T17:19:42.052454] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-24T17:19:42.052580] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-24T17:19:42.053722] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-24T17:19:42.053796] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-24T17:19:42.056079] [DEBUG] [LOCAL ] AS: Trimmed 76525 records to 53077 (keeping 200 days of data) [2025-09-24T17:19:42.429377] [DEBUG] [LOCAL ] AS: Primary data saved (53077 records). [2025-09-24T17:19:42.425186] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-24T17:19:42.431221] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T17:19:42.441363] [INFO ] [MAIN ] AS: Full history saved. [2025-09-24T17:19:42.441563] [INFO ] [MAIN ] Update Progress: 152/2373 symbols completed. AS took 37.6s. Estimated remaining: 4h 47m 4s. Rate: 7.7 symbols/min [2025-09-24T17:19:42.621192] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:42.626280] [DEBUG] [LOCAL ] ASBA: Loaded 3438 existing records from primary storage. [2025-09-24T17:19:42.626368] [INFO ] [MAIN ] ASBA: Loaded 3438 existing records. [2025-09-24T17:19:42.818154] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T17:19:42.822130] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:42.826433] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-24T17:19:42.826540] [INFO ] [REMOTE ] ASA: Full fetch complete (18526 records). [2025-09-24T17:19:42.826635] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-24T17:19:42.826759] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-24T17:19:42.858519] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-24T17:19:42.902395] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-24T17:19:43.232372] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-24T17:19:43.611561] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:43.648274] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-24T17:19:43.648373] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-24T17:19:43.648858] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-24T17:19:43.648933] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-24T17:19:43.649747] [DEBUG] [LOCAL ] ASA: Trimmed 18526 records to 13835 (keeping 200 days of data) [2025-09-24T17:19:43.732506] [DEBUG] [LOCAL ] ASA: Primary data saved (13835 records). [2025-09-24T17:19:43.732680] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-24T17:19:43.732787] [INFO ] [MAIN ] Update Progress: 153/2373 symbols completed. ASA took 34.3s. Estimated remaining: 4h 45m 22s. Rate: 7.8 symbols/min [2025-09-24T17:19:43.904849] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:43.943468] [DEBUG] [LOCAL ] ASC: Loaded 37756 existing records from primary storage. [2025-09-24T17:19:43.943606] [INFO ] [MAIN ] ASC: Loaded 37756 existing records. [2025-09-24T17:19:44.018706] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-24T17:19:44.160815] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:44.161298] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-24T17:19:44.161777] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-24T17:19:44.163252] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T17:19:44.167158] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-24T17:19:44.174136] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-24T17:19:44.542164] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:44.713842] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T17:19:44.759471] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T17:19:44.816092] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-24T17:19:45.317776] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T17:19:45.616075] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-24T17:19:46.416086] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-24T17:19:47.216072] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-24T17:19:47.549135] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:19:47.558567] [INFO ] [REMOTE ] ASAN: Full fetch complete (76551 records). [2025-09-24T17:19:47.559111] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-24T17:19:47.832544] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T17:19:47.969180] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-24T17:19:47.969318] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-24T17:19:47.970123] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-24T17:19:47.970192] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-24T17:19:47.971919] [DEBUG] [LOCAL ] ASAN: Trimmed 76551 records to 52745 (keeping 200 days of data) [2025-09-24T17:19:48.024085] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-24T17:19:48.298493] [DEBUG] [LOCAL ] ASAN: Primary data saved (52745 records). [2025-09-24T17:19:48.298662] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-24T17:19:48.303235] [INFO ] [MAIN ] Update Progress: 154/2373 symbols completed. ASAN took 32.0s. Estimated remaining: 4h 44m 29s. Rate: 7.8 symbols/min [2025-09-24T17:19:48.484403] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:48.512635] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T17:19:48.540046] [DEBUG] [LOCAL ] ASG: Loaded 20570 existing records from primary storage. [2025-09-24T17:19:48.540264] [INFO ] [MAIN ] ASG: Loaded 20570 existing records. [2025-09-24T17:19:48.719873] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:48.720127] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-24T17:19:48.720211] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-24T17:19:48.720879] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-24T17:19:48.720958] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-24T17:19:48.821236] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-24T17:19:49.096196] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:49.623126] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-24T17:19:49.625898] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T17:19:50.154039] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T17:19:50.308120] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T17:19:50.316269] [INFO ] [REMOTE ] ASB: Full fetch complete (71212 records). [2025-09-24T17:19:50.316382] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-24T17:19:50.317189] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:19:50.317277] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:19:50.317322] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:19:50.317396] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-24T17:19:50.317463] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-09-24T17:19:50.317501] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-09-24T17:19:50.318034] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-09-24T17:19:50.318130] [INFO ] [MAIN ] Update Progress: 155/2373 symbols completed. ASB took 25.8s. Estimated remaining: 4h 43m 0s. Rate: 7.8 symbols/min [2025-09-24T17:19:50.420971] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-24T17:19:50.493696] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:19:50.517885] [DEBUG] [LOCAL ] ASGI: Loaded 22412 existing records from primary storage. [2025-09-24T17:19:50.518067] [INFO ] [MAIN ] ASGI: Loaded 22412 existing records. [2025-09-24T17:19:50.714756] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:19:50.715064] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-24T17:19:50.715114] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-24T17:19:50.715814] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-24T17:19:50.715876] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-24T17:19:51.082256] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:19:51.216093] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-24T17:19:52.008254] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T17:19:52.016407] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-24T17:19:52.342531] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T17:19:52.569953] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T17:19:52.816084] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-24T17:19:53.227462] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T17:19:53.616110] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-24T17:19:54.160281] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-24T17:19:54.416103] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-24T17:19:55.216089] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-24T17:19:55.510931] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T17:19:56.016087] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-24T17:19:56.345608] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T17:19:56.816046] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-24T17:19:57.279363] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:19:57.616096] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-24T17:19:58.302388] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T17:19:58.416038] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-24T17:19:58.467976] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T17:19:59.216108] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-24T17:19:59.594182] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T17:20:00.016122] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-24T17:20:00.816084] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-24T17:20:00.892606] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T17:20:01.045109] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T17:20:01.616076] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-24T17:20:01.673316] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T17:20:02.416133] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-24T17:20:02.908720] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T17:20:03.216308] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-24T17:20:03.806991] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T17:20:04.016097] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-24T17:20:04.047893] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T17:20:04.631295] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T17:20:04.632442] [INFO ] [REMOTE ] ASBA: Full fetch complete (5263 records). [2025-09-24T17:20:04.632514] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-24T17:20:04.823381] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-24T17:20:05.018592] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-24T17:20:05.018726] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-24T17:20:05.019041] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-24T17:20:05.019106] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-24T17:20:05.019563] [DEBUG] [LOCAL ] ASBA: Trimmed 5263 records to 3433 (keeping 200 days of data) [2025-09-24T17:20:05.041418] [DEBUG] [LOCAL ] ASBA: Primary data saved (3433 records). [2025-09-24T17:20:05.041492] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-24T17:20:05.041582] [INFO ] [MAIN ] Update Progress: 156/2373 symbols completed. ASBA took 22.6s. Estimated remaining: 4h 44m 33s. Rate: 7.8 symbols/min [2025-09-24T17:20:05.222609] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:05.222935] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-09-24T17:20:05.222995] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-24T17:20:05.223168] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-24T17:20:05.223215] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-24T17:20:05.223316] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-24T17:20:05.223361] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-24T17:20:05.630540] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-24T17:20:05.653609] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:06.075311] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T17:20:06.416084] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-24T17:20:06.900875] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T17:20:07.216090] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-24T17:20:07.486130] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T17:20:08.016076] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-24T17:20:08.517242] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T17:20:08.816046] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-24T17:20:09.135280] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T17:20:09.616086] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-24T17:20:10.132957] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T17:20:10.416085] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-24T17:20:10.722480] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T17:20:11.216121] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-24T17:20:11.986806] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:20:12.016056] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-24T17:20:12.275710] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T17:20:12.816101] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-24T17:20:13.514705] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:20:13.616101] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-24T17:20:14.290896] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:20:14.416057] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-24T17:20:14.711902] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T17:20:15.216073] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-24T17:20:15.703091] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T17:20:15.906056] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T17:20:16.016048] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-24T17:20:16.816085] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-24T17:20:17.568236] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T17:20:17.616037] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-24T17:20:17.689816] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T17:20:18.416081] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-24T17:20:18.621618] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T17:20:18.630061] [INFO ] [REMOTE ] ASC: Full fetch complete (57127 records). [2025-09-24T17:20:18.630233] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-24T17:20:19.059742] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-24T17:20:19.059873] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-24T17:20:19.061436] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-24T17:20:19.061563] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-24T17:20:19.068084] [DEBUG] [LOCAL ] ASC: Trimmed 57127 records to 37684 (keeping 200 days of data) [2025-09-24T17:20:19.216072] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-24T17:20:19.328491] [DEBUG] [LOCAL ] ASC: Primary data saved (37684 records). [2025-09-24T17:20:19.328666] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-24T17:20:19.328875] [INFO ] [MAIN ] Update Progress: 157/2373 symbols completed. ASC took 35.6s. Estimated remaining: 4h 45m 58s. Rate: 7.7 symbols/min [2025-09-24T17:20:19.422576] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T17:20:20.016129] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-24T17:20:20.250951] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:20:20.816102] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-24T17:20:21.553301] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T17:20:21.616063] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-24T17:20:21.941594] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:20:21.946212] [INFO ] [REMOTE ] ASGI: Full fetch complete (33450 records). [2025-09-24T17:20:21.946316] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-24T17:20:22.354314] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-24T17:20:22.354400] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-24T17:20:22.354837] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-24T17:20:22.354901] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-24T17:20:22.355754] [DEBUG] [LOCAL ] ASGI: Trimmed 33450 records to 22386 (keeping 200 days of data) [2025-09-24T17:20:22.428267] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-24T17:20:22.522324] [DEBUG] [LOCAL ] ASGI: Primary data saved (22386 records). [2025-09-24T17:20:22.522483] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-24T17:20:22.522706] [INFO ] [MAIN ] Update Progress: 158/2373 symbols completed. ASGI took 32.2s. Estimated remaining: 4h 44m 47s. Rate: 7.8 symbols/min [2025-09-24T17:20:23.033625] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T17:20:23.192603] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T17:20:23.196239] [INFO ] [REMOTE ] ASG: Full fetch complete (31321 records). [2025-09-24T17:20:23.196326] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-24T17:20:23.197191] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:20:23.197321] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:20:23.197378] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:20:23.197452] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-24T17:20:23.197548] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-24T17:20:23.197626] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-24T17:20:23.198178] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-09-24T17:20:23.198353] [INFO ] [MAIN ] Update Progress: 159/2373 symbols completed. ASG took 34.9s. Estimated remaining: 4h 43m 1s. Rate: 7.8 symbols/min [2025-09-24T17:20:23.216043] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-24T17:20:24.441492] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:20:24.449137] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-24T17:20:25.755722] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T17:20:25.764327] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-24T17:20:27.349797] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T17:20:27.359151] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-24T17:20:28.845274] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T17:20:28.854792] [INFO ] [REMOTE ] ASGN: Full fetch complete (51691 records). [2025-09-24T17:20:28.854927] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-24T17:20:29.253871] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-24T17:20:29.253995] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-24T17:20:29.254570] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-24T17:20:29.254633] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-24T17:20:29.259841] [DEBUG] [LOCAL ] ASGN: Trimmed 51691 records to 35922 (keeping 200 days of data) [2025-09-24T17:20:29.477060] [DEBUG] [LOCAL ] ASGN: Primary data saved (35922 records). [2025-09-24T17:20:29.477197] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-24T17:20:29.477273] [INFO ] [MAIN ] Update Progress: 160/2373 symbols completed. ASGN took 24.4s. Estimated remaining: 4h 42m 34s. Rate: 7.8 symbols/min [2025-09-24T17:20:30.113537] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:30.152524] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:30.244007] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:30.270189] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:30.287808] [DEBUG] [LOCAL ] ASR: Loaded 9238 existing records from primary storage. [2025-09-24T17:20:30.287951] [INFO ] [MAIN ] ASR: Loaded 9238 existing records. [2025-09-24T17:20:30.357161] [DEBUG] [LOCAL ] ASIX: Loaded 22480 existing records from primary storage. [2025-09-24T17:20:30.387729] [INFO ] [MAIN ] ASIX: Loaded 22480 existing records. [2025-09-24T17:20:30.610799] [DEBUG] [LOCAL ] ASH: Loaded 37789 existing records from primary storage. [2025-09-24T17:20:30.688949] [INFO ] [MAIN ] ASH: Loaded 37789 existing records. [2025-09-24T17:20:30.703523] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:30.744028] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-24T17:20:30.779858] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-24T17:20:30.785244] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:30.790722] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-24T17:20:30.823356] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-24T17:20:30.824113] [DEBUG] [LOCAL ] ASPN: Loaded 49610 existing records from primary storage. [2025-09-24T17:20:30.869003] [INFO ] [MAIN ] ASPN: Loaded 49610 existing records. [2025-09-24T17:20:30.829330] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-24T17:20:30.883029] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-24T17:20:31.001835] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-24T17:20:31.030863] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-24T17:20:31.373777] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:31.378426] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:31.443029] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-24T17:20:31.448334] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-24T17:20:31.442903] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-24T17:20:31.464473] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-24T17:20:31.469847] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-24T17:20:31.488392] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-24T17:20:31.602962] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-24T17:20:31.608611] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-24T17:20:31.833926] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:31.868146] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-24T17:20:32.432338] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:32.533066] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:32.521084] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-24T17:20:32.544624] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-24T17:20:32.626768] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:32.627109] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-24T17:20:32.794929] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T17:20:32.797049] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-24T17:20:33.663165] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T17:20:33.667252] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-24T17:20:33.673242] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T17:20:33.675442] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-24T17:20:34.038487] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T17:20:34.045823] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-24T17:20:34.408832] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T17:20:34.410952] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-24T17:20:34.506440] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T17:20:34.516839] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-24T17:20:34.639508] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T17:20:34.643591] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-24T17:20:35.130278] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T17:20:35.216047] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-24T17:20:35.249928] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:20:35.579639] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T17:20:35.921183] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T17:20:36.013519] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T17:20:36.022942] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-24T17:20:36.816104] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-24T17:20:37.518016] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T17:20:37.547166] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T17:20:37.616065] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-24T17:20:38.416106] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-24T17:20:39.206813] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T17:20:39.216037] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-24T17:20:39.280536] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T17:20:40.006177] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T17:20:40.016032] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-24T17:20:40.808823] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T17:20:40.816018] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-24T17:20:41.605735] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T17:20:41.616023] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-24T17:20:42.392197] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T17:20:42.394529] [INFO ] [REMOTE ] ASR: Full fetch complete (12320 records). [2025-09-24T17:20:42.394621] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-24T17:20:42.425481] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-24T17:20:42.774817] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-24T17:20:42.775133] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-24T17:20:42.775404] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-24T17:20:42.775445] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-24T17:20:42.775936] [DEBUG] [LOCAL ] ASR: Trimmed 12320 records to 9262 (keeping 200 days of data) [2025-09-24T17:20:42.836550] [DEBUG] [LOCAL ] ASR: Primary data saved (9262 records). [2025-09-24T17:20:42.836730] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-24T17:20:42.836825] [INFO ] [MAIN ] Update Progress: 161/2373 symbols completed. ASR took 13.3s. Estimated remaining: 4h 43m 45s. Rate: 7.8 symbols/min [2025-09-24T17:20:43.005960] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:43.059400] [DEBUG] [LOCAL ] ASX: Loaded 52890 existing records from primary storage. [2025-09-24T17:20:43.059585] [INFO ] [MAIN ] ASX: Loaded 52890 existing records. [2025-09-24T17:20:43.219161] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-24T17:20:43.246601] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:43.247891] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-24T17:20:43.247959] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-24T17:20:43.250907] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-24T17:20:43.250978] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-24T17:20:43.651247] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:44.010394] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T17:20:44.016149] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-24T17:20:44.816051] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-24T17:20:45.016529] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:20:45.142350] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T17:20:45.616081] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-24T17:20:46.421165] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-24T17:20:46.441761] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T17:20:47.216073] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-24T17:20:47.459022] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T17:20:47.644428] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T17:20:48.016070] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-24T17:20:48.638023] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T17:20:48.816116] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-24T17:20:49.616050] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-24T17:20:49.920462] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:20:49.944678] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T17:20:50.416098] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-24T17:20:51.149549] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:20:51.216039] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-24T17:20:51.571964] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T17:20:52.016073] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-24T17:20:52.766593] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T17:20:52.816058] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-24T17:20:53.616067] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-24T17:20:53.789925] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T17:20:54.416115] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-24T17:20:54.465748] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T17:20:54.691473] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T17:20:55.216125] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-24T17:20:55.582275] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T17:20:55.587514] [INFO ] [REMOTE ] ASIX: Full fetch complete (29631 records). [2025-09-24T17:20:55.587789] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-24T17:20:55.588835] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:20:55.588957] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:20:55.589007] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:20:55.589057] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-24T17:20:55.589163] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-24T17:20:55.589213] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-24T17:20:55.589976] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-09-24T17:20:55.590318] [INFO ] [MAIN ] Update Progress: 162/2373 symbols completed. ASIX took 26.1s. Estimated remaining: 4h 44m 46s. Rate: 7.8 symbols/min [2025-09-24T17:20:55.806489] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:20:55.870998] [DEBUG] [LOCAL ] ATEN: Loaded 39963 existing records from primary storage. [2025-09-24T17:20:55.871296] [INFO ] [MAIN ] ATEN: Loaded 39963 existing records. [2025-09-24T17:20:56.022899] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-24T17:20:56.167529] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:20:56.169468] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-24T17:20:56.169542] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-24T17:20:56.173530] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-24T17:20:56.173709] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-24T17:20:56.688481] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:20:56.816229] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-24T17:20:57.131777] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T17:20:57.597110] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T17:20:57.616051] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-24T17:20:58.416063] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-24T17:20:58.771720] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T17:20:59.177345] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:20:59.216082] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-24T17:20:59.914963] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T17:21:00.016090] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-24T17:21:00.658724] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T17:21:00.816163] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-24T17:21:01.466249] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T17:21:01.616154] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-24T17:21:02.416143] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-24T17:21:03.216081] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-24T17:21:03.398904] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-24T17:21:04.016073] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-24T17:21:04.436974] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-24T17:21:04.444150] [INFO ] [REMOTE ] ASH: Full fetch complete (54595 records). [2025-09-24T17:21:04.444338] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-24T17:21:04.866494] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-24T17:21:04.866615] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-24T17:21:04.867435] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-24T17:21:04.867515] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-24T17:21:04.895191] [DEBUG] [LOCAL ] ASH: Trimmed 54595 records to 37748 (keeping 200 days of data) [2025-09-24T17:21:04.900893] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-24T17:21:05.015697] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-24T17:21:05.157746] [DEBUG] [LOCAL ] ASH: Primary data saved (37748 records). [2025-09-24T17:21:05.157913] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-24T17:21:05.158007] [INFO ] [MAIN ] Update Progress: 163/2373 symbols completed. ASH took 35.7s. Estimated remaining: 4h 45m 3s. Rate: 7.8 symbols/min [2025-09-24T17:21:05.330505] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:05.366186] [DEBUG] [LOCAL ] ATGE: Loaded 32031 existing records from primary storage. [2025-09-24T17:21:05.366499] [INFO ] [MAIN ] ATGE: Loaded 32031 existing records. [2025-09-24T17:21:05.510773] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-24T17:21:05.583246] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:05.583493] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-24T17:21:05.583543] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-24T17:21:05.584905] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-24T17:21:05.584969] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-24T17:21:05.630058] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-24T17:21:05.970630] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:06.012767] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T17:21:06.416095] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-24T17:21:06.934553] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T17:21:07.216205] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-24T17:21:07.674387] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T17:21:08.016064] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-24T17:21:08.423038] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-24T17:21:08.816053] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-24T17:21:08.952708] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T17:21:09.363860] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T17:21:09.616314] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-24T17:21:10.049239] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T17:21:10.416086] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-24T17:21:11.216184] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-24T17:21:11.662690] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T17:21:11.672782] [INFO ] [REMOTE ] ASX: Full fetch complete (76610 records). [2025-09-24T17:21:11.672928] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-24T17:21:11.938021] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T17:21:12.016124] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-24T17:21:12.167101] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-24T17:21:12.167193] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-24T17:21:12.167962] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-24T17:21:12.168027] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-24T17:21:12.169468] [DEBUG] [LOCAL ] ASX: Trimmed 76610 records to 52874 (keeping 200 days of data) [2025-09-24T17:21:12.486990] [DEBUG] [LOCAL ] ASX: Primary data saved (52874 records). [2025-09-24T17:21:12.487141] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-24T17:21:12.487230] [INFO ] [MAIN ] Update Progress: 164/2373 symbols completed. ASX took 29.7s. Estimated remaining: 4h 44m 50s. Rate: 7.8 symbols/min [2025-09-24T17:21:12.658639] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:12.691673] [DEBUG] [LOCAL ] ATHM: Loaded 32638 existing records from primary storage. [2025-09-24T17:21:12.691823] [INFO ] [MAIN ] ATHM: Loaded 32638 existing records. [2025-09-24T17:21:12.831080] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-24T17:21:12.871889] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:12.872099] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-24T17:21:12.872146] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-24T17:21:12.873755] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-24T17:21:12.873819] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-24T17:21:13.227874] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:13.616051] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-24T17:21:13.860055] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-24T17:21:14.006037] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T17:21:14.416091] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-24T17:21:15.194779] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-24T17:21:15.216043] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-24T17:21:16.016088] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-24T17:21:16.271485] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T17:21:16.282150] [INFO ] [REMOTE ] ASPN: Full fetch complete (72324 records). [2025-09-24T17:21:16.282305] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-24T17:21:16.732880] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T17:21:16.731957] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-24T17:21:16.740413] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-24T17:21:16.742040] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-24T17:21:16.742272] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-24T17:21:16.744040] [DEBUG] [LOCAL ] ASPN: Trimmed 72324 records to 49580 (keeping 200 days of data) [2025-09-24T17:21:16.781244] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-24T17:21:16.834319] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-24T17:21:17.075817] [DEBUG] [LOCAL ] ASPN: Primary data saved (49580 records). [2025-09-24T17:21:17.075972] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-24T17:21:17.076062] [INFO ] [MAIN ] Update Progress: 165/2373 symbols completed. ASPN took 47.6s. Estimated remaining: 4h 44m 0s. Rate: 7.8 symbols/min [2025-09-24T17:21:17.255930] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:17.265493] [DEBUG] [LOCAL ] ATHS: Loaded 7107 existing records from primary storage. [2025-09-24T17:21:17.265585] [INFO ] [MAIN ] ATHS: Loaded 7107 existing records. [2025-09-24T17:21:17.458539] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:17.458889] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-24T17:21:17.459014] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-24T17:21:17.459484] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-24T17:21:17.459545] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-24T17:21:17.621491] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-24T17:21:17.861993] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:21:17.891898] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:18.291349] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T17:21:18.416104] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-24T17:21:19.119530] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T17:21:19.216113] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-24T17:21:19.296588] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T17:21:20.016099] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-24T17:21:20.561866] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T17:21:20.816118] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-24T17:21:21.488534] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T17:21:21.539029] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T17:21:21.616077] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-24T17:21:22.416134] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-24T17:21:23.216118] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-24T17:21:23.249623] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T17:21:23.672289] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T17:21:23.800432] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T17:21:24.016132] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-24T17:21:24.816100] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-24T17:21:25.558199] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T17:21:25.616039] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-24T17:21:26.217811] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T17:21:26.224782] [INFO ] [REMOTE ] ATEN: Full fetch complete (57502 records). [2025-09-24T17:21:26.224963] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-24T17:21:26.426337] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-24T17:21:26.622075] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-24T17:21:26.622159] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-24T17:21:26.622853] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-24T17:21:26.622920] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-24T17:21:26.624174] [DEBUG] [LOCAL ] ATEN: Trimmed 57502 records to 39882 (keeping 200 days of data) [2025-09-24T17:21:26.870497] [DEBUG] [LOCAL ] ATEN: Primary data saved (39882 records). [2025-09-24T17:21:26.870638] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-24T17:21:26.870767] [INFO ] [MAIN ] Update Progress: 166/2373 symbols completed. ATEN took 31.3s. Estimated remaining: 4h 44m 20s. Rate: 7.8 symbols/min [2025-09-24T17:21:27.040939] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:27.092272] [DEBUG] [LOCAL ] ATI: Loaded 51578 existing records from primary storage. [2025-09-24T17:21:27.092421] [INFO ] [MAIN ] ATI: Loaded 51578 existing records. [2025-09-24T17:21:27.220070] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-24T17:21:27.282460] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:27.283077] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-24T17:21:27.283191] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-24T17:21:27.285837] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-24T17:21:27.285908] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-24T17:21:27.587146] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T17:21:27.721992] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:27.888778] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T17:21:27.909476] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T17:21:28.016086] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-24T17:21:28.737077] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T17:21:28.816086] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-24T17:21:29.616099] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-24T17:21:30.189601] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T17:21:30.416075] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-24T17:21:30.505953] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:21:31.216082] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-24T17:21:31.647167] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:21:32.016107] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-24T17:21:32.816119] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-24T17:21:32.945226] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:21:33.049745] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:21:33.616156] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-24T17:21:33.867174] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T17:21:34.349715] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T17:21:34.416043] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-24T17:21:35.216102] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-24T17:21:35.331046] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T17:21:35.976374] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T17:21:36.016084] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-24T17:21:36.816138] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-24T17:21:37.475255] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T17:21:37.616080] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-24T17:21:38.225833] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T17:21:38.230976] [INFO ] [REMOTE ] ATGE: Full fetch complete (46238 records). [2025-09-24T17:21:38.231140] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-24T17:21:38.422212] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-24T17:21:38.620062] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-24T17:21:38.620146] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-24T17:21:38.620694] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-24T17:21:38.620758] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-24T17:21:38.621828] [DEBUG] [LOCAL ] ATGE: Trimmed 46238 records to 31901 (keeping 200 days of data) [2025-09-24T17:21:38.819570] [DEBUG] [LOCAL ] ATGE: Primary data saved (31901 records). [2025-09-24T17:21:38.819945] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-24T17:21:38.820042] [INFO ] [MAIN ] Update Progress: 167/2373 symbols completed. ATGE took 33.7s. Estimated remaining: 4h 45m 8s. Rate: 7.7 symbols/min [2025-09-24T17:21:38.998817] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:39.037879] [DEBUG] [LOCAL ] ATKR: Loaded 35702 existing records from primary storage. [2025-09-24T17:21:39.038083] [INFO ] [MAIN ] ATKR: Loaded 35702 existing records. [2025-09-24T17:21:39.234163] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T17:21:39.234242] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-24T17:21:39.239146] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:39.243431] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-24T17:21:39.243712] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-24T17:21:39.253941] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-24T17:21:39.268386] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-24T17:21:39.346539] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T17:21:39.648401] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:40.016067] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-24T17:21:40.479437] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T17:21:40.486412] [INFO ] [REMOTE ] ATHM: Full fetch complete (51867 records). [2025-09-24T17:21:40.486598] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-24T17:21:40.821206] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-24T17:21:40.920241] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-24T17:21:40.920334] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-24T17:21:40.920983] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-24T17:21:40.921049] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-24T17:21:40.922237] [DEBUG] [LOCAL ] ATHM: Trimmed 51867 records to 32665 (keeping 200 days of data) [2025-09-24T17:21:41.114003] [DEBUG] [LOCAL ] ATHM: Primary data saved (32665 records). [2025-09-24T17:21:41.114158] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-24T17:21:41.114247] [INFO ] [MAIN ] Update Progress: 168/2373 symbols completed. ATHM took 28.6s. Estimated remaining: 4h 43m 49s. Rate: 7.8 symbols/min [2025-09-24T17:21:41.301695] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:41.341880] [DEBUG] [LOCAL ] ATMU: Loaded 39751 existing records from primary storage. [2025-09-24T17:21:41.342100] [INFO ] [MAIN ] ATMU: Loaded 39751 existing records. [2025-09-24T17:21:41.565736] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:41.566250] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-24T17:21:41.566401] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-24T17:21:41.568547] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-24T17:21:41.568614] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-24T17:21:41.617686] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-24T17:21:41.751228] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T17:21:41.779599] [INFO ] [REMOTE ] ATHS: Full fetch complete (10065 records). [2025-09-24T17:21:41.825217] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:21:41.845405] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-24T17:21:42.194965] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:42.394875] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-24T17:21:42.394955] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-24T17:21:42.395229] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-24T17:21:42.395267] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-24T17:21:42.395731] [DEBUG] [LOCAL ] ATHS: Trimmed 10065 records to 7098 (keeping 200 days of data) [2025-09-24T17:21:42.419190] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-24T17:21:42.443006] [DEBUG] [LOCAL ] ATHS: Primary data saved (7098 records). [2025-09-24T17:21:42.443684] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-24T17:21:42.443824] [INFO ] [MAIN ] Update Progress: 169/2373 symbols completed. ATHS took 25.4s. Estimated remaining: 4h 42m 18s. Rate: 7.8 symbols/min [2025-09-24T17:21:42.613460] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:21:42.658014] [DEBUG] [LOCAL ] ATO: Loaded 41969 existing records from primary storage. [2025-09-24T17:21:42.658175] [INFO ] [MAIN ] ATO: Loaded 41969 existing records. [2025-09-24T17:21:42.852489] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:21:42.852798] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-24T17:21:42.852854] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-24T17:21:42.855229] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-24T17:21:42.855294] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-24T17:21:43.223962] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-24T17:21:43.272378] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:21:43.295843] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T17:21:44.016104] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-24T17:21:44.816055] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-24T17:21:44.857169] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T17:21:45.041555] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-24T17:21:45.448636] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:21:45.616084] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-24T17:21:46.249233] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T17:21:46.416105] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-24T17:21:47.075366] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T17:21:47.216155] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-24T17:21:48.016142] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-24T17:21:48.176232] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:21:48.807259] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T17:21:48.817002] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-24T17:21:49.115680] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T17:21:49.616137] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-24T17:21:50.347200] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:21:50.416087] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-24T17:21:51.205299] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T17:21:51.216074] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-24T17:21:51.985133] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T17:21:52.016198] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-24T17:21:52.696891] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:21:52.816116] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-24T17:21:53.616084] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-24T17:21:53.718029] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:21:53.930814] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T17:21:54.416089] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-24T17:21:55.053739] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T17:21:55.216377] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-24T17:21:56.016088] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-24T17:21:56.412621] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T17:21:56.816148] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-24T17:21:57.360413] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T17:21:57.616090] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-24T17:21:58.182521] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T17:21:58.416064] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-24T17:21:59.216070] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-24T17:21:59.321514] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T17:21:59.478186] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T17:21:59.785705] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (5.37 seconds). [2025-09-24T17:22:00.016132] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-24T17:22:00.316843] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T17:22:00.816086] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-24T17:22:01.616107] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-24T17:22:01.681928] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T17:22:02.223683] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T17:22:02.416138] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-24T17:22:03.166924] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:22:03.175839] [INFO ] [REMOTE ] ATI: Full fetch complete (73827 records). [2025-09-24T17:22:03.175962] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-24T17:22:03.221148] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-24T17:22:03.589803] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-24T17:22:03.589901] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-24T17:22:03.590776] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-24T17:22:03.590844] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-24T17:22:03.592381] [DEBUG] [LOCAL ] ATI: Trimmed 73827 records to 51530 (keeping 200 days of data) [2025-09-24T17:22:03.703894] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T17:22:03.931377] [DEBUG] [LOCAL ] ATI: Primary data saved (51530 records). [2025-09-24T17:22:03.931535] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-24T17:22:03.931626] [INFO ] [MAIN ] Update Progress: 170/2373 symbols completed. ATI took 37.1s. Estimated remaining: 4h 45m 9s. Rate: 7.7 symbols/min [2025-09-24T17:22:04.021206] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-24T17:22:04.115901] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:04.148800] [DEBUG] [LOCAL ] ATR: Loaded 30488 existing records from primary storage. [2025-09-24T17:22:04.148965] [INFO ] [MAIN ] ATR: Loaded 30488 existing records. [2025-09-24T17:22:04.325069] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:22:04.325498] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-24T17:22:04.325596] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-24T17:22:04.327296] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-24T17:22:04.327386] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-24T17:22:04.688716] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:04.710232] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T17:22:04.717416] [INFO ] [REMOTE ] ATMU: Full fetch complete (56555 records). [2025-09-24T17:22:04.717546] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-24T17:22:04.718260] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:22:04.718353] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:22:04.718397] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:22:04.718461] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-24T17:22:04.718527] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-24T17:22:04.718564] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-09-24T17:22:04.718920] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-09-24T17:22:04.719026] [INFO ] [MAIN ] Update Progress: 171/2373 symbols completed. ATMU took 23.6s. Estimated remaining: 4h 43m 31s. Rate: 7.8 symbols/min [2025-09-24T17:22:04.819701] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-24T17:22:04.893021] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:04.915994] [DEBUG] [LOCAL ] ATS: Loaded 18001 existing records from primary storage. [2025-09-24T17:22:04.916131] [INFO ] [MAIN ] ATS: Loaded 18001 existing records. [2025-09-24T17:22:05.104224] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:22:05.104563] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-24T17:22:05.104637] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-24T17:22:05.105290] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-24T17:22:05.105352] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-24T17:22:05.503099] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:05.530953] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T17:22:05.616080] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-24T17:22:06.254894] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T17:22:06.416103] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-24T17:22:07.136948] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T17:22:07.216131] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-24T17:22:08.016132] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-24T17:22:08.098023] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T17:22:08.144276] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-24T17:22:08.816107] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-24T17:22:09.467270] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T17:22:09.616116] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-24T17:22:09.749815] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T17:22:10.416118] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-24T17:22:11.159634] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T17:22:11.167233] [INFO ] [REMOTE ] ATKR: Full fetch complete (53646 records). [2025-09-24T17:22:11.167349] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-24T17:22:11.224513] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-24T17:22:11.554412] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T17:22:11.591128] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-24T17:22:11.591214] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-24T17:22:11.591831] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-24T17:22:11.591895] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-24T17:22:11.593104] [DEBUG] [LOCAL ] ATKR: Trimmed 53646 records to 35658 (keeping 200 days of data) [2025-09-24T17:22:11.814491] [DEBUG] [LOCAL ] ATKR: Primary data saved (35658 records). [2025-09-24T17:22:11.814665] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-24T17:22:11.814774] [INFO ] [MAIN ] Update Progress: 172/2373 symbols completed. ATKR took 33.0s. Estimated remaining: 4h 43m 15s. Rate: 7.8 symbols/min [2025-09-24T17:22:11.984716] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:11.984943] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-24T17:22:11.984999] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-24T17:22:11.985139] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-24T17:22:11.985182] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-24T17:22:11.985228] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-24T17:22:11.985263] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-24T17:22:12.021386] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-24T17:22:12.350128] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:12.546030] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T17:22:12.816118] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-24T17:22:13.616059] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-24T17:22:13.759618] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T17:22:13.856273] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T17:22:14.416083] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-24T17:22:15.216056] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-24T17:22:15.455790] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:22:15.890548] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:22:15.984749] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T17:22:16.016030] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-24T17:22:16.816064] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-24T17:22:17.008767] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T17:22:17.616085] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-24T17:22:18.371960] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T17:22:18.416102] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-24T17:22:18.759563] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T17:22:19.216087] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-24T17:22:19.713571] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T17:22:20.016103] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-24T17:22:20.765790] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T17:22:20.816081] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-24T17:22:21.050839] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T17:22:21.616101] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-24T17:22:22.350271] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T17:22:22.416069] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-24T17:22:23.216059] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-24T17:22:23.289246] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:22:23.926140] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:22:24.016073] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-24T17:22:24.231348] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T17:22:24.239034] [INFO ] [REMOTE ] ATS: Full fetch complete (25734 records). [2025-09-24T17:22:24.239155] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-24T17:22:24.634046] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-24T17:22:24.634126] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-24T17:22:24.634501] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-24T17:22:24.634569] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-24T17:22:24.635220] [DEBUG] [LOCAL ] ATS: Trimmed 25734 records to 17957 (keeping 200 days of data) [2025-09-24T17:22:24.744968] [DEBUG] [LOCAL ] ATS: Primary data saved (17957 records). [2025-09-24T17:22:24.745122] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-24T17:22:24.745213] [INFO ] [MAIN ] Update Progress: 173/2373 symbols completed. ATS took 20.0s. Estimated remaining: 4h 44m 14s. Rate: 7.7 symbols/min [2025-09-24T17:22:24.821147] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-24T17:22:24.916693] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:24.973613] [DEBUG] [LOCAL ] AU: Loaded 52932 existing records from primary storage. [2025-09-24T17:22:24.973814] [INFO ] [MAIN ] AU: Loaded 52932 existing records. [2025-09-24T17:22:25.150791] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:22:25.151056] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-24T17:22:25.151104] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-24T17:22:25.153670] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-24T17:22:25.153746] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-24T17:22:25.529448] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:25.616065] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-24T17:22:26.196119] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T17:22:26.416055] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-24T17:22:27.216107] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-24T17:22:27.282615] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-09-24T17:22:27.531696] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T17:22:27.538997] [INFO ] [REMOTE ] ATO: Full fetch complete (60383 records). [2025-09-24T17:22:27.539153] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-24T17:22:27.936089] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-24T17:22:27.936197] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-24T17:22:27.936908] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-24T17:22:27.936999] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-24T17:22:27.938533] [DEBUG] [LOCAL ] ATO: Trimmed 60383 records to 41900 (keeping 200 days of data) [2025-09-24T17:22:28.037537] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-24T17:22:28.230738] [DEBUG] [LOCAL ] ATO: Primary data saved (41900 records). [2025-09-24T17:22:28.230983] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-24T17:22:28.235861] [INFO ] [MAIN ] Update Progress: 174/2373 symbols completed. ATO took 45.8s. Estimated remaining: 4h 43m 12s. Rate: 7.8 symbols/min [2025-09-24T17:22:28.415686] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:28.447769] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T17:22:28.505140] [DEBUG] [LOCAL ] AUB: Loaded 46455 existing records from primary storage. [2025-09-24T17:22:28.505331] [INFO ] [MAIN ] AUB: Loaded 46455 existing records. [2025-09-24T17:22:28.687389] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:22:28.687857] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-24T17:22:28.687966] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-24T17:22:28.704837] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-24T17:22:28.707069] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-24T17:22:28.773388] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:22:28.817626] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-24T17:22:29.092265] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:29.597323] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:22:29.616047] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-24T17:22:30.416113] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-24T17:22:30.840917] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-24T17:22:31.222677] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-24T17:22:31.229404] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T17:22:31.686238] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:22:32.016090] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-24T17:22:32.816096] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-24T17:22:33.012449] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T17:22:33.087289] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T17:22:33.616136] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-24T17:22:34.336672] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T17:22:34.416074] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-24T17:22:34.976742] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:22:35.216124] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-24T17:22:36.016048] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-24T17:22:36.502043] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T17:22:36.816045] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-24T17:22:37.535701] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T17:22:37.616055] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-24T17:22:38.200189] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-24T17:22:38.368339] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:22:38.374298] [INFO ] [REMOTE ] ATR: Full fetch complete (43383 records). [2025-09-24T17:22:38.374423] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-24T17:22:38.421187] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-24T17:22:38.782434] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-24T17:22:38.782556] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-24T17:22:38.783448] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-24T17:22:38.783544] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-24T17:22:38.808968] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T17:22:38.809091] [DEBUG] [LOCAL ] ATR: Trimmed 43383 records to 30413 (keeping 200 days of data) [2025-09-24T17:22:39.029235] [DEBUG] [LOCAL ] ATR: Primary data saved (30413 records). [2025-09-24T17:22:39.029390] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-24T17:22:39.029496] [INFO ] [MAIN ] Update Progress: 175/2373 symbols completed. ATR took 35.1s. Estimated remaining: 4h 43m 43s. Rate: 7.7 symbols/min [2025-09-24T17:22:39.200719] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:22:39.207904] [DEBUG] [LOCAL ] AUNA: Loaded 4746 existing records from primary storage. [2025-09-24T17:22:39.208009] [INFO ] [MAIN ] AUNA: Loaded 4746 existing records. [2025-09-24T17:22:39.221183] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-24T17:22:39.415712] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:22:39.416097] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-24T17:22:39.416154] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-24T17:22:39.416406] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-24T17:22:39.416475] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-24T17:22:39.776789] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:22:40.016090] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-24T17:22:40.719757] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T17:22:40.816060] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-24T17:22:41.030960] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:22:41.522595] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T17:22:41.627731] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-24T17:22:41.634524] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (3.21 seconds). [2025-09-24T17:22:42.416081] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-24T17:22:43.216054] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-24T17:22:43.361667] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T17:22:44.016119] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-24T17:22:44.558948] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-24T17:22:44.595164] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T17:22:44.761955] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T17:22:44.816077] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-24T17:22:45.616123] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-24T17:22:46.253495] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T17:22:46.416083] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-24T17:22:46.451057] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T17:22:46.970485] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T17:22:47.216093] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-24T17:22:48.016106] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-24T17:22:48.665816] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T17:22:48.664583] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T17:22:48.816057] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-24T17:22:49.616122] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-24T17:22:49.639319] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T17:22:50.416146] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-24T17:22:51.216084] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-24T17:22:51.568983] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T17:22:51.947449] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:22:52.016141] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-24T17:22:52.816092] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-24T17:22:53.616112] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-24T17:23:05.083834] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (13.87 seconds). [2025-09-24T17:23:05.085568] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-24T17:23:05.574455] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T17:23:05.576347] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-24T17:23:05.864203] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (13.05 seconds). [2025-09-24T17:23:05.873246] [INFO ] [REMOTE ] ATUS: Full fetch complete (70608 records). [2025-09-24T17:23:05.873411] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-24T17:23:05.878186] [FATAL] [VALIDATOR ] ATUS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:23:05.878282] [FATAL] [MAIN ] ATUS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:23:05.878340] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:23:05.878428] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-24T17:23:05.878518] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-24T17:23:05.878577] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-09-24T17:23:05.878671] [DEBUG] [LOCAL ] ATUS: No derivative data file found to delete. [2025-09-24T17:23:05.878801] [INFO ] [MAIN ] Update Progress: 176/2373 symbols completed. ATUS took 54.1s. Estimated remaining: 4h 47m 34s. Rate: 7.6 symbols/min [2025-09-24T17:23:06.054993] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:06.082014] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (12.47 seconds). [2025-09-24T17:23:06.092013] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-24T17:23:06.134192] [DEBUG] [LOCAL ] AVA: Loaded 39654 existing records from primary storage. [2025-09-24T17:23:06.134365] [INFO ] [MAIN ] AVA: Loaded 39654 existing records. [2025-09-24T17:23:06.316895] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:06.317302] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-24T17:23:06.317376] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-24T17:23:06.319625] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-24T17:23:06.319731] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-24T17:23:06.679441] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (14.66 seconds). [2025-09-24T17:23:06.718894] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-24T17:23:06.785799] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:06.786424] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-24T17:23:06.793567] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T17:23:06.795855] [INFO ] [REMOTE ] AUNA: Full fetch complete (7441 records). [2025-09-24T17:23:06.796018] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-24T17:23:06.796492] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:23:06.796638] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:23:06.796718] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:23:06.796761] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-24T17:23:06.796855] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-24T17:23:06.796941] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-09-24T17:23:06.797665] [DEBUG] [LOCAL ] AUNA: Deleted derivative data file. [2025-09-24T17:23:06.797790] [INFO ] [MAIN ] Update Progress: 177/2373 symbols completed. AUNA took 27.8s. Estimated remaining: 4h 46m 0s. Rate: 7.7 symbols/min [2025-09-24T17:23:06.979562] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:06.992205] [DEBUG] [LOCAL ] AVAL: Loaded 8950 existing records from primary storage. [2025-09-24T17:23:06.992344] [INFO ] [MAIN ] AVAL: Loaded 8950 existing records. [2025-09-24T17:23:07.180058] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:07.181330] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-24T17:23:07.181602] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-24T17:23:07.182292] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-24T17:23:07.182357] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-24T17:23:07.605623] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:07.608829] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-24T17:23:07.612426] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T17:23:07.621000] [INFO ] [REMOTE ] AUB: Full fetch complete (65373 records). [2025-09-24T17:23:07.621123] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-24T17:23:08.038609] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-24T17:23:08.038752] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-24T17:23:08.039520] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-24T17:23:08.039585] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-24T17:23:08.041221] [DEBUG] [LOCAL ] AUB: Trimmed 65373 records to 46415 (keeping 200 days of data) [2025-09-24T17:23:08.267036] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T17:23:08.270470] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-24T17:23:08.317706] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T17:23:08.328780] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-24T17:23:08.378401] [DEBUG] [LOCAL ] AUB: Primary data saved (46415 records). [2025-09-24T17:23:08.378558] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-24T17:23:08.379546] [INFO ] [MAIN ] Update Progress: 178/2373 symbols completed. AUB took 40.1s. Estimated remaining: 4h 44m 35s. Rate: 7.7 symbols/min [2025-09-24T17:23:08.562947] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:08.618444] [DEBUG] [LOCAL ] AVB: Loaded 41728 existing records from primary storage. [2025-09-24T17:23:08.618625] [INFO ] [MAIN ] AVB: Loaded 41728 existing records. [2025-09-24T17:23:08.826832] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:08.827253] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-24T17:23:08.827327] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-24T17:23:08.847087] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-24T17:23:08.857423] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-24T17:23:08.986971] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T17:23:09.081742] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-24T17:23:09.262830] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T17:23:09.285364] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:09.286208] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-24T17:23:09.286448] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-24T17:23:09.574257] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T17:23:09.582636] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-24T17:23:10.242561] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T17:23:10.246025] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-24T17:23:10.608494] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T17:23:10.615976] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-24T17:23:10.762564] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T17:23:10.769595] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-24T17:23:11.021092] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T17:23:11.031992] [INFO ] [REMOTE ] AU: Full fetch complete (76264 records). [2025-09-24T17:23:11.032166] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-24T17:23:11.323058] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T17:23:11.370474] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-24T17:23:11.482598] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-24T17:23:11.482733] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-24T17:23:11.483565] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-24T17:23:11.483690] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-24T17:23:11.485335] [DEBUG] [LOCAL ] AU: Trimmed 76264 records to 52936 (keeping 200 days of data) [2025-09-24T17:23:11.826070] [DEBUG] [LOCAL ] AU: Primary data saved (52936 records). [2025-09-24T17:23:11.826216] [INFO ] [MAIN ] AU: Full history saved. [2025-09-24T17:23:11.826305] [INFO ] [MAIN ] Update Progress: 179/2373 symbols completed. AU took 47.1s. Estimated remaining: 4h 43m 34s. Rate: 7.7 symbols/min [2025-09-24T17:23:12.075125] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:12.076397] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-24T17:23:12.076622] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-24T17:23:12.077559] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-24T17:23:12.077704] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-24T17:23:12.077771] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-24T17:23:12.096769] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-24T17:23:12.131679] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T17:23:12.213552] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-24T17:23:12.337402] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T17:23:12.353847] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T17:23:12.411383] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-24T17:23:12.434790] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-24T17:23:12.544603] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:12.544925] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-24T17:23:12.750496] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:12.750886] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-24T17:23:12.751331] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-24T17:23:12.946815] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:12.947133] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-24T17:23:12.947585] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-24T17:23:13.200333] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:13.201335] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T17:23:13.201690] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-24T17:23:13.204375] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-24T17:23:13.204889] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-24T17:23:13.569551] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:23:13.616062] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-24T17:23:13.622222] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:13.622709] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-24T17:23:13.656271] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T17:23:13.823511] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T17:23:14.416101] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-24T17:23:15.146696] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T17:23:15.216085] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-24T17:23:15.951165] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:23:16.016089] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-24T17:23:16.716901] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T17:23:16.816152] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-24T17:23:17.006703] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:17.007059] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-24T17:23:17.456151] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T17:23:17.616094] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-24T17:23:18.389607] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T17:23:18.416033] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-24T17:23:19.128665] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T17:23:19.216078] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-24T17:23:19.735931] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T17:23:19.737706] [INFO ] [REMOTE ] AVAL: Full fetch complete (14627 records). [2025-09-24T17:23:19.737784] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-24T17:23:20.019531] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-24T17:23:20.102092] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-24T17:23:20.102166] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-24T17:23:20.102443] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-24T17:23:20.102481] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-24T17:23:20.102985] [DEBUG] [LOCAL ] AVAL: Trimmed 14627 records to 8932 (keeping 200 days of data) [2025-09-24T17:23:20.157722] [DEBUG] [LOCAL ] AVAL: Primary data saved (8932 records). [2025-09-24T17:23:20.157913] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-24T17:23:20.158007] [INFO ] [MAIN ] Update Progress: 180/2373 symbols completed. AVAL took 13.4s. Estimated remaining: 4h 43m 34s. Rate: 7.7 symbols/min [2025-09-24T17:23:20.247604] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:20.265488] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-24T17:23:20.337505] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:20.360289] [DEBUG] [LOCAL ] AVD: Loaded 22934 existing records from primary storage. [2025-09-24T17:23:20.360412] [INFO ] [MAIN ] AVD: Loaded 22934 existing records. [2025-09-24T17:23:20.546269] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:20.546530] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-24T17:23:20.546620] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-24T17:23:20.547767] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-24T17:23:20.547829] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-24T17:23:20.821172] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-24T17:23:20.913753] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:21.616094] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-24T17:23:21.812313] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:21.812621] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-24T17:23:22.361947] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:23:22.416123] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-24T17:23:23.216077] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-24T17:23:23.409801] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:23:23.410149] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-24T17:23:23.638936] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:23:24.016079] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-24T17:23:24.816060] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-24T17:23:25.284729] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:23:25.616143] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-24T17:23:26.054105] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T17:23:26.416111] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-24T17:23:27.221176] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-24T17:23:27.239803] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T17:23:27.902759] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T17:23:28.016058] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-24T17:23:28.078312] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T17:23:28.081075] [INFO ] [REMOTE ] AVBC: Full fetch complete (4592 records). [2025-09-24T17:23:28.081152] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-24T17:23:28.273578] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-24T17:23:28.273854] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:23:28.273930] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:23:28.274005] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-24T17:23:28.274073] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-24T17:23:28.274112] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-24T17:23:28.274171] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-24T17:23:28.274255] [INFO ] [MAIN ] Update Progress: 181/2373 symbols completed. AVBC took 16.4s. Estimated remaining: 4h 43m 30s. Rate: 7.7 symbols/min [2025-09-24T17:23:28.451166] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:28.472754] [DEBUG] [LOCAL ] AVK: Loaded 17983 existing records from primary storage. [2025-09-24T17:23:28.472887] [INFO ] [MAIN ] AVK: Loaded 17983 existing records. [2025-09-24T17:23:28.668821] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:28.669123] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-24T17:23:28.669179] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-24T17:23:28.670545] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-24T17:23:28.670609] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-24T17:23:28.821164] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-24T17:23:29.072875] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:29.351532] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T17:23:29.512925] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T17:23:29.616121] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-24T17:23:30.416061] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-24T17:23:30.773501] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T17:23:31.216088] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-24T17:23:31.615369] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T17:23:32.016078] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-24T17:23:32.193468] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:23:32.816079] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-24T17:23:33.560025] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T17:23:33.566909] [INFO ] [REMOTE ] AVA: Full fetch complete (55574 records). [2025-09-24T17:23:33.567018] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-24T17:23:33.628080] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-24T17:23:33.745300] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T17:23:34.022555] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-24T17:23:34.022675] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-24T17:23:34.023333] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-24T17:23:34.023388] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-24T17:23:34.024620] [DEBUG] [LOCAL ] AVA: Trimmed 55574 records to 39617 (keeping 200 days of data) [2025-09-24T17:23:34.279301] [DEBUG] [LOCAL ] AVA: Primary data saved (39617 records). [2025-09-24T17:23:34.279471] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-24T17:23:34.279593] [INFO ] [MAIN ] Update Progress: 182/2373 symbols completed. AVA took 28.4s. Estimated remaining: 4h 43m 1s. Rate: 7.7 symbols/min [2025-09-24T17:23:34.427626] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-24T17:23:34.462784] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:34.497461] [DEBUG] [LOCAL ] AVNS: Loaded 33579 existing records from primary storage. [2025-09-24T17:23:34.497603] [INFO ] [MAIN ] AVNS: Loaded 33579 existing records. [2025-09-24T17:23:34.686814] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:34.687065] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-24T17:23:34.687116] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-24T17:23:34.688770] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-24T17:23:34.688834] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-24T17:23:35.081243] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T17:23:35.086149] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:35.216088] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-24T17:23:36.016098] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-24T17:23:36.183062] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T17:23:36.204531] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T17:23:36.816145] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-24T17:23:37.128760] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T17:23:37.527989] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T17:23:37.616079] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-24T17:23:38.416080] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-24T17:23:38.530758] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T17:23:39.216050] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-24T17:23:39.584086] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T17:23:39.936945] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T17:23:40.016079] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-24T17:23:40.816079] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-24T17:23:41.616057] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-24T17:23:41.854938] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T17:23:41.862837] [INFO ] [REMOTE ] AVB: Full fetch complete (58149 records). [2025-09-24T17:23:41.862970] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-24T17:23:42.261215] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-24T17:23:42.261438] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-24T17:23:42.262120] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-24T17:23:42.280112] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-24T17:23:42.281863] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T17:23:42.289956] [DEBUG] [LOCAL ] AVB: Trimmed 58149 records to 41784 (keeping 200 days of data) [2025-09-24T17:23:42.416114] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-24T17:23:42.549455] [DEBUG] [LOCAL ] AVB: Primary data saved (41784 records). [2025-09-24T17:23:42.549580] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-24T17:23:42.550288] [INFO ] [MAIN ] Update Progress: 183/2373 symbols completed. AVB took 34.2s. Estimated remaining: 4h 42m 60s. Rate: 7.7 symbols/min [2025-09-24T17:23:42.708628] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T17:23:42.745765] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:42.746151] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-09-24T17:23:42.746196] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-09-24T17:23:42.746339] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-24T17:23:42.746382] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-24T17:23:42.746426] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-24T17:23:42.746459] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-24T17:23:43.133417] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:43.216059] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-24T17:23:43.685975] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T17:23:44.016122] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-24T17:23:44.130539] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T17:23:44.816079] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-24T17:23:45.554219] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T17:23:45.616080] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-24T17:23:45.850093] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T17:23:46.416096] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-24T17:23:46.597818] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T17:23:47.216064] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-24T17:23:47.357978] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T17:23:48.016066] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-24T17:23:48.323241] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T17:23:48.327246] [INFO ] [REMOTE ] AVK: Full fetch complete (26594 records). [2025-09-24T17:23:48.327366] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-24T17:23:48.717407] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-24T17:23:48.717521] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-24T17:23:48.717972] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-24T17:23:48.718041] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-24T17:23:48.718804] [DEBUG] [LOCAL ] AVK: Trimmed 26594 records to 17864 (keeping 200 days of data) [2025-09-24T17:23:48.816292] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-24T17:23:48.827855] [DEBUG] [LOCAL ] AVK: Primary data saved (17864 records). [2025-09-24T17:23:48.828004] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-24T17:23:48.828092] [INFO ] [MAIN ] Update Progress: 184/2373 symbols completed. AVK took 20.6s. Estimated remaining: 4h 42m 35s. Rate: 7.7 symbols/min [2025-09-24T17:23:49.001112] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:49.056230] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-24T17:23:49.056446] [INFO ] [MAIN ] AVTR: Loaded 53567 existing records. [2025-09-24T17:23:49.250711] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T17:23:49.261419] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:49.262291] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-24T17:23:49.262843] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-24T17:23:49.266583] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-24T17:23:49.266672] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-24T17:23:49.622394] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:49.622519] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-24T17:23:50.048911] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T17:23:50.416082] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-24T17:23:50.817204] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T17:23:51.216134] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-24T17:23:51.511495] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T17:23:52.016186] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-24T17:23:52.370894] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T17:23:52.375340] [INFO ] [REMOTE ] AVD: Full fetch complete (33866 records). [2025-09-24T17:23:52.375516] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-24T17:23:52.803859] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-24T17:23:52.803947] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-24T17:23:52.804456] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-24T17:23:52.804500] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-24T17:23:52.805353] [DEBUG] [LOCAL ] AVD: Trimmed 33866 records to 22808 (keeping 200 days of data) [2025-09-24T17:23:52.851699] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-24T17:23:52.944350] [DEBUG] [LOCAL ] AVD: Primary data saved (22808 records). [2025-09-24T17:23:52.944498] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-24T17:23:52.944595] [INFO ] [MAIN ] Update Progress: 185/2373 symbols completed. AVD took 32.8s. Estimated remaining: 4h 41m 44s. Rate: 7.8 symbols/min [2025-09-24T17:23:53.137092] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:23:53.185929] [DEBUG] [LOCAL ] AVY: Loaded 37657 existing records from primary storage. [2025-09-24T17:23:53.186084] [INFO ] [MAIN ] AVY: Loaded 37657 existing records. [2025-09-24T17:23:53.392950] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:23:53.393412] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-24T17:23:53.393537] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-24T17:23:53.400827] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-24T17:23:53.414070] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-24T17:23:53.470329] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T17:23:53.621461] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-24T17:23:53.825424] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:23:54.294908] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T17:23:54.416091] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-24T17:23:55.210854] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T17:23:55.217829] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-24T17:23:55.878960] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T17:23:56.016136] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-24T17:23:56.445136] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:23:56.816207] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-24T17:23:57.616117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-24T17:23:57.780676] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T17:23:57.985696] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T17:23:58.416230] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-24T17:23:59.212834] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T17:23:59.221366] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-24T17:23:59.905715] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T17:24:00.016154] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-24T17:24:00.816070] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-24T17:24:01.070895] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T17:24:01.233566] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T17:24:01.616093] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-24T17:24:02.319336] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T17:24:02.416070] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-24T17:24:03.216143] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-24T17:24:03.662516] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T17:24:04.016087] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-24T17:24:04.816114] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-24T17:24:05.090322] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-24T17:24:05.378477] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:24:05.448435] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-24T17:24:05.616069] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-24T17:24:06.416050] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-24T17:24:06.764868] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-24T17:24:06.977828] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:24:07.216113] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-24T17:24:07.790669] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T17:24:07.796910] [INFO ] [REMOTE ] AVNS: Full fetch complete (47908 records). [2025-09-24T17:24:07.797012] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-24T17:24:08.021189] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-24T17:24:08.192458] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-24T17:24:08.192545] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-24T17:24:08.193143] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-24T17:24:08.193210] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-24T17:24:08.194366] [DEBUG] [LOCAL ] AVNS: Trimmed 47908 records to 33619 (keeping 200 days of data) [2025-09-24T17:24:08.388087] [DEBUG] [LOCAL ] AVNS: Primary data saved (33619 records). [2025-09-24T17:24:08.388253] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-24T17:24:08.388355] [INFO ] [MAIN ] Update Progress: 186/2373 symbols completed. AVNS took 34.1s. Estimated remaining: 4h 43m 7s. Rate: 7.7 symbols/min [2025-09-24T17:24:08.560590] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:08.584708] [DEBUG] [LOCAL ] AWF: Loaded 24324 existing records from primary storage. [2025-09-24T17:24:08.584834] [INFO ] [MAIN ] AWF: Loaded 24324 existing records. [2025-09-24T17:24:08.771673] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:08.772125] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-24T17:24:08.772336] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-24T17:24:08.773380] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-24T17:24:08.773443] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-24T17:24:08.817968] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-24T17:24:08.990968] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T17:24:09.196045] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:09.254068] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:24:09.616092] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-24T17:24:10.288209] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T17:24:10.416056] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-24T17:24:11.118406] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:24:11.216072] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-24T17:24:11.999814] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T17:24:12.016041] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-24T17:24:12.490481] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T17:24:12.816104] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-24T17:24:13.626781] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-24T17:24:13.633153] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T17:24:13.746723] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-24T17:24:14.416118] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-24T17:24:15.153966] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T17:24:15.216065] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-24T17:24:16.016133] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-24T17:24:16.202049] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:24:16.708385] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T17:24:16.816048] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-24T17:24:17.484306] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:24:17.616095] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-24T17:24:18.416091] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-24T17:24:19.038258] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T17:24:19.203406] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T17:24:19.209631] [INFO ] [REMOTE ] AVNT: Full fetch complete (55835 records). [2025-09-24T17:24:19.209796] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-24T17:24:19.210548] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:24:19.210659] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:24:19.210720] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:24:19.210793] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-24T17:24:19.210878] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-24T17:24:19.210936] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-24T17:24:19.210993] [DEBUG] [LOCAL ] AVNT: No derivative data file found to delete. [2025-09-24T17:24:19.211076] [INFO ] [MAIN ] Update Progress: 187/2373 symbols completed. AVNT took 36.7s. Estimated remaining: 4h 43m 35s. Rate: 7.7 symbols/min [2025-09-24T17:24:19.223018] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-24T17:24:19.392976] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:19.424096] [DEBUG] [LOCAL ] AWI: Loaded 26007 existing records from primary storage. [2025-09-24T17:24:19.424236] [INFO ] [MAIN ] AWI: Loaded 26007 existing records. [2025-09-24T17:24:19.621392] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:19.621697] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-24T17:24:19.621758] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-24T17:24:19.622479] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-24T17:24:19.622563] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-24T17:24:19.999358] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:20.017139] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-24T17:24:20.022095] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:24:20.592127] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:24:20.816140] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-24T17:24:20.912383] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T17:24:21.616075] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-24T17:24:22.033811] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T17:24:22.416083] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-24T17:24:22.681569] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T17:24:23.216107] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-24T17:24:23.654766] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T17:24:24.016086] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-24T17:24:24.816065] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-24T17:24:24.845743] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T17:24:24.855130] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-09-24T17:24:24.855288] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-24T17:24:25.141044] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T17:24:25.273195] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-24T17:24:25.273292] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-24T17:24:25.274106] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-24T17:24:25.274185] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-24T17:24:25.275930] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 53567 (keeping 200 days of data) [2025-09-24T17:24:25.597523] [DEBUG] [LOCAL ] AVTR: Primary data saved (53567 records). [2025-09-24T17:24:25.597695] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-24T17:24:25.597794] [INFO ] [MAIN ] Update Progress: 188/2373 symbols completed. AVTR took 36.8s. Estimated remaining: 4h 43m 11s. Rate: 7.7 symbols/min [2025-09-24T17:24:25.621169] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-24T17:24:25.774696] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:25.826177] [DEBUG] [LOCAL ] AWK: Loaded 48832 existing records from primary storage. [2025-09-24T17:24:25.826315] [INFO ] [MAIN ] AWK: Loaded 48832 existing records. [2025-09-24T17:24:26.013342] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:26.013845] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-24T17:24:26.013913] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-24T17:24:26.020403] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-24T17:24:26.027191] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-24T17:24:26.027718] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-24T17:24:26.391028] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:26.416066] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-24T17:24:26.989601] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T17:24:26.996422] [INFO ] [REMOTE ] AVY: Full fetch complete (56162 records). [2025-09-24T17:24:26.996537] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-24T17:24:27.222537] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-24T17:24:27.388707] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-24T17:24:27.388802] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-24T17:24:27.389444] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-24T17:24:27.389489] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-24T17:24:27.390730] [DEBUG] [LOCAL ] AVY: Trimmed 56162 records to 37582 (keeping 200 days of data) [2025-09-24T17:24:27.629017] [DEBUG] [LOCAL ] AVY: Primary data saved (37582 records). [2025-09-24T17:24:27.629173] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-24T17:24:27.629258] [INFO ] [MAIN ] Update Progress: 189/2373 symbols completed. AVY took 34.7s. Estimated remaining: 4h 41m 57s. Rate: 7.7 symbols/min [2025-09-24T17:24:27.806393] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:27.828988] [DEBUG] [LOCAL ] AWP: Loaded 21785 existing records from primary storage. [2025-09-24T17:24:27.829120] [INFO ] [MAIN ] AWP: Loaded 21785 existing records. [2025-09-24T17:24:28.013604] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:28.014054] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-24T17:24:28.014126] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-24T17:24:28.015031] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-24T17:24:28.015093] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-24T17:24:28.047997] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-24T17:24:28.390562] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:28.416035] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T17:24:28.441505] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T17:24:28.816083] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-24T17:24:29.260520] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T17:24:29.616095] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-24T17:24:30.416050] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-24T17:24:30.657014] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T17:24:31.216112] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-24T17:24:31.589887] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:24:31.974092] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:24:32.016062] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-24T17:24:32.068784] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:24:32.073744] [INFO ] [REMOTE ] AWF: Full fetch complete (36016 records). [2025-09-24T17:24:32.073840] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-24T17:24:32.462441] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-24T17:24:32.462540] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-24T17:24:32.463026] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-24T17:24:32.463092] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-24T17:24:32.464080] [DEBUG] [LOCAL ] AWF: Trimmed 36016 records to 24291 (keeping 200 days of data) [2025-09-24T17:24:32.612965] [DEBUG] [LOCAL ] AWF: Primary data saved (24291 records). [2025-09-24T17:24:32.613144] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-24T17:24:32.613278] [INFO ] [MAIN ] Update Progress: 190/2373 symbols completed. AWF took 24.2s. Estimated remaining: 4h 41m 17s. Rate: 7.8 symbols/min [2025-09-24T17:24:32.790624] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:32.815396] [DEBUG] [LOCAL ] AWR: Loaded 22614 existing records from primary storage. [2025-09-24T17:24:32.815546] [INFO ] [MAIN ] AWR: Loaded 22614 existing records. [2025-09-24T17:24:32.827194] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-24T17:24:33.002721] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:33.003098] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-24T17:24:33.003161] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-24T17:24:33.003908] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-24T17:24:33.003988] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-24T17:24:33.363986] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:33.616498] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-24T17:24:33.616427] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T17:24:34.013638] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T17:24:34.416087] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-24T17:24:34.758564] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T17:24:35.216103] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-24T17:24:35.361874] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T17:24:36.016080] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-24T17:24:36.816095] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-24T17:24:37.074378] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T17:24:37.104991] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T17:24:37.458086] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T17:24:37.616099] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-24T17:24:38.416104] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-24T17:24:38.714146] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T17:24:39.160117] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T17:24:39.216062] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-24T17:24:40.016089] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-24T17:24:40.321315] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T17:24:40.816142] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-24T17:24:40.841182] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T17:24:41.616082] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-24T17:24:41.961574] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T17:24:42.416102] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-24T17:24:42.758288] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T17:24:43.216142] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-24T17:24:43.263366] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T17:24:44.016163] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-24T17:24:44.816082] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-24T17:24:45.062247] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:24:45.117981] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T17:24:45.594492] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T17:24:45.616043] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-24T17:24:46.416161] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-24T17:24:46.561566] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:24:47.216147] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-24T17:24:47.479224] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T17:24:47.483791] [INFO ] [REMOTE ] AWI: Full fetch complete (35475 records). [2025-09-24T17:24:47.483902] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-24T17:24:47.852814] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-24T17:24:47.852892] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-24T17:24:47.853329] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-24T17:24:47.853370] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-24T17:24:47.854297] [DEBUG] [LOCAL ] AWI: Trimmed 35475 records to 25923 (keeping 200 days of data) [2025-09-24T17:24:48.017217] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-24T17:24:48.025936] [DEBUG] [LOCAL ] AWI: Primary data saved (25923 records). [2025-09-24T17:24:48.026025] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-24T17:24:48.026144] [INFO ] [MAIN ] Update Progress: 191/2373 symbols completed. AWI took 28.8s. Estimated remaining: 4h 42m 37s. Rate: 7.7 symbols/min [2025-09-24T17:24:48.200624] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:48.229211] [DEBUG] [LOCAL ] AX: Loaded 28637 existing records from primary storage. [2025-09-24T17:24:48.229342] [INFO ] [MAIN ] AX: Loaded 28637 existing records. [2025-09-24T17:24:48.407835] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:48.408104] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-24T17:24:48.408154] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-24T17:24:48.408892] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-24T17:24:48.408958] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-24T17:24:48.777323] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:48.816098] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-24T17:24:49.212849] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-24T17:24:49.372211] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T17:24:49.616152] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-24T17:24:50.104183] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T17:24:50.416106] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-24T17:24:50.801874] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T17:24:51.216099] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-24T17:24:51.801436] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T17:24:52.016050] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-24T17:24:52.383198] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T17:24:52.816100] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-24T17:24:53.266482] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:24:53.616079] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-24T17:24:53.919720] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T17:24:54.416078] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-24T17:24:55.216113] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-24T17:24:55.249884] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T17:24:55.470516] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T17:24:56.016107] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-24T17:24:56.496181] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T17:24:56.816093] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-24T17:24:57.500483] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T17:24:57.616054] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-24T17:24:57.738297] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T17:24:57.742265] [INFO ] [REMOTE ] AWP: Full fetch complete (32514 records). [2025-09-24T17:24:57.742393] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-24T17:24:58.115849] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-24T17:24:58.115998] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-24T17:24:58.116460] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-24T17:24:58.116524] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-24T17:24:58.117436] [DEBUG] [LOCAL ] AWP: Trimmed 32514 records to 21617 (keeping 200 days of data) [2025-09-24T17:24:58.245342] [DEBUG] [LOCAL ] AWP: Primary data saved (21617 records). [2025-09-24T17:24:58.245492] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-24T17:24:58.245615] [INFO ] [MAIN ] Update Progress: 192/2373 symbols completed. AWP took 30.6s. Estimated remaining: 4h 42m 57s. Rate: 7.7 symbols/min [2025-09-24T17:24:58.421634] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-24T17:24:58.424447] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:24:58.481836] [DEBUG] [LOCAL ] AXL: Loaded 50505 existing records from primary storage. [2025-09-24T17:24:58.482018] [INFO ] [MAIN ] AXL: Loaded 50505 existing records. [2025-09-24T17:24:58.667266] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:24:58.667914] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-24T17:24:58.667998] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-24T17:24:58.669061] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-24T17:24:58.669128] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-24T17:24:59.034599] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T17:24:59.063992] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:24:59.216080] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-24T17:24:59.768341] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T17:24:59.773446] [INFO ] [REMOTE ] AWR: Full fetch complete (31770 records). [2025-09-24T17:24:59.773530] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-24T17:25:00.022572] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-24T17:25:00.201973] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-24T17:25:00.202064] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-24T17:25:00.202550] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-24T17:25:00.202625] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-24T17:25:00.206080] [DEBUG] [LOCAL ] AWR: Trimmed 31770 records to 22612 (keeping 200 days of data) [2025-09-24T17:25:00.354889] [DEBUG] [LOCAL ] AWR: Primary data saved (22612 records). [2025-09-24T17:25:00.355020] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-24T17:25:00.355167] [INFO ] [MAIN ] Update Progress: 193/2373 symbols completed. AWR took 27.7s. Estimated remaining: 4h 41m 45s. Rate: 7.7 symbols/min [2025-09-24T17:25:00.523483] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:00.523700] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-09-24T17:25:00.523755] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-09-24T17:25:00.523899] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-24T17:25:00.523942] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-24T17:25:00.523984] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-24T17:25:00.524033] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-24T17:25:00.819480] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-24T17:25:00.900108] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:01.083526] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T17:25:01.616134] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-24T17:25:01.986040] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T17:25:01.999512] [INFO ] [REMOTE ] AWK: Full fetch complete (70491 records). [2025-09-24T17:25:01.999766] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-24T17:25:02.439951] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-24T17:25:02.462036] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-24T17:25:02.463432] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T17:25:02.463793] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-24T17:25:02.471321] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-24T17:25:02.472081] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-24T17:25:02.475123] [DEBUG] [LOCAL ] AWK: Trimmed 70491 records to 48797 (keeping 200 days of data) [2025-09-24T17:25:02.816628] [DEBUG] [LOCAL ] AWK: Primary data saved (48797 records). [2025-09-24T17:25:02.816808] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-24T17:25:02.816940] [INFO ] [MAIN ] Update Progress: 194/2373 symbols completed. AWK took 37.2s. Estimated remaining: 4h 40m 38s. Rate: 7.8 symbols/min [2025-09-24T17:25:03.014232] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:03.014429] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-09-24T17:25:03.014486] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-09-24T17:25:03.014730] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-24T17:25:03.014798] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-24T17:25:03.014890] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-09-24T17:25:03.014947] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-24T17:25:03.224911] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-24T17:25:03.429720] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:03.442630] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T17:25:04.016088] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-24T17:25:04.667533] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-24T17:25:04.728555] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T17:25:04.816105] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-24T17:25:04.988189] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T17:25:05.616123] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-24T17:25:06.269074] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T17:25:06.416176] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-24T17:25:07.216119] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-24T17:25:07.438389] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T17:25:07.613572] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T17:25:08.016084] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-24T17:25:08.816083] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-24T17:25:09.390098] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-24T17:25:09.410442] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-24T17:25:09.616098] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-24T17:25:09.698600] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T17:25:10.087472] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T17:25:10.416116] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-24T17:25:11.216165] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-24T17:25:11.832053] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T17:25:12.016071] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-24T17:25:12.269088] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:25:12.816139] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-24T17:25:13.616087] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-24T17:25:13.852940] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T17:25:13.882024] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T17:25:14.416122] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-24T17:25:15.216063] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-24T17:25:15.333359] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T17:25:15.564302] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T17:25:15.923966] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T17:25:16.016101] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-24T17:25:16.816120] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-24T17:25:17.317901] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T17:25:17.616085] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-24T17:25:18.259234] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T17:25:18.415824] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-24T17:25:18.426007] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-24T17:25:18.977368] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-24T17:25:19.216123] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-24T17:25:20.016085] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-24T17:25:20.816089] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-24T17:25:20.995257] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:25:21.221592] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T17:25:21.616084] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-24T17:25:21.967741] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-24T17:25:22.139258] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T17:25:22.416089] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-24T17:25:23.137585] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T17:25:23.138919] [INFO ] [REMOTE ] AXR: Full fetch complete (4986 records). [2025-09-24T17:25:23.138993] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-24T17:25:23.221138] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-24T17:25:23.529222] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-24T17:25:23.529322] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-24T17:25:23.529479] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-24T17:25:23.529519] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-24T17:25:23.530039] [DEBUG] [LOCAL ] AXR: Trimmed 4986 records to 3151 (keeping 200 days of data) [2025-09-24T17:25:23.550469] [DEBUG] [LOCAL ] AXR: Primary data saved (3151 records). [2025-09-24T17:25:23.550620] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-24T17:25:23.550752] [INFO ] [MAIN ] Update Progress: 195/2373 symbols completed. AXR took 20.7s. Estimated remaining: 4h 42m 56s. Rate: 7.7 symbols/min [2025-09-24T17:25:23.733939] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:23.779317] [DEBUG] [LOCAL ] AXS: Loaded 38262 existing records from primary storage. [2025-09-24T17:25:23.779475] [INFO ] [MAIN ] AXS: Loaded 38262 existing records. [2025-09-24T17:25:23.973629] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:25:23.973929] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-24T17:25:23.973985] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-24T17:25:23.974965] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-24T17:25:23.975029] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-24T17:25:24.025993] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-24T17:25:24.417538] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:24.816136] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-24T17:25:25.298290] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T17:25:25.504208] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T17:25:25.509863] [INFO ] [REMOTE ] AX: Full fetch complete (42708 records). [2025-09-24T17:25:25.509972] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-24T17:25:25.618953] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-24T17:25:25.935889] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-24T17:25:25.936036] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-24T17:25:25.940099] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-24T17:25:25.940196] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-24T17:25:25.941756] [DEBUG] [LOCAL ] AX: Trimmed 42708 records to 28543 (keeping 200 days of data) [2025-09-24T17:25:26.143728] [DEBUG] [LOCAL ] AX: Primary data saved (28543 records). [2025-09-24T17:25:26.143951] [INFO ] [MAIN ] AX: Full history saved. [2025-09-24T17:25:26.144069] [INFO ] [MAIN ] Update Progress: 196/2373 symbols completed. AX took 38.1s. Estimated remaining: 4h 41m 50s. Rate: 7.7 symbols/min [2025-09-24T17:25:26.331451] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:26.357816] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T17:25:26.420713] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-24T17:25:26.423038] [DEBUG] [LOCAL ] AXTA: Loaded 52056 existing records from primary storage. [2025-09-24T17:25:26.423286] [INFO ] [MAIN ] AXTA: Loaded 52056 existing records. [2025-09-24T17:25:26.603790] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:25:26.604090] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-24T17:25:26.604144] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-24T17:25:26.605367] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-24T17:25:26.605430] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-24T17:25:26.969268] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:27.216112] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-24T17:25:27.606837] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T17:25:27.905559] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T17:25:28.016062] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-24T17:25:28.816053] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-24T17:25:29.054219] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:25:29.375509] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:25:29.616089] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-24T17:25:30.416112] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-24T17:25:30.475261] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T17:25:31.098549] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:25:31.216079] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-24T17:25:32.016084] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-24T17:25:32.320694] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T17:25:32.634141] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T17:25:32.816097] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-24T17:25:33.535794] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T17:25:33.616097] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-24T17:25:33.887290] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T17:25:34.416080] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-24T17:25:35.216110] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-24T17:25:35.268482] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:25:36.021204] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-24T17:25:36.041494] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T17:25:36.051989] [INFO ] [REMOTE ] AXL: Full fetch complete (72448 records). [2025-09-24T17:25:36.052105] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-24T17:25:36.444674] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-24T17:25:36.444769] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-24T17:25:36.445497] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-24T17:25:36.445541] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-24T17:25:36.447075] [DEBUG] [LOCAL ] AXL: Trimmed 72448 records to 50488 (keeping 200 days of data) [2025-09-24T17:25:36.763670] [DEBUG] [LOCAL ] AXL: Primary data saved (50488 records). [2025-09-24T17:25:36.763865] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-24T17:25:36.763993] [INFO ] [MAIN ] Update Progress: 197/2373 symbols completed. AXL took 38.5s. Estimated remaining: 4h 42m 14s. Rate: 7.7 symbols/min [2025-09-24T17:25:36.816102] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-24T17:25:37.298378] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-24T17:25:37.616212] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-24T17:25:37.693242] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T17:25:38.155694] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T17:25:38.416082] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-24T17:25:39.216099] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-24T17:25:39.782601] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T17:25:39.793021] [INFO ] [REMOTE ] AXP: Full fetch complete (76928 records). [2025-09-24T17:25:39.793267] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-24T17:25:39.923812] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:25:40.027301] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-24T17:25:40.253426] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-24T17:25:40.253520] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-24T17:25:40.254316] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-24T17:25:40.254386] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-24T17:25:40.256054] [DEBUG] [LOCAL ] AXP: Trimmed 76928 records to 53254 (keeping 200 days of data) [2025-09-24T17:25:40.542816] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T17:25:40.637122] [DEBUG] [LOCAL ] AXP: Primary data saved (53254 records). [2025-09-24T17:25:40.637271] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-24T17:25:40.637348] [INFO ] [MAIN ] Update Progress: 198/2373 symbols completed. AXP took 40.3s. Estimated remaining: 4h 41m 23s. Rate: 7.7 symbols/min [2025-09-24T17:25:40.816097] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-24T17:25:41.887274] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T17:25:41.900014] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-24T17:25:41.961350] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T17:25:42.416107] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-24T17:25:43.482259] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T17:25:43.493378] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-24T17:25:43.968276] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:25:43.975908] [INFO ] [REMOTE ] AXS: Full fetch complete (55403 records). [2025-09-24T17:25:43.976082] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-24T17:25:44.367394] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-24T17:25:44.367488] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-24T17:25:44.368153] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-24T17:25:44.368219] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-24T17:25:44.369496] [DEBUG] [LOCAL ] AXS: Trimmed 55403 records to 38308 (keeping 200 days of data) [2025-09-24T17:25:44.615150] [DEBUG] [LOCAL ] AXS: Primary data saved (38308 records). [2025-09-24T17:25:44.615298] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-24T17:25:44.615432] [INFO ] [MAIN ] Update Progress: 199/2373 symbols completed. AXS took 21.1s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-24T17:25:45.157689] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T17:25:45.168533] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-24T17:25:46.930922] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T17:25:46.946466] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-24T17:25:48.573172] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T17:25:48.585467] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-24T17:25:50.457026] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:25:50.466350] [INFO ] [REMOTE ] AXTA: Full fetch complete (74793 records). [2025-09-24T17:25:50.466473] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-24T17:25:50.861504] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-24T17:25:50.861587] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-24T17:25:50.862355] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-24T17:25:50.862432] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-24T17:25:50.864062] [DEBUG] [LOCAL ] AXTA: Trimmed 74793 records to 52058 (keeping 200 days of data) [2025-09-24T17:25:51.180500] [DEBUG] [LOCAL ] AXTA: Primary data saved (52058 records). [2025-09-24T17:25:51.180660] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-24T17:25:51.182552] [INFO ] [MAIN ] Update Progress: 200/2373 symbols completed. AXTA took 25.0s. Estimated remaining: 4h 40m 14s. Rate: 7.8 symbols/min [2025-09-24T17:25:51.808120] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:51.838126] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:51.894187] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-24T17:25:51.891931] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:51.920613] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:25:51.895397] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-24T17:25:51.921371] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-24T17:25:51.921472] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-24T17:25:51.921562] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-24T17:25:51.921969] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-24T17:25:52.042941] [DEBUG] [LOCAL ] AZO: Loaded 11496 existing records from primary storage. [2025-09-24T17:25:52.043182] [INFO ] [MAIN ] AZO: Loaded 11496 existing records. [2025-09-24T17:25:52.084037] [DEBUG] [LOCAL ] AZZ: Loaded 22139 existing records from primary storage. [2025-09-24T17:25:52.185697] [INFO ] [MAIN ] AZZ: Loaded 22139 existing records. [2025-09-24T17:25:52.209260] [DEBUG] [LOCAL ] AYI: Loaded 25239 existing records from primary storage. [2025-09-24T17:25:52.238931] [INFO ] [MAIN ] AYI: Loaded 25239 existing records. [2025-09-24T17:25:52.645881] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:25:52.725510] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-24T17:25:52.803361] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:25:52.740222] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-24T17:25:52.821619] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:25:52.826071] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-24T17:25:52.825894] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-24T17:25:52.826243] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-24T17:25:52.826882] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-24T17:25:52.837853] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-24T17:25:52.832683] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-24T17:25:52.837948] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-24T17:25:52.848587] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-24T17:25:52.858947] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-24T17:25:52.848511] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-24T17:25:53.065956] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:53.144878] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-24T17:25:53.993489] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:54.066639] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:54.076074] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-24T17:25:54.075816] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-24T17:25:54.098700] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:25:54.100246] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-24T17:25:54.668219] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T17:25:54.675119] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-24T17:25:54.893394] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T17:25:54.902202] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-24T17:25:55.123314] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T17:25:55.131881] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-24T17:25:55.283445] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T17:25:55.287087] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-24T17:25:55.985983] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T17:25:55.992955] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-24T17:25:56.008464] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:25:56.013255] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-24T17:25:56.051208] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-24T17:25:56.054234] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-24T17:25:56.180984] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T17:25:56.187379] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-24T17:25:56.218446] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:25:56.218709] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-24T17:25:56.219087] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-24T17:25:56.467742] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:25:56.467988] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-24T17:25:56.816108] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-24T17:25:56.964566] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:25:57.059552] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:25:57.060744] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T17:25:57.060928] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-24T17:25:57.077592] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T17:25:57.616098] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-24T17:25:58.416116] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-24T17:25:58.904746] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T17:25:59.216059] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-24T17:25:59.360771] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T17:26:00.016090] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-24T17:26:00.401134] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T17:26:00.816062] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-24T17:26:00.887337] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T17:26:01.616058] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-24T17:26:01.913489] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T17:26:02.416116] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-24T17:26:02.677636] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T17:26:03.216102] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-24T17:26:03.682974] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:26:03.992992] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T17:26:04.016039] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-24T17:26:04.816054] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-24T17:26:05.121582] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T17:26:05.616040] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-24T17:26:05.991191] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T17:26:06.416118] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-24T17:26:07.079460] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T17:26:07.216069] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-24T17:26:07.319776] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T17:26:08.016125] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-24T17:26:08.352478] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T17:26:08.816112] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-24T17:26:09.272004] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T17:26:09.616106] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-24T17:26:10.416056] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-24T17:26:10.591071] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T17:26:10.823911] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T17:26:10.827855] [INFO ] [REMOTE ] AZZ: Full fetch complete (30892 records). [2025-09-24T17:26:10.827948] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-24T17:26:11.216952] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-24T17:26:11.216614] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-24T17:26:11.217164] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-24T17:26:11.218750] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-24T17:26:11.218822] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-24T17:26:11.219996] [DEBUG] [LOCAL ] AZZ: Trimmed 30892 records to 22152 (keeping 200 days of data) [2025-09-24T17:26:11.333270] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T17:26:11.382704] [DEBUG] [LOCAL ] AZZ: Primary data saved (22152 records). [2025-09-24T17:26:11.382871] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-24T17:26:11.382972] [INFO ] [MAIN ] Update Progress: 201/2373 symbols completed. AZZ took 20.2s. Estimated remaining: 4h 42m 21s. Rate: 7.7 symbols/min [2025-09-24T17:26:11.583383] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:11.639968] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-24T17:26:11.640128] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-24T17:26:11.849018] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:11.849329] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-24T17:26:11.849417] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-24T17:26:11.852383] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-24T17:26:11.852489] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-24T17:26:12.041687] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-24T17:26:12.239771] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:12.816079] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-24T17:26:13.232982] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T17:26:13.366891] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-24T17:26:13.616158] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-24T17:26:13.702663] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T17:26:14.124830] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T17:26:14.416131] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-24T17:26:15.216148] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-24T17:26:16.016131] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-24T17:26:16.806639] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T17:26:16.817777] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-24T17:26:17.301275] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T17:26:17.305288] [INFO ] [REMOTE ] AYI: Full fetch complete (36672 records). [2025-09-24T17:26:17.305425] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-24T17:26:17.621204] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-24T17:26:17.754876] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-24T17:26:17.755080] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-24T17:26:17.755548] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-24T17:26:17.755734] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-24T17:26:17.756917] [DEBUG] [LOCAL ] AYI: Trimmed 36672 records to 25117 (keeping 200 days of data) [2025-09-24T17:26:17.865750] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T17:26:17.871155] [INFO ] [REMOTE ] AZO: Full fetch complete (16369 records). [2025-09-24T17:26:17.871692] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-24T17:26:18.018695] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-24T17:26:18.387309] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-24T17:26:18.387784] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-24T17:26:18.388561] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-24T17:26:18.389047] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-24T17:26:18.391134] [DEBUG] [LOCAL ] AYI: Primary data saved (25117 records). [2025-09-24T17:26:18.391782] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-24T17:26:18.391965] [INFO ] [MAIN ] Update Progress: 202/2373 symbols completed. AYI took 27.2s. Estimated remaining: 4h 42m 4s. Rate: 7.7 symbols/min [2025-09-24T17:26:18.392114] [DEBUG] [LOCAL ] AZO: Trimmed 16369 records to 11473 (keeping 200 days of data) [2025-09-24T17:26:18.425425] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-24T17:26:18.578980] [DEBUG] [LOCAL ] AZO: Primary data saved (11473 records). [2025-09-24T17:26:18.589872] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-24T17:26:18.605704] [INFO ] [MAIN ] Update Progress: 203/2373 symbols completed. AZO took 27.4s. Estimated remaining: 4h 40m 35s. Rate: 7.7 symbols/min [2025-09-24T17:26:18.758075] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:18.850781] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:18.899314] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-24T17:26:18.899573] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-24T17:26:19.098155] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:19.114702] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-24T17:26:19.114814] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-24T17:26:19.115734] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-24T17:26:19.115889] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-24T17:26:19.148733] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-24T17:26:19.175773] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-24T17:26:19.519761] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:19.571713] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-24T17:26:19.594209] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-24T17:26:19.624151] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-24T17:26:19.627753] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-24T17:26:19.834768] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:19.835192] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-24T17:26:20.113839] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:20.114391] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-24T17:26:20.147541] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-24T17:26:20.816097] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-24T17:26:20.853917] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-24T17:26:21.616113] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-24T17:26:22.045153] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-24T17:26:22.416086] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-24T17:26:22.562173] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-24T17:26:23.096344] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-24T17:26:23.105569] [INFO ] [REMOTE ] B: Full fetch complete (45125 records). [2025-09-24T17:26:23.105735] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-24T17:26:23.221144] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-24T17:26:23.302584] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-24T17:26:23.303159] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:26:23.303230] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:26:23.303303] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-24T17:26:23.303383] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-24T17:26:23.303439] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-24T17:26:23.303498] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-24T17:26:23.303582] [INFO ] [MAIN ] Update Progress: 204/2373 symbols completed. B took 32.1s. Estimated remaining: 4h 39m 55s. Rate: 7.7 symbols/min [2025-09-24T17:26:23.478296] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:23.478518] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-09-24T17:26:23.478563] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-09-24T17:26:23.478744] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-24T17:26:23.478796] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-24T17:26:23.478841] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-24T17:26:23.478875] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-24T17:26:23.889364] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:23.924619] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-24T17:26:24.016120] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-24T17:26:24.558753] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-24T17:26:24.816086] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-24T17:26:25.615613] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-24T17:26:25.626238] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-24T17:26:25.936457] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T17:26:26.416125] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-24T17:26:27.216132] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-24T17:26:27.270028] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-24T17:26:27.678066] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T17:26:28.016124] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-24T17:26:28.485076] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-24T17:26:28.596828] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T17:26:28.816076] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-24T17:26:29.616083] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-24T17:26:30.418561] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-24T17:26:30.439837] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:26:30.660981] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-24T17:26:31.216077] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-24T17:26:31.970054] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T17:26:32.016080] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-24T17:26:32.530549] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T17:26:32.816083] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-24T17:26:33.616062] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-24T17:26:33.944881] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-24T17:26:34.416076] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-24T17:26:34.788272] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-24T17:26:35.216043] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-24T17:26:35.451847] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T17:26:35.468444] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-24T17:26:36.016082] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-24T17:26:36.816107] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-24T17:26:37.041593] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-24T17:26:37.527498] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-24T17:26:37.616095] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-24T17:26:37.797108] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:26:38.416083] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-24T17:26:38.958834] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-24T17:26:39.216091] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-24T17:26:39.828910] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T17:26:40.016130] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-24T17:26:40.311714] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:26:40.816085] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-24T17:26:41.145968] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-24T17:26:41.616097] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-24T17:26:42.416097] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-24T17:26:42.572870] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-24T17:26:42.694432] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T17:26:43.216125] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-24T17:26:44.016072] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-24T17:26:44.131508] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-24T17:26:44.816130] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-24T17:26:44.913441] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-24T17:26:45.009450] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:26:45.616130] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-24T17:26:46.416113] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-24T17:26:46.997431] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-24T17:26:47.190633] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-24T17:26:47.216036] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-24T17:26:47.370135] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T17:26:48.016161] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-24T17:26:48.816153] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-24T17:26:49.034588] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-24T17:26:49.045100] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-24T17:26:49.045288] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-24T17:26:49.477964] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-24T17:26:49.478089] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-24T17:26:49.478991] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-24T17:26:49.479155] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-24T17:26:49.498023] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-24T17:26:49.510082] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T17:26:49.611068] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-24T17:26:49.612468] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-24T17:26:50.079380] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-24T17:26:50.079807] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-24T17:26:50.081689] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-24T17:26:50.082365] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-24T17:26:50.087587] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-24T17:26:50.565692] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-24T17:26:50.567895] [INFO ] [MAIN ] BA: Full history saved. [2025-09-24T17:26:50.568057] [INFO ] [MAIN ] Update Progress: 205/2373 symbols completed. BA took 39.2s. Estimated remaining: 4h 43m 14s. Rate: 7.7 symbols/min [2025-09-24T17:26:50.755600] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-24T17:26:50.843428] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-24T17:26:50.863367] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:50.903757] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-24T17:26:50.917477] [INFO ] [REMOTE ] BAH: Full fetch complete (74823 records). [2025-09-24T17:26:50.918760] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-24T17:26:51.057487] [DEBUG] [LOCAL ] BAK: Loaded 38785 existing records from primary storage. [2025-09-24T17:26:51.064784] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-24T17:26:51.069992] [INFO ] [MAIN ] BAK: Loaded 38785 existing records. [2025-09-24T17:26:51.092743] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-24T17:26:51.128324] [INFO ] [MAIN ] Update Progress: 206/2373 symbols completed. BAC took 32.5s. Estimated remaining: 4h 41m 49s. Rate: 7.7 symbols/min [2025-09-24T17:26:51.628934] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:51.634406] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:51.645577] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-24T17:26:51.651035] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-24T17:26:51.686291] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-24T17:26:51.730952] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-24T17:26:51.734613] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-24T17:26:51.756242] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-24T17:26:51.788675] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-24T17:26:51.824370] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-24T17:26:51.878612] [DEBUG] [LOCAL ] BAH: Trimmed 74823 records to 51721 (keeping 200 days of data) [2025-09-24T17:26:52.162161] [DEBUG] [LOCAL ] BALL: Loaded 51815 existing records from primary storage. [2025-09-24T17:26:52.163337] [INFO ] [MAIN ] BALL: Loaded 51815 existing records. [2025-09-24T17:26:52.335389] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:52.346609] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-24T17:26:52.471882] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:52.472606] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-24T17:26:52.473185] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-24T17:26:52.476474] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-24T17:26:52.476801] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-24T17:26:52.864283] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:52.865106] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-24T17:26:53.076088] [DEBUG] [LOCAL ] BAH: Primary data saved (51721 records). [2025-09-24T17:26:53.076239] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-24T17:26:53.077477] [INFO ] [MAIN ] Update Progress: 207/2373 symbols completed. BAH took 29.8s. Estimated remaining: 4h 40m 40s. Rate: 7.7 symbols/min [2025-09-24T17:26:53.249600] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:53.249777] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-24T17:26:53.249821] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-24T17:26:53.249974] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-24T17:26:53.250034] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-24T17:26:53.250078] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-24T17:26:53.250111] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-24T17:26:53.613243] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:53.613528] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-24T17:26:53.841905] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-24T17:26:53.852024] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-24T17:26:53.852158] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-24T17:26:54.185213] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:26:54.214580] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-24T17:26:54.286634] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-24T17:26:54.286767] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-24T17:26:54.287587] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-24T17:26:54.287631] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-24T17:26:54.289264] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-24T17:26:54.445692] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:26:54.459774] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-24T17:26:54.482974] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T17:26:54.489403] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-24T17:26:54.714413] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-24T17:26:54.714574] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-24T17:26:54.714690] [INFO ] [MAIN ] Update Progress: 208/2373 symbols completed. BABA took 36.3s. Estimated remaining: 4h 39m 29s. Rate: 7.7 symbols/min [2025-09-24T17:26:54.885155] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:26:54.935671] [DEBUG] [LOCAL ] BAM: Loaded 52005 existing records from primary storage. [2025-09-24T17:26:54.935819] [INFO ] [MAIN ] BAM: Loaded 52005 existing records. [2025-09-24T17:26:55.114872] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:26:55.115111] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-24T17:26:55.115169] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-24T17:26:55.117677] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-24T17:26:55.117745] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-24T17:26:55.495602] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:26:55.496127] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-24T17:26:55.755045] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:26:55.843027] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T17:26:56.016055] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-24T17:26:56.068765] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:26:56.816101] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-24T17:26:57.213508] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T17:26:57.412150] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T17:26:57.616076] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-24T17:26:58.207547] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:26:58.416100] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-24T17:26:58.611683] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T17:26:59.216129] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-24T17:27:00.016136] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-24T17:27:00.146638] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:27:00.683888] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T17:27:00.816063] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-24T17:27:01.616080] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-24T17:27:01.677401] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T17:27:02.416213] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-24T17:27:03.216117] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-24T17:27:03.731906] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-24T17:27:04.016081] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-24T17:27:04.150125] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T17:27:04.560780] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-09-24T17:27:04.684208] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-24T17:27:04.816119] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-24T17:27:05.616074] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-24T17:27:05.659437] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T17:27:06.416165] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-24T17:27:06.714749] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T17:27:07.132926] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T17:27:07.216072] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-24T17:27:07.285126] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T17:27:08.016089] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-24T17:27:08.756520] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T17:27:08.816038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-24T17:27:09.108130] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T17:27:09.616110] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-24T17:27:09.779279] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T17:27:10.416087] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-24T17:27:11.215925] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T17:27:11.216059] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-24T17:27:11.260349] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T17:27:12.016086] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-24T17:27:12.811980] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T17:27:12.821106] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-24T17:27:13.616062] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-24T17:27:14.091803] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T17:27:14.416085] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-24T17:27:14.923771] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T17:27:15.216102] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-24T17:27:15.429759] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-24T17:27:15.890312] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T17:27:16.016116] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-24T17:27:16.789721] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-24T17:27:16.816034] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-24T17:27:16.904487] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T17:27:16.908109] [INFO ] [REMOTE ] BALY: Full fetch complete (17342 records). [2025-09-24T17:27:16.908300] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-24T17:27:17.107772] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T17:27:17.108207] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:27:17.108294] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:27:17.108393] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-24T17:27:17.108522] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-24T17:27:17.108604] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-24T17:27:17.108740] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-24T17:27:17.108899] [INFO ] [MAIN ] Update Progress: 209/2373 symbols completed. BALY took 24.0s. Estimated remaining: 4h 41m 53s. Rate: 7.7 symbols/min [2025-09-24T17:27:17.290308] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:17.382103] [DEBUG] [LOCAL ] BANC: Loaded 51262 existing records from primary storage. [2025-09-24T17:27:17.382319] [INFO ] [MAIN ] BANC: Loaded 51262 existing records. [2025-09-24T17:27:17.568550] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:17.568885] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-24T17:27:17.568938] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-24T17:27:17.571154] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-24T17:27:17.571237] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-24T17:27:17.626747] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-24T17:27:17.955605] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:18.416127] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-24T17:27:18.568674] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:27:18.811066] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T17:27:19.216095] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-24T17:27:20.018941] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-24T17:27:20.023365] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T17:27:20.816067] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-24T17:27:20.970999] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T17:27:21.558346] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T17:27:21.616130] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-24T17:27:22.286533] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T17:27:22.294678] [INFO ] [REMOTE ] BAK: Full fetch complete (57005 records). [2025-09-24T17:27:22.294815] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-24T17:27:22.421346] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-24T17:27:22.717749] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-24T17:27:22.717838] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-24T17:27:22.719450] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-24T17:27:22.719599] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-24T17:27:22.720944] [DEBUG] [LOCAL ] BAK: Trimmed 57005 records to 38810 (keeping 200 days of data) [2025-09-24T17:27:22.953152] [DEBUG] [LOCAL ] BAK: Primary data saved (38810 records). [2025-09-24T17:27:22.953382] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-24T17:27:22.953514] [INFO ] [MAIN ] Update Progress: 210/2373 symbols completed. BAK took 32.4s. Estimated remaining: 4h 41m 25s. Rate: 7.7 symbols/min [2025-09-24T17:27:23.135480] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:23.168273] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T17:27:23.209528] [DEBUG] [LOCAL ] BAP: Loaded 26398 existing records from primary storage. [2025-09-24T17:27:23.209753] [INFO ] [MAIN ] BAP: Loaded 26398 existing records. [2025-09-24T17:27:23.221227] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-24T17:27:23.412627] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:23.413401] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-24T17:27:23.413477] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-24T17:27:23.415234] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-24T17:27:23.415311] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-24T17:27:23.794151] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:24.010271] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T17:27:24.018815] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-24T17:27:24.020201] [INFO ] [REMOTE ] BALL: Full fetch complete (75384 records). [2025-09-24T17:27:24.020289] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-24T17:27:24.437966] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-24T17:27:24.438285] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-24T17:27:24.439177] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-24T17:27:24.439276] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-24T17:27:24.441112] [DEBUG] [LOCAL ] BALL: Trimmed 75384 records to 51811 (keeping 200 days of data) [2025-09-24T17:27:24.572339] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T17:27:24.805545] [DEBUG] [LOCAL ] BALL: Primary data saved (51811 records). [2025-09-24T17:27:24.805723] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-24T17:27:24.805836] [INFO ] [MAIN ] Update Progress: 211/2373 symbols completed. BALL took 33.7s. Estimated remaining: 4h 40m 16s. Rate: 7.7 symbols/min [2025-09-24T17:27:24.821260] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-24T17:27:24.999678] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:25.050407] [DEBUG] [LOCAL ] BARK: Loaded 38517 existing records from primary storage. [2025-09-24T17:27:25.050787] [INFO ] [MAIN ] BARK: Loaded 38517 existing records. [2025-09-24T17:27:25.259330] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:25.259677] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-24T17:27:25.259742] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-24T17:27:25.261567] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-24T17:27:25.261630] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-24T17:27:25.620200] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-24T17:27:25.661992] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:26.416141] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-24T17:27:26.659686] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-24T17:27:26.672710] [INFO ] [REMOTE ] BAM: Full fetch complete (74092 records). [2025-09-24T17:27:26.672916] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-24T17:27:27.116573] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-24T17:27:27.116963] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-24T17:27:27.118041] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-24T17:27:27.118112] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-24T17:27:27.119861] [DEBUG] [LOCAL ] BAM: Trimmed 74092 records to 52001 (keeping 200 days of data) [2025-09-24T17:27:27.266412] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-24T17:27:27.286074] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-24T17:27:27.313680] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T17:27:27.531162] [DEBUG] [LOCAL ] BAM: Primary data saved (52001 records). [2025-09-24T17:27:27.531332] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-24T17:27:27.531452] [INFO ] [MAIN ] Update Progress: 212/2373 symbols completed. BAM took 32.8s. Estimated remaining: 4h 39m 16s. Rate: 7.7 symbols/min [2025-09-24T17:27:27.708204] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:27.768555] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-09-24T17:27:27.768759] [INFO ] [MAIN ] BAX: Loaded 53493 existing records. [2025-09-24T17:27:27.965398] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:27.965874] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-24T17:27:27.966018] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-24T17:27:27.968389] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-24T17:27:27.968452] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-24T17:27:28.027429] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-24T17:27:28.368146] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T17:27:28.412490] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:28.816065] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-24T17:27:29.011994] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:27:29.225728] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:27:29.616086] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-24T17:27:30.243256] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:27:30.416087] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-24T17:27:31.216055] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-24T17:27:31.355065] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T17:27:31.808728] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:27:32.016077] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-24T17:27:32.816062] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-24T17:27:33.078177] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T17:27:33.487877] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:27:33.616072] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-24T17:27:33.670160] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T17:27:34.416088] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-24T17:27:35.107156] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:27:35.216073] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-24T17:27:36.016095] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-24T17:27:36.171890] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T17:27:36.816033] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-24T17:27:36.995872] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T17:27:37.226983] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T17:27:37.616083] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-24T17:27:38.416062] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-24T17:27:38.465039] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T17:27:39.035027] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T17:27:39.216127] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-24T17:27:39.538856] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T17:27:40.016132] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-24T17:27:40.816123] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-24T17:27:41.060940] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T17:27:41.590364] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:27:41.616087] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-24T17:27:41.731886] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T17:27:42.416097] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-24T17:27:43.217247] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-24T17:27:43.219866] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T17:27:43.980849] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T17:27:44.016030] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-24T17:27:44.338910] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T17:27:44.816088] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-24T17:27:45.616051] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-24T17:27:45.904740] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T17:27:45.913841] [INFO ] [REMOTE ] BANC: Full fetch complete (74101 records). [2025-09-24T17:27:45.913961] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-24T17:27:46.317080] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-24T17:27:46.317192] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-24T17:27:46.318130] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-24T17:27:46.318215] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-24T17:27:46.320144] [DEBUG] [LOCAL ] BANC: Trimmed 74101 records to 51263 (keeping 200 days of data) [2025-09-24T17:27:46.441901] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-24T17:27:46.445975] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T17:27:46.686815] [DEBUG] [LOCAL ] BANC: Primary data saved (51263 records). [2025-09-24T17:27:46.686950] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-24T17:27:46.688056] [INFO ] [MAIN ] Update Progress: 213/2373 symbols completed. BANC took 29.6s. Estimated remaining: 4h 41m 4s. Rate: 7.7 symbols/min [2025-09-24T17:27:46.861919] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:46.862181] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-09-24T17:27:46.862251] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-09-24T17:27:46.862550] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-24T17:27:46.862709] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-24T17:27:46.862887] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-09-24T17:27:46.862950] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-24T17:27:46.982411] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T17:27:47.221133] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-24T17:27:47.251589] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:47.602693] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-24T17:27:48.016135] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-24T17:27:48.721308] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:27:48.727788] [INFO ] [REMOTE ] BARK: Full fetch complete (57063 records). [2025-09-24T17:27:48.727903] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-24T17:27:48.823935] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-24T17:27:49.125915] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-24T17:27:49.125998] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-24T17:27:49.126698] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-24T17:27:49.126762] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-24T17:27:49.127960] [DEBUG] [LOCAL ] BARK: Trimmed 57063 records to 38436 (keeping 200 days of data) [2025-09-24T17:27:49.340331] [DEBUG] [LOCAL ] BARK: Primary data saved (38436 records). [2025-09-24T17:27:49.340471] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-24T17:27:49.340555] [INFO ] [MAIN ] Update Progress: 214/2373 symbols completed. BARK took 24.5s. Estimated remaining: 4h 40m 4s. Rate: 7.7 symbols/min [2025-09-24T17:27:49.517436] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:49.569403] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-24T17:27:49.569540] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-24T17:27:49.633755] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-24T17:27:49.747710] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:27:49.799635] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:49.799926] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-24T17:27:49.799981] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-24T17:27:49.803799] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-24T17:27:49.803902] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-24T17:27:50.157578] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:50.416051] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-24T17:27:50.817804] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-24T17:27:50.948866] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T17:27:51.216104] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-24T17:27:52.016136] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-24T17:27:52.816049] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-24T17:27:52.875271] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-24T17:27:53.033671] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T17:27:53.616078] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-24T17:27:53.929010] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T17:27:54.086337] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T17:27:54.091602] [INFO ] [REMOTE ] BAP: Full fetch complete (37912 records). [2025-09-24T17:27:54.091722] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-24T17:27:54.421185] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-24T17:27:54.467757] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-24T17:27:54.467846] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-24T17:27:54.468341] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-24T17:27:54.468383] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-24T17:27:54.470191] [DEBUG] [LOCAL ] BAP: Trimmed 37912 records to 26395 (keeping 200 days of data) [2025-09-24T17:27:54.633359] [DEBUG] [LOCAL ] BAP: Primary data saved (26395 records). [2025-09-24T17:27:54.633495] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-24T17:27:54.633580] [INFO ] [MAIN ] Update Progress: 215/2373 symbols completed. BAP took 31.7s. Estimated remaining: 4h 39m 32s. Rate: 7.7 symbols/min [2025-09-24T17:27:54.804677] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:27:54.845848] [DEBUG] [LOCAL ] BBAR: Loaded 41265 existing records from primary storage. [2025-09-24T17:27:54.846014] [INFO ] [MAIN ] BBAR: Loaded 41265 existing records. [2025-09-24T17:27:55.026837] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:27:55.027081] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-24T17:27:55.027129] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-24T17:27:55.028863] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-24T17:27:55.028925] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-24T17:27:55.239027] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-24T17:27:55.392241] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:27:56.016074] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-24T17:27:56.200573] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-24T17:27:56.262944] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T17:27:56.816202] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-24T17:27:57.436741] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-24T17:27:57.616094] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-24T17:27:57.667122] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:27:58.416089] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-24T17:27:59.121872] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-24T17:27:59.216042] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-24T17:27:59.531937] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T17:28:00.016050] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-24T17:28:00.112788] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:28:00.816088] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-24T17:28:01.616091] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-24T17:28:01.782483] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T17:28:01.921284] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-24T17:28:02.416053] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-24T17:28:02.864587] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T17:28:03.219186] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-24T17:28:03.223026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T17:28:03.947545] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T17:28:04.016102] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-24T17:28:04.816072] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-24T17:28:04.998129] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T17:28:05.616046] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-24T17:28:05.725788] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T17:28:05.735384] [INFO ] [REMOTE ] BAX: Full fetch complete (77438 records). [2025-09-24T17:28:05.735535] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-24T17:28:06.144868] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-24T17:28:06.144952] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-24T17:28:06.145758] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-24T17:28:06.145825] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-24T17:28:06.147357] [DEBUG] [LOCAL ] BAX: Trimmed 77438 records to 53493 (keeping 200 days of data) [2025-09-24T17:28:06.435512] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-24T17:28:06.492144] [DEBUG] [LOCAL ] BAX: Primary data saved (53493 records). [2025-09-24T17:28:06.492349] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-24T17:28:06.492467] [INFO ] [MAIN ] Update Progress: 216/2373 symbols completed. BAX took 39.0s. Estimated remaining: 4h 40m 5s. Rate: 7.7 symbols/min [2025-09-24T17:28:06.718113] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:06.770011] [DEBUG] [LOCAL ] BBD: Loaded 53181 existing records from primary storage. [2025-09-24T17:28:06.770164] [INFO ] [MAIN ] BBD: Loaded 53181 existing records. [2025-09-24T17:28:06.954952] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:06.955252] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-24T17:28:06.955390] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-24T17:28:06.957075] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-24T17:28:06.957138] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-24T17:28:07.322400] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:07.322776] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-24T17:28:07.467831] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-24T17:28:07.599516] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T17:28:08.016080] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-24T17:28:08.066912] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T17:28:08.816088] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-24T17:28:09.326203] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T17:28:09.616100] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-24T17:28:09.991621] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T17:28:10.416117] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-24T17:28:11.204781] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T17:28:11.216019] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-24T17:28:11.546608] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-24T17:28:11.966015] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T17:28:12.016063] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-24T17:28:12.523380] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T17:28:12.816155] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-24T17:28:13.616099] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-24T17:28:14.165890] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-24T17:28:14.176394] [INFO ] [REMOTE ] BB: Full fetch complete (76981 records). [2025-09-24T17:28:14.176771] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-24T17:28:14.440741] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-24T17:28:14.577258] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-24T17:28:14.577362] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-24T17:28:14.578222] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-24T17:28:14.578295] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-24T17:28:14.580006] [DEBUG] [LOCAL ] BB: Trimmed 76981 records to 52921 (keeping 200 days of data) [2025-09-24T17:28:14.910200] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T17:28:14.935958] [DEBUG] [LOCAL ] BB: Primary data saved (52921 records). [2025-09-24T17:28:14.936084] [INFO ] [MAIN ] BB: Full history saved. [2025-09-24T17:28:14.936158] [INFO ] [MAIN ] Update Progress: 217/2373 symbols completed. BB took 28.2s. Estimated remaining: 4h 40m 3s. Rate: 7.7 symbols/min [2025-09-24T17:28:15.109436] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:15.109596] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-09-24T17:28:15.109636] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-09-24T17:28:15.109831] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-24T17:28:15.109878] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-24T17:28:15.109963] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-09-24T17:28:15.110014] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-24T17:28:15.221321] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-24T17:28:15.489616] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:15.521270] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-24T17:28:16.016063] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-24T17:28:16.267547] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T17:28:16.816139] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-24T17:28:16.942217] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T17:28:17.616082] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-24T17:28:18.390257] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T17:28:18.416090] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-24T17:28:19.020476] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-24T17:28:19.212929] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T17:28:19.221060] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-24T17:28:19.422737] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T17:28:20.016093] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-24T17:28:20.816119] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-24T17:28:21.616222] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-24T17:28:21.667423] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T17:28:21.677724] [INFO ] [REMOTE ] BBAR: Full fetch complete (60591 records). [2025-09-24T17:28:21.677898] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-24T17:28:22.089937] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-24T17:28:22.090155] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-24T17:28:22.090925] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-24T17:28:22.101561] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-24T17:28:22.122667] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-24T17:28:22.137887] [DEBUG] [LOCAL ] BBAR: Trimmed 60591 records to 41302 (keeping 200 days of data) [2025-09-24T17:28:22.395494] [DEBUG] [LOCAL ] BBAR: Primary data saved (41302 records). [2025-09-24T17:28:22.395741] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-24T17:28:22.395840] [INFO ] [MAIN ] Update Progress: 218/2373 symbols completed. BBAR took 27.8s. Estimated remaining: 4h 39m 52s. Rate: 7.7 symbols/min [2025-09-24T17:28:22.427747] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-24T17:28:22.605675] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:22.607634] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:28:22.623973] [DEBUG] [LOCAL ] BBDO: Loaded 5032 existing records from primary storage. [2025-09-24T17:28:22.624094] [INFO ] [MAIN ] BBDO: Loaded 5032 existing records. [2025-09-24T17:28:22.809893] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:22.810285] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-24T17:28:22.810341] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-24T17:28:22.810992] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-24T17:28:22.811068] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-24T17:28:23.125778] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T17:28:23.213053] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:23.216035] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-24T17:28:23.983495] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T17:28:24.016047] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-24T17:28:24.646091] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T17:28:24.816051] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-24T17:28:25.107082] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-24T17:28:25.116634] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-24T17:28:25.116824] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-24T17:28:25.534852] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-24T17:28:25.534978] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-24T17:28:25.536392] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-24T17:28:25.536524] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-24T17:28:25.539055] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-24T17:28:25.629461] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-24T17:28:25.895901] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-24T17:28:25.896163] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-24T17:28:25.896292] [INFO ] [MAIN ] Update Progress: 219/2373 symbols completed. BBAI took 36.6s. Estimated remaining: 4h 39m 2s. Rate: 7.7 symbols/min [2025-09-24T17:28:26.098854] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:26.122800] [DEBUG] [LOCAL ] BBN: Loaded 18034 existing records from primary storage. [2025-09-24T17:28:26.123023] [INFO ] [MAIN ] BBN: Loaded 18034 existing records. [2025-09-24T17:28:26.327621] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:26.328053] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-24T17:28:26.328139] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-24T17:28:26.329057] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-24T17:28:26.329122] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-24T17:28:26.425848] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-24T17:28:26.729085] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:27.145291] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T17:28:27.174505] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-24T17:28:27.216061] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-24T17:28:27.327361] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T17:28:27.819053] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T17:28:28.016116] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-24T17:28:28.736386] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T17:28:28.816100] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-24T17:28:29.616094] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-24T17:28:30.188766] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T17:28:30.416135] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-24T17:28:31.216084] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-24T17:28:31.364186] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T17:28:31.432615] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T17:28:32.016079] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-24T17:28:32.819801] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-24T17:28:32.823404] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:28:32.936318] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T17:28:33.512610] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T17:28:33.616113] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-24T17:28:34.416068] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-24T17:28:34.462318] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T17:28:35.216075] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-24T17:28:36.016061] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-24T17:28:36.429989] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T17:28:36.502373] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T17:28:36.816046] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-24T17:28:37.057112] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T17:28:37.616077] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-24T17:28:38.416089] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-24T17:28:38.531316] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T17:28:38.991796] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T17:28:39.216056] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-24T17:28:39.402784] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T17:28:40.016105] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-24T17:28:40.145944] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T17:28:40.816099] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-24T17:28:41.386206] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T17:28:41.616101] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-24T17:28:42.416105] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-24T17:28:42.646050] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T17:28:42.689374] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T17:28:43.216105] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-24T17:28:43.771129] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:28:44.016058] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-24T17:28:44.240915] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T17:28:44.736395] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T17:28:44.816073] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-24T17:28:45.329068] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-24T17:28:45.616084] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-24T17:28:46.416104] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-24T17:28:47.003772] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T17:28:47.216082] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-24T17:28:47.361394] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T17:28:47.954238] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T17:28:47.957911] [INFO ] [REMOTE ] BBN: Full fetch complete (26864 records). [2025-09-24T17:28:47.958001] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-24T17:28:48.024541] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-24T17:28:48.360591] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-24T17:28:48.360699] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-24T17:28:48.361112] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-24T17:28:48.361152] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-24T17:28:48.361834] [DEBUG] [LOCAL ] BBN: Trimmed 26864 records to 17983 (keeping 200 days of data) [2025-09-24T17:28:48.480974] [DEBUG] [LOCAL ] BBN: Primary data saved (17983 records). [2025-09-24T17:28:48.481193] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-24T17:28:48.481306] [INFO ] [MAIN ] Update Progress: 220/2373 symbols completed. BBN took 22.6s. Estimated remaining: 4h 41m 20s. Rate: 7.7 symbols/min [2025-09-24T17:28:48.659578] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:48.659866] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-24T17:28:48.659912] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-24T17:28:48.660080] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-24T17:28:48.660125] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-24T17:28:48.660168] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-24T17:28:48.660203] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-24T17:28:48.824192] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-24T17:28:49.047765] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:49.577282] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T17:28:49.578798] [INFO ] [REMOTE ] BBDO: Full fetch complete (7727 records). [2025-09-24T17:28:49.578992] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-24T17:28:49.621453] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-24T17:28:49.863428] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:49.892374] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-24T17:28:49.979077] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-24T17:28:49.979283] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-24T17:28:49.979556] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-24T17:28:49.979639] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-24T17:28:49.980480] [DEBUG] [LOCAL ] BBDO: Trimmed 7727 records to 5017 (keeping 200 days of data) [2025-09-24T17:28:50.029907] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T17:28:50.041209] [INFO ] [REMOTE ] BBD: Full fetch complete (77120 records). [2025-09-24T17:28:50.041910] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-24T17:28:50.130838] [DEBUG] [LOCAL ] BBDO: Primary data saved (5017 records). [2025-09-24T17:28:50.151040] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-24T17:28:50.153937] [INFO ] [MAIN ] Update Progress: 221/2373 symbols completed. BBDO took 27.8s. Estimated remaining: 4h 40m 12s. Rate: 7.7 symbols/min [2025-09-24T17:28:50.421224] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-24T17:28:50.551264] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:50.641854] [DEBUG] [LOCAL ] BBU: Loaded 4116 existing records from primary storage. [2025-09-24T17:28:50.678735] [INFO ] [MAIN ] BBU: Loaded 4116 existing records. [2025-09-24T17:28:50.687760] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-24T17:28:50.709257] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-24T17:28:50.717901] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-24T17:28:50.737733] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-24T17:28:50.818131] [DEBUG] [LOCAL ] BBD: Trimmed 77120 records to 53181 (keeping 200 days of data) [2025-09-24T17:28:50.981966] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:50.983382] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-24T17:28:50.984358] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-24T17:28:50.985535] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-24T17:28:50.985859] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-24T17:28:51.217982] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-24T17:28:51.382758] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:51.497064] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:51.498901] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-24T17:28:51.597977] [DEBUG] [LOCAL ] BBD: Primary data saved (53181 records). [2025-09-24T17:28:51.598166] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-24T17:28:51.598268] [INFO ] [MAIN ] Update Progress: 222/2373 symbols completed. BBD took 45.1s. Estimated remaining: 4h 39m 2s. Rate: 7.7 symbols/min [2025-09-24T17:28:51.798286] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:51.818429] [DEBUG] [LOCAL ] BBUC: Loaded 13148 existing records from primary storage. [2025-09-24T17:28:51.818607] [INFO ] [MAIN ] BBUC: Loaded 13148 existing records. [2025-09-24T17:28:52.021062] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-24T17:28:52.020935] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:52.022907] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-24T17:28:52.029808] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-24T17:28:52.043308] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T17:28:52.041779] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-24T17:28:52.050804] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-24T17:28:52.056205] [INFO ] [REMOTE ] BBDC: Full fetch complete (48968 records). [2025-09-24T17:28:52.098815] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-24T17:28:52.778032] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:52.821326] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-24T17:28:52.858234] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T17:28:52.873091] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-24T17:28:52.873168] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-24T17:28:52.873776] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-24T17:28:52.873840] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-24T17:28:52.874973] [DEBUG] [LOCAL ] BBDC: Trimmed 48968 records to 33300 (keeping 200 days of data) [2025-09-24T17:28:53.073944] [DEBUG] [LOCAL ] BBDC: Primary data saved (33300 records). [2025-09-24T17:28:53.074105] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-24T17:28:53.074188] [INFO ] [MAIN ] Update Progress: 223/2373 symbols completed. BBDC took 38.1s. Estimated remaining: 4h 37m 54s. Rate: 7.7 symbols/min [2025-09-24T17:28:53.138880] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:53.155785] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-24T17:28:53.247285] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:28:53.299760] [DEBUG] [LOCAL ] BBVA: Loaded 49510 existing records from primary storage. [2025-09-24T17:28:53.300003] [INFO ] [MAIN ] BBVA: Loaded 49510 existing records. [2025-09-24T17:28:53.477392] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:28:53.477662] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-24T17:28:53.477724] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-24T17:28:53.480800] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-24T17:28:53.480862] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-24T17:28:53.621274] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-24T17:28:53.841859] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:28:53.924326] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:53.924721] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-24T17:28:54.416131] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-24T17:28:54.620951] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:54.621272] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-24T17:28:55.216102] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-24T17:28:55.791568] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T17:28:56.016124] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-24T17:28:56.816056] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-24T17:28:56.888852] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T17:28:57.265242] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T17:28:57.616083] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-24T17:28:57.814888] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:57.815171] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-24T17:28:58.416097] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-24T17:28:58.607018] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:28:58.607325] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-24T17:28:59.216107] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-24T17:29:00.016202] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-24T17:29:00.565133] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:29:00.816073] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-24T17:29:00.916400] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T17:29:01.015393] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:29:01.015722] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-24T17:29:01.616128] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-24T17:29:02.115288] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T17:29:02.416153] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-24T17:29:03.216136] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-24T17:29:03.852812] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:29:04.013917] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T17:29:04.016261] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-24T17:29:04.234469] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:29:04.234857] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-24T17:29:04.816136] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-24T17:29:05.588473] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T17:29:05.616058] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-24T17:29:06.416100] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-24T17:29:06.571325] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T17:29:07.216078] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-24T17:29:07.828028] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T17:29:07.924070] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T17:29:08.016093] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-24T17:29:08.816082] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-24T17:29:09.520831] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:29:09.528306] [INFO ] [REMOTE ] BBT: Full fetch complete (5109 records). [2025-09-24T17:29:09.528406] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-24T17:29:09.621243] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-24T17:29:09.736422] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 17 unique days, need 200 days [2025-09-24T17:29:09.736737] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:29:09.736811] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:29:09.736888] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-24T17:29:09.736974] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-24T17:29:09.737110] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-24T17:29:09.737190] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-24T17:29:09.737275] [INFO ] [MAIN ] Update Progress: 224/2373 symbols completed. BBT took 21.3s. Estimated remaining: 4h 39m 11s. Rate: 7.7 symbols/min [2025-09-24T17:29:09.889137] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T17:29:09.938463] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:09.965530] [DEBUG] [LOCAL ] BBW: Loaded 26671 existing records from primary storage. [2025-09-24T17:29:09.965678] [INFO ] [MAIN ] BBW: Loaded 26671 existing records. [2025-09-24T17:29:10.148263] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-24T17:29:10.154299] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:10.155829] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-24T17:29:10.155881] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-24T17:29:10.158241] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-24T17:29:10.158305] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-24T17:29:10.421210] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-24T17:29:10.536021] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:11.216060] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-24T17:29:11.353277] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T17:29:12.016081] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-24T17:29:12.306853] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T17:29:12.816064] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-24T17:29:12.878633] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T17:29:13.554929] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T17:29:13.616038] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-24T17:29:14.212281] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T17:29:14.416090] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-24T17:29:15.185669] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T17:29:15.187387] [INFO ] [REMOTE ] BBU: Full fetch complete (6107 records). [2025-09-24T17:29:15.187513] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-24T17:29:15.222726] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-24T17:29:15.564855] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-24T17:29:15.564942] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-24T17:29:15.565106] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-24T17:29:15.565164] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-24T17:29:15.565570] [DEBUG] [LOCAL ] BBU: Trimmed 6107 records to 4110 (keeping 200 days of data) [2025-09-24T17:29:15.591968] [DEBUG] [LOCAL ] BBU: Primary data saved (4110 records). [2025-09-24T17:29:15.592068] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-24T17:29:15.592196] [INFO ] [MAIN ] Update Progress: 225/2373 symbols completed. BBU took 25.4s. Estimated remaining: 4h 38m 45s. Rate: 7.7 symbols/min [2025-09-24T17:29:15.763758] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:15.827935] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-24T17:29:15.828080] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-09-24T17:29:16.017336] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-24T17:29:16.017604] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:16.019473] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-24T17:29:16.019550] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-24T17:29:16.023695] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-24T17:29:16.023789] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-24T17:29:16.406853] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:16.611609] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T17:29:16.816093] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-24T17:29:17.616065] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-24T17:29:17.840229] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T17:29:17.933177] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-24T17:29:18.416121] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-24T17:29:19.216130] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-24T17:29:19.348420] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:29:19.748534] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T17:29:20.016090] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-24T17:29:20.682138] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T17:29:20.816059] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-24T17:29:21.616115] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-24T17:29:21.751430] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T17:29:22.416134] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-24T17:29:22.564711] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T17:29:22.711136] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:29:23.216079] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-24T17:29:23.941044] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T17:29:24.016200] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-24T17:29:24.822532] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-24T17:29:24.829529] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T17:29:25.193279] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T17:29:25.616236] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-24T17:29:25.670704] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T17:29:26.416313] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-24T17:29:26.840910] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:29:27.216114] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-24T17:29:28.016231] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-24T17:29:28.176144] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T17:29:28.816068] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-24T17:29:28.865229] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:29:28.868208] [INFO ] [REMOTE ] BBUC: Full fetch complete (17353 records). [2025-09-24T17:29:28.868359] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-24T17:29:29.313807] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-24T17:29:29.313623] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-24T17:29:29.324211] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-24T17:29:29.325346] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-24T17:29:29.325850] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-24T17:29:29.326922] [DEBUG] [LOCAL ] BBUC: Trimmed 17353 records to 13112 (keeping 200 days of data) [2025-09-24T17:29:29.427697] [DEBUG] [LOCAL ] BBUC: Primary data saved (13112 records). [2025-09-24T17:29:29.427931] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-24T17:29:29.428146] [INFO ] [MAIN ] Update Progress: 226/2373 symbols completed. BBUC took 37.8s. Estimated remaining: 4h 39m 35s. Rate: 7.7 symbols/min [2025-09-24T17:29:29.628972] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-24T17:29:29.634188] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:29.720735] [DEBUG] [LOCAL ] BBY: Loaded 53480 existing records from primary storage. [2025-09-24T17:29:29.721017] [INFO ] [MAIN ] BBY: Loaded 53480 existing records. [2025-09-24T17:29:29.918435] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:29.918950] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-24T17:29:29.919021] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-24T17:29:29.921761] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-24T17:29:29.921854] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-24T17:29:30.337534] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:30.416123] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-24T17:29:30.678747] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T17:29:30.745263] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T17:29:31.216110] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-24T17:29:32.016060] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-24T17:29:32.236173] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T17:29:32.822695] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-24T17:29:32.830023] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:29:33.616059] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-24T17:29:33.874016] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T17:29:34.108768] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T17:29:34.416097] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-24T17:29:35.216117] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-24T17:29:35.460863] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T17:29:35.719976] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T17:29:35.732664] [INFO ] [REMOTE ] BBVA: Full fetch complete (71596 records). [2025-09-24T17:29:35.732849] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-24T17:29:36.021200] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-24T17:29:36.146354] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-24T17:29:36.146507] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-24T17:29:36.147379] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-24T17:29:36.147457] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-24T17:29:36.149093] [DEBUG] [LOCAL ] BBVA: Trimmed 71596 records to 49477 (keeping 200 days of data) [2025-09-24T17:29:36.470552] [DEBUG] [LOCAL ] BBVA: Primary data saved (49477 records). [2025-09-24T17:29:36.470970] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-24T17:29:36.473404] [INFO ] [MAIN ] Update Progress: 227/2373 symbols completed. BBVA took 43.4s. Estimated remaining: 4h 39m 20s. Rate: 7.7 symbols/min [2025-09-24T17:29:36.655099] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:36.702968] [DEBUG] [LOCAL ] BC: Loaded 44506 existing records from primary storage. [2025-09-24T17:29:36.703162] [INFO ] [MAIN ] BC: Loaded 44506 existing records. [2025-09-24T17:29:36.816212] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-24T17:29:36.897063] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:36.915009] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-24T17:29:36.917032] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-24T17:29:36.916887] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T17:29:36.923506] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-24T17:29:36.923810] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-24T17:29:36.972104] [INFO ] [REMOTE ] BBW: Full fetch complete (39263 records). [2025-09-24T17:29:37.012288] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-24T17:29:37.647795] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:37.667939] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-24T17:29:37.750516] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-24T17:29:37.750662] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-24T17:29:37.751237] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-24T17:29:37.751292] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-24T17:29:37.753353] [DEBUG] [LOCAL ] BBW: Trimmed 39263 records to 26707 (keeping 200 days of data) [2025-09-24T17:29:37.919556] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-24T17:29:37.975030] [DEBUG] [LOCAL ] BBW: Primary data saved (26707 records). [2025-09-24T17:29:37.975186] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-24T17:29:37.975304] [INFO ] [MAIN ] Update Progress: 228/2373 symbols completed. BBW took 28.2s. Estimated remaining: 4h 38m 12s. Rate: 7.7 symbols/min [2025-09-24T17:29:38.160509] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:38.207380] [DEBUG] [LOCAL ] BCAT: Loaded 34488 existing records from primary storage. [2025-09-24T17:29:38.207539] [INFO ] [MAIN ] BCAT: Loaded 34488 existing records. [2025-09-24T17:29:38.396881] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:38.397378] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-24T17:29:38.397518] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-24T17:29:38.400092] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-24T17:29:38.400156] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-24T17:29:38.430901] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-24T17:29:38.789237] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:38.825406] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T17:29:39.216087] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-24T17:29:39.642424] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:29:40.016121] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-24T17:29:40.204482] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T17:29:40.730820] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T17:29:40.816114] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-24T17:29:41.616052] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-24T17:29:41.657575] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T17:29:42.182360] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T17:29:42.416115] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-24T17:29:43.086508] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T17:29:43.216084] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-24T17:29:44.016088] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-24T17:29:44.294244] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T17:29:44.728150] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T17:29:44.816042] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-24T17:29:45.369715] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T17:29:45.616079] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-24T17:29:46.150015] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T17:29:46.416102] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-24T17:29:46.932423] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T17:29:47.216087] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-24T17:29:48.016110] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-24T17:29:48.294175] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T17:29:48.450278] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T17:29:48.459957] [INFO ] [REMOTE ] BBWI: Full fetch complete (77413 records). [2025-09-24T17:29:48.460126] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-24T17:29:48.819888] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-24T17:29:48.869218] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-24T17:29:48.869321] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-24T17:29:48.870285] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-24T17:29:48.870488] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-24T17:29:48.872232] [DEBUG] [LOCAL ] BBWI: Trimmed 77413 records to 53580 (keeping 200 days of data) [2025-09-24T17:29:49.214939] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-24T17:29:49.215095] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-24T17:29:49.215186] [INFO ] [MAIN ] Update Progress: 229/2373 symbols completed. BBWI took 33.6s. Estimated remaining: 4h 38m 37s. Rate: 7.7 symbols/min [2025-09-24T17:29:49.389287] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:29:49.418398] [DEBUG] [LOCAL ] BCC: Loaded 28407 existing records from primary storage. [2025-09-24T17:29:49.418534] [INFO ] [MAIN ] BCC: Loaded 28407 existing records. [2025-09-24T17:29:49.595912] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:29:49.596735] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-24T17:29:49.596973] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-24T17:29:49.598415] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-24T17:29:49.598547] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-24T17:29:49.631383] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-24T17:29:49.991396] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:29:50.030180] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T17:29:50.216059] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T17:29:50.416086] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-24T17:29:51.216064] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-24T17:29:51.446428] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T17:29:51.569740] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T17:29:52.016091] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-24T17:29:52.816118] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-24T17:29:52.966184] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:29:53.459790] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:29:53.616084] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-24T17:29:54.144366] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T17:29:54.416113] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-24T17:29:55.154195] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T17:29:55.216131] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-24T17:29:55.470504] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T17:29:56.016109] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-24T17:29:56.816092] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-24T17:29:57.191428] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-24T17:29:57.246353] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T17:29:57.616042] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-24T17:29:58.014234] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:29:58.416077] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-24T17:29:59.056535] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T17:29:59.216104] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-24T17:29:59.407361] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T17:30:00.016084] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-24T17:30:00.816105] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-24T17:30:01.307744] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-24T17:30:01.495762] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:30:01.616145] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-24T17:30:02.416147] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-24T17:30:03.216086] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-24T17:30:03.256139] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-24T17:30:04.016145] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-24T17:30:04.177200] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-24T17:30:04.816096] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-24T17:30:05.569494] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:30:05.591225] [INFO ] [REMOTE ] BC: Full fetch complete (63780 records). [2025-09-24T17:30:05.594618] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-24T17:30:05.599311] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-09-24T17:30:05.695419] [INFO ] [REMOTE ] BCAT: Full fetch complete (49681 records). [2025-09-24T17:30:05.718383] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-24T17:30:05.746428] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:30:05.770277] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:30:05.779991] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:30:05.801843] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-24T17:30:05.828267] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-24T17:30:05.852166] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-09-24T17:30:05.924727] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-09-24T17:30:05.936069] [INFO ] [MAIN ] Update Progress: 230/2373 symbols completed. BCAT took 28.0s. Estimated remaining: 4h 39m 52s. Rate: 7.7 symbols/min [2025-09-24T17:30:06.148066] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-24T17:30:06.148407] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-24T17:30:06.198683] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-24T17:30:06.207382] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-24T17:30:06.230279] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:06.266298] [DEBUG] [LOCAL ] BC: Trimmed 63780 records to 44422 (keeping 200 days of data) [2025-09-24T17:30:06.285287] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-24T17:30:06.287325] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T17:30:06.371237] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-24T17:30:06.416719] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-24T17:30:06.475927] [DEBUG] [LOCAL ] BCE: Loaded 52350 existing records from primary storage. [2025-09-24T17:30:06.476697] [INFO ] [MAIN ] BCE: Loaded 52350 existing records. [2025-09-24T17:30:06.759778] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:30:06.761130] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-24T17:30:06.761432] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-24T17:30:06.763157] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-24T17:30:06.763228] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-24T17:30:07.156166] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:07.192470] [DEBUG] [LOCAL ] BC: Primary data saved (44422 records). [2025-09-24T17:30:07.192620] [INFO ] [MAIN ] BC: Full history saved. [2025-09-24T17:30:07.193922] [INFO ] [MAIN ] Update Progress: 231/2373 symbols completed. BC took 30.7s. Estimated remaining: 4h 38m 43s. Rate: 7.7 symbols/min [2025-09-24T17:30:07.224798] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-24T17:30:07.379062] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:07.413908] [DEBUG] [LOCAL ] BCH: Loaded 29617 existing records from primary storage. [2025-09-24T17:30:07.414123] [INFO ] [MAIN ] BCH: Loaded 29617 existing records. [2025-09-24T17:30:07.642848] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:30:07.644161] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T17:30:07.649670] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-24T17:30:07.650268] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-24T17:30:07.651634] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-24T17:30:07.651982] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-24T17:30:08.021306] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-24T17:30:08.096020] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:08.296809] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T17:30:08.816093] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-24T17:30:08.929370] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T17:30:09.432356] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T17:30:09.616183] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-24T17:30:10.417814] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-24T17:30:10.421463] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T17:30:10.433017] [INFO ] [REMOTE ] BBY: Full fetch complete (77251 records). [2025-09-24T17:30:10.433253] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-24T17:30:10.854006] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-24T17:30:10.854262] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-24T17:30:10.855364] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-24T17:30:10.855464] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-24T17:30:10.879397] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T17:30:10.886404] [DEBUG] [LOCAL ] BBY: Trimmed 77251 records to 53480 (keeping 200 days of data) [2025-09-24T17:30:11.216119] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-24T17:30:11.244355] [DEBUG] [LOCAL ] BBY: Primary data saved (53480 records). [2025-09-24T17:30:11.244556] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-24T17:30:11.244686] [INFO ] [MAIN ] Update Progress: 232/2373 symbols completed. BBY took 41.8s. Estimated remaining: 4h 38m 1s. Rate: 7.7 symbols/min [2025-09-24T17:30:11.447543] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:11.447857] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-09-24T17:30:11.447911] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-09-24T17:30:11.448028] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-24T17:30:11.448068] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-24T17:30:11.448109] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-24T17:30:11.448143] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-24T17:30:11.845837] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:11.873264] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T17:30:12.016049] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-24T17:30:12.335167] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T17:30:12.816100] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-24T17:30:13.616100] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-24T17:30:13.754412] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T17:30:13.761356] [INFO ] [REMOTE ] BCC: Full fetch complete (40313 records). [2025-09-24T17:30:13.761540] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-24T17:30:14.143995] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-24T17:30:14.144098] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-24T17:30:14.144689] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-24T17:30:14.144754] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-24T17:30:14.145616] [DEBUG] [LOCAL ] BCC: Trimmed 40313 records to 28355 (keeping 200 days of data) [2025-09-24T17:30:14.317199] [DEBUG] [LOCAL ] BCC: Primary data saved (28355 records). [2025-09-24T17:30:14.317339] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-24T17:30:14.317430] [INFO ] [MAIN ] Update Progress: 233/2373 symbols completed. BCC took 25.1s. Estimated remaining: 4h 37m 10s. Rate: 7.7 symbols/min [2025-09-24T17:30:14.421245] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-24T17:30:14.494575] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:14.495119] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-24T17:30:14.495180] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-24T17:30:14.495335] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-24T17:30:14.495380] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-24T17:30:14.495423] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-24T17:30:14.495457] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-24T17:30:14.867056] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:15.216096] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-24T17:30:15.329444] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-24T17:30:15.383595] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T17:30:16.016053] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-24T17:30:16.178532] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T17:30:16.816064] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-24T17:30:17.144803] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:30:17.358319] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T17:30:17.616157] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-24T17:30:17.965963] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T17:30:18.416084] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-24T17:30:19.216115] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-24T17:30:19.254728] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T17:30:19.438730] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T17:30:20.016078] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-24T17:30:20.816060] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-24T17:30:21.232511] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-24T17:30:21.259871] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T17:30:21.616162] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-24T17:30:22.416144] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-24T17:30:22.589635] [DEBUG] [REMOTE ] BCS: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-24T17:30:22.590237] [WARN ] [REMOTE ] BCS: No data returned for month 2025-02 [2025-09-24T17:30:22.630326] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:30:23.019986] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T17:30:23.216071] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-24T17:30:24.016228] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-24T17:30:24.816108] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-24T17:30:24.948183] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:30:25.616097] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-24T17:30:26.228510] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-24T17:30:26.416079] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-24T17:30:27.048285] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T17:30:27.216078] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-24T17:30:27.381581] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-24T17:30:27.461425] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T17:30:28.016057] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-24T17:30:28.358398] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T17:30:28.816085] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-24T17:30:29.616084] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-24T17:30:29.764517] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:30:30.416088] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-24T17:30:30.467587] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T17:30:30.715721] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:30:31.216107] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-24T17:30:32.016074] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-24T17:30:32.600604] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T17:30:32.649978] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-24T17:30:32.816082] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-24T17:30:33.139678] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T17:30:33.616132] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-24T17:30:34.416093] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-24T17:30:34.481102] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T17:30:34.619870] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T17:30:35.216132] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-24T17:30:35.625690] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T17:30:36.016100] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-24T17:30:36.816133] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-24T17:30:37.018902] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:30:37.616091] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-24T17:30:38.031471] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T17:30:38.078971] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T17:30:38.086967] [INFO ] [REMOTE ] BCH: Full fetch complete (40658 records). [2025-09-24T17:30:38.087264] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-24T17:30:38.088497] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:30:38.088634] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:30:38.088735] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:30:38.088793] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-24T17:30:38.088874] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-24T17:30:38.088923] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-24T17:30:38.089490] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-09-24T17:30:38.089625] [INFO ] [MAIN ] Update Progress: 234/2373 symbols completed. BCH took 30.9s. Estimated remaining: 4h 39m 28s. Rate: 7.7 symbols/min [2025-09-24T17:30:38.344634] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:38.389372] [DEBUG] [LOCAL ] BCSF: Loaded 27779 existing records from primary storage. [2025-09-24T17:30:38.389542] [INFO ] [MAIN ] BCSF: Loaded 27779 existing records. [2025-09-24T17:30:38.421341] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-24T17:30:38.675681] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:30:38.676031] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-24T17:30:38.676098] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-24T17:30:38.677233] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-24T17:30:38.677325] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-24T17:30:39.208735] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:39.216078] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-24T17:30:39.427725] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T17:30:39.433045] [INFO ] [REMOTE ] BCO: Full fetch complete (36772 records). [2025-09-24T17:30:39.433169] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-24T17:30:39.762190] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T17:30:39.919696] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-24T17:30:39.919783] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-24T17:30:39.920297] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-24T17:30:39.920349] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-24T17:30:39.921192] [DEBUG] [LOCAL ] BCO: Trimmed 36772 records to 26443 (keeping 200 days of data) [2025-09-24T17:30:40.016044] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-24T17:30:40.086090] [DEBUG] [LOCAL ] BCO: Primary data saved (26443 records). [2025-09-24T17:30:40.086243] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-24T17:30:40.086319] [INFO ] [MAIN ] Update Progress: 235/2373 symbols completed. BCO took 28.8s. Estimated remaining: 4h 38m 27s. Rate: 7.7 symbols/min [2025-09-24T17:30:40.260164] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:40.283181] [DEBUG] [LOCAL ] BCX: Loaded 21721 existing records from primary storage. [2025-09-24T17:30:40.283354] [INFO ] [MAIN ] BCX: Loaded 21721 existing records. [2025-09-24T17:30:40.469786] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:30:40.475296] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-24T17:30:40.483496] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-24T17:30:40.484973] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-24T17:30:40.484902] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T17:30:40.491045] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-24T17:30:40.821677] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-24T17:30:40.852301] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:41.616058] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-24T17:30:41.893074] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T17:30:42.416102] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-24T17:30:42.563771] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T17:30:43.038819] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T17:30:43.216135] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-24T17:30:44.016056] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-24T17:30:44.086203] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T17:30:44.099418] [INFO ] [REMOTE ] BCE: Full fetch complete (76141 records). [2025-09-24T17:30:44.099750] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-24T17:30:44.477582] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T17:30:44.599686] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-24T17:30:44.599803] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-24T17:30:44.600901] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-24T17:30:44.600980] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-24T17:30:44.602857] [DEBUG] [LOCAL ] BCE: Trimmed 76141 records to 52340 (keeping 200 days of data) [2025-09-24T17:30:44.826080] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-24T17:30:44.946271] [DEBUG] [LOCAL ] BCE: Primary data saved (52340 records). [2025-09-24T17:30:44.946475] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-24T17:30:44.946617] [INFO ] [MAIN ] Update Progress: 236/2373 symbols completed. BCE took 39.0s. Estimated remaining: 4h 37m 53s. Rate: 7.7 symbols/min [2025-09-24T17:30:45.142219] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:30:45.167986] [DEBUG] [LOCAL ] BDC: Loaded 24877 existing records from primary storage. [2025-09-24T17:30:45.168129] [INFO ] [MAIN ] BDC: Loaded 24877 existing records. [2025-09-24T17:30:45.348176] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:30:45.348463] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-24T17:30:45.348516] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-24T17:30:45.349210] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-24T17:30:45.349277] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-24T17:30:45.626799] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-24T17:30:45.728895] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:30:45.825795] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T17:30:45.912981] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T17:30:45.923089] [INFO ] [REMOTE ] BCS: Full fetch complete (69915 records). [2025-09-24T17:30:45.923292] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-24T17:30:46.131608] [WARN ] [VALIDATOR ] BCS: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-24T17:30:46.132414] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:30:46.132497] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:30:46.132586] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-24T17:30:46.132697] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-24T17:30:46.132755] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-24T17:30:46.132819] [DEBUG] [LOCAL ] BCS: No derivative data file found to delete. [2025-09-24T17:30:46.132921] [INFO ] [MAIN ] Update Progress: 237/2373 symbols completed. BCS took 31.8s. Estimated remaining: 4h 36m 45s. Rate: 7.7 symbols/min [2025-09-24T17:30:46.416132] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-24T17:30:46.784910] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T17:30:47.216061] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-24T17:30:47.565712] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T17:30:48.016093] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-24T17:30:48.586391] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:30:48.816122] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-24T17:30:49.296433] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T17:30:49.616133] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-24T17:30:49.958217] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T17:30:50.416111] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-24T17:30:50.795104] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T17:30:51.216125] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-24T17:30:51.510952] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T17:30:52.016094] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-24T17:30:52.680981] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T17:30:52.816114] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-24T17:30:53.034885] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T17:30:53.616132] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-24T17:30:53.842811] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T17:30:54.416043] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-24T17:30:54.565456] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T17:30:55.216078] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-24T17:30:55.398862] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T17:30:56.016098] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-24T17:30:56.225999] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T17:30:56.816129] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-24T17:30:57.041200] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T17:30:57.616081] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-24T17:30:57.662718] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T17:30:58.416057] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-24T17:30:58.782332] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T17:30:59.216053] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-24T17:30:59.456287] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T17:31:00.016134] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-24T17:31:00.603202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T17:31:00.816119] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-24T17:31:01.180076] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T17:31:01.184326] [INFO ] [REMOTE ] BCX: Full fetch complete (33901 records). [2025-09-24T17:31:01.184423] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-24T17:31:01.578868] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-24T17:31:01.578954] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-24T17:31:01.579495] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-24T17:31:01.579560] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-24T17:31:01.580549] [DEBUG] [LOCAL ] BCX: Trimmed 33901 records to 21656 (keeping 200 days of data) [2025-09-24T17:31:01.635372] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-24T17:31:01.719613] [DEBUG] [LOCAL ] BCX: Primary data saved (21656 records). [2025-09-24T17:31:01.719781] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-24T17:31:01.719872] [INFO ] [MAIN ] Update Progress: 238/2373 symbols completed. BCX took 21.6s. Estimated remaining: 4h 37m 48s. Rate: 7.7 symbols/min [2025-09-24T17:31:01.846870] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T17:31:02.416086] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-24T17:31:02.933206] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T17:31:03.216084] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-24T17:31:03.417387] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T17:31:04.016143] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-24T17:31:04.565096] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T17:31:04.816095] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-24T17:31:05.356314] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T17:31:05.361885] [INFO ] [REMOTE ] BCSF: Full fetch complete (38071 records). [2025-09-24T17:31:05.361986] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-24T17:31:05.791970] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-24T17:31:05.792188] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-24T17:31:05.792870] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-24T17:31:05.792938] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-24T17:31:05.794150] [DEBUG] [LOCAL ] BCSF: Trimmed 38071 records to 27844 (keeping 200 days of data) [2025-09-24T17:31:05.944377] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T17:31:05.979095] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-24T17:31:06.009618] [DEBUG] [LOCAL ] BCSF: Primary data saved (27844 records). [2025-09-24T17:31:06.009853] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-24T17:31:06.011126] [INFO ] [MAIN ] Update Progress: 239/2373 symbols completed. BCSF took 27.9s. Estimated remaining: 4h 37m 9s. Rate: 7.7 symbols/min [2025-09-24T17:31:07.250516] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T17:31:07.255000] [INFO ] [REMOTE ] BDC: Full fetch complete (35731 records). [2025-09-24T17:31:07.255091] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-24T17:31:07.679825] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-24T17:31:07.679954] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-24T17:31:07.680465] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-24T17:31:07.680511] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-24T17:31:07.681601] [DEBUG] [LOCAL ] BDC: Trimmed 35731 records to 24794 (keeping 200 days of data) [2025-09-24T17:31:07.850676] [DEBUG] [LOCAL ] BDC: Primary data saved (24794 records). [2025-09-24T17:31:07.850816] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-24T17:31:07.850903] [INFO ] [MAIN ] Update Progress: 240/2373 symbols completed. BDC took 22.9s. Estimated remaining: 4h 36m 8s. Rate: 7.7 symbols/min [2025-09-24T17:31:08.520968] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:08.557892] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-09-24T17:31:08.542309] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:08.555188] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:08.562549] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-09-24T17:31:08.578301] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-24T17:31:08.582467] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:08.582619] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-24T17:31:08.582931] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-24T17:31:08.583250] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-24T17:31:08.895702] [DEBUG] [LOCAL ] BDJ: Loaded 28925 existing records from primary storage. [2025-09-24T17:31:08.932665] [INFO ] [MAIN ] BDJ: Loaded 28925 existing records. [2025-09-24T17:31:09.023094] [DEBUG] [LOCAL ] BDN: Loaded 47615 existing records from primary storage. [2025-09-24T17:31:09.044017] [INFO ] [MAIN ] BDN: Loaded 47615 existing records. [2025-09-24T17:31:09.233413] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:09.262227] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-24T17:31:09.244236] [DEBUG] [LOCAL ] BDX: Loaded 52492 existing records from primary storage. [2025-09-24T17:31:09.328089] [INFO ] [MAIN ] BDX: Loaded 52492 existing records. [2025-09-24T17:31:09.359699] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:09.515116] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:09.515218] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-24T17:31:09.515431] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-24T17:31:09.540491] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-24T17:31:09.540436] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-24T17:31:09.544922] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-24T17:31:09.544802] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-24T17:31:09.603470] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-24T17:31:09.629434] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-24T17:31:09.836609] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:09.914920] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-24T17:31:09.940864] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-24T17:31:10.021264] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-24T17:31:10.058321] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-24T17:31:10.405128] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:10.421904] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-24T17:31:10.523951] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:10.540575] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-24T17:31:10.827523] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:10.827946] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-24T17:31:11.531428] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-24T17:31:11.544227] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-24T17:31:11.906401] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T17:31:11.913319] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-24T17:31:12.375409] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T17:31:12.387838] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-24T17:31:12.422187] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T17:31:12.433325] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-24T17:31:12.772738] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T17:31:12.816137] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-24T17:31:13.643792] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T17:31:13.655261] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-24T17:31:14.119565] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T17:31:14.233364] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T17:31:14.380010] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T17:31:14.416031] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-24T17:31:15.216107] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-24T17:31:15.600389] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T17:31:16.016062] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-24T17:31:16.078751] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T17:31:16.515762] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T17:31:16.816108] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-24T17:31:17.616112] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-24T17:31:17.827610] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:31:18.390366] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T17:31:18.416078] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-24T17:31:19.065242] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T17:31:19.216086] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-24T17:31:20.016127] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-24T17:31:20.289827] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T17:31:20.347525] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T17:31:20.816161] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-24T17:31:21.247741] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T17:31:21.616093] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-24T17:31:22.416084] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-24T17:31:22.690143] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T17:31:22.875954] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T17:31:23.216129] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-24T17:31:24.016077] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-24T17:31:24.181796] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T17:31:24.816137] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-24T17:31:25.382622] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-24T17:31:25.410606] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T17:31:25.616114] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-24T17:31:26.416041] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-24T17:31:26.683872] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T17:31:27.192129] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T17:31:27.216031] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-24T17:31:27.384228] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T17:31:28.016081] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-24T17:31:28.557364] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T17:31:28.816093] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-24T17:31:29.616078] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-24T17:31:29.664861] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T17:31:30.237279] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T17:31:30.416099] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-24T17:31:31.216747] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-24T17:31:31.587943] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T17:31:32.016224] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-24T17:31:32.281027] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T17:31:32.286710] [INFO ] [REMOTE ] BDJ: Full fetch complete (42524 records). [2025-09-24T17:31:32.286906] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-24T17:31:32.287757] [FATAL] [VALIDATOR ] BDJ: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:31:32.287878] [FATAL] [MAIN ] BDJ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:31:32.287937] [WARN ] [MAIN ] BDJ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:31:32.288002] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-24T17:31:32.288089] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-24T17:31:32.288148] [INFO ] [LOCAL ] BDJ: Starting deletion of derivative data. [2025-09-24T17:31:32.288618] [DEBUG] [LOCAL ] BDJ: Deleted derivative data file. [2025-09-24T17:31:32.288765] [INFO ] [MAIN ] Update Progress: 241/2373 symbols completed. BDJ took 24.4s. Estimated remaining: 4h 38m 28s. Rate: 7.7 symbols/min [2025-09-24T17:31:32.497561] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-24T17:31:32.501750] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:32.502026] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-24T17:31:32.502099] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-24T17:31:32.514100] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-24T17:31:32.514170] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-24T17:31:32.514220] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-24T17:31:32.514273] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-24T17:31:32.821187] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-24T17:31:32.902567] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:33.616098] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-24T17:31:34.416059] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-24T17:31:34.520322] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-24T17:31:34.877953] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T17:31:34.950681] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T17:31:35.216128] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-24T17:31:35.338868] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T17:31:36.016137] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-24T17:31:36.330629] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-24T17:31:36.816049] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-24T17:31:37.099400] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T17:31:37.108523] [INFO ] [REMOTE ] BDX: Full fetch complete (75534 records). [2025-09-24T17:31:37.108739] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-24T17:31:37.110340] [FATAL] [VALIDATOR ] BDX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:31:37.110439] [FATAL] [MAIN ] BDX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:31:37.110485] [WARN ] [MAIN ] BDX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:31:37.110807] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-24T17:31:37.110951] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-09-24T17:31:37.111037] [INFO ] [LOCAL ] BDX: Starting deletion of derivative data. [2025-09-24T17:31:37.111595] [DEBUG] [LOCAL ] BDX: Deleted derivative data file. [2025-09-24T17:31:37.112226] [INFO ] [MAIN ] Update Progress: 242/2373 symbols completed. BDX took 29.3s. Estimated remaining: 4h 37m 53s. Rate: 7.7 symbols/min [2025-09-24T17:31:37.308634] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:37.379395] [DEBUG] [LOCAL ] BEKE: Loaded 53257 existing records from primary storage. [2025-09-24T17:31:37.379565] [INFO ] [MAIN ] BEKE: Loaded 53257 existing records. [2025-09-24T17:31:37.566203] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:37.566662] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-24T17:31:37.566744] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-24T17:31:37.568186] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-24T17:31:37.568250] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-24T17:31:37.623815] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-24T17:31:37.964233] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:38.416130] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-24T17:31:38.453449] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T17:31:39.216155] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-24T17:31:39.542094] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-24T17:31:39.761758] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T17:31:40.016090] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-24T17:31:40.453824] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-24T17:31:40.816166] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-24T17:31:41.450810] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T17:31:41.459135] [INFO ] [REMOTE ] BDN: Full fetch complete (68932 records). [2025-09-24T17:31:41.459347] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-24T17:31:41.460241] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:31:41.460347] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:31:41.460403] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:31:41.460480] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-24T17:31:41.460568] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-24T17:31:41.460626] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-09-24T17:31:41.461241] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-09-24T17:31:41.461408] [INFO ] [MAIN ] Update Progress: 243/2373 symbols completed. BDN took 33.6s. Estimated remaining: 4h 37m 15s. Rate: 7.7 symbols/min [2025-09-24T17:31:41.622240] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-24T17:31:41.653939] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:41.720020] [DEBUG] [LOCAL ] BEN: Loaded 53062 existing records from primary storage. [2025-09-24T17:31:41.720217] [INFO ] [MAIN ] BEN: Loaded 53062 existing records. [2025-09-24T17:31:41.921886] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:41.922173] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-24T17:31:41.922224] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-24T17:31:41.924847] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-24T17:31:41.924926] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-24T17:31:42.311041] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:42.416030] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-24T17:31:43.045004] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-24T17:31:43.058707] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-24T17:31:43.058922] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-24T17:31:43.223247] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-24T17:31:43.573246] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-24T17:31:43.576600] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-24T17:31:43.577676] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-24T17:31:43.577823] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-24T17:31:43.582482] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T17:31:43.600522] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53653 (keeping 200 days of data) [2025-09-24T17:31:43.673261] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T17:31:43.978759] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T17:31:44.009987] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-24T17:31:44.010162] [INFO ] [MAIN ] BE: Full history saved. [2025-09-24T17:31:44.010307] [INFO ] [MAIN ] Update Progress: 244/2373 symbols completed. BE took 36.1s. Estimated remaining: 4h 36m 21s. Rate: 7.7 symbols/min [2025-09-24T17:31:44.016097] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-24T17:31:44.188531] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:31:44.231721] [DEBUG] [LOCAL ] BEP: Loaded 38607 existing records from primary storage. [2025-09-24T17:31:44.231881] [INFO ] [MAIN ] BEP: Loaded 38607 existing records. [2025-09-24T17:31:44.428403] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:31:44.428687] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-24T17:31:44.428760] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-24T17:31:44.430111] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-24T17:31:44.430185] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-24T17:31:44.821551] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-24T17:31:44.915287] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:31:45.355331] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-24T17:31:45.608275] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T17:31:45.619091] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-24T17:31:46.001349] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-24T17:31:46.416101] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-24T17:31:46.754998] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T17:31:47.216202] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-24T17:31:48.016093] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-24T17:31:48.785302] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T17:31:48.816038] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-24T17:31:49.616059] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-24T17:31:49.698440] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T17:31:50.077936] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:31:50.416099] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-24T17:31:51.216107] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-24T17:31:51.791022] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-24T17:31:51.956842] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T17:31:52.016052] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-24T17:31:52.816114] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-24T17:31:52.948749] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:31:53.123667] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-24T17:31:53.605141] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T17:31:53.618190] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-24T17:31:54.416112] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-24T17:31:55.216063] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-24T17:31:55.539287] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T17:31:56.016056] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-24T17:31:56.065333] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T17:31:56.306989] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T17:31:56.816086] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-24T17:31:57.616056] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-24T17:31:57.817512] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:31:58.159355] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T17:31:58.184702] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T17:31:58.416093] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-24T17:31:59.216119] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-24T17:32:00.016130] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-24T17:32:00.214249] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:32:00.816146] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-24T17:32:01.389730] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-24T17:32:01.616111] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-24T17:32:02.199403] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T17:32:02.391015] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-24T17:32:02.416072] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-24T17:32:03.216126] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-24T17:32:03.410670] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T17:32:03.669998] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T17:32:03.670891] [INFO ] [REMOTE ] BEDU: Full fetch complete (1401 records). [2025-09-24T17:32:03.670966] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-24T17:32:03.892585] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-24T17:32:03.892800] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:32:03.892872] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:32:03.892946] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-24T17:32:03.893013] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-24T17:32:03.893129] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-24T17:32:03.893208] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-24T17:32:03.893292] [INFO ] [MAIN ] Update Progress: 245/2373 symbols completed. BEDU took 31.6s. Estimated remaining: 4h 37m 58s. Rate: 7.7 symbols/min [2025-09-24T17:32:04.020703] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-24T17:32:04.099132] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:04.179634] [DEBUG] [LOCAL ] BEPC: Loaded 46516 existing records from primary storage. [2025-09-24T17:32:04.179831] [INFO ] [MAIN ] BEPC: Loaded 46516 existing records. [2025-09-24T17:32:04.355146] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T17:32:04.444350] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:04.444664] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-24T17:32:04.444748] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-24T17:32:04.446083] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-24T17:32:04.446150] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-24T17:32:04.821617] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-24T17:32:04.841803] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:05.425544] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T17:32:05.616109] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-24T17:32:06.416057] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-24T17:32:06.686114] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T17:32:07.155489] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T17:32:07.216037] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-24T17:32:08.016093] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-24T17:32:08.304195] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:32:08.816127] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-24T17:32:08.869699] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:32:09.127343] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T17:32:09.133884] [INFO ] [REMOTE ] BEP: Full fetch complete (58000 records). [2025-09-24T17:32:09.134011] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-24T17:32:09.135031] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:32:09.135159] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:32:09.135209] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:32:09.135293] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-24T17:32:09.135610] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-24T17:32:09.135719] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-09-24T17:32:09.136638] [DEBUG] [LOCAL ] BEP: Deleted derivative data file. [2025-09-24T17:32:09.136806] [INFO ] [MAIN ] Update Progress: 246/2373 symbols completed. BEP took 25.1s. Estimated remaining: 4h 37m 28s. Rate: 7.7 symbols/min [2025-09-24T17:32:09.317865] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:09.325085] [DEBUG] [LOCAL ] BEPH: Loaded 5122 existing records from primary storage. [2025-09-24T17:32:09.325277] [INFO ] [MAIN ] BEPH: Loaded 5122 existing records. [2025-09-24T17:32:09.514289] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:09.514594] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-24T17:32:09.514689] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-24T17:32:09.515151] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-24T17:32:09.515214] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-24T17:32:09.621305] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-24T17:32:09.893386] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:10.416141] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-24T17:32:10.485798] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:32:10.968735] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T17:32:11.216100] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-24T17:32:12.016069] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-24T17:32:12.029494] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T17:32:12.213669] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T17:32:12.816093] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-24T17:32:13.625064] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-24T17:32:13.655049] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T17:32:13.667109] [INFO ] [REMOTE ] BEN: Full fetch complete (76883 records). [2025-09-24T17:32:13.667322] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-24T17:32:14.062510] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-24T17:32:14.062606] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-24T17:32:14.063421] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-24T17:32:14.063488] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-24T17:32:14.064994] [DEBUG] [LOCAL ] BEN: Trimmed 76883 records to 53059 (keeping 200 days of data) [2025-09-24T17:32:14.286071] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T17:32:14.406049] [DEBUG] [LOCAL ] BEN: Primary data saved (53059 records). [2025-09-24T17:32:14.406231] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-24T17:32:14.406340] [INFO ] [MAIN ] Update Progress: 247/2373 symbols completed. BEN took 32.9s. Estimated remaining: 4h 36m 58s. Rate: 7.7 symbols/min [2025-09-24T17:32:14.421185] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-24T17:32:14.588964] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:14.589153] [DEBUG] [LOCAL ] BEPI: No existing data file found in primary storage. [2025-09-24T17:32:14.589277] [WARN ] [MAIN ] BEPI: No existing data found, performing full refresh instead. [2025-09-24T17:32:14.589822] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-24T17:32:14.589896] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-24T17:32:14.590169] [DEBUG] [LOCAL ] BEPI: No primary data file found to delete. [2025-09-24T17:32:14.590290] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-24T17:32:14.794453] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T17:32:14.910813] [INFO ] [REMOTE ] BEKE: Full fetch complete (76816 records). [2025-09-24T17:32:14.913567] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-24T17:32:14.925384] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:32:14.940880] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:32:14.955142] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:32:14.955253] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-24T17:32:14.960497] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-09-24T17:32:14.966395] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-09-24T17:32:14.995251] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-09-24T17:32:14.999440] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:15.000180] [INFO ] [MAIN ] Update Progress: 248/2373 symbols completed. BEKE took 37.9s. Estimated remaining: 4h 35m 49s. Rate: 7.7 symbols/min [2025-09-24T17:32:15.170043] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T17:32:15.205456] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:15.216113] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-24T17:32:15.223621] [DEBUG] [LOCAL ] BEPJ: Loaded 3259 existing records from primary storage. [2025-09-24T17:32:15.223778] [INFO ] [MAIN ] BEPJ: Loaded 3259 existing records. [2025-09-24T17:32:15.409992] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:15.410251] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-24T17:32:15.410300] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-24T17:32:15.410823] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-24T17:32:15.410884] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-24T17:32:15.777952] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:15.988192] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T17:32:16.016119] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-24T17:32:16.558918] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T17:32:16.816081] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-24T17:32:17.430434] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T17:32:17.616108] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-24T17:32:18.106574] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T17:32:18.416110] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-24T17:32:18.892368] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T17:32:19.216158] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-24T17:32:19.769490] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T17:32:20.016132] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-24T17:32:20.816084] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-24T17:32:21.616068] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-24T17:32:21.619761] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-24T17:32:21.893792] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T17:32:22.061680] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T17:32:22.416086] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-24T17:32:23.014929] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T17:32:23.216145] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-24T17:32:23.869955] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T17:32:24.016121] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-24T17:32:24.520805] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T17:32:24.816087] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-24T17:32:25.428927] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T17:32:25.616093] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-24T17:32:26.057686] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T17:32:26.416084] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-24T17:32:27.216106] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-24T17:32:27.730873] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T17:32:28.016102] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-24T17:32:28.071470] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T17:32:28.816103] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-24T17:32:29.479998] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T17:32:29.537950] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T17:32:29.616084] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-24T17:32:30.129058] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-24T17:32:30.416132] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-24T17:32:30.976522] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T17:32:31.216138] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-24T17:32:31.609689] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-24T17:32:32.016102] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-24T17:32:32.616012] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T17:32:32.816251] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-24T17:32:33.616097] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-24T17:32:34.180195] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T17:32:34.416058] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-24T17:32:34.534820] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T17:32:35.170116] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T17:32:35.216091] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-24T17:32:36.016087] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-24T17:32:36.702507] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T17:32:36.816041] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-24T17:32:36.860575] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T17:32:37.281986] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T17:32:37.616096] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-24T17:32:38.416086] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-24T17:32:39.117541] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T17:32:39.151112] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T17:32:39.216123] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-24T17:32:39.915085] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T17:32:39.916125] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4494 records). [2025-09-24T17:32:39.916210] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-24T17:32:40.017933] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-24T17:32:40.299248] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-24T17:32:40.299343] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-24T17:32:40.299554] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-24T17:32:40.299617] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-24T17:32:40.300069] [DEBUG] [LOCAL ] BEPJ: Trimmed 4494 records to 3247 (keeping 200 days of data) [2025-09-24T17:32:40.320911] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3247 records). [2025-09-24T17:32:40.321045] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-24T17:32:40.321136] [INFO ] [MAIN ] Update Progress: 249/2373 symbols completed. BEPJ took 25.3s. Estimated remaining: 4h 38m 10s. Rate: 7.6 symbols/min [2025-09-24T17:32:40.500771] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:40.539388] [DEBUG] [LOCAL ] BFAM: Loaded 33044 existing records from primary storage. [2025-09-24T17:32:40.539572] [INFO ] [MAIN ] BFAM: Loaded 33044 existing records. [2025-09-24T17:32:40.748974] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:40.749271] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-24T17:32:40.749329] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-24T17:32:40.750353] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-24T17:32:40.750416] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-24T17:32:40.822767] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-24T17:32:41.124311] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:41.616094] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-24T17:32:41.651668] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T17:32:41.653130] [INFO ] [REMOTE ] BEPH: Full fetch complete (7503 records). [2025-09-24T17:32:41.653375] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-24T17:32:41.755698] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T17:32:41.792667] [INFO ] [REMOTE ] BEPC: Full fetch complete (68081 records). [2025-09-24T17:32:41.803394] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-24T17:32:41.853907] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:32:41.914477] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:32:41.963123] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:32:41.973878] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-24T17:32:41.984249] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-24T17:32:41.984311] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-09-24T17:32:42.005810] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-09-24T17:32:42.023928] [INFO ] [MAIN ] Update Progress: 250/2373 symbols completed. BEPC took 38.1s. Estimated remaining: 4h 37m 10s. Rate: 7.7 symbols/min [2025-09-24T17:32:42.150316] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-24T17:32:42.169864] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-24T17:32:42.172806] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-24T17:32:42.172913] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-24T17:32:42.194829] [DEBUG] [LOCAL ] BEPH: Trimmed 7503 records to 5099 (keeping 200 days of data) [2025-09-24T17:32:42.264735] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:42.279521] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T17:32:42.282908] [INFO ] [REMOTE ] BEPI: Full fetch complete (4957 records). [2025-09-24T17:32:42.283245] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-24T17:32:42.419502] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-24T17:32:42.439620] [DEBUG] [LOCAL ] BEPH: Primary data saved (5099 records). [2025-09-24T17:32:42.464916] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-24T17:32:42.499988] [INFO ] [MAIN ] Update Progress: 251/2373 symbols completed. BEPH took 33.4s. Estimated remaining: 4h 36m 0s. Rate: 7.7 symbols/min [2025-09-24T17:32:42.746548] [DEBUG] [LOCAL ] BFH: Loaded 41829 existing records from primary storage. [2025-09-24T17:32:42.746817] [INFO ] [MAIN ] BFH: Loaded 41829 existing records. [2025-09-24T17:32:42.984897] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:42.936261] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-24T17:32:42.990234] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-24T17:32:43.009198] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-24T17:32:43.012791] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-09-24T17:32:43.012903] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-24T17:32:43.013127] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-09-24T17:32:43.024828] [DEBUG] [LOCAL ] BEPI: Trimmed 4957 records to 3425 (keeping 200 days of data) [2025-09-24T17:32:43.073931] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-24T17:32:43.075825] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-24T17:32:43.089683] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-09-24T17:32:43.113817] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-24T17:32:43.114244] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:43.127489] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-24T17:32:43.128130] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-24T17:32:43.155858] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-24T17:32:43.162514] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-24T17:32:43.274609] [DEBUG] [LOCAL ] BEPI: Primary data saved (3425 records). [2025-09-24T17:32:43.274790] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-24T17:32:43.334336] [INFO ] [MAIN ] Update Progress: 252/2373 symbols completed. BEPI took 28.9s. Estimated remaining: 4h 34m 54s. Rate: 7.7 symbols/min [2025-09-24T17:32:43.919427] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:32:44.097266] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:44.097776] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-24T17:32:44.104702] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:44.105492] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-24T17:32:44.130892] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T17:32:44.179502] [DEBUG] [LOCAL ] BFLY: Loaded 51830 existing records from primary storage. [2025-09-24T17:32:44.179705] [INFO ] [MAIN ] BFLY: Loaded 51830 existing records. [2025-09-24T17:32:44.360873] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:32:44.361205] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-24T17:32:44.361264] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-24T17:32:44.362584] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-24T17:32:44.362671] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-24T17:32:44.747759] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:32:44.816049] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-24T17:32:45.134075] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T17:32:45.616070] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-24T17:32:45.681983] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:32:46.416074] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-24T17:32:46.622483] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T17:32:46.653698] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T17:32:47.216078] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-24T17:32:47.599673] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T17:32:48.016112] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-24T17:32:48.032778] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T17:32:48.816079] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-24T17:32:49.466184] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T17:32:49.616089] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-24T17:32:50.416065] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-24T17:32:50.727123] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T17:32:50.755363] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T17:32:51.216128] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-24T17:32:51.341896] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T17:32:52.016148] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-24T17:32:52.704678] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T17:32:52.816081] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-24T17:32:53.314540] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T17:32:53.616176] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-24T17:32:54.416087] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-24T17:32:54.577086] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T17:32:54.612917] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T17:32:55.216076] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-24T17:32:55.853567] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T17:32:56.016084] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-24T17:32:56.816103] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-24T17:32:56.953869] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:32:57.345475] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T17:32:57.616105] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-24T17:32:58.291964] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T17:32:58.416118] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-24T17:32:58.659682] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T17:32:59.216123] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-24T17:32:59.854748] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:33:00.016129] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-24T17:33:00.569485] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T17:33:00.816085] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-24T17:33:01.616114] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-24T17:33:02.162080] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-24T17:33:02.416122] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-24T17:33:02.468785] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T17:33:03.216118] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-24T17:33:04.016112] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-24T17:33:04.650609] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-24T17:33:04.756458] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:33:04.793901] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (3.18 seconds). [2025-09-24T17:33:04.816037] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-24T17:33:05.616096] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-24T17:33:05.902189] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T17:33:06.069313] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T17:33:06.416092] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-24T17:33:06.805863] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T17:33:07.216072] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-24T17:33:08.009496] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T17:33:08.017619] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-24T17:33:08.601203] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T17:33:08.609261] [INFO ] [REMOTE ] BFAM: Full fetch complete (47069 records). [2025-09-24T17:33:08.609436] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-24T17:33:08.821714] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-24T17:33:09.064455] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T17:33:09.064800] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-24T17:33:09.067700] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-24T17:33:09.069585] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-24T17:33:09.069698] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-24T17:33:09.071407] [DEBUG] [LOCAL ] BFAM: Trimmed 47069 records to 33023 (keeping 200 days of data) [2025-09-24T17:33:09.288458] [DEBUG] [LOCAL ] BFAM: Primary data saved (33023 records). [2025-09-24T17:33:09.288633] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-24T17:33:09.289504] [INFO ] [MAIN ] Update Progress: 253/2373 symbols completed. BFAM took 29.0s. Estimated remaining: 4h 37m 18s. Rate: 7.6 symbols/min [2025-09-24T17:33:09.465984] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:09.478088] [DEBUG] [LOCAL ] BFS: Loaded 9015 existing records from primary storage. [2025-09-24T17:33:09.478222] [INFO ] [MAIN ] BFS: Loaded 9015 existing records. [2025-09-24T17:33:09.627000] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-24T17:33:09.668915] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:09.669366] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-24T17:33:09.669420] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-24T17:33:09.669879] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-24T17:33:09.669941] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-24T17:33:10.055561] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:10.416161] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-24T17:33:10.962497] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T17:33:10.990327] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T17:33:11.199856] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T17:33:11.216029] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-24T17:33:12.016096] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-24T17:33:12.671286] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T17:33:12.695048] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T17:33:12.816091] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-24T17:33:13.616067] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-24T17:33:13.650234] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T17:33:14.416088] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-24T17:33:15.216063] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-24T17:33:15.280915] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T17:33:15.286271] [INFO ] [REMOTE ] BFK: Full fetch complete (19326 records). [2025-09-24T17:33:15.286881] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-24T17:33:15.888336] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-24T17:33:15.888492] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-24T17:33:15.889185] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-24T17:33:15.889259] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-24T17:33:15.890487] [DEBUG] [LOCAL ] BFK: Trimmed 19326 records to 13975 (keeping 200 days of data) [2025-09-24T17:33:16.016506] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-24T17:33:16.022118] [DEBUG] [LOCAL ] BFK: Primary data saved (13975 records). [2025-09-24T17:33:16.022344] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-24T17:33:16.022524] [INFO ] [MAIN ] Update Progress: 254/2373 symbols completed. BFK took 33.5s. Estimated remaining: 4h 37m 1s. Rate: 7.6 symbols/min [2025-09-24T17:33:16.287351] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:16.305547] [DEBUG] [LOCAL ] BFZ: Loaded 11731 existing records from primary storage. [2025-09-24T17:33:16.305784] [INFO ] [MAIN ] BFZ: Loaded 11731 existing records. [2025-09-24T17:33:16.525354] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:16.525635] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-24T17:33:16.525721] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-24T17:33:16.526226] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-24T17:33:16.526286] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-24T17:33:16.851419] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T17:33:16.854596] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-24T17:33:16.945084] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:16.964965] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-24T17:33:16.972107] [INFO ] [REMOTE ] BFH: Full fetch complete (59589 records). [2025-09-24T17:33:16.972246] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-24T17:33:17.412877] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-24T17:33:17.415656] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-24T17:33:17.416631] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-24T17:33:17.416784] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-24T17:33:17.418900] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-24T17:33:17.428954] [INFO ] [REMOTE ] BFLY: Full fetch complete (75241 records). [2025-09-24T17:33:17.429161] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-24T17:33:17.463582] [DEBUG] [LOCAL ] BFH: Trimmed 59589 records to 41716 (keeping 200 days of data) [2025-09-24T17:33:17.634092] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-24T17:33:17.789270] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T17:33:17.987787] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-24T17:33:17.989891] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-24T17:33:17.991105] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-24T17:33:17.991415] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-24T17:33:17.998341] [DEBUG] [LOCAL ] BFLY: Trimmed 75241 records to 51826 (keeping 200 days of data) [2025-09-24T17:33:18.274810] [DEBUG] [LOCAL ] BFH: Primary data saved (41716 records). [2025-09-24T17:33:18.276306] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-24T17:33:18.276432] [INFO ] [MAIN ] Update Progress: 255/2373 symbols completed. BFH took 36.2s. Estimated remaining: 4h 36m 7s. Rate: 7.7 symbols/min [2025-09-24T17:33:18.449115] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-24T17:33:18.525109] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:18.611541] [DEBUG] [LOCAL ] BG: Loaded 50394 existing records from primary storage. [2025-09-24T17:33:18.612598] [INFO ] [MAIN ] BG: Loaded 50394 existing records. [2025-09-24T17:33:18.798452] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T17:33:18.886825] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:18.893103] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-24T17:33:18.893483] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-24T17:33:18.897970] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-24T17:33:18.898272] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-24T17:33:18.967704] [DEBUG] [LOCAL ] BFLY: Primary data saved (51826 records). [2025-09-24T17:33:18.979480] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-24T17:33:18.984741] [INFO ] [MAIN ] Update Progress: 256/2373 symbols completed. BFLY took 35.6s. Estimated remaining: 4h 35m 0s. Rate: 7.7 symbols/min [2025-09-24T17:33:19.217513] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-24T17:33:19.320237] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:19.475346] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:19.490000] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T17:33:19.493905] [DEBUG] [LOCAL ] BGB: Loaded 17392 existing records from primary storage. [2025-09-24T17:33:19.495001] [INFO ] [MAIN ] BGB: Loaded 17392 existing records. [2025-09-24T17:33:19.676457] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:19.676794] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-24T17:33:19.676853] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-24T17:33:19.677633] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-24T17:33:19.677739] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-24T17:33:20.019705] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-24T17:33:20.061287] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:20.159726] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T17:33:20.816098] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-24T17:33:21.543814] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T17:33:21.616062] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-24T17:33:21.861473] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:33:22.416093] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-24T17:33:22.626343] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T17:33:23.216077] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-24T17:33:24.016097] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-24T17:33:24.081830] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T17:33:24.098798] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T17:33:24.590470] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T17:33:24.816124] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-24T17:33:25.616101] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-24T17:33:26.031484] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T17:33:26.210897] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T17:33:26.416113] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-24T17:33:27.216073] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-24T17:33:27.947825] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T17:33:28.016149] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-24T17:33:28.735884] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T17:33:28.816097] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-24T17:33:28.842544] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T17:33:29.586240] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T17:33:29.616119] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-24T17:33:30.416092] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-24T17:33:30.559550] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T17:33:31.035902] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T17:33:31.216111] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-24T17:33:32.016071] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-24T17:33:32.071187] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T17:33:32.073518] [INFO ] [REMOTE ] BFS: Full fetch complete (12442 records). [2025-09-24T17:33:32.073608] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-24T17:33:32.074165] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:33:32.074251] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:33:32.074295] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:33:32.074360] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-24T17:33:32.074456] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-24T17:33:32.074515] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-09-24T17:33:32.074961] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-09-24T17:33:32.075058] [INFO ] [MAIN ] Update Progress: 257/2373 symbols completed. BFS took 22.8s. Estimated remaining: 4h 35m 36s. Rate: 7.7 symbols/min [2025-09-24T17:33:32.243112] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:32.260863] [DEBUG] [LOCAL ] BGH: Loaded 16373 existing records from primary storage. [2025-09-24T17:33:32.260988] [INFO ] [MAIN ] BGH: Loaded 16373 existing records. [2025-09-24T17:33:32.436355] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:32.436717] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-24T17:33:32.436775] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-24T17:33:32.437499] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-24T17:33:32.437561] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-24T17:33:32.797258] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:32.816054] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-24T17:33:33.616050] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-24T17:33:33.770833] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T17:33:33.801600] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:33:34.338364] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T17:33:34.416069] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-24T17:33:35.216060] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-24T17:33:35.357607] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T17:33:36.016132] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-24T17:33:36.816116] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-24T17:33:36.977884] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T17:33:37.007892] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T17:33:37.279180] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T17:33:37.616117] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-24T17:33:38.416086] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-24T17:33:38.871600] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T17:33:39.216082] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-24T17:33:39.284783] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T17:33:39.288251] [INFO ] [REMOTE ] BFZ: Full fetch complete (18021 records). [2025-09-24T17:33:39.288326] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-24T17:33:39.664773] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-24T17:33:39.664865] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-24T17:33:39.665210] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-24T17:33:39.665251] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-24T17:33:39.665937] [DEBUG] [LOCAL ] BFZ: Trimmed 18021 records to 11925 (keeping 200 days of data) [2025-09-24T17:33:39.742707] [DEBUG] [LOCAL ] BFZ: Primary data saved (11925 records). [2025-09-24T17:33:39.742905] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-24T17:33:39.743104] [INFO ] [MAIN ] Update Progress: 258/2373 symbols completed. BFZ took 23.7s. Estimated remaining: 4h 35m 27s. Rate: 7.7 symbols/min [2025-09-24T17:33:39.919525] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:39.935279] [DEBUG] [LOCAL ] BGR: Loaded 13481 existing records from primary storage. [2025-09-24T17:33:39.935462] [INFO ] [MAIN ] BGR: Loaded 13481 existing records. [2025-09-24T17:33:40.017518] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-24T17:33:40.122092] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:40.122425] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-24T17:33:40.122485] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-24T17:33:40.123100] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-24T17:33:40.123171] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-24T17:33:40.268285] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T17:33:40.513170] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:40.816093] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-24T17:33:41.616072] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-24T17:33:41.789423] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T17:33:42.165330] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T17:33:42.416140] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-24T17:33:42.520333] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T17:33:43.216131] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-24T17:33:43.340219] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T17:33:44.016103] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-24T17:33:44.816054] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-24T17:33:45.044975] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T17:33:45.047315] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:33:45.616052] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-24T17:33:45.651095] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T17:33:46.416100] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-24T17:33:47.039869] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T17:33:47.216112] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-24T17:33:47.307772] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T17:33:47.945913] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T17:33:48.016096] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-24T17:33:48.816067] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-24T17:33:48.931556] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T17:33:48.934626] [INFO ] [REMOTE ] BGB: Full fetch complete (26875 records). [2025-09-24T17:33:48.934734] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-24T17:33:49.314079] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-24T17:33:49.314214] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-24T17:33:49.314729] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-24T17:33:49.314794] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-24T17:33:49.315487] [DEBUG] [LOCAL ] BGB: Trimmed 26875 records to 17384 (keeping 200 days of data) [2025-09-24T17:33:49.424750] [DEBUG] [LOCAL ] BGB: Primary data saved (17384 records). [2025-09-24T17:33:49.424903] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-24T17:33:49.425007] [INFO ] [MAIN ] Update Progress: 259/2373 symbols completed. BGB took 30.4s. Estimated remaining: 4h 35m 34s. Rate: 7.7 symbols/min [2025-09-24T17:33:49.599134] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:33:49.616079] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-24T17:33:49.652544] [DEBUG] [LOCAL ] BGS: Loaded 50467 existing records from primary storage. [2025-09-24T17:33:49.652732] [INFO ] [MAIN ] BGS: Loaded 50467 existing records. [2025-09-24T17:33:49.844479] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T17:33:49.849381] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:33:49.854169] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-24T17:33:49.854233] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-24T17:33:49.855724] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-24T17:33:49.855787] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-24T17:33:50.234880] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:33:50.416091] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-24T17:33:50.615820] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T17:33:51.216187] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-24T17:33:51.992973] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:33:52.016075] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-24T17:33:52.417354] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T17:33:52.816121] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-24T17:33:53.587031] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T17:33:53.608077] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T17:33:53.616044] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-24T17:33:54.349921] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T17:33:54.416142] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-24T17:33:55.216122] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-24T17:33:55.364979] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:33:56.016151] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-24T17:33:56.424340] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:33:56.816059] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-24T17:33:56.827593] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T17:33:57.616065] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-24T17:33:57.666611] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T17:33:58.416095] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-24T17:33:59.224428] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-24T17:33:59.232539] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:33:59.262588] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T17:34:00.016184] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-24T17:34:00.816092] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-24T17:34:01.310944] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-24T17:34:01.616177] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-24T17:34:01.666455] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T17:34:01.961835] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T17:34:02.416189] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-24T17:34:03.071521] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T17:34:03.216103] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-24T17:34:04.021523] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-24T17:34:04.028734] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:34:04.816074] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-24T17:34:05.086743] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:34:05.104810] [INFO ] [REMOTE ] BG: Full fetch complete (72411 records). [2025-09-24T17:34:05.106635] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-24T17:34:05.107837] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T17:34:05.112746] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:34:05.113242] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:34:05.113761] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:34:05.113892] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-24T17:34:05.114051] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-09-24T17:34:05.114119] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-09-24T17:34:05.114739] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-09-24T17:34:05.114914] [INFO ] [MAIN ] Update Progress: 260/2373 symbols completed. BG took 46.8s. Estimated remaining: 4h 36m 31s. Rate: 7.6 symbols/min [2025-09-24T17:34:05.300616] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:05.309803] [DEBUG] [LOCAL ] BGSF: Loaded 6707 existing records from primary storage. [2025-09-24T17:34:05.309907] [INFO ] [MAIN ] BGSF: Loaded 6707 existing records. [2025-09-24T17:34:05.493435] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:05.493795] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-24T17:34:05.493855] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-24T17:34:05.494380] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-24T17:34:05.494442] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-24T17:34:05.621271] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-24T17:34:05.934479] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:05.936777] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T17:34:05.941074] [INFO ] [REMOTE ] BGR: Full fetch complete (20278 records). [2025-09-24T17:34:05.941194] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-24T17:34:06.315870] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-24T17:34:06.315966] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-24T17:34:06.316535] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-24T17:34:06.316641] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-24T17:34:06.317336] [DEBUG] [LOCAL ] BGR: Trimmed 20278 records to 13451 (keeping 200 days of data) [2025-09-24T17:34:06.407384] [DEBUG] [LOCAL ] BGR: Primary data saved (13451 records). [2025-09-24T17:34:06.407558] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-24T17:34:06.407707] [INFO ] [MAIN ] Update Progress: 261/2373 symbols completed. BGR took 26.7s. Estimated remaining: 4h 35m 30s. Rate: 7.7 symbols/min [2025-09-24T17:34:06.421261] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-24T17:34:06.585849] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:06.609339] [DEBUG] [LOCAL ] BGT: Loaded 16586 existing records from primary storage. [2025-09-24T17:34:06.609509] [INFO ] [MAIN ] BGT: Loaded 16586 existing records. [2025-09-24T17:34:06.791430] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:06.791735] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-24T17:34:06.791795] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-24T17:34:06.792490] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-24T17:34:06.792565] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-24T17:34:07.176455] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T17:34:07.209213] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:07.217891] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-24T17:34:07.219540] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T17:34:07.222767] [INFO ] [REMOTE ] BGH: Full fetch complete (21788 records). [2025-09-24T17:34:07.222972] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-24T17:34:07.636407] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-24T17:34:07.636515] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-24T17:34:07.637136] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-24T17:34:07.637226] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-24T17:34:07.638095] [DEBUG] [LOCAL ] BGH: Trimmed 21788 records to 16392 (keeping 200 days of data) [2025-09-24T17:34:07.757041] [DEBUG] [LOCAL ] BGH: Primary data saved (16392 records). [2025-09-24T17:34:07.757296] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-24T17:34:07.757526] [INFO ] [MAIN ] Update Progress: 262/2373 symbols completed. BGH took 35.7s. Estimated remaining: 4h 34m 30s. Rate: 7.7 symbols/min [2025-09-24T17:34:07.950403] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:07.963789] [DEBUG] [LOCAL ] BGX: Loaded 10682 existing records from primary storage. [2025-09-24T17:34:07.963967] [INFO ] [MAIN ] BGX: Loaded 10682 existing records. [2025-09-24T17:34:08.027493] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-24T17:34:08.163929] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:08.164223] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-24T17:34:08.164275] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-24T17:34:08.165451] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-24T17:34:08.165611] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-24T17:34:08.573430] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:08.702470] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T17:34:08.816098] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-24T17:34:09.074680] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T17:34:09.406846] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T17:34:09.616139] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-24T17:34:10.416189] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-24T17:34:11.216050] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-24T17:34:11.436390] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T17:34:11.511250] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-24T17:34:11.648188] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T17:34:12.016097] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-24T17:34:12.816086] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-24T17:34:13.507170] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T17:34:13.616113] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-24T17:34:13.865739] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:34:14.000465] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-24T17:34:14.416082] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-24T17:34:15.216070] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-24T17:34:16.016056] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-24T17:34:16.278944] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T17:34:16.328045] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:34:16.766461] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T17:34:16.816082] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-24T17:34:17.616149] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-24T17:34:17.647616] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T17:34:18.384113] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T17:34:18.416094] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-24T17:34:19.141687] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T17:34:19.216140] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-24T17:34:20.006670] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T17:34:20.016020] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-24T17:34:20.592182] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T17:34:20.816083] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-24T17:34:21.616094] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-24T17:34:21.651235] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T17:34:22.416145] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-24T17:34:22.690309] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T17:34:23.216152] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-24T17:34:24.016106] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-24T17:34:24.151310] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T17:34:24.251918] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T17:34:24.265181] [INFO ] [REMOTE ] BGS: Full fetch complete (72506 records). [2025-09-24T17:34:24.265346] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-24T17:34:24.692879] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-24T17:34:24.693092] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-24T17:34:24.699116] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-24T17:34:24.704191] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-24T17:34:24.705844] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T17:34:24.710931] [DEBUG] [LOCAL ] BGS: Trimmed 72506 records to 50445 (keeping 200 days of data) [2025-09-24T17:34:24.817440] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-24T17:34:25.041922] [DEBUG] [LOCAL ] BGS: Primary data saved (50445 records). [2025-09-24T17:34:25.042175] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-24T17:34:25.042368] [INFO ] [MAIN ] Update Progress: 263/2373 symbols completed. BGS took 35.6s. Estimated remaining: 4h 35m 38s. Rate: 7.7 symbols/min [2025-09-24T17:34:25.266306] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:25.292188] [DEBUG] [LOCAL ] BGY: Loaded 22573 existing records from primary storage. [2025-09-24T17:34:25.292437] [INFO ] [MAIN ] BGY: Loaded 22573 existing records. [2025-09-24T17:34:25.487156] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:25.487575] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-24T17:34:25.487668] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-24T17:34:25.489069] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-24T17:34:25.489159] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-24T17:34:25.620456] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-24T17:34:25.937757] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T17:34:26.070749] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:26.253913] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T17:34:26.416153] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-24T17:34:27.216126] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-24T17:34:27.394294] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T17:34:28.016504] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-24T17:34:28.016995] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T17:34:28.816165] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-24T17:34:29.354843] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T17:34:29.359153] [INFO ] [REMOTE ] BGSF: Full fetch complete (8142 records). [2025-09-24T17:34:29.359361] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-24T17:34:29.624954] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-24T17:34:29.765540] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:34:29.776445] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-24T17:34:29.779475] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-24T17:34:29.779923] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-24T17:34:29.780004] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-24T17:34:29.780884] [DEBUG] [LOCAL ] BGSF: Trimmed 8142 records to 6821 (keeping 200 days of data) [2025-09-24T17:34:29.823321] [DEBUG] [LOCAL ] BGSF: Primary data saved (6821 records). [2025-09-24T17:34:29.823510] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-24T17:34:29.823683] [INFO ] [MAIN ] Update Progress: 264/2373 symbols completed. BGSF took 24.7s. Estimated remaining: 4h 35m 6s. Rate: 7.7 symbols/min [2025-09-24T17:34:30.011501] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:30.035990] [DEBUG] [LOCAL ] BH: Loaded 15557 existing records from primary storage. [2025-09-24T17:34:30.036194] [INFO ] [MAIN ] BH: Loaded 15557 existing records. [2025-09-24T17:34:30.222183] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:30.222453] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-24T17:34:30.222533] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-24T17:34:30.223723] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-24T17:34:30.224073] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-24T17:34:30.419824] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-24T17:34:30.650302] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:30.671016] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T17:34:31.216093] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-24T17:34:31.592041] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T17:34:32.016065] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-24T17:34:32.179058] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T17:34:32.816191] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-24T17:34:33.172945] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T17:34:33.616083] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-24T17:34:33.928607] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T17:34:33.931703] [INFO ] [REMOTE ] BGT: Full fetch complete (24329 records). [2025-09-24T17:34:33.931801] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-24T17:34:34.300897] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-24T17:34:34.300997] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-24T17:34:34.301420] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-24T17:34:34.301460] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-24T17:34:34.302134] [DEBUG] [LOCAL ] BGT: Trimmed 24329 records to 16560 (keeping 200 days of data) [2025-09-24T17:34:34.406568] [DEBUG] [LOCAL ] BGT: Primary data saved (16560 records). [2025-09-24T17:34:34.406757] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-24T17:34:34.406870] [INFO ] [MAIN ] Update Progress: 265/2373 symbols completed. BGT took 28.0s. Estimated remaining: 4h 34m 32s. Rate: 7.7 symbols/min [2025-09-24T17:34:34.421149] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-24T17:34:34.561501] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T17:34:34.619462] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:34.679105] [DEBUG] [LOCAL ] BHC: Loaded 46783 existing records from primary storage. [2025-09-24T17:34:34.679409] [INFO ] [MAIN ] BHC: Loaded 46783 existing records. [2025-09-24T17:34:34.871809] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:34.872167] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-24T17:34:34.872225] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-24T17:34:34.873882] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-24T17:34:34.873948] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-24T17:34:35.223351] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-24T17:34:35.250513] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:35.473464] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T17:34:36.016093] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-24T17:34:36.183095] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T17:34:36.816081] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-24T17:34:36.843240] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T17:34:37.620822] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-24T17:34:37.623829] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T17:34:38.416129] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-24T17:34:38.749981] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T17:34:39.198145] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T17:34:39.216043] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-24T17:34:40.016115] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-24T17:34:40.603407] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T17:34:40.800078] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:34:40.816035] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-24T17:34:41.616086] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-24T17:34:42.271615] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T17:34:42.287450] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T17:34:42.290498] [INFO ] [REMOTE ] BGX: Full fetch complete (15767 records). [2025-09-24T17:34:42.290584] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-24T17:34:42.421185] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-24T17:34:42.686732] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-24T17:34:42.686823] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-24T17:34:42.687156] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-24T17:34:42.687196] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-24T17:34:42.687786] [DEBUG] [LOCAL ] BGX: Trimmed 15767 records to 10704 (keeping 200 days of data) [2025-09-24T17:34:42.758910] [DEBUG] [LOCAL ] BGX: Primary data saved (10704 records). [2025-09-24T17:34:42.759052] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-24T17:34:42.759156] [INFO ] [MAIN ] Update Progress: 266/2373 symbols completed. BGX took 35.0s. Estimated remaining: 4h 34m 28s. Rate: 7.7 symbols/min [2025-09-24T17:34:42.944455] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:42.969917] [DEBUG] [LOCAL ] BHE: Loaded 25147 existing records from primary storage. [2025-09-24T17:34:42.970056] [INFO ] [MAIN ] BHE: Loaded 25147 existing records. [2025-09-24T17:34:43.152544] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:43.152876] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-24T17:34:43.152936] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-24T17:34:43.153913] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-24T17:34:43.153976] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-24T17:34:43.221201] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-24T17:34:43.580763] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:44.001881] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T17:34:44.016026] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-24T17:34:44.384776] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T17:34:44.816145] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-24T17:34:45.558518] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T17:34:45.576742] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T17:34:45.616066] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-24T17:34:46.416059] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-24T17:34:46.537000] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T17:34:47.216130] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-24T17:34:48.016077] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-24T17:34:48.214411] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:34:48.393852] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T17:34:48.816097] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-24T17:34:48.915956] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T17:34:49.616143] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-24T17:34:49.984493] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T17:34:50.416095] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-24T17:34:50.816452] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T17:34:51.216073] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-24T17:34:51.987985] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T17:34:52.016053] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-24T17:34:52.318573] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T17:34:52.816140] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-24T17:34:53.616163] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-24T17:34:53.708606] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T17:34:53.906589] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T17:34:54.416103] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-24T17:34:54.528189] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T17:34:55.216119] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-24T17:34:55.614190] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T17:34:55.617468] [INFO ] [REMOTE ] BGY: Full fetch complete (33329 records). [2025-09-24T17:34:55.617555] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-24T17:34:55.995255] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-24T17:34:55.995346] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-24T17:34:55.995856] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-24T17:34:55.995919] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-24T17:34:55.996830] [DEBUG] [LOCAL ] BGY: Trimmed 33329 records to 22545 (keeping 200 days of data) [2025-09-24T17:34:56.050012] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-24T17:34:56.136613] [DEBUG] [LOCAL ] BGY: Primary data saved (22545 records). [2025-09-24T17:34:56.136780] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-24T17:34:56.136871] [INFO ] [MAIN ] Update Progress: 267/2373 symbols completed. BGY took 31.1s. Estimated remaining: 4h 35m 5s. Rate: 7.7 symbols/min [2025-09-24T17:34:56.314760] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:34:56.336057] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-24T17:34:56.361392] [DEBUG] [LOCAL ] BHK: Loaded 22454 existing records from primary storage. [2025-09-24T17:34:56.361559] [INFO ] [MAIN ] BHK: Loaded 22454 existing records. [2025-09-24T17:34:56.539107] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:34:56.539378] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-24T17:34:56.539427] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-24T17:34:56.540375] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-24T17:34:56.540436] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-24T17:34:56.817553] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-24T17:34:56.903413] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:34:56.991264] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T17:34:57.616100] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-24T17:34:58.416078] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-24T17:34:58.584496] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T17:34:58.716139] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T17:34:59.216132] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-24T17:34:59.909745] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T17:34:59.970019] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T17:35:00.016091] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-24T17:35:00.816096] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-24T17:35:01.075981] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T17:35:01.616091] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-24T17:35:01.804461] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T17:35:01.809322] [INFO ] [REMOTE ] BH: Full fetch complete (19171 records). [2025-09-24T17:35:01.809760] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-24T17:35:01.810951] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:35:01.811076] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:35:01.811146] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:35:01.811241] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-24T17:35:01.811375] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-24T17:35:01.811427] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-24T17:35:01.812403] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-24T17:35:01.812845] [INFO ] [MAIN ] Update Progress: 268/2373 symbols completed. BH took 32.0s. Estimated remaining: 4h 34m 40s. Rate: 7.7 symbols/min [2025-09-24T17:35:02.012551] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:02.093635] [DEBUG] [LOCAL ] BHP: Loaded 53376 existing records from primary storage. [2025-09-24T17:35:02.093890] [INFO ] [MAIN ] BHP: Loaded 53376 existing records. [2025-09-24T17:35:02.278756] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:02.279003] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-24T17:35:02.279051] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-24T17:35:02.280507] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-24T17:35:02.280573] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-24T17:35:02.422060] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-24T17:35:02.578881] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T17:35:02.661126] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:03.216085] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-24T17:35:03.915432] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:35:04.016062] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-24T17:35:04.816144] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-24T17:35:05.291593] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T17:35:05.437323] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-24T17:35:05.616075] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-24T17:35:06.346747] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T17:35:06.416113] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-24T17:35:07.219262] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-24T17:35:07.222361] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:35:07.426539] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T17:35:08.016082] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-24T17:35:08.728190] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T17:35:08.816051] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-24T17:35:08.861143] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T17:35:08.870693] [INFO ] [REMOTE ] BHC: Full fetch complete (66737 records). [2025-09-24T17:35:08.870862] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-24T17:35:09.303483] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-24T17:35:09.303617] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-24T17:35:09.304374] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-24T17:35:09.304433] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-24T17:35:09.306051] [DEBUG] [LOCAL ] BHC: Trimmed 66737 records to 46794 (keeping 200 days of data) [2025-09-24T17:35:09.577571] [DEBUG] [LOCAL ] BHC: Primary data saved (46794 records). [2025-09-24T17:35:09.577773] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-24T17:35:09.577891] [INFO ] [MAIN ] Update Progress: 269/2373 symbols completed. BHC took 35.2s. Estimated remaining: 4h 34m 31s. Rate: 7.7 symbols/min [2025-09-24T17:35:09.621243] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-24T17:35:09.772367] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:09.795068] [DEBUG] [LOCAL ] BHR: Loaded 21431 existing records from primary storage. [2025-09-24T17:35:09.795241] [INFO ] [MAIN ] BHR: Loaded 21431 existing records. [2025-09-24T17:35:09.997922] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:09.998234] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-24T17:35:09.998289] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-24T17:35:09.998896] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-24T17:35:09.998965] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-24T17:35:10.385598] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:10.421154] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-24T17:35:10.440419] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:35:10.944153] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T17:35:11.216128] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-24T17:35:11.378254] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T17:35:12.016091] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-24T17:35:12.428116] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T17:35:12.816089] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-24T17:35:13.132546] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T17:35:13.616077] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-24T17:35:14.416050] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-24T17:35:14.687047] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T17:35:14.925085] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T17:35:15.216050] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-24T17:35:15.330764] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:35:16.016094] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-24T17:35:16.659566] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T17:35:16.816092] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-24T17:35:17.616088] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-24T17:35:17.866942] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:35:18.038198] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:35:18.416091] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-24T17:35:18.852082] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T17:35:19.216161] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-24T17:35:19.490157] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T17:35:20.016099] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-24T17:35:20.816112] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-24T17:35:21.160798] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T17:35:21.166411] [INFO ] [REMOTE ] BHE: Full fetch complete (36554 records). [2025-09-24T17:35:21.204385] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-24T17:35:21.216440] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-24T17:35:21.623880] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-24T17:35:21.642748] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-24T17:35:21.642861] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-24T17:35:21.643495] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-24T17:35:21.643566] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-24T17:35:21.644600] [DEBUG] [LOCAL ] BHE: Trimmed 36554 records to 25094 (keeping 200 days of data) [2025-09-24T17:35:21.798949] [DEBUG] [LOCAL ] BHE: Primary data saved (25094 records). [2025-09-24T17:35:21.799304] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-24T17:35:21.799397] [INFO ] [MAIN ] Update Progress: 270/2373 symbols completed. BHE took 39.0s. Estimated remaining: 4h 34m 58s. Rate: 7.6 symbols/min [2025-09-24T17:35:21.975894] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:21.976133] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-24T17:35:21.976187] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-24T17:35:21.976429] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-24T17:35:21.976547] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-24T17:35:21.976750] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-24T17:35:21.976806] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-24T17:35:22.173779] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:35:22.390189] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:22.416066] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-24T17:35:22.874596] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-24T17:35:23.216083] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-24T17:35:23.429541] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T17:35:23.589610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-24T17:35:24.016150] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-24T17:35:24.334473] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-24T17:35:24.816125] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-24T17:35:25.616105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-24T17:35:26.012103] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-24T17:35:26.416084] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-24T17:35:26.859159] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T17:35:27.216118] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-24T17:35:27.483330] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T17:35:27.488422] [INFO ] [REMOTE ] BHK: Full fetch complete (29711 records). [2025-09-24T17:35:27.488513] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-24T17:35:27.882565] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-24T17:35:27.882690] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-24T17:35:27.883242] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-24T17:35:27.883310] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-24T17:35:27.884304] [DEBUG] [LOCAL ] BHK: Trimmed 29711 records to 22541 (keeping 200 days of data) [2025-09-24T17:35:28.019489] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-24T17:35:28.025144] [DEBUG] [LOCAL ] BHK: Primary data saved (22541 records). [2025-09-24T17:35:28.025222] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-24T17:35:28.025303] [INFO ] [MAIN ] Update Progress: 271/2373 symbols completed. BHK took 31.9s. Estimated remaining: 4h 34m 37s. Rate: 7.7 symbols/min [2025-09-24T17:35:28.218685] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:28.268846] [DEBUG] [LOCAL ] BHVN: Loaded 49614 existing records from primary storage. [2025-09-24T17:35:28.268999] [INFO ] [MAIN ] BHVN: Loaded 49614 existing records. [2025-09-24T17:35:28.447783] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T17:35:28.474914] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:28.475213] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-24T17:35:28.475266] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-24T17:35:28.477207] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-24T17:35:28.477270] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-24T17:35:28.821203] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-24T17:35:28.851177] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:29.343459] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-24T17:35:29.616137] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-24T17:35:30.035432] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T17:35:30.416125] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-24T17:35:30.760892] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-24T17:35:31.216057] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-24T17:35:31.523596] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T17:35:31.535620] [INFO ] [REMOTE ] BHP: Full fetch complete (77235 records). [2025-09-24T17:35:31.535835] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-24T17:35:31.947021] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-24T17:35:31.947133] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-24T17:35:31.947968] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-24T17:35:31.948050] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-24T17:35:31.949688] [DEBUG] [LOCAL ] BHP: Trimmed 77235 records to 53374 (keeping 200 days of data) [2025-09-24T17:35:32.020365] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-24T17:35:32.293731] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T17:35:32.312385] [DEBUG] [LOCAL ] BHP: Primary data saved (53374 records). [2025-09-24T17:35:32.312566] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-24T17:35:32.312695] [INFO ] [MAIN ] Update Progress: 272/2373 symbols completed. BHP took 30.5s. Estimated remaining: 4h 34m 2s. Rate: 7.7 symbols/min [2025-09-24T17:35:32.484301] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:32.536111] [DEBUG] [LOCAL ] BILL: Loaded 52325 existing records from primary storage. [2025-09-24T17:35:32.536257] [INFO ] [MAIN ] BILL: Loaded 52325 existing records. [2025-09-24T17:35:32.715279] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:32.715549] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-24T17:35:32.715596] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-24T17:35:32.716753] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-24T17:35:32.716815] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-24T17:35:32.818927] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-24T17:35:33.081666] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:33.616110] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-24T17:35:33.738674] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T17:35:34.041010] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:35:34.416124] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-24T17:35:35.176432] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T17:35:35.216087] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-24T17:35:35.360818] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:35:35.565467] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T17:35:36.016113] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-24T17:35:36.816136] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-24T17:35:37.057392] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T17:35:37.264905] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T17:35:37.616146] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-24T17:35:38.416110] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-24T17:35:39.118293] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T17:35:39.216075] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-24T17:35:40.016187] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-24T17:35:40.103250] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T17:35:40.476455] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T17:35:40.816105] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-24T17:35:41.145146] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T17:35:41.616079] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-24T17:35:42.029684] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-24T17:35:42.416091] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-24T17:35:43.216054] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-24T17:35:43.265836] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T17:35:43.726913] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T17:35:43.732879] [INFO ] [REMOTE ] BHR: Full fetch complete (30582 records). [2025-09-24T17:35:43.733034] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-24T17:35:43.841409] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T17:35:43.854491] [INFO ] [REMOTE ] BHV: Full fetch complete (1381 records). [2025-09-24T17:35:43.854770] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-24T17:35:44.039407] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-24T17:35:44.283292] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-24T17:35:44.293756] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:35:44.323557] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:35:44.333143] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-24T17:35:44.341551] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-24T17:35:44.341674] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-24T17:35:44.349242] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-24T17:35:44.351195] [INFO ] [MAIN ] Update Progress: 273/2373 symbols completed. BHV took 22.6s. Estimated remaining: 4h 34m 27s. Rate: 7.7 symbols/min [2025-09-24T17:35:44.406021] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-24T17:35:44.433280] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-24T17:35:44.433964] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-24T17:35:44.444861] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-24T17:35:44.478798] [DEBUG] [LOCAL ] BHR: Trimmed 30582 records to 21489 (keeping 200 days of data) [2025-09-24T17:35:44.590782] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:44.657227] [DEBUG] [LOCAL ] BIO: Loaded 25445 existing records from primary storage. [2025-09-24T17:35:44.657934] [INFO ] [MAIN ] BIO: Loaded 25445 existing records. [2025-09-24T17:35:44.819085] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-24T17:35:44.848220] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:44.850731] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-24T17:35:44.851357] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-24T17:35:44.852894] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-24T17:35:44.853544] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-24T17:35:45.096553] [DEBUG] [LOCAL ] BHR: Primary data saved (21489 records). [2025-09-24T17:35:45.156470] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-24T17:35:45.167991] [INFO ] [MAIN ] Update Progress: 274/2373 symbols completed. BHR took 35.6s. Estimated remaining: 4h 33m 25s. Rate: 7.7 symbols/min [2025-09-24T17:35:45.402957] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:45.470853] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:35:45.520405] [DEBUG] [LOCAL ] BIP: Loaded 39590 existing records from primary storage. [2025-09-24T17:35:45.520597] [INFO ] [MAIN ] BIP: Loaded 39590 existing records. [2025-09-24T17:35:45.626781] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-24T17:35:45.717997] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:35:45.718311] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-24T17:35:45.718367] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-24T17:35:45.719337] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-24T17:35:45.719399] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-24T17:35:46.096302] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:35:46.234767] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T17:35:46.299637] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:35:46.416121] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-24T17:35:46.916291] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T17:35:47.216065] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-24T17:35:47.943032] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T17:35:48.016030] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-24T17:35:48.816071] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-24T17:35:49.000819] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T17:35:49.616055] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-24T17:35:49.854365] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T17:35:50.300495] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T17:35:50.416089] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-24T17:35:50.896133] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T17:35:51.216077] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-24T17:35:52.016051] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-24T17:35:52.351364] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T17:35:52.541389] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T17:35:52.816110] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-24T17:35:53.412730] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T17:35:53.616041] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-24T17:35:53.704156] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T17:35:54.416085] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-24T17:35:55.066151] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T17:35:55.216096] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-24T17:35:56.016081] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-24T17:35:56.108638] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T17:35:56.501593] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T17:35:56.816095] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-24T17:35:57.404206] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T17:35:57.616095] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-24T17:35:58.060188] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T17:35:58.416205] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-24T17:35:59.216167] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-24T17:35:59.602907] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T17:35:59.824420] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T17:36:00.016093] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-24T17:36:00.816053] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-24T17:36:01.064725] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:36:01.268852] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T17:36:01.616093] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-24T17:36:02.416094] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-24T17:36:03.216076] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-24T17:36:03.747629] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-24T17:36:03.757692] [INFO ] [REMOTE ] BILL: Full fetch complete (75585 records). [2025-09-24T17:36:03.757891] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-24T17:36:04.193942] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-24T17:36:04.194201] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-24T17:36:04.195762] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-24T17:36:04.195848] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-24T17:36:04.216302] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:36:04.223939] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-24T17:36:04.225726] [DEBUG] [LOCAL ] BILL: Trimmed 75585 records to 52325 (keeping 200 days of data) [2025-09-24T17:36:04.540991] [DEBUG] [LOCAL ] BILL: Primary data saved (52325 records). [2025-09-24T17:36:04.541154] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-24T17:36:04.541264] [INFO ] [MAIN ] Update Progress: 275/2373 symbols completed. BILL took 32.2s. Estimated remaining: 4h 34m 45s. Rate: 7.6 symbols/min [2025-09-24T17:36:04.711897] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:04.761847] [DEBUG] [LOCAL ] BIPC: Loaded 41701 existing records from primary storage. [2025-09-24T17:36:04.762050] [INFO ] [MAIN ] BIPC: Loaded 41701 existing records. [2025-09-24T17:36:04.939374] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:04.939721] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-24T17:36:04.939784] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-24T17:36:04.940910] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-24T17:36:04.940982] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-24T17:36:05.301443] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:05.301947] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-24T17:36:05.477952] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (3.86 seconds). [2025-09-24T17:36:05.552516] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-24T17:36:05.616056] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-24T17:36:05.760620] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:36:06.416070] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-24T17:36:06.767271] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T17:36:06.861967] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T17:36:07.216097] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-24T17:36:07.635910] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:36:08.016098] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-24T17:36:08.738794] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T17:36:08.816075] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-24T17:36:09.621638] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-24T17:36:09.627838] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T17:36:09.639033] [INFO ] [REMOTE ] BHVN: Full fetch complete (69435 records). [2025-09-24T17:36:09.639316] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-24T17:36:10.099401] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-24T17:36:10.099591] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-24T17:36:10.101281] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-24T17:36:10.101439] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-24T17:36:10.103465] [DEBUG] [LOCAL ] BHVN: Trimmed 69435 records to 49636 (keeping 200 days of data) [2025-09-24T17:36:10.196292] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T17:36:10.427478] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-24T17:36:10.465404] [DEBUG] [LOCAL ] BHVN: Primary data saved (49636 records). [2025-09-24T17:36:10.465570] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-24T17:36:10.465711] [INFO ] [MAIN ] Update Progress: 276/2373 symbols completed. BHVN took 42.4s. Estimated remaining: 4h 34m 23s. Rate: 7.6 symbols/min [2025-09-24T17:36:10.641159] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:10.645706] [DEBUG] [LOCAL ] BIPH: Loaded 2635 existing records from primary storage. [2025-09-24T17:36:10.645794] [INFO ] [MAIN ] BIPH: Loaded 2635 existing records. [2025-09-24T17:36:10.867351] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:10.868565] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-24T17:36:10.868723] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-24T17:36:10.875400] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-24T17:36:10.885510] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-24T17:36:10.892699] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T17:36:10.998416] [INFO ] [REMOTE ] BIO: Full fetch complete (34166 records). [2025-09-24T17:36:11.023439] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-24T17:36:11.251776] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-24T17:36:11.913775] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:12.022550] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-24T17:36:12.076219] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-24T17:36:12.076368] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-24T17:36:12.077187] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-24T17:36:12.077362] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-24T17:36:12.102756] [DEBUG] [LOCAL ] BIO: Trimmed 34166 records to 25314 (keeping 200 days of data) [2025-09-24T17:36:12.108741] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T17:36:12.281820] [DEBUG] [LOCAL ] BIO: Primary data saved (25314 records). [2025-09-24T17:36:12.282034] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-24T17:36:12.282255] [INFO ] [MAIN ] Update Progress: 277/2373 symbols completed. BIO took 27.9s. Estimated remaining: 4h 33m 29s. Rate: 7.7 symbols/min [2025-09-24T17:36:12.684028] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T17:36:12.711380] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T17:36:12.816097] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-24T17:36:13.399142] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T17:36:13.616075] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-24T17:36:14.416142] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-24T17:36:15.216068] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-24T17:36:15.350180] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T17:36:15.360116] [INFO ] [REMOTE ] BIP: Full fetch complete (56094 records). [2025-09-24T17:36:15.360235] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-24T17:36:15.361098] [FATAL] [VALIDATOR ] BIP: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:36:15.361185] [FATAL] [MAIN ] BIP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:36:15.361238] [WARN ] [MAIN ] BIP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:36:15.361343] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-24T17:36:15.361428] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-09-24T17:36:15.361503] [INFO ] [LOCAL ] BIP: Starting deletion of derivative data. [2025-09-24T17:36:15.362056] [DEBUG] [LOCAL ] BIP: Deleted derivative data file. [2025-09-24T17:36:15.362154] [INFO ] [MAIN ] Update Progress: 278/2373 symbols completed. BIP took 30.2s. Estimated remaining: 4h 32m 46s. Rate: 7.7 symbols/min [2025-09-24T17:36:15.752662] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T17:36:16.016096] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-24T17:36:16.471715] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T17:36:16.816167] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-24T17:36:17.240247] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T17:36:17.616139] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-24T17:36:18.222446] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T17:36:18.416107] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-24T17:36:19.091006] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-24T17:36:19.113154] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T17:36:19.216120] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-24T17:36:19.668330] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T17:36:20.016203] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-24T17:36:20.816265] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-24T17:36:21.291935] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T17:36:21.624620] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-24T17:36:21.631337] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T17:36:22.083872] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T17:36:22.416131] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-24T17:36:23.165463] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T17:36:23.166710] [INFO ] [REMOTE ] BIPH: Full fetch complete (4305 records). [2025-09-24T17:36:23.166793] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-24T17:36:23.167315] [FATAL] [VALIDATOR ] BIPH: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:36:23.167405] [FATAL] [MAIN ] BIPH: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:36:23.167448] [WARN ] [MAIN ] BIPH: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:36:23.167484] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-24T17:36:23.167541] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-09-24T17:36:23.167577] [INFO ] [LOCAL ] BIPH: Starting deletion of derivative data. [2025-09-24T17:36:23.168056] [DEBUG] [LOCAL ] BIPH: Deleted derivative data file. [2025-09-24T17:36:23.168189] [INFO ] [MAIN ] Update Progress: 279/2373 symbols completed. BIPH took 12.7s. Estimated remaining: 4h 32m 38s. Rate: 7.7 symbols/min [2025-09-24T17:36:23.216099] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-24T17:36:24.620714] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:36:24.629315] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-24T17:36:25.873733] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T17:36:25.885216] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-24T17:36:27.426710] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T17:36:27.439020] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-24T17:36:28.831296] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T17:36:28.838150] [INFO ] [REMOTE ] BIPC: Full fetch complete (59528 records). [2025-09-24T17:36:28.838286] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-24T17:36:29.313282] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-24T17:36:29.313484] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-24T17:36:29.315549] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-24T17:36:29.315664] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-24T17:36:29.328035] [DEBUG] [LOCAL ] BIPC: Trimmed 59528 records to 41668 (keeping 200 days of data) [2025-09-24T17:36:29.617182] [DEBUG] [LOCAL ] BIPC: Primary data saved (41668 records). [2025-09-24T17:36:29.617336] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-24T17:36:29.617603] [INFO ] [MAIN ] Update Progress: 280/2373 symbols completed. BIPC took 25.1s. Estimated remaining: 4h 32m 20s. Rate: 7.7 symbols/min [2025-09-24T17:36:30.209190] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:30.359039] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:30.427105] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:30.431767] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:30.438118] [DEBUG] [LOCAL ] BIPJ: Loaded 2951 existing records from primary storage. [2025-09-24T17:36:30.438546] [INFO ] [MAIN ] BIPJ: Loaded 2951 existing records. [2025-09-24T17:36:30.506811] [DEBUG] [LOCAL ] BIPI: Loaded 3293 existing records from primary storage. [2025-09-24T17:36:30.535920] [INFO ] [MAIN ] BIPI: Loaded 3293 existing records. [2025-09-24T17:36:30.644030] [DEBUG] [LOCAL ] BIT: Loaded 22326 existing records from primary storage. [2025-09-24T17:36:30.712345] [INFO ] [MAIN ] BIT: Loaded 22326 existing records. [2025-09-24T17:36:30.865502] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:31.020308] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:31.012348] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-24T17:36:31.013800] [DEBUG] [LOCAL ] BIRK: Loaded 50900 existing records from primary storage. [2025-09-24T17:36:31.031700] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-24T17:36:31.047192] [INFO ] [MAIN ] BIRK: Loaded 50900 existing records. [2025-09-24T17:36:31.095542] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-24T17:36:31.074300] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-24T17:36:31.133896] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-24T17:36:31.095712] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-24T17:36:31.155846] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:31.234879] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-24T17:36:31.254261] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-24T17:36:31.270302] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-24T17:36:31.333443] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-24T17:36:31.449520] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-24T17:36:31.462124] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-24T17:36:31.783127] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:31.892562] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-24T17:36:31.981124] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-24T17:36:32.129185] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-24T17:36:32.188862] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-24T17:36:32.397744] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:32.461481] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:32.461845] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-24T17:36:32.487634] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-24T17:36:32.632837] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:32.668222] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-24T17:36:32.893782] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:32.894420] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-24T17:36:33.272955] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T17:36:33.274589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-24T17:36:33.482172] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T17:36:33.484239] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-24T17:36:33.806240] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-24T17:36:33.808921] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-24T17:36:33.812313] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T17:36:33.814971] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-24T17:36:33.897214] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T17:36:33.902889] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-24T17:36:34.257401] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T17:36:34.258757] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-24T17:36:34.292403] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T17:36:34.416139] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-24T17:36:34.450797] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T17:36:34.634245] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-24T17:36:34.863199] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T17:36:34.947097] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T17:36:35.216082] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-24T17:36:35.775758] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T17:36:36.016116] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-24T17:36:36.449581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T17:36:36.816084] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-24T17:36:37.616083] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-24T17:36:38.170545] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T17:36:38.401493] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T17:36:38.416041] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-24T17:36:39.216073] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-24T17:36:40.021286] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-24T17:36:40.032331] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:36:40.044791] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T17:36:40.350733] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T17:36:40.816130] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-24T17:36:41.616062] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-24T17:36:41.814249] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T17:36:42.416175] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-24T17:36:42.486204] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T17:36:42.866497] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T17:36:43.216163] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-24T17:36:44.016153] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-24T17:36:44.816147] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-24T17:36:45.076399] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T17:36:45.164999] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T17:36:45.362897] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-24T17:36:45.616114] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-24T17:36:46.321406] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T17:36:46.322933] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4329 records). [2025-09-24T17:36:46.323008] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-24T17:36:46.421395] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-24T17:36:46.763397] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-24T17:36:46.763490] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-24T17:36:46.763664] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-24T17:36:46.763727] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-24T17:36:46.764105] [DEBUG] [LOCAL ] BIPJ: Trimmed 4329 records to 2962 (keeping 200 days of data) [2025-09-24T17:36:46.786173] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2962 records). [2025-09-24T17:36:46.786274] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-24T17:36:46.786388] [INFO ] [MAIN ] Update Progress: 281/2373 symbols completed. BIPJ took 17.2s. Estimated remaining: 4h 33m 22s. Rate: 7.7 symbols/min [2025-09-24T17:36:46.980267] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:46.980479] [DEBUG] [LOCAL ] BJ: No existing data file found in primary storage. [2025-09-24T17:36:46.980520] [WARN ] [MAIN ] BJ: No existing data found, performing full refresh instead. [2025-09-24T17:36:46.980730] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-24T17:36:46.980784] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-24T17:36:46.980828] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-24T17:36:46.980865] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-24T17:36:47.221191] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-24T17:36:47.350170] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:47.482526] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T17:36:48.016094] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-24T17:36:48.816135] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-24T17:36:48.878191] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T17:36:49.488833] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T17:36:49.616037] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-24T17:36:49.843707] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T17:36:50.416141] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-24T17:36:51.043195] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:36:51.058181] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T17:36:51.216090] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-24T17:36:52.021303] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-24T17:36:52.022797] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T17:36:52.816091] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-24T17:36:53.273301] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-24T17:36:53.616094] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-24T17:36:53.694950] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T17:36:54.180057] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T17:36:54.416118] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-24T17:36:55.089559] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T17:36:55.090930] [INFO ] [REMOTE ] BIPI: Full fetch complete (5245 records). [2025-09-24T17:36:55.091004] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-24T17:36:55.221308] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-24T17:36:55.481276] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-24T17:36:55.481391] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-24T17:36:55.481684] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-24T17:36:55.481753] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-24T17:36:55.482209] [DEBUG] [LOCAL ] BIPI: Trimmed 5245 records to 3248 (keeping 200 days of data) [2025-09-24T17:36:55.506421] [DEBUG] [LOCAL ] BIPI: Primary data saved (3248 records). [2025-09-24T17:36:55.506662] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-24T17:36:55.506796] [INFO ] [MAIN ] Update Progress: 282/2373 symbols completed. BIPI took 25.9s. Estimated remaining: 4h 33m 20s. Rate: 7.6 symbols/min [2025-09-24T17:36:55.684581] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:36:55.755944] [DEBUG] [LOCAL ] BK: Loaded 53555 existing records from primary storage. [2025-09-24T17:36:55.756149] [INFO ] [MAIN ] BK: Loaded 53555 existing records. [2025-09-24T17:36:55.939250] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:36:55.939541] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-24T17:36:55.939591] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-24T17:36:55.943059] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-24T17:36:55.943124] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-24T17:36:56.021246] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-24T17:36:56.306004] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:36:56.816129] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-24T17:36:56.847061] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T17:36:57.025850] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T17:36:57.616145] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-24T17:36:58.404999] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T17:36:58.416031] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-24T17:36:59.216093] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-24T17:36:59.407373] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T17:37:00.021272] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-24T17:37:00.039612] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T17:37:00.816122] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-24T17:37:01.166390] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T17:37:01.605576] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T17:37:01.617019] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-24T17:37:02.416061] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-24T17:37:02.528801] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T17:37:03.216052] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-24T17:37:03.355280] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T17:37:03.547327] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:37:03.554154] [INFO ] [REMOTE ] BIT: Full fetch complete (31133 records). [2025-09-24T17:37:03.554325] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-24T17:37:04.027145] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-24T17:37:04.029978] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-24T17:37:04.030183] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-24T17:37:04.031189] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-24T17:37:04.031336] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-24T17:37:04.035271] [DEBUG] [LOCAL ] BIT: Trimmed 31133 records to 22357 (keeping 200 days of data) [2025-09-24T17:37:04.214718] [DEBUG] [LOCAL ] BIT: Primary data saved (22357 records). [2025-09-24T17:37:04.214987] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-24T17:37:04.215171] [INFO ] [MAIN ] Update Progress: 283/2373 symbols completed. BIT took 34.6s. Estimated remaining: 4h 33m 19s. Rate: 7.6 symbols/min [2025-09-24T17:37:04.630477] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:04.631611] [DEBUG] [LOCAL ] BKD: No existing data file found in primary storage. [2025-09-24T17:37:04.631731] [WARN ] [MAIN ] BKD: No existing data found, performing full refresh instead. [2025-09-24T17:37:04.631979] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-24T17:37:04.632045] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-24T17:37:04.632134] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-09-24T17:37:04.632204] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-24T17:37:04.816964] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-24T17:37:05.151375] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:05.187202] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T17:37:05.202927] [INFO ] [REMOTE ] BIRK: Full fetch complete (72764 records). [2025-09-24T17:37:05.203248] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-24T17:37:05.625604] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-24T17:37:05.630911] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-24T17:37:05.631042] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-24T17:37:05.631969] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-24T17:37:05.632256] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-24T17:37:05.634320] [DEBUG] [LOCAL ] BIRK: Trimmed 72764 records to 50906 (keeping 200 days of data) [2025-09-24T17:37:05.890718] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T17:37:05.995331] [DEBUG] [LOCAL ] BIRK: Primary data saved (50906 records). [2025-09-24T17:37:05.995520] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-24T17:37:05.995616] [INFO ] [MAIN ] Update Progress: 284/2373 symbols completed. BIRK took 36.4s. Estimated remaining: 4h 32m 27s. Rate: 7.7 symbols/min [2025-09-24T17:37:06.167124] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:06.167316] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-09-24T17:37:06.167353] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-09-24T17:37:06.167497] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-24T17:37:06.167541] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-24T17:37:06.167582] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-24T17:37:06.167615] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-24T17:37:06.420731] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-24T17:37:06.542902] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:06.574106] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T17:37:07.216089] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-24T17:37:07.351327] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:37:08.016096] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-24T17:37:08.269085] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T17:37:08.733318] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:37:08.816089] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-24T17:37:09.063319] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T17:37:09.616088] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-24T17:37:10.416061] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-24T17:37:10.567041] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:37:11.149924] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:37:11.216098] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-24T17:37:12.016150] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-24T17:37:12.344748] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T17:37:12.816123] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-24T17:37:13.079306] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T17:37:13.258044] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T17:37:13.616101] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-24T17:37:14.416128] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-24T17:37:14.682597] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T17:37:15.216090] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-24T17:37:15.404213] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T17:37:15.415204] [INFO ] [REMOTE ] BJ: Full fetch complete (73715 records). [2025-09-24T17:37:15.415420] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-24T17:37:15.838615] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-24T17:37:15.838797] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-24T17:37:15.840018] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-24T17:37:15.840115] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-24T17:37:15.842257] [DEBUG] [LOCAL ] BJ: Trimmed 73715 records to 51395 (keeping 200 days of data) [2025-09-24T17:37:15.969907] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T17:37:16.059572] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-24T17:37:16.203065] [DEBUG] [LOCAL ] BJ: Primary data saved (51395 records). [2025-09-24T17:37:16.203241] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-24T17:37:16.203325] [INFO ] [MAIN ] Update Progress: 285/2373 symbols completed. BJ took 29.4s. Estimated remaining: 4h 32m 36s. Rate: 7.7 symbols/min [2025-09-24T17:37:16.371919] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:16.412087] [DEBUG] [LOCAL ] BKH: Loaded 36620 existing records from primary storage. [2025-09-24T17:37:16.412257] [INFO ] [MAIN ] BKH: Loaded 36620 existing records. [2025-09-24T17:37:16.588546] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:37:16.588868] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-24T17:37:16.588918] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-24T17:37:16.590243] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-24T17:37:16.590338] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-24T17:37:16.817160] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-24T17:37:16.967924] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:16.997865] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T17:37:17.215119] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T17:37:17.616105] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-24T17:37:18.084728] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T17:37:18.416106] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-24T17:37:19.111190] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T17:37:19.216085] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-24T17:37:19.633004] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T17:37:20.016108] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-24T17:37:20.666724] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T17:37:20.816074] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-24T17:37:21.437372] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T17:37:21.616072] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-24T17:37:22.416058] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-24T17:37:22.593892] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T17:37:22.966115] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T17:37:23.216088] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-24T17:37:24.023071] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-24T17:37:24.027148] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T17:37:24.729245] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T17:37:24.816233] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-24T17:37:25.616099] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-24T17:37:25.664007] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T17:37:25.675098] [INFO ] [REMOTE ] BK: Full fetch complete (77488 records). [2025-09-24T17:37:25.675360] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-24T17:37:26.102036] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-24T17:37:26.102329] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-24T17:37:26.103788] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-24T17:37:26.103879] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-24T17:37:26.106204] [DEBUG] [LOCAL ] BK: Trimmed 77488 records to 53553 (keeping 200 days of data) [2025-09-24T17:37:26.261854] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T17:37:26.446263] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-24T17:37:26.506549] [DEBUG] [LOCAL ] BK: Primary data saved (53553 records). [2025-09-24T17:37:26.506806] [INFO ] [MAIN ] BK: Full history saved. [2025-09-24T17:37:26.509425] [INFO ] [MAIN ] Update Progress: 286/2373 symbols completed. BK took 31.0s. Estimated remaining: 4h 32m 46s. Rate: 7.7 symbols/min [2025-09-24T17:37:26.720852] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:26.765822] [DEBUG] [LOCAL ] BKKT: Loaded 34261 existing records from primary storage. [2025-09-24T17:37:26.766036] [INFO ] [MAIN ] BKKT: Loaded 34261 existing records. [2025-09-24T17:37:26.972528] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:37:26.973169] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-24T17:37:26.973316] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-24T17:37:26.981114] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-24T17:37:26.993780] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-24T17:37:26.994588] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T17:37:27.227232] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-24T17:37:27.405182] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:27.952103] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T17:37:28.016131] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-24T17:37:28.798951] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T17:37:28.816033] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-24T17:37:29.616051] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-24T17:37:29.807510] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T17:37:29.946710] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T17:37:30.416084] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-24T17:37:31.011197] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:37:31.216078] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-24T17:37:32.016112] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-24T17:37:32.162694] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:37:32.619897] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:37:32.816120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-24T17:37:33.616114] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-24T17:37:34.027967] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T17:37:34.352959] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:37:34.416095] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-24T17:37:34.880450] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T17:37:35.216076] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-24T17:37:35.648916] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T17:37:36.016097] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-24T17:37:36.338283] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T17:37:36.816135] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-24T17:37:37.616103] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-24T17:37:37.952094] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T17:37:37.961222] [INFO ] [REMOTE ] BKD: Full fetch complete (71455 records). [2025-09-24T17:37:37.961395] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-24T17:37:38.375435] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-24T17:37:38.375544] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-24T17:37:38.376340] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-24T17:37:38.376425] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-24T17:37:38.378289] [DEBUG] [LOCAL ] BKD: Trimmed 71455 records to 50137 (keeping 200 days of data) [2025-09-24T17:37:38.423731] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-24T17:37:38.504281] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T17:37:38.655715] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T17:37:38.743384] [DEBUG] [LOCAL ] BKD: Primary data saved (50137 records). [2025-09-24T17:37:38.743553] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-24T17:37:38.743637] [INFO ] [MAIN ] Update Progress: 287/2373 symbols completed. BKD took 34.5s. Estimated remaining: 4h 33m 10s. Rate: 7.6 symbols/min [2025-09-24T17:37:38.910705] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:38.920778] [DEBUG] [LOCAL ] BKN: Loaded 7722 existing records from primary storage. [2025-09-24T17:37:38.920954] [INFO ] [MAIN ] BKN: Loaded 7722 existing records. [2025-09-24T17:37:39.096774] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:37:39.097034] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-24T17:37:39.097083] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-24T17:37:39.097596] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-24T17:37:39.097689] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-24T17:37:39.221150] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-24T17:37:39.477949] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:39.589571] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T17:37:40.016114] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-24T17:37:40.705433] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T17:37:40.711953] [INFO ] [REMOTE ] BKE: Full fetch complete (50291 records). [2025-09-24T17:37:40.712080] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-24T17:37:40.822382] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-24T17:37:41.132471] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-24T17:37:41.132574] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-24T17:37:41.133278] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-24T17:37:41.133347] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-24T17:37:41.134761] [DEBUG] [LOCAL ] BKE: Trimmed 50291 records to 34750 (keeping 200 days of data) [2025-09-24T17:37:41.360896] [DEBUG] [LOCAL ] BKE: Primary data saved (34750 records). [2025-09-24T17:37:41.361064] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-24T17:37:41.361146] [INFO ] [MAIN ] Update Progress: 288/2373 symbols completed. BKE took 35.4s. Estimated remaining: 4h 32m 25s. Rate: 7.7 symbols/min [2025-09-24T17:37:41.538588] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:41.588534] [DEBUG] [LOCAL ] BKSY: Loaded 48276 existing records from primary storage. [2025-09-24T17:37:41.588730] [INFO ] [MAIN ] BKSY: Loaded 48276 existing records. [2025-09-24T17:37:41.621286] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-24T17:37:41.774119] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:37:41.774629] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-24T17:37:41.774792] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-24T17:37:41.782625] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-24T17:37:41.794815] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-24T17:37:41.833123] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T17:37:42.172632] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:42.324373] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:37:42.331781] [INFO ] [REMOTE ] BKH: Full fetch complete (52051 records). [2025-09-24T17:37:42.332007] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-24T17:37:42.420941] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-24T17:37:42.548934] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T17:37:42.781710] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-24T17:37:42.781805] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-24T17:37:42.782457] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-24T17:37:42.782498] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-24T17:37:42.783592] [DEBUG] [LOCAL ] BKH: Trimmed 52051 records to 36608 (keeping 200 days of data) [2025-09-24T17:37:43.016402] [DEBUG] [LOCAL ] BKH: Primary data saved (36608 records). [2025-09-24T17:37:43.016607] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-24T17:37:43.016884] [INFO ] [MAIN ] Update Progress: 289/2373 symbols completed. BKH took 26.8s. Estimated remaining: 4h 31m 32s. Rate: 7.7 symbols/min [2025-09-24T17:37:43.203601] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:37:43.216172] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-24T17:37:43.216104] [DEBUG] [LOCAL ] BKT: Loaded 10811 existing records from primary storage. [2025-09-24T17:37:43.218751] [INFO ] [MAIN ] BKT: Loaded 10811 existing records. [2025-09-24T17:37:43.413214] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:37:43.413503] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-24T17:37:43.413560] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-24T17:37:43.414071] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-24T17:37:43.414133] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-24T17:37:43.795793] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:37:43.810992] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T17:37:44.016080] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-24T17:37:44.816057] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-24T17:37:45.231154] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T17:37:45.307606] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T17:37:45.596308] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T17:37:45.616037] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-24T17:37:46.241586] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T17:37:46.416137] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-24T17:37:47.216124] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-24T17:37:47.857435] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T17:37:48.016157] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-24T17:37:48.126418] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T17:37:48.810692] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T17:37:48.816020] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-24T17:37:49.275491] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-24T17:37:49.616166] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-24T17:37:50.416195] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-24T17:37:50.842705] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T17:37:51.131960] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T17:37:51.216102] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-24T17:37:51.947630] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T17:37:52.016169] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-24T17:37:52.779953] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T17:37:52.816132] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-24T17:37:53.616139] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-24T17:37:54.416161] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-24T17:37:54.522278] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T17:37:54.774505] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T17:37:55.216131] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-24T17:37:55.928157] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T17:37:56.016089] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-24T17:37:56.298244] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T17:37:56.790046] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T17:37:56.816089] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-24T17:37:57.616082] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-24T17:37:58.416064] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-24T17:37:58.735292] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T17:37:59.134054] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T17:37:59.216088] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-24T17:37:59.259292] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T17:38:00.016094] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-24T17:38:00.790922] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T17:38:00.816129] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-24T17:38:00.921690] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T17:38:00.924036] [INFO ] [REMOTE ] BKN: Full fetch complete (11973 records). [2025-09-24T17:38:00.924117] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-24T17:38:01.297539] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-24T17:38:01.297675] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-24T17:38:01.298066] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-24T17:38:01.298111] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-24T17:38:01.298753] [DEBUG] [LOCAL ] BKN: Trimmed 11973 records to 7731 (keeping 200 days of data) [2025-09-24T17:38:01.354014] [DEBUG] [LOCAL ] BKN: Primary data saved (7731 records). [2025-09-24T17:38:01.354237] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-24T17:38:01.354365] [INFO ] [MAIN ] Update Progress: 290/2373 symbols completed. BKN took 22.6s. Estimated remaining: 4h 32m 40s. Rate: 7.6 symbols/min [2025-09-24T17:38:01.541973] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:01.591226] [DEBUG] [LOCAL ] BKU: Loaded 41950 existing records from primary storage. [2025-09-24T17:38:01.591501] [INFO ] [MAIN ] BKU: Loaded 41950 existing records. [2025-09-24T17:38:01.622688] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-24T17:38:01.779391] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:01.779749] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-24T17:38:01.779810] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-24T17:38:01.781454] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-24T17:38:01.781520] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-24T17:38:02.195280] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:02.416096] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-24T17:38:02.478097] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T17:38:02.790277] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T17:38:02.798441] [INFO ] [REMOTE ] BKKT: Full fetch complete (49729 records). [2025-09-24T17:38:02.798603] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-24T17:38:03.201000] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-24T17:38:03.201096] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-24T17:38:03.201814] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-24T17:38:03.201879] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-24T17:38:03.203053] [DEBUG] [LOCAL ] BKKT: Trimmed 49729 records to 34400 (keeping 200 days of data) [2025-09-24T17:38:03.257685] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-24T17:38:03.415631] [DEBUG] [LOCAL ] BKKT: Primary data saved (34400 records). [2025-09-24T17:38:03.415826] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-24T17:38:03.418341] [INFO ] [MAIN ] Update Progress: 291/2373 symbols completed. BKKT took 36.9s. Estimated remaining: 4h 31m 51s. Rate: 7.7 symbols/min [2025-09-24T17:38:03.588765] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:03.621768] [DEBUG] [LOCAL ] BKV: Loaded 29765 existing records from primary storage. [2025-09-24T17:38:03.621926] [INFO ] [MAIN ] BKV: Loaded 29765 existing records. [2025-09-24T17:38:03.813524] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:03.813917] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-24T17:38:03.813996] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-24T17:38:03.815255] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-24T17:38:03.815325] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-24T17:38:04.035423] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-24T17:38:04.037832] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T17:38:04.142120] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T17:38:04.258387] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:04.816096] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-24T17:38:05.616100] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-24T17:38:05.782952] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T17:38:05.815321] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T17:38:06.416083] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-24T17:38:07.216050] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-24T17:38:07.244531] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T17:38:08.016080] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-24T17:38:08.322018] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T17:38:08.788539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T17:38:08.816115] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-24T17:38:08.863698] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T17:38:09.616117] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-24T17:38:09.628214] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T17:38:10.416282] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-24T17:38:10.914993] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T17:38:11.216151] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-24T17:38:12.016119] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-24T17:38:12.499557] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-24T17:38:12.687499] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:38:12.817802] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-24T17:38:12.824570] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T17:38:13.616107] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-24T17:38:14.005070] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T17:38:14.416144] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-24T17:38:14.778629] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T17:38:14.784232] [INFO ] [REMOTE ] BKT: Full fetch complete (14987 records). [2025-09-24T17:38:14.784423] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-24T17:38:15.221427] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-24T17:38:15.334139] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-24T17:38:15.334280] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-24T17:38:15.335101] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-24T17:38:15.335191] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-24T17:38:15.336371] [DEBUG] [LOCAL ] BKT: Trimmed 14987 records to 10910 (keeping 200 days of data) [2025-09-24T17:38:15.446757] [DEBUG] [LOCAL ] BKT: Primary data saved (10910 records). [2025-09-24T17:38:15.446951] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-24T17:38:15.447076] [INFO ] [MAIN ] Update Progress: 292/2373 symbols completed. BKT took 32.4s. Estimated remaining: 4h 32m 13s. Rate: 7.6 symbols/min [2025-09-24T17:38:15.692988] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:15.720925] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T17:38:15.780424] [DEBUG] [LOCAL ] BLCO: Loaded 35761 existing records from primary storage. [2025-09-24T17:38:15.780687] [INFO ] [MAIN ] BLCO: Loaded 35761 existing records. [2025-09-24T17:38:15.978151] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:15.978441] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-24T17:38:15.978542] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-24T17:38:15.979479] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-24T17:38:15.979553] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-24T17:38:16.022266] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-24T17:38:16.377253] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:16.816128] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-24T17:38:17.269124] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T17:38:17.616083] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-24T17:38:17.718519] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T17:38:17.925546] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T17:38:18.416137] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-24T17:38:18.935870] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T17:38:19.216086] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-24T17:38:19.768982] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T17:38:20.016185] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-24T17:38:20.816114] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-24T17:38:21.223628] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T17:38:21.282082] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T17:38:21.291484] [INFO ] [REMOTE ] BKSY: Full fetch complete (69355 records). [2025-09-24T17:38:21.291632] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-24T17:38:21.621189] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-24T17:38:21.699639] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-24T17:38:21.699763] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-24T17:38:21.700562] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-24T17:38:21.700630] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-24T17:38:21.702171] [DEBUG] [LOCAL ] BKSY: Trimmed 69355 records to 48281 (keeping 200 days of data) [2025-09-24T17:38:22.025783] [DEBUG] [LOCAL ] BKSY: Primary data saved (48281 records). [2025-09-24T17:38:22.026243] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-24T17:38:22.026496] [INFO ] [MAIN ] Update Progress: 293/2373 symbols completed. BKSY took 40.7s. Estimated remaining: 4h 31m 56s. Rate: 7.6 symbols/min [2025-09-24T17:38:22.225753] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:22.222628] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T17:38:22.263100] [DEBUG] [LOCAL ] BLD: Loaded 28198 existing records from primary storage. [2025-09-24T17:38:22.263271] [INFO ] [MAIN ] BLD: Loaded 28198 existing records. [2025-09-24T17:38:22.427242] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-24T17:38:22.476108] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:22.476392] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-24T17:38:22.476452] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-24T17:38:22.477342] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-24T17:38:22.477403] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-24T17:38:22.872132] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:23.082440] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T17:38:23.216074] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-24T17:38:23.812629] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T17:38:24.016047] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-24T17:38:24.199298] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T17:38:24.816086] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-24T17:38:25.540284] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T17:38:25.616073] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-24T17:38:25.974949] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T17:38:26.416111] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-24T17:38:27.085855] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T17:38:27.216128] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-24T17:38:27.919320] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T17:38:28.016123] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-24T17:38:28.357498] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T17:38:28.816127] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-24T17:38:29.195733] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T17:38:29.200601] [INFO ] [REMOTE ] BKV: Full fetch complete (44881 records). [2025-09-24T17:38:29.200845] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-24T17:38:29.615343] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-24T17:38:29.615487] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-24T17:38:29.616392] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-24T17:38:29.616553] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-24T17:38:29.616699] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-24T17:38:29.619785] [DEBUG] [LOCAL ] BKV: Trimmed 44881 records to 29686 (keeping 200 days of data) [2025-09-24T17:38:29.802361] [DEBUG] [LOCAL ] BKV: Primary data saved (29686 records). [2025-09-24T17:38:29.802517] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-24T17:38:29.802701] [INFO ] [MAIN ] Update Progress: 294/2373 symbols completed. BKV took 26.4s. Estimated remaining: 4h 31m 48s. Rate: 7.6 symbols/min [2025-09-24T17:38:29.981729] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:30.044402] [DEBUG] [LOCAL ] BLDR: Loaded 51666 existing records from primary storage. [2025-09-24T17:38:30.044568] [INFO ] [MAIN ] BLDR: Loaded 51666 existing records. [2025-09-24T17:38:30.239191] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:30.239673] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-24T17:38:30.239804] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-24T17:38:30.241416] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-24T17:38:30.241493] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-24T17:38:30.424777] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-24T17:38:30.455344] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T17:38:30.582520] [INFO ] [REMOTE ] BKU: Full fetch complete (59705 records). [2025-09-24T17:38:30.605167] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-24T17:38:30.740241] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:31.161898] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-24T17:38:31.165859] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-24T17:38:31.167007] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-24T17:38:31.167091] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-24T17:38:31.171474] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T17:38:31.182391] [DEBUG] [LOCAL ] BKU: Trimmed 59705 records to 41905 (keeping 200 days of data) [2025-09-24T17:38:31.250485] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-24T17:38:31.458269] [DEBUG] [LOCAL ] BKU: Primary data saved (41905 records). [2025-09-24T17:38:31.458419] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-24T17:38:31.458620] [INFO ] [MAIN ] Update Progress: 295/2373 symbols completed. BKU took 30.1s. Estimated remaining: 4h 30m 56s. Rate: 7.7 symbols/min [2025-09-24T17:38:31.635533] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:31.653054] [DEBUG] [LOCAL ] BLE: Loaded 14633 existing records from primary storage. [2025-09-24T17:38:31.653235] [INFO ] [MAIN ] BLE: Loaded 14633 existing records. [2025-09-24T17:38:31.846383] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:31.846756] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-24T17:38:31.847499] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-24T17:38:31.848238] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-24T17:38:31.848690] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-24T17:38:31.999546] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T17:38:32.031247] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-24T17:38:32.254755] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:32.816044] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-24T17:38:33.175982] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:38:33.197272] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T17:38:33.616075] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-24T17:38:33.982548] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T17:38:34.416186] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-24T17:38:34.769225] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T17:38:35.216083] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-24T17:38:36.016060] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-24T17:38:36.063221] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T17:38:36.270135] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T17:38:36.816135] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-24T17:38:37.246066] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T17:38:37.616081] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-24T17:38:38.380269] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T17:38:38.416034] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-24T17:38:38.862847] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:38:39.216146] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-24T17:38:40.016094] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-24T17:38:40.309474] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T17:38:40.541266] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T17:38:40.554721] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T17:38:40.816118] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-24T17:38:41.616108] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-24T17:38:41.656723] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T17:38:42.416080] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-24T17:38:43.216054] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-24T17:38:43.581770] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T17:38:43.998437] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T17:38:44.016039] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-24T17:38:44.240528] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T17:38:44.816079] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-24T17:38:45.616144] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-24T17:38:45.847888] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:38:45.873844] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T17:38:46.416081] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-24T17:38:46.504548] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:38:47.216097] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-24T17:38:47.596683] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T17:38:48.016128] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-24T17:38:48.219995] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T17:38:48.816078] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-24T17:38:49.616044] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-24T17:38:49.671808] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T17:38:49.938146] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T17:38:50.391907] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T17:38:50.416034] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-24T17:38:51.214681] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T17:38:51.217683] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-24T17:38:52.016096] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-24T17:38:52.816121] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-24T17:38:53.066586] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:38:53.139863] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T17:38:53.616089] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-24T17:38:53.973760] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T17:38:54.416084] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-24T17:38:55.080117] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T17:38:55.216052] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-24T17:38:55.243530] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T17:38:55.246284] [INFO ] [REMOTE ] BLE: Full fetch complete (20571 records). [2025-09-24T17:38:55.246361] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-24T17:38:55.618499] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-24T17:38:55.618581] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-24T17:38:55.618993] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-24T17:38:55.619121] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-24T17:38:55.619796] [DEBUG] [LOCAL ] BLE: Trimmed 20571 records to 14568 (keeping 200 days of data) [2025-09-24T17:38:55.710281] [DEBUG] [LOCAL ] BLE: Primary data saved (14568 records). [2025-09-24T17:38:55.710442] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-24T17:38:55.710552] [INFO ] [MAIN ] Update Progress: 296/2373 symbols completed. BLE took 24.3s. Estimated remaining: 4h 32m 44s. Rate: 7.6 symbols/min [2025-09-24T17:38:55.897139] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:55.938470] [DEBUG] [LOCAL ] BLK: Loaded 34927 existing records from primary storage. [2025-09-24T17:38:55.938622] [INFO ] [MAIN ] BLK: Loaded 34927 existing records. [2025-09-24T17:38:56.021296] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-24T17:38:56.126443] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:56.126855] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-24T17:38:56.126944] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-24T17:38:56.128388] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-24T17:38:56.128453] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-24T17:38:56.494125] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:56.593834] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T17:38:56.599411] [INFO ] [REMOTE ] BLD: Full fetch complete (40460 records). [2025-09-24T17:38:56.599587] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-24T17:38:56.824563] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-24T17:38:57.006622] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-24T17:38:57.006747] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-24T17:38:57.007356] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-24T17:38:57.007398] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-24T17:38:57.008470] [DEBUG] [LOCAL ] BLD: Trimmed 40460 records to 28097 (keeping 200 days of data) [2025-09-24T17:38:57.193341] [DEBUG] [LOCAL ] BLD: Primary data saved (28097 records). [2025-09-24T17:38:57.193509] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-24T17:38:57.193602] [INFO ] [MAIN ] Update Progress: 297/2373 symbols completed. BLD took 35.2s. Estimated remaining: 4h 31m 51s. Rate: 7.6 symbols/min [2025-09-24T17:38:57.363724] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:57.419025] [DEBUG] [LOCAL ] BLND: Loaded 49485 existing records from primary storage. [2025-09-24T17:38:57.419728] [INFO ] [MAIN ] BLND: Loaded 49485 existing records. [2025-09-24T17:38:57.601061] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:38:57.601733] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-24T17:38:57.601809] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-24T17:38:57.603753] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-24T17:38:57.603817] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-24T17:38:57.635239] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-24T17:38:57.999621] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-24T17:38:58.003485] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:58.325868] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:38:58.331496] [INFO ] [REMOTE ] BLCO: Full fetch complete (52615 records). [2025-09-24T17:38:58.331743] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-24T17:38:58.425286] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-24T17:38:58.724721] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-24T17:38:58.724824] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-24T17:38:58.725451] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-24T17:38:58.725495] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-24T17:38:58.728896] [DEBUG] [LOCAL ] BLCO: Trimmed 52615 records to 35617 (keeping 200 days of data) [2025-09-24T17:38:58.952781] [DEBUG] [LOCAL ] BLCO: Primary data saved (35617 records). [2025-09-24T17:38:58.952979] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-24T17:38:58.953137] [INFO ] [MAIN ] Update Progress: 298/2373 symbols completed. BLCO took 43.5s. Estimated remaining: 4h 31m 1s. Rate: 7.7 symbols/min [2025-09-24T17:38:59.148158] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:38:59.148341] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-24T17:38:59.148378] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-24T17:38:59.148522] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-24T17:38:59.148565] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-24T17:38:59.148607] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-24T17:38:59.148639] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-24T17:38:59.217137] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-24T17:38:59.518239] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:38:59.547360] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T17:39:00.016138] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-24T17:39:00.430922] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T17:39:00.440143] [INFO ] [REMOTE ] BLDR: Full fetch complete (74330 records). [2025-09-24T17:39:00.440290] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-24T17:39:00.834065] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-24T17:39:00.830475] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-24T17:39:00.834195] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-24T17:39:00.835195] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-24T17:39:00.835906] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-24T17:39:00.837635] [DEBUG] [LOCAL ] BLDR: Trimmed 74330 records to 51664 (keeping 200 days of data) [2025-09-24T17:39:01.123130] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:01.129507] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-24T17:39:01.168468] [DEBUG] [LOCAL ] BLDR: Primary data saved (51664 records). [2025-09-24T17:39:01.168627] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-24T17:39:01.168752] [INFO ] [MAIN ] Update Progress: 299/2373 symbols completed. BLDR took 31.4s. Estimated remaining: 4h 30m 14s. Rate: 7.7 symbols/min [2025-09-24T17:39:01.372667] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:01.379800] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-24T17:39:01.412496] [DEBUG] [LOCAL ] BLW: Loaded 12741 existing records from primary storage. [2025-09-24T17:39:01.412781] [INFO ] [MAIN ] BLW: Loaded 12741 existing records. [2025-09-24T17:39:01.622432] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-24T17:39:01.658805] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:01.659131] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-24T17:39:01.659195] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-24T17:39:01.659793] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-24T17:39:01.659856] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-24T17:39:02.061402] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:02.206542] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-24T17:39:02.416124] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-24T17:39:03.216147] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-24T17:39:03.315000] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:03.315351] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-24T17:39:04.016132] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-24T17:39:04.486943] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:04.487286] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-24T17:39:04.816090] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-24T17:39:05.030336] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:05.030705] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-24T17:39:05.620670] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-24T17:39:05.642538] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-24T17:39:05.687053] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (3.27 seconds). [2025-09-24T17:39:06.416117] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-24T17:39:06.556475] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-24T17:39:06.614553] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:06.615000] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-24T17:39:07.216136] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-24T17:39:07.415211] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:07.415711] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-24T17:39:08.016162] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-24T17:39:08.214190] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:08.214632] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-24T17:39:08.816084] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-24T17:39:09.025297] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:39:09.025635] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-24T17:39:09.616099] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-24T17:39:10.416127] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-24T17:39:11.216070] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-24T17:39:11.394242] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:39:11.531421] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T17:39:12.016085] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-24T17:39:12.816047] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-24T17:39:12.954864] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T17:39:13.006330] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T17:39:13.616095] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-24T17:39:14.416161] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-24T17:39:14.675831] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T17:39:14.995198] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T17:39:15.216090] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-24T17:39:15.287601] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T17:39:16.016112] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-24T17:39:16.816086] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-24T17:39:17.616066] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-24T17:39:17.974634] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-24T17:39:18.336944] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T17:39:18.416045] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-24T17:39:19.004036] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-24T17:39:19.003795] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-24T17:39:19.216098] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-24T17:39:19.349108] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-24T17:39:19.359268] [INFO ] [REMOTE ] BLSH: Full fetch complete (11438 records). [2025-09-24T17:39:19.359445] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-24T17:39:19.549130] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-24T17:39:19.549426] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:39:19.549517] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:39:19.549595] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-24T17:39:19.549692] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-24T17:39:19.549798] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-24T17:39:19.549882] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-24T17:39:19.549971] [INFO ] [MAIN ] Update Progress: 300/2373 symbols completed. BLSH took 20.6s. Estimated remaining: 4h 31m 19s. Rate: 7.6 symbols/min [2025-09-24T17:39:19.722154] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:19.739737] [DEBUG] [LOCAL ] BLX: Loaded 15743 existing records from primary storage. [2025-09-24T17:39:19.739867] [INFO ] [MAIN ] BLX: Loaded 15743 existing records. [2025-09-24T17:39:19.921689] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:19.921963] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-24T17:39:19.922013] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-24T17:39:19.922546] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-24T17:39:19.922605] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-24T17:39:20.021373] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-24T17:39:20.279664] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:20.816111] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-24T17:39:20.968903] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:39:20.975040] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:39:21.616110] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-24T17:39:21.877303] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T17:39:22.412722] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T17:39:22.416022] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-24T17:39:23.216054] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-24T17:39:23.226003] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T17:39:24.016103] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-24T17:39:24.816092] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-24T17:39:25.018568] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T17:39:25.020885] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:39:25.035297] [INFO ] [REMOTE ] BLW: Full fetch complete (18856 records). [2025-09-24T17:39:25.035575] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-24T17:39:25.408984] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-24T17:39:25.409088] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-24T17:39:25.409574] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-24T17:39:25.409618] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-24T17:39:25.410407] [DEBUG] [LOCAL ] BLW: Trimmed 18856 records to 12773 (keeping 200 days of data) [2025-09-24T17:39:25.491931] [DEBUG] [LOCAL ] BLW: Primary data saved (12773 records). [2025-09-24T17:39:25.492101] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-24T17:39:25.492193] [INFO ] [MAIN ] Update Progress: 301/2373 symbols completed. BLW took 24.3s. Estimated remaining: 4h 30m 58s. Rate: 7.6 symbols/min [2025-09-24T17:39:25.635415] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-24T17:39:25.668897] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:25.709965] [DEBUG] [LOCAL ] BMA: Loaded 34895 existing records from primary storage. [2025-09-24T17:39:25.710173] [INFO ] [MAIN ] BMA: Loaded 34895 existing records. [2025-09-24T17:39:25.823576] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T17:39:25.912763] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:25.913022] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-24T17:39:25.913069] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-24T17:39:25.914357] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-24T17:39:25.914419] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-24T17:39:26.284310] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:26.416107] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-24T17:39:27.216162] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-24T17:39:27.517219] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T17:39:27.834435] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T17:39:28.016138] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-24T17:39:28.052191] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T17:39:28.816085] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-24T17:39:29.616101] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-24T17:39:30.207556] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T17:39:30.416106] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-24T17:39:30.464372] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T17:39:31.216136] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-24T17:39:31.895574] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T17:39:32.016126] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-24T17:39:32.213123] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-24T17:39:32.416469] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T17:39:32.816174] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-24T17:39:33.195598] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T17:39:33.616157] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-24T17:39:34.416055] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-24T17:39:34.616719] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T17:39:34.867864] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T17:39:35.216094] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-24T17:39:36.016097] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-24T17:39:36.065150] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T17:39:36.300060] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T17:39:36.816161] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-24T17:39:37.616113] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-24T17:39:37.723942] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T17:39:37.734220] [INFO ] [REMOTE ] BLND: Full fetch complete (72300 records). [2025-09-24T17:39:37.734482] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-24T17:39:38.185638] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-24T17:39:38.185842] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-24T17:39:38.186864] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-24T17:39:38.186933] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-24T17:39:38.188866] [DEBUG] [LOCAL ] BLND: Trimmed 72300 records to 49442 (keeping 200 days of data) [2025-09-24T17:39:38.420059] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-24T17:39:38.431238] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T17:39:38.439158] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T17:39:38.532664] [DEBUG] [LOCAL ] BLND: Primary data saved (49442 records). [2025-09-24T17:39:38.532897] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-24T17:39:38.533018] [INFO ] [MAIN ] Update Progress: 302/2373 symbols completed. BLND took 41.3s. Estimated remaining: 4h 31m 26s. Rate: 7.6 symbols/min [2025-09-24T17:39:38.718256] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:38.733075] [DEBUG] [LOCAL ] BME: Loaded 10811 existing records from primary storage. [2025-09-24T17:39:38.733295] [INFO ] [MAIN ] BME: Loaded 10811 existing records. [2025-09-24T17:39:39.058823] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:39.059169] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-24T17:39:39.059262] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-24T17:39:39.059971] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-24T17:39:39.060034] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-24T17:39:39.221243] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-24T17:39:39.467722] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:39.765368] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T17:39:40.016086] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-24T17:39:40.816134] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-24T17:39:40.977298] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T17:39:40.984709] [INFO ] [REMOTE ] BLK: Full fetch complete (52868 records). [2025-09-24T17:39:40.984951] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-24T17:39:41.382598] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-24T17:39:41.382818] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-24T17:39:41.384036] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-24T17:39:41.384294] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-24T17:39:41.386022] [DEBUG] [LOCAL ] BLK: Trimmed 52868 records to 34754 (keeping 200 days of data) [2025-09-24T17:39:41.495805] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T17:39:41.528301] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T17:39:41.636970] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-24T17:39:41.670532] [DEBUG] [LOCAL ] BLK: Primary data saved (34754 records). [2025-09-24T17:39:41.670753] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-24T17:39:41.670864] [INFO ] [MAIN ] Update Progress: 303/2373 symbols completed. BLK took 46.0s. Estimated remaining: 4h 30m 46s. Rate: 7.6 symbols/min [2025-09-24T17:39:41.846372] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:41.875064] [DEBUG] [LOCAL ] BMEZ: Loaded 26034 existing records from primary storage. [2025-09-24T17:39:41.875235] [INFO ] [MAIN ] BMEZ: Loaded 26034 existing records. [2025-09-24T17:39:42.065836] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:42.066181] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-24T17:39:42.066253] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-24T17:39:42.067399] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-24T17:39:42.067464] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-24T17:39:42.430223] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-24T17:39:42.490515] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:43.047160] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T17:39:43.177180] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T17:39:43.216039] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-24T17:39:44.016181] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-24T17:39:44.580748] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T17:39:44.816083] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-24T17:39:45.211126] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T17:39:45.616087] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-24T17:39:46.234417] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T17:39:46.416112] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-24T17:39:46.562816] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T17:39:47.216108] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-24T17:39:47.466171] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T17:39:48.016084] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-24T17:39:48.821679] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-24T17:39:48.832361] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T17:39:48.841036] [INFO ] [REMOTE ] BMA: Full fetch complete (51187 records). [2025-09-24T17:39:48.841160] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-24T17:39:49.023472] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T17:39:49.285798] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-24T17:39:49.285933] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-24T17:39:49.286698] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-24T17:39:49.286778] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-24T17:39:49.288625] [DEBUG] [LOCAL ] BMA: Trimmed 51187 records to 35033 (keeping 200 days of data) [2025-09-24T17:39:49.537301] [DEBUG] [LOCAL ] BMA: Primary data saved (35033 records). [2025-09-24T17:39:49.537531] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-24T17:39:49.538779] [INFO ] [MAIN ] Update Progress: 304/2373 symbols completed. BMA took 24.0s. Estimated remaining: 4h 30m 38s. Rate: 7.6 symbols/min [2025-09-24T17:39:49.621266] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-24T17:39:49.747736] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:49.776390] [DEBUG] [LOCAL ] BMI: Loaded 24187 existing records from primary storage. [2025-09-24T17:39:49.776632] [INFO ] [MAIN ] BMI: Loaded 24187 existing records. [2025-09-24T17:39:49.902017] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T17:39:49.919818] [INFO ] [REMOTE ] BLX: Full fetch complete (22737 records). [2025-09-24T17:39:49.950067] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-24T17:39:49.992304] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:50.074266] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-24T17:39:50.083046] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-24T17:39:50.105214] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-24T17:39:50.117197] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-24T17:39:50.460570] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-24T17:39:50.756145] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-24T17:39:50.781088] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-24T17:39:50.819284] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-24T17:39:50.825031] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:50.825320] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-24T17:39:50.842534] [DEBUG] [LOCAL ] BLX: Trimmed 22737 records to 15678 (keeping 200 days of data) [2025-09-24T17:39:50.842426] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T17:39:50.946719] [DEBUG] [LOCAL ] BLX: Primary data saved (15678 records). [2025-09-24T17:39:50.946890] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-24T17:39:50.946988] [INFO ] [MAIN ] Update Progress: 305/2373 symbols completed. BLX took 31.4s. Estimated remaining: 4h 29m 46s. Rate: 7.7 symbols/min [2025-09-24T17:39:51.118409] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:39:51.123599] [DEBUG] [LOCAL ] BMN: Loaded 2537 existing records from primary storage. [2025-09-24T17:39:51.123705] [INFO ] [MAIN ] BMN: Loaded 2537 existing records. [2025-09-24T17:39:51.221829] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-24T17:39:51.309107] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:39:51.309395] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-24T17:39:51.309445] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-24T17:39:51.309714] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-24T17:39:51.309775] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-24T17:39:51.394544] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T17:39:51.668350] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:39:52.016093] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-24T17:39:52.446128] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:39:52.589736] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T17:39:52.816077] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-24T17:39:53.616049] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-24T17:39:53.743041] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T17:39:54.290599] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-24T17:39:54.416103] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-24T17:39:55.216125] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-24T17:39:55.753439] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T17:39:55.991147] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T17:39:56.016054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-24T17:39:56.779408] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T17:39:56.816083] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-24T17:39:57.616046] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-24T17:39:57.766540] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T17:39:58.093760] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T17:39:58.416083] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-24T17:39:59.216083] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-24T17:39:59.832284] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T17:40:00.016121] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-24T17:40:00.110358] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T17:40:00.816123] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-24T17:40:01.079399] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T17:40:01.616142] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-24T17:40:01.862927] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T17:40:02.416125] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-24T17:40:02.859844] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T17:40:03.090203] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:40:03.216150] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-24T17:40:04.016115] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-24T17:40:04.416245] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T17:40:04.816187] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-24T17:40:05.214690] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T17:40:05.616155] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-24T17:40:05.952523] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T17:40:06.416131] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-24T17:40:06.624565] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T17:40:06.627142] [INFO ] [REMOTE ] BME: Full fetch complete (16084 records). [2025-09-24T17:40:06.627216] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-24T17:40:06.986864] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T17:40:06.996230] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-24T17:40:06.997668] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-24T17:40:06.998048] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-24T17:40:06.998092] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-24T17:40:06.998583] [DEBUG] [LOCAL ] BME: Trimmed 16084 records to 10831 (keeping 200 days of data) [2025-09-24T17:40:07.066118] [DEBUG] [LOCAL ] BME: Primary data saved (10831 records). [2025-09-24T17:40:07.066256] [INFO ] [MAIN ] BME: Full history saved. [2025-09-24T17:40:07.066346] [INFO ] [MAIN ] Update Progress: 306/2373 symbols completed. BME took 28.5s. Estimated remaining: 4h 30m 35s. Rate: 7.6 symbols/min [2025-09-24T17:40:07.235333] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:07.232762] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-24T17:40:07.276328] [DEBUG] [LOCAL ] BMO: Loaded 41304 existing records from primary storage. [2025-09-24T17:40:07.276549] [INFO ] [MAIN ] BMO: Loaded 41304 existing records. [2025-09-24T17:40:07.452283] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:07.452556] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-24T17:40:07.452604] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-24T17:40:07.453768] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-24T17:40:07.453830] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-24T17:40:07.810626] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:08.016068] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-24T17:40:08.429136] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:40:08.816128] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-24T17:40:09.616066] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-24T17:40:09.759390] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:40:09.946338] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-24T17:40:10.030795] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:40:10.416188] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-24T17:40:11.216150] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-24T17:40:11.939717] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T17:40:12.016053] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-24T17:40:12.293222] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T17:40:12.816199] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-24T17:40:13.289822] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T17:40:13.292299] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T17:40:13.616084] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-24T17:40:14.416085] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-24T17:40:14.792880] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T17:40:15.216122] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-24T17:40:15.624986] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T17:40:16.016171] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-24T17:40:16.438185] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T17:40:16.816078] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-24T17:40:17.000374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T17:40:17.616092] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-24T17:40:18.035130] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T17:40:18.042682] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41021 records). [2025-09-24T17:40:18.042843] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-24T17:40:18.418786] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-24T17:40:18.434918] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-24T17:40:18.435082] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-24T17:40:18.435795] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-24T17:40:18.435865] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-24T17:40:18.437307] [DEBUG] [LOCAL ] BMEZ: Trimmed 41021 records to 26022 (keeping 200 days of data) [2025-09-24T17:40:18.604255] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26022 records). [2025-09-24T17:40:18.604421] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-24T17:40:18.604516] [INFO ] [MAIN ] Update Progress: 307/2373 symbols completed. BMEZ took 36.9s. Estimated remaining: 4h 30m 52s. Rate: 7.6 symbols/min [2025-09-24T17:40:18.778448] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:18.834863] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-24T17:40:18.835026] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-24T17:40:19.013140] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:19.013564] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-24T17:40:19.013621] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-24T17:40:19.016403] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-24T17:40:19.016466] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-24T17:40:19.223410] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-24T17:40:19.386968] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:19.543005] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T17:40:19.577501] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T17:40:20.016095] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-24T17:40:20.500919] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T17:40:20.816122] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-24T17:40:21.616077] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-24T17:40:22.137635] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-24T17:40:22.193168] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T17:40:22.416098] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-24T17:40:23.014908] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T17:40:23.020433] [INFO ] [REMOTE ] BMI: Full fetch complete (32865 records). [2025-09-24T17:40:23.020547] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-24T17:40:23.221319] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-24T17:40:23.395606] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-24T17:40:23.395728] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-24T17:40:23.396204] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-24T17:40:23.396249] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-24T17:40:23.397278] [DEBUG] [LOCAL ] BMI: Trimmed 32865 records to 24210 (keeping 200 days of data) [2025-09-24T17:40:23.549741] [DEBUG] [LOCAL ] BMI: Primary data saved (24210 records). [2025-09-24T17:40:23.549893] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-24T17:40:23.549979] [INFO ] [MAIN ] Update Progress: 308/2373 symbols completed. BMI took 34.0s. Estimated remaining: 4h 30m 24s. Rate: 7.6 symbols/min [2025-09-24T17:40:23.743963] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:23.798558] [DEBUG] [LOCAL ] BN: Loaded 52994 existing records from primary storage. [2025-09-24T17:40:23.798816] [INFO ] [MAIN ] BN: Loaded 52994 existing records. [2025-09-24T17:40:23.981584] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:23.982318] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-24T17:40:23.982415] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-24T17:40:23.983934] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-24T17:40:23.984001] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-24T17:40:24.028444] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-24T17:40:24.369029] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:24.404586] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T17:40:24.585944] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T17:40:24.687512] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T17:40:24.816099] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-24T17:40:25.616123] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-24T17:40:26.416095] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-24T17:40:26.683453] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T17:40:26.989329] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T17:40:26.990458] [INFO ] [REMOTE ] BMN: Full fetch complete (3711 records). [2025-09-24T17:40:26.990529] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-24T17:40:27.226712] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-24T17:40:27.325997] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T17:40:27.417745] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-24T17:40:27.417849] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-24T17:40:27.418059] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-24T17:40:27.418136] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-24T17:40:27.418585] [DEBUG] [LOCAL ] BMN: Trimmed 3711 records to 2520 (keeping 200 days of data) [2025-09-24T17:40:27.434614] [DEBUG] [LOCAL ] BMN: Primary data saved (2520 records). [2025-09-24T17:40:27.434705] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-24T17:40:27.434790] [INFO ] [MAIN ] Update Progress: 309/2373 symbols completed. BMN took 36.5s. Estimated remaining: 4h 29m 50s. Rate: 7.6 symbols/min [2025-09-24T17:40:27.602523] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:27.632495] [DEBUG] [LOCAL ] BNED: Loaded 29989 existing records from primary storage. [2025-09-24T17:40:27.632665] [INFO ] [MAIN ] BNED: Loaded 29989 existing records. [2025-09-24T17:40:27.808614] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:27.808955] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-24T17:40:27.809008] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-24T17:40:27.811294] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-24T17:40:27.811365] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-24T17:40:28.021348] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-24T17:40:28.164401] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:28.816139] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-24T17:40:29.194050] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:40:29.616092] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-24T17:40:29.679085] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T17:40:30.416092] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-24T17:40:30.484414] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T17:40:31.216101] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-24T17:40:31.297034] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T17:40:32.016085] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-24T17:40:32.678621] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-24T17:40:32.686333] [INFO ] [REMOTE ] BMO: Full fetch complete (59856 records). [2025-09-24T17:40:32.686468] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-24T17:40:32.825537] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-24T17:40:33.076346] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-24T17:40:33.076434] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-24T17:40:33.077266] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-24T17:40:33.077335] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-24T17:40:33.078621] [DEBUG] [LOCAL ] BMO: Trimmed 59856 records to 41316 (keeping 200 days of data) [2025-09-24T17:40:33.374187] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T17:40:33.387911] [DEBUG] [LOCAL ] BMO: Primary data saved (41316 records). [2025-09-24T17:40:33.388077] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-24T17:40:33.388174] [INFO ] [MAIN ] Update Progress: 310/2373 symbols completed. BMO took 26.3s. Estimated remaining: 4h 29m 29s. Rate: 7.7 symbols/min [2025-09-24T17:40:33.562258] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:33.569338] [DEBUG] [LOCAL ] BNH: Loaded 4838 existing records from primary storage. [2025-09-24T17:40:33.569481] [INFO ] [MAIN ] BNH: Loaded 4838 existing records. [2025-09-24T17:40:33.627707] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-24T17:40:33.760930] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:33.761324] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-24T17:40:33.761575] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-24T17:40:33.761990] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-24T17:40:33.762103] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-24T17:40:34.071864] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T17:40:34.167146] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:34.415238] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T17:40:34.423231] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-24T17:40:35.069963] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T17:40:35.216103] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-24T17:40:35.822754] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T17:40:35.945563] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-24T17:40:36.016096] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-24T17:40:36.816145] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-24T17:40:37.387945] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T17:40:37.616128] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-24T17:40:37.990932] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T17:40:38.166107] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:40:38.416096] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-24T17:40:39.216092] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-24T17:40:39.850131] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T17:40:40.016041] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-24T17:40:40.376021] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T17:40:40.816113] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-24T17:40:41.174100] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T17:40:41.420026] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T17:40:41.616121] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-24T17:40:42.416091] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-24T17:40:43.216061] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-24T17:40:43.566918] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T17:40:43.638062] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T17:40:43.744514] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T17:40:44.016243] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-24T17:40:44.816125] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-24T17:40:45.456122] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T17:40:45.616103] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-24T17:40:45.911584] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T17:40:46.416089] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-24T17:40:47.216105] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-24T17:40:47.629502] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T17:40:48.016062] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-24T17:40:48.250501] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:40:48.816129] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-24T17:40:49.001606] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T17:40:49.012662] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-24T17:40:49.012879] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-24T17:40:49.223809] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T17:40:49.451383] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-24T17:40:49.451482] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-24T17:40:49.452398] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-24T17:40:49.452501] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-24T17:40:49.454628] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-24T17:40:49.558434] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T17:40:49.652131] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-24T17:40:49.819966] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-24T17:40:49.820190] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-24T17:40:49.820423] [INFO ] [MAIN ] Update Progress: 311/2373 symbols completed. BMY took 31.2s. Estimated remaining: 4h 30m 18s. Rate: 7.6 symbols/min [2025-09-24T17:40:49.994397] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:49.999442] [DEBUG] [LOCAL ] BNJ: Loaded 2584 existing records from primary storage. [2025-09-24T17:40:49.999542] [INFO ] [MAIN ] BNJ: Loaded 2584 existing records. [2025-09-24T17:40:50.173661] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:50.173987] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-24T17:40:50.174054] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-24T17:40:50.174300] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-24T17:40:50.174376] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-24T17:40:50.427250] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-24T17:40:50.599626] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:50.982042] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T17:40:51.216082] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-24T17:40:52.016055] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-24T17:40:52.228125] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T17:40:52.368739] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T17:40:52.584084] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T17:40:52.585521] [INFO ] [REMOTE ] BNH: Full fetch complete (6820 records). [2025-09-24T17:40:52.585596] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-24T17:40:52.821259] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-24T17:40:52.973777] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-24T17:40:52.973857] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-24T17:40:52.974053] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-24T17:40:52.974103] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-24T17:40:52.974518] [DEBUG] [LOCAL ] BNH: Trimmed 6820 records to 4826 (keeping 200 days of data) [2025-09-24T17:40:53.007493] [DEBUG] [LOCAL ] BNH: Primary data saved (4826 records). [2025-09-24T17:40:53.007602] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-24T17:40:53.007710] [INFO ] [MAIN ] Update Progress: 312/2373 symbols completed. BNH took 19.6s. Estimated remaining: 4h 29m 40s. Rate: 7.6 symbols/min [2025-09-24T17:40:53.208241] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:40:53.291812] [DEBUG] [LOCAL ] BNL: Loaded 46871 existing records from primary storage. [2025-09-24T17:40:53.292058] [INFO ] [MAIN ] BNL: Loaded 46871 existing records. [2025-09-24T17:40:53.538968] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:40:53.539371] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-24T17:40:53.539447] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-24T17:40:53.540919] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-24T17:40:53.541003] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-24T17:40:53.621734] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-24T17:40:54.125877] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:40:54.359743] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T17:40:54.416100] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-24T17:40:54.695720] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T17:40:55.216093] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-24T17:40:55.670119] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T17:40:56.016271] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-24T17:40:56.017804] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T17:40:56.816148] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-24T17:40:57.616068] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-24T17:40:57.869008] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T17:40:57.900171] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T17:40:58.158976] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T17:40:58.416103] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-24T17:40:59.216116] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-24T17:40:59.440890] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:41:00.016102] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-24T17:41:00.672751] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T17:41:00.816090] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-24T17:41:01.134799] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T17:41:01.144278] [INFO ] [REMOTE ] BN: Full fetch complete (76631 records). [2025-09-24T17:41:01.144443] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-24T17:41:01.280317] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-24T17:41:01.567552] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-24T17:41:01.567687] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-24T17:41:01.568597] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-24T17:41:01.568714] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-24T17:41:01.570790] [DEBUG] [LOCAL ] BN: Trimmed 76631 records to 52994 (keeping 200 days of data) [2025-09-24T17:41:01.641291] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-24T17:41:01.949031] [DEBUG] [LOCAL ] BN: Primary data saved (52994 records). [2025-09-24T17:41:01.949583] [INFO ] [MAIN ] BN: Full history saved. [2025-09-24T17:41:01.951002] [INFO ] [MAIN ] Update Progress: 313/2373 symbols completed. BN took 38.4s. Estimated remaining: 4h 29m 39s. Rate: 7.6 symbols/min [2025-09-24T17:41:02.126581] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:02.182438] [DEBUG] [LOCAL ] BNS: Loaded 51460 existing records from primary storage. [2025-09-24T17:41:02.182600] [INFO ] [MAIN ] BNS: Loaded 51460 existing records. [2025-09-24T17:41:02.359912] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:02.360218] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-24T17:41:02.360279] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-24T17:41:02.361561] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-24T17:41:02.361633] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-24T17:41:02.423875] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-24T17:41:02.729415] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:03.216076] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-24T17:41:03.248924] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T17:41:03.700560] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T17:41:03.732575] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T17:41:04.016217] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-24T17:41:04.816127] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-24T17:41:05.232091] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:41:05.616136] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-24T17:41:06.416109] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-24T17:41:06.527592] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T17:41:06.843869] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T17:41:07.216178] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-24T17:41:08.016154] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-24T17:41:08.042186] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T17:41:08.047334] [INFO ] [REMOTE ] BNED: Full fetch complete (44253 records). [2025-09-24T17:41:08.047442] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-24T17:41:08.503129] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-24T17:41:08.503468] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-24T17:41:08.504099] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-24T17:41:08.504165] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-24T17:41:08.505324] [DEBUG] [LOCAL ] BNED: Trimmed 44253 records to 29914 (keeping 200 days of data) [2025-09-24T17:41:08.690138] [DEBUG] [LOCAL ] BNED: Primary data saved (29914 records). [2025-09-24T17:41:08.690287] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-24T17:41:08.690374] [INFO ] [MAIN ] Update Progress: 314/2373 symbols completed. BNED took 41.3s. Estimated remaining: 4h 29m 24s. Rate: 7.6 symbols/min [2025-09-24T17:41:08.819679] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-24T17:41:08.866822] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:08.899788] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T17:41:08.902477] [DEBUG] [LOCAL ] BNT: Loaded 3417 existing records from primary storage. [2025-09-24T17:41:08.903123] [INFO ] [MAIN ] BNT: Loaded 3417 existing records. [2025-09-24T17:41:09.097835] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:09.098166] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-24T17:41:09.098216] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-24T17:41:09.098723] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-24T17:41:09.098806] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-24T17:41:09.383549] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T17:41:09.511187] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:09.616088] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-24T17:41:09.708575] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T17:41:10.114460] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T17:41:10.416075] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-24T17:41:10.970669] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T17:41:10.972025] [INFO ] [REMOTE ] BNJ: Full fetch complete (4423 records). [2025-09-24T17:41:10.972118] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-24T17:41:11.225490] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-24T17:41:11.355100] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-24T17:41:11.355178] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-24T17:41:11.355332] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-24T17:41:11.355370] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-24T17:41:11.355802] [DEBUG] [LOCAL ] BNJ: Trimmed 4423 records to 2584 (keeping 200 days of data) [2025-09-24T17:41:11.372399] [DEBUG] [LOCAL ] BNJ: Primary data saved (2584 records). [2025-09-24T17:41:11.372470] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-24T17:41:11.372544] [INFO ] [MAIN ] Update Progress: 315/2373 symbols completed. BNJ took 21.6s. Estimated remaining: 4h 28m 42s. Rate: 7.7 symbols/min [2025-09-24T17:41:11.552390] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:11.566618] [DEBUG] [LOCAL ] BNY: Loaded 7423 existing records from primary storage. [2025-09-24T17:41:11.566756] [INFO ] [MAIN ] BNY: Loaded 7423 existing records. [2025-09-24T17:41:11.744896] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:11.745191] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-24T17:41:11.745249] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-24T17:41:11.745609] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-24T17:41:11.745699] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-24T17:41:11.973631] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T17:41:12.021240] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-24T17:41:12.134590] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:12.816103] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-24T17:41:13.616057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-24T17:41:13.858515] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T17:41:14.170858] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T17:41:14.322943] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T17:41:14.416107] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-24T17:41:15.216150] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-24T17:41:15.380756] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T17:41:16.016104] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-24T17:41:16.137730] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T17:41:16.816089] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-24T17:41:17.397057] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T17:41:17.437877] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T17:41:17.616135] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-24T17:41:18.416098] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-24T17:41:19.026796] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-24T17:41:19.194570] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T17:41:19.216052] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-24T17:41:20.016088] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-24T17:41:20.619779] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T17:41:20.777171] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T17:41:20.816062] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-24T17:41:21.616090] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-24T17:41:22.138712] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T17:41:22.248454] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T17:41:22.416167] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-24T17:41:23.037097] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T17:41:23.216094] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-24T17:41:23.829353] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T17:41:24.016125] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-24T17:41:24.816096] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-24T17:41:25.536815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:41:25.616046] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-24T17:41:26.095028] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T17:41:26.266298] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T17:41:26.274614] [INFO ] [REMOTE ] BNL: Full fetch complete (66646 records). [2025-09-24T17:41:26.274779] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-24T17:41:26.424952] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-24T17:41:26.670208] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-24T17:41:26.670299] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-24T17:41:26.671047] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-24T17:41:26.671113] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-24T17:41:26.672502] [DEBUG] [LOCAL ] BNL: Trimmed 66646 records to 46864 (keeping 200 days of data) [2025-09-24T17:41:26.955140] [DEBUG] [LOCAL ] BNL: Primary data saved (46864 records). [2025-09-24T17:41:26.955284] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-24T17:41:26.955372] [INFO ] [MAIN ] Update Progress: 316/2373 symbols completed. BNL took 33.9s. Estimated remaining: 4h 29m 25s. Rate: 7.6 symbols/min [2025-09-24T17:41:27.065396] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T17:41:27.136523] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:27.157228] [DEBUG] [LOCAL ] BOC: Loaded 18394 existing records from primary storage. [2025-09-24T17:41:27.157376] [INFO ] [MAIN ] BOC: Loaded 18394 existing records. [2025-09-24T17:41:27.221236] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-24T17:41:27.335148] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:27.335392] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-24T17:41:27.335442] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-24T17:41:27.336076] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-24T17:41:27.336137] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-24T17:41:27.682021] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:28.016126] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-24T17:41:28.049516] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T17:41:28.571313] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T17:41:28.816143] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-24T17:41:29.274780] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T17:41:29.616075] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-24T17:41:30.416045] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-24T17:41:30.805068] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T17:41:31.216139] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-24T17:41:32.016130] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-24T17:41:32.303144] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T17:41:32.338513] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T17:41:32.779401] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T17:41:32.816056] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-24T17:41:33.579206] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T17:41:33.616176] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-24T17:41:34.416068] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-24T17:41:34.512029] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T17:41:35.028889] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T17:41:35.030463] [INFO ] [REMOTE ] BNT: Full fetch complete (4470 records). [2025-09-24T17:41:35.030558] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-24T17:41:35.224617] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-24T17:41:35.400028] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-24T17:41:35.400140] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-24T17:41:35.400317] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-24T17:41:35.400359] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-24T17:41:35.400790] [DEBUG] [LOCAL ] BNT: Trimmed 4470 records to 3412 (keeping 200 days of data) [2025-09-24T17:41:35.423134] [DEBUG] [LOCAL ] BNT: Primary data saved (3412 records). [2025-09-24T17:41:35.423237] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-24T17:41:35.423320] [INFO ] [MAIN ] Update Progress: 317/2373 symbols completed. BNT took 26.7s. Estimated remaining: 4h 29m 21s. Rate: 7.6 symbols/min [2025-09-24T17:41:35.900020] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T17:41:36.016085] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-24T17:41:36.816071] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-24T17:41:37.077407] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T17:41:37.616091] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-24T17:41:38.416073] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-24T17:41:38.663981] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T17:41:38.685629] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T17:41:38.687633] [INFO ] [REMOTE ] BNY: Full fetch complete (10500 records). [2025-09-24T17:41:38.687743] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-24T17:41:39.085045] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-24T17:41:39.085132] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-24T17:41:39.085431] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-24T17:41:39.085474] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-24T17:41:39.086000] [DEBUG] [LOCAL ] BNY: Trimmed 10500 records to 7382 (keeping 200 days of data) [2025-09-24T17:41:39.132547] [DEBUG] [LOCAL ] BNY: Primary data saved (7382 records). [2025-09-24T17:41:39.132720] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-24T17:41:39.132819] [INFO ] [MAIN ] Update Progress: 318/2373 symbols completed. BNY took 27.8s. Estimated remaining: 4h 28m 46s. Rate: 7.6 symbols/min [2025-09-24T17:41:39.201918] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T17:41:39.216040] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-24T17:41:40.016114] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-24T17:41:40.243685] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T17:41:40.816114] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-24T17:41:41.318416] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T17:41:41.616050] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-24T17:41:41.816022] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T17:41:42.416084] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-24T17:41:43.154874] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T17:41:43.216069] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-24T17:41:43.401383] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:41:44.016133] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-24T17:41:44.177932] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T17:41:44.816084] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-24T17:41:45.602188] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T17:41:45.616027] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-24T17:41:45.945789] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:41:45.949221] [INFO ] [REMOTE ] BOC: Full fetch complete (25802 records). [2025-09-24T17:41:45.949298] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-24T17:41:46.318950] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-24T17:41:46.319070] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-24T17:41:46.319565] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-24T17:41:46.319611] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-24T17:41:46.320295] [DEBUG] [LOCAL ] BOC: Trimmed 25802 records to 18381 (keeping 200 days of data) [2025-09-24T17:41:46.427895] [DEBUG] [LOCAL ] BOC: Primary data saved (18381 records). [2025-09-24T17:41:46.428095] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-24T17:41:46.428187] [INFO ] [MAIN ] Update Progress: 319/2373 symbols completed. BOC took 19.5s. Estimated remaining: 4h 28m 35s. Rate: 7.6 symbols/min [2025-09-24T17:41:47.309196] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T17:41:47.321269] [INFO ] [REMOTE ] BNS: Full fetch complete (73820 records). [2025-09-24T17:41:47.321487] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-24T17:41:47.322354] [FATAL] [VALIDATOR ] BNS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:41:47.322485] [FATAL] [MAIN ] BNS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:41:47.322560] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:41:47.322684] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-24T17:41:47.322770] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-09-24T17:41:47.322809] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-09-24T17:41:47.323379] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-09-24T17:41:47.323978] [INFO ] [MAIN ] Update Progress: 320/2373 symbols completed. BNS took 45.4s. Estimated remaining: 4h 27m 42s. Rate: 7.7 symbols/min [2025-09-24T17:41:48.035225] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:48.037529] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:48.097020] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:48.100530] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:41:48.118107] [DEBUG] [LOCAL ] BOE: Loaded 17606 existing records from primary storage. [2025-09-24T17:41:48.118278] [INFO ] [MAIN ] BOE: Loaded 17606 existing records. [2025-09-24T17:41:48.359212] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:48.370598] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-24T17:41:48.359851] [DEBUG] [LOCAL ] BOND: Loaded 32076 existing records from primary storage. [2025-09-24T17:41:48.372757] [INFO ] [MAIN ] BOND: Loaded 32076 existing records. [2025-09-24T17:41:48.372552] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-24T17:41:48.371585] [DEBUG] [LOCAL ] BOH: Loaded 31414 existing records from primary storage. [2025-09-24T17:41:48.418028] [INFO ] [MAIN ] BOH: Loaded 31414 existing records. [2025-09-24T17:41:48.446543] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-24T17:41:48.467474] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-24T17:41:48.477395] [DEBUG] [LOCAL ] BOOT: Loaded 40931 existing records from primary storage. [2025-09-24T17:41:48.583761] [INFO ] [MAIN ] BOOT: Loaded 40931 existing records. [2025-09-24T17:41:48.840088] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:48.931762] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-24T17:41:48.937114] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-24T17:41:49.042053] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:49.051896] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-24T17:41:49.057567] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-24T17:41:49.057482] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-24T17:41:49.074953] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-24T17:41:49.101249] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-24T17:41:49.171718] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-24T17:41:49.349345] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:41:49.410236] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-24T17:41:49.425774] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-24T17:41:49.551861] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-24T17:41:49.624031] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-24T17:41:49.882554] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:49.971638] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-24T17:41:50.265605] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:50.306312] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-24T17:41:50.461970] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:50.492540] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-24T17:41:50.595893] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:41:50.596246] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-24T17:41:51.296969] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T17:41:51.301941] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-24T17:41:51.920740] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T17:41:51.928429] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T17:41:51.934494] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-24T17:41:51.936399] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-24T17:41:52.007395] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T17:41:52.016024] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-24T17:41:52.343543] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T17:41:52.816142] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-24T17:41:53.049080] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:41:53.133931] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:41:53.616047] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-24T17:41:53.653116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T17:41:53.822598] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T17:41:54.416075] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-24T17:41:54.904274] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T17:41:55.216157] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-24T17:41:55.677258] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T17:41:56.016111] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-24T17:41:56.240282] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T17:41:56.816104] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-24T17:41:56.926736] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:41:57.616089] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-24T17:41:57.684731] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T17:41:58.416127] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-24T17:41:58.797756] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T17:41:58.996420] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T17:41:59.216085] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-24T17:42:00.016109] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-24T17:42:00.723813] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:42:00.816073] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-24T17:42:01.473269] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T17:42:01.616127] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-24T17:42:02.416115] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-24T17:42:03.221264] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-24T17:42:03.245336] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-24T17:42:03.669395] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T17:42:04.016084] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-24T17:42:04.799970] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-24T17:42:04.816089] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-24T17:42:04.941098] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T17:42:05.616165] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-24T17:42:05.809639] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T17:42:05.896205] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T17:42:06.416095] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-24T17:42:06.878790] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T17:42:07.216141] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-24T17:42:07.754320] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T17:42:08.016081] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-24T17:42:08.399630] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T17:42:08.816086] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-24T17:42:09.342348] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T17:42:09.616106] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-24T17:42:10.183417] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T17:42:10.416136] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-24T17:42:11.041389] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T17:42:11.216086] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-24T17:42:11.729384] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T17:42:12.016128] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-24T17:42:12.531006] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T17:42:12.665295] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-24T17:42:12.816101] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-24T17:42:13.616129] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-24T17:42:14.257673] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T17:42:14.416125] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-24T17:42:15.216120] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-24T17:42:15.908432] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-24T17:42:16.016109] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-24T17:42:16.816178] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-24T17:42:16.836883] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T17:42:16.841153] [INFO ] [REMOTE ] BOE: Full fetch complete (26708 records). [2025-09-24T17:42:16.841307] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-24T17:42:17.034160] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-24T17:42:17.125248] [INFO ] [REMOTE ] BOH: Full fetch complete (44890 records). [2025-09-24T17:42:17.136844] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-24T17:42:17.377055] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-24T17:42:17.387558] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-24T17:42:17.412064] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-24T17:42:17.445091] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-24T17:42:17.559179] [DEBUG] [LOCAL ] BOE: Trimmed 26708 records to 17572 (keeping 200 days of data) [2025-09-24T17:42:17.733524] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T17:42:17.731442] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-24T17:42:17.767322] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-24T17:42:17.769429] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-24T17:42:17.771539] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-24T17:42:17.775566] [INFO ] [REMOTE ] BOND: Full fetch complete (46332 records). [2025-09-24T17:42:17.791604] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-24T17:42:17.785517] [DEBUG] [LOCAL ] BOH: Trimmed 44890 records to 31331 (keeping 200 days of data) [2025-09-24T17:42:18.006801] [DEBUG] [LOCAL ] BOE: Primary data saved (17572 records). [2025-09-24T17:42:18.019700] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-24T17:42:18.042750] [INFO ] [MAIN ] Update Progress: 321/2373 symbols completed. BOE took 30.7s. Estimated remaining: 4h 30m 1s. Rate: 7.6 symbols/min [2025-09-24T17:42:18.495299] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:18.618858] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-24T17:42:18.619867] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-24T17:42:18.621475] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-24T17:42:18.621940] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-24T17:42:18.624131] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T17:42:18.635730] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-24T17:42:18.641607] [DEBUG] [LOCAL ] BOND: Trimmed 46332 records to 32119 (keeping 200 days of data) [2025-09-24T17:42:18.836025] [DEBUG] [LOCAL ] BORR: Loaded 51182 existing records from primary storage. [2025-09-24T17:42:18.842084] [INFO ] [MAIN ] BORR: Loaded 51182 existing records. [2025-09-24T17:42:19.041219] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:19.078460] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-24T17:42:19.102400] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-24T17:42:19.105255] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-24T17:42:19.106235] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-24T17:42:19.120832] [DEBUG] [LOCAL ] BOH: Primary data saved (31331 records). [2025-09-24T17:42:19.121271] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-24T17:42:19.121950] [INFO ] [MAIN ] Update Progress: 322/2373 symbols completed. BOH took 31.8s. Estimated remaining: 4h 29m 10s. Rate: 7.6 symbols/min [2025-09-24T17:42:19.521246] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:19.690035] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:19.693203] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-24T17:42:19.692485] [DEBUG] [LOCAL ] BOND: Primary data saved (32119 records). [2025-09-24T17:42:19.702518] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-24T17:42:19.704308] [INFO ] [MAIN ] Update Progress: 323/2373 symbols completed. BOND took 32.4s. Estimated remaining: 4h 28m 16s. Rate: 7.6 symbols/min [2025-09-24T17:42:19.704833] [DEBUG] [LOCAL ] BOW: Loaded 23640 existing records from primary storage. [2025-09-24T17:42:19.705138] [INFO ] [MAIN ] BOW: Loaded 23640 existing records. [2025-09-24T17:42:20.061532] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:20.064602] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:20.065421] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-24T17:42:20.065492] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-24T17:42:20.066341] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-24T17:42:20.066455] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-24T17:42:20.183272] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:42:20.203986] [INFO ] [REMOTE ] BOOT: Full fetch complete (60322 records). [2025-09-24T17:42:20.243515] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-24T17:42:20.487135] [DEBUG] [LOCAL ] BOX: Loaded 50321 existing records from primary storage. [2025-09-24T17:42:20.563333] [INFO ] [MAIN ] BOX: Loaded 50321 existing records. [2025-09-24T17:42:20.598365] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:20.642389] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-24T17:42:21.023618] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:21.056754] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-24T17:42:21.056890] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-24T17:42:21.057022] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-24T17:42:21.056965] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-24T17:42:21.057803] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-24T17:42:21.057880] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-24T17:42:21.059373] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-24T17:42:21.059556] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-24T17:42:21.059507] [DEBUG] [LOCAL ] BOOT: Trimmed 60322 records to 40846 (keeping 200 days of data) [2025-09-24T17:42:21.529769] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:21.530600] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-24T17:42:21.680750] [DEBUG] [LOCAL ] BOOT: Primary data saved (40846 records). [2025-09-24T17:42:21.680895] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-24T17:42:21.681633] [INFO ] [MAIN ] Update Progress: 324/2373 symbols completed. BOOT took 34.4s. Estimated remaining: 4h 27m 31s. Rate: 7.7 symbols/min [2025-09-24T17:42:21.863186] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:21.877151] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T17:42:21.905971] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-24T17:42:21.912221] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-24T17:42:21.923559] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-24T17:42:21.972470] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-24T17:42:21.972629] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-24T17:42:22.150403] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:22.150749] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-24T17:42:22.150807] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-24T17:42:22.152262] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-24T17:42:22.152326] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-24T17:42:22.503248] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:22.503546] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-24T17:42:22.909396] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T17:42:23.210214] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T17:42:23.219923] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-24T17:42:23.316393] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T17:42:24.016084] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-24T17:42:24.034033] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T17:42:24.384993] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T17:42:24.816104] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-24T17:42:25.616219] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-24T17:42:25.654853] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T17:42:26.416118] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-24T17:42:26.467813] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:42:26.932618] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T17:42:27.216098] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-24T17:42:28.016098] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-24T17:42:28.816115] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-24T17:42:29.365764] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-24T17:42:29.616205] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-24T17:42:29.750305] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:42:30.304749] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T17:42:30.360683] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-24T17:42:30.416036] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-24T17:42:31.216108] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-24T17:42:31.717523] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-24T17:42:32.016157] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-24T17:42:32.358705] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T17:42:32.581810] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:42:32.816149] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-24T17:42:33.000386] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T17:42:33.616108] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-24T17:42:34.383520] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T17:42:34.416035] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-24T17:42:34.586258] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T17:42:35.216106] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-24T17:42:35.386397] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T17:42:36.016084] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-24T17:42:36.713934] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T17:42:36.816105] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-24T17:42:37.616108] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-24T17:42:38.318437] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-24T17:42:38.397465] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T17:42:38.416040] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-24T17:42:38.601136] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T17:42:39.216101] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-24T17:42:40.016175] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-24T17:42:40.230832] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T17:42:40.821329] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-24T17:42:40.849122] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T17:42:41.616092] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-24T17:42:41.860483] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T17:42:41.865356] [INFO ] [REMOTE ] BOW: Full fetch complete (31108 records). [2025-09-24T17:42:41.865499] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-24T17:42:42.266793] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-24T17:42:42.266999] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-24T17:42:42.267617] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-24T17:42:42.267813] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-24T17:42:42.269282] [DEBUG] [LOCAL ] BOW: Trimmed 31108 records to 23628 (keeping 200 days of data) [2025-09-24T17:42:42.398905] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T17:42:42.416754] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-24T17:42:42.474932] [DEBUG] [LOCAL ] BOW: Primary data saved (23628 records). [2025-09-24T17:42:42.475164] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-24T17:42:42.475288] [INFO ] [MAIN ] Update Progress: 325/2373 symbols completed. BOW took 23.3s. Estimated remaining: 4h 28m 44s. Rate: 7.6 symbols/min [2025-09-24T17:42:42.677562] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:42.720498] [DEBUG] [LOCAL ] BR: Loaded 34778 existing records from primary storage. [2025-09-24T17:42:42.720754] [INFO ] [MAIN ] BR: Loaded 34778 existing records. [2025-09-24T17:42:42.922916] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:42.923263] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-24T17:42:42.923313] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-24T17:42:42.924854] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-24T17:42:42.924918] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-24T17:42:43.224599] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-24T17:42:43.350715] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:43.558426] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T17:42:43.568322] [INFO ] [REMOTE ] BORR: Full fetch complete (74751 records). [2025-09-24T17:42:43.568588] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-24T17:42:44.039569] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-24T17:42:44.061025] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-24T17:42:44.061272] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-24T17:42:44.062844] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-24T17:42:44.063193] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-24T17:42:44.065609] [DEBUG] [LOCAL ] BORR: Trimmed 74751 records to 51165 (keeping 200 days of data) [2025-09-24T17:42:44.196546] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T17:42:44.422736] [DEBUG] [LOCAL ] BORR: Primary data saved (51165 records). [2025-09-24T17:42:44.422908] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-24T17:42:44.423001] [INFO ] [MAIN ] Update Progress: 326/2373 symbols completed. BORR took 26.4s. Estimated remaining: 4h 27m 59s. Rate: 7.6 symbols/min [2025-09-24T17:42:44.596320] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:44.650501] [DEBUG] [LOCAL ] BRBR: Loaded 51231 existing records from primary storage. [2025-09-24T17:42:44.650706] [INFO ] [MAIN ] BRBR: Loaded 51231 existing records. [2025-09-24T17:42:44.831596] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-24T17:42:44.837791] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:44.839147] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-24T17:42:44.839247] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-24T17:42:44.840689] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-24T17:42:44.840750] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-24T17:42:45.223666] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:45.387810] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-24T17:42:45.432959] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T17:42:45.616094] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-24T17:42:46.336887] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T17:42:46.416094] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-24T17:42:47.216070] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-24T17:42:47.682487] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-24T17:42:48.016048] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-24T17:42:48.126558] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T17:42:48.816117] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-24T17:42:48.875446] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T17:42:49.505197] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T17:42:49.616089] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-24T17:42:50.416080] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-24T17:42:51.004936] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:42:51.221210] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-24T17:42:51.249494] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-24T17:42:52.016061] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-24T17:42:52.334254] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T17:42:52.791555] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T17:42:52.816041] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-24T17:42:53.107440] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T17:42:53.616083] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-24T17:42:54.074379] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T17:42:54.416108] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-24T17:42:55.216120] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-24T17:42:55.613553] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T17:42:56.016078] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-24T17:42:56.184853] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T17:42:56.194411] [INFO ] [REMOTE ] BOX: Full fetch complete (72133 records). [2025-09-24T17:42:56.194568] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-24T17:42:56.641968] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-24T17:42:56.642253] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-24T17:42:56.643258] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-24T17:42:56.643381] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-24T17:42:56.645785] [DEBUG] [LOCAL ] BOX: Trimmed 72133 records to 50296 (keeping 200 days of data) [2025-09-24T17:42:56.789724] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T17:42:56.816232] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-24T17:42:57.017218] [DEBUG] [LOCAL ] BOX: Primary data saved (50296 records). [2025-09-24T17:42:57.017604] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-24T17:42:57.017776] [INFO ] [MAIN ] Update Progress: 327/2373 symbols completed. BOX took 37.3s. Estimated remaining: 4h 28m 21s. Rate: 7.6 symbols/min [2025-09-24T17:42:57.197968] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:57.217227] [DEBUG] [LOCAL ] BRC: Loaded 19365 existing records from primary storage. [2025-09-24T17:42:57.217365] [INFO ] [MAIN ] BRC: Loaded 19365 existing records. [2025-09-24T17:42:57.402951] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:57.403261] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-24T17:42:57.403326] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-24T17:42:57.404087] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-24T17:42:57.404161] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-24T17:42:57.616324] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-24T17:42:57.953550] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:42:58.208450] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T17:42:58.229247] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-24T17:42:58.229684] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-24T17:42:58.426846] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-24T17:42:58.602801] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T17:42:58.882105] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-24T17:42:58.882241] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-24T17:42:58.883362] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-24T17:42:58.883539] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-24T17:42:58.887578] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-24T17:42:59.222380] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-24T17:42:59.272681] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-24T17:42:59.272820] [INFO ] [MAIN ] BP: Full history saved. [2025-09-24T17:42:59.274736] [INFO ] [MAIN ] Update Progress: 328/2373 symbols completed. BP took 37.6s. Estimated remaining: 4h 27m 38s. Rate: 7.6 symbols/min [2025-09-24T17:42:59.458026] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:42:59.540095] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T17:42:59.551469] [DEBUG] [LOCAL ] BRCC: Loaded 40441 existing records from primary storage. [2025-09-24T17:42:59.552168] [INFO ] [MAIN ] BRCC: Loaded 40441 existing records. [2025-09-24T17:42:59.658526] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T17:42:59.777776] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:42:59.778112] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-24T17:42:59.778163] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-24T17:42:59.779224] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-24T17:42:59.779298] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-24T17:43:00.021380] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-24T17:43:00.176166] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:00.816177] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-24T17:43:01.048828] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T17:43:01.432240] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T17:43:01.616126] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-24T17:43:02.416199] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-24T17:43:02.463857] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:43:03.216146] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-24T17:43:03.297850] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T17:43:03.442107] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T17:43:04.016109] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-24T17:43:04.659889] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T17:43:04.816173] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-24T17:43:05.433875] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T17:43:05.616102] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-24T17:43:05.666131] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T17:43:06.416137] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-24T17:43:06.917548] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T17:43:07.216141] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-24T17:43:07.477216] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T17:43:08.016099] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-24T17:43:08.710137] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T17:43:08.816094] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-24T17:43:09.278288] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T17:43:09.616109] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-24T17:43:10.368695] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T17:43:10.416045] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-24T17:43:10.844508] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T17:43:11.216087] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-24T17:43:12.016156] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-24T17:43:12.067285] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T17:43:12.434339] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T17:43:12.816133] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-24T17:43:13.297002] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T17:43:13.303492] [INFO ] [REMOTE ] BR: Full fetch complete (49012 records). [2025-09-24T17:43:13.303605] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-24T17:43:13.621225] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-24T17:43:13.704963] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-24T17:43:13.705095] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-24T17:43:13.706030] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-24T17:43:13.706144] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-24T17:43:13.708068] [DEBUG] [LOCAL ] BR: Trimmed 49012 records to 34707 (keeping 200 days of data) [2025-09-24T17:43:13.975076] [DEBUG] [LOCAL ] BR: Primary data saved (34707 records). [2025-09-24T17:43:13.975357] [INFO ] [MAIN ] BR: Full history saved. [2025-09-24T17:43:13.975724] [INFO ] [MAIN ] Update Progress: 329/2373 symbols completed. BR took 31.5s. Estimated remaining: 4h 28m 13s. Rate: 7.6 symbols/min [2025-09-24T17:43:14.150104] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:14.219629] [DEBUG] [LOCAL ] BRO: Loaded 51916 existing records from primary storage. [2025-09-24T17:43:14.219843] [INFO ] [MAIN ] BRO: Loaded 51916 existing records. [2025-09-24T17:43:14.405016] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:43:14.405282] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-24T17:43:14.405330] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-24T17:43:14.406886] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-24T17:43:14.406947] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-24T17:43:14.421280] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-24T17:43:14.823929] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:14.828019] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T17:43:14.853211] [INFO ] [REMOTE ] BRBR: Full fetch complete (71793 records). [2025-09-24T17:43:14.853700] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T17:43:14.853996] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-24T17:43:15.219728] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-24T17:43:15.275460] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-24T17:43:15.275565] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-24T17:43:15.276626] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-24T17:43:15.276753] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-24T17:43:15.278577] [DEBUG] [LOCAL ] BRBR: Trimmed 71793 records to 51234 (keeping 200 days of data) [2025-09-24T17:43:15.593810] [DEBUG] [LOCAL ] BRBR: Primary data saved (51234 records). [2025-09-24T17:43:15.593983] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-24T17:43:15.594137] [INFO ] [MAIN ] Update Progress: 330/2373 symbols completed. BRBR took 31.2s. Estimated remaining: 4h 27m 26s. Rate: 7.6 symbols/min [2025-09-24T17:43:15.771849] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:15.772164] [DEBUG] [LOCAL ] BROS: No existing data file found in primary storage. [2025-09-24T17:43:15.772250] [WARN ] [MAIN ] BROS: No existing data found, performing full refresh instead. [2025-09-24T17:43:15.772526] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-24T17:43:15.772819] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-24T17:43:15.772894] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-24T17:43:15.780968] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-24T17:43:15.862812] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:43:16.022595] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-24T17:43:16.173627] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:16.450607] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T17:43:16.816148] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-24T17:43:17.616151] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-24T17:43:17.729246] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T17:43:18.416105] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-24T17:43:18.448748] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T17:43:19.216060] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-24T17:43:19.315815] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T17:43:19.452688] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T17:43:20.016284] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-24T17:43:20.816057] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-24T17:43:20.961471] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T17:43:21.100527] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T17:43:21.616105] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-24T17:43:22.416109] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-24T17:43:22.558182] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T17:43:22.663290] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T17:43:23.216161] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-24T17:43:24.016058] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-24T17:43:24.378351] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T17:43:24.381829] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T17:43:24.397244] [INFO ] [REMOTE ] BRC: Full fetch complete (29190 records). [2025-09-24T17:43:24.397545] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-24T17:43:24.804946] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-24T17:43:24.805178] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-24T17:43:24.805801] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-24T17:43:24.805867] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-24T17:43:24.806966] [DEBUG] [LOCAL ] BRC: Trimmed 29190 records to 19348 (keeping 200 days of data) [2025-09-24T17:43:24.816102] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-24T17:43:24.945330] [DEBUG] [LOCAL ] BRC: Primary data saved (19348 records). [2025-09-24T17:43:24.946038] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-24T17:43:24.946368] [INFO ] [MAIN ] Update Progress: 331/2373 symbols completed. BRC took 27.9s. Estimated remaining: 4h 27m 28s. Rate: 7.6 symbols/min [2025-09-24T17:43:25.130306] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:25.130541] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-24T17:43:25.130597] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-24T17:43:25.130773] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-24T17:43:25.130830] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-24T17:43:25.130876] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-24T17:43:25.130909] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-24T17:43:25.522093] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:25.574420] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T17:43:25.616041] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-24T17:43:25.852450] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:25.852823] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-24T17:43:26.416078] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-24T17:43:26.569404] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T17:43:27.216160] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-24T17:43:27.459838] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:27.460190] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-24T17:43:28.016113] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-24T17:43:28.221190] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T17:43:28.816108] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-24T17:43:29.081631] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:29.082042] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-24T17:43:29.616052] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-24T17:43:29.812052] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:29.812394] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-24T17:43:30.015269] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T17:43:30.416080] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-24T17:43:31.216099] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-24T17:43:32.016134] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-24T17:43:32.275604] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T17:43:32.816122] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-24T17:43:33.055579] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:33.055914] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-24T17:43:33.299724] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T17:43:33.521517] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T17:43:33.616142] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-24T17:43:33.811113] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:33.811499] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-24T17:43:34.416092] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-24T17:43:35.216099] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-24T17:43:36.004424] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T17:43:36.012607] [INFO ] [REMOTE ] BRCC: Full fetch complete (57980 records). [2025-09-24T17:43:36.012794] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-24T17:43:36.024909] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-24T17:43:36.411957] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-24T17:43:36.412060] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-24T17:43:36.412843] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-24T17:43:36.412916] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-24T17:43:36.414927] [DEBUG] [LOCAL ] BRCC: Trimmed 57980 records to 40396 (keeping 200 days of data) [2025-09-24T17:43:36.656368] [DEBUG] [LOCAL ] BRCC: Primary data saved (40396 records). [2025-09-24T17:43:36.656539] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-24T17:43:36.657165] [INFO ] [MAIN ] Update Progress: 332/2373 symbols completed. BRCC took 37.4s. Estimated remaining: 4h 27m 44s. Rate: 7.6 symbols/min [2025-09-24T17:43:36.821295] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-24T17:43:36.857388] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:36.857676] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-09-24T17:43:36.857733] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-09-24T17:43:36.857878] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-24T17:43:36.857921] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-24T17:43:36.857964] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-24T17:43:36.857996] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-24T17:43:37.082697] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:43:37.126170] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-24T17:43:37.229571] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:37.430930] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-24T17:43:37.616053] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-24T17:43:37.749164] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T17:43:38.416102] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-24T17:43:39.155862] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:43:39.216038] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-24T17:43:39.996960] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T17:43:40.016038] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-24T17:43:40.816104] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-24T17:43:40.865440] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T17:43:41.616123] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-24T17:43:41.998882] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T17:43:42.405142] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T17:43:42.416128] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-24T17:43:43.216091] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-24T17:43:43.265291] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T17:43:43.273841] [INFO ] [REMOTE ] BRSL: Full fetch complete (21617 records). [2025-09-24T17:43:43.273925] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-24T17:43:43.460634] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 59 unique days, need 200 days [2025-09-24T17:43:43.461492] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:43:43.461587] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:43:43.461685] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-24T17:43:43.461762] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-24T17:43:43.461813] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-24T17:43:43.461894] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-24T17:43:43.461980] [INFO ] [MAIN ] Update Progress: 333/2373 symbols completed. BRSL took 18.5s. Estimated remaining: 4h 27m 29s. Rate: 7.6 symbols/min [2025-09-24T17:43:43.633754] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:43.643721] [DEBUG] [LOCAL ] BRT: Loaded 4949 existing records from primary storage. [2025-09-24T17:43:43.643836] [INFO ] [MAIN ] BRT: Loaded 4949 existing records. [2025-09-24T17:43:43.830633] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:43:43.830931] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-24T17:43:43.830979] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-24T17:43:43.831377] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-24T17:43:43.831438] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-24T17:43:44.044555] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-24T17:43:44.144278] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:43:44.230519] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:44.816060] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-24T17:43:44.989167] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T17:43:45.616093] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-24T17:43:46.257949] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T17:43:46.297229] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T17:43:46.416085] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-24T17:43:47.216069] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-24T17:43:47.487852] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:43:47.497610] [INFO ] [REMOTE ] BRO: Full fetch complete (74207 records). [2025-09-24T17:43:47.497822] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-24T17:43:47.899504] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-24T17:43:47.899755] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-24T17:43:47.900827] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-24T17:43:47.900915] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-24T17:43:47.902762] [DEBUG] [LOCAL ] BRO: Trimmed 74207 records to 51915 (keeping 200 days of data) [2025-09-24T17:43:48.019020] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-24T17:43:48.174236] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T17:43:48.286176] [DEBUG] [LOCAL ] BRO: Primary data saved (51915 records). [2025-09-24T17:43:48.286332] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-24T17:43:48.286439] [INFO ] [MAIN ] Update Progress: 334/2373 symbols completed. BRO took 34.3s. Estimated remaining: 4h 27m 3s. Rate: 7.6 symbols/min [2025-09-24T17:43:48.505275] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:48.508803] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T17:43:48.535247] [DEBUG] [LOCAL ] BRW: Loaded 18999 existing records from primary storage. [2025-09-24T17:43:48.535413] [INFO ] [MAIN ] BRW: Loaded 18999 existing records. [2025-09-24T17:43:48.737074] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T17:43:48.736812] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:43:48.739401] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-24T17:43:48.739464] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-24T17:43:48.740331] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-24T17:43:48.740423] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-24T17:43:48.821274] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-24T17:43:49.102826] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:49.616082] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-24T17:43:50.382577] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T17:43:50.416111] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-24T17:43:51.026603] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T17:43:51.216079] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-24T17:43:51.703447] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T17:43:51.764899] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-24T17:43:51.774542] [INFO ] [REMOTE ] BROS: Full fetch complete (76976 records). [2025-09-24T17:43:51.774761] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-24T17:43:52.023380] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-24T17:43:52.174213] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-24T17:43:52.174301] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-24T17:43:52.175166] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-24T17:43:52.175266] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-24T17:43:52.176803] [DEBUG] [LOCAL ] BROS: Trimmed 76976 records to 53287 (keeping 200 days of data) [2025-09-24T17:43:52.515201] [DEBUG] [LOCAL ] BROS: Primary data saved (53287 records). [2025-09-24T17:43:52.515365] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-24T17:43:52.515499] [INFO ] [MAIN ] Update Progress: 335/2373 symbols completed. BROS took 36.9s. Estimated remaining: 4h 26m 33s. Rate: 7.6 symbols/min [2025-09-24T17:43:52.690453] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:43:52.741527] [DEBUG] [LOCAL ] BRX: Loaded 51807 existing records from primary storage. [2025-09-24T17:43:52.741740] [INFO ] [MAIN ] BRX: Loaded 51807 existing records. [2025-09-24T17:43:52.821304] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-24T17:43:53.039711] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:43:53.039963] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-24T17:43:53.040011] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-24T17:43:53.041357] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-24T17:43:53.041418] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-24T17:43:53.418784] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:43:53.613520] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T17:43:53.622338] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-24T17:43:54.310793] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T17:43:54.416138] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-24T17:43:55.216157] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-24T17:43:55.357739] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:43:55.612788] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T17:43:55.848695] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T17:43:56.016088] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-24T17:43:56.816039] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-24T17:43:56.875009] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T17:43:57.428618] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T17:43:57.616101] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-24T17:43:58.262098] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T17:43:58.416123] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-24T17:43:59.216151] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-24T17:43:59.896947] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T17:44:00.016083] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-24T17:44:00.126381] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T17:44:00.816057] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-24T17:44:00.978303] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T17:44:01.461145] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T17:44:01.616097] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-24T17:44:02.416081] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-24T17:44:02.870688] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T17:44:03.216113] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-24T17:44:03.777478] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:44:04.016105] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-24T17:44:04.629674] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T17:44:04.726293] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T17:44:04.816051] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-24T17:44:05.616088] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-24T17:44:06.199399] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T17:44:06.416069] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-24T17:44:07.216061] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-24T17:44:07.347261] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:44:07.460606] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T17:44:07.799600] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T17:44:08.016098] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-24T17:44:08.789376] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T17:44:08.790958] [INFO ] [REMOTE ] BRT: Full fetch complete (6830 records). [2025-09-24T17:44:08.791032] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-24T17:44:08.821306] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-24T17:44:09.163372] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-24T17:44:09.163459] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-24T17:44:09.163717] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-24T17:44:09.163780] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-24T17:44:09.164189] [DEBUG] [LOCAL ] BRT: Trimmed 6830 records to 4967 (keeping 200 days of data) [2025-09-24T17:44:09.195802] [DEBUG] [LOCAL ] BRT: Primary data saved (4967 records). [2025-09-24T17:44:09.195921] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-24T17:44:09.196006] [INFO ] [MAIN ] Update Progress: 336/2373 symbols completed. BRT took 25.7s. Estimated remaining: 4h 27m 18s. Rate: 7.6 symbols/min [2025-09-24T17:44:09.370741] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:09.408799] [DEBUG] [LOCAL ] BSAC: Loaded 32985 existing records from primary storage. [2025-09-24T17:44:09.408956] [INFO ] [MAIN ] BSAC: Loaded 32985 existing records. [2025-09-24T17:44:09.589205] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:09.589464] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-24T17:44:09.589515] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-24T17:44:09.590551] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-24T17:44:09.590617] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-24T17:44:09.621787] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-24T17:44:10.003093] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:10.035446] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T17:44:10.042707] [INFO ] [REMOTE ] BRSP: Full fetch complete (54071 records). [2025-09-24T17:44:10.042867] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-24T17:44:10.421798] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-24T17:44:10.467722] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-24T17:44:10.467813] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-24T17:44:10.468453] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-24T17:44:10.468495] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-24T17:44:10.469827] [DEBUG] [LOCAL ] BRSP: Trimmed 54071 records to 36996 (keeping 200 days of data) [2025-09-24T17:44:10.691935] [DEBUG] [LOCAL ] BRSP: Primary data saved (36996 records). [2025-09-24T17:44:10.692100] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-24T17:44:10.692181] [INFO ] [MAIN ] Update Progress: 337/2373 symbols completed. BRSP took 34.0s. Estimated remaining: 4h 26m 32s. Rate: 7.6 symbols/min [2025-09-24T17:44:10.881957] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:10.925022] [DEBUG] [LOCAL ] BSBR: Loaded 35113 existing records from primary storage. [2025-09-24T17:44:10.925203] [INFO ] [MAIN ] BSBR: Loaded 35113 existing records. [2025-09-24T17:44:11.149382] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:11.150412] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-24T17:44:11.150660] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-24T17:44:11.160144] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-24T17:44:11.160588] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-24T17:44:11.185017] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T17:44:11.230270] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-24T17:44:11.384732] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T17:44:11.649243] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:12.016114] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-24T17:44:12.398506] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T17:44:12.816080] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-24T17:44:13.591951] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T17:44:13.616073] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-24T17:44:13.689277] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T17:44:14.416134] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-24T17:44:14.876216] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T17:44:15.216110] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-24T17:44:15.610628] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T17:44:16.016081] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-24T17:44:16.438710] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T17:44:16.816091] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-24T17:44:17.043018] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T17:44:17.616056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-24T17:44:17.919274] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T17:44:18.416086] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-24T17:44:19.216111] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-24T17:44:19.304438] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T17:44:19.336910] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T17:44:20.016124] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-24T17:44:20.204911] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T17:44:20.816115] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-24T17:44:21.616101] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-24T17:44:21.765394] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T17:44:22.105944] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T17:44:22.416054] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-24T17:44:22.505926] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T17:44:22.511064] [INFO ] [REMOTE ] BRW: Full fetch complete (29473 records). [2025-09-24T17:44:22.511216] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-24T17:44:22.904234] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-24T17:44:22.904324] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-24T17:44:22.904813] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-24T17:44:22.904877] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-24T17:44:22.905606] [DEBUG] [LOCAL ] BRW: Trimmed 29473 records to 19261 (keeping 200 days of data) [2025-09-24T17:44:23.021525] [DEBUG] [LOCAL ] BRW: Primary data saved (19261 records). [2025-09-24T17:44:23.021708] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-24T17:44:23.021812] [INFO ] [MAIN ] Update Progress: 338/2373 symbols completed. BRW took 34.7s. Estimated remaining: 4h 26m 51s. Rate: 7.6 symbols/min [2025-09-24T17:44:23.199786] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:23.209236] [DEBUG] [LOCAL ] BSL: Loaded 7936 existing records from primary storage. [2025-09-24T17:44:23.209339] [INFO ] [MAIN ] BSL: Loaded 7936 existing records. [2025-09-24T17:44:23.221990] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-24T17:44:23.402787] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:23.403064] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-24T17:44:23.403116] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-24T17:44:23.403520] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-24T17:44:23.403582] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-24T17:44:23.787181] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:23.809064] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:44:24.016091] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-24T17:44:24.816117] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-24T17:44:25.034419] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:44:25.410112] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T17:44:25.616067] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-24T17:44:25.729034] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T17:44:26.416084] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-24T17:44:26.784282] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T17:44:27.216109] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-24T17:44:28.016080] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-24T17:44:28.185582] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T17:44:28.195344] [INFO ] [REMOTE ] BRX: Full fetch complete (74922 records). [2025-09-24T17:44:28.195547] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-24T17:44:28.640476] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-24T17:44:28.643050] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-24T17:44:28.644003] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-24T17:44:28.644149] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-24T17:44:28.647737] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T17:44:28.659562] [DEBUG] [LOCAL ] BRX: Trimmed 74922 records to 51773 (keeping 200 days of data) [2025-09-24T17:44:28.792689] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T17:44:28.848418] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-24T17:44:28.992044] [DEBUG] [LOCAL ] BRX: Primary data saved (51773 records). [2025-09-24T17:44:28.992223] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-24T17:44:28.992326] [INFO ] [MAIN ] Update Progress: 339/2373 symbols completed. BRX took 36.5s. Estimated remaining: 4h 26m 32s. Rate: 7.6 symbols/min [2025-09-24T17:44:29.164347] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:29.200632] [DEBUG] [LOCAL ] BSM: Loaded 32342 existing records from primary storage. [2025-09-24T17:44:29.200874] [INFO ] [MAIN ] BSM: Loaded 32342 existing records. [2025-09-24T17:44:29.383336] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:29.383622] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-24T17:44:29.383703] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-24T17:44:29.384788] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-24T17:44:29.384850] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-24T17:44:29.621243] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-24T17:44:29.789442] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:29.798622] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T17:44:30.416094] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-24T17:44:30.517277] [DEBUG] [REMOTE ] BSL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-24T17:44:30.517691] [WARN ] [REMOTE ] BSL: No data returned for month 2025-03 [2025-09-24T17:44:30.961615] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T17:44:31.216161] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-24T17:44:32.016092] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-24T17:44:32.684779] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T17:44:32.816092] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-24T17:44:33.277259] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T17:44:33.616096] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-24T17:44:34.240000] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T17:44:34.395139] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T17:44:34.416081] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-24T17:44:35.216112] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-24T17:44:35.442596] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T17:44:36.016095] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-24T17:44:36.616358] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:44:36.816081] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-24T17:44:37.508192] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T17:44:37.616085] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-24T17:44:37.871262] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T17:44:38.416096] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-24T17:44:39.114878] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:44:39.122372] [INFO ] [REMOTE ] BSBR: Full fetch complete (50540 records). [2025-09-24T17:44:39.122549] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-24T17:44:39.221239] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-24T17:44:39.521547] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-24T17:44:39.521794] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-24T17:44:39.522510] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-24T17:44:39.522572] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-24T17:44:39.523809] [DEBUG] [LOCAL ] BSBR: Trimmed 50540 records to 35185 (keeping 200 days of data) [2025-09-24T17:44:39.744400] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T17:44:39.766012] [DEBUG] [LOCAL ] BSBR: Primary data saved (35185 records). [2025-09-24T17:44:39.766179] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-24T17:44:39.766764] [INFO ] [MAIN ] Update Progress: 340/2373 symbols completed. BSBR took 29.1s. Estimated remaining: 4h 26m 41s. Rate: 7.6 symbols/min [2025-09-24T17:44:39.936156] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:39.958971] [DEBUG] [LOCAL ] BST: Loaded 19205 existing records from primary storage. [2025-09-24T17:44:39.959123] [INFO ] [MAIN ] BST: Loaded 19205 existing records. [2025-09-24T17:44:40.021347] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-24T17:44:40.161574] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:40.161939] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-24T17:44:40.161992] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-24T17:44:40.162614] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-24T17:44:40.162718] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-24T17:44:40.537883] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:40.558011] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T17:44:40.816093] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-24T17:44:40.882991] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T17:44:41.616081] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-24T17:44:42.170835] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T17:44:42.259413] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T17:44:42.416081] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-24T17:44:43.162041] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T17:44:43.216194] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-24T17:44:44.016163] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-24T17:44:44.600346] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T17:44:44.601186] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T17:44:44.816097] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-24T17:44:45.451151] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T17:44:45.453522] [INFO ] [REMOTE ] BSL: Full fetch complete (11071 records). [2025-09-24T17:44:45.453601] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-24T17:44:45.638962] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-24T17:44:45.655449] [WARN ] [VALIDATOR ] BSL: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T17:44:45.657600] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:44:45.657736] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:44:45.657832] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-24T17:44:45.657917] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-09-24T17:44:45.657971] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-09-24T17:44:45.659025] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-09-24T17:44:45.659353] [INFO ] [MAIN ] Update Progress: 341/2373 symbols completed. BSL took 22.6s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-24T17:44:45.848682] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:45.874996] [DEBUG] [LOCAL ] BSTZ: Loaded 24871 existing records from primary storage. [2025-09-24T17:44:45.875145] [INFO ] [MAIN ] BSTZ: Loaded 24871 existing records. [2025-09-24T17:44:46.052334] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:46.052587] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-24T17:44:46.052637] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-24T17:44:46.054328] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-24T17:44:46.054391] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-24T17:44:46.408415] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:46.416047] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-24T17:44:47.216141] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-24T17:44:47.325840] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T17:44:47.331699] [INFO ] [REMOTE ] BSAC: Full fetch complete (43558 records). [2025-09-24T17:44:47.331813] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-24T17:44:47.754452] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-24T17:44:47.764740] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-24T17:44:47.766116] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-24T17:44:47.767345] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-24T17:44:47.767242] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T17:44:47.774865] [DEBUG] [LOCAL ] BSAC: Trimmed 43558 records to 33027 (keeping 200 days of data) [2025-09-24T17:44:47.966388] [DEBUG] [LOCAL ] BSAC: Primary data saved (33027 records). [2025-09-24T17:44:47.966704] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-24T17:44:47.966829] [INFO ] [MAIN ] Update Progress: 342/2373 symbols completed. BSAC took 38.8s. Estimated remaining: 4h 25m 41s. Rate: 7.6 symbols/min [2025-09-24T17:44:48.021258] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-24T17:44:48.142848] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:48.197246] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T17:44:48.254668] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-24T17:44:48.254890] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-24T17:44:48.430400] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:44:48.430677] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-24T17:44:48.430736] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-24T17:44:48.432217] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-24T17:44:48.432280] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-24T17:44:48.785477] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:44:48.816030] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-24T17:44:49.310404] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T17:44:49.616098] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-24T17:44:50.416092] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-24T17:44:50.612659] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T17:44:50.636671] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T17:44:51.216099] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-24T17:44:51.529760] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T17:44:52.016295] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-24T17:44:52.556992] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T17:44:52.816090] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-24T17:44:52.927917] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T17:44:53.616103] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-24T17:44:54.416107] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-24T17:44:54.591896] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T17:44:54.653703] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T17:44:55.216095] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-24T17:44:55.879810] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T17:44:56.016041] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-24T17:44:56.353959] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T17:44:56.816116] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-24T17:44:57.270954] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T17:44:57.616059] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-24T17:44:57.949329] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T17:44:58.416122] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-24T17:44:59.162146] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T17:44:59.168439] [INFO ] [REMOTE ] BSM: Full fetch complete (47591 records). [2025-09-24T17:44:59.168547] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-24T17:44:59.223468] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-24T17:44:59.553986] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-24T17:44:59.554146] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-24T17:44:59.554763] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-24T17:44:59.554827] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-24T17:44:59.555912] [DEBUG] [LOCAL ] BSM: Trimmed 47591 records to 32388 (keeping 200 days of data) [2025-09-24T17:44:59.757909] [DEBUG] [LOCAL ] BSM: Primary data saved (32388 records). [2025-09-24T17:44:59.758091] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-24T17:44:59.758184] [INFO ] [MAIN ] Update Progress: 343/2373 symbols completed. BSM took 30.8s. Estimated remaining: 4h 25m 56s. Rate: 7.6 symbols/min [2025-09-24T17:44:59.940901] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:44:59.957605] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T17:44:59.968840] [DEBUG] [LOCAL ] BTA: Loaded 5282 existing records from primary storage. [2025-09-24T17:44:59.968981] [INFO ] [MAIN ] BTA: Loaded 5282 existing records. [2025-09-24T17:45:00.021251] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-24T17:45:00.203636] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:00.203997] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-24T17:45:00.204060] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-24T17:45:00.204485] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-24T17:45:00.204553] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-24T17:45:00.556752] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:00.816065] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-24T17:45:01.049865] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T17:45:01.118692] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T17:45:01.550274] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T17:45:01.616145] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-24T17:45:02.416134] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-24T17:45:03.216102] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-24T17:45:04.016112] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-24T17:45:04.700565] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-24T17:45:04.809985] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (3.19 seconds). [2025-09-24T17:45:04.815987] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-24T17:45:05.597243] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T17:45:05.616051] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-24T17:45:05.764373] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T17:45:05.890285] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T17:45:06.416141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-24T17:45:06.640416] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T17:45:07.216113] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-24T17:45:07.425495] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T17:45:08.016125] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-24T17:45:08.816090] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-24T17:45:08.929866] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T17:45:08.970860] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:45:09.582341] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T17:45:09.616059] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-24T17:45:10.167611] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:45:10.416142] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-24T17:45:11.026122] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T17:45:11.216094] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-24T17:45:12.016082] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-24T17:45:12.603509] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T17:45:12.608731] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36460 records). [2025-09-24T17:45:12.608830] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-24T17:45:12.609469] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:45:12.609564] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:45:12.609606] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:45:12.609666] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-24T17:45:12.609762] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-24T17:45:12.609821] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-09-24T17:45:12.610299] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-09-24T17:45:12.610464] [INFO ] [MAIN ] Update Progress: 344/2373 symbols completed. BSTZ took 27.0s. Estimated remaining: 4h 26m 18s. Rate: 7.6 symbols/min [2025-09-24T17:45:12.729549] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T17:45:12.792346] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:12.808552] [DEBUG] [LOCAL ] BTCM: Loaded 14757 existing records from primary storage. [2025-09-24T17:45:12.808697] [INFO ] [MAIN ] BTCM: Loaded 14757 existing records. [2025-09-24T17:45:12.821265] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-24T17:45:12.996201] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:12.996546] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-24T17:45:12.996613] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-24T17:45:13.002516] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-24T17:45:13.002874] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-24T17:45:13.371680] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:13.616067] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-24T17:45:13.648704] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T17:45:14.416092] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-24T17:45:15.216161] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-24T17:45:15.857786] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-24T17:45:15.944898] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T17:45:16.016079] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-24T17:45:16.331588] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T17:45:16.651113] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T17:45:16.816205] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-24T17:45:17.538122] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T17:45:17.616096] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-24T17:45:18.406697] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T17:45:18.408462] [INFO ] [REMOTE ] BTA: Full fetch complete (9586 records). [2025-09-24T17:45:18.408566] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-24T17:45:18.421227] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-24T17:45:18.813821] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-24T17:45:18.813915] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-24T17:45:18.814158] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-24T17:45:18.814197] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-24T17:45:18.814625] [DEBUG] [LOCAL ] BTA: Trimmed 9586 records to 5372 (keeping 200 days of data) [2025-09-24T17:45:18.846348] [DEBUG] [LOCAL ] BTA: Primary data saved (5372 records). [2025-09-24T17:45:18.846442] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-24T17:45:18.846578] [INFO ] [MAIN ] Update Progress: 345/2373 symbols completed. BTA took 19.1s. Estimated remaining: 4h 26m 0s. Rate: 7.6 symbols/min [2025-09-24T17:45:19.014940] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:19.076962] [DEBUG] [LOCAL ] BTE: Loaded 52748 existing records from primary storage. [2025-09-24T17:45:19.077143] [INFO ] [MAIN ] BTE: Loaded 52748 existing records. [2025-09-24T17:45:19.223108] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-24T17:45:19.267538] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:19.267871] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-24T17:45:19.267938] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-24T17:45:19.269356] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-24T17:45:19.269418] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-24T17:45:19.629424] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:19.642895] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:45:20.016086] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-24T17:45:20.816060] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-24T17:45:21.174478] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T17:45:21.385889] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T17:45:21.401490] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T17:45:21.616090] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-24T17:45:22.118442] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T17:45:22.416131] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-24T17:45:23.158736] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T17:45:23.216104] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-24T17:45:24.016111] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-24T17:45:24.666259] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T17:45:24.816082] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-24T17:45:25.154043] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T17:45:25.159830] [INFO ] [REMOTE ] BST: Full fetch complete (28752 records). [2025-09-24T17:45:25.159973] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-24T17:45:25.556931] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-24T17:45:25.557033] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-24T17:45:25.557534] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-24T17:45:25.557732] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-24T17:45:25.562529] [DEBUG] [LOCAL ] BST: Trimmed 28752 records to 19137 (keeping 200 days of data) [2025-09-24T17:45:25.629056] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-24T17:45:25.705011] [DEBUG] [LOCAL ] BST: Primary data saved (19137 records). [2025-09-24T17:45:25.705188] [INFO ] [MAIN ] BST: Full history saved. [2025-09-24T17:45:25.705326] [INFO ] [MAIN ] Update Progress: 346/2373 symbols completed. BST took 45.9s. Estimated remaining: 4h 25m 47s. Rate: 7.6 symbols/min [2025-09-24T17:45:25.889867] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:25.948587] [DEBUG] [LOCAL ] BTI: Loaded 53557 existing records from primary storage. [2025-09-24T17:45:25.948782] [INFO ] [MAIN ] BTI: Loaded 53557 existing records. [2025-09-24T17:45:26.135976] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:26.136370] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-24T17:45:26.136454] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-24T17:45:26.137968] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-24T17:45:26.138047] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-24T17:45:26.416136] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-24T17:45:26.498398] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:26.899368] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T17:45:27.216091] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-24T17:45:27.401296] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-24T17:45:28.016147] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-24T17:45:28.816191] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-24T17:45:29.095782] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-24T17:45:29.346672] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T17:45:29.417242] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T17:45:29.616077] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-24T17:45:29.768220] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T17:45:30.416058] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-24T17:45:31.216054] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-24T17:45:31.624813] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T17:45:32.016132] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-24T17:45:32.650044] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-24T17:45:32.816049] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-24T17:45:33.312053] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T17:45:33.616108] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-24T17:45:33.954731] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T17:45:34.416144] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-24T17:45:34.606443] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T17:45:35.216103] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-24T17:45:35.331798] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T17:45:36.016088] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-24T17:45:36.616576] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-24T17:45:36.816150] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-24T17:45:37.264473] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T17:45:37.277586] [INFO ] [REMOTE ] BSX: Full fetch complete (77684 records). [2025-09-24T17:45:37.277763] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-24T17:45:37.617377] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-24T17:45:37.750141] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-24T17:45:37.766461] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-24T17:45:37.767481] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-24T17:45:37.767586] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-24T17:45:37.795272] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T17:45:37.795432] [DEBUG] [LOCAL ] BSX: Trimmed 77684 records to 53688 (keeping 200 days of data) [2025-09-24T17:45:38.145585] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-24T17:45:38.145776] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-24T17:45:38.145906] [INFO ] [MAIN ] Update Progress: 347/2373 symbols completed. BSX took 50.2s. Estimated remaining: 4h 26m 5s. Rate: 7.6 symbols/min [2025-09-24T17:45:38.328066] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:38.340253] [DEBUG] [LOCAL ] BTO: Loaded 8939 existing records from primary storage. [2025-09-24T17:45:38.340376] [INFO ] [MAIN ] BTO: Loaded 8939 existing records. [2025-09-24T17:45:38.419278] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-24T17:45:38.542725] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:38.543132] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-24T17:45:38.543208] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-24T17:45:38.543820] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-24T17:45:38.543893] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-24T17:45:38.962834] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:38.993505] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-24T17:45:39.098905] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T17:45:39.216084] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-24T17:45:40.016096] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-24T17:45:40.246084] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T17:45:40.296730] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T17:45:40.301592] [INFO ] [REMOTE ] BTCM: Full fetch complete (19635 records). [2025-09-24T17:45:40.301780] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-24T17:45:40.746959] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-24T17:45:40.747297] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-24T17:45:40.747781] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-24T17:45:40.747844] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-24T17:45:40.748577] [DEBUG] [LOCAL ] BTCM: Trimmed 19635 records to 14856 (keeping 200 days of data) [2025-09-24T17:45:40.828449] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-24T17:45:40.828349] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T17:45:40.859279] [DEBUG] [LOCAL ] BTCM: Primary data saved (14856 records). [2025-09-24T17:45:40.859947] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-24T17:45:40.860079] [INFO ] [MAIN ] Update Progress: 348/2373 symbols completed. BTCM took 28.2s. Estimated remaining: 4h 25m 28s. Rate: 7.6 symbols/min [2025-09-24T17:45:41.029078] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:41.029268] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-09-24T17:45:41.029313] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-09-24T17:45:41.029467] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-24T17:45:41.029509] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-24T17:45:41.029552] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-24T17:45:41.029662] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-24T17:45:41.392802] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:41.616078] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-24T17:45:42.416083] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-24T17:45:42.588225] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T17:45:42.838171] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:45:43.216082] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-24T17:45:44.016106] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-24T17:45:44.193084] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:45:44.374030] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T17:45:44.816109] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-24T17:45:45.612111] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T17:45:45.616019] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-24T17:45:45.946912] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T17:45:46.416051] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-24T17:45:46.447170] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T17:45:47.216092] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-24T17:45:48.017897] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-24T17:45:48.020254] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T17:45:48.215279] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T17:45:48.605390] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T17:45:48.816055] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-24T17:45:49.616127] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-24T17:45:50.345834] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T17:45:50.416089] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-24T17:45:50.582315] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T17:45:50.595306] [INFO ] [REMOTE ] BTE: Full fetch complete (75605 records). [2025-09-24T17:45:50.595468] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-24T17:45:50.596396] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:45:50.596536] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:45:50.596594] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:45:50.596691] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-24T17:45:50.596777] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-09-24T17:45:50.596844] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-09-24T17:45:50.597438] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-09-24T17:45:50.597556] [INFO ] [MAIN ] Update Progress: 349/2373 symbols completed. BTE took 31.8s. Estimated remaining: 4h 25m 31s. Rate: 7.6 symbols/min [2025-09-24T17:45:50.769036] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:45:50.823157] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-24T17:45:50.823312] [INFO ] [MAIN ] BTU: Loaded 53303 existing records. [2025-09-24T17:45:51.000275] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:45:51.000515] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-24T17:45:51.000567] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-24T17:45:51.001939] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-24T17:45:51.001999] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-24T17:45:51.222391] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-24T17:45:51.406954] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:45:52.016067] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-24T17:45:52.298486] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T17:45:52.536211] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T17:45:52.791760] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T17:45:52.816033] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-24T17:45:53.616127] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-24T17:45:53.869212] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T17:45:54.337056] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T17:45:54.416157] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-24T17:45:55.201009] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T17:45:55.216063] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-24T17:45:55.916305] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T17:45:56.016143] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-24T17:45:56.816103] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-24T17:45:57.616068] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-24T17:45:57.863420] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T17:45:58.416058] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-24T17:45:58.614171] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T17:45:58.651251] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:45:59.216086] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-24T17:45:59.990516] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T17:46:00.016120] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-24T17:46:00.405077] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T17:46:00.416620] [INFO ] [REMOTE ] BTI: Full fetch complete (77426 records). [2025-09-24T17:46:00.416884] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-24T17:46:00.815960] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T17:46:00.831503] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-24T17:46:00.838375] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-24T17:46:00.839635] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-24T17:46:00.840629] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-24T17:46:00.840815] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-24T17:46:00.843267] [DEBUG] [LOCAL ] BTI: Trimmed 77426 records to 53558 (keeping 200 days of data) [2025-09-24T17:46:01.181018] [DEBUG] [LOCAL ] BTI: Primary data saved (53558 records). [2025-09-24T17:46:01.181227] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-24T17:46:01.182639] [INFO ] [MAIN ] Update Progress: 350/2373 symbols completed. BTI took 35.5s. Estimated remaining: 4h 25m 38s. Rate: 7.6 symbols/min [2025-09-24T17:46:01.351371] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:01.351577] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-24T17:46:01.351615] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-24T17:46:01.351784] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-24T17:46:01.351826] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-24T17:46:01.351867] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-24T17:46:01.351899] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-24T17:46:01.621261] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-24T17:46:01.830052] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:02.348016] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T17:46:02.416086] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-24T17:46:02.637824] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T17:46:02.640529] [INFO ] [REMOTE ] BTO: Full fetch complete (13285 records). [2025-09-24T17:46:02.640611] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-24T17:46:02.641096] [FATAL] [VALIDATOR ] BTO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:46:02.641185] [FATAL] [MAIN ] BTO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:46:02.641230] [WARN ] [MAIN ] BTO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:46:02.641298] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-24T17:46:02.641384] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-09-24T17:46:02.641437] [INFO ] [LOCAL ] BTO: Starting deletion of derivative data. [2025-09-24T17:46:02.641823] [DEBUG] [LOCAL ] BTO: Deleted derivative data file. [2025-09-24T17:46:02.641920] [INFO ] [MAIN ] Update Progress: 351/2373 symbols completed. BTO took 24.5s. Estimated remaining: 4h 24m 54s. Rate: 7.6 symbols/min [2025-09-24T17:46:02.826193] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:02.852049] [DEBUG] [LOCAL ] BTZ: Loaded 22844 existing records from primary storage. [2025-09-24T17:46:02.852196] [INFO ] [MAIN ] BTZ: Loaded 22844 existing records. [2025-09-24T17:46:03.033976] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:46:03.034258] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-24T17:46:03.034309] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-24T17:46:03.035059] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-24T17:46:03.035122] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-24T17:46:03.216291] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-24T17:46:03.413855] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:04.016110] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-24T17:46:04.170172] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T17:46:04.205334] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T17:46:04.816130] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-24T17:46:05.227441] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:46:05.228120] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-24T17:46:05.254378] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T17:46:05.616101] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-24T17:46:06.321371] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T17:46:06.325343] [INFO ] [REMOTE ] BTT: Full fetch complete (24381 records). [2025-09-24T17:46:06.325481] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-24T17:46:06.421232] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-24T17:46:06.681332] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:46:06.718037] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-24T17:46:06.758610] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-24T17:46:06.758755] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-24T17:46:06.759307] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-24T17:46:06.759353] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-24T17:46:06.760387] [DEBUG] [LOCAL ] BTT: Trimmed 24381 records to 15944 (keeping 200 days of data) [2025-09-24T17:46:06.874724] [DEBUG] [LOCAL ] BTT: Primary data saved (15944 records). [2025-09-24T17:46:06.874910] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-24T17:46:06.875001] [INFO ] [MAIN ] Update Progress: 352/2373 symbols completed. BTT took 26.0s. Estimated remaining: 4h 24m 25s. Rate: 7.6 symbols/min [2025-09-24T17:46:07.105915] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:07.177919] [DEBUG] [LOCAL ] BUD: Loaded 52743 existing records from primary storage. [2025-09-24T17:46:07.178168] [INFO ] [MAIN ] BUD: Loaded 52743 existing records. [2025-09-24T17:46:07.221351] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-24T17:46:07.385459] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:46:07.385885] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-24T17:46:07.385947] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-24T17:46:07.387236] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-24T17:46:07.387300] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-24T17:46:07.808513] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:08.016114] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-24T17:46:08.367603] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T17:46:08.816106] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-24T17:46:09.616096] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-24T17:46:09.830266] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:46:10.416066] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-24T17:46:10.525438] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:46:10.848201] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T17:46:11.216119] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-24T17:46:12.016122] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-24T17:46:12.210420] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T17:46:12.816070] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-24T17:46:12.931635] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T17:46:13.488773] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:46:13.616093] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-24T17:46:14.416118] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-24T17:46:14.825468] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T17:46:15.016287] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T17:46:15.216151] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-24T17:46:15.611293] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T17:46:16.016139] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-24T17:46:16.816074] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-24T17:46:16.917028] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T17:46:17.616053] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-24T17:46:17.852164] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T17:46:17.912296] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T17:46:18.416102] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-24T17:46:19.216097] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-24T17:46:19.650955] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T17:46:20.002768] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T17:46:20.016037] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-24T17:46:20.078717] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T17:46:20.816087] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-24T17:46:21.616107] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-24T17:46:21.674464] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T17:46:22.416132] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-24T17:46:22.806420] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T17:46:22.970813] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T17:46:23.216126] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-24T17:46:24.016081] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-24T17:46:24.315971] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T17:46:24.597154] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T17:46:24.816139] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-24T17:46:25.268497] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T17:46:25.616082] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-24T17:46:26.416126] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-24T17:46:26.541439] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T17:46:26.886921] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T17:46:27.216128] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-24T17:46:27.327534] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T17:46:28.016085] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-24T17:46:28.816092] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-24T17:46:28.835854] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T17:46:29.010472] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T17:46:29.020169] [INFO ] [REMOTE ] BTU: Full fetch complete (76831 records). [2025-09-24T17:46:29.020343] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-24T17:46:29.424624] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-24T17:46:29.424769] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-24T17:46:29.425580] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-24T17:46:29.425624] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-24T17:46:29.427151] [DEBUG] [LOCAL ] BTU: Trimmed 76831 records to 53303 (keeping 200 days of data) [2025-09-24T17:46:29.617522] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-24T17:46:29.756745] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-24T17:46:29.756893] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-24T17:46:29.756981] [INFO ] [MAIN ] Update Progress: 353/2373 symbols completed. BTU took 39.2s. Estimated remaining: 4h 25m 43s. Rate: 7.6 symbols/min [2025-09-24T17:46:29.929824] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:29.942587] [DEBUG] [LOCAL ] BUI: Loaded 11464 existing records from primary storage. [2025-09-24T17:46:29.942750] [INFO ] [MAIN ] BUI: Loaded 11464 existing records. [2025-09-24T17:46:30.154780] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:46:30.155088] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-24T17:46:30.155139] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-24T17:46:30.155727] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-24T17:46:30.155791] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-24T17:46:30.421185] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-24T17:46:30.534890] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:30.657475] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T17:46:30.762263] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T17:46:31.216137] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-24T17:46:31.773197] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T17:46:31.779110] [INFO ] [REMOTE ] BTX: Full fetch complete (35773 records). [2025-09-24T17:46:31.779283] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-24T17:46:31.979743] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-24T17:46:31.980176] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:46:31.980247] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:46:31.980317] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-24T17:46:31.980384] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-24T17:46:31.980422] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-24T17:46:31.980461] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-24T17:46:31.980521] [INFO ] [MAIN ] Update Progress: 354/2373 symbols completed. BTX took 30.8s. Estimated remaining: 4h 25m 3s. Rate: 7.6 symbols/min [2025-09-24T17:46:32.021132] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-24T17:46:32.084433] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T17:46:32.171968] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:32.172160] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-24T17:46:32.172247] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-24T17:46:32.172445] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-24T17:46:32.172516] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-24T17:46:32.172570] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-24T17:46:32.172605] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-24T17:46:32.541706] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:32.816105] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-24T17:46:33.216525] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T17:46:33.355309] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T17:46:33.616092] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-24T17:46:34.236767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T17:46:34.416096] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-24T17:46:35.212985] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T17:46:35.216017] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-24T17:46:36.016050] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-24T17:46:36.095234] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T17:46:36.816100] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-24T17:46:37.364977] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T17:46:37.616091] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-24T17:46:38.170514] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T17:46:38.174863] [INFO ] [REMOTE ] BTZ: Full fetch complete (33769 records). [2025-09-24T17:46:38.174945] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-24T17:46:38.426803] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-24T17:46:38.554067] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-24T17:46:38.554146] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-24T17:46:38.554611] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-24T17:46:38.554685] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-24T17:46:38.555439] [DEBUG] [LOCAL ] BTZ: Trimmed 33769 records to 22755 (keeping 200 days of data) [2025-09-24T17:46:38.695128] [DEBUG] [LOCAL ] BTZ: Primary data saved (22755 records). [2025-09-24T17:46:38.695258] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-24T17:46:38.695336] [INFO ] [MAIN ] Update Progress: 355/2373 symbols completed. BTZ took 36.1s. Estimated remaining: 4h 24m 48s. Rate: 7.6 symbols/min [2025-09-24T17:46:38.867542] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:38.912148] [DEBUG] [LOCAL ] BURL: Loaded 46328 existing records from primary storage. [2025-09-24T17:46:38.912343] [INFO ] [MAIN ] BURL: Loaded 46328 existing records. [2025-09-24T17:46:39.095105] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:46:39.095497] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-24T17:46:39.095635] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-24T17:46:39.096849] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-24T17:46:39.096911] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-24T17:46:39.220334] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-24T17:46:39.309675] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T17:46:39.503210] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:40.016103] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-24T17:46:40.174693] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T17:46:40.410446] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-24T17:46:40.816081] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-24T17:46:41.443023] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T17:46:41.616089] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-24T17:46:42.416102] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-24T17:46:42.705008] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T17:46:42.715622] [INFO ] [REMOTE ] BUD: Full fetch complete (76484 records). [2025-09-24T17:46:42.715823] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-24T17:46:43.131898] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-24T17:46:43.132006] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-24T17:46:43.133127] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-24T17:46:43.133215] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-24T17:46:43.163726] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T17:46:43.163928] [DEBUG] [LOCAL ] BUD: Trimmed 76484 records to 52737 (keeping 200 days of data) [2025-09-24T17:46:43.250228] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-24T17:46:43.419762] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T17:46:43.532571] [DEBUG] [LOCAL ] BUD: Primary data saved (52737 records). [2025-09-24T17:46:43.532775] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-24T17:46:43.532918] [INFO ] [MAIN ] Update Progress: 356/2373 symbols completed. BUD took 36.7s. Estimated remaining: 4h 24m 23s. Rate: 7.6 symbols/min [2025-09-24T17:46:43.734826] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:46:43.758764] [DEBUG] [LOCAL ] BUXX: Loaded 15142 existing records from primary storage. [2025-09-24T17:46:43.758949] [INFO ] [MAIN ] BUXX: Loaded 15142 existing records. [2025-09-24T17:46:43.942349] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:46:43.942689] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-24T17:46:43.942747] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-24T17:46:43.943222] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-24T17:46:43.943282] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-24T17:46:44.021227] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-24T17:46:44.328706] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:46:44.816119] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-24T17:46:45.046314] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T17:46:45.575978] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T17:46:45.616032] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-24T17:46:45.748602] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T17:46:46.416092] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-24T17:46:47.216173] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-24T17:46:47.231469] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T17:46:47.313166] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T17:46:48.016192] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-24T17:46:48.158329] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-24T17:46:48.816113] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-24T17:46:49.566579] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T17:46:49.616034] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-24T17:46:49.734562] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T17:46:49.737384] [INFO ] [REMOTE ] BUI: Full fetch complete (16157 records). [2025-09-24T17:46:49.737460] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-24T17:46:50.113746] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-24T17:46:50.113840] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-24T17:46:50.114228] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-24T17:46:50.114271] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-24T17:46:50.114890] [DEBUG] [LOCAL ] BUI: Trimmed 16157 records to 11472 (keeping 200 days of data) [2025-09-24T17:46:50.187971] [DEBUG] [LOCAL ] BUI: Primary data saved (11472 records). [2025-09-24T17:46:50.188143] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-24T17:46:50.188239] [INFO ] [MAIN ] Update Progress: 357/2373 symbols completed. BUI took 20.4s. Estimated remaining: 4h 24m 9s. Rate: 7.6 symbols/min [2025-09-24T17:46:50.416089] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-24T17:46:51.191590] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T17:46:51.216133] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-24T17:46:51.503429] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T17:46:51.893827] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T17:46:52.016160] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-24T17:46:52.816221] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-24T17:46:53.616135] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-24T17:46:53.637578] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T17:46:53.788391] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T17:46:54.416115] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-24T17:46:55.216112] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-24T17:46:55.469160] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T17:46:55.524412] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T17:46:56.016136] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-24T17:46:56.754617] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T17:46:56.816156] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-24T17:46:57.616067] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-24T17:46:57.829435] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:46:57.834042] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T17:46:58.416097] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-24T17:46:59.186127] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T17:46:59.216095] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-24T17:46:59.995584] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T17:47:00.016045] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-24T17:47:00.816072] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-24T17:47:00.966049] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T17:47:00.973987] [INFO ] [REMOTE ] BUR: Full fetch complete (63297 records). [2025-09-24T17:47:00.974105] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-24T17:47:01.373027] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-24T17:47:01.373266] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-24T17:47:01.374003] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-24T17:47:01.374068] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-24T17:47:01.375455] [DEBUG] [LOCAL ] BUR: Trimmed 63297 records to 45078 (keeping 200 days of data) [2025-09-24T17:47:01.562684] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T17:47:01.656103] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-24T17:47:01.721865] [DEBUG] [LOCAL ] BUR: Primary data saved (45078 records). [2025-09-24T17:47:01.722005] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-24T17:47:01.722080] [INFO ] [MAIN ] Update Progress: 358/2373 symbols completed. BUR took 29.7s. Estimated remaining: 4h 24m 21s. Rate: 7.6 symbols/min [2025-09-24T17:47:01.766914] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:47:02.416125] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-24T17:47:03.269467] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T17:47:03.273246] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-24T17:47:03.318144] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T17:47:04.016106] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-24T17:47:04.099846] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T17:47:04.816080] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-24T17:47:05.517398] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T17:47:05.616083] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-24T17:47:05.836514] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T17:47:05.840253] [INFO ] [REMOTE ] BUXX: Full fetch complete (20242 records). [2025-09-24T17:47:05.840409] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-24T17:47:06.226999] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-24T17:47:06.227086] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-24T17:47:06.227467] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-24T17:47:06.227507] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-24T17:47:06.228162] [DEBUG] [LOCAL ] BUXX: Trimmed 20242 records to 15128 (keeping 200 days of data) [2025-09-24T17:47:06.324414] [DEBUG] [LOCAL ] BUXX: Primary data saved (15128 records). [2025-09-24T17:47:06.324568] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-24T17:47:06.324679] [INFO ] [MAIN ] Update Progress: 359/2373 symbols completed. BUXX took 22.8s. Estimated remaining: 4h 23m 55s. Rate: 7.6 symbols/min [2025-09-24T17:47:07.359235] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T17:47:07.367134] [INFO ] [REMOTE ] BURL: Full fetch complete (65726 records). [2025-09-24T17:47:07.367265] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-24T17:47:07.751964] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-24T17:47:07.752053] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-24T17:47:07.752824] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-24T17:47:07.752891] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-24T17:47:07.754321] [DEBUG] [LOCAL ] BURL: Trimmed 65726 records to 46310 (keeping 200 days of data) [2025-09-24T17:47:08.038225] [DEBUG] [LOCAL ] BURL: Primary data saved (46310 records). [2025-09-24T17:47:08.038377] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-24T17:47:08.038465] [INFO ] [MAIN ] Update Progress: 360/2373 symbols completed. BURL took 29.3s. Estimated remaining: 4h 23m 13s. Rate: 7.6 symbols/min [2025-09-24T17:47:08.673347] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:08.770760] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:08.760535] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:08.802998] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:08.864549] [DEBUG] [LOCAL ] BV: Loaded 38602 existing records from primary storage. [2025-09-24T17:47:08.875623] [INFO ] [MAIN ] BV: Loaded 38602 existing records. [2025-09-24T17:47:08.887024] [DEBUG] [LOCAL ] BW: Loaded 39536 existing records from primary storage. [2025-09-24T17:47:08.955440] [INFO ] [MAIN ] BW: Loaded 39536 existing records. [2025-09-24T17:47:09.078537] [DEBUG] [LOCAL ] BWA: Loaded 52250 existing records from primary storage. [2025-09-24T17:47:09.121467] [INFO ] [MAIN ] BWA: Loaded 52250 existing records. [2025-09-24T17:47:09.168419] [DEBUG] [LOCAL ] BVN: Loaded 43805 existing records from primary storage. [2025-09-24T17:47:09.237547] [INFO ] [MAIN ] BVN: Loaded 43805 existing records. [2025-09-24T17:47:09.463533] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:09.494108] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-24T17:47:09.493870] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:09.510263] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-24T17:47:09.546732] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-24T17:47:09.601875] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-24T17:47:09.596092] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-24T17:47:09.659566] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:09.640143] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-24T17:47:09.683771] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-24T17:47:09.714487] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-24T17:47:09.727208] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-24T17:47:09.737734] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:09.784030] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-24T17:47:09.836379] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-24T17:47:09.852040] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-24T17:47:09.811909] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-24T17:47:09.865795] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-24T17:47:09.869440] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-24T17:47:09.893400] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-24T17:47:10.977723] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:11.047193] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-24T17:47:11.083495] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:11.167430] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-24T17:47:11.161504] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:11.167978] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-24T17:47:11.246696] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:11.247032] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-24T17:47:12.630746] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T17:47:12.637954] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-24T17:47:12.749262] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T17:47:12.759235] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-24T17:47:12.839957] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T17:47:12.850815] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-24T17:47:12.944997] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T17:47:12.955622] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-24T17:47:13.891804] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T17:47:13.898324] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-24T17:47:14.097813] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T17:47:14.105851] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-24T17:47:14.334897] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T17:47:14.416057] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-24T17:47:14.488333] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T17:47:15.216106] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-24T17:47:15.343716] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T17:47:15.429467] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T17:47:16.016154] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-24T17:47:16.238043] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T17:47:16.392852] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T17:47:16.816109] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-24T17:47:17.535564] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:47:17.616079] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-24T17:47:18.416117] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-24T17:47:18.574863] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T17:47:19.037534] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T17:47:19.216105] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-24T17:47:19.928478] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:47:20.016084] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-24T17:47:20.808690] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T17:47:20.817756] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-24T17:47:21.621166] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-24T17:47:21.638895] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T17:47:22.416125] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-24T17:47:22.667923] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T17:47:23.058110] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T17:47:23.216104] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-24T17:47:23.556508] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T17:47:24.016131] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-24T17:47:24.816058] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-24T17:47:24.986506] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T17:47:25.236552] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T17:47:25.616073] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-24T17:47:26.038891] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T17:47:26.416079] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-24T17:47:27.116883] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:47:27.216095] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-24T17:47:27.893173] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T17:47:28.016148] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-24T17:47:28.809855] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T17:47:28.820541] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-24T17:47:29.431368] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T17:47:29.616088] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-24T17:47:29.817626] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T17:47:30.416090] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-24T17:47:31.073398] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T17:47:31.216102] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-24T17:47:31.753827] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T17:47:32.016088] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-24T17:47:32.431977] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T17:47:32.816110] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-24T17:47:33.549482] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T17:47:33.616083] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-24T17:47:34.416250] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-24T17:47:34.499179] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T17:47:35.216109] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-24T17:47:35.319393] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T17:47:35.328412] [INFO ] [REMOTE ] BW: Full fetch complete (58717 records). [2025-09-24T17:47:35.328595] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-24T17:47:35.741222] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-24T17:47:35.741399] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-24T17:47:35.742182] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-24T17:47:35.742301] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-24T17:47:35.744065] [DEBUG] [LOCAL ] BW: Trimmed 58717 records to 39574 (keeping 200 days of data) [2025-09-24T17:47:35.771085] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T17:47:36.011523] [DEBUG] [LOCAL ] BW: Primary data saved (39574 records). [2025-09-24T17:47:36.011798] [INFO ] [MAIN ] BW: Full history saved. [2025-09-24T17:47:36.012034] [INFO ] [MAIN ] Update Progress: 361/2373 symbols completed. BW took 28.0s. Estimated remaining: 4h 24m 57s. Rate: 7.6 symbols/min [2025-09-24T17:47:36.025100] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-24T17:47:36.190306] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:36.205221] [DEBUG] [LOCAL ] BWG: Loaded 12317 existing records from primary storage. [2025-09-24T17:47:36.205366] [INFO ] [MAIN ] BWG: Loaded 12317 existing records. [2025-09-24T17:47:36.382426] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:36.382760] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-24T17:47:36.382826] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-24T17:47:36.383363] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-24T17:47:36.383440] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-24T17:47:36.762920] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:36.816072] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-24T17:47:36.991141] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T17:47:37.005413] [INFO ] [REMOTE ] BWA: Full fetch complete (75749 records). [2025-09-24T17:47:37.005675] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-24T17:47:37.436686] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-24T17:47:37.436834] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-24T17:47:37.437847] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-24T17:47:37.437918] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-24T17:47:37.439581] [DEBUG] [LOCAL ] BWA: Trimmed 75749 records to 52242 (keeping 200 days of data) [2025-09-24T17:47:37.600452] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T17:47:37.616387] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-24T17:47:37.647275] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T17:47:37.844059] [DEBUG] [LOCAL ] BWA: Primary data saved (52242 records). [2025-09-24T17:47:37.844233] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-24T17:47:37.844371] [INFO ] [MAIN ] Update Progress: 362/2373 symbols completed. BWA took 29.8s. Estimated remaining: 4h 24m 16s. Rate: 7.6 symbols/min [2025-09-24T17:47:38.013680] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:38.050305] [DEBUG] [LOCAL ] BWLP: Loaded 32847 existing records from primary storage. [2025-09-24T17:47:38.050459] [INFO ] [MAIN ] BWLP: Loaded 32847 existing records. [2025-09-24T17:47:38.225752] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:38.226034] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-24T17:47:38.226082] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-24T17:47:38.227176] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-24T17:47:38.227237] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-24T17:47:38.423208] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-24T17:47:38.624037] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:39.216047] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-24T17:47:39.244604] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T17:47:39.401563] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T17:47:39.412049] [INFO ] [REMOTE ] BVN: Full fetch complete (62695 records). [2025-09-24T17:47:39.412242] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-24T17:47:39.947228] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-24T17:47:39.947404] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-24T17:47:39.948884] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-24T17:47:39.948978] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-24T17:47:39.952192] [DEBUG] [LOCAL ] BVN: Trimmed 62695 records to 43807 (keeping 200 days of data) [2025-09-24T17:47:40.033741] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-24T17:47:40.373928] [DEBUG] [LOCAL ] BVN: Primary data saved (43807 records). [2025-09-24T17:47:40.374377] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-24T17:47:40.374617] [INFO ] [MAIN ] Update Progress: 363/2373 symbols completed. BVN took 32.3s. Estimated remaining: 4h 23m 38s. Rate: 7.6 symbols/min [2025-09-24T17:47:40.660060] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:40.701192] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T17:47:40.714149] [DEBUG] [LOCAL ] BWMX: Loaded 7621 existing records from primary storage. [2025-09-24T17:47:40.715569] [INFO ] [MAIN ] BWMX: Loaded 7621 existing records. [2025-09-24T17:47:40.820166] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-24T17:47:40.861108] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T17:47:40.924608] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:47:40.924944] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-24T17:47:40.925008] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-24T17:47:40.925528] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-24T17:47:40.925616] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-24T17:47:41.310770] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:41.616091] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-24T17:47:42.317956] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T17:47:42.416084] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-24T17:47:42.497896] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T17:47:42.505455] [INFO ] [REMOTE ] BV: Full fetch complete (53792 records). [2025-09-24T17:47:42.505597] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-24T17:47:42.881431] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-24T17:47:42.881526] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-24T17:47:42.882179] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-24T17:47:42.882269] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-24T17:47:42.883469] [DEBUG] [LOCAL ] BV: Trimmed 53792 records to 38509 (keeping 200 days of data) [2025-09-24T17:47:43.127180] [DEBUG] [LOCAL ] BV: Primary data saved (38509 records). [2025-09-24T17:47:43.127344] [INFO ] [MAIN ] BV: Full history saved. [2025-09-24T17:47:43.127496] [INFO ] [MAIN ] Update Progress: 364/2373 symbols completed. BV took 35.1s. Estimated remaining: 4h 23m 2s. Rate: 7.6 symbols/min [2025-09-24T17:47:43.221209] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-24T17:47:43.305972] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:47:43.306137] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-09-24T17:47:43.306174] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-09-24T17:47:43.306321] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-24T17:47:43.306365] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-24T17:47:43.306407] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-24T17:47:43.306440] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-24T17:47:43.696682] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:47:43.843543] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:47:43.880602] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T17:47:44.016086] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-24T17:47:44.536315] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-24T17:47:44.816112] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-24T17:47:45.255101] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T17:47:45.616080] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-24T17:47:46.154587] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T17:47:46.416072] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-24T17:47:47.216128] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-24T17:47:47.652927] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T17:47:47.793449] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T17:47:48.016093] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-24T17:47:48.580931] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T17:47:48.816140] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-24T17:47:49.616150] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-24T17:47:50.274753] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-24T17:47:50.299613] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:47:50.416092] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-24T17:47:51.216112] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-24T17:47:51.847478] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T17:47:52.016078] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-24T17:47:52.072317] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T17:47:52.362478] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T17:47:52.816097] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-24T17:47:53.425044] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T17:47:53.616112] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-24T17:47:54.358405] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T17:47:54.416109] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-24T17:47:55.216129] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-24T17:47:55.873624] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T17:47:55.886870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T17:47:56.016035] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-24T17:47:56.816089] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-24T17:47:57.418430] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T17:47:57.460173] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T17:47:57.616080] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-24T17:47:58.053501] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T17:47:58.416070] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-24T17:47:59.216063] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-24T17:47:59.288069] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T17:47:59.774941] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T17:48:00.016126] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-24T17:48:00.816133] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-24T17:48:00.981022] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T17:48:01.616062] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-24T17:48:01.746504] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T17:48:01.747784] [INFO ] [REMOTE ] BWNB: Full fetch complete (5745 records). [2025-09-24T17:48:01.747856] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-24T17:48:02.123038] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-24T17:48:02.123118] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-24T17:48:02.123360] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-24T17:48:02.123417] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-24T17:48:02.123839] [DEBUG] [LOCAL ] BWNB: Trimmed 5745 records to 4454 (keeping 200 days of data) [2025-09-24T17:48:02.151431] [DEBUG] [LOCAL ] BWNB: Primary data saved (4454 records). [2025-09-24T17:48:02.151513] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-24T17:48:02.151580] [INFO ] [MAIN ] Update Progress: 365/2373 symbols completed. BWNB took 19.0s. Estimated remaining: 4h 23m 56s. Rate: 7.6 symbols/min [2025-09-24T17:48:02.320454] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:02.331872] [DEBUG] [LOCAL ] BWSN: Loaded 5091 existing records from primary storage. [2025-09-24T17:48:02.331984] [INFO ] [MAIN ] BWSN: Loaded 5091 existing records. [2025-09-24T17:48:02.424742] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-24T17:48:02.606361] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:02.606712] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-24T17:48:02.606769] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-24T17:48:02.607332] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-24T17:48:02.607394] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-24T17:48:02.966055] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:03.216061] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-24T17:48:04.016158] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-24T17:48:04.692602] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T17:48:04.789966] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (3.17 seconds). [2025-09-24T17:48:04.816041] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-24T17:48:04.904888] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-24T17:48:05.393537] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T17:48:05.616104] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-24T17:48:05.868937] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:48:06.288173] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T17:48:06.416102] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-24T17:48:07.216079] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-24T17:48:07.746442] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-24T17:48:07.767440] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T17:48:08.016151] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-24T17:48:08.816105] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-24T17:48:09.328626] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T17:48:09.334128] [INFO ] [REMOTE ] BWLP: Full fetch complete (48359 records). [2025-09-24T17:48:09.334221] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-24T17:48:09.336725] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:48:09.336816] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:48:09.336858] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:48:09.336943] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-24T17:48:09.337011] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-24T17:48:09.337046] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-09-24T17:48:09.337560] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-09-24T17:48:09.337686] [INFO ] [MAIN ] Update Progress: 366/2373 symbols completed. BWLP took 31.5s. Estimated remaining: 4h 23m 44s. Rate: 7.6 symbols/min [2025-09-24T17:48:09.509203] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:09.572294] [DEBUG] [LOCAL ] BWXT: Loaded 46764 existing records from primary storage. [2025-09-24T17:48:09.572447] [INFO ] [MAIN ] BWXT: Loaded 46764 existing records. [2025-09-24T17:48:09.617117] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-24T17:48:09.760758] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:09.761248] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-24T17:48:09.761786] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-24T17:48:09.763243] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-24T17:48:09.763305] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-24T17:48:09.881479] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T17:48:10.148417] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:10.416050] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-24T17:48:10.462214] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:48:10.463957] [INFO ] [REMOTE ] BWMX: Full fetch complete (10056 records). [2025-09-24T17:48:10.464027] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-24T17:48:10.820930] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-24T17:48:10.821010] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-24T17:48:10.821285] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-24T17:48:10.821324] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-24T17:48:10.821793] [DEBUG] [LOCAL ] BWMX: Trimmed 10056 records to 7626 (keeping 200 days of data) [2025-09-24T17:48:10.860352] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T17:48:10.873529] [DEBUG] [LOCAL ] BWMX: Primary data saved (7626 records). [2025-09-24T17:48:10.873612] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-24T17:48:10.873714] [INFO ] [MAIN ] Update Progress: 367/2373 symbols completed. BWMX took 30.5s. Estimated remaining: 4h 23m 1s. Rate: 7.6 symbols/min [2025-09-24T17:48:11.046936] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:11.108894] [DEBUG] [LOCAL ] BX: Loaded 53497 existing records from primary storage. [2025-09-24T17:48:11.109067] [INFO ] [MAIN ] BX: Loaded 53497 existing records. [2025-09-24T17:48:11.219771] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-24T17:48:11.302305] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:11.302555] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-24T17:48:11.302604] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-24T17:48:11.305712] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-24T17:48:11.305790] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-24T17:48:11.665101] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:12.016053] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-24T17:48:12.691633] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T17:48:12.816057] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-24T17:48:13.089081] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T17:48:13.616136] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-24T17:48:14.416130] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-24T17:48:15.216060] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-24T17:48:15.275351] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-24T17:48:16.016053] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-24T17:48:16.127866] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-24T17:48:16.291088] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T17:48:16.715577] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T17:48:16.816093] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-24T17:48:17.269776] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T17:48:17.616096] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-24T17:48:17.981555] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T17:48:18.416143] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-24T17:48:18.452098] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:48:19.216137] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-24T17:48:19.260024] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T17:48:19.264711] [INFO ] [REMOTE ] BWG: Full fetch complete (17754 records). [2025-09-24T17:48:19.264830] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-24T17:48:19.645152] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-24T17:48:19.645242] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-24T17:48:19.645586] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-24T17:48:19.645626] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-24T17:48:19.646788] [DEBUG] [LOCAL ] BWG: Trimmed 17754 records to 12359 (keeping 200 days of data) [2025-09-24T17:48:19.721692] [DEBUG] [LOCAL ] BWG: Primary data saved (12359 records). [2025-09-24T17:48:19.721845] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-24T17:48:19.721949] [INFO ] [MAIN ] Update Progress: 368/2373 symbols completed. BWG took 43.7s. Estimated remaining: 4h 22m 59s. Rate: 7.6 symbols/min [2025-09-24T17:48:19.894966] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:19.913675] [DEBUG] [LOCAL ] BXC: Loaded 13767 existing records from primary storage. [2025-09-24T17:48:19.913838] [INFO ] [MAIN ] BXC: Loaded 13767 existing records. [2025-09-24T17:48:20.020158] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-24T17:48:20.103089] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:20.103320] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-24T17:48:20.103369] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-24T17:48:20.103964] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-24T17:48:20.104027] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-24T17:48:20.468472] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T17:48:20.472456] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:20.816137] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-24T17:48:21.100407] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T17:48:21.616089] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-24T17:48:22.416084] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-24T17:48:22.559718] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-24T17:48:22.786239] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T17:48:23.118388] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T17:48:23.216139] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-24T17:48:24.016109] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-24T17:48:24.670021] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T17:48:24.672418] [INFO ] [REMOTE ] BWSN: Full fetch complete (6122 records). [2025-09-24T17:48:24.672605] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-24T17:48:24.673222] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:48:24.673313] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:48:24.673357] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:48:24.673399] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-24T17:48:24.673490] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-24T17:48:24.673541] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-09-24T17:48:24.673963] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-09-24T17:48:24.674083] [INFO ] [MAIN ] Update Progress: 369/2373 symbols completed. BWSN took 22.5s. Estimated remaining: 4h 22m 35s. Rate: 7.6 symbols/min [2025-09-24T17:48:24.824609] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-24T17:48:24.853189] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:24.907180] [DEBUG] [LOCAL ] BXMT: Loaded 47250 existing records from primary storage. [2025-09-24T17:48:24.907364] [INFO ] [MAIN ] BXMT: Loaded 47250 existing records. [2025-09-24T17:48:25.091811] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:25.107353] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-24T17:48:25.107464] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-24T17:48:25.114120] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-24T17:48:25.130879] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-24T17:48:25.198820] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T17:48:25.506639] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:25.616077] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-24T17:48:26.416047] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-24T17:48:26.627139] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T17:48:27.216093] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-24T17:48:27.424674] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T17:48:28.016081] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-24T17:48:28.650798] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:48:28.816060] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-24T17:48:28.897379] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T17:48:29.577212] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T17:48:29.616025] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-24T17:48:29.738129] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T17:48:30.416093] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-24T17:48:31.216075] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-24T17:48:31.246900] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T17:48:31.415019] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T17:48:32.016103] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-24T17:48:32.816163] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-24T17:48:33.238327] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T17:48:33.616164] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-24T17:48:33.905275] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T17:48:34.416098] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-24T17:48:34.549527] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T17:48:34.806833] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T17:48:35.216137] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-24T17:48:36.016111] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-24T17:48:36.440217] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T17:48:36.811362] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T17:48:36.821279] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-24T17:48:37.616094] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-24T17:48:38.073969] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-24T17:48:38.416070] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-24T17:48:38.681508] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T17:48:39.216107] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-24T17:48:39.355882] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T17:48:39.901867] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T17:48:40.016104] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-24T17:48:40.816146] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-24T17:48:41.501751] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T17:48:41.509931] [INFO ] [REMOTE ] BWXT: Full fetch complete (67285 records). [2025-09-24T17:48:41.510055] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-24T17:48:41.617228] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-24T17:48:41.944097] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-24T17:48:41.944230] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-24T17:48:41.945145] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-24T17:48:41.945224] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-24T17:48:41.946675] [DEBUG] [LOCAL ] BWXT: Trimmed 67285 records to 46755 (keeping 200 days of data) [2025-09-24T17:48:42.218587] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T17:48:42.262150] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T17:48:42.329947] [DEBUG] [LOCAL ] BWXT: Primary data saved (46755 records). [2025-09-24T17:48:42.330097] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-24T17:48:42.330184] [INFO ] [MAIN ] Update Progress: 370/2373 symbols completed. BWXT took 33.0s. Estimated remaining: 4h 23m 20s. Rate: 7.6 symbols/min [2025-09-24T17:48:42.426144] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-24T17:48:42.510463] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:42.532048] [DEBUG] [LOCAL ] BXMX: Loaded 19572 existing records from primary storage. [2025-09-24T17:48:42.532186] [INFO ] [MAIN ] BXMX: Loaded 19572 existing records. [2025-09-24T17:48:42.642406] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T17:48:42.724044] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:42.724348] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-24T17:48:42.724402] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-24T17:48:42.725096] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-24T17:48:42.725156] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-24T17:48:43.097177] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:43.216098] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-24T17:48:44.016104] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-24T17:48:44.106745] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T17:48:44.135758] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T17:48:44.816069] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-24T17:48:44.963471] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T17:48:45.616125] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-24T17:48:46.016406] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:48:46.416086] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-24T17:48:47.216124] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-24T17:48:47.287187] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:48:47.734185] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T17:48:48.016117] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-24T17:48:48.021385] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T17:48:48.816120] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-24T17:48:49.616135] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-24T17:48:49.884995] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T17:48:49.991528] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T17:48:50.001854] [INFO ] [REMOTE ] BX: Full fetch complete (77011 records). [2025-09-24T17:48:50.002145] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-24T17:48:50.003395] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:48:50.003496] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:48:50.003583] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:48:50.003690] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-24T17:48:50.003776] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-09-24T17:48:50.003816] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-09-24T17:48:50.004233] [DEBUG] [LOCAL ] BX: Deleted derivative data file. [2025-09-24T17:48:50.005395] [INFO ] [MAIN ] Update Progress: 371/2373 symbols completed. BX took 39.1s. Estimated remaining: 4h 23m 11s. Rate: 7.6 symbols/min [2025-09-24T17:48:50.183432] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:50.239446] [DEBUG] [LOCAL ] BXP: Loaded 49802 existing records from primary storage. [2025-09-24T17:48:50.239597] [INFO ] [MAIN ] BXP: Loaded 49802 existing records. [2025-09-24T17:48:50.416072] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-24T17:48:50.419911] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:50.420869] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-24T17:48:50.420924] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-24T17:48:50.422277] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-24T17:48:50.422339] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-24T17:48:50.712000] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T17:48:50.730611] [INFO ] [REMOTE ] BXC: Full fetch complete (17681 records). [2025-09-24T17:48:50.740981] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-24T17:48:50.777337] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:48:50.799823] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:48:50.799749] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:50.799930] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:48:50.800280] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-24T17:48:50.800382] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-24T17:48:50.800442] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-09-24T17:48:50.800816] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-09-24T17:48:50.800916] [INFO ] [MAIN ] Update Progress: 372/2373 symbols completed. BXC took 31.1s. Estimated remaining: 4h 22m 25s. Rate: 7.6 symbols/min [2025-09-24T17:48:50.998483] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:51.052338] [DEBUG] [LOCAL ] BXSL: Loaded 47457 existing records from primary storage. [2025-09-24T17:48:51.052498] [INFO ] [MAIN ] BXSL: Loaded 47457 existing records. [2025-09-24T17:48:51.235740] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-24T17:48:51.242110] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:51.243029] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-24T17:48:51.243079] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-24T17:48:51.244275] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-24T17:48:51.244339] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-24T17:48:51.612805] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:52.016083] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-24T17:48:52.069560] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T17:48:52.816080] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-24T17:48:52.983728] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T17:48:53.616053] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-24T17:48:53.719749] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T17:48:54.416112] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-24T17:48:54.472357] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T17:48:54.481361] [INFO ] [REMOTE ] BXMT: Full fetch complete (69439 records). [2025-09-24T17:48:54.481538] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-24T17:48:54.847925] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T17:48:54.900284] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-24T17:48:54.900386] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-24T17:48:54.901189] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-24T17:48:54.901301] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-24T17:48:54.905074] [DEBUG] [LOCAL ] BXMT: Trimmed 69439 records to 47261 (keeping 200 days of data) [2025-09-24T17:48:55.188337] [DEBUG] [LOCAL ] BXMT: Primary data saved (47261 records). [2025-09-24T17:48:55.188479] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-24T17:48:55.188564] [INFO ] [MAIN ] Update Progress: 373/2373 symbols completed. BXMT took 30.5s. Estimated remaining: 4h 21m 59s. Rate: 7.6 symbols/min [2025-09-24T17:48:55.221223] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-24T17:48:55.360310] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:48:55.381125] [DEBUG] [LOCAL ] BY: Loaded 21542 existing records from primary storage. [2025-09-24T17:48:55.381248] [INFO ] [MAIN ] BY: Loaded 21542 existing records. [2025-09-24T17:48:55.558951] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:48:55.559335] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-24T17:48:55.559393] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-24T17:48:55.560161] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-24T17:48:55.560223] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-24T17:48:55.922434] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:48:55.950769] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:48:56.016081] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-24T17:48:56.816101] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-24T17:48:57.103450] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T17:48:57.616065] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-24T17:48:57.775336] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T17:48:58.267678] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T17:48:58.416055] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-24T17:48:58.722763] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T17:48:59.216078] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-24T17:48:59.301376] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T17:49:00.016133] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-24T17:49:00.821237] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-24T17:49:00.844753] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T17:49:01.178140] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T17:49:01.616105] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-24T17:49:01.926251] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T17:49:02.416109] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-24T17:49:03.136748] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:49:03.174408] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T17:49:03.216078] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-24T17:49:04.016168] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-24T17:49:04.816111] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-24T17:49:05.104757] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T17:49:05.227977] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T17:49:05.616104] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-24T17:49:05.729181] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:49:06.416118] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-24T17:49:07.216051] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-24T17:49:07.309089] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T17:49:07.499860] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T17:49:08.016085] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-24T17:49:08.733759] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T17:49:08.816056] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-24T17:49:08.986144] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T17:49:09.616066] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-24T17:49:09.838035] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T17:49:10.416114] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-24T17:49:11.020186] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T17:49:11.216091] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-24T17:49:11.912490] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T17:49:12.016129] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-24T17:49:12.309908] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T17:49:12.816123] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-24T17:49:13.581595] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:49:13.616114] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-24T17:49:14.056345] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T17:49:14.416091] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-24T17:49:14.917095] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T17:49:15.216132] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-24T17:49:16.016159] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-24T17:49:16.311514] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T17:49:16.738462] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T17:49:16.816051] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-24T17:49:17.185347] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T17:49:17.616094] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-24T17:49:18.416092] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-24T17:49:18.807745] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T17:49:18.949576] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-24T17:49:18.958460] [INFO ] [REMOTE ] BXSL: Full fetch complete (68855 records). [2025-09-24T17:49:18.958626] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-24T17:49:18.959477] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:49:18.959563] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:49:18.959633] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:49:18.959734] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-24T17:49:18.959804] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-09-24T17:49:18.959843] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-09-24T17:49:18.960201] [DEBUG] [LOCAL ] BXSL: Deleted derivative data file. [2025-09-24T17:49:18.960301] [INFO ] [MAIN ] Update Progress: 374/2373 symbols completed. BXSL took 28.2s. Estimated remaining: 4h 23m 16s. Rate: 7.6 symbols/min [2025-09-24T17:49:19.136707] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:19.181682] [DEBUG] [LOCAL ] BYD: Loaded 45300 existing records from primary storage. [2025-09-24T17:49:19.181860] [INFO ] [MAIN ] BYD: Loaded 45300 existing records. [2025-09-24T17:49:19.225028] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-24T17:49:19.364298] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:19.364553] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-24T17:49:19.364603] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-24T17:49:19.365940] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-24T17:49:19.366003] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-24T17:49:19.736692] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:19.896926] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T17:49:20.016098] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-24T17:49:20.312572] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T17:49:20.316903] [INFO ] [REMOTE ] BY: Full fetch complete (29142 records). [2025-09-24T17:49:20.316998] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-24T17:49:20.689335] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-24T17:49:20.689485] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-24T17:49:20.690056] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-24T17:49:20.690120] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-24T17:49:20.690972] [DEBUG] [LOCAL ] BY: Trimmed 29142 records to 21597 (keeping 200 days of data) [2025-09-24T17:49:20.820036] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-24T17:49:20.823573] [DEBUG] [LOCAL ] BY: Primary data saved (21597 records). [2025-09-24T17:49:20.823706] [INFO ] [MAIN ] BY: Full history saved. [2025-09-24T17:49:20.823805] [INFO ] [MAIN ] Update Progress: 375/2373 symbols completed. BY took 25.6s. Estimated remaining: 4h 22m 36s. Rate: 7.6 symbols/min [2025-09-24T17:49:20.997150] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:21.010731] [DEBUG] [LOCAL ] BYM: Loaded 12057 existing records from primary storage. [2025-09-24T17:49:21.010882] [INFO ] [MAIN ] BYM: Loaded 12057 existing records. [2025-09-24T17:49:21.192827] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:21.193212] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-24T17:49:21.193268] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-24T17:49:21.194259] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-24T17:49:21.194320] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-24T17:49:21.559342] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:21.628602] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-24T17:49:21.638720] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T17:49:22.026699] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T17:49:22.030277] [INFO ] [REMOTE ] BXMX: Full fetch complete (28733 records). [2025-09-24T17:49:22.030356] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-24T17:49:22.398543] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-24T17:49:22.398632] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-24T17:49:22.399100] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-24T17:49:22.399147] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-24T17:49:22.399886] [DEBUG] [LOCAL ] BXMX: Trimmed 28733 records to 19561 (keeping 200 days of data) [2025-09-24T17:49:22.451308] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-24T17:49:22.521616] [DEBUG] [LOCAL ] BXMX: Primary data saved (19561 records). [2025-09-24T17:49:22.521801] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-24T17:49:22.521895] [INFO ] [MAIN ] Update Progress: 376/2373 symbols completed. BXMX took 40.2s. Estimated remaining: 4h 21m 55s. Rate: 7.6 symbols/min [2025-09-24T17:49:22.697980] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:22.707774] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T17:49:22.742416] [DEBUG] [LOCAL ] BZH: Loaded 32727 existing records from primary storage. [2025-09-24T17:49:22.742566] [INFO ] [MAIN ] BZH: Loaded 32727 existing records. [2025-09-24T17:49:22.921396] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:22.921760] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-24T17:49:22.921817] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-24T17:49:22.922737] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-24T17:49:22.922798] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-24T17:49:23.221284] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-24T17:49:23.288080] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:23.867277] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T17:49:24.016095] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-24T17:49:24.787687] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T17:49:24.796744] [INFO ] [REMOTE ] BXP: Full fetch complete (71230 records). [2025-09-24T17:49:24.796878] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-24T17:49:24.828145] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-24T17:49:24.932101] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T17:49:25.201512] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-24T17:49:25.201596] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-24T17:49:25.202355] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-24T17:49:25.202419] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-24T17:49:25.203897] [DEBUG] [LOCAL ] BXP: Trimmed 71230 records to 49802 (keeping 200 days of data) [2025-09-24T17:49:25.505864] [DEBUG] [LOCAL ] BXP: Primary data saved (49802 records). [2025-09-24T17:49:25.506008] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-24T17:49:25.507858] [INFO ] [MAIN ] Update Progress: 377/2373 symbols completed. BXP took 35.5s. Estimated remaining: 4h 21m 21s. Rate: 7.6 symbols/min [2025-09-24T17:49:25.621237] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-24T17:49:25.679350] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:25.733973] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-24T17:49:25.734188] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-24T17:49:25.912892] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:25.913120] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-24T17:49:25.913173] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-24T17:49:25.914476] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-24T17:49:25.914537] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-24T17:49:26.287248] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:26.288708] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T17:49:26.416088] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-24T17:49:27.127123] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T17:49:27.216075] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-24T17:49:28.016088] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-24T17:49:28.222702] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T17:49:28.461364] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T17:49:28.773310] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T17:49:28.816102] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-24T17:49:29.616110] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-24T17:49:30.416165] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-24T17:49:30.668452] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T17:49:30.911286] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T17:49:31.216100] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-24T17:49:32.016097] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-24T17:49:32.166321] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T17:49:32.816100] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-24T17:49:33.049986] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T17:49:33.458003] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T17:49:33.616156] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-24T17:49:34.416092] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-24T17:49:34.601242] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T17:49:35.216076] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-24T17:49:35.510181] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T17:49:35.668857] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T17:49:36.016083] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-24T17:49:36.818028] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-24T17:49:36.844773] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T17:49:37.047789] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T17:49:37.616101] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-24T17:49:38.400281] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T17:49:38.416048] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-24T17:49:39.129240] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T17:49:39.216093] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-24T17:49:39.970092] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T17:49:40.016078] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-24T17:49:40.709545] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T17:49:40.816079] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-24T17:49:41.380749] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T17:49:41.616147] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-24T17:49:42.421167] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-24T17:49:42.446270] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T17:49:42.557357] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T17:49:43.216139] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-24T17:49:43.378251] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T17:49:44.016089] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-24T17:49:44.533638] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T17:49:44.816169] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-24T17:49:45.616124] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-24T17:49:46.242502] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-24T17:49:46.416101] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-24T17:49:46.549496] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T17:49:46.557108] [INFO ] [REMOTE ] BYD: Full fetch complete (64651 records). [2025-09-24T17:49:46.557289] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-24T17:49:46.558483] [FATAL] [VALIDATOR ] BYD: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:49:46.558601] [FATAL] [MAIN ] BYD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:49:46.558707] [WARN ] [MAIN ] BYD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:49:46.558803] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-24T17:49:46.558990] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-09-24T17:49:46.559061] [INFO ] [LOCAL ] BYD: Starting deletion of derivative data. [2025-09-24T17:49:46.559624] [DEBUG] [LOCAL ] BYD: Deleted derivative data file. [2025-09-24T17:49:46.559838] [INFO ] [MAIN ] Update Progress: 378/2373 symbols completed. BYD took 27.6s. Estimated remaining: 4h 22m 23s. Rate: 7.6 symbols/min [2025-09-24T17:49:46.743582] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:46.765823] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T17:49:46.789528] [DEBUG] [LOCAL ] CAAP: Loaded 19410 existing records from primary storage. [2025-09-24T17:49:46.789707] [INFO ] [MAIN ] CAAP: Loaded 19410 existing records. [2025-09-24T17:49:46.972513] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:46.972812] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-24T17:49:46.972861] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-24T17:49:46.973635] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-24T17:49:46.973746] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-24T17:49:47.218583] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-24T17:49:47.341682] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:47.348979] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T17:49:48.016133] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-24T17:49:48.674614] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T17:49:48.680661] [INFO ] [REMOTE ] BZH: Full fetch complete (47001 records). [2025-09-24T17:49:48.680789] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-24T17:49:48.829481] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-24T17:49:48.989852] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T17:49:49.085839] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-24T17:49:49.085927] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-24T17:49:49.086529] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-24T17:49:49.086593] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-24T17:49:49.087758] [DEBUG] [LOCAL ] BZH: Trimmed 47001 records to 32665 (keeping 200 days of data) [2025-09-24T17:49:49.284260] [DEBUG] [LOCAL ] BZH: Primary data saved (32665 records). [2025-09-24T17:49:49.284530] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-24T17:49:49.284853] [INFO ] [MAIN ] Update Progress: 379/2373 symbols completed. BZH took 26.8s. Estimated remaining: 4h 21m 48s. Rate: 7.6 symbols/min [2025-09-24T17:49:49.460796] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:49.480100] [DEBUG] [LOCAL ] CABO: Loaded 17449 existing records from primary storage. [2025-09-24T17:49:49.480231] [INFO ] [MAIN ] CABO: Loaded 17449 existing records. [2025-09-24T17:49:49.621426] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-24T17:49:49.668907] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:49.669216] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-24T17:49:49.669264] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-24T17:49:49.670032] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-24T17:49:49.670102] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-24T17:49:50.069870] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:50.354874] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T17:49:50.416049] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-24T17:49:50.971773] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-24T17:49:51.186423] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T17:49:51.189364] [INFO ] [REMOTE ] BYM: Full fetch complete (17973 records). [2025-09-24T17:49:51.189459] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-24T17:49:51.221256] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-24T17:49:51.576739] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-24T17:49:51.576847] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-24T17:49:51.577304] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-24T17:49:51.577379] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-24T17:49:51.578205] [DEBUG] [LOCAL ] BYM: Trimmed 17973 records to 12061 (keeping 200 days of data) [2025-09-24T17:49:51.662307] [DEBUG] [LOCAL ] BYM: Primary data saved (12061 records). [2025-09-24T17:49:51.662463] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-24T17:49:51.662599] [INFO ] [MAIN ] Update Progress: 380/2373 symbols completed. BYM took 30.8s. Estimated remaining: 4h 21m 11s. Rate: 7.6 symbols/min [2025-09-24T17:49:51.854178] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:49:51.893740] [DEBUG] [LOCAL ] CACI: Loaded 25266 existing records from primary storage. [2025-09-24T17:49:51.893949] [INFO ] [MAIN ] CACI: Loaded 25266 existing records. [2025-09-24T17:49:52.021251] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-24T17:49:52.086509] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:49:52.086887] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-24T17:49:52.086950] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-24T17:49:52.088202] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-24T17:49:52.088285] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-24T17:49:52.523728] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T17:49:52.573941] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:49:52.816121] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-24T17:49:53.616090] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-24T17:49:53.805810] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T17:49:53.885181] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T17:49:54.272345] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T17:49:54.416125] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-24T17:49:55.216123] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-24T17:49:55.327547] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T17:49:56.005998] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T17:49:56.016024] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-24T17:49:56.816150] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-24T17:49:57.086253] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T17:49:57.616085] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-24T17:49:58.049239] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T17:49:58.416094] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-24T17:49:58.682364] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T17:49:59.216089] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-24T17:50:00.016109] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-24T17:50:00.213009] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T17:50:00.646895] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-24T17:50:00.816104] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-24T17:50:01.074214] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T17:50:01.616144] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-24T17:50:02.088345] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:50:02.416140] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-24T17:50:02.857217] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T17:50:03.216049] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-24T17:50:03.531977] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T17:50:04.016100] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-24T17:50:04.136328] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T17:50:04.816119] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-24T17:50:05.385415] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T17:50:05.616066] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-24T17:50:05.734314] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T17:50:06.416082] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-24T17:50:07.216090] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-24T17:50:07.269685] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T17:50:07.612083] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T17:50:08.016120] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-24T17:50:08.759688] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T17:50:08.816084] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-24T17:50:09.261591] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T17:50:09.616097] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-24T17:50:10.113221] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T17:50:10.118860] [INFO ] [REMOTE ] CAAP: Full fetch complete (27696 records). [2025-09-24T17:50:10.118977] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-24T17:50:10.426392] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-24T17:50:10.531784] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-24T17:50:10.531870] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-24T17:50:10.532373] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-24T17:50:10.532438] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-24T17:50:10.534423] [DEBUG] [LOCAL ] CAAP: Trimmed 27696 records to 19503 (keeping 200 days of data) [2025-09-24T17:50:10.674230] [DEBUG] [LOCAL ] CAAP: Primary data saved (19503 records). [2025-09-24T17:50:10.674400] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-24T17:50:10.674520] [INFO ] [MAIN ] Update Progress: 381/2373 symbols completed. CAAP took 24.1s. Estimated remaining: 4h 22m 2s. Rate: 7.6 symbols/min [2025-09-24T17:50:10.875779] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:10.927715] [DEBUG] [LOCAL ] CADE: Loaded 48801 existing records from primary storage. [2025-09-24T17:50:10.927877] [INFO ] [MAIN ] CADE: Loaded 48801 existing records. [2025-09-24T17:50:11.138631] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:11.139001] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-24T17:50:11.139087] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-24T17:50:11.142324] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-24T17:50:11.142420] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-24T17:50:11.223254] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-24T17:50:11.554886] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:11.718347] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T17:50:11.772864] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T17:50:11.782705] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-24T17:50:11.782878] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-24T17:50:12.018996] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-24T17:50:12.208339] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-24T17:50:12.208627] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-24T17:50:12.209989] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-24T17:50:12.210181] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-24T17:50:12.212510] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53741 (keeping 200 days of data) [2025-09-24T17:50:12.332844] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T17:50:12.590702] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-24T17:50:12.590874] [INFO ] [MAIN ] C: Full history saved. [2025-09-24T17:50:12.591427] [INFO ] [MAIN ] Update Progress: 382/2373 symbols completed. C took 47.1s. Estimated remaining: 4h 21m 23s. Rate: 7.6 symbols/min [2025-09-24T17:50:12.772240] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:12.817074] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-24T17:50:12.819495] [DEBUG] [LOCAL ] CAE: Loaded 38961 existing records from primary storage. [2025-09-24T17:50:12.819690] [INFO ] [MAIN ] CAE: Loaded 38961 existing records. [2025-09-24T17:50:13.002892] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:13.003229] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-24T17:50:13.003286] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-24T17:50:13.004485] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-24T17:50:13.004549] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-24T17:50:13.359626] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:13.616092] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-24T17:50:13.873979] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T17:50:14.416105] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-24T17:50:14.942025] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T17:50:15.054882] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T17:50:15.216080] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-24T17:50:15.413268] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-24T17:50:16.016114] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-24T17:50:16.615676] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T17:50:16.816047] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-24T17:50:17.053044] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T17:50:17.055849] [INFO ] [REMOTE ] CABO: Full fetch complete (22919 records). [2025-09-24T17:50:17.055954] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-24T17:50:17.056722] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:50:17.056799] [FATAL] [MAIN ] CABO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:50:17.056836] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:50:17.056873] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-24T17:50:17.056929] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-24T17:50:17.056966] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-09-24T17:50:17.057361] [DEBUG] [LOCAL ] CABO: Deleted derivative data file. [2025-09-24T17:50:17.057473] [INFO ] [MAIN ] Update Progress: 383/2373 symbols completed. CABO took 27.8s. Estimated remaining: 4h 20m 57s. Rate: 7.6 symbols/min [2025-09-24T17:50:17.230891] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:17.239169] [DEBUG] [LOCAL ] CAF: Loaded 3440 existing records from primary storage. [2025-09-24T17:50:17.239265] [INFO ] [MAIN ] CAF: Loaded 3440 existing records. [2025-09-24T17:50:17.422504] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:17.422795] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-24T17:50:17.422845] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-24T17:50:17.423115] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-24T17:50:17.423183] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-24T17:50:17.625409] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-24T17:50:17.795582] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:17.975373] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T17:50:18.416151] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-24T17:50:19.059449] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T17:50:19.216091] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-24T17:50:19.886731] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T17:50:20.016079] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-24T17:50:20.573869] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T17:50:20.816087] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-24T17:50:21.442590] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T17:50:21.616080] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-24T17:50:22.412086] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T17:50:22.421260] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-24T17:50:22.429329] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T17:50:23.216197] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-24T17:50:23.757753] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T17:50:24.016125] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-24T17:50:24.607527] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-24T17:50:24.816126] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-24T17:50:24.941430] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T17:50:25.616135] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-24T17:50:26.416173] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-24T17:50:26.471259] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T17:50:27.216180] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-24T17:50:27.306587] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T17:50:27.493891] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T17:50:28.016120] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-24T17:50:28.618595] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:50:28.816145] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-24T17:50:29.025869] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T17:50:29.616101] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-24T17:50:30.318937] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T17:50:30.416096] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-24T17:50:30.813943] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-24T17:50:30.857082] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T17:50:31.216091] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-24T17:50:31.778424] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T17:50:32.016109] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-24T17:50:32.816081] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-24T17:50:33.616165] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-24T17:50:33.767401] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:50:33.795176] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T17:50:34.416069] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-24T17:50:35.100037] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T17:50:35.216074] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-24T17:50:35.870134] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T17:50:36.016076] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-24T17:50:36.816134] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-24T17:50:36.861312] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T17:50:36.877749] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T17:50:36.892185] [INFO ] [REMOTE ] CAE: Full fetch complete (55745 records). [2025-09-24T17:50:36.892425] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-24T17:50:36.913236] [INFO ] [REMOTE ] CACI: Full fetch complete (39110 records). [2025-09-24T17:50:36.929362] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-24T17:50:37.634031] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-24T17:50:37.905394] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-24T17:50:37.924279] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-24T17:50:37.933748] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-24T17:50:37.943673] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-24T17:50:37.957138] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-24T17:50:37.957272] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-24T17:50:37.957688] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-24T17:50:37.957832] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-24T17:50:37.958613] [DEBUG] [LOCAL ] CAE: Trimmed 55745 records to 39010 (keeping 200 days of data) [2025-09-24T17:50:37.959072] [DEBUG] [LOCAL ] CACI: Trimmed 39110 records to 25045 (keeping 200 days of data) [2025-09-24T17:50:38.312894] [DEBUG] [LOCAL ] CACI: Primary data saved (25045 records). [2025-09-24T17:50:38.313272] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-24T17:50:38.314714] [INFO ] [MAIN ] Update Progress: 384/2373 symbols completed. CACI took 46.7s. Estimated remaining: 4h 21m 58s. Rate: 7.6 symbols/min [2025-09-24T17:50:38.462204] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T17:50:38.486531] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-24T17:50:38.512316] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:38.540842] [DEBUG] [LOCAL ] CAE: Primary data saved (39010 records). [2025-09-24T17:50:38.541022] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-24T17:50:38.541873] [INFO ] [MAIN ] Update Progress: 385/2373 symbols completed. CAE took 26.0s. Estimated remaining: 4h 21m 11s. Rate: 7.6 symbols/min [2025-09-24T17:50:38.680951] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-24T17:50:38.701918] [INFO ] [MAIN ] CAG: Loaded 53659 existing records. [2025-09-24T17:50:38.753030] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:38.765246] [DEBUG] [LOCAL ] CAH: No existing data file found in primary storage. [2025-09-24T17:50:38.775243] [WARN ] [MAIN ] CAH: No existing data found, performing full refresh instead. [2025-09-24T17:50:38.786635] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-24T17:50:38.799204] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-24T17:50:38.823346] [DEBUG] [LOCAL ] CAH: No primary data file found to delete. [2025-09-24T17:50:38.848075] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-24T17:50:39.109543] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:39.119946] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-24T17:50:39.126046] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T17:50:39.126272] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-24T17:50:39.229946] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-24T17:50:39.229853] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-24T17:50:39.296075] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-24T17:50:39.303607] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-24T17:50:39.403422] [INFO ] [REMOTE ] CADE: Full fetch complete (69661 records). [2025-09-24T17:50:39.468560] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-24T17:50:39.571567] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:39.823933] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T17:50:40.031716] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-24T17:50:40.094913] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:40.225125] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-24T17:50:40.225216] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-24T17:50:40.226014] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-24T17:50:40.226079] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-24T17:50:40.228668] [DEBUG] [LOCAL ] CADE: Trimmed 69661 records to 48819 (keeping 200 days of data) [2025-09-24T17:50:40.533150] [DEBUG] [LOCAL ] CADE: Primary data saved (48819 records). [2025-09-24T17:50:40.533306] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-24T17:50:40.533397] [INFO ] [MAIN ] Update Progress: 386/2373 symbols completed. CADE took 29.9s. Estimated remaining: 4h 20m 33s. Rate: 7.6 symbols/min [2025-09-24T17:50:40.646209] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T17:50:40.723057] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:40.768172] [DEBUG] [LOCAL ] CAL: Loaded 43299 existing records from primary storage. [2025-09-24T17:50:40.768336] [INFO ] [MAIN ] CAL: Loaded 43299 existing records. [2025-09-24T17:50:40.821554] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-24T17:50:40.954419] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:40.954742] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-24T17:50:40.954801] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-24T17:50:40.956089] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-24T17:50:40.956156] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-24T17:50:41.328482] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:41.616136] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-24T17:50:42.416045] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-24T17:50:42.545531] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T17:50:43.216051] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-24T17:50:43.725128] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-24T17:50:43.830591] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T17:50:44.016123] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-24T17:50:44.728515] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T17:50:44.816124] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-24T17:50:45.268153] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T17:50:45.363915] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T17:50:45.616095] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-24T17:50:46.315575] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T17:50:46.317003] [INFO ] [REMOTE ] CAF: Full fetch complete (5780 records). [2025-09-24T17:50:46.317073] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-24T17:50:46.418502] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-24T17:50:46.688051] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-24T17:50:46.688160] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-24T17:50:46.688395] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-24T17:50:46.688441] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-24T17:50:46.689317] [DEBUG] [LOCAL ] CAF: Trimmed 5780 records to 3440 (keeping 200 days of data) [2025-09-24T17:50:46.712278] [DEBUG] [LOCAL ] CAF: Primary data saved (3440 records). [2025-09-24T17:50:46.712433] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-24T17:50:46.712548] [INFO ] [MAIN ] Update Progress: 387/2373 symbols completed. CAF took 29.7s. Estimated remaining: 4h 20m 16s. Rate: 7.6 symbols/min [2025-09-24T17:50:46.895298] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:50:46.945961] [DEBUG] [LOCAL ] CALX: Loaded 38586 existing records from primary storage. [2025-09-24T17:50:46.946149] [INFO ] [MAIN ] CALX: Loaded 38586 existing records. [2025-09-24T17:50:47.137633] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:50:47.137998] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-24T17:50:47.138063] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-24T17:50:47.139032] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-24T17:50:47.139096] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-24T17:50:47.221319] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-24T17:50:47.534092] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:50:48.016126] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-24T17:50:48.204889] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T17:50:48.673898] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T17:50:48.816137] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-24T17:50:49.616116] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-24T17:50:49.663303] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T17:50:50.416130] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-24T17:50:50.590254] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T17:50:50.658401] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T17:50:51.216077] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-24T17:50:51.938105] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T17:50:52.016186] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-24T17:50:52.816197] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-24T17:50:53.125696] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T17:50:53.523930] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T17:50:53.616149] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-24T17:50:54.416134] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-24T17:50:54.625347] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T17:50:55.216102] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-24T17:50:55.283295] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T17:50:55.605398] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T17:50:56.016100] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-24T17:50:56.816061] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-24T17:50:57.152799] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T17:50:57.286592] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T17:50:57.616083] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-24T17:50:58.310606] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:50:58.416068] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-24T17:50:59.175696] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:50:59.216038] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-24T17:50:59.949096] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T17:51:00.016079] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-24T17:51:00.675480] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T17:51:00.816040] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-24T17:51:01.616104] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-24T17:51:02.343141] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-24T17:51:02.416127] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-24T17:51:03.216101] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-24T17:51:03.641168] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-24T17:51:04.016095] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-24T17:51:04.121691] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-24T17:51:04.816115] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-24T17:51:05.015398] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-24T17:51:05.143020] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T17:51:05.616118] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-24T17:51:06.054852] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T17:51:06.420722] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T17:51:06.420887] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-24T17:51:07.216094] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-24T17:51:07.529483] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T17:51:08.016094] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-24T17:51:08.502480] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-24T17:51:08.753677] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T17:51:08.816081] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-24T17:51:09.616067] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-24T17:51:09.827001] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T17:51:09.836221] [INFO ] [REMOTE ] CAH: Full fetch complete (74564 records). [2025-09-24T17:51:09.836400] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-24T17:51:10.190800] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T17:51:10.278867] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-24T17:51:10.278967] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-24T17:51:10.279883] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-24T17:51:10.279955] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-24T17:51:10.281673] [DEBUG] [LOCAL ] CAH: Trimmed 74564 records to 51442 (keeping 200 days of data) [2025-09-24T17:51:10.464497] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-24T17:51:10.617931] [DEBUG] [LOCAL ] CAH: Primary data saved (51442 records). [2025-09-24T17:51:10.618104] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-24T17:51:10.618244] [INFO ] [MAIN ] Update Progress: 388/2373 symbols completed. CAH took 32.1s. Estimated remaining: 4h 21m 30s. Rate: 7.6 symbols/min [2025-09-24T17:51:10.802011] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:10.828078] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T17:51:10.857909] [DEBUG] [LOCAL ] CANG: Loaded 26721 existing records from primary storage. [2025-09-24T17:51:10.858063] [INFO ] [MAIN ] CANG: Loaded 26721 existing records. [2025-09-24T17:51:11.036261] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:11.036565] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-24T17:51:11.036623] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-24T17:51:11.037381] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-24T17:51:11.037441] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-24T17:51:11.222581] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-24T17:51:11.400868] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:11.700993] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T17:51:12.016113] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-24T17:51:12.816118] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-24T17:51:13.093899] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T17:51:13.103732] [INFO ] [REMOTE ] CAG: Full fetch complete (77649 records). [2025-09-24T17:51:13.103884] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-24T17:51:13.512362] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-24T17:51:13.512450] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-24T17:51:13.513351] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-24T17:51:13.513418] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-24T17:51:13.515007] [DEBUG] [LOCAL ] CAG: Trimmed 77649 records to 53659 (keeping 200 days of data) [2025-09-24T17:51:13.616758] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-24T17:51:13.663538] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:51:13.889217] [DEBUG] [LOCAL ] CAG: Primary data saved (53659 records). [2025-09-24T17:51:13.889365] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-24T17:51:13.889458] [INFO ] [MAIN ] Update Progress: 389/2373 symbols completed. CAG took 35.6s. Estimated remaining: 4h 20m 59s. Rate: 7.6 symbols/min [2025-09-24T17:51:14.065335] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:14.072909] [DEBUG] [LOCAL ] CAPL: Loaded 5866 existing records from primary storage. [2025-09-24T17:51:14.073043] [INFO ] [MAIN ] CAPL: Loaded 5866 existing records. [2025-09-24T17:51:14.281137] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:14.281421] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-24T17:51:14.281476] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-24T17:51:14.281835] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-24T17:51:14.281918] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-24T17:51:14.421176] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-24T17:51:14.678498] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:14.703555] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T17:51:15.216169] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-24T17:51:16.016089] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-24T17:51:16.283402] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-24T17:51:16.291919] [INFO ] [REMOTE ] CAL: Full fetch complete (61931 records). [2025-09-24T17:51:16.292075] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-24T17:51:16.753487] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-24T17:51:16.754181] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-24T17:51:16.755041] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-24T17:51:16.756476] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-24T17:51:16.756566] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-24T17:51:16.764495] [DEBUG] [LOCAL ] CAL: Trimmed 61931 records to 43227 (keeping 200 days of data) [2025-09-24T17:51:16.818355] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-24T17:51:16.873383] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T17:51:17.052141] [DEBUG] [LOCAL ] CAL: Primary data saved (43227 records). [2025-09-24T17:51:17.052328] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-24T17:51:17.052496] [INFO ] [MAIN ] Update Progress: 390/2373 symbols completed. CAL took 36.5s. Estimated remaining: 4h 20m 27s. Rate: 7.6 symbols/min [2025-09-24T17:51:17.210445] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T17:51:17.248977] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:17.247263] [INFO ] [REMOTE ] CALX: Full fetch complete (54241 records). [2025-09-24T17:51:17.249668] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-24T17:51:17.634348] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-24T17:51:17.671432] [DEBUG] [LOCAL ] CARR: Loaded 53596 existing records from primary storage. [2025-09-24T17:51:17.703513] [INFO ] [MAIN ] CARR: Loaded 53596 existing records. [2025-09-24T17:51:17.786707] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-24T17:51:17.808690] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-24T17:51:17.816005] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-24T17:51:17.824594] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-24T17:51:17.885764] [DEBUG] [LOCAL ] CALX: Trimmed 54241 records to 38509 (keeping 200 days of data) [2025-09-24T17:51:17.912148] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:17.912383] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-24T17:51:17.912436] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-24T17:51:17.913703] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-24T17:51:17.913771] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-24T17:51:18.305169] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T17:51:18.406162] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T17:51:18.417236] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-24T17:51:18.448685] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:18.582430] [DEBUG] [LOCAL ] CALX: Primary data saved (38509 records). [2025-09-24T17:51:18.582711] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-24T17:51:18.582908] [INFO ] [MAIN ] Update Progress: 391/2373 symbols completed. CALX took 31.9s. Estimated remaining: 4h 19m 47s. Rate: 7.6 symbols/min [2025-09-24T17:51:18.783146] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:18.840759] [DEBUG] [LOCAL ] CARS: Loaded 40251 existing records from primary storage. [2025-09-24T17:51:18.841042] [INFO ] [MAIN ] CARS: Loaded 40251 existing records. [2025-09-24T17:51:19.069205] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:19.069541] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-24T17:51:19.069597] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-24T17:51:19.070796] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-24T17:51:19.070861] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-24T17:51:19.221356] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-24T17:51:19.470599] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:19.577038] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T17:51:20.016157] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-24T17:51:20.816122] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-24T17:51:21.109420] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T17:51:21.284527] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-24T17:51:21.285283] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T17:51:21.616083] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-24T17:51:22.258929] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T17:51:22.416078] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-24T17:51:23.216049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-24T17:51:23.653940] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T17:51:24.016135] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-24T17:51:24.816109] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-24T17:51:24.980472] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T17:51:25.123081] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-24T17:51:25.616088] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-24T17:51:25.781972] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T17:51:26.416091] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-24T17:51:26.722417] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T17:51:27.071257] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T17:51:27.216092] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-24T17:51:28.016088] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-24T17:51:28.707052] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T17:51:28.816102] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-24T17:51:29.616122] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-24T17:51:29.770683] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T17:51:30.241820] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-24T17:51:30.416089] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-24T17:51:30.755490] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T17:51:30.841133] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T17:51:31.216089] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-24T17:51:31.833394] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T17:51:32.016086] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-24T17:51:32.594799] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T17:51:32.596352] [INFO ] [REMOTE ] CAPL: Full fetch complete (8926 records). [2025-09-24T17:51:32.596430] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-24T17:51:32.821373] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-24T17:51:32.967940] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-24T17:51:32.968029] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-24T17:51:32.968286] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-24T17:51:32.968328] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-24T17:51:32.968807] [DEBUG] [LOCAL ] CAPL: Trimmed 8926 records to 5870 (keeping 200 days of data) [2025-09-24T17:51:33.004532] [DEBUG] [LOCAL ] CAPL: Primary data saved (5870 records). [2025-09-24T17:51:33.004706] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-24T17:51:33.004810] [INFO ] [MAIN ] Update Progress: 392/2373 symbols completed. CAPL took 19.1s. Estimated remaining: 4h 20m 12s. Rate: 7.6 symbols/min [2025-09-24T17:51:33.181074] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:33.233299] [DEBUG] [LOCAL ] CAT: Loaded 52925 existing records from primary storage. [2025-09-24T17:51:33.233483] [INFO ] [MAIN ] CAT: Loaded 52925 existing records. [2025-09-24T17:51:33.422042] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:33.422436] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-24T17:51:33.422495] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-24T17:51:33.423922] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-24T17:51:33.423987] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-24T17:51:33.621805] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-24T17:51:33.803241] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:34.416103] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-24T17:51:34.550524] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:51:35.216066] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-24T17:51:35.241056] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T17:51:36.016132] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-24T17:51:36.164866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T17:51:36.339808] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T17:51:36.816128] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-24T17:51:36.934953] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T17:51:37.616088] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-24T17:51:38.416058] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-24T17:51:38.819056] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T17:51:39.110207] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:51:39.216040] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-24T17:51:39.942756] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T17:51:40.016097] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-24T17:51:40.816132] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-24T17:51:40.978059] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:51:41.283165] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T17:51:41.289080] [INFO ] [REMOTE ] CANG: Full fetch complete (40552 records). [2025-09-24T17:51:41.289209] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-24T17:51:41.631025] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-24T17:51:41.688888] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-24T17:51:41.688974] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-24T17:51:41.689499] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-24T17:51:41.689539] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-24T17:51:41.690427] [DEBUG] [LOCAL ] CANG: Trimmed 40552 records to 26695 (keeping 200 days of data) [2025-09-24T17:51:41.840635] [DEBUG] [LOCAL ] CANG: Primary data saved (26695 records). [2025-09-24T17:51:41.840806] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-24T17:51:41.840892] [INFO ] [MAIN ] Update Progress: 393/2373 symbols completed. CANG took 31.2s. Estimated remaining: 4h 20m 9s. Rate: 7.6 symbols/min [2025-09-24T17:51:42.010351] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:42.019068] [DEBUG] [LOCAL ] CATO: Loaded 7317 existing records from primary storage. [2025-09-24T17:51:42.019159] [INFO ] [MAIN ] CATO: Loaded 7317 existing records. [2025-09-24T17:51:42.197621] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:42.197946] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-24T17:51:42.197997] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-24T17:51:42.198390] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-24T17:51:42.198451] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-24T17:51:42.418558] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-24T17:51:42.560804] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:42.697177] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T17:51:43.181339] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T17:51:43.216045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-24T17:51:43.807152] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T17:51:44.016116] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-24T17:51:44.816055] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-24T17:51:44.947083] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T17:51:45.046233] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T17:51:45.616099] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-24T17:51:46.277966] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T17:51:46.416112] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-24T17:51:47.216147] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-24T17:51:47.597737] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T17:51:47.657984] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-24T17:51:48.016092] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-24T17:51:48.816064] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-24T17:51:48.922899] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T17:51:49.616084] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-24T17:51:49.948140] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T17:51:50.318977] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T17:51:50.328750] [INFO ] [REMOTE ] CARS: Full fetch complete (55358 records). [2025-09-24T17:51:50.328987] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-24T17:51:50.421185] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-24T17:51:50.745575] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-24T17:51:50.745695] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-24T17:51:50.746362] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-24T17:51:50.746408] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-24T17:51:50.747754] [DEBUG] [LOCAL ] CARS: Trimmed 55358 records to 40146 (keeping 200 days of data) [2025-09-24T17:51:50.986130] [DEBUG] [LOCAL ] CARS: Primary data saved (40146 records). [2025-09-24T17:51:50.986282] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-24T17:51:50.986371] [INFO ] [MAIN ] Update Progress: 394/2373 symbols completed. CARS took 32.4s. Estimated remaining: 4h 20m 8s. Rate: 7.6 symbols/min [2025-09-24T17:51:51.158285] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:51.218701] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-24T17:51:51.239729] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T17:51:51.270862] [DEBUG] [LOCAL ] CAVA: Loaded 53550 existing records from primary storage. [2025-09-24T17:51:51.271070] [INFO ] [MAIN ] CAVA: Loaded 53550 existing records. [2025-09-24T17:51:51.451117] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:51.451427] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-24T17:51:51.451501] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-24T17:51:51.452899] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-24T17:51:51.452973] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-24T17:51:51.810174] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:51.972856] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T17:51:52.016098] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-24T17:51:52.547512] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-24T17:51:52.816114] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-24T17:51:53.535450] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T17:51:53.616117] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-24T17:51:54.295466] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T17:51:54.298534] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T17:51:54.416107] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-24T17:51:55.216105] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-24T17:51:55.400223] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T17:51:56.016101] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-24T17:51:56.816105] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-24T17:51:57.138070] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T17:51:57.435315] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T17:51:57.616063] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-24T17:51:57.826019] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T17:51:57.835626] [INFO ] [REMOTE ] CARR: Full fetch complete (77600 records). [2025-09-24T17:51:57.835838] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-24T17:51:58.255066] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-24T17:51:58.255207] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-24T17:51:58.256089] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-24T17:51:58.256166] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-24T17:51:58.257757] [DEBUG] [LOCAL ] CARR: Trimmed 77600 records to 53594 (keeping 200 days of data) [2025-09-24T17:51:58.441768] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-24T17:51:58.594973] [DEBUG] [LOCAL ] CARR: Primary data saved (53594 records). [2025-09-24T17:51:58.595142] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-24T17:51:58.595252] [INFO ] [MAIN ] Update Progress: 395/2373 symbols completed. CARR took 41.5s. Estimated remaining: 4h 19m 58s. Rate: 7.6 symbols/min [2025-09-24T17:51:58.775807] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:51:58.831482] [DEBUG] [LOCAL ] CB: Loaded 50089 existing records from primary storage. [2025-09-24T17:51:58.831689] [INFO ] [MAIN ] CB: Loaded 50089 existing records. [2025-09-24T17:51:58.951211] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T17:51:59.021278] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:51:59.021663] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-24T17:51:59.021745] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-24T17:51:59.023032] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-24T17:51:59.023101] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-24T17:51:59.221321] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-24T17:51:59.398282] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:51:59.436515] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T17:52:00.016127] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-24T17:52:00.816052] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-24T17:52:01.091619] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-24T17:52:01.492676] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T17:52:01.616105] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-24T17:52:02.416128] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-24T17:52:02.579508] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-24T17:52:03.216157] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-24T17:52:03.566437] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T17:52:03.838180] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T17:52:04.000155] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T17:52:04.016024] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-24T17:52:04.816120] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-24T17:52:05.616133] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-24T17:52:05.953695] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T17:52:06.416142] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-24T17:52:07.134242] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-24T17:52:07.151109] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-24T17:52:07.153721] [INFO ] [REMOTE ] CATO: Full fetch complete (12009 records). [2025-09-24T17:52:07.153830] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-24T17:52:07.221163] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-24T17:52:07.570500] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-24T17:52:07.570632] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-24T17:52:07.571026] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-24T17:52:07.571120] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-24T17:52:07.572501] [DEBUG] [LOCAL ] CATO: Trimmed 12009 records to 7234 (keeping 200 days of data) [2025-09-24T17:52:07.633636] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-24T17:52:07.657816] [DEBUG] [LOCAL ] CATO: Primary data saved (7234 records). [2025-09-24T17:52:07.657981] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-24T17:52:07.658179] [INFO ] [MAIN ] Update Progress: 396/2373 symbols completed. CATO took 25.8s. Estimated remaining: 4h 19m 56s. Rate: 7.6 symbols/min [2025-09-24T17:52:07.654557] [INFO ] [REMOTE ] CAT: Full fetch complete (76617 records). [2025-09-24T17:52:07.724269] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-24T17:52:07.995804] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:08.023879] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-24T17:52:08.164847] [DEBUG] [LOCAL ] CBAN: Loaded 11122 existing records from primary storage. [2025-09-24T17:52:08.175597] [INFO ] [MAIN ] CBAN: Loaded 11122 existing records. [2025-09-24T17:52:08.415770] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-24T17:52:08.508228] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-24T17:52:08.513619] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:08.515198] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-24T17:52:08.515380] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-24T17:52:08.516014] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-24T17:52:08.516120] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-24T17:52:08.516789] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-24T17:52:08.516868] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-24T17:52:08.602073] [DEBUG] [LOCAL ] CAT: Trimmed 76617 records to 52923 (keeping 200 days of data) [2025-09-24T17:52:09.147994] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:09.170296] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-24T17:52:09.261672] [DEBUG] [LOCAL ] CAT: Primary data saved (52923 records). [2025-09-24T17:52:09.261884] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-24T17:52:09.262458] [INFO ] [MAIN ] Update Progress: 397/2373 symbols completed. CAT took 36.3s. Estimated remaining: 4h 19m 17s. Rate: 7.6 symbols/min [2025-09-24T17:52:09.314057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T17:52:09.616147] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-24T17:52:10.096320] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T17:52:10.129459] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T17:52:10.416140] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-24T17:52:11.216105] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-24T17:52:11.403518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T17:52:11.957239] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T17:52:12.016045] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-24T17:52:12.146434] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T17:52:12.816175] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-24T17:52:13.621186] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-24T17:52:13.643466] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T17:52:14.416055] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-24T17:52:14.533729] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T17:52:14.951463] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-24T17:52:15.216097] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-24T17:52:16.016093] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-24T17:52:16.291786] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T17:52:16.610560] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T17:52:16.816087] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-24T17:52:17.085663] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T17:52:17.616099] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-24T17:52:17.782314] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T17:52:18.416121] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-24T17:52:19.216170] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-24T17:52:19.236223] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T17:52:19.680476] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T17:52:20.016197] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-24T17:52:20.816218] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-24T17:52:21.114778] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T17:52:21.558191] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T17:52:21.616218] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-24T17:52:22.206638] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T17:52:22.226759] [INFO ] [REMOTE ] CAVA: Full fetch complete (77282 records). [2025-09-24T17:52:22.227141] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-24T17:52:22.421234] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-24T17:52:22.688595] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-24T17:52:22.688725] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-24T17:52:22.689557] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-24T17:52:22.689628] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-24T17:52:22.691772] [DEBUG] [LOCAL ] CAVA: Trimmed 77282 records to 53550 (keeping 200 days of data) [2025-09-24T17:52:23.023907] [DEBUG] [LOCAL ] CAVA: Primary data saved (53550 records). [2025-09-24T17:52:23.024071] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-24T17:52:23.024160] [INFO ] [MAIN ] Update Progress: 398/2373 symbols completed. CAVA took 32.0s. Estimated remaining: 4h 19m 38s. Rate: 7.6 symbols/min [2025-09-24T17:52:23.564553] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T17:52:23.576641] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-24T17:52:23.584893] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-24T17:52:24.016087] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-24T17:52:24.880389] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T17:52:24.883450] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-24T17:52:25.279595] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T17:52:25.417234] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T17:52:25.419451] [INFO ] [REMOTE ] CBAN: Full fetch complete (16077 records). [2025-09-24T17:52:25.419522] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-24T17:52:25.630060] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-24T17:52:25.785894] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-24T17:52:25.786052] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-24T17:52:25.786439] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-24T17:52:25.786518] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-24T17:52:25.787115] [DEBUG] [LOCAL ] CBAN: Trimmed 16077 records to 11061 (keeping 200 days of data) [2025-09-24T17:52:25.861570] [DEBUG] [LOCAL ] CBAN: Primary data saved (11061 records). [2025-09-24T17:52:25.861790] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-24T17:52:25.861900] [INFO ] [MAIN ] Update Progress: 399/2373 symbols completed. CBAN took 18.2s. Estimated remaining: 4h 19m 6s. Rate: 7.6 symbols/min [2025-09-24T17:52:27.796083] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T17:52:27.808805] [INFO ] [REMOTE ] CB: Full fetch complete (72706 records). [2025-09-24T17:52:27.808983] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-24T17:52:28.210042] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-24T17:52:28.210140] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-24T17:52:28.211044] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-24T17:52:28.211133] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-24T17:52:28.212702] [DEBUG] [LOCAL ] CB: Trimmed 72706 records to 50082 (keeping 200 days of data) [2025-09-24T17:52:28.546202] [DEBUG] [LOCAL ] CB: Primary data saved (50082 records). [2025-09-24T17:52:28.546361] [INFO ] [MAIN ] CB: Full history saved. [2025-09-24T17:52:28.546449] [INFO ] [MAIN ] Update Progress: 400/2373 symbols completed. CB took 30.0s. Estimated remaining: 4h 18m 32s. Rate: 7.6 symbols/min [2025-09-24T17:52:29.120785] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:29.239323] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:29.257825] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:29.258951] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:29.259604] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-24T17:52:29.259684] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-24T17:52:29.260397] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-24T17:52:29.260473] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-24T17:52:29.260546] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-24T17:52:29.260595] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-24T17:52:29.317772] [DEBUG] [LOCAL ] CBNA: Loaded 2892 existing records from primary storage. [2025-09-24T17:52:29.350303] [INFO ] [MAIN ] CBNA: Loaded 2892 existing records. [2025-09-24T17:52:29.439771] [DEBUG] [LOCAL ] CBL: Loaded 16744 existing records from primary storage. [2025-09-24T17:52:29.450425] [INFO ] [MAIN ] CBL: Loaded 16744 existing records. [2025-09-24T17:52:29.724131] [DEBUG] [LOCAL ] CBRE: Loaded 50658 existing records from primary storage. [2025-09-24T17:52:29.777164] [INFO ] [MAIN ] CBRE: Loaded 50658 existing records. [2025-09-24T17:52:30.003134] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:30.037403] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-24T17:52:30.064145] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:30.086415] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-24T17:52:30.133266] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-24T17:52:30.149095] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-24T17:52:30.127926] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-24T17:52:30.175495] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-24T17:52:30.230363] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-24T17:52:30.230199] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-24T17:52:30.365753] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:30.487307] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-24T17:52:30.541466] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:30.576395] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-24T17:52:30.599349] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-24T17:52:30.716684] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-24T17:52:30.796702] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-24T17:52:30.869149] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:52:30.986412] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-24T17:52:31.065884] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-24T17:52:31.261515] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:31.325203] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:31.336314] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-24T17:52:31.355896] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-24T17:52:31.478334] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:52:31.479053] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-24T17:52:31.495442] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-24T17:52:31.581026] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:31.581361] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-24T17:52:31.789711] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:52:31.790084] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-24T17:52:31.790516] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-24T17:52:32.095147] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T17:52:32.096996] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-24T17:52:32.132826] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-24T17:52:32.551266] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T17:52:32.617163] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T17:52:32.816197] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-24T17:52:33.037403] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-24T17:52:33.232716] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T17:52:33.616094] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-24T17:52:34.416091] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-24T17:52:34.644389] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T17:52:34.834868] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-24T17:52:35.216109] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-24T17:52:36.016138] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-24T17:52:36.816122] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-24T17:52:37.021763] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T17:52:37.067404] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T17:52:37.565531] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T17:52:37.616102] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-24T17:52:37.859620] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-24T17:52:38.416115] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-24T17:52:38.717511] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-24T17:52:39.216101] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-24T17:52:40.016107] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-24T17:52:40.259504] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T17:52:40.816127] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-24T17:52:41.586334] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T17:52:41.616033] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-24T17:52:41.749448] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T17:52:42.416071] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-24T17:52:42.718414] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-24T17:52:43.216056] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-24T17:52:43.352333] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:52:43.646949] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T17:52:44.016093] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-24T17:52:44.816071] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-24T17:52:45.141179] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T17:52:45.247071] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T17:52:45.616086] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-24T17:52:46.175664] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-24T17:52:46.416066] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-24T17:52:47.216116] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-24T17:52:47.549051] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T17:52:47.907914] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T17:52:48.016072] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-24T17:52:48.816095] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-24T17:52:49.353273] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T17:52:49.616051] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-24T17:52:49.710276] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T17:52:50.232430] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T17:52:50.233466] [INFO ] [REMOTE ] CBNA: Full fetch complete (4676 records). [2025-09-24T17:52:50.233537] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-24T17:52:50.425405] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-24T17:52:50.611142] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-24T17:52:50.611237] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-24T17:52:50.611405] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-24T17:52:50.611445] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-24T17:52:50.611855] [DEBUG] [LOCAL ] CBNA: Trimmed 4676 records to 2887 (keeping 200 days of data) [2025-09-24T17:52:50.630381] [DEBUG] [LOCAL ] CBNA: Primary data saved (2887 records). [2025-09-24T17:52:50.630540] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-24T17:52:50.630633] [INFO ] [MAIN ] Update Progress: 401/2373 symbols completed. CBNA took 22.1s. Estimated remaining: 4h 19m 34s. Rate: 7.6 symbols/min [2025-09-24T17:52:50.748456] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:52:50.764460] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-24T17:52:50.810914] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:50.847035] [DEBUG] [LOCAL ] CBT: Loaded 31140 existing records from primary storage. [2025-09-24T17:52:50.847193] [INFO ] [MAIN ] CBT: Loaded 31140 existing records. [2025-09-24T17:52:51.027929] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:51.028201] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-24T17:52:51.028269] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-24T17:52:51.029323] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-24T17:52:51.029387] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-24T17:52:51.226155] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-24T17:52:51.415406] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:52.016139] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-24T17:52:52.274023] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T17:52:52.470837] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:52:52.471257] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-24T17:52:52.471369] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-24T17:52:52.471458] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-24T17:52:52.472378] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:52:52.472461] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:52:52.472514] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:52:52.472558] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-24T17:52:52.472624] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-24T17:52:52.472704] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-24T17:52:52.472781] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-24T17:52:52.472882] [INFO ] [MAIN ] Update Progress: 402/2373 symbols completed. CBO took 23.9s. Estimated remaining: 4h 18m 57s. Rate: 7.6 symbols/min [2025-09-24T17:52:52.650388] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:52:52.672823] [DEBUG] [LOCAL ] CBU: Loaded 22875 existing records from primary storage. [2025-09-24T17:52:52.672968] [INFO ] [MAIN ] CBU: Loaded 22875 existing records. [2025-09-24T17:52:52.816168] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-24T17:52:52.852775] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:52:52.853034] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-24T17:52:52.853088] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-24T17:52:52.854257] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-24T17:52:52.854319] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-24T17:52:53.203838] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:52:53.616165] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-24T17:52:54.416093] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-24T17:52:54.554041] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T17:52:54.570618] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T17:52:55.216042] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-24T17:52:55.254838] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T17:52:56.016077] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-24T17:52:56.573152] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T17:52:56.644392] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T17:52:56.816113] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-24T17:52:57.616124] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-24T17:52:57.958172] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T17:52:58.416078] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-24T17:52:59.192430] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T17:52:59.216031] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-24T17:52:59.683198] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:53:00.016079] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-24T17:53:00.816075] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-24T17:53:00.984802] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T17:53:00.993420] [INFO ] [REMOTE ] CBRE: Full fetch complete (73931 records). [2025-09-24T17:53:00.993550] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-24T17:53:01.391538] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-24T17:53:01.391678] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-24T17:53:01.392499] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-24T17:53:01.392578] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-24T17:53:01.412680] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T17:53:01.419433] [DEBUG] [LOCAL ] CBRE: Trimmed 73931 records to 50635 (keeping 200 days of data) [2025-09-24T17:53:01.625152] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-24T17:53:01.736340] [DEBUG] [LOCAL ] CBRE: Primary data saved (50635 records). [2025-09-24T17:53:01.736568] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-24T17:53:01.736709] [INFO ] [MAIN ] Update Progress: 403/2373 symbols completed. CBRE took 33.2s. Estimated remaining: 4h 18m 55s. Rate: 7.6 symbols/min [2025-09-24T17:53:01.925883] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:01.934390] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-24T17:53:01.934495] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-24T17:53:01.934912] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T17:53:01.938572] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-24T17:53:01.938837] [INFO ] [REMOTE ] CBL: Full fetch complete (25645 records). [2025-09-24T17:53:01.938953] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-24T17:53:01.939228] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-24T17:53:01.939146] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-24T17:53:01.939521] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-24T17:53:02.423069] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-24T17:53:02.684705] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:02.748292] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-24T17:53:02.748384] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-24T17:53:02.748853] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-24T17:53:02.748924] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-24T17:53:02.749710] [DEBUG] [LOCAL ] CBL: Trimmed 25645 records to 16676 (keeping 200 days of data) [2025-09-24T17:53:02.858880] [DEBUG] [LOCAL ] CBL: Primary data saved (16676 records). [2025-09-24T17:53:02.859063] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-24T17:53:02.859176] [INFO ] [MAIN ] Update Progress: 404/2373 symbols completed. CBL took 34.3s. Estimated remaining: 4h 18m 15s. Rate: 7.6 symbols/min [2025-09-24T17:53:03.031819] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:03.052163] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T17:53:03.088873] [DEBUG] [LOCAL ] CBZ: Loaded 33481 existing records from primary storage. [2025-09-24T17:53:03.089049] [INFO ] [MAIN ] CBZ: Loaded 33481 existing records. [2025-09-24T17:53:03.226551] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-24T17:53:03.268075] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:53:03.268362] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-24T17:53:03.268417] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-24T17:53:03.269286] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-24T17:53:03.269348] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-24T17:53:03.639136] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:03.734561] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T17:53:04.016113] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-24T17:53:04.650175] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T17:53:04.816093] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-24T17:53:05.333760] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T17:53:05.616095] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-24T17:53:06.122074] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T17:53:06.416058] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-24T17:53:06.792267] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T17:53:07.216058] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-24T17:53:07.432144] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:53:08.016185] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-24T17:53:08.442136] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T17:53:08.816078] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-24T17:53:08.935998] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T17:53:09.616152] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-24T17:53:09.870274] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:09.870731] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-24T17:53:10.015187] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:53:10.416124] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-24T17:53:11.216044] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-24T17:53:11.530011] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T17:53:12.016099] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-24T17:53:12.114783] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T17:53:12.220955] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:12.221443] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-24T17:53:12.816121] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-24T17:53:13.616088] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-24T17:53:14.035173] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T17:53:14.416112] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-24T17:53:14.911310] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T17:53:15.216132] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-24T17:53:15.838712] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T17:53:15.846952] [INFO ] [REMOTE ] CBT: Full fetch complete (45984 records). [2025-09-24T17:53:15.847118] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-24T17:53:16.028793] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-24T17:53:16.239749] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-24T17:53:16.239835] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-24T17:53:16.240393] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-24T17:53:16.240435] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-24T17:53:16.241465] [DEBUG] [LOCAL ] CBT: Trimmed 45984 records to 31097 (keeping 200 days of data) [2025-09-24T17:53:16.372432] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:16.406727] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-24T17:53:16.443839] [DEBUG] [LOCAL ] CBT: Primary data saved (31097 records). [2025-09-24T17:53:16.444011] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-24T17:53:16.444105] [INFO ] [MAIN ] Update Progress: 405/2373 symbols completed. CBT took 25.8s. Estimated remaining: 4h 18m 34s. Rate: 7.6 symbols/min [2025-09-24T17:53:16.623665] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:16.675529] [DEBUG] [LOCAL ] CC: Loaded 53032 existing records from primary storage. [2025-09-24T17:53:16.675709] [INFO ] [MAIN ] CC: Loaded 53032 existing records. [2025-09-24T17:53:16.837739] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-24T17:53:16.860358] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:53:16.860888] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-24T17:53:16.860964] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-24T17:53:16.868576] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-24T17:53:16.881295] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-24T17:53:16.881945] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T17:53:17.249586] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:17.616092] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-24T17:53:17.679698] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T17:53:18.416128] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-24T17:53:18.625833] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T17:53:19.216143] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-24T17:53:20.016102] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-24T17:53:20.158509] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T17:53:20.210348] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T17:53:20.816092] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-24T17:53:20.935877] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T17:53:21.016137] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:21.016505] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-24T17:53:21.616095] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-24T17:53:22.416096] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-24T17:53:22.636899] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:22.637274] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-24T17:53:22.788442] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T17:53:23.216156] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-24T17:53:24.016079] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-24T17:53:24.497466] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T17:53:24.816094] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-24T17:53:25.477027] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T17:53:25.616052] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-24T17:53:25.828811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T17:53:26.416093] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-24T17:53:27.227140] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-24T17:53:27.229690] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T17:53:27.241153] [INFO ] [REMOTE ] CBZ: Full fetch complete (44827 records). [2025-09-24T17:53:27.241275] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-24T17:53:27.636775] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-24T17:53:27.636899] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-24T17:53:27.637482] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-24T17:53:27.637528] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-24T17:53:27.638525] [DEBUG] [LOCAL ] CBZ: Trimmed 44827 records to 33505 (keeping 200 days of data) [2025-09-24T17:53:27.834197] [DEBUG] [LOCAL ] CBZ: Primary data saved (33505 records). [2025-09-24T17:53:27.834355] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-24T17:53:27.834444] [INFO ] [MAIN ] Update Progress: 406/2373 symbols completed. CBZ took 25.0s. Estimated remaining: 4h 18m 44s. Rate: 7.6 symbols/min [2025-09-24T17:53:28.011417] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:28.030673] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-24T17:53:28.070852] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T17:53:28.114559] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:53:28.135580] [DEBUG] [LOCAL ] CCI: Loaded 53153 existing records from primary storage. [2025-09-24T17:53:28.135766] [INFO ] [MAIN ] CCI: Loaded 53153 existing records. [2025-09-24T17:53:28.317903] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:53:28.318214] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-24T17:53:28.318302] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-24T17:53:28.319726] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-24T17:53:28.319789] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-24T17:53:28.677279] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:28.816034] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-24T17:53:29.176986] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T17:53:29.181588] [INFO ] [REMOTE ] CBU: Full fetch complete (32232 records). [2025-09-24T17:53:29.181733] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-24T17:53:29.613441] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-24T17:53:29.613572] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-24T17:53:29.614057] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-24T17:53:29.614119] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-24T17:53:29.615001] [DEBUG] [LOCAL ] CBU: Trimmed 32232 records to 22866 (keeping 200 days of data) [2025-09-24T17:53:29.616071] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-24T17:53:29.760889] [DEBUG] [LOCAL ] CBU: Primary data saved (22866 records). [2025-09-24T17:53:29.761034] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-24T17:53:29.761119] [INFO ] [MAIN ] Update Progress: 407/2373 symbols completed. CBU took 37.3s. Estimated remaining: 4h 18m 7s. Rate: 7.6 symbols/min [2025-09-24T17:53:29.930204] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:29.930436] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-24T17:53:29.930491] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-24T17:53:29.930661] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-24T17:53:29.930719] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-24T17:53:29.930767] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-24T17:53:29.930802] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-24T17:53:30.296528] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:30.416088] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-24T17:53:30.659019] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-24T17:53:30.873579] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-24T17:53:31.216087] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-24T17:53:31.343319] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T17:53:31.443931] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-24T17:53:32.016090] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-24T17:53:32.525371] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-24T17:53:32.816166] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-24T17:53:33.616207] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-24T17:53:34.416130] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-24T17:53:34.460474] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T17:53:34.617290] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:34.617751] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-24T17:53:35.216055] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-24T17:53:35.408972] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T17:53:35.507359] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:53:35.507918] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-24T17:53:35.508057] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-24T17:53:35.508159] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-24T17:53:35.508957] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:53:35.509062] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:53:35.509154] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:53:35.509252] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-24T17:53:35.509347] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-24T17:53:35.509407] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-24T17:53:35.509502] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-24T17:53:35.509611] [INFO ] [MAIN ] Update Progress: 408/2373 symbols completed. CBX took 33.8s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-24T17:53:35.713717] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:35.730060] [DEBUG] [LOCAL ] CCIF: Loaded 15346 existing records from primary storage. [2025-09-24T17:53:35.730219] [INFO ] [MAIN ] CCIF: Loaded 15346 existing records. [2025-09-24T17:53:35.910614] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:53:35.910892] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-24T17:53:35.910941] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-24T17:53:35.911506] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-24T17:53:35.911568] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-24T17:53:36.021184] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-24T17:53:36.271760] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:36.816096] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-24T17:53:37.244267] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T17:53:37.616148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-24T17:53:37.707287] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T17:53:38.416112] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-24T17:53:38.647836] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T17:53:39.216132] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-24T17:53:40.003305] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T17:53:40.016033] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-24T17:53:40.281484] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T17:53:40.816087] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-24T17:53:40.900017] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T17:53:41.616197] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-24T17:53:41.988062] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T17:53:42.416116] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-24T17:53:42.556009] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T17:53:42.830245] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-24T17:53:43.216142] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-24T17:53:44.016130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-24T17:53:44.120476] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T17:53:44.445870] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T17:53:44.816065] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-24T17:53:45.616058] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-24T17:53:45.774990] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T17:53:46.091505] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T17:53:46.416069] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-24T17:53:47.216104] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-24T17:53:48.016082] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-24T17:53:48.281294] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T17:53:48.608461] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T17:53:48.816064] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-24T17:53:49.026675] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T17:53:49.616106] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-24T17:53:49.945285] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-24T17:53:50.416053] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-24T17:53:50.634719] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T17:53:51.216728] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-24T17:53:51.218606] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T17:53:52.016181] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-24T17:53:52.432821] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T17:53:52.816094] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-24T17:53:53.024416] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T17:53:53.616122] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-24T17:53:54.139445] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T17:53:54.416067] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-24T17:53:54.664077] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T17:53:54.864397] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T17:53:54.865321] [INFO ] [REMOTE ] CCIA: Full fetch complete (2033 records). [2025-09-24T17:53:54.865392] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-24T17:53:55.047231] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T17:53:55.047446] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:53:55.047517] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:53:55.047587] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-24T17:53:55.047682] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-24T17:53:55.047788] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-24T17:53:55.047869] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-24T17:53:55.047953] [INFO ] [MAIN ] Update Progress: 409/2373 symbols completed. CCIA took 25.3s. Estimated remaining: 4h 18m 37s. Rate: 7.6 symbols/min [2025-09-24T17:53:55.222303] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-24T17:53:55.222181] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:53:55.285326] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-24T17:53:55.285501] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-24T17:53:55.484095] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:53:55.484364] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-24T17:53:55.484415] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-24T17:53:55.485803] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-24T17:53:55.485872] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-24T17:53:55.844218] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:53:56.016061] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-24T17:53:56.267548] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T17:53:56.816082] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-24T17:53:57.616059] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-24T17:53:57.652281] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T17:53:58.144866] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T17:53:58.416097] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-24T17:53:59.175956] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T17:53:59.216076] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-24T17:54:00.016128] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-24T17:54:00.361811] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T17:54:00.816040] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-24T17:54:00.905776] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T17:54:01.124131] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T17:54:01.616135] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-24T17:54:02.416086] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-24T17:54:03.216063] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-24T17:54:03.309711] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-24T17:54:04.016113] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-24T17:54:04.574022] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T17:54:04.579055] [INFO ] [REMOTE ] CCIF: Full fetch complete (21546 records). [2025-09-24T17:54:04.579196] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-24T17:54:04.972213] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-24T17:54:04.972311] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-24T17:54:04.972768] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-24T17:54:04.972909] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-24T17:54:04.973837] [DEBUG] [LOCAL ] CCIF: Trimmed 21546 records to 15401 (keeping 200 days of data) [2025-09-24T17:54:05.065577] [DEBUG] [LOCAL ] CCIF: Primary data saved (15401 records). [2025-09-24T17:54:05.065753] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-24T17:54:05.065847] [INFO ] [MAIN ] Update Progress: 410/2373 symbols completed. CCIF took 29.6s. Estimated remaining: 4h 18m 39s. Rate: 7.6 symbols/min [2025-09-24T17:54:05.247699] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-09-24T17:54:05.304931] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:05.306098] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-24T17:54:05.352854] [DEBUG] [LOCAL ] CCK: Loaded 46406 existing records from primary storage. [2025-09-24T17:54:05.353019] [INFO ] [MAIN ] CCK: Loaded 46406 existing records. [2025-09-24T17:54:05.539661] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:05.539915] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-24T17:54:05.539965] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-24T17:54:05.541637] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-24T17:54:05.541723] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-24T17:54:05.961301] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:05.971143] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-24T17:54:05.973970] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-24T17:54:05.984151] [INFO ] [REMOTE ] CCI: Full fetch complete (76999 records). [2025-09-24T17:54:05.984317] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-24T17:54:06.428249] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-24T17:54:06.443403] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-24T17:54:06.443810] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-24T17:54:06.445206] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-24T17:54:06.445800] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-24T17:54:06.445702] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-24T17:54:06.448125] [DEBUG] [LOCAL ] CCI: Trimmed 76999 records to 53149 (keeping 200 days of data) [2025-09-24T17:54:06.783002] [DEBUG] [LOCAL ] CCI: Primary data saved (53149 records). [2025-09-24T17:54:06.783157] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-24T17:54:06.783242] [INFO ] [MAIN ] Update Progress: 411/2373 symbols completed. CCI took 38.9s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-24T17:54:06.962618] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:07.016287] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-24T17:54:07.016497] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-24T17:54:07.200111] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:07.200456] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-24T17:54:07.200515] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-24T17:54:07.201984] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-24T17:54:07.202050] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-24T17:54:07.499948] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T17:54:07.567511] [INFO ] [REMOTE ] CC: Full fetch complete (75530 records). [2025-09-24T17:54:07.624410] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-24T17:54:07.624249] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:07.625165] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-24T17:54:07.941892] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T17:54:08.024845] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-24T17:54:08.077370] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-24T17:54:08.077478] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-24T17:54:08.078450] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-24T17:54:08.078515] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-24T17:54:08.080342] [DEBUG] [LOCAL ] CC: Trimmed 75530 records to 53032 (keeping 200 days of data) [2025-09-24T17:54:08.407233] [DEBUG] [LOCAL ] CC: Primary data saved (53032 records). [2025-09-24T17:54:08.407379] [INFO ] [MAIN ] CC: Full history saved. [2025-09-24T17:54:08.407467] [INFO ] [MAIN ] Update Progress: 412/2373 symbols completed. CC took 52.0s. Estimated remaining: 4h 17m 24s. Rate: 7.6 symbols/min [2025-09-24T17:54:08.587485] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:08.632726] [DEBUG] [LOCAL ] CCO: Loaded 47684 existing records from primary storage. [2025-09-24T17:54:08.632940] [INFO ] [MAIN ] CCO: Loaded 47684 existing records. [2025-09-24T17:54:08.838186] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:08.838612] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-24T17:54:08.838749] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-24T17:54:08.840200] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-24T17:54:08.840267] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-24T17:54:08.983235] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-24T17:54:09.056388] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-24T17:54:09.256786] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:09.616142] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-24T17:54:09.709159] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T17:54:10.002993] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-24T17:54:10.416083] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-24T17:54:10.822717] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T17:54:11.225111] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-24T17:54:11.246235] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-24T17:54:11.803453] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:54:12.016116] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-24T17:54:12.816084] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-24T17:54:13.566910] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-24T17:54:13.616068] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-24T17:54:13.747342] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:54:14.416123] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-24T17:54:15.216172] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-24T17:54:15.967066] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-09-24T17:54:16.016053] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-24T17:54:16.503919] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-24T17:54:16.816054] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-24T17:54:17.094820] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-24T17:54:17.134522] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-24T17:54:17.616156] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-24T17:54:18.352462] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-24T17:54:18.416104] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-24T17:54:19.056229] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T17:54:19.216113] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-24T17:54:19.269813] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-24T17:54:20.016045] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-24T17:54:20.223414] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T17:54:20.691687] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T17:54:20.816092] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-24T17:54:21.616093] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-24T17:54:22.372010] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T17:54:22.416033] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-24T17:54:22.634182] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-24T17:54:23.216057] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-24T17:54:23.401630] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T17:54:24.016054] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-24T17:54:24.112544] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T17:54:24.816092] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-24T17:54:25.560605] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T17:54:25.616073] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-24T17:54:25.700109] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-24T17:54:26.427012] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-24T17:54:26.467351] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T17:54:27.216127] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-24T17:54:27.957789] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-24T17:54:28.016094] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-24T17:54:28.816143] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-24T17:54:28.939437] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-24T17:54:29.616107] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-24T17:54:29.747275] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-24T17:54:29.755607] [INFO ] [REMOTE ] CCK: Full fetch complete (67751 records). [2025-09-24T17:54:29.755785] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-24T17:54:30.168975] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-24T17:54:30.169391] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-24T17:54:30.170769] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-24T17:54:30.170970] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-24T17:54:30.203123] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T17:54:30.203367] [DEBUG] [LOCAL ] CCK: Trimmed 67751 records to 46358 (keeping 200 days of data) [2025-09-24T17:54:30.334481] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-24T17:54:30.350443] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-09-24T17:54:30.352980] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-24T17:54:30.433901] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-24T17:54:30.781487] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-24T17:54:30.781889] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-24T17:54:30.783251] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-24T17:54:30.783344] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-24T17:54:30.787430] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 53675 (keeping 200 days of data) [2025-09-24T17:54:31.254841] [DEBUG] [LOCAL ] CCK: Primary data saved (46358 records). [2025-09-24T17:54:31.256089] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-24T17:54:31.256494] [INFO ] [MAIN ] Update Progress: 413/2373 symbols completed. CCK took 26.2s. Estimated remaining: 4h 18m 27s. Rate: 7.6 symbols/min [2025-09-24T17:54:31.381390] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-24T17:54:31.405343] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-24T17:54:31.413952] [INFO ] [MAIN ] Update Progress: 414/2373 symbols completed. CCJ took 36.4s. Estimated remaining: 4h 17m 43s. Rate: 7.6 symbols/min [2025-09-24T17:54:31.522379] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:31.622016] [DEBUG] [LOCAL ] CCRD: Loaded 9000 existing records from primary storage. [2025-09-24T17:54:31.648909] [INFO ] [MAIN ] CCRD: Loaded 9000 existing records. [2025-09-24T17:54:31.648776] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:31.899332] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:31.902347] [DEBUG] [LOCAL ] CCS: Loaded 30701 existing records from primary storage. [2025-09-24T17:54:31.903252] [INFO ] [MAIN ] CCS: Loaded 30701 existing records. [2025-09-24T17:54:31.903438] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-24T17:54:32.001807] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-24T17:54:32.051317] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-24T17:54:32.051515] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-24T17:54:32.222819] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T17:54:32.306742] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:32.314933] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-24T17:54:32.366690] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-24T17:54:32.392622] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-24T17:54:32.393216] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-24T17:54:32.419373] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-24T17:54:32.419893] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-24T17:54:32.420193] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-24T17:54:32.828868] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:32.861765] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-24T17:54:32.980524] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:33.616118] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-24T17:54:33.769566] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T17:54:34.146055] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T17:54:34.416067] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-24T17:54:34.875735] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-24T17:54:34.908608] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T17:54:35.216134] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-24T17:54:35.981428] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T17:54:35.990936] [INFO ] [REMOTE ] CCO: Full fetch complete (66131 records). [2025-09-24T17:54:35.991059] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-24T17:54:36.026341] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-24T17:54:36.445537] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-24T17:54:36.445798] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-24T17:54:36.446939] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-24T17:54:36.447239] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-24T17:54:36.449548] [DEBUG] [LOCAL ] CCO: Trimmed 66131 records to 47658 (keeping 200 days of data) [2025-09-24T17:54:36.587324] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T17:54:36.760619] [DEBUG] [LOCAL ] CCO: Primary data saved (47658 records). [2025-09-24T17:54:36.760840] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-24T17:54:36.760980] [INFO ] [MAIN ] Update Progress: 415/2373 symbols completed. CCO took 28.4s. Estimated remaining: 4h 17m 23s. Rate: 7.6 symbols/min [2025-09-24T17:54:36.827728] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-24T17:54:36.944303] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:36.967564] [DEBUG] [LOCAL ] CCU: Loaded 23677 existing records from primary storage. [2025-09-24T17:54:36.967738] [INFO ] [MAIN ] CCU: Loaded 23677 existing records. [2025-09-24T17:54:37.146993] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:37.147277] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-24T17:54:37.147327] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-24T17:54:37.148228] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-24T17:54:37.148292] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-24T17:54:37.511206] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:37.616125] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-24T17:54:37.997294] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T17:54:38.232384] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-24T17:54:38.242265] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-24T17:54:38.242465] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-24T17:54:38.382809] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T17:54:38.422060] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-24T17:54:38.670476] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-24T17:54:38.670637] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-24T17:54:38.671553] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-24T17:54:38.671615] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-24T17:54:38.673166] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-24T17:54:39.000271] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-24T17:54:39.000420] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-24T17:54:39.000519] [INFO ] [MAIN ] Update Progress: 416/2373 symbols completed. CCL took 32.2s. Estimated remaining: 4h 16m 48s. Rate: 7.6 symbols/min [2025-09-24T17:54:39.171700] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:39.171893] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-24T17:54:39.171948] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-24T17:54:39.172147] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-24T17:54:39.172205] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-24T17:54:39.172273] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-24T17:54:39.172321] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-24T17:54:39.225672] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-24T17:54:39.544337] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:39.903326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T17:54:39.938019] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T17:54:40.016059] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-24T17:54:40.816090] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-24T17:54:41.429429] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T17:54:41.447047] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T17:54:41.616080] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-24T17:54:42.416090] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-24T17:54:42.832529] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T17:54:42.886198] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T17:54:43.216106] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-24T17:54:43.641242] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-24T17:54:44.016142] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-24T17:54:44.243279] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-24T17:54:44.816077] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-24T17:54:45.616067] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-24T17:54:45.795278] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:54:45.828879] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-24T17:54:46.416094] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-24T17:54:47.216110] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-24T17:54:47.820480] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T17:54:47.909803] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T17:54:48.016094] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-24T17:54:48.816047] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-24T17:54:49.269129] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T17:54:49.616065] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-24T17:54:49.840456] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:54:50.416079] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-24T17:54:50.652087] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T17:54:51.216154] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-24T17:54:51.434957] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-24T17:54:51.773113] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T17:54:52.016074] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-24T17:54:52.816044] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-24T17:54:52.969123] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T17:54:53.616130] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-24T17:54:54.143516] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T17:54:54.416189] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-24T17:54:54.706341] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T17:54:54.712089] [INFO ] [REMOTE ] CCS: Full fetch complete (44931 records). [2025-09-24T17:54:54.712244] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-24T17:54:55.100146] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-24T17:54:55.100457] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-24T17:54:55.101182] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-24T17:54:55.101384] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-24T17:54:55.103600] [DEBUG] [LOCAL ] CCS: Trimmed 44931 records to 30736 (keeping 200 days of data) [2025-09-24T17:54:55.214879] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T17:54:55.223696] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-24T17:54:55.320887] [DEBUG] [LOCAL ] CCS: Primary data saved (30736 records). [2025-09-24T17:54:55.321039] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-24T17:54:55.321138] [INFO ] [MAIN ] Update Progress: 417/2373 symbols completed. CCS took 23.9s. Estimated remaining: 4h 17m 20s. Rate: 7.6 symbols/min [2025-09-24T17:54:55.493899] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:54:55.549759] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-24T17:54:55.549928] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-24T17:54:55.728932] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:54:55.729223] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-24T17:54:55.729272] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-24T17:54:55.730601] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-24T17:54:55.730704] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-24T17:54:56.020995] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-24T17:54:56.115685] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:54:56.119632] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:54:56.462140] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-24T17:54:56.816097] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-24T17:54:57.616085] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-24T17:54:57.879666] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-24T17:54:58.416100] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-24T17:54:58.712845] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T17:54:59.216134] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-24T17:54:59.504279] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:54:59.504605] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-24T17:54:59.611354] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T17:55:00.016116] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-24T17:55:00.816082] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-24T17:55:01.616109] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-24T17:55:01.653426] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:55:01.799765] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T17:55:01.853209] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-24T17:55:02.416090] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-24T17:55:03.216083] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-24T17:55:03.424370] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T17:55:04.016081] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-24T17:55:04.412255] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-24T17:55:04.816093] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-24T17:55:05.018164] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T17:55:05.616053] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-24T17:55:05.956220] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T17:55:06.416083] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-24T17:55:07.216116] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-24T17:55:07.492727] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T17:55:07.543782] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T17:55:07.548385] [INFO ] [REMOTE ] CCU: Full fetch complete (33180 records). [2025-09-24T17:55:07.548588] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-24T17:55:07.663213] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T17:55:07.670101] [INFO ] [REMOTE ] CCZ: Full fetch complete (122 records). [2025-09-24T17:55:07.690824] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-24T17:55:07.699922] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:55:07.720709] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:55:07.726847] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:55:07.752549] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-24T17:55:07.758392] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-24T17:55:07.758502] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-24T17:55:07.770315] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-24T17:55:07.797793] [INFO ] [MAIN ] Update Progress: 418/2373 symbols completed. CCZ took 28.8s. Estimated remaining: 4h 17m 33s. Rate: 7.6 symbols/min [2025-09-24T17:55:08.023144] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-24T17:55:08.088534] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-24T17:55:08.093925] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-24T17:55:08.100106] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-24T17:55:08.105323] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-24T17:55:08.145591] [DEBUG] [LOCAL ] CCU: Trimmed 33180 records to 23608 (keeping 200 days of data) [2025-09-24T17:55:08.166093] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:08.166684] [DEBUG] [LOCAL ] CDLR: No existing data file found in primary storage. [2025-09-24T17:55:08.166743] [WARN ] [MAIN ] CDLR: No existing data found, performing full refresh instead. [2025-09-24T17:55:08.167231] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-24T17:55:08.167287] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-24T17:55:08.167333] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-24T17:55:08.167393] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-24T17:55:08.655957] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:08.705234] [DEBUG] [LOCAL ] CCU: Primary data saved (23608 records). [2025-09-24T17:55:08.705410] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-24T17:55:08.705522] [INFO ] [MAIN ] Update Progress: 419/2373 symbols completed. CCU took 31.9s. Estimated remaining: 4h 16m 53s. Rate: 7.6 symbols/min [2025-09-24T17:55:08.821634] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-24T17:55:08.900084] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:08.947574] [DEBUG] [LOCAL ] CDP: Loaded 42704 existing records from primary storage. [2025-09-24T17:55:08.947798] [INFO ] [MAIN ] CDP: Loaded 42704 existing records. [2025-09-24T17:55:09.141361] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:09.141898] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-24T17:55:09.142085] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-24T17:55:09.153459] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T17:55:09.153695] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-24T17:55:09.153845] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-24T17:55:09.529991] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:09.616091] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-24T17:55:10.410062] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T17:55:10.416027] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-24T17:55:10.944416] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T17:55:11.025468] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T17:55:11.216095] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-24T17:55:12.016092] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-24T17:55:12.816058] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-24T17:55:12.976021] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:55:13.416250] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T17:55:13.556081] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T17:55:13.616051] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-24T17:55:14.416091] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-24T17:55:14.469329] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T17:55:14.471584] [INFO ] [REMOTE ] CCRD: Full fetch complete (11937 records). [2025-09-24T17:55:14.471688] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-24T17:55:14.837391] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-24T17:55:14.837475] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-24T17:55:14.837837] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-24T17:55:14.837903] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-24T17:55:14.838422] [DEBUG] [LOCAL ] CCRD: Trimmed 11937 records to 9021 (keeping 200 days of data) [2025-09-24T17:55:14.895664] [DEBUG] [LOCAL ] CCRD: Primary data saved (9021 records). [2025-09-24T17:55:14.895818] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-24T17:55:14.895921] [INFO ] [MAIN ] Update Progress: 420/2373 symbols completed. CCRD took 43.6s. Estimated remaining: 4h 16m 37s. Rate: 7.6 symbols/min [2025-09-24T17:55:15.065793] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:15.066013] [DEBUG] [LOCAL ] CDRE: No existing data file found in primary storage. [2025-09-24T17:55:15.066069] [WARN ] [MAIN ] CDRE: No existing data found, performing full refresh instead. [2025-09-24T17:55:15.066224] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-24T17:55:15.066292] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-24T17:55:15.066356] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-24T17:55:15.066404] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-24T17:55:15.225552] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-24T17:55:15.457913] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:16.016086] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-24T17:55:16.291156] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T17:55:16.429810] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:55:16.623409] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T17:55:16.816079] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-24T17:55:17.616087] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-24T17:55:18.416100] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-24T17:55:18.742527] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T17:55:19.098503] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T17:55:19.216138] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-24T17:55:19.384899] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T17:55:19.946014] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T17:55:20.016125] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-24T17:55:20.816092] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-24T17:55:21.141116] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T17:55:21.616078] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-24T17:55:22.416101] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-24T17:55:22.655358] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T17:55:22.814702] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T17:55:23.216085] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-24T17:55:23.246708] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T17:55:24.016089] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-24T17:55:24.371158] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T17:55:24.816086] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-24T17:55:25.616134] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-24T17:55:25.676323] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T17:55:26.073572] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T17:55:26.409470] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T17:55:26.416047] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-24T17:55:27.216121] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-24T17:55:27.627880] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T17:55:28.015610] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T17:55:28.018682] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-24T17:55:28.816113] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-24T17:55:29.616164] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-24T17:55:30.119895] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T17:55:30.130123] [INFO ] [REMOTE ] CDE: Full fetch complete (77578 records). [2025-09-24T17:55:30.130309] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-24T17:55:30.420850] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-24T17:55:30.460806] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T17:55:30.615132] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T17:55:30.650898] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-24T17:55:30.651141] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-24T17:55:30.652192] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-24T17:55:30.652324] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-24T17:55:30.654560] [DEBUG] [LOCAL ] CDE: Trimmed 77578 records to 53641 (keeping 200 days of data) [2025-09-24T17:55:30.974629] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-24T17:55:30.974813] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-24T17:55:30.975503] [INFO ] [MAIN ] Update Progress: 421/2373 symbols completed. CDE took 35.7s. Estimated remaining: 4h 17m 7s. Rate: 7.6 symbols/min [2025-09-24T17:55:31.181843] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:31.216135] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-24T17:55:31.237374] [DEBUG] [LOCAL ] CE: Loaded 51554 existing records from primary storage. [2025-09-24T17:55:31.237566] [INFO ] [MAIN ] CE: Loaded 51554 existing records. [2025-09-24T17:55:31.424220] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:31.424478] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-24T17:55:31.424528] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-24T17:55:31.425911] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-24T17:55:31.425973] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-24T17:55:31.864636] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:31.880860] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T17:55:32.016057] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-24T17:55:32.092862] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T17:55:32.095106] [INFO ] [REMOTE ] CDLR: Full fetch complete (13104 records). [2025-09-24T17:55:32.095181] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-24T17:55:32.470733] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-24T17:55:32.470829] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-24T17:55:32.471184] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-24T17:55:32.471227] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-24T17:55:32.471902] [DEBUG] [LOCAL ] CDLR: Trimmed 13104 records to 9802 (keeping 200 days of data) [2025-09-24T17:55:32.530756] [DEBUG] [LOCAL ] CDLR: Primary data saved (9802 records). [2025-09-24T17:55:32.530902] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-24T17:55:32.530991] [INFO ] [MAIN ] Update Progress: 422/2373 symbols completed. CDLR took 24.7s. Estimated remaining: 4h 16m 30s. Rate: 7.6 symbols/min [2025-09-24T17:55:32.702217] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:32.712208] [DEBUG] [LOCAL ] CEE: Loaded 6777 existing records from primary storage. [2025-09-24T17:55:32.712353] [INFO ] [MAIN ] CEE: Loaded 6777 existing records. [2025-09-24T17:55:32.821688] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-24T17:55:32.904550] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:32.904828] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-24T17:55:32.904881] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-24T17:55:32.905156] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-24T17:55:32.905226] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-24T17:55:33.278596] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:33.569124] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T17:55:33.616061] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-24T17:55:34.260587] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T17:55:34.416120] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-24T17:55:34.771746] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T17:55:35.216103] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-24T17:55:36.016050] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-24T17:55:36.124253] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T17:55:36.308856] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T17:55:36.816079] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-24T17:55:37.413340] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T17:55:37.616052] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-24T17:55:37.734588] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T17:55:38.416099] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-24T17:55:39.102060] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T17:55:39.216041] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-24T17:55:39.252590] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T17:55:40.016124] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-24T17:55:40.550611] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T17:55:40.816099] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-24T17:55:41.012421] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T17:55:41.616086] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-24T17:55:41.734178] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T17:55:42.416142] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-24T17:55:43.188883] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T17:55:43.216046] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-24T17:55:43.553122] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T17:55:43.558340] [INFO ] [REMOTE ] CDRE: Full fetch complete (35531 records). [2025-09-24T17:55:43.558496] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-24T17:55:43.937328] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-24T17:55:43.937416] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-24T17:55:43.937985] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-24T17:55:43.938051] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-24T17:55:43.940443] [DEBUG] [LOCAL ] CDRE: Trimmed 35531 records to 25426 (keeping 200 days of data) [2025-09-24T17:55:44.038495] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-24T17:55:44.106984] [DEBUG] [LOCAL ] CDRE: Primary data saved (25426 records). [2025-09-24T17:55:44.107135] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-24T17:55:44.107215] [INFO ] [MAIN ] Update Progress: 423/2373 symbols completed. CDRE took 29.2s. Estimated remaining: 4h 16m 39s. Rate: 7.6 symbols/min [2025-09-24T17:55:44.275170] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:44.304047] [DEBUG] [LOCAL ] CEPU: Loaded 25995 existing records from primary storage. [2025-09-24T17:55:44.304217] [INFO ] [MAIN ] CEPU: Loaded 25995 existing records. [2025-09-24T17:55:44.484224] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:44.484485] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-24T17:55:44.484533] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-24T17:55:44.485168] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-24T17:55:44.485243] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-24T17:55:44.818085] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-24T17:55:44.880711] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:44.959184] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T17:55:45.598259] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T17:55:45.606162] [INFO ] [REMOTE ] CDP: Full fetch complete (61836 records). [2025-09-24T17:55:45.606327] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-24T17:55:45.621164] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-24T17:55:45.734792] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T17:55:46.049826] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-24T17:55:46.049922] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-24T17:55:46.050821] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-24T17:55:46.050890] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-24T17:55:46.052316] [DEBUG] [LOCAL ] CDP: Trimmed 61836 records to 42701 (keeping 200 days of data) [2025-09-24T17:55:46.322959] [DEBUG] [LOCAL ] CDP: Primary data saved (42701 records). [2025-09-24T17:55:46.323112] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-24T17:55:46.323204] [INFO ] [MAIN ] Update Progress: 424/2373 symbols completed. CDP took 37.6s. Estimated remaining: 4h 16m 5s. Rate: 7.6 symbols/min [2025-09-24T17:55:46.421459] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-24T17:55:46.520535] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:46.571394] [DEBUG] [LOCAL ] CF: Loaded 52228 existing records from primary storage. [2025-09-24T17:55:46.571567] [INFO ] [MAIN ] CF: Loaded 52228 existing records. [2025-09-24T17:55:46.768332] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:46.768602] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-24T17:55:46.768706] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-24T17:55:46.770088] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-24T17:55:46.770152] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-24T17:55:47.143805] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:47.161576] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T17:55:47.216037] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-24T17:55:47.572711] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T17:55:47.691031] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T17:55:48.016120] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-24T17:55:48.816127] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-24T17:55:49.394902] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T17:55:49.416736] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T17:55:49.616096] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-24T17:55:50.416132] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-24T17:55:51.216066] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-24T17:55:51.438944] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T17:55:51.826314] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T17:55:51.882137] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T17:55:52.016081] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-24T17:55:52.816091] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-24T17:55:53.616076] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-24T17:55:53.704866] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T17:55:53.900836] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T17:55:54.300301] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T17:55:54.302563] [INFO ] [REMOTE ] CEE: Full fetch complete (10211 records). [2025-09-24T17:55:54.302680] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-24T17:55:54.421209] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-24T17:55:54.679956] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-24T17:55:54.680082] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-24T17:55:54.680348] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-24T17:55:54.680390] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-24T17:55:54.680910] [DEBUG] [LOCAL ] CEE: Trimmed 10211 records to 6649 (keeping 200 days of data) [2025-09-24T17:55:54.720582] [DEBUG] [LOCAL ] CEE: Primary data saved (6649 records). [2025-09-24T17:55:54.720747] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-24T17:55:54.720841] [INFO ] [MAIN ] Update Progress: 425/2373 symbols completed. CEE took 22.2s. Estimated remaining: 4h 15m 60s. Rate: 7.6 symbols/min [2025-09-24T17:55:54.894203] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:55:54.954521] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-24T17:55:54.954716] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-09-24T17:55:55.132049] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:55:55.132353] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-24T17:55:55.132418] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-24T17:55:55.133874] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-24T17:55:55.133940] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-24T17:55:55.225068] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-24T17:55:55.492744] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:55:56.016049] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-24T17:55:56.218775] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T17:55:56.404370] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T17:55:56.816159] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-24T17:55:57.616078] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-24T17:55:57.781704] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T17:55:58.416062] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-24T17:55:58.545736] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T17:55:59.204851] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T17:55:59.216019] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-24T17:56:00.016121] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-24T17:56:00.086690] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T17:56:00.816105] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-24T17:56:01.057036] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T17:56:01.575699] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:56:01.616063] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-24T17:56:02.093464] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T17:56:02.416079] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-24T17:56:02.994725] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T17:56:03.216096] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-24T17:56:04.016100] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-24T17:56:04.203309] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T17:56:04.213126] [INFO ] [REMOTE ] CE: Full fetch complete (74885 records). [2025-09-24T17:56:04.213370] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-24T17:56:04.569371] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T17:56:04.669545] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-24T17:56:04.669622] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-24T17:56:04.670431] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-24T17:56:04.670487] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-24T17:56:04.671934] [DEBUG] [LOCAL ] CE: Trimmed 74885 records to 51543 (keeping 200 days of data) [2025-09-24T17:56:04.857621] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-24T17:56:04.994448] [DEBUG] [LOCAL ] CE: Primary data saved (51543 records). [2025-09-24T17:56:04.994603] [INFO ] [MAIN ] CE: Full history saved. [2025-09-24T17:56:04.994718] [INFO ] [MAIN ] Update Progress: 426/2373 symbols completed. CE took 34.0s. Estimated remaining: 4h 16m 3s. Rate: 7.6 symbols/min [2025-09-24T17:56:05.178850] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:05.179119] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-24T17:56:05.179176] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-24T17:56:05.179330] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-24T17:56:05.179373] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-24T17:56:05.179416] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-24T17:56:05.179449] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-24T17:56:05.554052] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:05.616081] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-24T17:56:05.887521] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:05.890042] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T17:56:05.890176] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-24T17:56:06.416062] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-24T17:56:06.937129] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T17:56:07.216100] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-24T17:56:07.864991] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T17:56:08.016041] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-24T17:56:08.556623] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T17:56:08.816081] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-24T17:56:09.602937] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T17:56:09.616025] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-24T17:56:09.855701] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T17:56:10.416083] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-24T17:56:11.141258] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:56:11.216137] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-24T17:56:11.622261] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T17:56:12.016168] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-24T17:56:12.816107] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-24T17:56:12.976837] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T17:56:13.616085] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-24T17:56:13.765263] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T17:56:14.102061] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T17:56:14.416126] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-24T17:56:15.136141] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T17:56:15.216130] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-24T17:56:15.425444] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:15.425814] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-24T17:56:16.016059] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-24T17:56:16.190088] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T17:56:16.219270] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:16.219599] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-24T17:56:16.816104] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-24T17:56:17.616083] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-24T17:56:18.416076] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-24T17:56:18.469670] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T17:56:18.615422] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:18.615852] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-24T17:56:19.220421] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-24T17:56:19.225688] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T17:56:19.235748] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-24T17:56:19.235881] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-24T17:56:19.493224] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:19.522680] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-24T17:56:19.657171] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-24T17:56:19.657271] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-24T17:56:19.658147] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-24T17:56:19.658220] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-24T17:56:19.659934] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-24T17:56:19.997865] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-24T17:56:19.998027] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-24T17:56:19.998129] [INFO ] [MAIN ] Update Progress: 427/2373 symbols completed. CFG took 25.3s. Estimated remaining: 4h 16m 27s. Rate: 7.6 symbols/min [2025-09-24T17:56:20.021154] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-24T17:56:20.175367] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:20.213917] [DEBUG] [LOCAL ] CFR: Loaded 33622 existing records from primary storage. [2025-09-24T17:56:20.214112] [INFO ] [MAIN ] CFR: Loaded 33622 existing records. [2025-09-24T17:56:20.394970] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:20.395217] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-24T17:56:20.395268] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-24T17:56:20.397022] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-24T17:56:20.397085] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-24T17:56:20.767196] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:20.816080] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-24T17:56:21.493617] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T17:56:21.500041] [INFO ] [REMOTE ] CEPU: Full fetch complete (39631 records). [2025-09-24T17:56:21.500204] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-24T17:56:21.621178] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-24T17:56:21.896745] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-24T17:56:21.896831] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-24T17:56:21.897360] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-24T17:56:21.897400] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-24T17:56:21.898325] [DEBUG] [LOCAL ] CEPU: Trimmed 39631 records to 26053 (keeping 200 days of data) [2025-09-24T17:56:22.014359] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T17:56:22.082850] [DEBUG] [LOCAL ] CEPU: Primary data saved (26053 records). [2025-09-24T17:56:22.082990] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-24T17:56:22.083089] [INFO ] [MAIN ] Update Progress: 428/2373 symbols completed. CEPU took 38.0s. Estimated remaining: 4h 15m 53s. Rate: 7.6 symbols/min [2025-09-24T17:56:22.259867] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:22.302938] [DEBUG] [LOCAL ] CGAU: Loaded 42686 existing records from primary storage. [2025-09-24T17:56:22.303125] [INFO ] [MAIN ] CGAU: Loaded 42686 existing records. [2025-09-24T17:56:22.421144] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-24T17:56:22.490024] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:22.490244] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-24T17:56:22.490296] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-24T17:56:22.491267] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-24T17:56:22.491329] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-24T17:56:22.841607] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:23.216067] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-24T17:56:23.427878] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T17:56:23.946328] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T17:56:24.016077] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-24T17:56:24.386918] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T17:56:24.816116] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-24T17:56:25.084818] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:25.085274] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-24T17:56:25.408216] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T17:56:25.616121] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-24T17:56:25.812519] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:25.812896] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-24T17:56:26.416121] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-24T17:56:27.216095] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-24T17:56:27.423729] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:56:27.424106] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-24T17:56:28.016113] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-24T17:56:28.419959] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T17:56:28.429992] [INFO ] [REMOTE ] CF: Full fetch complete (75141 records). [2025-09-24T17:56:28.430192] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-24T17:56:28.825928] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-24T17:56:28.851221] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-24T17:56:28.851296] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-24T17:56:28.852208] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-24T17:56:28.852280] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-24T17:56:28.854080] [DEBUG] [LOCAL ] CF: Trimmed 75141 records to 52229 (keeping 200 days of data) [2025-09-24T17:56:29.179824] [DEBUG] [LOCAL ] CF: Primary data saved (52229 records). [2025-09-24T17:56:29.180028] [INFO ] [MAIN ] CF: Full history saved. [2025-09-24T17:56:29.180159] [INFO ] [MAIN ] Update Progress: 429/2373 symbols completed. CF took 42.9s. Estimated remaining: 4h 15m 41s. Rate: 7.6 symbols/min [2025-09-24T17:56:29.358275] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:29.361922] [DEBUG] [LOCAL ] CGV: Loaded 1405 existing records from primary storage. [2025-09-24T17:56:29.362048] [INFO ] [MAIN ] CGV: Loaded 1405 existing records. [2025-09-24T17:56:29.490596] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T17:56:29.593508] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:29.594057] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-24T17:56:29.594145] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-24T17:56:29.594428] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-24T17:56:29.594502] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-24T17:56:29.625095] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-24T17:56:29.972128] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:29.982627] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T17:56:30.416122] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-24T17:56:31.125672] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T17:56:31.216098] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-24T17:56:31.859832] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T17:56:32.016123] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-24T17:56:32.611597] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T17:56:32.622189] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T17:56:32.816094] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-24T17:56:33.253145] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T17:56:33.616093] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-24T17:56:34.171927] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T17:56:34.173630] [INFO ] [REMOTE ] CFND: Full fetch complete (2546 records). [2025-09-24T17:56:34.173726] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-24T17:56:34.353440] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-24T17:56:34.353658] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:56:34.353727] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:56:34.353798] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-24T17:56:34.353887] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-24T17:56:34.353944] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-24T17:56:34.354014] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-24T17:56:34.354108] [INFO ] [MAIN ] Update Progress: 430/2373 symbols completed. CFND took 29.4s. Estimated remaining: 4h 15m 21s. Rate: 7.6 symbols/min [2025-09-24T17:56:34.421258] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-24T17:56:34.528967] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:34.572493] [DEBUG] [LOCAL ] CHCT: Loaded 24013 existing records from primary storage. [2025-09-24T17:56:34.572723] [INFO ] [MAIN ] CHCT: Loaded 24013 existing records. [2025-09-24T17:56:34.756701] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:34.757158] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-24T17:56:34.757251] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-24T17:56:34.757941] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-24T17:56:34.758001] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-24T17:56:34.914789] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T17:56:35.124439] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:35.216097] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-24T17:56:36.016087] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-24T17:56:36.229628] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T17:56:36.816091] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-24T17:56:37.300483] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T17:56:37.571840] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T17:56:37.616148] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-24T17:56:38.416130] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-24T17:56:38.820192] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T17:56:39.216076] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-24T17:56:39.708546] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T17:56:39.960096] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T17:56:40.016034] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-24T17:56:40.816103] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-24T17:56:41.093329] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T17:56:41.245006] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T17:56:41.616108] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-24T17:56:42.416051] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-24T17:56:42.792202] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T17:56:42.952585] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T17:56:43.216078] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-24T17:56:44.016080] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-24T17:56:44.440441] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T17:56:44.773281] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T17:56:44.816052] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-24T17:56:45.616133] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-24T17:56:46.242330] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T17:56:46.416091] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-24T17:56:46.741873] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T17:56:46.767844] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T17:56:47.216093] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-24T17:56:48.016138] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-24T17:56:48.573361] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T17:56:48.816055] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-24T17:56:48.838219] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T17:56:49.616076] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-24T17:56:50.255601] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T17:56:50.416076] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-24T17:56:51.012110] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T17:56:51.216092] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-24T17:56:51.561441] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T17:56:51.571093] [INFO ] [REMOTE ] CFR: Full fetch complete (48475 records). [2025-09-24T17:56:51.571345] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-24T17:56:51.974225] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-24T17:56:51.974334] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-24T17:56:51.975412] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-24T17:56:51.975502] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-24T17:56:51.980695] [DEBUG] [LOCAL ] CFR: Trimmed 48475 records to 33520 (keeping 200 days of data) [2025-09-24T17:56:52.044432] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-24T17:56:52.207473] [DEBUG] [LOCAL ] CFR: Primary data saved (33520 records). [2025-09-24T17:56:52.207624] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-24T17:56:52.207758] [INFO ] [MAIN ] Update Progress: 431/2373 symbols completed. CFR took 32.2s. Estimated remaining: 4h 15m 58s. Rate: 7.6 symbols/min [2025-09-24T17:56:52.386300] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:52.446956] [DEBUG] [LOCAL ] CHD: Loaded 52024 existing records from primary storage. [2025-09-24T17:56:52.447135] [INFO ] [MAIN ] CHD: Loaded 52024 existing records. [2025-09-24T17:56:52.650273] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:52.651368] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-24T17:56:52.651515] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-24T17:56:52.652885] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-24T17:56:52.652962] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-24T17:56:52.826032] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-24T17:56:52.868720] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T17:56:53.078230] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:53.200261] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T17:56:53.287970] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T17:56:53.616087] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-24T17:56:54.416092] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-24T17:56:55.169635] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T17:56:55.216043] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-24T17:56:56.016043] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-24T17:56:56.048269] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T17:56:56.513493] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T17:56:56.514369] [INFO ] [REMOTE ] CGV: Full fetch complete (2288 records). [2025-09-24T17:56:56.514438] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-24T17:56:56.822321] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-24T17:56:56.909386] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-24T17:56:56.909528] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-24T17:56:56.909744] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-24T17:56:56.909806] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-24T17:56:56.910235] [DEBUG] [LOCAL ] CGV: Trimmed 2288 records to 1403 (keeping 200 days of data) [2025-09-24T17:56:56.920221] [DEBUG] [LOCAL ] CGV: Primary data saved (1403 records). [2025-09-24T17:56:56.920493] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-24T17:56:56.920743] [INFO ] [MAIN ] Update Progress: 432/2373 symbols completed. CGV took 27.7s. Estimated remaining: 4h 15m 36s. Rate: 7.6 symbols/min [2025-09-24T17:56:57.141561] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:57.145921] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T17:56:57.174228] [DEBUG] [LOCAL ] CHE: Loaded 14740 existing records from primary storage. [2025-09-24T17:56:57.174362] [INFO ] [MAIN ] CHE: Loaded 14740 existing records. [2025-09-24T17:56:57.350862] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:57.351134] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-24T17:56:57.351196] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-24T17:56:57.351798] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-24T17:56:57.351868] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-24T17:56:57.623685] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-24T17:56:57.706132] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:56:58.416146] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-24T17:56:58.764760] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T17:56:58.773286] [INFO ] [REMOTE ] CGAU: Full fetch complete (60587 records). [2025-09-24T17:56:58.773418] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-24T17:56:59.175732] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-24T17:56:59.176179] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-24T17:56:59.183903] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-24T17:56:59.184006] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-24T17:56:59.184778] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T17:56:59.189265] [DEBUG] [LOCAL ] CGAU: Trimmed 60587 records to 42718 (keeping 200 days of data) [2025-09-24T17:56:59.256874] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-24T17:56:59.319926] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T17:56:59.483899] [DEBUG] [LOCAL ] CGAU: Primary data saved (42718 records). [2025-09-24T17:56:59.484033] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-24T17:56:59.484118] [INFO ] [MAIN ] Update Progress: 433/2373 symbols completed. CGAU took 37.4s. Estimated remaining: 4h 15m 4s. Rate: 7.6 symbols/min [2025-09-24T17:56:59.653547] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:56:59.701542] [DEBUG] [LOCAL ] CHGG: Loaded 47742 existing records from primary storage. [2025-09-24T17:56:59.701749] [INFO ] [MAIN ] CHGG: Loaded 47742 existing records. [2025-09-24T17:56:59.887357] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:56:59.887944] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-24T17:56:59.888002] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-24T17:56:59.889173] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-24T17:56:59.889235] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-24T17:57:00.029043] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-24T17:57:00.247809] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:00.717866] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T17:57:00.816042] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-24T17:57:00.876127] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T17:57:01.616046] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-24T17:57:01.991354] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T17:57:02.416095] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-24T17:57:03.216135] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-24T17:57:03.539455] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T17:57:04.016110] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-24T17:57:04.816097] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-24T17:57:05.124699] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T17:57:05.131320] [INFO ] [REMOTE ] CHCT: Full fetch complete (35018 records). [2025-09-24T17:57:05.131583] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-24T17:57:05.617033] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T17:57:05.620485] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-24T17:57:05.623443] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-24T17:57:05.633429] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-24T17:57:05.627210] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-24T17:57:05.634886] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-24T17:57:05.636489] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-24T17:57:05.638476] [DEBUG] [LOCAL ] CHCT: Trimmed 35018 records to 23991 (keeping 200 days of data) [2025-09-24T17:57:05.823286] [DEBUG] [LOCAL ] CHCT: Primary data saved (23991 records). [2025-09-24T17:57:05.823472] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-24T17:57:05.823594] [INFO ] [MAIN ] Update Progress: 434/2373 symbols completed. CHCT took 31.5s. Estimated remaining: 4h 14m 49s. Rate: 7.6 symbols/min [2025-09-24T17:57:06.016031] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:06.074257] [DEBUG] [LOCAL ] CHH: Loaded 32213 existing records from primary storage. [2025-09-24T17:57:06.101910] [INFO ] [MAIN ] CHH: Loaded 32213 existing records. [2025-09-24T17:57:06.220286] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-24T17:57:06.321924] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:06.322253] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-24T17:57:06.322306] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-24T17:57:06.323290] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-24T17:57:06.323354] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-24T17:57:06.422747] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-24T17:57:06.728033] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:06.734582] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T17:57:07.216089] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-24T17:57:08.016092] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-24T17:57:08.174222] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T17:57:08.193428] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T17:57:08.816097] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-24T17:57:09.616074] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-24T17:57:09.838091] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T17:57:09.839418] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T17:57:10.416141] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-24T17:57:11.054084] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T17:57:11.216104] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-24T17:57:12.016131] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-24T17:57:12.267623] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T17:57:12.464439] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T17:57:12.816137] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-24T17:57:13.616087] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-24T17:57:13.671901] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T17:57:14.347237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T17:57:14.416051] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-24T17:57:14.777280] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-24T17:57:15.216100] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-24T17:57:16.016054] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-24T17:57:16.237056] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T17:57:16.816059] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-24T17:57:16.970842] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T17:57:17.572245] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T17:57:17.616087] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-24T17:57:18.416102] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-24T17:57:18.521428] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T17:57:19.216058] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-24T17:57:19.322532] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T17:57:19.798364] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T17:57:20.016042] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-24T17:57:20.071470] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T17:57:20.816077] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-24T17:57:21.616082] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-24T17:57:22.416087] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-24T17:57:22.580767] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-24T17:57:23.216203] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-24T17:57:23.482930] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-24T17:57:23.487414] [INFO ] [REMOTE ] CHE: Full fetch complete (19702 records). [2025-09-24T17:57:23.487581] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-24T17:57:23.991370] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-24T17:57:23.991852] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-24T17:57:23.992565] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-24T17:57:23.992687] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-24T17:57:23.993781] [DEBUG] [LOCAL ] CHE: Trimmed 19702 records to 14812 (keeping 200 days of data) [2025-09-24T17:57:24.089250] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-24T17:57:24.117064] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-24T17:57:24.129629] [DEBUG] [LOCAL ] CHE: Primary data saved (14812 records). [2025-09-24T17:57:24.129905] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-24T17:57:24.130129] [INFO ] [MAIN ] Update Progress: 435/2373 symbols completed. CHE took 27.2s. Estimated remaining: 4h 15m 28s. Rate: 7.6 symbols/min [2025-09-24T17:57:24.332331] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:24.348483] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T17:57:24.357891] [INFO ] [REMOTE ] CHD: Full fetch complete (74368 records). [2025-09-24T17:57:24.358040] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-24T17:57:24.494202] [DEBUG] [LOCAL ] CHMI: Loaded 22112 existing records from primary storage. [2025-09-24T17:57:24.517544] [INFO ] [MAIN ] CHMI: Loaded 22112 existing records. [2025-09-24T17:57:24.956600] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:24.981349] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-24T17:57:24.989406] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-24T17:57:24.999054] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-24T17:57:25.003156] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T17:57:25.003311] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-24T17:57:25.002240] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-24T17:57:25.003440] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-24T17:57:25.011850] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-24T17:57:25.032985] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-24T17:57:25.088831] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-24T17:57:25.116824] [DEBUG] [LOCAL ] CHD: Trimmed 74368 records to 52017 (keeping 200 days of data) [2025-09-24T17:57:25.500716] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:25.617020] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-24T17:57:25.709970] [DEBUG] [LOCAL ] CHD: Primary data saved (52017 records). [2025-09-24T17:57:25.710123] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-24T17:57:25.710219] [INFO ] [MAIN ] Update Progress: 436/2373 symbols completed. CHD took 33.5s. Estimated remaining: 4h 14m 52s. Rate: 7.6 symbols/min [2025-09-24T17:57:25.882491] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:25.888947] [DEBUG] [LOCAL ] CHN: Loaded 4788 existing records from primary storage. [2025-09-24T17:57:25.889099] [INFO ] [MAIN ] CHN: Loaded 4788 existing records. [2025-09-24T17:57:26.079990] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:26.080451] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-24T17:57:26.080698] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-24T17:57:26.081076] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-24T17:57:26.081139] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-24T17:57:26.373820] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-24T17:57:26.416273] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-24T17:57:26.533920] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:26.566482] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T17:57:26.575754] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T17:57:27.216139] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-24T17:57:28.016053] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-24T17:57:28.339761] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T17:57:28.499686] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-24T17:57:28.816096] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-24T17:57:29.362036] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T17:57:29.616133] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-24T17:57:30.273685] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T17:57:30.416119] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-24T17:57:30.502311] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T17:57:31.216086] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-24T17:57:31.490093] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T17:57:31.888433] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T17:57:32.016066] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-24T17:57:32.816119] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-24T17:57:32.900378] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T17:57:33.616083] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-24T17:57:34.309386] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T17:57:34.416096] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-24T17:57:34.933771] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T17:57:34.989413] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T17:57:35.216110] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-24T17:57:36.016135] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-24T17:57:36.816109] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-24T17:57:37.101739] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T17:57:37.110262] [INFO ] [REMOTE ] CHGG: Full fetch complete (70627 records). [2025-09-24T17:57:37.110392] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-24T17:57:37.541986] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T17:57:37.584685] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-24T17:57:37.587377] [INFO ] [REMOTE ] CHH: Full fetch complete (46340 records). [2025-09-24T17:57:37.587793] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-24T17:57:37.587616] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-24T17:57:37.588487] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-24T17:57:37.589547] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-24T17:57:37.589677] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-24T17:57:37.621168] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-24T17:57:37.698047] [DEBUG] [LOCAL ] CHGG: Trimmed 70627 records to 47701 (keeping 200 days of data) [2025-09-24T17:57:38.144338] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-24T17:57:38.144749] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-24T17:57:38.148989] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-24T17:57:38.149132] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-24T17:57:38.204401] [DEBUG] [LOCAL ] CHH: Trimmed 46340 records to 32181 (keeping 200 days of data) [2025-09-24T17:57:38.417529] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-24T17:57:38.429688] [DEBUG] [LOCAL ] CHGG: Primary data saved (47701 records). [2025-09-24T17:57:38.430165] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-24T17:57:38.430939] [INFO ] [MAIN ] Update Progress: 437/2373 symbols completed. CHGG took 38.9s. Estimated remaining: 4h 15m 5s. Rate: 7.6 symbols/min [2025-09-24T17:57:38.516054] [DEBUG] [LOCAL ] CHH: Primary data saved (32181 records). [2025-09-24T17:57:38.516193] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-24T17:57:38.516935] [INFO ] [MAIN ] Update Progress: 438/2373 symbols completed. CHH took 32.7s. Estimated remaining: 4h 14m 23s. Rate: 7.6 symbols/min [2025-09-24T17:57:39.374486] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T17:57:39.376366] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-24T17:57:39.440302] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T17:57:40.016088] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-24T17:57:40.212161] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T17:57:40.816059] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-24T17:57:40.903601] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:57:41.383614] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T17:57:41.616125] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-24T17:57:42.416106] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-24T17:57:42.685497] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T17:57:43.101300] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T17:57:43.216124] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-24T17:57:44.016053] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-24T17:57:44.265073] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T17:57:44.710130] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T17:57:44.711722] [INFO ] [REMOTE ] CHN: Full fetch complete (7592 records). [2025-09-24T17:57:44.711860] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-24T17:57:44.819601] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-24T17:57:45.089363] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-24T17:57:45.089450] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-24T17:57:45.089670] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-24T17:57:45.089733] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-24T17:57:45.090123] [DEBUG] [LOCAL ] CHN: Trimmed 7592 records to 4808 (keeping 200 days of data) [2025-09-24T17:57:45.117942] [DEBUG] [LOCAL ] CHN: Primary data saved (4808 records). [2025-09-24T17:57:45.118039] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-24T17:57:45.118123] [INFO ] [MAIN ] Update Progress: 439/2373 symbols completed. CHN took 19.4s. Estimated remaining: 4h 14m 9s. Rate: 7.6 symbols/min [2025-09-24T17:57:45.965475] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T17:57:45.970410] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-24T17:57:47.157671] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T17:57:47.161887] [INFO ] [REMOTE ] CHMI: Full fetch complete (31614 records). [2025-09-24T17:57:47.161969] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-24T17:57:47.536799] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-24T17:57:47.536883] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-24T17:57:47.537439] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-24T17:57:47.537482] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-24T17:57:47.538327] [DEBUG] [LOCAL ] CHMI: Trimmed 31614 records to 22062 (keeping 200 days of data) [2025-09-24T17:57:47.685860] [DEBUG] [LOCAL ] CHMI: Primary data saved (22062 records). [2025-09-24T17:57:47.685996] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-24T17:57:47.686089] [INFO ] [MAIN ] Update Progress: 440/2373 symbols completed. CHMI took 23.6s. Estimated remaining: 4h 13m 38s. Rate: 7.6 symbols/min [2025-09-24T17:57:48.309785] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:48.369233] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:48.395143] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:48.412175] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:57:48.440587] [DEBUG] [LOCAL ] CHT: Loaded 19542 existing records from primary storage. [2025-09-24T17:57:48.440794] [INFO ] [MAIN ] CHT: Loaded 19542 existing records. [2025-09-24T17:57:48.615997] [DEBUG] [LOCAL ] CHPT: Loaded 49401 existing records from primary storage. [2025-09-24T17:57:48.627542] [INFO ] [MAIN ] CHPT: Loaded 49401 existing records. [2025-09-24T17:57:48.773419] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:48.789873] [DEBUG] [LOCAL ] CI: Loaded 49904 existing records from primary storage. [2025-09-24T17:57:48.816084] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-24T17:57:48.821838] [INFO ] [MAIN ] CI: Loaded 49904 existing records. [2025-09-24T17:57:48.821406] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-24T17:57:48.821691] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-24T17:57:48.832371] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-24T17:57:48.848458] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-24T17:57:48.868944] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-24T17:57:49.280810] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:49.377215] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-24T17:57:49.377421] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-24T17:57:49.431605] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-24T17:57:49.458268] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-24T17:57:49.569540] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:49.626429] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:57:49.681991] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-24T17:57:49.708366] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-24T17:57:49.724057] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-24T17:57:49.765827] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-24T17:57:49.765749] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-24T17:57:49.777701] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-24T17:57:49.777108] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-24T17:57:49.777943] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-24T17:57:50.059086] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:50.251907] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-24T17:57:50.757742] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:50.809905] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-24T17:57:50.948982] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:50.957333] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-24T17:57:51.015908] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:57:51.016555] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-24T17:57:51.466023] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T17:57:51.470208] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-24T17:57:52.472951] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T17:57:52.477140] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-24T17:57:52.909029] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T17:57:52.940621] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-24T17:57:52.944075] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T17:57:52.957096] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-24T17:57:52.997154] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-24T17:57:53.009129] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-24T17:57:53.129124] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T17:57:53.616107] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-24T17:57:54.423702] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T17:57:54.429139] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-24T17:57:54.638697] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T17:57:54.725960] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T17:57:54.780523] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T17:57:55.216099] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-24T17:57:55.261062] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T17:57:56.016169] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-24T17:57:56.816110] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-24T17:57:57.388591] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-24T17:57:57.519958] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T17:57:57.616085] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-24T17:57:58.421191] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-24T17:57:58.440060] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:57:59.221368] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-24T17:57:59.238263] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T17:58:00.016063] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-24T17:58:00.113366] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T17:58:00.357264] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T17:58:00.816095] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-24T17:58:01.616067] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-24T17:58:01.940756] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T17:58:02.416111] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-24T17:58:02.646837] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T17:58:03.216149] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-24T17:58:03.428808] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T17:58:03.614044] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T17:58:04.016131] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-24T17:58:04.816111] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-24T17:58:04.957776] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T17:58:05.108124] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T17:58:05.616144] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-24T17:58:06.416075] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-24T17:58:06.903125] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T17:58:07.216063] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-24T17:58:07.403179] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T17:58:08.016147] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-24T17:58:08.500962] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T17:58:08.816102] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-24T17:58:09.379029] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-24T17:58:09.421791] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T17:58:09.616083] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-24T17:58:09.761093] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T17:58:10.416082] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-24T17:58:11.216053] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-24T17:58:11.386579] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T17:58:12.016138] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-24T17:58:12.755499] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-24T17:58:12.816115] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-24T17:58:13.244020] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T17:58:13.616174] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-24T17:58:13.892827] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T17:58:14.146220] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T17:58:14.150093] [INFO ] [REMOTE ] CHT: Full fetch complete (27322 records). [2025-09-24T17:58:14.150200] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-24T17:58:14.421228] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-24T17:58:14.536514] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-24T17:58:14.536613] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-24T17:58:14.537132] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-24T17:58:14.537192] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-24T17:58:14.538099] [DEBUG] [LOCAL ] CHT: Trimmed 27322 records to 19530 (keeping 200 days of data) [2025-09-24T17:58:14.658452] [DEBUG] [LOCAL ] CHT: Primary data saved (19530 records). [2025-09-24T17:58:14.658597] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-24T17:58:14.658707] [INFO ] [MAIN ] Update Progress: 441/2373 symbols completed. CHT took 27.0s. Estimated remaining: 4h 14m 54s. Rate: 7.6 symbols/min [2025-09-24T17:58:14.834824] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:14.852091] [DEBUG] [LOCAL ] CIA: Loaded 17059 existing records from primary storage. [2025-09-24T17:58:14.852215] [INFO ] [MAIN ] CIA: Loaded 17059 existing records. [2025-09-24T17:58:15.033208] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:15.033475] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-24T17:58:15.033538] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-24T17:58:15.034036] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-24T17:58:15.034099] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-24T17:58:15.216868] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-24T17:58:15.511411] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:15.581102] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T17:58:16.016157] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-24T17:58:16.597038] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-24T17:58:16.606159] [INFO ] [REMOTE ] CI: Full fetch complete (72512 records). [2025-09-24T17:58:16.606368] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-24T17:58:16.824925] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-24T17:58:17.083673] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-24T17:58:17.113039] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-24T17:58:17.119131] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-24T17:58:17.117599] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-24T17:58:17.119415] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-24T17:58:17.125107] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T17:58:17.135553] [DEBUG] [LOCAL ] CI: Trimmed 72512 records to 49852 (keeping 200 days of data) [2025-09-24T17:58:17.463379] [DEBUG] [LOCAL ] CI: Primary data saved (49852 records). [2025-09-24T17:58:17.463538] [INFO ] [MAIN ] CI: Full history saved. [2025-09-24T17:58:17.463633] [INFO ] [MAIN ] Update Progress: 442/2373 symbols completed. CI took 29.8s. Estimated remaining: 4h 14m 24s. Rate: 7.6 symbols/min [2025-09-24T17:58:17.634481] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-24T17:58:17.638488] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:17.671392] [DEBUG] [LOCAL ] CIB: Loaded 31006 existing records from primary storage. [2025-09-24T17:58:17.671544] [INFO ] [MAIN ] CIB: Loaded 31006 existing records. [2025-09-24T17:58:17.856813] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:17.857087] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-24T17:58:17.857137] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-24T17:58:17.858098] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-24T17:58:17.858162] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-24T17:58:18.226517] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:18.416068] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-24T17:58:18.611962] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T17:58:18.966249] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T17:58:19.216106] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-24T17:58:19.787496] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T17:58:20.016078] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-24T17:58:20.079331] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T17:58:20.816083] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-24T17:58:21.616139] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-24T17:58:22.231768] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T17:58:22.240069] [INFO ] [REMOTE ] CHPT: Full fetch complete (73386 records). [2025-09-24T17:58:22.240230] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-24T17:58:22.424980] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-24T17:58:22.621336] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-24T17:58:22.693610] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T17:58:22.698326] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-24T17:58:22.698678] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-24T17:58:22.702216] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-24T17:58:22.703183] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-24T17:58:22.703937] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-24T17:58:22.704185] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-24T17:58:22.705780] [DEBUG] [LOCAL ] CHPT: Trimmed 73386 records to 49274 (keeping 200 days of data) [2025-09-24T17:58:23.229603] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-24T17:58:23.260929] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-24T17:58:23.265115] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-24T17:58:23.266367] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-24T17:58:23.266480] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-24T17:58:23.357419] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 53654 (keeping 200 days of data) [2025-09-24T17:58:23.663862] [DEBUG] [LOCAL ] CHPT: Primary data saved (49274 records). [2025-09-24T17:58:23.664928] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-24T17:58:23.665906] [INFO ] [MAIN ] Update Progress: 443/2373 symbols completed. CHPT took 36.0s. Estimated remaining: 4h 14m 8s. Rate: 7.6 symbols/min [2025-09-24T17:58:23.867247] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:23.869109] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-24T17:58:23.869902] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-24T17:58:23.870981] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-24T17:58:23.871620] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-24T17:58:23.872603] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-24T17:58:23.873281] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-24T17:58:23.984239] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T17:58:24.017882] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-24T17:58:24.311591] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:24.403452] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-09-24T17:58:24.403624] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-24T17:58:24.405504] [INFO ] [MAIN ] Update Progress: 444/2373 symbols completed. CHWY took 36.7s. Estimated remaining: 4h 13m 29s. Rate: 7.6 symbols/min [2025-09-24T17:58:24.543843] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T17:58:24.641751] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:24.697988] [DEBUG] [LOCAL ] CIEN: Loaded 52087 existing records from primary storage. [2025-09-24T17:58:24.698198] [INFO ] [MAIN ] CIEN: Loaded 52087 existing records. [2025-09-24T17:58:24.821250] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-24T17:58:24.896474] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:24.896785] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-24T17:58:24.896843] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-24T17:58:24.898331] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-24T17:58:24.898540] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-24T17:58:25.289823] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:25.383282] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T17:58:25.444284] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T17:58:25.616130] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-24T17:58:26.132294] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T17:58:26.416097] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-24T17:58:27.216118] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-24T17:58:27.387098] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T17:58:28.016100] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-24T17:58:28.788855] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T17:58:28.816039] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-24T17:58:29.115082] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T17:58:29.616178] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-24T17:58:30.072812] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-24T17:58:30.416053] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-24T17:58:30.728509] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T17:58:30.815465] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-24T17:58:31.216097] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-24T17:58:32.016054] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-24T17:58:32.279898] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T17:58:32.816123] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-24T17:58:33.382204] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T17:58:33.616059] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-24T17:58:34.424229] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-24T17:58:34.431821] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T17:58:34.776915] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T17:58:34.884886] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-24T17:58:35.216119] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-24T17:58:36.016100] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-24T17:58:36.816066] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-24T17:58:36.962412] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T17:58:37.048321] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T17:58:37.616103] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-24T17:58:37.975683] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T17:58:38.416069] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-24T17:58:38.625856] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T17:58:38.630340] [INFO ] [REMOTE ] CIA: Full fetch complete (23345 records). [2025-09-24T17:58:38.630448] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-24T17:58:38.926320] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T17:58:39.036728] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-24T17:58:39.036822] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-24T17:58:39.037271] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-24T17:58:39.037314] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-24T17:58:39.038119] [DEBUG] [LOCAL ] CIA: Trimmed 23345 records to 17021 (keeping 200 days of data) [2025-09-24T17:58:39.133796] [DEBUG] [LOCAL ] CIA: Primary data saved (17021 records). [2025-09-24T17:58:39.133948] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-24T17:58:39.134038] [INFO ] [MAIN ] Update Progress: 445/2373 symbols completed. CIA took 24.5s. Estimated remaining: 4h 13m 51s. Rate: 7.6 symbols/min [2025-09-24T17:58:39.221181] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-24T17:58:39.309740] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:39.315704] [DEBUG] [LOCAL ] CIF: Loaded 4364 existing records from primary storage. [2025-09-24T17:58:39.315788] [INFO ] [MAIN ] CIF: Loaded 4364 existing records. [2025-09-24T17:58:39.508228] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:39.508623] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-24T17:58:39.508710] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-24T17:58:39.509173] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-24T17:58:39.509237] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-24T17:58:39.867073] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:40.016071] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-24T17:58:40.725283] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T17:58:40.816084] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-24T17:58:40.883005] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T17:58:41.616105] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-24T17:58:42.021946] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T17:58:42.046675] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T17:58:42.416121] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-24T17:58:42.751122] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T17:58:43.216135] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-24T17:58:44.016087] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-24T17:58:44.584157] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T17:58:44.816052] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-24T17:58:44.914460] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T17:58:45.616109] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-24T17:58:46.340194] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T17:58:46.416099] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-24T17:58:46.744352] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-24T17:58:47.216054] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-24T17:58:47.253213] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T17:58:47.868361] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T17:58:48.016076] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-24T17:58:48.816100] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-24T17:58:49.496003] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T17:58:49.616062] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-24T17:58:49.662279] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T17:58:50.286603] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-24T17:58:50.416137] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-24T17:58:50.886771] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-24T17:58:50.887567] [INFO ] [REMOTE ] CICB: Full fetch complete (2124 records). [2025-09-24T17:58:50.887635] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-24T17:58:51.074177] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-24T17:58:51.074390] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:58:51.074462] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:58:51.074514] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-24T17:58:51.074575] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-24T17:58:51.074612] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-24T17:58:51.074703] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-24T17:58:51.074790] [INFO ] [MAIN ] Update Progress: 446/2373 symbols completed. CICB took 27.4s. Estimated remaining: 4h 14m 1s. Rate: 7.6 symbols/min [2025-09-24T17:58:51.228136] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-24T17:58:51.263263] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:51.311003] [DEBUG] [LOCAL ] CIG: Loaded 43739 existing records from primary storage. [2025-09-24T17:58:51.311167] [INFO ] [MAIN ] CIG: Loaded 43739 existing records. [2025-09-24T17:58:51.491219] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:51.491478] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-24T17:58:51.491526] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-24T17:58:51.492579] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-24T17:58:51.492669] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-24T17:58:51.884314] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:52.016089] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-24T17:58:52.586707] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T17:58:52.816079] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-24T17:58:53.616080] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-24T17:58:53.626272] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T17:58:53.652923] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T17:58:54.416113] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-24T17:58:55.020001] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T17:58:55.022636] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T17:58:55.031634] [INFO ] [REMOTE ] CIB: Full fetch complete (44341 records). [2025-09-24T17:58:55.031863] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-24T17:58:55.221594] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-24T17:58:55.464557] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-24T17:58:55.464726] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-24T17:58:55.465584] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-24T17:58:55.465687] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-24T17:58:55.468179] [DEBUG] [LOCAL ] CIB: Trimmed 44341 records to 31023 (keeping 200 days of data) [2025-09-24T17:58:55.660260] [DEBUG] [LOCAL ] CIB: Primary data saved (31023 records). [2025-09-24T17:58:55.660425] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-24T17:58:55.660570] [INFO ] [MAIN ] Update Progress: 447/2373 symbols completed. CIB took 38.2s. Estimated remaining: 4h 13m 38s. Rate: 7.6 symbols/min [2025-09-24T17:58:55.840381] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:58:55.857743] [DEBUG] [LOCAL ] CII: Loaded 15526 existing records from primary storage. [2025-09-24T17:58:55.857917] [INFO ] [MAIN ] CII: Loaded 15526 existing records. [2025-09-24T17:58:56.024698] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-24T17:58:56.063249] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:58:56.064847] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-24T17:58:56.064922] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-24T17:58:56.065478] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-24T17:58:56.065567] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-24T17:58:56.512578] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:58:56.816096] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-24T17:58:57.151890] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T17:58:57.206795] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T17:58:57.463600] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T17:58:57.616085] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-24T17:58:58.416106] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-24T17:58:58.855565] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T17:58:59.216066] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-24T17:58:59.498466] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T17:59:00.016114] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-24T17:59:00.816086] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-24T17:59:00.949553] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T17:59:01.243573] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T17:59:01.616081] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-24T17:59:02.006189] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T17:59:02.017036] [INFO ] [REMOTE ] CIEN: Full fetch complete (75551 records). [2025-09-24T17:59:02.017230] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-24T17:59:02.421190] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-24T17:59:02.470562] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-24T17:59:02.470673] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-24T17:59:02.471498] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-24T17:59:02.471563] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-24T17:59:02.473132] [DEBUG] [LOCAL ] CIEN: Trimmed 75551 records to 52083 (keeping 200 days of data) [2025-09-24T17:59:02.798399] [DEBUG] [LOCAL ] CIEN: Primary data saved (52083 records). [2025-09-24T17:59:02.798629] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-24T17:59:02.799023] [INFO ] [MAIN ] Update Progress: 448/2373 symbols completed. CIEN took 38.4s. Estimated remaining: 4h 13m 27s. Rate: 7.6 symbols/min [2025-09-24T17:59:02.996104] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T17:59:02.998548] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:03.045736] [DEBUG] [LOCAL ] CIM: Loaded 37225 existing records from primary storage. [2025-09-24T17:59:03.045871] [INFO ] [MAIN ] CIM: Loaded 37225 existing records. [2025-09-24T17:59:03.224886] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-24T17:59:03.231444] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:03.233090] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-24T17:59:03.233166] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-24T17:59:03.234969] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-24T17:59:03.235034] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-24T17:59:03.511115] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T17:59:03.628966] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:03.862897] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T17:59:03.864851] [INFO ] [REMOTE ] CIF: Full fetch complete (6607 records). [2025-09-24T17:59:03.864954] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-24T17:59:04.021361] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-24T17:59:04.287046] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-24T17:59:04.287163] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-24T17:59:04.287406] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-24T17:59:04.287449] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-24T17:59:04.288026] [DEBUG] [LOCAL ] CIF: Trimmed 6607 records to 4350 (keeping 200 days of data) [2025-09-24T17:59:04.323538] [DEBUG] [LOCAL ] CIF: Primary data saved (4350 records). [2025-09-24T17:59:04.323782] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-24T17:59:04.323969] [INFO ] [MAIN ] Update Progress: 449/2373 symbols completed. CIF took 25.2s. Estimated remaining: 4h 12m 52s. Rate: 7.6 symbols/min [2025-09-24T17:59:04.532054] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:04.538089] [DEBUG] [LOCAL ] CIMN: Loaded 2681 existing records from primary storage. [2025-09-24T17:59:04.538226] [INFO ] [MAIN ] CIMN: Loaded 2681 existing records. [2025-09-24T17:59:04.728276] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:04.728685] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-24T17:59:04.728790] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-24T17:59:04.729078] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-24T17:59:04.729155] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-24T17:59:04.826356] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-24T17:59:05.097945] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:05.583437] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T17:59:05.616034] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-24T17:59:05.636349] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T17:59:06.416114] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-24T17:59:07.189876] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T17:59:07.216048] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-24T17:59:07.431484] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T17:59:08.016114] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-24T17:59:08.630079] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T17:59:08.816179] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-24T17:59:09.180883] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T17:59:09.442047] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T17:59:09.616113] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-24T17:59:10.416094] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-24T17:59:11.136502] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T17:59:11.209787] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T17:59:11.216028] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-24T17:59:12.023879] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-24T17:59:12.035958] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T17:59:12.526033] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T17:59:12.816086] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-24T17:59:13.616057] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-24T17:59:13.667350] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T17:59:14.416092] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-24T17:59:14.795215] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-24T17:59:15.216100] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-24T17:59:15.300178] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T17:59:16.016059] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-24T17:59:16.149943] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T17:59:16.816072] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-24T17:59:17.616125] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-24T17:59:17.688998] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T17:59:17.701209] [INFO ] [REMOTE ] CIG: Full fetch complete (60851 records). [2025-09-24T17:59:17.701434] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-24T17:59:17.862767] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T17:59:17.899461] [INFO ] [REMOTE ] CII: Full fetch complete (23128 records). [2025-09-24T17:59:17.914143] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-24T17:59:18.421174] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-24T17:59:18.446721] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-24T17:59:18.458149] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-24T17:59:18.470193] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-24T17:59:18.496273] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-24T17:59:18.540325] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-24T17:59:18.540633] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-24T17:59:18.541023] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-24T17:59:18.541137] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-24T17:59:18.542141] [DEBUG] [LOCAL ] CII: Trimmed 23128 records to 15476 (keeping 200 days of data) [2025-09-24T17:59:18.543264] [DEBUG] [LOCAL ] CIG: Trimmed 60851 records to 43740 (keeping 200 days of data) [2025-09-24T17:59:18.948139] [DEBUG] [LOCAL ] CIG: Primary data saved (43740 records). [2025-09-24T17:59:18.950304] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-24T17:59:18.950163] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T17:59:18.950587] [INFO ] [MAIN ] Update Progress: 450/2373 symbols completed. CIG took 27.9s. Estimated remaining: 4h 13m 13s. Rate: 7.6 symbols/min [2025-09-24T17:59:19.067969] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T17:59:19.181749] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:19.182271] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-24T17:59:19.182677] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-24T17:59:19.183226] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-24T17:59:19.183715] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-24T17:59:19.183839] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-24T17:59:19.183906] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-24T17:59:19.219426] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-24T17:59:19.262667] [DEBUG] [LOCAL ] CII: Primary data saved (15476 records). [2025-09-24T17:59:19.269425] [INFO ] [MAIN ] CII: Full history saved. [2025-09-24T17:59:19.275763] [INFO ] [MAIN ] Update Progress: 451/2373 symbols completed. CII took 23.6s. Estimated remaining: 4h 12m 33s. Rate: 7.6 symbols/min [2025-09-24T17:59:19.580094] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:19.647183] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-24T17:59:19.678937] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-24T17:59:19.682104] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-24T17:59:19.682193] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-24T17:59:19.682254] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-24T17:59:19.682289] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-24T17:59:19.855171] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:19.900003] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-24T17:59:20.021148] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-24T17:59:20.166292] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:20.816063] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-24T17:59:20.903250] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T17:59:21.441326] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T17:59:21.616105] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-24T17:59:22.416091] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-24T17:59:22.893986] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T17:59:22.905228] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T17:59:23.216078] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-24T17:59:23.581155] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T17:59:24.016132] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-24T17:59:24.532468] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T17:59:24.816100] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-24T17:59:25.616096] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-24T17:59:25.970387] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T17:59:26.427892] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-24T17:59:26.430300] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T17:59:26.875369] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T17:59:27.216123] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-24T17:59:28.016088] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-24T17:59:28.559366] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T17:59:28.560434] [INFO ] [REMOTE ] CIMN: Full fetch complete (3901 records). [2025-09-24T17:59:28.560504] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-24T17:59:28.819388] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-24T17:59:28.871129] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T17:59:28.979323] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-24T17:59:28.979426] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-24T17:59:28.979627] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-24T17:59:28.979725] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-24T17:59:28.980179] [DEBUG] [LOCAL ] CIMN: Trimmed 3901 records to 2666 (keeping 200 days of data) [2025-09-24T17:59:29.001087] [DEBUG] [LOCAL ] CIMN: Primary data saved (2666 records). [2025-09-24T17:59:29.001220] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-24T17:59:29.001378] [INFO ] [MAIN ] Update Progress: 452/2373 symbols completed. CIMN took 24.7s. Estimated remaining: 4h 12m 33s. Rate: 7.6 symbols/min [2025-09-24T17:59:29.083934] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:29.108533] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-24T17:59:29.244906] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:29.264827] [DEBUG] [LOCAL ] CINT: Loaded 18366 existing records from primary storage. [2025-09-24T17:59:29.264951] [INFO ] [MAIN ] CINT: Loaded 18366 existing records. [2025-09-24T17:59:29.451730] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:29.452034] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-24T17:59:29.452123] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-24T17:59:29.452855] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-24T17:59:29.452917] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-24T17:59:29.627410] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-24T17:59:29.819859] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:30.181249] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T17:59:30.416089] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-24T17:59:31.216110] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-24T17:59:31.853501] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T17:59:31.854365] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T17:59:32.016092] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-24T17:59:32.549927] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T17:59:32.816133] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-24T17:59:33.155459] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T17:59:33.616098] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-24T17:59:33.983311] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-24T17:59:34.416110] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-24T17:59:34.948418] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-24T17:59:35.216113] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-24T17:59:36.016101] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-24T17:59:36.709255] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T17:59:36.720446] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T17:59:36.816149] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-24T17:59:37.078217] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:37.078557] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-24T17:59:37.616092] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-24T17:59:37.814542] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:37.814945] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-24T17:59:38.416160] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-24T17:59:39.216092] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-24T17:59:39.472711] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T17:59:40.016093] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-24T17:59:40.429051] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T17:59:40.644484] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T17:59:40.816089] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-24T17:59:41.005698] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:41.006029] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-24T17:59:41.616148] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-24T17:59:42.416123] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-24T17:59:42.476987] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T17:59:42.478773] [INFO ] [REMOTE ] CIMO: Full fetch complete (5470 records). [2025-09-24T17:59:42.478854] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-24T17:59:42.479333] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T17:59:42.479422] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:59:42.479467] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:59:42.479507] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-24T17:59:42.479590] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-24T17:59:42.479673] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-24T17:59:42.479795] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-24T17:59:42.479884] [INFO ] [MAIN ] Update Progress: 453/2373 symbols completed. CIMO took 23.5s. Estimated remaining: 4h 12m 48s. Rate: 7.6 symbols/min [2025-09-24T17:59:42.654961] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:42.656764] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:42.657346] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-24T17:59:42.680417] [DEBUG] [LOCAL ] CIO: Loaded 20138 existing records from primary storage. [2025-09-24T17:59:42.680621] [INFO ] [MAIN ] CIO: Loaded 20138 existing records. [2025-09-24T17:59:42.882957] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:42.883326] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-24T17:59:42.883380] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-24T17:59:42.884317] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-24T17:59:42.884383] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-24T17:59:43.221248] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-24T17:59:43.281682] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:43.474490] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:43.474972] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-24T17:59:44.016119] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-24T17:59:44.816154] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-24T17:59:45.298049] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T17:59:45.616056] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-24T17:59:45.750539] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T17:59:46.416092] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-24T17:59:47.084626] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T17:59:47.216091] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-24T17:59:47.432271] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T17:59:48.016124] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-24T17:59:48.199957] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:48.200365] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-24T17:59:48.816056] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-24T17:59:48.834625] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T17:59:48.842070] [INFO ] [REMOTE ] CIM: Full fetch complete (54592 records). [2025-09-24T17:59:48.842176] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-24T17:59:49.219324] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-24T17:59:49.219402] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-24T17:59:49.220066] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-24T17:59:49.220134] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-24T17:59:49.221289] [DEBUG] [LOCAL ] CIM: Trimmed 54592 records to 37312 (keeping 200 days of data) [2025-09-24T17:59:49.470014] [DEBUG] [LOCAL ] CIM: Primary data saved (37312 records). [2025-09-24T17:59:49.470275] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-24T17:59:49.470401] [INFO ] [MAIN ] Update Progress: 454/2373 symbols completed. CIM took 46.7s. Estimated remaining: 4h 12m 37s. Rate: 7.6 symbols/min [2025-09-24T17:59:49.621335] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-24T17:59:49.675100] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:49.721481] [DEBUG] [LOCAL ] CION: Loaded 29384 existing records from primary storage. [2025-09-24T17:59:49.721726] [INFO ] [MAIN ] CION: Loaded 29384 existing records. [2025-09-24T17:59:49.923254] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:49.936770] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-24T17:59:49.937596] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-24T17:59:49.938321] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T17:59:49.942826] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-24T17:59:49.943674] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-24T17:59:49.990561] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:50.032069] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-24T17:59:50.332475] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:50.416161] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-24T17:59:50.613827] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T17:59:50.614298] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-24T17:59:51.216125] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-24T17:59:51.927979] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T17:59:51.929884] [INFO ] [REMOTE ] CIMP: Full fetch complete (798 records). [2025-09-24T17:59:51.929963] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-24T17:59:52.021337] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-24T17:59:52.127236] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-24T17:59:52.127552] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T17:59:52.127626] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T17:59:52.127722] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-24T17:59:52.127798] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-24T17:59:52.127837] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-24T17:59:52.127911] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-24T17:59:52.128005] [INFO ] [MAIN ] Update Progress: 455/2373 symbols completed. CIMP took 32.8s. Estimated remaining: 4h 12m 7s. Rate: 7.6 symbols/min [2025-09-24T17:59:52.312074] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:52.381948] [DEBUG] [LOCAL ] CIVI: Loaded 52583 existing records from primary storage. [2025-09-24T17:59:52.382148] [INFO ] [MAIN ] CIVI: Loaded 52583 existing records. [2025-09-24T17:59:52.569578] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T17:59:52.569897] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-24T17:59:52.569947] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-24T17:59:52.572392] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-24T17:59:52.572456] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-24T17:59:52.816391] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-24T17:59:52.980552] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T17:59:52.986215] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T17:59:53.616104] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-24T17:59:54.268022] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T17:59:54.416071] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-24T17:59:54.476941] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T17:59:55.216154] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-24T17:59:55.391465] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T17:59:56.016114] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-24T17:59:56.816077] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-24T17:59:57.060684] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T17:59:57.085936] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T17:59:57.457402] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T17:59:57.616087] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-24T17:59:58.416128] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-24T17:59:58.694235] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T17:59:58.699128] [INFO ] [REMOTE ] CINT: Full fetch complete (26002 records). [2025-09-24T17:59:58.699233] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-24T17:59:59.098150] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-24T17:59:59.098275] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-24T17:59:59.099030] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-24T17:59:59.099097] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-24T17:59:59.099907] [DEBUG] [LOCAL ] CINT: Trimmed 26002 records to 18484 (keeping 200 days of data) [2025-09-24T17:59:59.216415] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-24T17:59:59.243604] [DEBUG] [LOCAL ] CINT: Primary data saved (18484 records). [2025-09-24T17:59:59.243868] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-24T17:59:59.243990] [INFO ] [MAIN ] Update Progress: 456/2373 symbols completed. CINT took 30.2s. Estimated remaining: 4h 11m 56s. Rate: 7.6 symbols/min [2025-09-24T17:59:59.422041] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T17:59:59.422360] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-09-24T17:59:59.422409] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-09-24T17:59:59.422574] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-24T17:59:59.422617] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-24T17:59:59.422701] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-09-24T17:59:59.422753] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-24T17:59:59.681317] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T17:59:59.843959] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:00.016188] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-24T18:00:00.323903] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T18:00:00.816129] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-24T18:00:01.616169] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-24T18:00:02.416146] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-24T18:00:02.840854] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-24T18:00:03.216202] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-24T18:00:03.821324] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-24T18:00:04.016093] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-24T18:00:05.314914] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (2.90 seconds). [2025-09-24T18:00:05.321068] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-24T18:00:05.425443] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (3.81 seconds). [2025-09-24T18:00:05.616133] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-24T18:00:05.994882] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-24T18:00:06.416059] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-24T18:00:06.551596] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (3.34 seconds). [2025-09-24T18:00:06.613044] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:00:07.012210] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T18:00:07.216070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-24T18:00:07.402197] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T18:00:08.016120] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-24T18:00:08.569273] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T18:00:08.816155] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-24T18:00:09.616100] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-24T18:00:09.836173] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T18:00:09.877433] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T18:00:10.416086] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-24T18:00:10.837001] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T18:00:11.216089] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-24T18:00:12.016093] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-24T18:00:12.473085] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T18:00:12.816064] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-24T18:00:12.959605] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T18:00:12.965427] [INFO ] [REMOTE ] CIO: Full fetch complete (28865 records). [2025-09-24T18:00:12.965634] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-24T18:00:13.411168] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-24T18:00:13.432396] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-24T18:00:13.432728] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-24T18:00:13.433399] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-24T18:00:13.433507] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-24T18:00:13.435050] [DEBUG] [LOCAL ] CIO: Trimmed 28865 records to 20031 (keeping 200 days of data) [2025-09-24T18:00:13.586253] [DEBUG] [LOCAL ] CIO: Primary data saved (20031 records). [2025-09-24T18:00:13.586392] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-24T18:00:13.586502] [INFO ] [MAIN ] Update Progress: 457/2373 symbols completed. CIO took 31.1s. Estimated remaining: 4h 12m 15s. Rate: 7.6 symbols/min [2025-09-24T18:00:13.621206] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-24T18:00:13.759211] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:13.793296] [DEBUG] [LOCAL ] CLB: Loaded 33098 existing records from primary storage. [2025-09-24T18:00:13.793434] [INFO ] [MAIN ] CLB: Loaded 33098 existing records. [2025-09-24T18:00:13.973297] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:00:13.973600] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-24T18:00:13.973684] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-24T18:00:13.974780] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-24T18:00:13.974843] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-24T18:00:14.336976] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:14.416080] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-24T18:00:15.216107] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-24T18:00:15.786034] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-24T18:00:16.016168] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-24T18:00:16.252382] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T18:00:16.723813] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T18:00:16.736385] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-24T18:00:16.816086] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-24T18:00:17.616066] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-24T18:00:17.973630] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T18:00:18.416130] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-24T18:00:18.935415] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T18:00:18.996879] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T18:00:19.216111] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-24T18:00:19.592405] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T18:00:20.016141] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-24T18:00:20.046989] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T18:00:20.816116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-24T18:00:21.616076] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-24T18:00:21.800207] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T18:00:21.839922] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T18:00:22.416128] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-24T18:00:22.793574] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T18:00:23.216177] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-24T18:00:24.016076] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-24T18:00:24.483599] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T18:00:24.545572] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T18:00:24.816092] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-24T18:00:25.455268] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T18:00:25.616121] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-24T18:00:26.347892] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:00:26.416112] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-24T18:00:26.928698] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:00:26.933691] [INFO ] [REMOTE ] CION: Full fetch complete (41105 records). [2025-09-24T18:00:26.933798] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-24T18:00:26.934394] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:00:26.934485] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:00:26.934530] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:00:26.934594] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-24T18:00:26.934691] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-09-24T18:00:26.934749] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-09-24T18:00:26.935202] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-09-24T18:00:26.935300] [INFO ] [MAIN ] Update Progress: 458/2373 symbols completed. CION took 37.5s. Estimated remaining: 4h 12m 30s. Rate: 7.6 symbols/min [2025-09-24T18:00:27.115483] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:27.128291] [DEBUG] [LOCAL ] CLCO: Loaded 12763 existing records from primary storage. [2025-09-24T18:00:27.128402] [INFO ] [MAIN ] CLCO: Loaded 12763 existing records. [2025-09-24T18:00:27.221283] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-24T18:00:27.317802] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:00:27.318043] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-24T18:00:27.318093] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-24T18:00:27.318514] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-24T18:00:27.318575] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-24T18:00:27.676488] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:28.016090] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-24T18:00:28.273195] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:00:28.283225] [INFO ] [REMOTE ] CL: Full fetch complete (77616 records). [2025-09-24T18:00:28.283376] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-24T18:00:28.678058] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-24T18:00:28.678141] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-24T18:00:28.678993] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-24T18:00:28.679058] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-24T18:00:28.680863] [DEBUG] [LOCAL ] CL: Trimmed 77616 records to 53644 (keeping 200 days of data) [2025-09-24T18:00:28.867044] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-24T18:00:29.021327] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-24T18:00:29.021504] [INFO ] [MAIN ] CL: Full history saved. [2025-09-24T18:00:29.021588] [INFO ] [MAIN ] Update Progress: 459/2373 symbols completed. CL took 29.8s. Estimated remaining: 4h 11m 57s. Rate: 7.6 symbols/min [2025-09-24T18:00:29.193912] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:29.219101] [DEBUG] [LOCAL ] CLDT: Loaded 25815 existing records from primary storage. [2025-09-24T18:00:29.219247] [INFO ] [MAIN ] CLDT: Loaded 25815 existing records. [2025-09-24T18:00:29.403136] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:00:29.403391] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-24T18:00:29.403442] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-24T18:00:29.404299] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-24T18:00:29.404362] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-24T18:00:29.755509] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:29.755874] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-24T18:00:30.190724] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-24T18:00:30.416062] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-24T18:00:30.511601] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-24T18:00:30.721418] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T18:00:31.032401] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T18:00:31.216059] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-24T18:00:32.017192] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-24T18:00:32.023785] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T18:00:32.267439] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T18:00:32.816080] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-24T18:00:33.169308] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T18:00:33.616082] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-24T18:00:34.136926] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:00:34.416089] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-24T18:00:35.216057] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-24T18:00:35.383328] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T18:00:35.393216] [INFO ] [REMOTE ] CIVI: Full fetch complete (75533 records). [2025-09-24T18:00:35.393410] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-24T18:00:35.796497] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:00:35.860726] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-24T18:00:35.860817] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-24T18:00:35.861755] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-24T18:00:35.861824] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-24T18:00:35.863377] [DEBUG] [LOCAL ] CIVI: Trimmed 75533 records to 52587 (keeping 200 days of data) [2025-09-24T18:00:36.043510] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-24T18:00:36.195141] [DEBUG] [LOCAL ] CIVI: Primary data saved (52587 records). [2025-09-24T18:00:36.195276] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-24T18:00:36.195361] [INFO ] [MAIN ] Update Progress: 460/2373 symbols completed. CIVI took 44.1s. Estimated remaining: 4h 11m 47s. Rate: 7.6 symbols/min [2025-09-24T18:00:36.377136] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:36.396249] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T18:00:36.453839] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-24T18:00:36.454030] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-24T18:00:36.641768] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:00:36.642032] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-24T18:00:36.642081] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-24T18:00:36.643466] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-24T18:00:36.643532] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-24T18:00:36.821200] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-24T18:00:37.015406] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:37.173089] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T18:00:37.616095] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-24T18:00:37.953211] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T18:00:38.416093] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-24T18:00:39.216108] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-24T18:00:39.757952] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-24T18:00:39.760103] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T18:00:40.016100] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-24T18:00:40.314993] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T18:00:40.816114] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-24T18:00:41.537080] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T18:00:41.543277] [INFO ] [REMOTE ] CLB: Full fetch complete (46334 records). [2025-09-24T18:00:41.543387] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-24T18:00:41.621605] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-24T18:00:41.933836] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-24T18:00:41.934032] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-24T18:00:41.934703] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-24T18:00:41.934821] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-24T18:00:41.935874] [DEBUG] [LOCAL ] CLB: Trimmed 46334 records to 33033 (keeping 200 days of data) [2025-09-24T18:00:42.062292] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T18:00:42.187154] [DEBUG] [LOCAL ] CLB: Primary data saved (33033 records). [2025-09-24T18:00:42.187303] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-24T18:00:42.187391] [INFO ] [MAIN ] Update Progress: 461/2373 symbols completed. CLB took 28.6s. Estimated remaining: 4h 11m 31s. Rate: 7.6 symbols/min [2025-09-24T18:00:42.355281] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:42.355512] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-09-24T18:00:42.355569] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-09-24T18:00:42.355738] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-24T18:00:42.355789] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-24T18:00:42.355833] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-24T18:00:42.355866] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-24T18:00:42.421445] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-24T18:00:42.722123] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:43.216113] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-24T18:00:43.737880] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-24T18:00:43.869674] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T18:00:44.016117] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-24T18:00:44.494323] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:00:44.816100] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-24T18:00:45.479206] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:00:45.616114] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-24T18:00:46.416119] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-24T18:00:46.741987] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T18:00:46.969636] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T18:00:47.216113] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-24T18:00:48.016106] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-24T18:00:48.633761] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T18:00:48.816080] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-24T18:00:48.873881] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-24T18:00:49.616129] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-24T18:00:49.842830] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T18:00:50.279020] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-24T18:00:50.323906] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T18:00:50.416095] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-24T18:00:51.221028] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-24T18:00:51.225071] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T18:00:52.016109] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-24T18:00:52.816091] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-24T18:00:53.061906] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T18:00:53.310457] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T18:00:53.390573] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-24T18:00:53.616115] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-24T18:00:54.416061] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-24T18:00:54.556631] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T18:00:55.216090] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-24T18:00:55.852715] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T18:00:55.855053] [INFO ] [REMOTE ] CLCO: Full fetch complete (23089 records). [2025-09-24T18:00:55.855143] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-24T18:00:56.017550] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-24T18:00:56.233295] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:00:56.304197] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-24T18:00:56.304285] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-24T18:00:56.304802] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-24T18:00:56.304865] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-24T18:00:56.305542] [DEBUG] [LOCAL ] CLCO: Trimmed 23089 records to 12868 (keeping 200 days of data) [2025-09-24T18:00:56.382659] [DEBUG] [LOCAL ] CLCO: Primary data saved (12868 records). [2025-09-24T18:00:56.382824] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-24T18:00:56.382940] [INFO ] [MAIN ] Update Progress: 462/2373 symbols completed. CLCO took 29.4s. Estimated remaining: 4h 11m 49s. Rate: 7.6 symbols/min [2025-09-24T18:00:56.577140] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:00:56.591380] [DEBUG] [LOCAL ] CLPR: Loaded 11559 existing records from primary storage. [2025-09-24T18:00:56.591522] [INFO ] [MAIN ] CLPR: Loaded 11559 existing records. [2025-09-24T18:00:56.773583] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:00:56.773912] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-24T18:00:56.773969] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-24T18:00:56.774409] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-24T18:00:56.774481] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-24T18:00:56.821240] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-24T18:00:57.159282] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:00:57.616151] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-24T18:00:58.120378] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T18:00:58.343431] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-24T18:00:58.416121] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-24T18:00:58.783324] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T18:00:59.216095] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-24T18:00:59.293973] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T18:01:00.016115] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-24T18:01:00.336894] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T18:01:00.816124] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-24T18:01:01.616143] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-24T18:01:02.240951] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T18:01:02.430089] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-24T18:01:02.435501] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-24T18:01:03.131222] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T18:01:03.137522] [INFO ] [REMOTE ] CLDT: Full fetch complete (36892 records). [2025-09-24T18:01:03.137710] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-24T18:01:03.138493] [FATAL] [VALIDATOR ] CLDT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:01:03.138596] [FATAL] [MAIN ] CLDT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:01:03.138682] [WARN ] [MAIN ] CLDT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:01:03.138792] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-24T18:01:03.138946] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-09-24T18:01:03.139029] [INFO ] [LOCAL ] CLDT: Starting deletion of derivative data. [2025-09-24T18:01:03.139627] [DEBUG] [LOCAL ] CLDT: Deleted derivative data file. [2025-09-24T18:01:03.139794] [INFO ] [MAIN ] Update Progress: 463/2373 symbols completed. CLDT took 34.1s. Estimated remaining: 4h 11m 36s. Rate: 7.6 symbols/min [2025-09-24T18:01:03.221177] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-24T18:01:03.321488] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:03.382926] [DEBUG] [LOCAL ] CLS: Loaded 53638 existing records from primary storage. [2025-09-24T18:01:03.383071] [INFO ] [MAIN ] CLS: Loaded 53638 existing records. [2025-09-24T18:01:03.589639] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T18:01:03.593914] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:03.598557] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-24T18:01:03.598631] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-24T18:01:03.600092] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-24T18:01:03.600153] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-24T18:01:03.964830] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:04.016053] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-24T18:01:04.492508] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T18:01:04.816085] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-24T18:01:05.616247] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-24T18:01:06.037344] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-24T18:01:06.181829] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T18:01:06.186969] [INFO ] [REMOTE ] CLH: Full fetch complete (41836 records). [2025-09-24T18:01:06.187129] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-24T18:01:06.424578] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-24T18:01:06.582589] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-24T18:01:06.582698] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-24T18:01:06.583287] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-24T18:01:06.583381] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-24T18:01:06.584295] [DEBUG] [LOCAL ] CLH: Trimmed 41836 records to 28056 (keeping 200 days of data) [2025-09-24T18:01:06.763541] [DEBUG] [LOCAL ] CLH: Primary data saved (28056 records). [2025-09-24T18:01:06.763709] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-24T18:01:06.763841] [INFO ] [MAIN ] Update Progress: 464/2373 symbols completed. CLH took 24.6s. Estimated remaining: 4h 11m 11s. Rate: 7.6 symbols/min [2025-09-24T18:01:06.941824] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:06.996251] [DEBUG] [LOCAL ] CLVT: Loaded 51969 existing records from primary storage. [2025-09-24T18:01:06.996392] [INFO ] [MAIN ] CLVT: Loaded 51969 existing records. [2025-09-24T18:01:07.179191] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:07.179509] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-24T18:01:07.179572] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-24T18:01:07.180993] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-24T18:01:07.181068] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-24T18:01:07.224172] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-24T18:01:07.454956] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T18:01:07.606825] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:07.646415] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T18:01:08.016082] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-24T18:01:08.816116] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-24T18:01:08.859261] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T18:01:09.189254] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T18:01:09.616125] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-24T18:01:10.402755] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T18:01:10.416024] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-24T18:01:10.519029] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T18:01:11.216132] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-24T18:01:12.016044] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-24T18:01:12.089251] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T18:01:12.816152] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-24T18:01:13.417190] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T18:01:13.499368] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-24T18:01:13.616148] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-24T18:01:14.186904] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T18:01:14.217208] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-24T18:01:14.416096] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-24T18:01:15.216135] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-24T18:01:16.016098] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-24T18:01:16.489142] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T18:01:16.500543] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-09-24T18:01:16.500752] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-24T18:01:16.501928] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:01:16.502025] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:01:16.502080] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:01:16.502154] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-24T18:01:16.502222] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-24T18:01:16.502270] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-09-24T18:01:16.502677] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-09-24T18:01:16.502823] [INFO ] [MAIN ] Update Progress: 465/2373 symbols completed. CLF took 40.3s. Estimated remaining: 4h 11m 10s. Rate: 7.6 symbols/min [2025-09-24T18:01:16.684361] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:16.706560] [DEBUG] [LOCAL ] CLW: Loaded 21956 existing records from primary storage. [2025-09-24T18:01:16.706716] [INFO ] [MAIN ] CLW: Loaded 21956 existing records. [2025-09-24T18:01:16.824597] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-24T18:01:16.902345] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:16.903264] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-24T18:01:16.903359] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-24T18:01:16.904341] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-24T18:01:16.904434] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-24T18:01:17.042061] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T18:01:17.316050] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:17.616074] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-24T18:01:17.690474] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T18:01:18.380844] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-24T18:01:18.416051] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-24T18:01:19.216051] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-24T18:01:19.452321] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T18:01:20.016134] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-24T18:01:20.046847] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T18:01:20.816135] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-24T18:01:20.901761] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-24T18:01:21.324598] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T18:01:21.511806] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:01:21.616112] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-24T18:01:22.416113] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-24T18:01:23.039921] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T18:01:23.042327] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T18:01:23.052230] [INFO ] [REMOTE ] CLPR: Full fetch complete (17718 records). [2025-09-24T18:01:23.052902] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-24T18:01:23.221348] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-24T18:01:23.495389] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-24T18:01:23.495568] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-24T18:01:23.496284] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-24T18:01:23.496383] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-24T18:01:23.497558] [DEBUG] [LOCAL ] CLPR: Trimmed 17718 records to 11546 (keeping 200 days of data) [2025-09-24T18:01:23.584826] [DEBUG] [LOCAL ] CLPR: Primary data saved (11546 records). [2025-09-24T18:01:23.585058] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-24T18:01:23.585199] [INFO ] [MAIN ] Update Progress: 466/2373 symbols completed. CLPR took 27.2s. Estimated remaining: 4h 10m 59s. Rate: 7.6 symbols/min [2025-09-24T18:01:23.834344] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:23.834712] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-09-24T18:01:23.834776] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-09-24T18:01:23.835068] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-24T18:01:23.835159] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-24T18:01:23.835248] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-24T18:01:23.835382] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-24T18:01:24.021319] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-24T18:01:24.298234] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:24.585244] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T18:01:24.816137] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-24T18:01:25.432336] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:01:25.616119] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-24T18:01:25.896931] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T18:01:26.416181] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-24T18:01:27.216142] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-24T18:01:27.856280] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-24T18:01:28.016100] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-24T18:01:28.271285] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T18:01:28.816083] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-24T18:01:28.953680] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T18:01:29.616128] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-24T18:01:30.182337] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-24T18:01:30.223444] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T18:01:30.416089] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-24T18:01:31.216051] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-24T18:01:31.483808] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T18:01:31.669681] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T18:01:32.016080] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-24T18:01:32.816160] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-24T18:01:33.354680] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-24T18:01:33.616121] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-24T18:01:33.821698] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T18:01:33.957498] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T18:01:34.416083] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-24T18:01:35.216064] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-24T18:01:35.306122] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T18:01:36.016146] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-24T18:01:36.733568] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T18:01:36.816063] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-24T18:01:36.908218] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T18:01:37.616067] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-24T18:01:37.762432] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T18:01:37.763867] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T18:01:38.416152] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-24T18:01:39.216065] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-24T18:01:39.354171] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:01:39.363138] [INFO ] [REMOTE ] CLVT: Full fetch complete (75225 records). [2025-09-24T18:01:39.363268] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-24T18:01:39.764987] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-24T18:01:39.765082] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-24T18:01:39.765957] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-24T18:01:39.766028] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-24T18:01:39.767623] [DEBUG] [LOCAL ] CLVT: Trimmed 75225 records to 51953 (keeping 200 days of data) [2025-09-24T18:01:40.041679] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-24T18:01:40.087084] [DEBUG] [LOCAL ] CLVT: Primary data saved (51953 records). [2025-09-24T18:01:40.087237] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-24T18:01:40.087357] [INFO ] [MAIN ] Update Progress: 467/2373 symbols completed. CLVT took 33.3s. Estimated remaining: 4h 11m 26s. Rate: 7.6 symbols/min [2025-09-24T18:01:40.277580] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:40.287327] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T18:01:40.340457] [DEBUG] [LOCAL ] CM: Loaded 48632 existing records from primary storage. [2025-09-24T18:01:40.340614] [INFO ] [MAIN ] CM: Loaded 48632 existing records. [2025-09-24T18:01:40.528272] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:40.528735] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-24T18:01:40.528931] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-24T18:01:40.530398] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-24T18:01:40.530463] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-24T18:01:40.821072] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-24T18:01:40.937389] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:40.933224] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-24T18:01:41.616072] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-24T18:01:42.130912] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T18:01:42.416059] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-24T18:01:42.702025] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-24T18:01:42.715885] [INFO ] [REMOTE ] CLS: Full fetch complete (77448 records). [2025-09-24T18:01:42.716061] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-24T18:01:43.185135] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-24T18:01:43.185242] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-24T18:01:43.186111] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-24T18:01:43.186192] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-24T18:01:43.197354] [DEBUG] [LOCAL ] CLS: Trimmed 77448 records to 53636 (keeping 200 days of data) [2025-09-24T18:01:43.215333] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T18:01:43.226013] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-24T18:01:43.547158] [DEBUG] [LOCAL ] CLS: Primary data saved (53636 records). [2025-09-24T18:01:43.547302] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-24T18:01:43.549501] [INFO ] [MAIN ] Update Progress: 468/2373 symbols completed. CLS took 40.4s. Estimated remaining: 4h 11m 0s. Rate: 7.6 symbols/min [2025-09-24T18:01:43.719962] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:43.773729] [DEBUG] [LOCAL ] CMA: Loaded 50140 existing records from primary storage. [2025-09-24T18:01:43.773917] [INFO ] [MAIN ] CMA: Loaded 50140 existing records. [2025-09-24T18:01:43.950844] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:43.951117] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-24T18:01:43.951166] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-24T18:01:43.952403] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-24T18:01:43.952464] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-24T18:01:44.026771] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-24T18:01:44.338490] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:44.515083] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-24T18:01:44.516086] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T18:01:44.531085] [INFO ] [REMOTE ] CLW: Full fetch complete (35196 records). [2025-09-24T18:01:44.531179] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-24T18:01:44.821343] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-24T18:01:44.933932] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-24T18:01:44.934020] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-24T18:01:44.934575] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-24T18:01:44.934618] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-24T18:01:44.935398] [DEBUG] [LOCAL ] CLW: Trimmed 35196 records to 21898 (keeping 200 days of data) [2025-09-24T18:01:45.081116] [DEBUG] [LOCAL ] CLW: Primary data saved (21898 records). [2025-09-24T18:01:45.081258] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-24T18:01:45.081349] [INFO ] [MAIN ] Update Progress: 469/2373 symbols completed. CLW took 28.6s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-24T18:01:45.266955] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:45.267913] [DEBUG] [LOCAL ] CMBT: No existing data file found in primary storage. [2025-09-24T18:01:45.267980] [WARN ] [MAIN ] CMBT: No existing data found, performing full refresh instead. [2025-09-24T18:01:45.268156] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-24T18:01:45.268208] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-24T18:01:45.268252] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-24T18:01:45.268285] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-24T18:01:45.619389] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-24T18:01:45.641781] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:45.759719] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:01:46.416090] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-24T18:01:46.665875] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T18:01:47.141778] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T18:01:47.216087] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-24T18:01:47.404681] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T18:01:48.016131] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-24T18:01:48.257702] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T18:01:48.816124] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-24T18:01:49.623116] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-24T18:01:49.629381] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T18:01:50.160271] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T18:01:50.416160] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-24T18:01:51.216088] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-24T18:01:51.303699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T18:01:51.563333] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T18:01:52.016125] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-24T18:01:52.774200] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T18:01:52.816094] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-24T18:01:53.616121] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-24T18:01:54.035980] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T18:01:54.195833] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T18:01:54.416080] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-24T18:01:55.216056] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-24T18:01:55.365170] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:01:55.510071] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T18:01:56.016082] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-24T18:01:56.725704] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T18:01:56.816092] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-24T18:01:57.616093] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-24T18:01:57.968793] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T18:01:57.978755] [INFO ] [REMOTE ] CLX: Full fetch complete (72914 records). [2025-09-24T18:01:57.978939] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-24T18:01:58.418381] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-24T18:01:58.437904] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-24T18:01:58.439015] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-24T18:01:58.440052] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-24T18:01:58.440373] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-24T18:01:58.442436] [DEBUG] [LOCAL ] CLX: Trimmed 72914 records to 51425 (keeping 200 days of data) [2025-09-24T18:01:58.472846] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T18:01:58.814668] [DEBUG] [LOCAL ] CLX: Primary data saved (51425 records). [2025-09-24T18:01:58.814828] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-24T18:01:58.814907] [INFO ] [MAIN ] Update Progress: 470/2373 symbols completed. CLX took 35.2s. Estimated remaining: 4h 10m 42s. Rate: 7.6 symbols/min [2025-09-24T18:01:58.989706] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:01:59.036394] [DEBUG] [LOCAL ] CMC: Loaded 45728 existing records from primary storage. [2025-09-24T18:01:59.036568] [INFO ] [MAIN ] CMC: Loaded 45728 existing records. [2025-09-24T18:01:59.219833] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-24T18:01:59.228191] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:01:59.228603] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-24T18:01:59.228698] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-24T18:01:59.230048] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-24T18:01:59.230117] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-24T18:01:59.614486] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:01:59.616213] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T18:01:59.650299] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T18:02:00.016075] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-24T18:02:00.705167] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T18:02:00.816078] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-24T18:02:01.616572] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T18:02:01.616681] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-24T18:02:02.416042] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-24T18:02:02.738986] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T18:02:02.855465] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T18:02:03.216100] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-24T18:02:03.947305] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:02:04.016098] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-24T18:02:04.816070] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-24T18:02:04.909777] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:02:05.616085] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-24T18:02:05.622465] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:02:05.770010] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:02:06.416099] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-24T18:02:07.079862] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:02:07.216085] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-24T18:02:07.474876] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T18:02:08.016136] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-24T18:02:08.816118] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-24T18:02:08.979344] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T18:02:09.451508] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:02:09.616124] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-24T18:02:10.416066] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-24T18:02:10.502500] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T18:02:11.216032] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-24T18:02:11.493969] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T18:02:11.548276] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T18:02:11.556907] [INFO ] [REMOTE ] CM: Full fetch complete (69055 records). [2025-09-24T18:02:11.557046] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-24T18:02:11.557866] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:02:11.557981] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:02:11.558025] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:02:11.558064] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-24T18:02:11.558121] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-24T18:02:11.558156] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-24T18:02:11.558591] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-09-24T18:02:11.558717] [INFO ] [MAIN ] Update Progress: 471/2373 symbols completed. CM took 31.5s. Estimated remaining: 4h 10m 54s. Rate: 7.6 symbols/min [2025-09-24T18:02:11.748992] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:11.755137] [DEBUG] [LOCAL ] CMCM: Loaded 4730 existing records from primary storage. [2025-09-24T18:02:11.755234] [INFO ] [MAIN ] CMCM: Loaded 4730 existing records. [2025-09-24T18:02:11.947278] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:02:11.947525] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-24T18:02:11.947572] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-24T18:02:11.947942] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-24T18:02:11.948006] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-24T18:02:12.025880] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-24T18:02:12.320138] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:12.816098] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-24T18:02:13.126967] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:02:13.139209] [INFO ] [REMOTE ] CMA: Full fetch complete (73326 records). [2025-09-24T18:02:13.139392] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-24T18:02:13.534950] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-24T18:02:13.535054] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-24T18:02:13.535985] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-24T18:02:13.536071] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-24T18:02:13.537894] [DEBUG] [LOCAL ] CMA: Trimmed 73326 records to 50097 (keeping 200 days of data) [2025-09-24T18:02:13.620438] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-24T18:02:13.670949] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T18:02:13.672392] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T18:02:13.900345] [DEBUG] [LOCAL ] CMA: Primary data saved (50097 records). [2025-09-24T18:02:13.900488] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-24T18:02:13.901032] [INFO ] [MAIN ] Update Progress: 472/2373 symbols completed. CMA took 30.4s. Estimated remaining: 4h 10m 24s. Rate: 7.6 symbols/min [2025-09-24T18:02:14.075793] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:14.075974] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-24T18:02:14.076014] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-24T18:02:14.076170] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-24T18:02:14.076231] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-24T18:02:14.076275] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-24T18:02:14.076310] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-24T18:02:14.424428] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-24T18:02:14.471549] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:14.976890] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T18:02:15.066629] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:02:15.216066] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-24T18:02:16.016114] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-24T18:02:16.774059] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T18:02:16.816051] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-24T18:02:17.129895] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:02:17.138553] [INFO ] [REMOTE ] CMBT: Full fetch complete (29253 records). [2025-09-24T18:02:17.138683] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-24T18:02:17.460296] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T18:02:17.552027] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-24T18:02:17.552115] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-24T18:02:17.552681] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-24T18:02:17.552746] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-24T18:02:17.553479] [DEBUG] [LOCAL ] CMBT: Trimmed 29253 records to 22204 (keeping 200 days of data) [2025-09-24T18:02:17.637291] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-24T18:02:17.688344] [DEBUG] [LOCAL ] CMBT: Primary data saved (22204 records). [2025-09-24T18:02:17.688477] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-24T18:02:17.688553] [INFO ] [MAIN ] Update Progress: 473/2373 symbols completed. CMBT took 32.6s. Estimated remaining: 4h 9m 59s. Rate: 7.6 symbols/min [2025-09-24T18:02:17.859488] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:17.915436] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-24T18:02:17.915591] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-09-24T18:02:18.098855] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:02:18.099164] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-24T18:02:18.099242] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-24T18:02:18.100378] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-24T18:02:18.100439] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-24T18:02:18.421155] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-24T18:02:18.466580] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:18.664319] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:02:18.664705] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-24T18:02:19.216065] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-24T18:02:19.244091] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T18:02:19.723917] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-24T18:02:20.016109] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-24T18:02:20.816139] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-24T18:02:21.013422] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:02:21.013773] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-24T18:02:21.616171] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-24T18:02:22.066954] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T18:02:22.340949] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-24T18:02:22.416135] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-24T18:02:22.974720] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-24T18:02:23.216119] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-24T18:02:24.016103] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-24T18:02:24.680964] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T18:02:24.816113] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-24T18:02:24.824577] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T18:02:25.616118] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-24T18:02:25.807024] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:02:25.807353] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-24T18:02:26.392327] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T18:02:26.416032] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-24T18:02:27.216133] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-24T18:02:27.602442] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-24T18:02:27.821821] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T18:02:28.016146] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-24T18:02:28.212425] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:02:28.212805] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-24T18:02:28.816116] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-24T18:02:29.616105] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-24T18:02:29.822465] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:02:29.822850] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-24T18:02:30.416172] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-24T18:02:31.034701] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-24T18:02:31.097677] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T18:02:31.100004] [INFO ] [REMOTE ] CMCM: Full fetch complete (7057 records). [2025-09-24T18:02:31.100091] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-24T18:02:31.221173] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-24T18:02:31.478163] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-24T18:02:31.478242] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-24T18:02:31.478488] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-24T18:02:31.478535] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-24T18:02:31.478967] [DEBUG] [LOCAL ] CMCM: Trimmed 7057 records to 4756 (keeping 200 days of data) [2025-09-24T18:02:31.511058] [DEBUG] [LOCAL ] CMCM: Primary data saved (4756 records). [2025-09-24T18:02:31.511195] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-24T18:02:31.511281] [INFO ] [MAIN ] Update Progress: 474/2373 symbols completed. CMCM took 20.0s. Estimated remaining: 4h 10m 15s. Rate: 7.6 symbols/min [2025-09-24T18:02:31.684774] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:31.730106] [DEBUG] [LOCAL ] CMI: Loaded 41900 existing records from primary storage. [2025-09-24T18:02:31.730251] [INFO ] [MAIN ] CMI: Loaded 41900 existing records. [2025-09-24T18:02:31.912168] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:02:31.912400] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-24T18:02:31.912447] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-24T18:02:31.913445] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-24T18:02:31.913507] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-24T18:02:32.021248] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-24T18:02:32.306544] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:32.318285] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T18:02:32.816089] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-24T18:02:33.616051] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-24T18:02:33.846861] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:02:33.866544] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T18:02:33.866045] [INFO ] [REMOTE ] CMC: Full fetch complete (66898 records). [2025-09-24T18:02:33.870461] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-24T18:02:34.280020] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-24T18:02:34.280159] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-24T18:02:34.280945] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-24T18:02:34.281009] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-24T18:02:34.282364] [DEBUG] [LOCAL ] CMC: Trimmed 66898 records to 45646 (keeping 200 days of data) [2025-09-24T18:02:34.459503] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-24T18:02:34.565042] [DEBUG] [LOCAL ] CMC: Primary data saved (45646 records). [2025-09-24T18:02:34.565197] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-24T18:02:34.565309] [INFO ] [MAIN ] Update Progress: 475/2373 symbols completed. CMC took 35.8s. Estimated remaining: 4h 9m 48s. Rate: 7.6 symbols/min [2025-09-24T18:02:34.744129] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:34.744340] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-09-24T18:02:34.744383] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-09-24T18:02:34.744534] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-24T18:02:34.744579] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-24T18:02:34.744626] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-24T18:02:34.744695] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-24T18:02:35.118504] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:35.216052] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-24T18:02:35.375795] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T18:02:35.970583] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-24T18:02:36.016058] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-24T18:02:36.824280] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-24T18:02:36.829507] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T18:02:37.616051] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-24T18:02:38.126186] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T18:02:38.284919] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:02:38.416116] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-24T18:02:39.149403] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:02:39.205713] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T18:02:39.216069] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-24T18:02:40.016102] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-24T18:02:40.816118] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-24T18:02:41.290614] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-24T18:02:41.380331] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:02:41.616111] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-24T18:02:42.111580] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T18:02:42.416127] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-24T18:02:43.216103] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-24T18:02:43.461894] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T18:02:43.465310] [INFO ] [REMOTE ] CMDB: Full fetch complete (10699 records). [2025-09-24T18:02:43.465675] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-24T18:02:43.466444] [FATAL] [VALIDATOR ] CMDB: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:02:43.466697] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:02:43.466884] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:02:43.466966] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-24T18:02:43.467074] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-24T18:02:43.467135] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-24T18:02:43.467204] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-24T18:02:43.467291] [INFO ] [MAIN ] Update Progress: 476/2373 symbols completed. CMDB took 29.6s. Estimated remaining: 4h 9m 44s. Rate: 7.6 symbols/min [2025-09-24T18:02:43.679738] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:02:43.679986] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-09-24T18:02:43.680044] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-09-24T18:02:43.680238] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-24T18:02:43.680297] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-24T18:02:43.680345] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-24T18:02:43.680389] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-24T18:02:43.908167] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-24T18:02:44.031748] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-24T18:02:44.137146] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:02:44.814684] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:02:44.822518] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-24T18:02:45.616102] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-24T18:02:46.219989] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T18:02:46.284051] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-24T18:02:46.416112] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-24T18:02:47.090534] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T18:02:47.216081] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-24T18:02:48.021316] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-24T18:02:48.033995] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T18:02:48.816114] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-24T18:02:49.046015] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T18:02:49.481757] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T18:02:49.616092] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-24T18:02:50.194795] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T18:02:50.416122] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-24T18:02:51.207358] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T18:02:51.216612] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-24T18:02:52.016145] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-24T18:02:52.413355] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T18:02:52.664277] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T18:02:52.816087] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-24T18:02:53.377581] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T18:02:53.616089] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-24T18:02:54.260967] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T18:02:54.416125] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-24T18:02:55.018740] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T18:02:55.216091] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-24T18:02:55.903916] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T18:02:56.016102] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-24T18:02:56.816090] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-24T18:02:57.572928] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T18:02:57.616061] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-24T18:02:57.711881] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-24T18:02:58.416152] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-24T18:02:58.624819] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T18:02:58.912833] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:02:59.216119] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-24T18:02:59.739912] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T18:03:00.016130] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-24T18:03:00.756551] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T18:03:00.762110] [INFO ] [REMOTE ] CMP: Full fetch complete (52888 records). [2025-09-24T18:03:00.762309] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-24T18:03:00.763552] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:03:00.763681] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:03:00.763739] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:03:00.763830] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-24T18:03:00.763945] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-24T18:03:00.764014] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-24T18:03:00.764086] [DEBUG] [LOCAL ] CMP: No derivative data file found to delete. [2025-09-24T18:03:00.764182] [INFO ] [MAIN ] Update Progress: 477/2373 symbols completed. CMP took 26.2s. Estimated remaining: 4h 10m 13s. Rate: 7.6 symbols/min [2025-09-24T18:03:00.816084] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-24T18:03:01.616147] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-24T18:03:02.478789] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T18:03:02.489330] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-24T18:03:02.600580] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-24T18:03:02.612601] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-24T18:03:02.612870] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-24T18:03:03.091455] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-24T18:03:03.091689] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-24T18:03:03.093048] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-24T18:03:03.093164] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-24T18:03:03.099892] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-09-24T18:03:03.452289] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-09-24T18:03:03.452473] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-24T18:03:03.452724] [INFO ] [MAIN ] Update Progress: 478/2373 symbols completed. CMG took 45.8s. Estimated remaining: 4h 9m 45s. Rate: 7.6 symbols/min [2025-09-24T18:03:06.194286] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (4.58 seconds). [2025-09-24T18:03:06.206220] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-24T18:03:06.245680] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-09-24T18:03:06.255819] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-24T18:03:07.667442] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T18:03:07.678546] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-24T18:03:07.932879] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:03:07.942727] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-24T18:03:09.464066] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T18:03:09.472223] [INFO ] [REMOTE ] CMPO: Full fetch complete (58994 records). [2025-09-24T18:03:09.472459] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-24T18:03:09.863536] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T18:03:09.933134] [INFO ] [REMOTE ] CMI: Full fetch complete (59599 records). [2025-09-24T18:03:09.949563] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-24T18:03:09.971154] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-09-24T18:03:09.971272] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-09-24T18:03:09.972046] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-09-24T18:03:09.972141] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-09-24T18:03:09.972678] [FATAL] [VALIDATOR ] CMI: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:03:09.973032] [FATAL] [MAIN ] CMI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:03:09.973236] [WARN ] [MAIN ] CMI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:03:09.973488] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-24T18:03:09.973757] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-09-24T18:03:09.973945] [DEBUG] [LOCAL ] CMPO: Trimmed 58994 records to 39590 (keeping 200 days of data) [2025-09-24T18:03:09.973865] [INFO ] [LOCAL ] CMI: Starting deletion of derivative data. [2025-09-24T18:03:09.975128] [DEBUG] [LOCAL ] CMI: Deleted derivative data file. [2025-09-24T18:03:09.975304] [INFO ] [MAIN ] Update Progress: 479/2373 symbols completed. CMI took 38.5s. Estimated remaining: 4h 9m 31s. Rate: 7.6 symbols/min [2025-09-24T18:03:10.250438] [DEBUG] [LOCAL ] CMPO: Primary data saved (39590 records). [2025-09-24T18:03:10.250762] [INFO ] [MAIN ] CMPO: Full history saved. [2025-09-24T18:03:10.250924] [INFO ] [MAIN ] Update Progress: 480/2373 symbols completed. CMPO took 26.8s. Estimated remaining: 4h 8m 53s. Rate: 7.6 symbols/min [2025-09-24T18:03:10.874295] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:11.038918] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:11.089230] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:11.107921] [DEBUG] [LOCAL ] CMSC: Loaded 5090 existing records from primary storage. [2025-09-24T18:03:11.132705] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:11.132910] [INFO ] [MAIN ] CMSC: Loaded 5090 existing records. [2025-09-24T18:03:11.198428] [DEBUG] [LOCAL ] CMSA: Loaded 3391 existing records from primary storage. [2025-09-24T18:03:11.210062] [INFO ] [MAIN ] CMSA: Loaded 3391 existing records. [2025-09-24T18:03:11.512358] [DEBUG] [LOCAL ] CMRE: Loaded 35502 existing records from primary storage. [2025-09-24T18:03:11.546897] [INFO ] [MAIN ] CMRE: Loaded 35502 existing records. [2025-09-24T18:03:11.646594] [DEBUG] [LOCAL ] CMS: Loaded 52611 existing records from primary storage. [2025-09-24T18:03:11.687117] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:11.719940] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:11.714912] [INFO ] [MAIN ] CMS: Loaded 52611 existing records. [2025-09-24T18:03:11.720063] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-24T18:03:11.761620] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-24T18:03:11.740832] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-24T18:03:11.786183] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-24T18:03:11.850791] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-24T18:03:11.850922] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-24T18:03:11.856286] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-24T18:03:11.851032] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-24T18:03:12.175749] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:12.203131] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:12.218960] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-24T18:03:12.247528] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-24T18:03:12.274731] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-24T18:03:12.265534] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-24T18:03:12.296178] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-24T18:03:12.290920] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-24T18:03:12.396627] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-24T18:03:12.585706] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-24T18:03:13.138251] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:13.133002] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:13.162491] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-24T18:03:13.177613] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-24T18:03:13.602445] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:13.609175] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-24T18:03:13.651158] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:13.652014] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-24T18:03:14.005028] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T18:03:14.006835] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-24T18:03:14.102053] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-24T18:03:14.103847] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-24T18:03:14.616698] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T18:03:14.618704] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-24T18:03:14.724205] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T18:03:14.730066] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-24T18:03:14.762052] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T18:03:14.763781] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-24T18:03:15.091615] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T18:03:15.092916] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-24T18:03:15.415872] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T18:03:15.417922] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T18:03:15.419585] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-24T18:03:15.432827] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-24T18:03:15.822379] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T18:03:16.016128] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-24T18:03:16.919282] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-24T18:03:16.927434] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-24T18:03:17.684931] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:03:17.686756] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-24T18:03:17.810696] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-24T18:03:18.074711] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-24T18:03:18.114609] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-24T18:03:18.416107] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-24T18:03:18.869354] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T18:03:19.216124] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-24T18:03:19.338278] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T18:03:19.794428] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T18:03:20.016160] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-24T18:03:20.638021] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T18:03:20.816129] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-24T18:03:21.405554] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T18:03:21.616163] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-24T18:03:22.416131] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-24T18:03:23.099925] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T18:03:23.216048] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-24T18:03:23.299298] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T18:03:23.797197] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T18:03:24.016104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-24T18:03:24.709090] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T18:03:24.816090] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-24T18:03:25.616108] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-24T18:03:26.158001] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T18:03:26.416105] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-24T18:03:26.731436] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:03:27.216095] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-24T18:03:27.878338] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T18:03:28.016130] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-24T18:03:28.810796] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T18:03:28.811961] [INFO ] [REMOTE ] CMSA: Full fetch complete (5021 records). [2025-09-24T18:03:28.812037] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-24T18:03:28.812419] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:03:28.812550] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:03:28.812638] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:03:28.812876] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-24T18:03:28.812961] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-09-24T18:03:28.813002] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-09-24T18:03:28.813395] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-09-24T18:03:28.813537] [INFO ] [MAIN ] Update Progress: 481/2373 symbols completed. CMSA took 18.6s. Estimated remaining: 4h 9m 27s. Rate: 7.6 symbols/min [2025-09-24T18:03:28.819681] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-24T18:03:29.010812] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:29.024595] [DEBUG] [LOCAL ] CMSD: Loaded 8098 existing records from primary storage. [2025-09-24T18:03:29.024738] [INFO ] [MAIN ] CMSD: Loaded 8098 existing records. [2025-09-24T18:03:29.204914] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:29.205261] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-24T18:03:29.205334] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-24T18:03:29.206082] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-24T18:03:29.206143] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-24T18:03:29.535023] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-24T18:03:29.616071] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:29.616368] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-24T18:03:29.620419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T18:03:29.623876] [INFO ] [REMOTE ] CMSC: Full fetch complete (7173 records). [2025-09-24T18:03:29.623977] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-24T18:03:30.000612] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-24T18:03:30.000743] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-24T18:03:30.000965] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-24T18:03:30.001008] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-24T18:03:30.001517] [DEBUG] [LOCAL ] CMSC: Trimmed 7173 records to 5072 (keeping 200 days of data) [2025-09-24T18:03:30.032430] [DEBUG] [LOCAL ] CMSC: Primary data saved (5072 records). [2025-09-24T18:03:30.032568] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-24T18:03:30.032678] [INFO ] [MAIN ] Update Progress: 482/2373 symbols completed. CMSC took 19.8s. Estimated remaining: 4h 8m 53s. Rate: 7.6 symbols/min [2025-09-24T18:03:30.203623] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:30.248126] [DEBUG] [LOCAL ] CMTG: Loaded 37485 existing records from primary storage. [2025-09-24T18:03:30.248301] [INFO ] [MAIN ] CMTG: Loaded 37485 existing records. [2025-09-24T18:03:30.424547] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-24T18:03:30.429796] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:30.431007] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-24T18:03:30.431059] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-24T18:03:30.432116] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-24T18:03:30.432180] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-24T18:03:30.832520] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:31.216110] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-24T18:03:31.437836] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T18:03:32.021213] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-24T18:03:32.042231] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T18:03:32.254992] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T18:03:32.816126] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-24T18:03:33.616071] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-24T18:03:33.703277] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T18:03:33.769123] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:03:34.416158] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-24T18:03:34.772723] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T18:03:35.216094] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-24T18:03:36.011679] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T18:03:36.023121] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-24T18:03:36.200460] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T18:03:36.816115] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-24T18:03:37.109262] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T18:03:37.550463] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T18:03:37.616091] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-24T18:03:38.416146] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-24T18:03:39.216070] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-24T18:03:39.243512] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T18:03:39.841297] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T18:03:40.016058] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-24T18:03:40.816068] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-24T18:03:41.018444] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T18:03:41.335371] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:03:41.616084] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-24T18:03:42.363224] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T18:03:42.416030] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-24T18:03:42.913892] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:03:43.216074] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-24T18:03:43.882364] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T18:03:43.983070] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T18:03:44.016078] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-24T18:03:44.816120] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-24T18:03:45.361519] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T18:03:45.616075] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-24T18:03:46.265441] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T18:03:46.271629] [INFO ] [REMOTE ] CMRE: Full fetch complete (49514 records). [2025-09-24T18:03:46.271806] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-24T18:03:46.424123] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-24T18:03:46.677560] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-24T18:03:46.677676] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-24T18:03:46.678400] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-24T18:03:46.678464] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-24T18:03:46.679757] [DEBUG] [LOCAL ] CMRE: Trimmed 49514 records to 35469 (keeping 200 days of data) [2025-09-24T18:03:46.906070] [DEBUG] [LOCAL ] CMRE: Primary data saved (35469 records). [2025-09-24T18:03:46.906220] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-24T18:03:46.906308] [INFO ] [MAIN ] Update Progress: 483/2373 symbols completed. CMRE took 36.7s. Estimated remaining: 4h 9m 20s. Rate: 7.6 symbols/min [2025-09-24T18:03:47.076854] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:47.085299] [DEBUG] [LOCAL ] CMU: Loaded 7381 existing records from primary storage. [2025-09-24T18:03:47.085399] [INFO ] [MAIN ] CMU: Loaded 7381 existing records. [2025-09-24T18:03:47.229727] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-24T18:03:47.277534] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:47.277970] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-24T18:03:47.278026] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-24T18:03:47.278420] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-24T18:03:47.278482] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-24T18:03:47.598681] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T18:03:47.783297] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T18:03:47.787548] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:47.797716] [INFO ] [REMOTE ] CMS: Full fetch complete (76008 records). [2025-09-24T18:03:47.797883] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-24T18:03:48.025288] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-24T18:03:48.224145] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-24T18:03:48.224244] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-24T18:03:48.225204] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-24T18:03:48.225276] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-24T18:03:48.226956] [DEBUG] [LOCAL ] CMS: Trimmed 76008 records to 52599 (keeping 200 days of data) [2025-09-24T18:03:48.575455] [DEBUG] [LOCAL ] CMS: Primary data saved (52599 records). [2025-09-24T18:03:48.575672] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-24T18:03:48.575808] [INFO ] [MAIN ] Update Progress: 484/2373 symbols completed. CMS took 38.3s. Estimated remaining: 4h 8m 48s. Rate: 7.6 symbols/min [2025-09-24T18:03:48.771990] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:48.797074] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T18:03:48.820763] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-24T18:03:48.827177] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T18:03:48.841084] [DEBUG] [LOCAL ] CNA: Loaded 32752 existing records from primary storage. [2025-09-24T18:03:48.841229] [INFO ] [MAIN ] CNA: Loaded 32752 existing records. [2025-09-24T18:03:49.036372] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:49.036736] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-24T18:03:49.036807] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-24T18:03:49.037810] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-24T18:03:49.037873] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-24T18:03:49.410774] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:49.616079] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-24T18:03:50.166490] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T18:03:50.346587] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T18:03:50.416071] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-24T18:03:50.983252] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T18:03:51.216194] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-24T18:03:52.017225] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-24T18:03:52.018430] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-24T18:03:52.786868] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T18:03:52.816088] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-24T18:03:53.555619] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T18:03:53.616069] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-24T18:03:54.248989] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T18:03:54.416095] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-24T18:03:54.992685] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T18:03:55.216081] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-24T18:03:56.016101] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-24T18:03:56.594708] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T18:03:56.600948] [INFO ] [REMOTE ] CMTG: Full fetch complete (53335 records). [2025-09-24T18:03:56.601048] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-24T18:03:56.792126] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T18:03:56.823994] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-24T18:03:57.015574] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-24T18:03:57.015713] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-24T18:03:57.016662] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-24T18:03:57.016739] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-24T18:03:57.018808] [DEBUG] [LOCAL ] CMTG: Trimmed 53335 records to 37547 (keeping 200 days of data) [2025-09-24T18:03:57.235038] [DEBUG] [LOCAL ] CMTG: Primary data saved (37547 records). [2025-09-24T18:03:57.235183] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-24T18:03:57.235974] [INFO ] [MAIN ] Update Progress: 485/2373 symbols completed. CMTG took 27.2s. Estimated remaining: 4h 8m 43s. Rate: 7.6 symbols/min [2025-09-24T18:03:57.407899] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:03:57.461866] [DEBUG] [LOCAL ] CNC: Loaded 53737 existing records from primary storage. [2025-09-24T18:03:57.462029] [INFO ] [MAIN ] CNC: Loaded 53737 existing records. [2025-09-24T18:03:57.638245] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-24T18:03:57.643667] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:03:57.644834] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-24T18:03:57.645007] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-24T18:03:57.646783] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-24T18:03:57.646875] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-24T18:03:57.734121] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T18:03:58.058886] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:03:58.416139] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-24T18:03:58.454873] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T18:03:59.092413] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T18:03:59.216095] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-24T18:03:59.873921] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T18:03:59.875419] [INFO ] [REMOTE ] CMU: Full fetch complete (9647 records). [2025-09-24T18:03:59.875495] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-24T18:04:00.021163] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-24T18:04:00.252040] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-24T18:04:00.252121] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-24T18:04:00.252351] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-24T18:04:00.252390] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-24T18:04:00.252865] [DEBUG] [LOCAL ] CMU: Trimmed 9647 records to 7267 (keeping 200 days of data) [2025-09-24T18:04:00.294491] [DEBUG] [LOCAL ] CMU: Primary data saved (7267 records). [2025-09-24T18:04:00.294612] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-24T18:04:00.294726] [INFO ] [MAIN ] Update Progress: 486/2373 symbols completed. CMU took 13.4s. Estimated remaining: 4h 8m 16s. Rate: 7.6 symbols/min [2025-09-24T18:04:00.468350] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:00.479788] [DEBUG] [LOCAL ] CNF: Loaded 10858 existing records from primary storage. [2025-09-24T18:04:00.479886] [INFO ] [MAIN ] CNF: Loaded 10858 existing records. [2025-09-24T18:04:00.662150] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:04:00.662434] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-24T18:04:00.662484] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-24T18:04:00.662954] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-24T18:04:00.663017] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-24T18:04:00.821223] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-24T18:04:01.038687] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:01.616080] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-24T18:04:01.770237] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T18:04:02.353548] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:04:02.421275] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-24T18:04:02.445955] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T18:04:03.025003] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-24T18:04:03.216129] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-24T18:04:04.016149] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-24T18:04:04.627939] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T18:04:04.816080] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-24T18:04:04.925217] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T18:04:05.336841] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T18:04:05.616126] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-24T18:04:06.067305] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T18:04:06.416123] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-24T18:04:07.138674] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T18:04:07.140507] [INFO ] [REMOTE ] CMSD: Full fetch complete (12536 records). [2025-09-24T18:04:07.140583] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-24T18:04:07.221327] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-24T18:04:07.521570] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-24T18:04:07.521680] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-24T18:04:07.522030] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-24T18:04:07.522074] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-24T18:04:07.522585] [DEBUG] [LOCAL ] CMSD: Trimmed 12536 records to 8101 (keeping 200 days of data) [2025-09-24T18:04:07.583566] [DEBUG] [LOCAL ] CMSD: Primary data saved (8101 records). [2025-09-24T18:04:07.583755] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-24T18:04:07.583854] [INFO ] [MAIN ] Update Progress: 487/2373 symbols completed. CMSD took 38.8s. Estimated remaining: 4h 8m 6s. Rate: 7.6 symbols/min [2025-09-24T18:04:07.756597] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:07.828790] [DEBUG] [LOCAL ] CNH: Loaded 53561 existing records from primary storage. [2025-09-24T18:04:07.828946] [INFO ] [MAIN ] CNH: Loaded 53561 existing records. [2025-09-24T18:04:08.008945] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:04:08.009225] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-24T18:04:08.009275] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-24T18:04:08.011788] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-24T18:04:08.011852] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-24T18:04:08.023295] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-24T18:04:08.382413] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:08.816159] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-24T18:04:08.959068] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:04:08.992305] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T18:04:09.616125] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-24T18:04:09.907668] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T18:04:10.416107] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-24T18:04:11.156849] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T18:04:11.216049] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-24T18:04:12.016054] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-24T18:04:12.067086] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:04:12.823019] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-24T18:04:12.843832] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T18:04:13.065577] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T18:04:13.616125] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-24T18:04:14.416094] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-24T18:04:14.453370] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:04:14.944195] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:04:15.001584] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-24T18:04:15.216116] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-24T18:04:16.016083] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-24T18:04:16.090249] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:04:16.816091] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-24T18:04:17.616062] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-24T18:04:17.659050] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T18:04:17.925216] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T18:04:18.416180] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-24T18:04:18.691224] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T18:04:19.216121] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-24T18:04:19.969447] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T18:04:20.016054] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-24T18:04:20.444182] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T18:04:20.816137] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-24T18:04:21.578269] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T18:04:21.617533] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-24T18:04:21.620703] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T18:04:22.416065] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-24T18:04:22.556362] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T18:04:23.216116] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-24T18:04:24.016125] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-24T18:04:24.228702] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T18:04:24.778804] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:04:24.816111] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-24T18:04:24.853863] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T18:04:24.856858] [INFO ] [REMOTE ] CNF: Full fetch complete (12719 records). [2025-09-24T18:04:24.856929] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-24T18:04:25.227270] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-24T18:04:25.227351] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-24T18:04:25.227713] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-24T18:04:25.227782] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-24T18:04:25.228299] [DEBUG] [LOCAL ] CNF: Trimmed 12719 records to 10918 (keeping 200 days of data) [2025-09-24T18:04:25.288123] [DEBUG] [LOCAL ] CNF: Primary data saved (10918 records). [2025-09-24T18:04:25.288263] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-24T18:04:25.288350] [INFO ] [MAIN ] Update Progress: 488/2373 symbols completed. CNF took 25.0s. Estimated remaining: 4h 8m 36s. Rate: 7.6 symbols/min [2025-09-24T18:04:25.464182] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:25.464394] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-09-24T18:04:25.464449] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-09-24T18:04:25.464598] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-24T18:04:25.464666] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-24T18:04:25.464738] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-09-24T18:04:25.464773] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-24T18:04:25.623145] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-24T18:04:25.836245] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:26.132989] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:04:26.416171] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-24T18:04:27.216092] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-24T18:04:27.641998] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T18:04:27.922524] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T18:04:28.016113] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-24T18:04:28.816106] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-24T18:04:28.879759] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T18:04:29.214909] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T18:04:29.616095] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-24T18:04:30.126821] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:04:30.132481] [INFO ] [REMOTE ] CNA: Full fetch complete (45514 records). [2025-09-24T18:04:30.132574] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-24T18:04:30.423175] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-24T18:04:30.528328] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-24T18:04:30.528419] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-24T18:04:30.529185] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-24T18:04:30.529254] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-24T18:04:30.530376] [DEBUG] [LOCAL ] CNA: Trimmed 45514 records to 32762 (keeping 200 days of data) [2025-09-24T18:04:30.735062] [DEBUG] [LOCAL ] CNA: Primary data saved (32762 records). [2025-09-24T18:04:30.735259] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-24T18:04:30.735385] [INFO ] [MAIN ] Update Progress: 489/2373 symbols completed. CNA took 42.2s. Estimated remaining: 4h 8m 19s. Rate: 7.6 symbols/min [2025-09-24T18:04:30.907588] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:30.960394] [DEBUG] [LOCAL ] CNK: Loaded 52903 existing records from primary storage. [2025-09-24T18:04:30.960572] [INFO ] [MAIN ] CNK: Loaded 52903 existing records. [2025-09-24T18:04:31.151528] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:04:31.151964] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-24T18:04:31.152043] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-24T18:04:31.153568] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-24T18:04:31.153634] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-24T18:04:31.219760] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-24T18:04:31.529816] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:31.560087] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T18:04:32.016115] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-24T18:04:32.417151] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:04:32.806324] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T18:04:32.817596] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-24T18:04:33.616099] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-24T18:04:33.758667] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:04:34.416096] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-24T18:04:34.551551] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:04:35.216195] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-24T18:04:35.982937] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:04:36.016091] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-24T18:04:36.146753] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-24T18:04:36.816115] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-24T18:04:37.122853] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:04:37.132410] [INFO ] [REMOTE ] CNH: Full fetch complete (77533 records). [2025-09-24T18:04:37.132581] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-24T18:04:37.552546] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-24T18:04:37.552755] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-24T18:04:37.553767] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-24T18:04:37.553886] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-24T18:04:37.556687] [DEBUG] [LOCAL ] CNH: Trimmed 77533 records to 53559 (keeping 200 days of data) [2025-09-24T18:04:37.624693] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-24T18:04:37.683749] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T18:04:37.933084] [DEBUG] [LOCAL ] CNH: Primary data saved (53559 records). [2025-09-24T18:04:37.933240] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-24T18:04:37.933327] [INFO ] [MAIN ] Update Progress: 490/2373 symbols completed. CNH took 30.3s. Estimated remaining: 4h 8m 8s. Rate: 7.6 symbols/min [2025-09-24T18:04:38.109168] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:38.109498] [DEBUG] [LOCAL ] CNM: No existing data file found in primary storage. [2025-09-24T18:04:38.109628] [WARN ] [MAIN ] CNM: No existing data found, performing full refresh instead. [2025-09-24T18:04:38.109923] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-24T18:04:38.109970] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-24T18:04:38.110014] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-09-24T18:04:38.110049] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-24T18:04:38.420464] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-24T18:04:38.482777] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:38.515010] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:04:39.216098] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-24T18:04:39.789426] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-24T18:04:40.014600] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:04:40.024799] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-24T18:04:40.778173] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T18:04:40.816082] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-24T18:04:41.616091] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-24T18:04:42.137781] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T18:04:42.147516] [INFO ] [REMOTE ] CNC: Full fetch complete (77672 records). [2025-09-24T18:04:42.147689] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-24T18:04:42.424045] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-24T18:04:42.603257] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-24T18:04:42.603457] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-24T18:04:42.604528] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-24T18:04:42.604703] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-24T18:04:42.606819] [DEBUG] [LOCAL ] CNC: Trimmed 77672 records to 53738 (keeping 200 days of data) [2025-09-24T18:04:42.739970] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:04:43.001986] [DEBUG] [LOCAL ] CNC: Primary data saved (53738 records). [2025-09-24T18:04:43.002184] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-24T18:04:43.003192] [INFO ] [MAIN ] Update Progress: 491/2373 symbols completed. CNC took 45.8s. Estimated remaining: 4h 7m 49s. Rate: 7.6 symbols/min [2025-09-24T18:04:43.193908] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:04:43.217889] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-24T18:04:43.232397] [DEBUG] [LOCAL ] CNMD: Loaded 32416 existing records from primary storage. [2025-09-24T18:04:43.232593] [INFO ] [MAIN ] CNMD: Loaded 32416 existing records. [2025-09-24T18:04:43.431108] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:04:43.431951] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-24T18:04:43.432478] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-24T18:04:43.443488] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-24T18:04:43.443577] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-24T18:04:43.550862] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T18:04:43.881152] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:04:44.016116] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-24T18:04:44.231853] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T18:04:44.761536] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T18:04:44.816085] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-24T18:04:45.002328] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T18:04:45.616086] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-24T18:04:46.199715] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T18:04:46.416090] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-24T18:04:47.213776] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T18:04:47.223562] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-24T18:04:47.762955] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T18:04:48.016092] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-24T18:04:48.816064] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-24T18:04:48.907334] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T18:04:49.395922] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T18:04:49.616124] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-24T18:04:50.416117] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-24T18:04:50.835493] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T18:04:51.048560] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T18:04:51.216126] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-24T18:04:51.791556] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T18:04:52.016142] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-24T18:04:52.547836] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T18:04:52.816101] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-24T18:04:53.615898] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T18:04:53.616047] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-24T18:04:54.416082] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-24T18:04:54.606753] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:04:55.216161] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-24T18:04:55.404323] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T18:04:55.888632] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T18:04:56.016042] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-24T18:04:56.265670] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T18:04:56.816093] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-24T18:04:57.616124] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-24T18:04:58.018797] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T18:04:58.416109] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-24T18:04:58.574429] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T18:04:59.216139] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-24T18:04:59.478712] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:04:59.491141] [INFO ] [REMOTE ] CNI: Full fetch complete (74675 records). [2025-09-24T18:04:59.491309] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-24T18:04:59.867412] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T18:04:59.923957] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-24T18:04:59.924378] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-24T18:04:59.925363] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-24T18:04:59.925438] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-24T18:04:59.928852] [DEBUG] [LOCAL ] CNI: Trimmed 74675 records to 51659 (keeping 200 days of data) [2025-09-24T18:05:00.027739] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-24T18:05:00.275832] [DEBUG] [LOCAL ] CNI: Primary data saved (51659 records). [2025-09-24T18:05:00.275986] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-24T18:05:00.276083] [INFO ] [MAIN ] Update Progress: 492/2373 symbols completed. CNI took 35.0s. Estimated remaining: 4h 8m 17s. Rate: 7.6 symbols/min [2025-09-24T18:05:00.453446] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:00.495537] [DEBUG] [LOCAL ] CNNE: Loaded 36888 existing records from primary storage. [2025-09-24T18:05:00.495729] [INFO ] [MAIN ] CNNE: Loaded 36888 existing records. [2025-09-24T18:05:00.686150] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:00.686450] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-24T18:05:00.686512] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-24T18:05:00.687558] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-24T18:05:00.687634] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-24T18:05:00.821271] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-24T18:05:01.101965] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:01.168191] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T18:05:01.178352] [INFO ] [REMOTE ] CNK: Full fetch complete (75631 records). [2025-09-24T18:05:01.178529] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-24T18:05:01.613878] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-24T18:05:01.614195] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-24T18:05:01.616951] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-24T18:05:01.617129] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-24T18:05:01.619556] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-24T18:05:01.640743] [DEBUG] [LOCAL ] CNK: Trimmed 75631 records to 52902 (keeping 200 days of data) [2025-09-24T18:05:01.659397] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T18:05:02.102077] [DEBUG] [LOCAL ] CNK: Primary data saved (52902 records). [2025-09-24T18:05:02.102275] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-24T18:05:02.102440] [INFO ] [MAIN ] Update Progress: 493/2373 symbols completed. CNK took 31.4s. Estimated remaining: 4h 7m 46s. Rate: 7.6 symbols/min [2025-09-24T18:05:02.369352] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:02.424706] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-24T18:05:02.430532] [DEBUG] [LOCAL ] CNO: Loaded 41431 existing records from primary storage. [2025-09-24T18:05:02.430803] [INFO ] [MAIN ] CNO: Loaded 41431 existing records. [2025-09-24T18:05:02.758421] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:02.759494] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-24T18:05:02.759680] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-24T18:05:02.772907] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-24T18:05:02.794107] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-24T18:05:02.846839] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T18:05:03.199201] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T18:05:03.219740] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-24T18:05:03.264886] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:03.457907] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T18:05:04.016113] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-24T18:05:04.827249] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-24T18:05:04.830108] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:05:05.381368] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T18:05:05.387046] [INFO ] [REMOTE ] CNMD: Full fetch complete (46999 records). [2025-09-24T18:05:05.387172] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-24T18:05:05.624766] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-24T18:05:05.795898] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-24T18:05:05.796011] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-24T18:05:05.796850] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-24T18:05:05.796947] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-24T18:05:05.801617] [DEBUG] [LOCAL ] CNMD: Trimmed 46999 records to 32356 (keeping 200 days of data) [2025-09-24T18:05:06.018388] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T18:05:06.047560] [DEBUG] [LOCAL ] CNMD: Primary data saved (32356 records). [2025-09-24T18:05:06.047763] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-24T18:05:06.048941] [INFO ] [MAIN ] Update Progress: 494/2373 symbols completed. CNMD took 23.0s. Estimated remaining: 4h 7m 23s. Rate: 7.6 symbols/min [2025-09-24T18:05:06.233611] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:06.308919] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-24T18:05:06.309178] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-24T18:05:06.416083] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-24T18:05:06.500336] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:06.500721] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-24T18:05:06.500781] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-24T18:05:06.502233] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-24T18:05:06.502308] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-24T18:05:06.857922] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:07.216053] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-24T18:05:07.296178] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T18:05:07.738068] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:05:08.016118] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-24T18:05:08.821119] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-24T18:05:08.828063] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T18:05:09.596074] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T18:05:09.616144] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-24T18:05:10.416089] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-24T18:05:10.666175] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T18:05:11.066339] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T18:05:11.216200] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-24T18:05:12.016097] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-24T18:05:12.177993] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T18:05:12.191985] [INFO ] [REMOTE ] CNM: Full fetch complete (73613 records). [2025-09-24T18:05:12.192171] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-24T18:05:12.629712] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-24T18:05:12.629817] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-24T18:05:12.630702] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-24T18:05:12.630787] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-24T18:05:12.632360] [DEBUG] [LOCAL ] CNM: Trimmed 73613 records to 50969 (keeping 200 days of data) [2025-09-24T18:05:12.764033] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:05:12.859216] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-24T18:05:12.997817] [DEBUG] [LOCAL ] CNM: Primary data saved (50969 records). [2025-09-24T18:05:12.997993] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-24T18:05:12.998095] [INFO ] [MAIN ] Update Progress: 495/2373 symbols completed. CNM took 35.1s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-24T18:05:13.173333] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:13.231784] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-24T18:05:13.231960] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-09-24T18:05:13.423832] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:13.424120] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-24T18:05:13.424201] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-24T18:05:13.426159] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-24T18:05:13.426285] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-24T18:05:13.622210] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-24T18:05:13.824816] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:13.843886] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T18:05:14.416099] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-24T18:05:14.546738] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T18:05:15.216136] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-24T18:05:15.287681] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:05:16.016099] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-24T18:05:16.373419] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T18:05:16.816099] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-24T18:05:16.907830] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T18:05:17.231601] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T18:05:17.616080] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-24T18:05:18.416056] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-24T18:05:18.592887] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T18:05:19.025285] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:05:19.216072] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-24T18:05:20.016105] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-24T18:05:20.063111] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T18:05:20.716545] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T18:05:20.816184] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-24T18:05:21.616073] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-24T18:05:21.724613] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T18:05:22.416101] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-24T18:05:22.765099] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T18:05:22.817540] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T18:05:23.216150] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-24T18:05:23.566592] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T18:05:24.016164] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-24T18:05:24.816075] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-24T18:05:25.019930] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T18:05:25.616061] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-24T18:05:25.667523] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:05:26.416059] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-24T18:05:26.802628] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T18:05:26.957271] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T18:05:27.216106] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-24T18:05:27.967562] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T18:05:28.016074] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-24T18:05:28.816155] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-24T18:05:28.954695] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T18:05:29.616109] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-24T18:05:29.690716] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T18:05:29.698454] [INFO ] [REMOTE ] CNO: Full fetch complete (60633 records). [2025-09-24T18:05:29.698678] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-24T18:05:30.093126] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-24T18:05:30.093235] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-24T18:05:30.093993] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-24T18:05:30.094137] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-24T18:05:30.095516] [DEBUG] [LOCAL ] CNO: Trimmed 60633 records to 41382 (keeping 200 days of data) [2025-09-24T18:05:30.369045] [DEBUG] [LOCAL ] CNO: Primary data saved (41382 records). [2025-09-24T18:05:30.369191] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-24T18:05:30.369303] [INFO ] [MAIN ] Update Progress: 496/2373 symbols completed. CNO took 28.3s. Estimated remaining: 4h 7m 40s. Rate: 7.6 symbols/min [2025-09-24T18:05:30.424488] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-24T18:05:30.545698] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:30.546144] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-24T18:05:30.546218] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-24T18:05:30.546386] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-24T18:05:30.546585] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-24T18:05:30.546704] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-24T18:05:30.546804] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-24T18:05:30.818755] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-24T18:05:30.953098] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:31.216118] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-24T18:05:31.533014] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T18:05:31.845086] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T18:05:32.016134] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-24T18:05:32.816128] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-24T18:05:33.066986] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:05:33.067328] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-24T18:05:33.256090] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T18:05:33.357121] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T18:05:33.616113] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-24T18:05:34.416148] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-24T18:05:34.883422] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T18:05:35.216129] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-24T18:05:36.016105] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-24T18:05:36.329552] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T18:05:36.605067] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T18:05:36.611922] [INFO ] [REMOTE ] CNNE: Full fetch complete (49217 records). [2025-09-24T18:05:36.612056] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-24T18:05:36.821321] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-24T18:05:37.022714] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-24T18:05:37.022813] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-24T18:05:37.023492] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-24T18:05:37.023557] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-24T18:05:37.024845] [DEBUG] [LOCAL ] CNNE: Trimmed 49217 records to 36748 (keeping 200 days of data) [2025-09-24T18:05:37.267121] [DEBUG] [LOCAL ] CNNE: Primary data saved (36748 records). [2025-09-24T18:05:37.267307] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-24T18:05:37.267449] [INFO ] [MAIN ] Update Progress: 497/2373 symbols completed. CNNE took 37.0s. Estimated remaining: 4h 7m 28s. Rate: 7.6 symbols/min [2025-09-24T18:05:37.448172] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:37.448353] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-09-24T18:05:37.448390] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-09-24T18:05:37.448536] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-24T18:05:37.448578] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-24T18:05:37.448618] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-09-24T18:05:37.448677] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-24T18:05:37.630191] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-24T18:05:37.787694] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T18:05:37.880424] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:38.416119] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-24T18:05:38.869934] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T18:05:38.879567] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-09-24T18:05:38.879753] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-24T18:05:39.220089] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-24T18:05:39.280039] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-24T18:05:39.280191] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-24T18:05:39.281143] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-24T18:05:39.281366] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-24T18:05:39.283194] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53469 (keeping 200 days of data) [2025-09-24T18:05:39.403976] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T18:05:39.647332] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-24T18:05:39.647478] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-24T18:05:39.648095] [INFO ] [MAIN ] Update Progress: 498/2373 symbols completed. CNP took 33.6s. Estimated remaining: 4h 6m 59s. Rate: 7.6 symbols/min [2025-09-24T18:05:39.826716] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:39.881089] [DEBUG] [LOCAL ] CNX: Loaded 51391 existing records from primary storage. [2025-09-24T18:05:39.881265] [INFO ] [MAIN ] CNX: Loaded 51391 existing records. [2025-09-24T18:05:40.021317] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-24T18:05:40.082918] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:40.083582] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-24T18:05:40.083757] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-24T18:05:40.085312] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-24T18:05:40.085380] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-24T18:05:40.509552] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:40.555030] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T18:05:40.554227] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-24T18:05:40.816094] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-24T18:05:41.628747] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-24T18:05:41.636538] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:05:42.416091] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-24T18:05:42.669990] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T18:05:42.694706] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T18:05:43.216082] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-24T18:05:44.016068] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-24T18:05:44.050902] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T18:05:44.816046] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-24T18:05:45.089692] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-24T18:05:45.092919] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T18:05:45.616113] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-24T18:05:46.416050] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-24T18:05:46.679339] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:05:46.688945] [INFO ] [REMOTE ] CNQ: Full fetch complete (77543 records). [2025-09-24T18:05:46.689083] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-24T18:05:46.905914] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:05:47.108638] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-24T18:05:47.108746] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-24T18:05:47.109602] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-24T18:05:47.109666] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-24T18:05:47.111565] [DEBUG] [LOCAL ] CNQ: Trimmed 77543 records to 53582 (keeping 200 days of data) [2025-09-24T18:05:47.221758] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-24T18:05:47.441838] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-09-24T18:05:47.441975] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-24T18:05:47.442057] [INFO ] [MAIN ] Update Progress: 499/2373 symbols completed. CNQ took 34.4s. Estimated remaining: 4h 6m 51s. Rate: 7.6 symbols/min [2025-09-24T18:05:47.617261] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:05:47.654853] [DEBUG] [LOCAL ] CODI: Loaded 39695 existing records from primary storage. [2025-09-24T18:05:47.655054] [INFO ] [MAIN ] CODI: Loaded 39695 existing records. [2025-09-24T18:05:47.787950] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T18:05:47.878115] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:05:47.878339] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-24T18:05:47.878388] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-24T18:05:47.879369] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-24T18:05:47.879433] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-24T18:05:48.023302] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-24T18:05:48.249097] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:05:48.488830] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T18:05:48.816047] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-24T18:05:49.616050] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-24T18:05:49.861549] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T18:05:50.416053] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-24T18:05:50.618822] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:05:50.782481] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T18:05:51.216081] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-24T18:05:52.021217] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-24T18:05:52.036856] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:05:52.326139] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T18:05:52.816082] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-24T18:05:53.616048] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-24T18:05:53.815972] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T18:05:54.021840] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T18:05:54.416076] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-24T18:05:55.004278] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T18:05:55.160350] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:05:55.216172] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-24T18:05:56.016227] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-24T18:05:56.816116] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-24T18:05:57.082171] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:05:57.228241] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T18:05:57.616098] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-24T18:05:57.852233] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T18:05:58.416101] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-24T18:05:59.156178] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T18:05:59.216032] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-24T18:05:59.460720] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T18:06:00.016087] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-24T18:06:00.753964] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T18:06:00.816035] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-24T18:06:01.616125] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-24T18:06:01.746471] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:06:02.416061] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-24T18:06:02.770976] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T18:06:02.779585] [INFO ] [REMOTE ] CNR: Full fetch complete (56200 records). [2025-09-24T18:06:02.779865] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-24T18:06:03.056545] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-24T18:06:03.057197] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:06:03.057271] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:06:03.057344] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-24T18:06:03.057414] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-24T18:06:03.057454] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-24T18:06:03.057494] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-24T18:06:03.057622] [INFO ] [MAIN ] Update Progress: 500/2373 symbols completed. CNR took 32.7s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-24T18:06:03.225810] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-24T18:06:03.228613] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:03.287922] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-24T18:06:03.288074] [INFO ] [MAIN ] COF: Loaded 53610 existing records. [2025-09-24T18:06:03.469569] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:03.469846] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-24T18:06:03.469896] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-24T18:06:03.471353] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-24T18:06:03.471416] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-24T18:06:03.841901] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:04.016072] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-24T18:06:04.438473] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-24T18:06:04.615330] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T18:06:04.816127] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-24T18:06:05.056675] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:06:05.062303] [INFO ] [REMOTE ] CNS: Full fetch complete (29664 records). [2025-09-24T18:06:05.062393] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-24T18:06:05.062922] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:06:05.063012] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:06:05.063056] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:06:05.063095] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-24T18:06:05.063152] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-09-24T18:06:05.063187] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-09-24T18:06:05.063227] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-09-24T18:06:05.063280] [INFO ] [MAIN ] Update Progress: 501/2373 symbols completed. CNS took 27.8s. Estimated remaining: 4h 6m 42s. Rate: 7.6 symbols/min [2025-09-24T18:06:05.241051] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:05.302752] [DEBUG] [LOCAL ] COHR: Loaded 53365 existing records from primary storage. [2025-09-24T18:06:05.302909] [INFO ] [MAIN ] COHR: Loaded 53365 existing records. [2025-09-24T18:06:05.484056] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:05.484319] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-24T18:06:05.484366] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-24T18:06:05.485811] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-24T18:06:05.485873] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-24T18:06:05.625193] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-24T18:06:05.849747] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:06.114814] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-24T18:06:06.416116] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-24T18:06:06.588495] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T18:06:07.216135] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-24T18:06:07.422616] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T18:06:08.016082] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-24T18:06:08.556501] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-24T18:06:08.816188] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-24T18:06:09.032012] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T18:06:09.616118] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-24T18:06:09.760883] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T18:06:10.388377] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:06:10.416033] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-24T18:06:11.026453] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T18:06:11.216104] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-24T18:06:12.016145] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-24T18:06:12.360252] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T18:06:12.816116] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-24T18:06:12.950753] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T18:06:13.616049] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-24T18:06:13.860019] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:06:13.869100] [INFO ] [REMOTE ] CNX: Full fetch complete (74776 records). [2025-09-24T18:06:13.869237] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-24T18:06:14.289822] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-24T18:06:14.289899] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-24T18:06:14.290727] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-24T18:06:14.290791] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-24T18:06:14.292246] [DEBUG] [LOCAL ] CNX: Trimmed 74776 records to 51382 (keeping 200 days of data) [2025-09-24T18:06:14.416069] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-24T18:06:14.597492] [DEBUG] [LOCAL ] CNX: Primary data saved (51382 records). [2025-09-24T18:06:14.597662] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-24T18:06:14.598291] [INFO ] [MAIN ] Update Progress: 502/2373 symbols completed. CNX took 35.0s. Estimated remaining: 4h 6m 40s. Rate: 7.6 symbols/min [2025-09-24T18:06:14.767681] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:14.821443] [DEBUG] [LOCAL ] COLD: Loaded 51991 existing records from primary storage. [2025-09-24T18:06:14.821586] [INFO ] [MAIN ] COLD: Loaded 51991 existing records. [2025-09-24T18:06:14.999407] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:14.999692] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-24T18:06:14.999750] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-24T18:06:15.001030] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-24T18:06:15.001093] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-24T18:06:15.362125] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:15.362469] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-24T18:06:15.736356] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-09-24T18:06:15.808115] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-24T18:06:16.016087] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-24T18:06:16.816054] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-24T18:06:17.055009] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T18:06:17.145147] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-24T18:06:17.624505] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-24T18:06:17.626502] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T18:06:17.635019] [INFO ] [REMOTE ] CODI: Full fetch complete (50370 records). [2025-09-24T18:06:17.635155] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-24T18:06:18.088870] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-24T18:06:18.089028] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-24T18:06:18.089866] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-24T18:06:18.089936] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-24T18:06:18.092344] [DEBUG] [LOCAL ] CODI: Trimmed 50370 records to 39726 (keeping 200 days of data) [2025-09-24T18:06:18.325960] [DEBUG] [LOCAL ] CODI: Primary data saved (39726 records). [2025-09-24T18:06:18.326128] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-24T18:06:18.326220] [INFO ] [MAIN ] Update Progress: 503/2373 symbols completed. CODI took 30.9s. Estimated remaining: 4h 6m 17s. Rate: 7.6 symbols/min [2025-09-24T18:06:18.422623] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-24T18:06:18.514137] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:18.567955] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-24T18:06:18.568099] [INFO ] [MAIN ] COMP: Loaded 53386 existing records. [2025-09-24T18:06:18.781076] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:18.781396] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-24T18:06:18.781502] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-24T18:06:18.782913] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-24T18:06:18.782980] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-24T18:06:19.155558] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-24T18:06:19.216837] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-24T18:06:19.220614] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:19.564044] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:06:20.010368] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T18:06:20.019459] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-24T18:06:20.816095] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-24T18:06:21.096010] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T18:06:21.616105] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-24T18:06:22.144363] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T18:06:22.417222] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-24T18:06:22.422415] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:06:23.216078] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-24T18:06:23.445546] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T18:06:24.016079] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-24T18:06:24.354729] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T18:06:24.816128] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-24T18:06:25.156518] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T18:06:25.292051] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T18:06:25.616087] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-24T18:06:26.416060] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-24T18:06:26.875433] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T18:06:27.149852] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T18:06:27.216147] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-24T18:06:27.720300] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:06:28.016097] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-24T18:06:28.816085] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-24T18:06:29.347913] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T18:06:29.616064] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-24T18:06:29.728636] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T18:06:30.416161] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-24T18:06:30.639919] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:06:31.216156] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-24T18:06:31.654839] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T18:06:32.016134] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-24T18:06:32.485664] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-24T18:06:32.816109] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-24T18:06:33.097667] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T18:06:33.616089] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-24T18:06:34.004485] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T18:06:34.013842] [INFO ] [REMOTE ] COF: Full fetch complete (77392 records). [2025-09-24T18:06:34.013975] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-24T18:06:34.432688] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-24T18:06:34.428622] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-24T18:06:34.432998] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-24T18:06:34.434888] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-24T18:06:34.435237] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-24T18:06:34.437215] [DEBUG] [LOCAL ] COF: Trimmed 77392 records to 53610 (keeping 200 days of data) [2025-09-24T18:06:34.703853] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T18:06:34.827923] [DEBUG] [LOCAL ] COF: Primary data saved (53610 records). [2025-09-24T18:06:34.828096] [INFO ] [MAIN ] COF: Full history saved. [2025-09-24T18:06:34.828195] [INFO ] [MAIN ] Update Progress: 504/2373 symbols completed. COF took 31.8s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-24T18:06:35.002114] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:35.039793] [DEBUG] [LOCAL ] CON: Loaded 38791 existing records from primary storage. [2025-09-24T18:06:35.039940] [INFO ] [MAIN ] CON: Loaded 38791 existing records. [2025-09-24T18:06:35.228301] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-24T18:06:35.233281] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:35.233535] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-24T18:06:35.233584] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-24T18:06:35.234743] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-24T18:06:35.234807] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-24T18:06:35.548197] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T18:06:35.647679] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:36.016083] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-24T18:06:36.467893] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T18:06:36.477298] [INFO ] [REMOTE ] COHR: Full fetch complete (77086 records). [2025-09-24T18:06:36.477422] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-24T18:06:36.818403] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-24T18:06:36.899926] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-24T18:06:36.900078] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-24T18:06:36.901168] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-24T18:06:36.901267] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-24T18:06:36.903353] [DEBUG] [LOCAL ] COHR: Trimmed 77086 records to 53364 (keeping 200 days of data) [2025-09-24T18:06:36.935638] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T18:06:37.270800] [DEBUG] [LOCAL ] COHR: Primary data saved (53364 records). [2025-09-24T18:06:37.270941] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-24T18:06:37.271029] [INFO ] [MAIN ] Update Progress: 505/2373 symbols completed. COHR took 32.2s. Estimated remaining: 4h 6m 12s. Rate: 7.6 symbols/min [2025-09-24T18:06:37.453120] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:37.477898] [DEBUG] [LOCAL ] COOK: Loaded 24522 existing records from primary storage. [2025-09-24T18:06:37.478044] [INFO ] [MAIN ] COOK: Loaded 24522 existing records. [2025-09-24T18:06:37.641282] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-24T18:06:37.675490] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:37.675907] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-24T18:06:37.676062] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-24T18:06:37.676962] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-24T18:06:37.677027] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-24T18:06:37.843702] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T18:06:38.106696] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:38.416048] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-24T18:06:38.586663] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T18:06:39.226459] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-24T18:06:39.249101] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T18:06:39.589449] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T18:06:40.016133] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-24T18:06:40.816061] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-24T18:06:41.007451] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T18:06:41.054631] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T18:06:41.616128] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-24T18:06:42.416050] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-24T18:06:42.744272] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T18:06:43.216082] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-24T18:06:43.230130] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T18:06:43.331158] [DEBUG] [REMOTE ] COLD: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-24T18:06:43.331534] [WARN ] [REMOTE ] COLD: No data returned for month 2025-09 [2025-09-24T18:06:43.331663] [INFO ] [REMOTE ] COLD: Full fetch complete (67528 records). [2025-09-24T18:06:43.331757] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-24T18:06:43.332835] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:06:43.332930] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:06:43.332995] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:06:43.333064] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-24T18:06:43.333157] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-09-24T18:06:43.333216] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-09-24T18:06:43.333799] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-09-24T18:06:43.333901] [INFO ] [MAIN ] Update Progress: 506/2373 symbols completed. COLD took 28.7s. Estimated remaining: 4h 5m 58s. Rate: 7.6 symbols/min [2025-09-24T18:06:43.550803] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T18:06:43.570243] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:43.636050] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-24T18:06:43.636208] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-24T18:06:43.822991] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:43.823292] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-24T18:06:43.823355] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-24T18:06:43.824695] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-24T18:06:43.824781] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-24T18:06:44.021618] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-24T18:06:44.188953] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:44.816110] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-24T18:06:45.088622] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T18:06:45.616077] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-24T18:06:46.416084] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-24T18:06:46.606394] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-24T18:06:46.807933] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T18:06:47.216147] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-24T18:06:47.903682] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T18:06:48.016116] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-24T18:06:48.354475] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T18:06:48.816142] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-24T18:06:49.616075] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-24T18:06:50.063875] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T18:06:50.288487] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T18:06:50.416126] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-24T18:06:51.044285] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:06:51.216135] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-24T18:06:52.016107] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-24T18:06:52.383933] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T18:06:52.816085] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-24T18:06:53.098594] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T18:06:53.109712] [INFO ] [REMOTE ] COMP: Full fetch complete (77077 records). [2025-09-24T18:06:53.109975] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-24T18:06:53.624912] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-24T18:06:53.721052] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-24T18:06:53.721290] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-24T18:06:53.722406] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-24T18:06:53.722505] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-24T18:06:53.725994] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:06:53.737180] [DEBUG] [LOCAL ] COMP: Trimmed 77077 records to 53386 (keeping 200 days of data) [2025-09-24T18:06:53.969439] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T18:06:54.096226] [DEBUG] [LOCAL ] COMP: Primary data saved (53386 records). [2025-09-24T18:06:54.096381] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-24T18:06:54.096540] [INFO ] [MAIN ] Update Progress: 507/2373 symbols completed. COMP took 35.8s. Estimated remaining: 4h 6m 0s. Rate: 7.6 symbols/min [2025-09-24T18:06:54.273714] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:06:54.325330] [DEBUG] [LOCAL ] COR: Loaded 47253 existing records from primary storage. [2025-09-24T18:06:54.325480] [INFO ] [MAIN ] COR: Loaded 47253 existing records. [2025-09-24T18:06:54.425736] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-24T18:06:54.513462] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:06:54.513834] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-24T18:06:54.513903] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-24T18:06:54.516079] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-24T18:06:54.516142] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-24T18:06:54.866807] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:06:55.216103] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-24T18:06:55.546898] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T18:06:55.643003] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-24T18:06:56.016143] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-24T18:06:56.696452] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:06:56.816147] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-24T18:06:57.442049] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T18:06:57.616089] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-24T18:06:58.416113] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-24T18:06:58.736388] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:06:58.976810] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:06:59.216108] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-24T18:06:59.831565] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T18:07:00.016166] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-24T18:07:00.724818] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T18:07:00.816087] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-24T18:07:01.623666] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-24T18:07:01.643509] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:07:02.416046] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-24T18:07:02.521192] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:07:03.216105] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-24T18:07:03.730557] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T18:07:03.862725] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T18:07:04.016110] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-24T18:07:04.816061] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-24T18:07:05.326860] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T18:07:05.371623] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T18:07:05.616062] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-24T18:07:06.416157] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-24T18:07:06.740771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T18:07:07.152250] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T18:07:07.160209] [INFO ] [REMOTE ] COOK: Full fetch complete (32860 records). [2025-09-24T18:07:07.160317] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-24T18:07:07.226765] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-24T18:07:07.560748] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-24T18:07:07.560833] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-24T18:07:07.561351] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-24T18:07:07.561432] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-24T18:07:07.563779] [DEBUG] [LOCAL ] COOK: Trimmed 32860 records to 24510 (keeping 200 days of data) [2025-09-24T18:07:07.712333] [DEBUG] [LOCAL ] COOK: Primary data saved (24510 records). [2025-09-24T18:07:07.712464] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-24T18:07:07.712592] [INFO ] [MAIN ] Update Progress: 508/2373 symbols completed. COOK took 30.4s. Estimated remaining: 4h 6m 13s. Rate: 7.6 symbols/min [2025-09-24T18:07:07.888611] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:07.951317] [DEBUG] [LOCAL ] COTY: Loaded 53248 existing records from primary storage. [2025-09-24T18:07:07.951466] [INFO ] [MAIN ] COTY: Loaded 53248 existing records. [2025-09-24T18:07:08.026268] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-24T18:07:08.138038] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:08.139115] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-24T18:07:08.139184] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-24T18:07:08.140276] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-24T18:07:08.140359] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-24T18:07:08.503028] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:08.533879] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-24T18:07:08.816117] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-24T18:07:09.334191] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T18:07:09.616100] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-24T18:07:09.748581] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T18:07:09.757275] [INFO ] [REMOTE ] CON: Full fetch complete (57109 records). [2025-09-24T18:07:09.757430] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-24T18:07:10.144819] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-24T18:07:10.144972] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-24T18:07:10.145727] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-24T18:07:10.145789] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-24T18:07:10.149386] [DEBUG] [LOCAL ] CON: Trimmed 57109 records to 38732 (keeping 200 days of data) [2025-09-24T18:07:10.394744] [DEBUG] [LOCAL ] CON: Primary data saved (38732 records). [2025-09-24T18:07:10.394897] [INFO ] [MAIN ] CON: Full history saved. [2025-09-24T18:07:10.395003] [INFO ] [MAIN ] Update Progress: 509/2373 symbols completed. CON took 35.6s. Estimated remaining: 4h 5m 46s. Rate: 7.6 symbols/min [2025-09-24T18:07:10.426251] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-24T18:07:10.569148] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:10.618150] [DEBUG] [LOCAL ] COUR: Loaded 48950 existing records from primary storage. [2025-09-24T18:07:10.618322] [INFO ] [MAIN ] COUR: Loaded 48950 existing records. [2025-09-24T18:07:10.796535] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T18:07:10.843250] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:10.843540] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-24T18:07:10.843588] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-24T18:07:10.844640] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-24T18:07:10.844734] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-24T18:07:11.203984] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:11.216038] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-24T18:07:11.714886] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-24T18:07:11.756684] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T18:07:12.016153] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-24T18:07:12.816143] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-24T18:07:12.923107] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:07:13.616079] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-24T18:07:14.028397] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T18:07:14.416132] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-24T18:07:14.540365] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T18:07:15.180454] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T18:07:15.216041] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-24T18:07:16.016104] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-24T18:07:16.520540] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T18:07:16.532816] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-24T18:07:16.533024] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-24T18:07:16.817690] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-24T18:07:16.982347] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-24T18:07:16.985215] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-24T18:07:16.988225] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T18:07:16.986812] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-24T18:07:16.988388] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-24T18:07:16.999867] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-24T18:07:17.348383] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-24T18:07:17.348520] [INFO ] [MAIN ] COP: Full history saved. [2025-09-24T18:07:17.348605] [INFO ] [MAIN ] Update Progress: 510/2373 symbols completed. COP took 34.0s. Estimated remaining: 4h 5m 35s. Rate: 7.6 symbols/min [2025-09-24T18:07:17.533144] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:17.561378] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T18:07:17.621225] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-24T18:07:17.623905] [DEBUG] [LOCAL ] CP: Loaded 53279 existing records from primary storage. [2025-09-24T18:07:17.624092] [INFO ] [MAIN ] CP: Loaded 53279 existing records. [2025-09-24T18:07:17.805269] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:17.805589] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-24T18:07:17.805667] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-24T18:07:17.807583] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-24T18:07:17.807671] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-24T18:07:18.158483] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:18.416047] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-24T18:07:18.623937] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T18:07:19.216144] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-24T18:07:19.560131] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T18:07:19.568838] [INFO ] [REMOTE ] COR: Full fetch complete (68891 records). [2025-09-24T18:07:19.569038] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-24T18:07:19.982851] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-24T18:07:19.983011] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-24T18:07:19.983884] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-24T18:07:19.983948] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-24T18:07:19.985256] [DEBUG] [LOCAL ] COR: Trimmed 68891 records to 47251 (keeping 200 days of data) [2025-09-24T18:07:20.047706] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-24T18:07:20.274777] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T18:07:20.334313] [DEBUG] [LOCAL ] COR: Primary data saved (47251 records). [2025-09-24T18:07:20.334464] [INFO ] [MAIN ] COR: Full history saved. [2025-09-24T18:07:20.334580] [INFO ] [MAIN ] Update Progress: 511/2373 symbols completed. COR took 26.2s. Estimated remaining: 4h 5m 9s. Rate: 7.6 symbols/min [2025-09-24T18:07:20.506609] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:20.538261] [DEBUG] [LOCAL ] CPA: Loaded 28837 existing records from primary storage. [2025-09-24T18:07:20.538402] [INFO ] [MAIN ] CPA: Loaded 28837 existing records. [2025-09-24T18:07:20.727017] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:20.727285] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-24T18:07:20.727333] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-24T18:07:20.728087] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-24T18:07:20.728161] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-24T18:07:20.832213] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-24T18:07:21.125767] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:21.187474] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T18:07:21.400297] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T18:07:21.616108] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-24T18:07:22.416114] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-24T18:07:22.612947] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T18:07:23.078145] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:07:23.216077] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-24T18:07:24.016120] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-24T18:07:24.230024] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T18:07:24.586284] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T18:07:24.816097] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-24T18:07:25.299116] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:07:25.616128] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-24T18:07:26.416109] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-24T18:07:26.474445] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T18:07:27.216175] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-24T18:07:27.533723] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:07:28.016054] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-24T18:07:28.289692] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T18:07:28.648786] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T18:07:28.816125] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-24T18:07:29.616090] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-24T18:07:29.995927] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T18:07:30.416127] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-24T18:07:30.457776] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T18:07:30.819041] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T18:07:31.216078] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-24T18:07:32.016066] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-24T18:07:32.270318] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T18:07:32.630410] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:07:32.816056] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-24T18:07:33.616104] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-24T18:07:33.971640] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T18:07:34.252317] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T18:07:34.416086] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-24T18:07:35.216070] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-24T18:07:35.487629] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:07:35.787243] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T18:07:36.016099] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-24T18:07:36.509738] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T18:07:36.816098] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-24T18:07:37.495408] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T18:07:37.616078] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-24T18:07:38.416131] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-24T18:07:38.684085] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T18:07:39.216067] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-24T18:07:39.464865] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T18:07:40.016109] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-24T18:07:40.342035] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-24T18:07:40.821280] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-24T18:07:40.862495] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:07:41.583478] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T18:07:41.616034] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-24T18:07:42.416146] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-24T18:07:42.692775] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T18:07:43.142585] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:07:43.216118] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-24T18:07:43.980404] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T18:07:44.016076] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-24T18:07:44.518365] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T18:07:44.523576] [INFO ] [REMOTE ] CPA: Full fetch complete (42171 records). [2025-09-24T18:07:44.523729] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-24T18:07:44.821244] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-24T18:07:44.944689] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-24T18:07:44.944795] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-24T18:07:44.945447] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-24T18:07:44.945493] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-24T18:07:44.946677] [DEBUG] [LOCAL ] CPA: Trimmed 42171 records to 28828 (keeping 200 days of data) [2025-09-24T18:07:45.130959] [DEBUG] [LOCAL ] CPA: Primary data saved (28828 records). [2025-09-24T18:07:45.131114] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-24T18:07:45.131228] [INFO ] [MAIN ] Update Progress: 512/2373 symbols completed. CPA took 24.8s. Estimated remaining: 4h 6m 2s. Rate: 7.6 symbols/min [2025-09-24T18:07:45.304493] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:45.304718] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-24T18:07:45.304768] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-24T18:07:45.304911] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-24T18:07:45.304954] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-24T18:07:45.304996] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-24T18:07:45.305029] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-24T18:07:45.625932] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-24T18:07:45.668245] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:45.950429] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T18:07:45.959508] [INFO ] [REMOTE ] COUR: Full fetch complete (70911 records). [2025-09-24T18:07:45.959727] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-24T18:07:46.346842] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-24T18:07:46.346924] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-24T18:07:46.347747] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-24T18:07:46.347810] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-24T18:07:46.349165] [DEBUG] [LOCAL ] COUR: Trimmed 70911 records to 48958 (keeping 200 days of data) [2025-09-24T18:07:46.429978] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-24T18:07:46.630567] [DEBUG] [LOCAL ] COUR: Primary data saved (48958 records). [2025-09-24T18:07:46.630748] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-24T18:07:46.630843] [INFO ] [MAIN ] Update Progress: 513/2373 symbols completed. COUR took 36.2s. Estimated remaining: 4h 5m 31s. Rate: 7.6 symbols/min [2025-09-24T18:07:46.805101] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:46.836463] [DEBUG] [LOCAL ] CPAY: Loaded 31109 existing records from primary storage. [2025-09-24T18:07:46.836612] [INFO ] [MAIN ] CPAY: Loaded 31109 existing records. [2025-09-24T18:07:47.022082] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:47.022421] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-24T18:07:47.022639] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-24T18:07:47.032561] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-24T18:07:47.046199] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-24T18:07:47.107614] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T18:07:47.172598] [INFO ] [REMOTE ] COTY: Full fetch complete (77092 records). [2025-09-24T18:07:47.192496] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-24T18:07:47.192326] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T18:07:47.219752] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-24T18:07:47.618564] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:47.861776] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T18:07:47.922969] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-24T18:07:47.923081] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-24T18:07:47.924208] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-24T18:07:47.924293] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-24T18:07:47.952557] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-24T18:07:47.961430] [DEBUG] [LOCAL ] COTY: Trimmed 77092 records to 53254 (keeping 200 days of data) [2025-09-24T18:07:47.962870] [INFO ] [REMOTE ] CP: Full fetch complete (77127 records). [2025-09-24T18:07:47.963003] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-24T18:07:48.040102] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-24T18:07:48.486860] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-24T18:07:48.488721] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-24T18:07:48.491718] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-24T18:07:48.493162] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-24T18:07:48.498890] [DEBUG] [LOCAL ] CP: Trimmed 77127 records to 53276 (keeping 200 days of data) [2025-09-24T18:07:48.817062] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-24T18:07:48.993099] [DEBUG] [LOCAL ] COTY: Primary data saved (53254 records). [2025-09-24T18:07:48.995335] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-24T18:07:48.995465] [INFO ] [MAIN ] Update Progress: 514/2373 symbols completed. COTY took 41.3s. Estimated remaining: 4h 5m 3s. Rate: 7.6 symbols/min [2025-09-24T18:07:49.120448] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-24T18:07:49.196909] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:49.203842] [DEBUG] [LOCAL ] CP: Primary data saved (53276 records). [2025-09-24T18:07:49.203961] [INFO ] [MAIN ] CP: Full history saved. [2025-09-24T18:07:49.204105] [INFO ] [MAIN ] Update Progress: 515/2373 symbols completed. CP took 31.9s. Estimated remaining: 4h 4m 27s. Rate: 7.6 symbols/min [2025-09-24T18:07:49.365118] [DEBUG] [LOCAL ] CPF: Loaded 15434 existing records from primary storage. [2025-09-24T18:07:49.391181] [INFO ] [MAIN ] CPF: Loaded 15434 existing records. [2025-09-24T18:07:49.392312] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:07:49.498880] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:07:49.596949] [DEBUG] [LOCAL ] CPK: Loaded 13338 existing records from primary storage. [2025-09-24T18:07:49.605210] [INFO ] [MAIN ] CPK: Loaded 13338 existing records. [2025-09-24T18:07:49.620345] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-24T18:07:49.652335] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:49.671753] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-24T18:07:49.700928] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-24T18:07:49.731266] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-24T18:07:49.731401] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-24T18:07:49.967243] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:07:49.976987] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-24T18:07:49.984366] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-24T18:07:50.030403] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-24T18:07:50.063214] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-24T18:07:50.350045] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:50.424806] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-24T18:07:50.555447] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:07:51.153198] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:07:51.216067] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-24T18:07:51.321044] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T18:07:52.016087] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-24T18:07:52.508403] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T18:07:52.816055] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-24T18:07:52.965933] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T18:07:53.616071] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-24T18:07:53.954017] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T18:07:54.391182] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T18:07:54.416032] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-24T18:07:55.138746] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T18:07:55.216099] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-24T18:07:56.016100] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-24T18:07:56.168284] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T18:07:56.816110] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-24T18:07:56.881056] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T18:07:57.616091] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-24T18:07:57.845509] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T18:07:58.416080] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-24T18:07:58.769765] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T18:07:59.177525] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T18:07:59.216104] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-24T18:07:59.629673] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-24T18:08:00.016083] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-24T18:08:00.816135] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-24T18:08:00.914237] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T18:08:01.280602] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-24T18:08:01.616129] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-24T18:08:02.416095] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-24T18:08:02.489565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:08:03.216109] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-24T18:08:03.491872] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T18:08:04.016152] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-24T18:08:04.181841] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T18:08:04.391216] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-24T18:08:04.816128] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-24T18:08:05.616088] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-24T18:08:06.061141] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T18:08:06.302846] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:08:06.416065] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-24T18:08:06.777809] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-24T18:08:07.216075] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-24T18:08:07.757264] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T18:08:07.758187] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-24T18:08:07.758258] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-24T18:08:07.948252] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T18:08:07.948531] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:08:07.948619] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:08:07.948737] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-24T18:08:07.948830] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-24T18:08:07.948870] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-24T18:08:07.948910] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-24T18:08:07.948972] [INFO ] [MAIN ] Update Progress: 516/2373 symbols completed. CPAC took 22.8s. Estimated remaining: 4h 4m 59s. Rate: 7.6 symbols/min [2025-09-24T18:08:08.021265] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-24T18:08:08.131950] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:08.194096] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-24T18:08:08.194253] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-09-24T18:08:08.374113] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:08:08.374358] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-24T18:08:08.374407] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-24T18:08:08.375522] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-24T18:08:08.375584] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-24T18:08:08.774471] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:08.816057] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-24T18:08:08.894439] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T18:08:09.616126] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-24T18:08:10.049463] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T18:08:10.416273] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-24T18:08:10.448282] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T18:08:11.216107] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-24T18:08:11.823221] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:08:12.016050] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-24T18:08:12.058571] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T18:08:12.816127] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-24T18:08:13.224408] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T18:08:13.616139] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-24T18:08:14.416094] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-24T18:08:14.472909] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T18:08:15.134290] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-24T18:08:15.216053] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-24T18:08:15.669989] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T18:08:16.016110] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-24T18:08:16.251714] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T18:08:16.254436] [INFO ] [REMOTE ] CPK: Full fetch complete (17634 records). [2025-09-24T18:08:16.254511] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-24T18:08:16.614857] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-24T18:08:16.614937] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-24T18:08:16.615369] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-24T18:08:16.615410] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-24T18:08:16.615983] [DEBUG] [LOCAL ] CPK: Trimmed 17634 records to 13331 (keeping 200 days of data) [2025-09-24T18:08:16.706378] [DEBUG] [LOCAL ] CPK: Primary data saved (13331 records). [2025-09-24T18:08:16.706583] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-24T18:08:16.706713] [INFO ] [MAIN ] Update Progress: 517/2373 symbols completed. CPK took 27.5s. Estimated remaining: 4h 4m 54s. Rate: 7.6 symbols/min [2025-09-24T18:08:16.816166] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-24T18:08:17.067597] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T18:08:17.616089] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-24T18:08:18.199137] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T18:08:18.416086] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-24T18:08:19.216169] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-24T18:08:19.643118] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T18:08:19.678855] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T18:08:19.684618] [INFO ] [REMOTE ] CPAY: Full fetch complete (45195 records). [2025-09-24T18:08:19.684848] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-24T18:08:20.021392] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-24T18:08:20.075040] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-24T18:08:20.075132] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-24T18:08:20.075789] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-24T18:08:20.075856] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-24T18:08:20.077151] [DEBUG] [LOCAL ] CPAY: Trimmed 45195 records to 30917 (keeping 200 days of data) [2025-09-24T18:08:20.203936] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T18:08:20.208816] [INFO ] [REMOTE ] CPF: Full fetch complete (24275 records). [2025-09-24T18:08:20.209488] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-24T18:08:20.717808] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-24T18:08:20.718171] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-24T18:08:20.719107] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-24T18:08:20.719184] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-24T18:08:20.722966] [DEBUG] [LOCAL ] CPF: Trimmed 24275 records to 15464 (keeping 200 days of data) [2025-09-24T18:08:20.725628] [DEBUG] [LOCAL ] CPAY: Primary data saved (30917 records). [2025-09-24T18:08:20.725834] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-24T18:08:20.725933] [INFO ] [MAIN ] Update Progress: 518/2373 symbols completed. CPAY took 34.1s. Estimated remaining: 4h 4m 32s. Rate: 7.6 symbols/min [2025-09-24T18:08:20.823475] [DEBUG] [LOCAL ] CPF: Primary data saved (15464 records). [2025-09-24T18:08:20.823679] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-24T18:08:20.823805] [INFO ] [MAIN ] Update Progress: 519/2373 symbols completed. CPF took 31.8s. Estimated remaining: 4h 3m 56s. Rate: 7.6 symbols/min [2025-09-24T18:08:22.213791] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-24T18:08:22.224096] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-24T18:08:24.349358] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-24T18:08:24.360368] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-24T18:08:26.426618] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-24T18:08:26.437868] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-24T18:08:28.614982] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T18:08:28.626166] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-24T18:08:30.806156] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-24T18:08:30.817887] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-24T18:08:33.215971] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-24T18:08:33.229162] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-24T18:08:35.493917] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-24T18:08:35.506135] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-24T18:08:38.024426] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-24T18:08:38.034705] [INFO ] [REMOTE ] CPNG: Full fetch complete (77667 records). [2025-09-24T18:08:38.034888] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-24T18:08:38.469057] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-24T18:08:38.469188] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-24T18:08:38.470501] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-24T18:08:38.470576] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-24T18:08:38.473013] [DEBUG] [LOCAL ] CPNG: Trimmed 77667 records to 53670 (keeping 200 days of data) [2025-09-24T18:08:38.833745] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-09-24T18:08:38.833966] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-24T18:08:38.834101] [INFO ] [MAIN ] Update Progress: 520/2373 symbols completed. CPNG took 30.9s. Estimated remaining: 4h 4m 24s. Rate: 7.6 symbols/min [2025-09-24T18:08:39.577561] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:39.583568] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:39.604330] [DEBUG] [LOCAL ] CPT: No existing data file found in primary storage. [2025-09-24T18:08:39.625422] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:39.627789] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:39.628376] [WARN ] [MAIN ] CPT: No existing data found, performing full refresh instead. [2025-09-24T18:08:39.629957] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-24T18:08:39.630121] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-24T18:08:39.630192] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-09-24T18:08:39.630229] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-24T18:08:39.757059] [DEBUG] [LOCAL ] CQP: Loaded 19922 existing records from primary storage. [2025-09-24T18:08:39.768142] [INFO ] [MAIN ] CQP: Loaded 19922 existing records. [2025-09-24T18:08:39.895544] [DEBUG] [LOCAL ] CPS: Loaded 26259 existing records from primary storage. [2025-09-24T18:08:39.962600] [INFO ] [MAIN ] CPS: Loaded 26259 existing records. [2025-09-24T18:08:40.295769] [DEBUG] [LOCAL ] CPRI: Loaded 52595 existing records from primary storage. [2025-09-24T18:08:40.306497] [INFO ] [MAIN ] CPRI: Loaded 52595 existing records. [2025-09-24T18:08:40.295930] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:08:40.333049] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-24T18:08:40.362702] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-24T18:08:40.430186] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-24T18:08:40.463835] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-24T18:08:40.569538] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:40.617327] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-24T18:08:40.743182] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:08:40.851145] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-24T18:08:40.896379] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-24T18:08:40.908565] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-24T18:08:40.908717] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:08:40.934000] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-24T18:08:40.918475] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-24T18:08:40.940755] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-24T18:08:40.966502] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-24T18:08:41.022292] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-24T18:08:41.295072] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:41.327210] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-24T18:08:41.817920] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:41.848144] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:41.842620] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-24T18:08:41.848421] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-24T18:08:42.265391] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:08:42.273372] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-24T18:08:42.520284] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T18:08:42.524984] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-24T18:08:42.630030] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T18:08:42.634376] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-24T18:08:43.510826] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T18:08:43.525130] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-24T18:08:43.540197] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T18:08:43.545555] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-24T18:08:43.689622] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T18:08:43.695784] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-24T18:08:43.725310] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T18:08:43.736376] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-24T18:08:44.530033] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T18:08:44.535330] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-24T18:08:45.029893] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T18:08:45.035493] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-24T18:08:45.061404] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T18:08:45.071055] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-24T18:08:45.432137] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:08:45.443079] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-24T18:08:45.829726] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:08:45.836270] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-24T18:08:46.110261] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T18:08:46.116855] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-24T18:08:46.822790] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T18:08:46.833010] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-24T18:08:47.047281] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:08:47.058471] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-24T18:08:47.140556] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T18:08:47.145287] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-24T18:08:47.198221] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T18:08:47.205397] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-24T18:08:47.966328] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T18:08:47.971459] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-24T18:08:48.157594] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:08:48.164566] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-24T18:08:48.612327] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T18:08:48.622582] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-24T18:08:48.692968] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T18:08:48.704451] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-24T18:08:48.828681] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T18:08:48.836235] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-24T18:08:48.853572] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T18:08:48.859738] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-24T18:08:49.961572] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:08:49.967588] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-24T18:08:50.015711] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T18:08:50.027300] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-24T18:08:50.121256] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T18:08:50.131171] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-24T18:08:50.499578] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T18:08:50.510909] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-24T18:08:51.027466] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T18:08:51.176365] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T18:08:51.216041] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-24T18:08:51.579471] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T18:08:52.016106] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-24T18:08:52.127378] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:08:52.418036] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:08:52.423042] [INFO ] [REMOTE ] CPS: Full fetch complete (36320 records). [2025-09-24T18:08:52.423208] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-24T18:08:52.821979] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-24T18:08:53.028615] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-24T18:08:53.028847] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-24T18:08:53.029834] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-24T18:08:53.030032] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-24T18:08:53.031725] [DEBUG] [LOCAL ] CPS: Trimmed 36320 records to 26208 (keeping 200 days of data) [2025-09-24T18:08:53.167139] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T18:08:53.172243] [INFO ] [REMOTE ] CQP: Full fetch complete (30832 records). [2025-09-24T18:08:53.173045] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-24T18:08:53.618172] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-24T18:08:53.684809] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-24T18:08:53.685720] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-24T18:08:53.687163] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-24T18:08:53.687908] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-24T18:08:53.691797] [DEBUG] [LOCAL ] CQP: Trimmed 30832 records to 19841 (keeping 200 days of data) [2025-09-24T18:08:53.846911] [DEBUG] [LOCAL ] CPS: Primary data saved (26208 records). [2025-09-24T18:08:53.848119] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-24T18:08:53.848489] [INFO ] [MAIN ] Update Progress: 521/2373 symbols completed. CPS took 15.0s. Estimated remaining: 4h 4m 42s. Rate: 7.6 symbols/min [2025-09-24T18:08:54.028898] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:54.050880] [DEBUG] [LOCAL ] CQP: Primary data saved (19841 records). [2025-09-24T18:08:54.057663] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-24T18:08:54.058706] [INFO ] [MAIN ] Update Progress: 522/2373 symbols completed. CQP took 15.2s. Estimated remaining: 4h 4m 6s. Rate: 7.6 symbols/min [2025-09-24T18:08:54.064482] [DEBUG] [LOCAL ] CR: Loaded 24782 existing records from primary storage. [2025-09-24T18:08:54.071122] [INFO ] [MAIN ] CR: Loaded 24782 existing records. [2025-09-24T18:08:54.398563] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:08:54.439477] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-24T18:08:54.439263] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:08:54.439635] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-24T18:08:54.439905] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-24T18:08:54.439961] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-24T18:08:54.440005] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-24T18:08:54.440038] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-24T18:08:54.488021] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-24T18:08:54.511689] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-24T18:08:54.542158] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-24T18:08:54.554031] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-24T18:08:55.125127] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:55.131214] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-24T18:08:55.253545] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:08:55.255325] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-24T18:08:55.255622] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-24T18:08:55.512274] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T18:08:56.016127] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-24T18:08:56.323769] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T18:08:56.466170] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:08:56.816147] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-24T18:08:57.577109] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-24T18:08:57.616035] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-24T18:08:57.756255] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:08:58.375812] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T18:08:58.416046] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-24T18:08:59.005188] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T18:08:59.216084] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-24T18:08:59.957853] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T18:09:00.016103] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-24T18:09:00.816133] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-24T18:09:01.616084] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-24T18:09:01.736453] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T18:09:02.416174] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-24T18:09:02.821938] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T18:09:03.079420] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T18:09:03.216085] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-24T18:09:04.016183] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-24T18:09:04.294312] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T18:09:04.458203] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-24T18:09:04.816096] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-24T18:09:05.616165] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-24T18:09:05.753317] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:09:05.762980] [INFO ] [REMOTE ] CPRI: Full fetch complete (76161 records). [2025-09-24T18:09:05.763137] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-24T18:09:06.189103] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-24T18:09:06.189191] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-24T18:09:06.190359] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-24T18:09:06.190437] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-24T18:09:06.194547] [DEBUG] [LOCAL ] CPRI: Trimmed 76161 records to 52566 (keeping 200 days of data) [2025-09-24T18:09:06.417416] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-24T18:09:06.519791] [DEBUG] [LOCAL ] CPRI: Primary data saved (52566 records). [2025-09-24T18:09:06.519988] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-24T18:09:06.520119] [INFO ] [MAIN ] Update Progress: 523/2373 symbols completed. CPRI took 27.7s. Estimated remaining: 4h 4m 14s. Rate: 7.6 symbols/min [2025-09-24T18:09:06.687960] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T18:09:06.716158] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:06.773538] [DEBUG] [LOCAL ] CRBG: Loaded 52352 existing records from primary storage. [2025-09-24T18:09:06.773713] [INFO ] [MAIN ] CRBG: Loaded 52352 existing records. [2025-09-24T18:09:06.970227] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:06.989823] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-24T18:09:06.990091] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-24T18:09:06.991281] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-24T18:09:06.998447] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-24T18:09:06.998920] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-24T18:09:07.032619] [INFO ] [REMOTE ] CPT: Full fetch complete (63553 records). [2025-09-24T18:09:07.077948] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-24T18:09:07.229320] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-24T18:09:07.720086] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:07.827766] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-24T18:09:07.827893] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-24T18:09:07.828797] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-24T18:09:07.828880] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-24T18:09:07.832236] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T18:09:07.837239] [DEBUG] [LOCAL ] CPT: Trimmed 63553 records to 44379 (keeping 200 days of data) [2025-09-24T18:09:08.022257] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-24T18:09:08.129833] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-24T18:09:08.139100] [DEBUG] [LOCAL ] CPT: Primary data saved (44379 records). [2025-09-24T18:09:08.139278] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-24T18:09:08.139367] [INFO ] [MAIN ] Update Progress: 524/2373 symbols completed. CPT took 29.3s. Estimated remaining: 4h 3m 44s. Rate: 7.6 symbols/min [2025-09-24T18:09:08.326991] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:08.381869] [DEBUG] [LOCAL ] CRC: Loaded 44375 existing records from primary storage. [2025-09-24T18:09:08.382033] [INFO ] [MAIN ] CRC: Loaded 44375 existing records. [2025-09-24T18:09:08.564248] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:08.564579] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-24T18:09:08.564687] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-24T18:09:08.566363] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-24T18:09:08.566671] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-24T18:09:08.821453] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-24T18:09:08.934326] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:09.107788] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T18:09:09.616167] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-24T18:09:09.645907] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T18:09:09.648134] [INFO ] [REMOTE ] CRBD: Full fetch complete (15501 records). [2025-09-24T18:09:09.648257] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-24T18:09:09.845629] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T18:09:09.846074] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:09:09.846153] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:09:09.846234] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-24T18:09:09.846344] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-24T18:09:09.846431] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-24T18:09:09.846500] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-24T18:09:09.846668] [INFO ] [MAIN ] Update Progress: 525/2373 symbols completed. CRBD took 15.8s. Estimated remaining: 4h 3m 15s. Rate: 7.6 symbols/min [2025-09-24T18:09:10.016764] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:10.016958] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-24T18:09:10.017014] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-24T18:09:10.017164] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-24T18:09:10.017207] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-24T18:09:10.017250] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-24T18:09:10.017284] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-24T18:09:10.395451] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:10.416095] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-24T18:09:10.616067] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:10.616586] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-24T18:09:10.724609] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-24T18:09:11.216131] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-24T18:09:12.016126] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-24T18:09:12.816067] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-24T18:09:13.123996] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T18:09:13.127666] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T18:09:13.295368] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:13.295836] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-24T18:09:13.616104] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-24T18:09:14.416248] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-24T18:09:15.047292] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T18:09:15.216098] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-24T18:09:16.016082] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-24T18:09:16.141463] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:09:16.704855] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T18:09:16.816114] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-24T18:09:17.616064] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-24T18:09:17.863672] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T18:09:18.416167] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-24T18:09:18.622474] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:18.623097] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-24T18:09:19.216187] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-24T18:09:19.337000] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T18:09:19.477158] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:19.477634] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-24T18:09:19.530478] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-24T18:09:20.016113] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-24T18:09:20.816139] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-24T18:09:21.486178] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T18:09:21.616087] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-24T18:09:21.853812] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:21.854138] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-24T18:09:22.416197] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-24T18:09:22.574562] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T18:09:23.216106] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-24T18:09:23.422268] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:09:23.422601] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-24T18:09:23.893844] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:09:24.016149] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-24T18:09:24.816123] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-24T18:09:25.616122] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-24T18:09:25.974240] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T18:09:26.416065] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-24T18:09:26.694086] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T18:09:27.216083] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-24T18:09:27.516602] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:09:28.007761] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-24T18:09:28.016825] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-24T18:09:28.816136] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-24T18:09:29.066917] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T18:09:29.095479] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T18:09:29.616098] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-24T18:09:30.416120] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-24T18:09:30.450629] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:09:30.832088] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T18:09:30.839855] [INFO ] [REMOTE ] CR: Full fetch complete (34842 records). [2025-09-24T18:09:30.840112] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-24T18:09:30.843137] [FATAL] [VALIDATOR ] CR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:09:30.843238] [FATAL] [MAIN ] CR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:09:30.843323] [WARN ] [MAIN ] CR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:09:30.843413] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-24T18:09:30.843501] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-24T18:09:30.843565] [INFO ] [LOCAL ] CR: Starting deletion of derivative data. [2025-09-24T18:09:30.844025] [DEBUG] [LOCAL ] CR: Deleted derivative data file. [2025-09-24T18:09:30.844151] [INFO ] [MAIN ] Update Progress: 526/2373 symbols completed. CR took 37.0s. Estimated remaining: 4h 3m 53s. Rate: 7.6 symbols/min [2025-09-24T18:09:31.040459] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:31.103959] [DEBUG] [LOCAL ] CRGY: Loaded 52511 existing records from primary storage. [2025-09-24T18:09:31.104149] [INFO ] [MAIN ] CRGY: Loaded 52511 existing records. [2025-09-24T18:09:31.221270] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-24T18:09:31.291447] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:31.291780] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-24T18:09:31.291842] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-24T18:09:31.293299] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-24T18:09:31.293362] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-24T18:09:31.655569] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:32.016056] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-24T18:09:32.070818] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:09:32.816166] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-24T18:09:33.028354] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T18:09:33.616066] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-24T18:09:33.822444] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T18:09:34.416132] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-24T18:09:34.578026] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T18:09:35.216150] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-24T18:09:36.016178] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-24T18:09:36.117719] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:09:36.477310] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-24T18:09:36.816064] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-24T18:09:36.963312] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:09:37.616092] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-24T18:09:38.134325] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-24T18:09:38.267740] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T18:09:38.416085] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-24T18:09:39.216087] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-24T18:09:40.016045] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-24T18:09:40.115108] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T18:09:40.125249] [INFO ] [REMOTE ] CRBG: Full fetch complete (75689 records). [2025-09-24T18:09:40.125413] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-24T18:09:40.573366] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-24T18:09:40.577196] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-24T18:09:40.579460] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-24T18:09:40.579637] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-24T18:09:40.578441] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.96 seconds). [2025-09-24T18:09:40.592958] [DEBUG] [LOCAL ] CRBG: Trimmed 75689 records to 52339 (keeping 200 days of data) [2025-09-24T18:09:40.718922] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T18:09:40.817398] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-24T18:09:40.964326] [DEBUG] [LOCAL ] CRBG: Primary data saved (52339 records). [2025-09-24T18:09:40.964477] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-24T18:09:40.964624] [INFO ] [MAIN ] Update Progress: 527/2373 symbols completed. CRBG took 34.4s. Estimated remaining: 4h 3m 52s. Rate: 7.6 symbols/min [2025-09-24T18:09:41.132601] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:41.187399] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-24T18:09:41.187664] [INFO ] [MAIN ] CRH: Loaded 53472 existing records. [2025-09-24T18:09:41.362935] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:41.363191] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-24T18:09:41.363252] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-24T18:09:41.364810] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-24T18:09:41.364882] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-24T18:09:41.617461] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-24T18:09:41.725121] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:41.847174] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:09:41.855690] [INFO ] [REMOTE ] CRC: Full fetch complete (62227 records). [2025-09-24T18:09:41.855861] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-24T18:09:42.265002] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-24T18:09:42.265088] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-24T18:09:42.265946] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-24T18:09:42.266016] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-24T18:09:42.267412] [DEBUG] [LOCAL ] CRC: Trimmed 62227 records to 44323 (keeping 200 days of data) [2025-09-24T18:09:42.452165] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-24T18:09:42.546151] [DEBUG] [LOCAL ] CRC: Primary data saved (44323 records). [2025-09-24T18:09:42.546277] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-24T18:09:42.546373] [INFO ] [MAIN ] Update Progress: 528/2373 symbols completed. CRC took 34.4s. Estimated remaining: 4h 3m 22s. Rate: 7.6 symbols/min [2025-09-24T18:09:42.716001] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:42.763272] [DEBUG] [LOCAL ] CRI: Loaded 49985 existing records from primary storage. [2025-09-24T18:09:42.763434] [INFO ] [MAIN ] CRI: Loaded 49985 existing records. [2025-09-24T18:09:42.943075] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:42.943292] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-24T18:09:42.943348] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-24T18:09:42.944858] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-24T18:09:42.944921] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-24T18:09:43.380607] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:43.381424] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-24T18:09:43.435947] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:09:43.755764] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-09-24T18:09:43.764739] [INFO ] [REMOTE ] CRCL: Full fetch complete (29829 records). [2025-09-24T18:09:43.764834] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-24T18:09:43.954234] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-24T18:09:43.954689] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:09:43.954972] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:09:43.955195] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-24T18:09:43.955336] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-24T18:09:43.955444] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-24T18:09:43.955538] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-24T18:09:43.955632] [INFO ] [MAIN ] Update Progress: 529/2373 symbols completed. CRCL took 34.1s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-24T18:09:44.025044] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-24T18:09:44.133425] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:09:44.168203] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T18:09:44.239274] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-24T18:09:44.239447] [INFO ] [MAIN ] CRK: Loaded 52121 existing records. [2025-09-24T18:09:44.416884] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:09:44.417171] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-24T18:09:44.417226] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-24T18:09:44.418508] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-24T18:09:44.418570] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-24T18:09:44.798584] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:09:44.816091] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-24T18:09:45.057198] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T18:09:45.616107] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-24T18:09:46.037585] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:09:46.416119] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-24T18:09:46.650685] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T18:09:47.216172] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-24T18:09:47.565615] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T18:09:47.628997] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T18:09:48.016180] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-24T18:09:48.816076] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-24T18:09:49.437125] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-24T18:09:49.601731] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T18:09:49.616050] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-24T18:09:50.416124] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-24T18:09:51.157611] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-24T18:09:51.216057] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-24T18:09:51.435832] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T18:09:52.016101] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-24T18:09:52.165783] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:09:52.816088] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-24T18:09:52.887053] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T18:09:53.616046] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-24T18:09:53.665072] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T18:09:54.416102] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-24T18:09:54.714515] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T18:09:55.216206] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-24T18:09:55.410366] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:09:55.813801] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T18:09:56.016140] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-24T18:09:56.816105] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-24T18:09:57.601280] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T18:09:57.616054] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-24T18:09:57.949446] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T18:09:58.023049] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T18:09:58.416084] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-24T18:09:58.983967] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:09:59.216136] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-24T18:10:00.016084] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-24T18:10:00.198833] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T18:10:00.816144] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-24T18:10:00.882968] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T18:10:01.616083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-24T18:10:02.021669] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T18:10:02.031630] [INFO ] [REMOTE ] CRGY: Full fetch complete (75955 records). [2025-09-24T18:10:02.031852] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-24T18:10:02.423707] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-24T18:10:02.454117] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-24T18:10:02.454227] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-24T18:10:02.455460] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-24T18:10:02.455529] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-24T18:10:02.458668] [DEBUG] [LOCAL ] CRGY: Trimmed 75955 records to 52514 (keeping 200 days of data) [2025-09-24T18:10:02.805277] [DEBUG] [LOCAL ] CRGY: Primary data saved (52514 records). [2025-09-24T18:10:02.805433] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-24T18:10:02.805533] [INFO ] [MAIN ] Update Progress: 530/2373 symbols completed. CRGY took 32.0s. Estimated remaining: 4h 3m 22s. Rate: 7.6 symbols/min [2025-09-24T18:10:03.003527] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:03.004001] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-09-24T18:10:03.004181] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-09-24T18:10:03.004433] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-24T18:10:03.004592] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-24T18:10:03.004786] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-24T18:10:03.004842] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-24T18:10:03.399329] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:03.399814] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-24T18:10:03.527816] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-24T18:10:04.016177] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-24T18:10:04.137742] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-24T18:10:04.238201] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T18:10:04.816143] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-24T18:10:05.203029] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T18:10:05.616218] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-24T18:10:06.129176] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-24T18:10:06.416069] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-24T18:10:06.856759] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T18:10:06.864977] [INFO ] [REMOTE ] CRI: Full fetch complete (70571 records). [2025-09-24T18:10:06.865099] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-24T18:10:06.865870] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:10:06.865960] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:10:06.866003] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:10:06.866070] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-24T18:10:06.866137] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-24T18:10:06.866172] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-09-24T18:10:06.866699] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-09-24T18:10:06.866807] [INFO ] [MAIN ] Update Progress: 531/2373 symbols completed. CRI took 24.3s. Estimated remaining: 4h 3m 1s. Rate: 7.6 symbols/min [2025-09-24T18:10:07.055171] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:07.122230] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-24T18:10:07.122409] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-24T18:10:07.222710] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-24T18:10:07.327932] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:07.329036] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-24T18:10:07.329152] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-24T18:10:07.339466] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-24T18:10:07.345301] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-24T18:10:07.428958] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T18:10:07.746015] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:08.016059] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-24T18:10:08.209409] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T18:10:08.816142] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-24T18:10:09.108230] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T18:10:09.616089] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-24T18:10:10.395783] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-24T18:10:10.416044] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-24T18:10:10.463188] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T18:10:11.216134] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-24T18:10:11.549691] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T18:10:12.016154] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-24T18:10:12.759432] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-24T18:10:12.816117] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-24T18:10:13.039230] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T18:10:13.616085] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-24T18:10:14.128588] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-24T18:10:14.416158] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-24T18:10:14.553848] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T18:10:15.135247] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T18:10:15.216129] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-24T18:10:16.016147] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-24T18:10:16.378588] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T18:10:16.388817] [INFO ] [REMOTE ] CRH: Full fetch complete (77298 records). [2025-09-24T18:10:16.389035] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-24T18:10:16.817270] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-24T18:10:16.838731] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-24T18:10:16.838894] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-24T18:10:16.840178] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-24T18:10:16.840297] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-24T18:10:16.843067] [DEBUG] [LOCAL ] CRH: Trimmed 77298 records to 53468 (keeping 200 days of data) [2025-09-24T18:10:17.229148] [DEBUG] [LOCAL ] CRH: Primary data saved (53468 records). [2025-09-24T18:10:17.229423] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-24T18:10:17.229545] [INFO ] [MAIN ] Update Progress: 532/2373 symbols completed. CRH took 36.3s. Estimated remaining: 4h 3m 1s. Rate: 7.6 symbols/min [2025-09-24T18:10:17.427198] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:17.480953] [DEBUG] [LOCAL ] CRS: Loaded 43423 existing records from primary storage. [2025-09-24T18:10:17.481186] [INFO ] [MAIN ] CRS: Loaded 43423 existing records. [2025-09-24T18:10:17.678951] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-24T18:10:17.735255] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:17.741754] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-24T18:10:17.742402] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-24T18:10:17.743798] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-24T18:10:17.756102] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-24T18:10:17.756234] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-24T18:10:17.867049] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T18:10:18.182014] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:18.416137] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-24T18:10:19.216163] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-24T18:10:20.051636] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-09-24T18:10:20.064588] [INFO ] [REMOTE ] CRK: Full fetch complete (75531 records). [2025-09-24T18:10:20.064816] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-24T18:10:20.468233] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T18:10:20.498517] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-24T18:10:20.533391] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-24T18:10:20.533723] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-24T18:10:20.535503] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-24T18:10:20.535587] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-24T18:10:20.573348] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-24T18:10:20.585963] [DEBUG] [LOCAL ] CRK: Trimmed 75531 records to 52121 (keeping 200 days of data) [2025-09-24T18:10:20.822417] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-24T18:10:20.860085] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T18:10:20.983992] [DEBUG] [LOCAL ] CRK: Primary data saved (52121 records). [2025-09-24T18:10:20.984247] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-24T18:10:20.984376] [INFO ] [MAIN ] Update Progress: 533/2373 symbols completed. CRK took 37.0s. Estimated remaining: 4h 2m 39s. Rate: 7.6 symbols/min [2025-09-24T18:10:21.174828] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:21.182338] [DEBUG] [LOCAL ] CRT: Loaded 4954 existing records from primary storage. [2025-09-24T18:10:21.182454] [INFO ] [MAIN ] CRT: Loaded 4954 existing records. [2025-09-24T18:10:21.376229] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:21.376593] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-24T18:10:21.376691] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-24T18:10:21.377182] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-24T18:10:21.377244] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-24T18:10:21.626051] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-24T18:10:21.754609] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:22.162900] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T18:10:22.416092] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-24T18:10:23.214850] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T18:10:23.223803] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-24T18:10:23.257082] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-24T18:10:23.984103] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T18:10:23.991875] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T18:10:24.016049] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-24T18:10:24.631701] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T18:10:24.816128] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-24T18:10:25.616083] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-24T18:10:26.406033] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T18:10:26.416030] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-24T18:10:27.216086] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-24T18:10:28.011444] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-24T18:10:28.017377] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-24T18:10:28.041255] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:10:28.048740] [INFO ] [REMOTE ] CRL: Full fetch complete (62723 records). [2025-09-24T18:10:28.048873] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-24T18:10:28.452524] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-24T18:10:28.452768] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-24T18:10:28.453723] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-24T18:10:28.453812] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-24T18:10:28.455485] [DEBUG] [LOCAL ] CRL: Trimmed 62723 records to 43211 (keeping 200 days of data) [2025-09-24T18:10:28.584810] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T18:10:28.721504] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T18:10:28.786972] [DEBUG] [LOCAL ] CRL: Primary data saved (43211 records). [2025-09-24T18:10:28.787126] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-24T18:10:28.787206] [INFO ] [MAIN ] Update Progress: 534/2373 symbols completed. CRL took 26.0s. Estimated remaining: 4h 2m 31s. Rate: 7.6 symbols/min [2025-09-24T18:10:28.821235] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-24T18:10:28.973335] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:29.014183] [DEBUG] [LOCAL ] CSAN: Loaded 42250 existing records from primary storage. [2025-09-24T18:10:29.014333] [INFO ] [MAIN ] CSAN: Loaded 42250 existing records. [2025-09-24T18:10:29.198465] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:29.198777] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-24T18:10:29.198831] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-24T18:10:29.199770] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-24T18:10:29.199831] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-24T18:10:29.560831] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:29.616063] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-24T18:10:30.416109] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-24T18:10:31.216069] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-24T18:10:31.300544] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T18:10:31.357609] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-24T18:10:31.700479] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T18:10:32.016057] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-24T18:10:32.069802] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T18:10:32.659056] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T18:10:32.816176] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-24T18:10:33.616119] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-24T18:10:34.416089] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-24T18:10:34.990932] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T18:10:35.161023] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T18:10:35.216874] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-24T18:10:35.222667] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-24T18:10:36.016136] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-24T18:10:36.687244] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T18:10:36.816088] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-24T18:10:37.411951] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T18:10:37.616185] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-24T18:10:38.416102] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-24T18:10:38.564385] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-24T18:10:38.784574] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T18:10:39.216084] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-24T18:10:40.009371] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T18:10:40.019020] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-24T18:10:40.816094] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-24T18:10:41.616121] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-24T18:10:41.756502] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:10:41.861435] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-24T18:10:41.871234] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-24T18:10:41.871418] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-24T18:10:42.366025] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-24T18:10:42.366197] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-24T18:10:42.367423] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-24T18:10:42.367496] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-24T18:10:42.369460] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-24T18:10:42.432966] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-24T18:10:42.481601] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T18:10:42.520798] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T18:10:42.800755] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-24T18:10:42.800912] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-24T18:10:42.801003] [INFO ] [MAIN ] Update Progress: 535/2373 symbols completed. CRM took 35.9s. Estimated remaining: 4h 2m 44s. Rate: 7.6 symbols/min [2025-09-24T18:10:42.975681] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:43.009424] [DEBUG] [LOCAL ] CSL: Loaded 31553 existing records from primary storage. [2025-09-24T18:10:43.009567] [INFO ] [MAIN ] CSL: Loaded 31553 existing records. [2025-09-24T18:10:43.188351] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:43.188628] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-24T18:10:43.188719] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-24T18:10:43.189874] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-24T18:10:43.189946] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-24T18:10:43.221278] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-24T18:10:43.562048] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:44.016119] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-24T18:10:44.125108] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T18:10:44.824251] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-24T18:10:44.841733] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:10:45.286540] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T18:10:45.616092] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-24T18:10:46.312870] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T18:10:46.326277] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T18:10:46.416139] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-24T18:10:47.124691] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T18:10:47.127187] [INFO ] [REMOTE ] CRT: Full fetch complete (7625 records). [2025-09-24T18:10:47.127296] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-24T18:10:47.221194] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-24T18:10:47.512972] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-24T18:10:47.513057] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-24T18:10:47.513255] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-24T18:10:47.513294] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-24T18:10:47.513724] [DEBUG] [LOCAL ] CRT: Trimmed 7625 records to 4954 (keeping 200 days of data) [2025-09-24T18:10:47.544059] [DEBUG] [LOCAL ] CRT: Primary data saved (4954 records). [2025-09-24T18:10:47.544203] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-24T18:10:47.544300] [INFO ] [MAIN ] Update Progress: 536/2373 symbols completed. CRT took 26.6s. Estimated remaining: 4h 2m 25s. Rate: 7.6 symbols/min [2025-09-24T18:10:47.718445] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:47.731916] [DEBUG] [LOCAL ] CSR: Loaded 12558 existing records from primary storage. [2025-09-24T18:10:47.732065] [INFO ] [MAIN ] CSR: Loaded 12558 existing records. [2025-09-24T18:10:47.908531] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:47.908822] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-24T18:10:47.908911] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-24T18:10:47.909378] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-24T18:10:47.909438] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-24T18:10:48.021288] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-24T18:10:48.271188] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:48.816070] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-24T18:10:48.999371] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T18:10:49.007305] [INFO ] [REMOTE ] CRS: Full fetch complete (62546 records). [2025-09-24T18:10:49.007460] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-24T18:10:49.407036] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-24T18:10:49.407355] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-24T18:10:49.408949] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-24T18:10:49.409040] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-24T18:10:49.411031] [DEBUG] [LOCAL ] CRS: Trimmed 62546 records to 43297 (keeping 200 days of data) [2025-09-24T18:10:49.542195] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:10:49.640977] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-24T18:10:49.715136] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T18:10:49.751929] [DEBUG] [LOCAL ] CRS: Primary data saved (43297 records). [2025-09-24T18:10:49.752060] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-24T18:10:49.752146] [INFO ] [MAIN ] Update Progress: 537/2373 symbols completed. CRS took 32.5s. Estimated remaining: 4h 1m 57s. Rate: 7.6 symbols/min [2025-09-24T18:10:49.930343] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:49.977187] [DEBUG] [LOCAL ] CSTM: Loaded 47738 existing records from primary storage. [2025-09-24T18:10:49.977370] [INFO ] [MAIN ] CSTM: Loaded 47738 existing records. [2025-09-24T18:10:50.159243] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:50.159528] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-24T18:10:50.159583] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-24T18:10:50.160619] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-24T18:10:50.160708] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-24T18:10:50.421383] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-24T18:10:50.540816] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:51.086547] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T18:10:51.216060] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-24T18:10:51.260666] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:10:52.016118] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-24T18:10:52.816056] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-24T18:10:52.851508] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T18:10:53.458404] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:10:53.616057] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-24T18:10:53.685685] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:10:54.416074] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-24T18:10:54.944767] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T18:10:55.216082] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-24T18:10:56.016197] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-24T18:10:56.060164] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T18:10:56.767271] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T18:10:56.816067] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-24T18:10:57.616139] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-24T18:10:57.645225] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:10:57.653080] [INFO ] [REMOTE ] CSAN: Full fetch complete (60840 records). [2025-09-24T18:10:57.653208] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-24T18:10:58.037847] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-24T18:10:58.037934] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-24T18:10:58.038705] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-24T18:10:58.038768] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-24T18:10:58.039995] [DEBUG] [LOCAL ] CSAN: Trimmed 60840 records to 42311 (keeping 200 days of data) [2025-09-24T18:10:58.279038] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T18:10:58.296615] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T18:10:58.323451] [DEBUG] [LOCAL ] CSAN: Primary data saved (42311 records). [2025-09-24T18:10:58.323622] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-24T18:10:58.323770] [INFO ] [MAIN ] Update Progress: 538/2373 symbols completed. CSAN took 29.5s. Estimated remaining: 4h 1m 52s. Rate: 7.6 symbols/min [2025-09-24T18:10:58.421178] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-24T18:10:58.518872] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:10:58.532573] [DEBUG] [LOCAL ] CSV: Loaded 13081 existing records from primary storage. [2025-09-24T18:10:58.532713] [INFO ] [MAIN ] CSV: Loaded 13081 existing records. [2025-09-24T18:10:58.713790] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:10:58.714109] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-24T18:10:58.714166] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-24T18:10:58.714681] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-24T18:10:58.714743] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-24T18:10:59.078177] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:10:59.216080] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-24T18:10:59.906879] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T18:10:59.986457] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T18:11:00.016058] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-24T18:11:00.816115] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-24T18:11:01.428220] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:11:01.616044] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-24T18:11:02.421315] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-24T18:11:02.438296] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T18:11:02.512526] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T18:11:03.216121] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-24T18:11:03.762386] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T18:11:04.016137] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-24T18:11:04.816080] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-24T18:11:04.891125] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:11:04.923865] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:11:05.616062] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-24T18:11:05.775396] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T18:11:06.416114] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-24T18:11:07.164513] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T18:11:07.216049] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-24T18:11:07.229789] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T18:11:08.016091] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-24T18:11:08.749201] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T18:11:08.816093] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-24T18:11:09.382174] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T18:11:09.616068] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-24T18:11:10.187272] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:11:10.416101] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-24T18:11:11.216075] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-24T18:11:11.281854] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T18:11:11.963282] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T18:11:11.970973] [INFO ] [REMOTE ] CSL: Full fetch complete (45156 records). [2025-09-24T18:11:11.971166] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-24T18:11:12.017795] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-24T18:11:12.340438] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-24T18:11:12.415184] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-24T18:11:12.415295] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-24T18:11:12.416230] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-24T18:11:12.416307] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-24T18:11:12.417688] [DEBUG] [LOCAL ] CSL: Trimmed 45156 records to 31600 (keeping 200 days of data) [2025-09-24T18:11:12.633239] [DEBUG] [LOCAL ] CSL: Primary data saved (31600 records). [2025-09-24T18:11:12.633404] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-24T18:11:12.633532] [INFO ] [MAIN ] Update Progress: 539/2373 symbols completed. CSL took 29.8s. Estimated remaining: 4h 2m 6s. Rate: 7.6 symbols/min [2025-09-24T18:11:12.803128] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:12.803308] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-24T18:11:12.803364] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-24T18:11:12.803520] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-24T18:11:12.803563] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-24T18:11:12.803605] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-24T18:11:12.803675] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-24T18:11:12.823989] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-24T18:11:13.171329] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:13.616065] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-24T18:11:13.753991] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:11:13.777001] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T18:11:13.825504] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:13.825931] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-24T18:11:14.416122] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-24T18:11:15.216108] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-24T18:11:15.480919] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:11:16.016162] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-24T18:11:16.236112] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:16.236470] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-24T18:11:16.277550] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T18:11:16.816132] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-24T18:11:17.022816] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:17.023124] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-24T18:11:17.616092] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-24T18:11:18.416138] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-24T18:11:18.500993] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T18:11:19.216196] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-24T18:11:19.427449] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:19.427851] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-24T18:11:20.016110] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-24T18:11:20.320407] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T18:11:20.416145] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:20.416491] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-24T18:11:20.816097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-24T18:11:21.616056] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-24T18:11:21.774621] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T18:11:22.416097] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-24T18:11:23.216095] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-24T18:11:23.266503] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T18:11:23.283681] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T18:11:23.286844] [INFO ] [REMOTE ] CSTM: Full fetch complete (69069 records). [2025-09-24T18:11:23.287043] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-24T18:11:23.321597] [INFO ] [REMOTE ] CSR: Full fetch complete (17451 records). [2025-09-24T18:11:23.355587] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-24T18:11:24.021074] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-24T18:11:24.078795] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-24T18:11:24.078923] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-24T18:11:24.080115] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-24T18:11:24.081216] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-24T18:11:24.081310] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-24T18:11:24.081808] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-24T18:11:24.082105] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-24T18:11:24.082438] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-24T18:11:24.083318] [DEBUG] [LOCAL ] CSR: Trimmed 17451 records to 12575 (keeping 200 days of data) [2025-09-24T18:11:24.084348] [DEBUG] [LOCAL ] CSTM: Trimmed 69069 records to 47710 (keeping 200 days of data) [2025-09-24T18:11:24.238623] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T18:11:24.292305] [DEBUG] [LOCAL ] CSR: Primary data saved (12575 records). [2025-09-24T18:11:24.293040] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-24T18:11:24.293732] [INFO ] [MAIN ] Update Progress: 540/2373 symbols completed. CSR took 36.7s. Estimated remaining: 4h 2m 10s. Rate: 7.6 symbols/min [2025-09-24T18:11:24.455049] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:24.459269] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-24T18:11:24.567993] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:24.583605] [DEBUG] [LOCAL ] CTBB: Loaded 7105 existing records from primary storage. [2025-09-24T18:11:24.584328] [INFO ] [MAIN ] CTBB: Loaded 7105 existing records. [2025-09-24T18:11:24.782955] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:11:24.784996] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-24T18:11:24.785403] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-24T18:11:24.786852] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-24T18:11:24.787479] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-24T18:11:24.821239] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-24T18:11:25.249577] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:25.257853] [DEBUG] [LOCAL ] CSTM: Primary data saved (47710 records). [2025-09-24T18:11:25.258053] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-24T18:11:25.258285] [INFO ] [MAIN ] Update Progress: 541/2373 symbols completed. CSTM took 35.5s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-24T18:11:25.430442] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:25.441252] [DEBUG] [LOCAL ] CTDD: Loaded 5842 existing records from primary storage. [2025-09-24T18:11:25.441349] [INFO ] [MAIN ] CTDD: Loaded 5842 existing records. [2025-09-24T18:11:25.618254] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-24T18:11:25.621981] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:11:25.623857] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-24T18:11:25.623942] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-24T18:11:25.624332] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-24T18:11:25.624416] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-24T18:11:25.761160] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T18:11:25.995795] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:26.416097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-24T18:11:26.655043] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T18:11:27.155282] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:11:27.216027] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-24T18:11:28.016058] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-24T18:11:28.176696] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T18:11:28.816104] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-24T18:11:28.869156] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T18:11:29.544232] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T18:11:29.616113] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-24T18:11:30.416130] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-24T18:11:30.575386] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T18:11:30.580277] [INFO ] [REMOTE ] CSV: Full fetch complete (19487 records). [2025-09-24T18:11:30.580499] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-24T18:11:31.041292] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-24T18:11:31.041413] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-24T18:11:31.042050] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-24T18:11:31.042134] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-24T18:11:31.043325] [DEBUG] [LOCAL ] CSV: Trimmed 19487 records to 13045 (keeping 200 days of data) [2025-09-24T18:11:31.131358] [DEBUG] [LOCAL ] CSV: Primary data saved (13045 records). [2025-09-24T18:11:31.131516] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-24T18:11:31.131713] [INFO ] [MAIN ] Update Progress: 542/2373 symbols completed. CSV took 32.8s. Estimated remaining: 4h 1m 24s. Rate: 7.6 symbols/min [2025-09-24T18:11:31.238043] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-24T18:11:31.336026] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:31.336538] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-24T18:11:31.336675] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-24T18:11:31.337045] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-24T18:11:31.337117] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-24T18:11:31.337244] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-24T18:11:31.337357] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-24T18:11:31.422457] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T18:11:31.715904] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:31.892540] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T18:11:32.016094] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-24T18:11:32.764382] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T18:11:32.816083] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-24T18:11:33.586674] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-24T18:11:33.616073] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-24T18:11:34.303807] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T18:11:34.416085] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-24T18:11:35.216107] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-24T18:11:35.370269] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T18:11:35.546800] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:35.547126] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-24T18:11:36.016077] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-24T18:11:36.816103] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-24T18:11:37.221020] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:11:37.227033] [INFO ] [REMOTE ] CSW: Full fetch complete (8065 records). [2025-09-24T18:11:37.227246] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-24T18:11:37.486629] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T18:11:37.501217] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-24T18:11:37.501618] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:11:37.501720] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:11:37.501802] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-24T18:11:37.501874] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-24T18:11:37.501911] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-24T18:11:37.501966] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-24T18:11:37.502042] [INFO ] [MAIN ] Update Progress: 543/2373 symbols completed. CSW took 24.9s. Estimated remaining: 4h 1m 11s. Rate: 7.6 symbols/min [2025-09-24T18:11:37.621266] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-24T18:11:37.673901] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:37.674209] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-24T18:11:37.674267] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-24T18:11:37.674406] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-24T18:11:37.674449] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-24T18:11:37.674490] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-24T18:11:37.674523] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-24T18:11:37.924183] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:37.946988] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-24T18:11:38.065357] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:38.416080] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-24T18:11:38.618692] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:38.619021] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-24T18:11:39.216083] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-24T18:11:39.431250] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:39.431595] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-24T18:11:40.016078] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-24T18:11:40.427405] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-24T18:11:40.816097] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-24T18:11:41.015962] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:41.016276] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-24T18:11:41.616106] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-24T18:11:42.416056] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-24T18:11:42.653725] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T18:11:42.948077] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T18:11:43.216100] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-24T18:11:43.424760] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:43.425153] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-24T18:11:44.016139] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-24T18:11:44.638796] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T18:11:44.816106] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-24T18:11:45.524744] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T18:11:45.616123] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-24T18:11:46.288721] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T18:11:46.416123] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-24T18:11:46.745256] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:46.745577] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-24T18:11:47.216118] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-24T18:11:47.994586] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T18:11:47.996302] [INFO ] [REMOTE ] CTBB: Full fetch complete (10941 records). [2025-09-24T18:11:47.996377] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-24T18:11:48.021215] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-24T18:11:48.382502] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-24T18:11:48.382618] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-24T18:11:48.383175] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-24T18:11:48.383239] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-24T18:11:48.385106] [DEBUG] [LOCAL ] CTBB: Trimmed 10941 records to 7061 (keeping 200 days of data) [2025-09-24T18:11:48.430144] [DEBUG] [LOCAL ] CTBB: Primary data saved (7061 records). [2025-09-24T18:11:48.430304] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-24T18:11:48.430469] [INFO ] [MAIN ] Update Progress: 544/2373 symbols completed. CTBB took 24.1s. Estimated remaining: 4h 1m 13s. Rate: 7.6 symbols/min [2025-09-24T18:11:48.606698] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:48.654677] [DEBUG] [LOCAL ] CTO: Loaded 28318 existing records from primary storage. [2025-09-24T18:11:48.654820] [INFO ] [MAIN ] CTO: Loaded 28318 existing records. [2025-09-24T18:11:48.821509] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-24T18:11:48.844158] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:11:48.844839] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-24T18:11:48.844925] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-24T18:11:48.845921] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-24T18:11:48.845987] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-24T18:11:49.044804] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T18:11:49.247971] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:11:49.616095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-24T18:11:49.654435] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T18:11:50.416104] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-24T18:11:51.104892] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T18:11:51.212779] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T18:11:51.216025] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-24T18:11:51.488683] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-24T18:11:52.016103] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-24T18:11:52.804432] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T18:11:52.816069] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-24T18:11:53.616122] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-24T18:11:53.723934] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T18:11:54.222997] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T18:11:54.416137] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-24T18:11:55.216144] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-24T18:11:55.438404] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-24T18:11:55.496070] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T18:11:56.016080] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-24T18:11:56.816096] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-24T18:11:57.304969] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T18:11:57.616080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-24T18:11:57.776009] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T18:11:58.179703] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-24T18:11:58.416119] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-24T18:11:58.747363] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:58.747817] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-24T18:11:59.216123] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-24T18:11:59.558522] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:11:59.558866] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-24T18:11:59.558970] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-24T18:11:59.559046] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-24T18:11:59.559693] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:11:59.559773] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:11:59.559839] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:11:59.559932] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-24T18:11:59.560012] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-24T18:11:59.560063] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-24T18:11:59.560145] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-24T18:11:59.560256] [INFO ] [MAIN ] Update Progress: 545/2373 symbols completed. CTEST took 28.4s. Estimated remaining: 4h 1m 16s. Rate: 7.6 symbols/min [2025-09-24T18:11:59.736480] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:11:59.796535] [DEBUG] [LOCAL ] CTOS: Loaded 36812 existing records from primary storage. [2025-09-24T18:11:59.796725] [INFO ] [MAIN ] CTOS: Loaded 36812 existing records. [2025-09-24T18:11:59.989418] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:11:59.990063] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-24T18:11:59.990122] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-24T18:11:59.991262] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-24T18:11:59.991326] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-24T18:12:00.022324] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-24T18:12:00.375797] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:00.693123] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-24T18:12:00.816094] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-24T18:12:01.616076] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-24T18:12:01.678744] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T18:12:02.416130] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-24T18:12:03.216114] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-24T18:12:04.016133] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-24T18:12:04.568608] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-24T18:12:04.816136] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-24T18:12:05.013661] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-24T18:12:05.015263] [INFO ] [REMOTE ] CTDD: Full fetch complete (8533 records). [2025-09-24T18:12:05.015344] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-24T18:12:05.345519] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T18:12:05.442416] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-24T18:12:05.442512] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-24T18:12:05.442743] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-24T18:12:05.442806] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-24T18:12:05.443278] [DEBUG] [LOCAL ] CTDD: Trimmed 8533 records to 5838 (keeping 200 days of data) [2025-09-24T18:12:05.483445] [DEBUG] [LOCAL ] CTDD: Primary data saved (5838 records). [2025-09-24T18:12:05.483604] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-24T18:12:05.483814] [INFO ] [MAIN ] Update Progress: 546/2373 symbols completed. CTDD took 40.2s. Estimated remaining: 4h 1m 1s. Rate: 7.6 symbols/min [2025-09-24T18:12:05.621001] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-24T18:12:05.669570] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:05.750201] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-24T18:12:05.750369] [INFO ] [MAIN ] CTRA: Loaded 53649 existing records. [2025-09-24T18:12:05.963934] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:05.973868] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-24T18:12:05.973697] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:12:05.974301] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-24T18:12:05.977511] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T18:12:05.990266] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-24T18:12:05.990336] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-24T18:12:06.375339] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:06.416091] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-24T18:12:06.921740] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:12:07.216090] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-24T18:12:07.830747] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:12:08.016130] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-24T18:12:08.205161] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T18:12:08.214025] [INFO ] [REMOTE ] CTEV: Full fetch complete (13613 records). [2025-09-24T18:12:08.214839] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-24T18:12:08.402720] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-24T18:12:08.403187] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:12:08.403262] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:12:08.403335] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-24T18:12:08.403414] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-24T18:12:08.403471] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-24T18:12:08.403515] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-24T18:12:08.403578] [INFO ] [MAIN ] Update Progress: 547/2373 symbols completed. CTEV took 30.9s. Estimated remaining: 4h 0m 37s. Rate: 7.6 symbols/min [2025-09-24T18:12:08.574985] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:08.645834] [DEBUG] [LOCAL ] CTRE: Loaded 49212 existing records from primary storage. [2025-09-24T18:12:08.645983] [INFO ] [MAIN ] CTRE: Loaded 49212 existing records. [2025-09-24T18:12:08.823462] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-24T18:12:08.828397] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:08.829311] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-24T18:12:08.829362] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-24T18:12:08.831116] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-24T18:12:08.831178] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-24T18:12:09.199152] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:09.278018] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T18:12:09.616088] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-24T18:12:10.116990] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T18:12:10.416100] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-24T18:12:11.184526] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:12:11.216040] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-24T18:12:12.016060] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-24T18:12:12.378682] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T18:12:12.414380] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T18:12:12.816114] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-24T18:12:13.414880] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T18:12:13.616077] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-24T18:12:14.416107] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-24T18:12:15.216127] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-24T18:12:15.442975] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-24T18:12:16.016068] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-24T18:12:16.379312] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-24T18:12:16.816102] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-24T18:12:16.988975] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T18:12:17.143867] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T18:12:17.197957] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-24T18:12:17.616087] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-24T18:12:18.416037] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-24T18:12:18.492115] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T18:12:18.855931] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T18:12:19.216094] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-24T18:12:19.407457] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T18:12:20.016113] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-24T18:12:20.816070] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-24T18:12:20.902228] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:12:21.299307] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T18:12:21.616147] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-24T18:12:21.907875] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T18:12:22.416170] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-24T18:12:23.221280] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-24T18:12:23.227199] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T18:12:23.712232] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T18:12:23.718486] [INFO ] [REMOTE ] CTO: Full fetch complete (41832 records). [2025-09-24T18:12:23.718673] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-24T18:12:24.019949] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-24T18:12:24.118416] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-24T18:12:24.118510] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-24T18:12:24.119246] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-24T18:12:24.119312] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-24T18:12:24.120566] [DEBUG] [LOCAL ] CTO: Trimmed 41832 records to 28253 (keeping 200 days of data) [2025-09-24T18:12:24.307486] [DEBUG] [LOCAL ] CTO: Primary data saved (28253 records). [2025-09-24T18:12:24.307629] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-24T18:12:24.307758] [INFO ] [MAIN ] Update Progress: 548/2373 symbols completed. CTO took 35.9s. Estimated remaining: 4h 0m 56s. Rate: 7.6 symbols/min [2025-09-24T18:12:24.494082] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:24.537685] [DEBUG] [LOCAL ] CTRI: Loaded 37835 existing records from primary storage. [2025-09-24T18:12:24.537839] [INFO ] [MAIN ] CTRI: Loaded 37835 existing records. [2025-09-24T18:12:24.731511] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:24.732041] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-24T18:12:24.732103] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-24T18:12:24.733055] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-24T18:12:24.733120] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-24T18:12:24.817010] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-24T18:12:25.132516] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:25.161868] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T18:12:25.616087] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-24T18:12:25.765755] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T18:12:26.139822] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T18:12:26.416120] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-24T18:12:27.113605] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:12:27.216079] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-24T18:12:28.016053] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-24T18:12:28.227507] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T18:12:28.256894] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T18:12:28.816093] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-24T18:12:29.616075] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-24T18:12:29.700456] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T18:12:30.094527] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T18:12:30.101064] [INFO ] [REMOTE ] CTOS: Full fetch complete (53411 records). [2025-09-24T18:12:30.101210] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-24T18:12:30.418801] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-24T18:12:30.524749] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-24T18:12:30.524897] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-24T18:12:30.526096] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-24T18:12:30.526235] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-24T18:12:30.534749] [DEBUG] [LOCAL ] CTOS: Trimmed 53411 records to 36721 (keeping 200 days of data) [2025-09-24T18:12:30.553483] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T18:12:30.767244] [DEBUG] [LOCAL ] CTOS: Primary data saved (36721 records). [2025-09-24T18:12:30.767423] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-24T18:12:30.767520] [INFO ] [MAIN ] Update Progress: 549/2373 symbols completed. CTOS took 31.2s. Estimated remaining: 4h 0m 43s. Rate: 7.6 symbols/min [2025-09-24T18:12:30.950042] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:30.972493] [DEBUG] [LOCAL ] CTS: Loaded 19403 existing records from primary storage. [2025-09-24T18:12:30.972695] [INFO ] [MAIN ] CTS: Loaded 19403 existing records. [2025-09-24T18:12:31.170594] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:31.170917] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-24T18:12:31.170973] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-24T18:12:31.171601] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-24T18:12:31.171708] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-24T18:12:31.221289] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-24T18:12:31.568627] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:32.016060] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-24T18:12:32.169595] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:12:32.816138] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-24T18:12:32.939982] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:12:32.995491] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T18:12:33.616077] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-24T18:12:34.416091] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-24T18:12:34.595679] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T18:12:34.604567] [INFO ] [REMOTE ] CTRE: Full fetch complete (71088 records). [2025-09-24T18:12:34.604719] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-24T18:12:34.994091] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-24T18:12:34.994179] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-24T18:12:34.995037] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-24T18:12:34.995101] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-24T18:12:34.996554] [DEBUG] [LOCAL ] CTRE: Trimmed 71088 records to 49225 (keeping 200 days of data) [2025-09-24T18:12:35.216185] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-24T18:12:35.303354] [DEBUG] [LOCAL ] CTRE: Primary data saved (49225 records). [2025-09-24T18:12:35.303700] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-24T18:12:35.303931] [INFO ] [MAIN ] Update Progress: 550/2373 symbols completed. CTRE took 26.9s. Estimated remaining: 4h 0m 24s. Rate: 7.6 symbols/min [2025-09-24T18:12:35.485368] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:35.519714] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T18:12:35.580813] [DEBUG] [LOCAL ] CTVA: Loaded 53229 existing records from primary storage. [2025-09-24T18:12:35.580955] [INFO ] [MAIN ] CTVA: Loaded 53229 existing records. [2025-09-24T18:12:35.775161] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:35.786310] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T18:12:35.786493] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-24T18:12:35.793061] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-24T18:12:35.794481] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-24T18:12:35.794543] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-24T18:12:36.019851] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-24T18:12:36.173837] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T18:12:36.178839] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:36.816090] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-24T18:12:37.616055] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-24T18:12:37.789587] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T18:12:38.278147] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T18:12:38.362873] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T18:12:38.416037] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-24T18:12:39.216064] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-24T18:12:39.406364] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T18:12:40.016098] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-24T18:12:40.816154] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-24T18:12:41.191255] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T18:12:41.616141] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-24T18:12:41.880194] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:12:41.967426] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T18:12:42.416123] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-24T18:12:42.780315] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T18:12:43.216140] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-24T18:12:43.611132] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T18:12:44.016089] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-24T18:12:44.617936] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T18:12:44.816087] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-24T18:12:45.616060] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-24T18:12:45.927686] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T18:12:46.416067] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-24T18:12:46.535608] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T18:12:47.109768] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:12:47.216095] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-24T18:12:48.016086] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-24T18:12:48.410410] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T18:12:48.419864] [INFO ] [REMOTE ] CTRA: Full fetch complete (77664 records). [2025-09-24T18:12:48.419999] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-24T18:12:48.823182] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-24T18:12:48.875551] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-24T18:12:48.875826] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-24T18:12:48.877061] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-24T18:12:48.877616] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-24T18:12:48.907858] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T18:12:48.905975] [DEBUG] [LOCAL ] CTRA: Trimmed 77664 records to 53649 (keeping 200 days of data) [2025-09-24T18:12:49.031227] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T18:12:49.305872] [DEBUG] [LOCAL ] CTRA: Primary data saved (53649 records). [2025-09-24T18:12:49.306037] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-24T18:12:49.306126] [INFO ] [MAIN ] Update Progress: 551/2373 symbols completed. CTRA took 43.8s. Estimated remaining: 4h 0m 36s. Rate: 7.6 symbols/min [2025-09-24T18:12:49.494023] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:49.494322] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-24T18:12:49.494401] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-24T18:12:49.494613] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-24T18:12:49.494691] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-24T18:12:49.494756] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-24T18:12:49.494793] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-24T18:12:49.623594] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-24T18:12:49.887919] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:50.342111] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T18:12:50.416089] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-24T18:12:50.700198] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T18:12:50.949954] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T18:12:51.216083] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-24T18:12:51.548823] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T18:12:52.016089] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-24T18:12:52.329341] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-24T18:12:52.816137] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-24T18:12:53.616093] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-24T18:12:54.416085] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-24T18:12:54.448189] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:12:54.456867] [INFO ] [REMOTE ] CTRI: Full fetch complete (51059 records). [2025-09-24T18:12:54.456985] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-24T18:12:54.647560] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T18:12:54.861413] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-24T18:12:54.861511] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-24T18:12:54.862286] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-24T18:12:54.862353] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-24T18:12:54.863622] [DEBUG] [LOCAL ] CTRI: Trimmed 51059 records to 37887 (keeping 200 days of data) [2025-09-24T18:12:55.089158] [DEBUG] [LOCAL ] CTRI: Primary data saved (37887 records). [2025-09-24T18:12:55.089318] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-24T18:12:55.089409] [INFO ] [MAIN ] Update Progress: 552/2373 symbols completed. CTRI took 30.8s. Estimated remaining: 4h 0m 21s. Rate: 7.6 symbols/min [2025-09-24T18:12:55.221301] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-24T18:12:55.270130] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:55.321146] [DEBUG] [LOCAL ] CUBE: Loaded 50740 existing records from primary storage. [2025-09-24T18:12:55.321285] [INFO ] [MAIN ] CUBE: Loaded 50740 existing records. [2025-09-24T18:12:55.504284] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:55.504519] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-24T18:12:55.504569] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-24T18:12:55.505964] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-24T18:12:55.506027] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-24T18:12:55.847930] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T18:12:55.910985] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:56.016053] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-24T18:12:56.273487] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T18:12:56.816147] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-24T18:12:57.612265] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T18:12:57.621586] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-24T18:12:57.929462] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T18:12:57.933244] [INFO ] [REMOTE ] CTS: Full fetch complete (26556 records). [2025-09-24T18:12:57.933356] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-24T18:12:58.324720] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-24T18:12:58.324832] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-24T18:12:58.325471] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-24T18:12:58.325551] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-24T18:12:58.326591] [DEBUG] [LOCAL ] CTS: Trimmed 26556 records to 19327 (keeping 200 days of data) [2025-09-24T18:12:58.416364] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-24T18:12:58.453761] [DEBUG] [LOCAL ] CTS: Primary data saved (19327 records). [2025-09-24T18:12:58.453901] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-24T18:12:58.453993] [INFO ] [MAIN ] Update Progress: 553/2373 symbols completed. CTS took 27.7s. Estimated remaining: 3h 59m 58s. Rate: 7.6 symbols/min [2025-09-24T18:12:58.639092] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:12:58.665427] [DEBUG] [LOCAL ] CUBI: Loaded 27245 existing records from primary storage. [2025-09-24T18:12:58.665566] [INFO ] [MAIN ] CUBI: Loaded 27245 existing records. [2025-09-24T18:12:58.841307] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:12:58.841543] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-24T18:12:58.841591] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-24T18:12:58.842264] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-24T18:12:58.842325] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-24T18:12:59.218854] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-24T18:12:59.218767] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:12:59.287951] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:12:59.589070] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-24T18:12:59.985303] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:13:00.016095] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-24T18:13:00.331913] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-24T18:13:00.816115] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-24T18:13:01.616142] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-24T18:13:02.158869] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T18:13:02.416127] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-24T18:13:03.216082] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-24T18:13:03.343891] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:13:03.515534] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-24T18:13:03.696146] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:13:04.016107] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-24T18:13:04.344897] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T18:13:04.816095] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-24T18:13:05.616182] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-24T18:13:06.064807] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T18:13:06.416087] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-24T18:13:07.216045] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-24T18:13:07.403000] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T18:13:07.552157] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T18:13:08.016100] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-24T18:13:08.828004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-24T18:13:08.834169] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:13:09.238399] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T18:13:09.616074] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-24T18:13:09.951265] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T18:13:10.416086] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-24T18:13:11.216088] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-24T18:13:11.461603] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T18:13:11.660025] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T18:13:11.661200] [INFO ] [REMOTE ] CUBB: Full fetch complete (927 records). [2025-09-24T18:13:11.661341] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-24T18:13:11.891343] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-24T18:13:11.891829] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:13:11.891986] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:13:11.892076] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-24T18:13:11.892270] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-24T18:13:11.892341] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-24T18:13:11.892542] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-24T18:13:11.892690] [INFO ] [MAIN ] Update Progress: 554/2373 symbols completed. CUBB took 22.6s. Estimated remaining: 4h 0m 8s. Rate: 7.6 symbols/min [2025-09-24T18:13:12.017607] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-24T18:13:12.093622] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:12.130111] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T18:13:12.197031] [DEBUG] [LOCAL ] CUK: Loaded 51014 existing records from primary storage. [2025-09-24T18:13:12.197194] [INFO ] [MAIN ] CUK: Loaded 51014 existing records. [2025-09-24T18:13:12.379091] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:13:12.379363] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-24T18:13:12.379412] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-24T18:13:12.380748] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-24T18:13:12.380810] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-24T18:13:12.748235] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:12.816122] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-24T18:13:13.016266] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T18:13:13.616126] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-24T18:13:14.416045] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-24T18:13:14.803097] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-24T18:13:15.028810] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:13:15.216086] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-24T18:13:15.921114] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T18:13:16.016052] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-24T18:13:16.779359] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T18:13:16.816043] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-24T18:13:17.360862] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T18:13:17.616087] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-24T18:13:18.416045] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-24T18:13:18.595936] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T18:13:18.666710] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T18:13:19.216132] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-24T18:13:20.016136] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-24T18:13:20.266894] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T18:13:20.816152] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-24T18:13:21.034697] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T18:13:21.044730] [INFO ] [REMOTE ] CTVA: Full fetch complete (76943 records). [2025-09-24T18:13:21.044955] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-24T18:13:21.397777] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:13:21.501622] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-24T18:13:21.501796] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-24T18:13:21.502916] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-24T18:13:21.502990] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-24T18:13:21.505235] [DEBUG] [LOCAL ] CTVA: Trimmed 76943 records to 53225 (keeping 200 days of data) [2025-09-24T18:13:21.616178] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-24T18:13:21.887862] [DEBUG] [LOCAL ] CTVA: Primary data saved (53225 records). [2025-09-24T18:13:21.888101] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-24T18:13:21.888223] [INFO ] [MAIN ] Update Progress: 555/2373 symbols completed. CTVA took 46.6s. Estimated remaining: 4h 0m 7s. Rate: 7.6 symbols/min [2025-09-24T18:13:22.077785] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:22.083375] [DEBUG] [LOCAL ] CULP: Loaded 3010 existing records from primary storage. [2025-09-24T18:13:22.083559] [INFO ] [MAIN ] CULP: Loaded 3010 existing records. [2025-09-24T18:13:22.272203] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:13:22.272983] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-24T18:13:22.273055] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-24T18:13:22.273472] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-24T18:13:22.273540] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-24T18:13:22.420093] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-24T18:13:22.688027] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:22.752060] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:13:22.753629] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T18:13:23.216117] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-24T18:13:23.781314] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T18:13:24.016157] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-24T18:13:24.342310] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T18:13:24.816120] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-24T18:13:25.616149] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-24T18:13:25.788971] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T18:13:25.798373] [INFO ] [REMOTE ] CUBE: Full fetch complete (72979 records). [2025-09-24T18:13:25.798519] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-24T18:13:26.215594] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-24T18:13:26.227986] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-24T18:13:26.230980] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-24T18:13:26.231161] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-24T18:13:26.233188] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T18:13:26.239695] [INFO ] [REMOTE ] CUBI: Full fetch complete (39298 records). [2025-09-24T18:13:26.239876] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-24T18:13:26.240143] [DEBUG] [LOCAL ] CUBE: Trimmed 72979 records to 50695 (keeping 200 days of data) [2025-09-24T18:13:26.365827] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T18:13:26.421129] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-24T18:13:26.742278] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-24T18:13:26.743471] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-24T18:13:26.744284] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-24T18:13:26.744839] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-24T18:13:26.748847] [DEBUG] [LOCAL ] CUBI: Trimmed 39298 records to 27343 (keeping 200 days of data) [2025-09-24T18:13:27.036698] [DEBUG] [LOCAL ] CUBI: Primary data saved (27343 records). [2025-09-24T18:13:27.037437] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-24T18:13:27.037594] [INFO ] [MAIN ] Update Progress: 556/2373 symbols completed. CUBI took 28.6s. Estimated remaining: 3h 59m 50s. Rate: 7.6 symbols/min [2025-09-24T18:13:27.233156] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-24T18:13:27.232773] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:27.326876] [DEBUG] [LOCAL ] CURB: Loaded 33003 existing records from primary storage. [2025-09-24T18:13:27.328632] [INFO ] [MAIN ] CURB: Loaded 33003 existing records. [2025-09-24T18:13:27.526894] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:13:27.526761] [DEBUG] [LOCAL ] CUBE: Primary data saved (50695 records). [2025-09-24T18:13:27.527189] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-24T18:13:27.527292] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-24T18:13:27.527480] [INFO ] [MAIN ] Update Progress: 557/2373 symbols completed. CUBE took 32.4s. Estimated remaining: 3h 59m 18s. Rate: 7.6 symbols/min [2025-09-24T18:13:27.527370] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-24T18:13:27.528476] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-24T18:13:27.528541] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-24T18:13:27.907472] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:27.901325] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T18:13:28.016032] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-24T18:13:28.546090] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T18:13:28.816098] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-24T18:13:29.300894] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T18:13:29.479368] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:13:29.616102] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-24T18:13:30.416090] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-24T18:13:31.160013] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T18:13:31.216064] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-24T18:13:31.367237] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T18:13:31.765732] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T18:13:32.016079] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-24T18:13:32.816084] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-24T18:13:33.191511] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T18:13:33.616094] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-24T18:13:34.083376] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T18:13:34.416147] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-24T18:13:34.684348] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T18:13:35.216089] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-24T18:13:35.561129] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T18:13:36.016119] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-24T18:13:36.351397] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T18:13:36.816090] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-24T18:13:37.105479] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T18:13:37.345361] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T18:13:37.616079] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-24T18:13:38.053840] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T18:13:38.416089] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-24T18:13:39.216056] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-24T18:13:39.345818] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T18:13:39.347114] [INFO ] [REMOTE ] CULP: Full fetch complete (4802 records). [2025-09-24T18:13:39.347183] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-24T18:13:39.731384] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-24T18:13:39.731528] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-24T18:13:39.731814] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-24T18:13:39.731908] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-24T18:13:39.732454] [DEBUG] [LOCAL ] CULP: Trimmed 4802 records to 3045 (keeping 200 days of data) [2025-09-24T18:13:39.750903] [DEBUG] [LOCAL ] CULP: Primary data saved (3045 records). [2025-09-24T18:13:39.750985] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-24T18:13:39.751157] [INFO ] [MAIN ] Update Progress: 558/2373 symbols completed. CULP took 17.9s. Estimated remaining: 3h 59m 24s. Rate: 7.6 symbols/min [2025-09-24T18:13:40.016156] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-24T18:13:41.240678] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T18:13:41.253082] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-24T18:13:41.414296] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T18:13:41.616146] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-24T18:13:43.042505] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T18:13:43.052072] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-24T18:13:43.124821] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:13:43.137527] [INFO ] [REMOTE ] CUK: Full fetch complete (73739 records). [2025-09-24T18:13:43.137709] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-24T18:13:43.543625] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-24T18:13:43.543796] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-24T18:13:43.544718] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-24T18:13:43.544792] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-24T18:13:43.548817] [DEBUG] [LOCAL ] CUK: Trimmed 73739 records to 50995 (keeping 200 days of data) [2025-09-24T18:13:43.860676] [DEBUG] [LOCAL ] CUK: Primary data saved (50995 records). [2025-09-24T18:13:43.860858] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-24T18:13:43.861062] [INFO ] [MAIN ] Update Progress: 559/2373 symbols completed. CUK took 32.0s. Estimated remaining: 3h 59m 4s. Rate: 7.6 symbols/min [2025-09-24T18:13:43.892485] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T18:13:43.900851] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-24T18:13:45.150904] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T18:13:45.157718] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-24T18:13:46.481997] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:13:46.489909] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-24T18:13:47.811987] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T18:13:47.820048] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-24T18:13:49.143382] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T18:13:49.149323] [INFO ] [REMOTE ] CURB: Full fetch complete (47217 records). [2025-09-24T18:13:49.149422] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-24T18:13:49.540350] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-24T18:13:49.540513] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-24T18:13:49.541261] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-24T18:13:49.541343] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-24T18:13:49.542874] [DEBUG] [LOCAL ] CURB: Trimmed 47217 records to 32949 (keeping 200 days of data) [2025-09-24T18:13:49.750103] [DEBUG] [LOCAL ] CURB: Primary data saved (32949 records). [2025-09-24T18:13:49.750249] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-24T18:13:49.750395] [INFO ] [MAIN ] Update Progress: 560/2373 symbols completed. CURB took 22.7s. Estimated remaining: 3h 58m 49s. Rate: 7.6 symbols/min [2025-09-24T18:13:50.350336] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:50.372205] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:50.391302] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-09-24T18:13:50.421290] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:50.417718] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-09-24T18:13:50.473165] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:13:50.474290] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-24T18:13:50.440161] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-09-24T18:13:50.474532] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-09-24T18:13:50.474679] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-24T18:13:50.475221] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-24T18:13:50.475310] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-24T18:13:50.475415] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-24T18:13:50.475517] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-24T18:13:50.501754] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-24T18:13:50.501894] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-24T18:13:50.756493] [DEBUG] [LOCAL ] CURV: Loaded 26669 existing records from primary storage. [2025-09-24T18:13:50.786279] [INFO ] [MAIN ] CURV: Loaded 26669 existing records. [2025-09-24T18:13:51.232976] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-09-24T18:13:51.278790] [INFO ] [MAIN ] CVE: Loaded 53556 existing records. [2025-09-24T18:13:51.515614] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:13:51.537384] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:51.584716] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-24T18:13:51.607681] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:51.629112] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-24T18:13:51.628597] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-24T18:13:51.647872] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-24T18:13:51.664622] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-24T18:13:51.680446] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-24T18:13:51.823863] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:13:51.851016] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-24T18:13:51.851539] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-24T18:13:51.859402] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-24T18:13:51.869748] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-24T18:13:52.479884] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:52.495244] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-24T18:13:52.580879] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:13:52.581249] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-24T18:13:52.590784] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T18:13:52.594001] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-24T18:13:53.525242] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-24T18:13:53.527915] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-24T18:13:53.589675] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T18:13:53.599622] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-24T18:13:54.110310] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T18:13:54.118427] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-24T18:13:54.292105] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:13:54.304512] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-24T18:13:54.314535] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T18:13:54.318129] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-24T18:13:55.067458] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T18:13:55.079358] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-24T18:13:55.222082] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T18:13:55.228082] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-24T18:13:55.270421] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T18:13:55.883533] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:13:56.016089] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-24T18:13:56.185374] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:13:56.278513] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T18:13:56.816092] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-24T18:13:57.547316] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T18:13:57.616113] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-24T18:13:57.798093] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T18:13:58.416084] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-24T18:13:58.935377] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T18:13:59.216090] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-24T18:13:59.455508] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T18:14:00.016144] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-24T18:14:00.816140] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-24T18:14:00.986935] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T18:14:01.265223] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T18:14:01.616134] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-24T18:14:01.894078] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T18:14:02.416182] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-24T18:14:03.216074] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-24T18:14:03.348453] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:14:03.844794] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T18:14:04.016045] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-24T18:14:04.217438] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T18:14:04.816144] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-24T18:14:05.616112] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-24T18:14:05.999268] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T18:14:06.368617] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T18:14:06.416086] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-24T18:14:06.674174] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T18:14:07.216092] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-24T18:14:08.016103] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-24T18:14:08.134630] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T18:14:08.816100] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-24T18:14:09.089784] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:14:09.115097] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T18:14:09.616092] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-24T18:14:10.269913] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:14:10.416042] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-24T18:14:10.711841] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T18:14:11.216079] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-24T18:14:12.016092] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-24T18:14:12.153613] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:14:12.162577] [INFO ] [REMOTE ] CUZ: Full fetch complete (70748 records). [2025-09-24T18:14:12.162781] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-24T18:14:12.491606] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T18:14:12.537197] [INFO ] [REMOTE ] CVEO: Full fetch complete (20276 records). [2025-09-24T18:14:12.561559] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-24T18:14:12.585849] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-24T18:14:12.586021] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-24T18:14:12.592533] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-24T18:14:12.634534] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-24T18:14:12.708792] [DEBUG] [LOCAL ] CUZ: Trimmed 70748 records to 49420 (keeping 200 days of data) [2025-09-24T18:14:12.827969] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-24T18:14:13.110407] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-24T18:14:13.110995] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-24T18:14:13.116173] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-24T18:14:13.116356] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-24T18:14:13.126161] [DEBUG] [LOCAL ] CVEO: Trimmed 20276 records to 15263 (keeping 200 days of data) [2025-09-24T18:14:13.322617] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T18:14:13.382446] [DEBUG] [LOCAL ] CVEO: Primary data saved (15263 records). [2025-09-24T18:14:13.383250] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-24T18:14:13.383369] [INFO ] [MAIN ] Update Progress: 561/2373 symbols completed. CVEO took 23.6s. Estimated remaining: 3h 59m 32s. Rate: 7.6 symbols/min [2025-09-24T18:14:13.569001] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:13.616226] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-24T18:14:13.647294] [DEBUG] [LOCAL ] CUZ: Primary data saved (49420 records). [2025-09-24T18:14:13.647498] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-24T18:14:13.647590] [INFO ] [MAIN ] Update Progress: 562/2373 symbols completed. CUZ took 23.9s. Estimated remaining: 3h 58m 60s. Rate: 7.6 symbols/min [2025-09-24T18:14:13.775450] [DEBUG] [LOCAL ] CVI: Loaded 46431 existing records from primary storage. [2025-09-24T18:14:13.790984] [INFO ] [MAIN ] CVI: Loaded 46431 existing records. [2025-09-24T18:14:13.953919] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:14.055553] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:14.055976] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-24T18:14:14.056083] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-24T18:14:14.063050] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-24T18:14:14.064200] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-24T18:14:14.064624] [DEBUG] [LOCAL ] CVLG: Loaded 15567 existing records from primary storage. [2025-09-24T18:14:14.129502] [INFO ] [MAIN ] CVLG: Loaded 15567 existing records. [2025-09-24T18:14:14.575252] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:14.657264] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-24T18:14:14.689862] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:14.690597] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-24T18:14:14.689994] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-24T18:14:14.692511] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-24T18:14:14.692594] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-24T18:14:15.015892] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-24T18:14:15.174997] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:15.178405] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T18:14:15.216148] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-24T18:14:16.016148] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-24T18:14:16.599752] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T18:14:16.816086] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-24T18:14:17.139876] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T18:14:17.233490] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T18:14:17.548466] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T18:14:17.616077] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-24T18:14:18.380607] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-24T18:14:18.416041] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-24T18:14:19.191732] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T18:14:19.216077] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-24T18:14:20.016056] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-24T18:14:20.078962] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T18:14:20.816152] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-24T18:14:21.616090] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-24T18:14:21.740084] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T18:14:21.746974] [INFO ] [REMOTE ] CURV: Full fetch complete (39580 records). [2025-09-24T18:14:21.747072] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-24T18:14:22.144019] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-24T18:14:22.144253] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-24T18:14:22.145370] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-24T18:14:22.145461] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-24T18:14:22.176066] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:14:22.176496] [DEBUG] [LOCAL ] CURV: Trimmed 39580 records to 26594 (keeping 200 days of data) [2025-09-24T18:14:22.349771] [DEBUG] [LOCAL ] CURV: Primary data saved (26594 records). [2025-09-24T18:14:22.349924] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-24T18:14:22.350017] [INFO ] [MAIN ] Update Progress: 563/2373 symbols completed. CURV took 32.6s. Estimated remaining: 3h 58m 54s. Rate: 7.6 symbols/min [2025-09-24T18:14:22.419412] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-24T18:14:22.526499] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:22.541084] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T18:14:22.600208] [DEBUG] [LOCAL ] CVNA: Loaded 53022 existing records from primary storage. [2025-09-24T18:14:22.600386] [INFO ] [MAIN ] CVNA: Loaded 53022 existing records. [2025-09-24T18:14:22.777133] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:22.777440] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-24T18:14:22.777490] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-24T18:14:22.779130] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-24T18:14:22.779192] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-24T18:14:23.131521] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:23.216053] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-24T18:14:24.016112] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-24T18:14:24.414163] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T18:14:24.816132] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-24T18:14:25.153671] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T18:14:25.252850] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-24T18:14:25.616131] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-24T18:14:26.412445] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T18:14:26.421184] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-24T18:14:26.423483] [INFO ] [REMOTE ] CVE: Full fetch complete (77538 records). [2025-09-24T18:14:26.423679] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-24T18:14:26.913575] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-24T18:14:26.913741] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-24T18:14:26.915041] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-24T18:14:26.915121] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-24T18:14:26.917070] [DEBUG] [LOCAL ] CVE: Trimmed 77538 records to 53556 (keeping 200 days of data) [2025-09-24T18:14:27.217042] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-24T18:14:27.403373] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-09-24T18:14:27.403565] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-24T18:14:27.403703] [INFO ] [MAIN ] Update Progress: 564/2373 symbols completed. CVE took 37.6s. Estimated remaining: 3h 58m 37s. Rate: 7.6 symbols/min [2025-09-24T18:14:27.672866] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:27.748261] [DEBUG] [LOCAL ] CVS: Loaded 53697 existing records from primary storage. [2025-09-24T18:14:27.749495] [INFO ] [MAIN ] CVS: Loaded 53697 existing records. [2025-09-24T18:14:28.035963] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:28.041838] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-24T18:14:28.041961] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-24T18:14:28.046847] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-24T18:14:28.047290] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-24T18:14:28.046664] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-24T18:14:28.100581] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-24T18:14:28.273794] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T18:14:28.459387] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T18:14:28.540006] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:28.816155] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-24T18:14:29.616145] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-24T18:14:29.800617] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T18:14:30.176931] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T18:14:30.416095] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-24T18:14:31.216073] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-24T18:14:31.318799] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T18:14:32.016123] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-24T18:14:32.649098] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-24T18:14:32.816116] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-24T18:14:32.873323] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T18:14:33.227109] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T18:14:33.616113] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-24T18:14:34.416157] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-24T18:14:34.900051] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T18:14:35.216154] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-24T18:14:35.274616] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T18:14:36.016197] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-24T18:14:36.597311] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T18:14:36.816133] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-24T18:14:37.532977] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-24T18:14:37.616113] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-24T18:14:37.694032] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T18:14:38.416077] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-24T18:14:38.724362] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T18:14:39.216141] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-24T18:14:39.669334] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T18:14:39.897199] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T18:14:40.016105] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-24T18:14:40.314808] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T18:14:40.318062] [INFO ] [REMOTE ] CVLG: Full fetch complete (20750 records). [2025-09-24T18:14:40.318164] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-24T18:14:40.694407] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-24T18:14:40.694513] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-24T18:14:40.695047] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-24T18:14:40.695113] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-24T18:14:40.696066] [DEBUG] [LOCAL ] CVLG: Trimmed 20750 records to 15591 (keeping 200 days of data) [2025-09-24T18:14:40.792762] [DEBUG] [LOCAL ] CVLG: Primary data saved (15591 records). [2025-09-24T18:14:40.792908] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-24T18:14:40.792993] [INFO ] [MAIN ] Update Progress: 565/2373 symbols completed. CVLG took 27.1s. Estimated remaining: 3h 58m 47s. Rate: 7.6 symbols/min [2025-09-24T18:14:40.822968] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-24T18:14:40.974047] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:41.038071] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-24T18:14:41.038255] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-24T18:14:41.218825] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:41.219071] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-24T18:14:41.219121] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-24T18:14:41.220785] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-24T18:14:41.220847] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-24T18:14:41.597732] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:41.621225] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-24T18:14:41.638633] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:14:42.416139] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-24T18:14:42.767060] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:14:43.216144] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-24T18:14:43.978217] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-24T18:14:44.016083] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-24T18:14:44.124319] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T18:14:44.816147] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-24T18:14:45.262537] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T18:14:45.616114] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-24T18:14:45.796984] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T18:14:46.291498] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T18:14:46.300139] [INFO ] [REMOTE ] CVI: Full fetch complete (67279 records). [2025-09-24T18:14:46.300259] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-24T18:14:46.421331] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-24T18:14:46.691426] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-24T18:14:46.691578] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-24T18:14:46.692612] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-24T18:14:46.692729] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-24T18:14:46.694200] [DEBUG] [LOCAL ] CVI: Trimmed 67279 records to 46432 (keeping 200 days of data) [2025-09-24T18:14:46.984994] [DEBUG] [LOCAL ] CVI: Primary data saved (46432 records). [2025-09-24T18:14:46.985143] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-24T18:14:46.985236] [INFO ] [MAIN ] Update Progress: 566/2373 symbols completed. CVI took 33.6s. Estimated remaining: 3h 58m 33s. Rate: 7.6 symbols/min [2025-09-24T18:14:47.164992] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:47.188252] [DEBUG] [LOCAL ] CW: Loaded 22479 existing records from primary storage. [2025-09-24T18:14:47.188422] [INFO ] [MAIN ] CW: Loaded 22479 existing records. [2025-09-24T18:14:47.221348] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-24T18:14:47.379699] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:47.380002] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-24T18:14:47.380061] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-24T18:14:47.380721] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-24T18:14:47.380783] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-24T18:14:47.767435] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:47.858544] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-24T18:14:48.016058] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-24T18:14:48.651660] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-24T18:14:48.816109] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-24T18:14:49.616197] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-24T18:14:49.773140] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-24T18:14:49.782603] [INFO ] [REMOTE ] CVNA: Full fetch complete (76679 records). [2025-09-24T18:14:49.782821] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-24T18:14:50.135695] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T18:14:50.228017] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-24T18:14:50.228219] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-24T18:14:50.229368] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-24T18:14:50.229452] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-24T18:14:50.231306] [DEBUG] [LOCAL ] CVNA: Trimmed 76679 records to 53009 (keeping 200 days of data) [2025-09-24T18:14:50.349714] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-24T18:14:50.445077] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-24T18:14:50.595159] [DEBUG] [LOCAL ] CVNA: Primary data saved (53009 records). [2025-09-24T18:14:50.595317] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-24T18:14:50.595419] [INFO ] [MAIN ] Update Progress: 567/2373 symbols completed. CVNA took 28.2s. Estimated remaining: 3h 58m 12s. Rate: 7.6 symbols/min [2025-09-24T18:14:50.782578] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:14:50.839012] [DEBUG] [LOCAL ] CWAN: Loaded 52401 existing records from primary storage. [2025-09-24T18:14:50.839186] [INFO ] [MAIN ] CWAN: Loaded 52401 existing records. [2025-09-24T18:14:51.019377] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:14:51.019721] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-24T18:14:51.019778] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-24T18:14:51.021160] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-24T18:14:51.021222] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-24T18:14:51.223717] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-24T18:14:51.415137] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:14:51.476789] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T18:14:52.016083] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-24T18:14:52.533701] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T18:14:52.595592] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T18:14:52.816101] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-24T18:14:53.616092] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-24T18:14:53.697068] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T18:14:54.162816] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T18:14:54.416123] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-24T18:14:55.216108] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-24T18:14:55.815459] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T18:14:55.966307] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:14:56.016038] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-24T18:14:56.816105] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-24T18:14:57.393293] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-24T18:14:57.616067] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-24T18:14:57.686633] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T18:14:58.416088] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-24T18:14:58.770265] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T18:14:59.216128] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-24T18:15:00.016087] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-24T18:15:00.087042] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-24T18:15:00.156944] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T18:15:00.816095] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-24T18:15:01.393437] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-24T18:15:01.403382] [INFO ] [REMOTE ] CVS: Full fetch complete (77814 records). [2025-09-24T18:15:01.403576] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-24T18:15:01.628979] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-24T18:15:01.880551] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-24T18:15:01.882676] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-24T18:15:01.882532] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T18:15:01.884008] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-24T18:15:01.892792] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-24T18:15:01.895025] [DEBUG] [LOCAL ] CVS: Trimmed 77814 records to 53697 (keeping 200 days of data) [2025-09-24T18:15:02.243507] [DEBUG] [LOCAL ] CVS: Primary data saved (53697 records). [2025-09-24T18:15:02.243722] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-24T18:15:02.243835] [INFO ] [MAIN ] Update Progress: 568/2373 symbols completed. CVS took 34.8s. Estimated remaining: 3h 58m 16s. Rate: 7.6 symbols/min [2025-09-24T18:15:02.422001] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-24T18:15:02.425768] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:02.426950] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-09-24T18:15:02.427008] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-09-24T18:15:02.427163] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-24T18:15:02.427221] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-24T18:15:02.427281] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-24T18:15:02.427316] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-24T18:15:02.793160] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:03.216103] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-24T18:15:04.478138] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (3.66 seconds). [2025-09-24T18:15:04.489572] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-24T18:15:04.961442] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (3.33 seconds). [2025-09-24T18:15:04.974016] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-24T18:15:05.328351] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-24T18:15:05.616080] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-24T18:15:05.712311] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-24T18:15:06.416501] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-24T18:15:06.448182] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T18:15:06.536636] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T18:15:06.714791] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T18:15:07.216156] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-24T18:15:07.713132] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T18:15:08.016159] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-24T18:15:08.816141] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-24T18:15:09.233687] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T18:15:09.616159] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-24T18:15:10.215445] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T18:15:10.416541] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-24T18:15:10.423095] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-09-24T18:15:10.626897] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T18:15:11.216109] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-24T18:15:11.947692] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T18:15:12.016078] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-24T18:15:12.816086] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-24T18:15:13.441140] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-24T18:15:13.533198] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T18:15:13.616121] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-24T18:15:14.187013] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:15:14.416088] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-24T18:15:15.216089] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-24T18:15:16.016096] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-24T18:15:16.715792] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-09-24T18:15:16.780411] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T18:15:16.784178] [INFO ] [REMOTE ] CW: Full fetch complete (33371 records). [2025-09-24T18:15:16.784279] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-24T18:15:16.784850] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:15:16.784941] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:15:16.784987] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:15:16.785026] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-24T18:15:16.785087] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-24T18:15:16.785126] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-09-24T18:15:16.785540] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-09-24T18:15:16.785666] [INFO ] [MAIN ] Update Progress: 569/2373 symbols completed. CW took 29.8s. Estimated remaining: 3h 58m 29s. Rate: 7.6 symbols/min [2025-09-24T18:15:16.821159] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-24T18:15:16.976292] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:17.030086] [DEBUG] [LOCAL ] CWH: Loaded 51415 existing records from primary storage. [2025-09-24T18:15:17.030260] [INFO ] [MAIN ] CWH: Loaded 51415 existing records. [2025-09-24T18:15:17.224063] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:17.224443] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-24T18:15:17.224522] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-24T18:15:17.226083] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-24T18:15:17.226150] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-24T18:15:17.597821] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-09-24T18:15:17.636083] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:17.646515] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-24T18:15:17.647761] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-24T18:15:17.648073] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-24T18:15:18.025007] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T18:15:18.103783] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-24T18:15:18.103881] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-24T18:15:18.104979] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-24T18:15:18.105046] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-24T18:15:18.106727] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-24T18:15:18.431864] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-24T18:15:18.463101] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-24T18:15:18.463443] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-24T18:15:18.463582] [INFO ] [MAIN ] Update Progress: 570/2373 symbols completed. CVX took 37.7s. Estimated remaining: 3h 58m 1s. Rate: 7.6 symbols/min [2025-09-24T18:15:18.651200] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T18:15:18.677885] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:18.736304] [DEBUG] [LOCAL ] CWK: Loaded 49427 existing records from primary storage. [2025-09-24T18:15:18.736485] [INFO ] [MAIN ] CWK: Loaded 49427 existing records. [2025-09-24T18:15:18.933871] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:18.934249] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-24T18:15:18.934369] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-24T18:15:18.936007] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-24T18:15:18.936076] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-24T18:15:19.224160] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-24T18:15:19.434394] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:19.539823] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:15:19.685686] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T18:15:20.016172] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-24T18:15:20.816145] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-24T18:15:20.899267] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T18:15:20.908528] [INFO ] [REMOTE ] CWAN: Full fetch complete (74715 records). [2025-09-24T18:15:20.908745] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-24T18:15:20.909703] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:15:20.909816] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:15:20.909862] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:15:20.909975] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-24T18:15:20.910068] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-24T18:15:20.910138] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-24T18:15:20.910535] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-09-24T18:15:20.910711] [INFO ] [MAIN ] Update Progress: 571/2373 symbols completed. CWAN took 30.3s. Estimated remaining: 3h 57m 36s. Rate: 7.6 symbols/min [2025-09-24T18:15:21.081330] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:21.110010] [DEBUG] [LOCAL ] CWT: Loaded 27855 existing records from primary storage. [2025-09-24T18:15:21.110149] [INFO ] [MAIN ] CWT: Loaded 27855 existing records. [2025-09-24T18:15:21.311278] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:21.312002] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-24T18:15:21.312097] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-24T18:15:21.312923] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-24T18:15:21.312990] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-24T18:15:21.621061] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-24T18:15:21.721834] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:21.751982] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:15:22.153604] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T18:15:22.416086] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-24T18:15:23.216106] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-24T18:15:23.262019] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T18:15:23.963838] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:15:24.016085] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-24T18:15:24.816070] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-24T18:15:24.861729] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:15:25.612778] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:15:25.626530] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-24T18:15:26.135856] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T18:15:26.416089] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-24T18:15:27.216128] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-24T18:15:27.428782] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T18:15:27.736625] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T18:15:28.016080] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-24T18:15:28.644037] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:15:28.816072] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-24T18:15:29.616054] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-24T18:15:29.888828] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T18:15:30.416118] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-24T18:15:30.556341] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T18:15:31.216095] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-24T18:15:31.473599] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:15:31.482339] [INFO ] [REMOTE ] CWEN: Full fetch complete (64379 records). [2025-09-24T18:15:31.482501] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-24T18:15:31.903198] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-24T18:15:31.903369] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-24T18:15:31.904366] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-24T18:15:31.904434] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-24T18:15:31.906343] [DEBUG] [LOCAL ] CWEN: Trimmed 64379 records to 45039 (keeping 200 days of data) [2025-09-24T18:15:32.016173] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-24T18:15:32.200003] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T18:15:32.268818] [DEBUG] [LOCAL ] CWEN: Primary data saved (45039 records). [2025-09-24T18:15:32.269016] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-24T18:15:32.269122] [INFO ] [MAIN ] Update Progress: 572/2373 symbols completed. CWEN took 30.0s. Estimated remaining: 3h 57m 39s. Rate: 7.6 symbols/min [2025-09-24T18:15:32.459528] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:32.519662] [DEBUG] [LOCAL ] CX: Loaded 52840 existing records from primary storage. [2025-09-24T18:15:32.519946] [INFO ] [MAIN ] CX: Loaded 52840 existing records. [2025-09-24T18:15:32.711205] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:32.711559] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-24T18:15:32.711616] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-24T18:15:32.713491] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-24T18:15:32.713560] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-24T18:15:32.820854] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-24T18:15:33.100792] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:33.160498] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T18:15:33.162302] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T18:15:33.616144] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-24T18:15:34.416098] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-24T18:15:34.766457] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T18:15:34.877041] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T18:15:35.216082] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-24T18:15:35.911202] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T18:15:36.016130] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-24T18:15:36.604254] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T18:15:36.816137] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-24T18:15:37.616080] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-24T18:15:37.955636] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T18:15:38.416097] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-24T18:15:38.469535] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:15:39.221133] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-24T18:15:39.226428] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:15:40.016094] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-24T18:15:40.279046] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T18:15:40.550411] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T18:15:40.816175] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-24T18:15:41.616120] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-24T18:15:41.836960] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T18:15:42.416096] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-24T18:15:42.565716] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T18:15:43.216153] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-24T18:15:43.293848] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T18:15:44.016161] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-24T18:15:44.166481] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:15:44.606523] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-24T18:15:44.816083] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-24T18:15:45.255186] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T18:15:45.616085] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-24T18:15:46.416092] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-24T18:15:46.557010] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:15:46.566227] [INFO ] [REMOTE ] CWK: Full fetch complete (70888 records). [2025-09-24T18:15:46.566414] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-24T18:15:46.997411] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-24T18:15:46.997671] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-24T18:15:46.999964] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-24T18:15:47.000068] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-24T18:15:47.012758] [DEBUG] [LOCAL ] CWK: Trimmed 70888 records to 49420 (keeping 200 days of data) [2025-09-24T18:15:47.026605] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T18:15:47.221391] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-24T18:15:47.351444] [DEBUG] [LOCAL ] CWK: Primary data saved (49420 records). [2025-09-24T18:15:47.351593] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-24T18:15:47.351748] [INFO ] [MAIN ] Update Progress: 573/2373 symbols completed. CWK took 28.9s. Estimated remaining: 3h 57m 53s. Rate: 7.6 symbols/min [2025-09-24T18:15:47.523236] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:47.532042] [DEBUG] [LOCAL ] CXE: Loaded 7248 existing records from primary storage. [2025-09-24T18:15:47.532155] [INFO ] [MAIN ] CXE: Loaded 7248 existing records. [2025-09-24T18:15:47.708976] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:47.709246] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-24T18:15:47.709306] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-24T18:15:47.710105] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-24T18:15:47.710251] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-24T18:15:48.054587] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-24T18:15:48.135321] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:48.160020] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:15:48.169854] [INFO ] [REMOTE ] CWH: Full fetch complete (72768 records). [2025-09-24T18:15:48.169991] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-24T18:15:48.559306] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-24T18:15:48.559411] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-24T18:15:48.560570] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-24T18:15:48.560681] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-24T18:15:48.562174] [DEBUG] [LOCAL ] CWH: Trimmed 72768 records to 51426 (keeping 200 days of data) [2025-09-24T18:15:48.816117] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-24T18:15:48.901601] [DEBUG] [LOCAL ] CWH: Primary data saved (51426 records). [2025-09-24T18:15:48.901863] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-24T18:15:48.902057] [INFO ] [MAIN ] Update Progress: 574/2373 symbols completed. CWH took 32.1s. Estimated remaining: 3h 57m 25s. Rate: 7.6 symbols/min [2025-09-24T18:15:49.086584] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:49.124915] [DEBUG] [LOCAL ] CXH: Loaded 4406 existing records from primary storage. [2025-09-24T18:15:49.127425] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T18:15:49.138529] [INFO ] [MAIN ] CXH: Loaded 4406 existing records. [2025-09-24T18:15:49.327083] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:49.327720] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-24T18:15:49.327841] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-24T18:15:49.333469] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-24T18:15:49.342933] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-24T18:15:49.422680] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:15:49.585328] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T18:15:49.618891] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-24T18:15:49.770967] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:50.385072] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T18:15:50.416040] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-24T18:15:51.216115] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-24T18:15:51.238946] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T18:15:52.016147] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-24T18:15:52.556432] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T18:15:52.562721] [INFO ] [REMOTE ] CWT: Full fetch complete (40232 records). [2025-09-24T18:15:52.562819] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-24T18:15:52.821347] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-24T18:15:52.967042] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-24T18:15:52.967128] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-24T18:15:52.968062] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-24T18:15:52.968135] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-24T18:15:52.969462] [DEBUG] [LOCAL ] CWT: Trimmed 40232 records to 27912 (keeping 200 days of data) [2025-09-24T18:15:53.165290] [DEBUG] [LOCAL ] CWT: Primary data saved (27912 records). [2025-09-24T18:15:53.165454] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-24T18:15:53.165589] [INFO ] [MAIN ] Update Progress: 575/2373 symbols completed. CWT took 32.3s. Estimated remaining: 3h 57m 6s. Rate: 7.6 symbols/min [2025-09-24T18:15:53.340601] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:15:53.393692] [DEBUG] [LOCAL ] CXM: Loaded 47985 existing records from primary storage. [2025-09-24T18:15:53.393876] [INFO ] [MAIN ] CXM: Loaded 47985 existing records. [2025-09-24T18:15:53.480640] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T18:15:53.598211] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:15:53.599226] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-24T18:15:53.599415] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-24T18:15:53.601757] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-24T18:15:53.602083] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-24T18:15:53.624152] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-24T18:15:53.830714] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T18:15:54.035756] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:15:54.416093] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-24T18:15:54.576599] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T18:15:55.216091] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-24T18:15:56.016087] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-24T18:15:56.109270] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T18:15:56.680373] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T18:15:56.698211] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-24T18:15:56.816109] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-24T18:15:57.616083] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-24T18:15:58.315616] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T18:15:58.352852] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:15:58.416074] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-24T18:15:59.216141] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-24T18:16:00.016066] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-24T18:16:00.465243] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T18:16:00.507345] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T18:16:00.821213] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-24T18:16:00.834262] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T18:16:01.355714] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T18:16:01.616082] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-24T18:16:02.066779] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T18:16:02.416121] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-24T18:16:03.216107] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-24T18:16:03.929597] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T18:16:03.985392] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T18:16:04.016043] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-24T18:16:04.655982] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T18:16:04.816094] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-24T18:16:05.522812] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T18:16:05.616139] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-24T18:16:06.416106] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-24T18:16:06.933405] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T18:16:07.188458] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T18:16:07.216042] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-24T18:16:08.016113] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-24T18:16:08.613949] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T18:16:08.816078] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-24T18:16:08.939324] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:16:09.436399] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T18:16:09.616097] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-24T18:16:10.416115] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-24T18:16:10.679248] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T18:16:10.681387] [INFO ] [REMOTE ] CXE: Full fetch complete (11880 records). [2025-09-24T18:16:10.681484] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-24T18:16:11.050849] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T18:16:11.080929] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-24T18:16:11.081393] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-24T18:16:11.081855] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-24T18:16:11.081921] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-24T18:16:11.082501] [DEBUG] [LOCAL ] CXE: Trimmed 11880 records to 7207 (keeping 200 days of data) [2025-09-24T18:16:11.129276] [DEBUG] [LOCAL ] CXE: Primary data saved (7207 records). [2025-09-24T18:16:11.129440] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-24T18:16:11.129546] [INFO ] [MAIN ] Update Progress: 576/2373 symbols completed. CXE took 23.8s. Estimated remaining: 3h 57m 29s. Rate: 7.6 symbols/min [2025-09-24T18:16:11.221302] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-24T18:16:11.311626] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:11.358227] [DEBUG] [LOCAL ] CXT: Loaded 31082 existing records from primary storage. [2025-09-24T18:16:11.358376] [INFO ] [MAIN ] CXT: Loaded 31082 existing records. [2025-09-24T18:16:11.545761] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:11.546038] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-24T18:16:11.546089] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-24T18:16:11.547117] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-24T18:16:11.547180] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-24T18:16:11.921588] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:12.016068] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-24T18:16:12.816107] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-24T18:16:13.130945] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T18:16:13.191240] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-24T18:16:13.296713] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T18:16:13.616079] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-24T18:16:14.356940] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T18:16:14.358516] [INFO ] [REMOTE ] CXH: Full fetch complete (5499 records). [2025-09-24T18:16:14.358586] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-24T18:16:14.421281] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-24T18:16:14.725191] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-24T18:16:14.725272] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-24T18:16:14.725449] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-24T18:16:14.725490] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-24T18:16:14.725910] [DEBUG] [LOCAL ] CXH: Trimmed 5499 records to 4414 (keeping 200 days of data) [2025-09-24T18:16:14.759317] [DEBUG] [LOCAL ] CXH: Primary data saved (4414 records). [2025-09-24T18:16:14.759726] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-24T18:16:14.759823] [INFO ] [MAIN ] Update Progress: 577/2373 symbols completed. CXH took 25.9s. Estimated remaining: 3h 57m 8s. Rate: 7.6 symbols/min [2025-09-24T18:16:14.931896] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:14.992893] [DEBUG] [LOCAL ] CXW: Loaded 44386 existing records from primary storage. [2025-09-24T18:16:14.993091] [INFO ] [MAIN ] CXW: Loaded 44386 existing records. [2025-09-24T18:16:15.182883] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:15.183212] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-24T18:16:15.183284] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-24T18:16:15.184887] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-24T18:16:15.184953] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-24T18:16:15.221233] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-24T18:16:15.565754] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:15.908359] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T18:16:16.016101] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-24T18:16:16.816142] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-24T18:16:17.088800] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:16:17.099016] [INFO ] [REMOTE ] CX: Full fetch complete (75995 records). [2025-09-24T18:16:17.099213] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-24T18:16:17.100550] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:16:17.100697] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:16:17.100767] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:16:17.100834] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-24T18:16:17.100902] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-24T18:16:17.100952] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-09-24T18:16:17.101449] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-09-24T18:16:17.101571] [INFO ] [MAIN ] Update Progress: 578/2373 symbols completed. CX took 44.8s. Estimated remaining: 3h 56m 43s. Rate: 7.6 symbols/min [2025-09-24T18:16:17.303704] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:17.334607] [DEBUG] [LOCAL ] CYD: Loaded 26605 existing records from primary storage. [2025-09-24T18:16:17.334779] [INFO ] [MAIN ] CYD: Loaded 26605 existing records. [2025-09-24T18:16:17.522673] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:17.523034] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-24T18:16:17.523430] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-24T18:16:17.524761] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-24T18:16:17.524836] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-24T18:16:17.631149] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-24T18:16:17.859836] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T18:16:17.977753] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:18.068107] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T18:16:18.416091] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-24T18:16:19.216103] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-24T18:16:19.399133] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T18:16:19.506563] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T18:16:20.016087] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-24T18:16:20.816076] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-24T18:16:20.861743] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T18:16:21.512689] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T18:16:21.616083] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-24T18:16:22.140410] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:16:22.416107] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-24T18:16:23.203458] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T18:16:23.216031] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-24T18:16:23.668887] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T18:16:24.016095] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-24T18:16:24.774433] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T18:16:24.786103] [INFO ] [REMOTE ] CXM: Full fetch complete (69046 records). [2025-09-24T18:16:24.786270] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-24T18:16:24.821183] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-24T18:16:25.185997] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-24T18:16:25.186091] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-24T18:16:25.186967] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-24T18:16:25.187035] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-24T18:16:25.188561] [DEBUG] [LOCAL ] CXM: Trimmed 69046 records to 47947 (keeping 200 days of data) [2025-09-24T18:16:25.318107] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T18:16:25.491376] [DEBUG] [LOCAL ] CXM: Primary data saved (47947 records). [2025-09-24T18:16:25.491509] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-24T18:16:25.491615] [INFO ] [MAIN ] Update Progress: 579/2373 symbols completed. CXM took 32.3s. Estimated remaining: 3h 56m 36s. Rate: 7.6 symbols/min [2025-09-24T18:16:25.608331] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T18:16:25.618719] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-24T18:16:25.672173] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:25.719895] [DEBUG] [LOCAL ] CYH: Loaded 47841 existing records from primary storage. [2025-09-24T18:16:25.720107] [INFO ] [MAIN ] CYH: Loaded 47841 existing records. [2025-09-24T18:16:25.898060] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:25.898370] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-24T18:16:25.898428] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-24T18:16:25.899572] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-24T18:16:25.899634] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-24T18:16:26.273867] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:26.416086] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-24T18:16:27.169762] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T18:16:27.216050] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-24T18:16:28.016053] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-24T18:16:28.061818] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T18:16:28.268507] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T18:16:28.816091] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-24T18:16:29.036628] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T18:16:29.616088] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-24T18:16:30.275813] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T18:16:30.416157] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-24T18:16:31.208762] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:16:31.223620] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-24T18:16:32.016155] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-24T18:16:32.159891] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T18:16:32.512032] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T18:16:32.816140] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-24T18:16:33.406152] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T18:16:33.616132] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-24T18:16:34.416075] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-24T18:16:34.449781] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:16:34.901123] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:16:35.216128] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-24T18:16:35.794129] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T18:16:36.016121] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-24T18:16:36.548702] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T18:16:36.816091] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-24T18:16:37.109082] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T18:16:37.616082] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-24T18:16:38.259825] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T18:16:38.416141] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-24T18:16:39.216107] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-24T18:16:39.331305] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:16:39.512100] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:16:40.016084] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-24T18:16:40.528310] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T18:16:40.816072] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-24T18:16:41.214476] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T18:16:41.616083] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-24T18:16:42.250434] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T18:16:42.256446] [INFO ] [REMOTE ] CXT: Full fetch complete (45015 records). [2025-09-24T18:16:42.256562] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-24T18:16:42.416102] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-24T18:16:42.640245] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-24T18:16:42.640332] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-24T18:16:42.640986] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-24T18:16:42.641049] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-24T18:16:42.642029] [DEBUG] [LOCAL ] CXT: Trimmed 45015 records to 31061 (keeping 200 days of data) [2025-09-24T18:16:42.777367] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T18:16:42.784706] [INFO ] [REMOTE ] CYD: Full fetch complete (32014 records). [2025-09-24T18:16:42.787271] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-24T18:16:42.788051] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:16:42.788147] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:16:42.788210] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:16:42.788296] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-24T18:16:42.788381] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-09-24T18:16:42.788433] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-09-24T18:16:42.816097] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-09-24T18:16:42.821417] [INFO ] [MAIN ] Update Progress: 580/2373 symbols completed. CYD took 25.7s. Estimated remaining: 3h 56m 58s. Rate: 7.6 symbols/min [2025-09-24T18:16:42.961017] [DEBUG] [LOCAL ] CXT: Primary data saved (31061 records). [2025-09-24T18:16:42.961636] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-24T18:16:42.967279] [INFO ] [MAIN ] Update Progress: 581/2373 symbols completed. CXT took 31.8s. Estimated remaining: 3h 56m 26s. Rate: 7.6 symbols/min [2025-09-24T18:16:43.136122] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:43.210574] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:43.210764] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-24T18:16:43.210809] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-24T18:16:43.210955] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-24T18:16:43.210998] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-24T18:16:43.211041] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-24T18:16:43.211075] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-24T18:16:43.222504] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-24T18:16:43.531882] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-24T18:16:43.534592] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-09-24T18:16:43.734501] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:43.827624] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:43.827887] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-24T18:16:43.827935] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-24T18:16:43.829390] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-24T18:16:43.829453] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-24T18:16:44.022075] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-24T18:16:44.245353] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:44.286787] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T18:16:44.816130] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-24T18:16:44.854848] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:16:45.269092] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T18:16:45.616170] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-24T18:16:46.416055] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-24T18:16:46.891383] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-24T18:16:47.216065] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-24T18:16:47.276219] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T18:16:47.837265] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T18:16:47.881310] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T18:16:48.016042] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-24T18:16:48.816125] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-24T18:16:49.616094] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-24T18:16:49.744080] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:16:49.746447] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T18:16:50.416108] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-24T18:16:51.216115] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-24T18:16:51.415520] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T18:16:52.016623] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-24T18:16:52.016556] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T18:16:52.086755] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T18:16:52.816136] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-24T18:16:53.616057] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-24T18:16:53.682080] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T18:16:53.689573] [INFO ] [REMOTE ] CXW: Full fetch complete (64957 records). [2025-09-24T18:16:53.689735] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-24T18:16:54.092320] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-24T18:16:54.092429] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-24T18:16:54.093389] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-24T18:16:54.093467] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-24T18:16:54.095025] [DEBUG] [LOCAL ] CXW: Trimmed 64957 records to 44300 (keeping 200 days of data) [2025-09-24T18:16:54.370845] [DEBUG] [LOCAL ] CXW: Primary data saved (44300 records). [2025-09-24T18:16:54.371202] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-24T18:16:54.371414] [INFO ] [MAIN ] Update Progress: 582/2373 symbols completed. CXW took 39.6s. Estimated remaining: 3h 56m 29s. Rate: 7.6 symbols/min [2025-09-24T18:16:54.435001] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-24T18:16:54.570577] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:16:54.605865] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T18:16:54.676963] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-24T18:16:54.677756] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-24T18:16:54.683450] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T18:16:54.919416] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:16:54.919845] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-24T18:16:54.919915] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-24T18:16:54.921544] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-24T18:16:54.921623] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-24T18:16:55.216551] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-24T18:16:55.298320] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:16:56.016145] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-24T18:16:56.339099] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T18:16:56.816142] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-24T18:16:57.228585] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T18:16:57.616099] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-24T18:16:58.228757] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-24T18:16:58.247857] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T18:16:58.416082] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-24T18:16:59.216065] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-24T18:16:59.288050] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:16:59.386620] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T18:17:00.016133] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-24T18:17:00.816117] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-24T18:17:01.106935] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T18:17:01.116175] [INFO ] [REMOTE ] CYH: Full fetch complete (70360 records). [2025-09-24T18:17:01.116431] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-24T18:17:01.573471] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-24T18:17:01.573614] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-24T18:17:01.574586] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-24T18:17:01.574679] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-24T18:17:01.576392] [DEBUG] [LOCAL ] CYH: Trimmed 70360 records to 47783 (keeping 200 days of data) [2025-09-24T18:17:01.625817] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-24T18:17:01.872384] [DEBUG] [LOCAL ] CYH: Primary data saved (47783 records). [2025-09-24T18:17:01.872551] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-24T18:17:01.872676] [INFO ] [MAIN ] Update Progress: 583/2373 symbols completed. CYH took 36.4s. Estimated remaining: 3h 56m 19s. Rate: 7.6 symbols/min [2025-09-24T18:17:02.066708] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:02.123907] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T18:17:02.151145] [DEBUG] [LOCAL ] DAN: Loaded 49032 existing records from primary storage. [2025-09-24T18:17:02.151336] [INFO ] [MAIN ] DAN: Loaded 49032 existing records. [2025-09-24T18:17:02.346494] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:17:02.346862] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-24T18:17:02.346914] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-24T18:17:02.348195] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-24T18:17:02.348260] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-24T18:17:02.419079] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-24T18:17:02.688075] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T18:17:02.759485] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:02.850729] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T18:17:03.216088] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-24T18:17:04.016080] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-24T18:17:04.374833] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T18:17:04.818870] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-24T18:17:04.823282] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T18:17:05.075042] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T18:17:05.616109] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-24T18:17:06.416183] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-24T18:17:07.045793] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-24T18:17:07.224045] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-24T18:17:07.242753] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:17:08.016123] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-24T18:17:08.238639] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T18:17:08.816092] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-24T18:17:09.626398] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-24T18:17:09.629052] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:17:09.686603] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-24T18:17:09.799263] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T18:17:10.416088] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-24T18:17:11.216065] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-24T18:17:11.324168] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T18:17:11.449350] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T18:17:11.451744] [INFO ] [REMOTE ] DAC: Full fetch complete (19794 records). [2025-09-24T18:17:11.451824] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-24T18:17:11.836171] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-24T18:17:11.836257] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-24T18:17:11.836784] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-24T18:17:11.836848] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-24T18:17:11.837527] [DEBUG] [LOCAL ] DAC: Trimmed 19794 records to 12600 (keeping 200 days of data) [2025-09-24T18:17:11.921574] [DEBUG] [LOCAL ] DAC: Primary data saved (12600 records). [2025-09-24T18:17:11.921827] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-24T18:17:11.921973] [INFO ] [MAIN ] Update Progress: 584/2373 symbols completed. DAC took 29.0s. Estimated remaining: 3h 56m 18s. Rate: 7.6 symbols/min [2025-09-24T18:17:12.024307] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-24T18:17:12.109482] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:12.129535] [DEBUG] [LOCAL ] DAO: Loaded 21242 existing records from primary storage. [2025-09-24T18:17:12.129698] [INFO ] [MAIN ] DAO: Loaded 21242 existing records. [2025-09-24T18:17:12.306055] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:17:12.306332] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-24T18:17:12.306405] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-24T18:17:12.307040] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-24T18:17:12.307100] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-24T18:17:12.662824] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:12.816132] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-24T18:17:13.301851] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T18:17:13.616076] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-24T18:17:13.750859] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:17:13.927263] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T18:17:14.416078] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-24T18:17:15.021907] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T18:17:15.055787] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T18:17:15.216095] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-24T18:17:16.016072] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-24T18:17:16.456456] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T18:17:16.816087] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-24T18:17:17.616091] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-24T18:17:18.042597] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T18:17:18.052610] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-09-24T18:17:18.052835] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-24T18:17:18.449562] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-24T18:17:18.476452] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-24T18:17:18.476760] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-24T18:17:18.477930] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-24T18:17:18.477998] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-24T18:17:18.480270] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 53647 (keeping 200 days of data) [2025-09-24T18:17:18.510706] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:17:18.860585] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-24T18:17:18.860772] [INFO ] [MAIN ] D: Full history saved. [2025-09-24T18:17:18.860904] [INFO ] [MAIN ] Update Progress: 585/2373 symbols completed. D took 36.0s. Estimated remaining: 3h 56m 7s. Rate: 7.6 symbols/min [2025-09-24T18:17:19.060525] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T18:17:19.063871] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:19.122900] [DEBUG] [LOCAL ] DAR: Loaded 51855 existing records from primary storage. [2025-09-24T18:17:19.123089] [INFO ] [MAIN ] DAR: Loaded 51855 existing records. [2025-09-24T18:17:19.221221] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-24T18:17:19.316397] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:17:19.316711] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-24T18:17:19.316769] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-24T18:17:19.317850] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-24T18:17:19.317913] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-24T18:17:19.693665] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:20.016068] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-24T18:17:20.461520] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T18:17:20.681734] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-24T18:17:20.816100] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-24T18:17:21.616074] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-24T18:17:21.678520] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T18:17:22.416137] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-24T18:17:22.643310] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T18:17:23.218712] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-24T18:17:23.231498] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-24T18:17:23.990396] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:17:24.016035] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-24T18:17:24.138559] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T18:17:24.816080] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-24T18:17:25.616073] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-24T18:17:25.754305] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T18:17:26.416047] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-24T18:17:26.608387] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T18:17:26.951438] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T18:17:27.216090] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-24T18:17:27.945375] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T18:17:28.016046] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-24T18:17:28.233629] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T18:17:28.816083] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-24T18:17:29.616088] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-24T18:17:29.991833] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T18:17:30.416094] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-24T18:17:30.569052] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:17:31.216125] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-24T18:17:31.952440] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T18:17:31.962983] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-24T18:17:31.963232] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-24T18:17:32.026466] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-24T18:17:32.267271] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T18:17:32.447265] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-24T18:17:32.447372] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-24T18:17:32.448585] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-24T18:17:32.448681] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-24T18:17:32.450383] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-24T18:17:32.816634] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-24T18:17:32.825260] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-24T18:17:32.825492] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-24T18:17:32.825635] [INFO ] [MAIN ] Update Progress: 586/2373 symbols completed. DAL took 38.5s. Estimated remaining: 3h 56m 18s. Rate: 7.6 symbols/min [2025-09-24T18:17:33.047779] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T18:17:33.073237] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:33.073786] [INFO ] [REMOTE ] DAO: Full fetch complete (32649 records). [2025-09-24T18:17:33.074232] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-24T18:17:33.077118] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T18:17:33.404374] [DEBUG] [LOCAL ] DAVA: Loaded 40534 existing records from primary storage. [2025-09-24T18:17:33.410138] [INFO ] [MAIN ] DAVA: Loaded 40534 existing records. [2025-09-24T18:17:33.610106] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-24T18:17:33.620528] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-24T18:17:33.615342] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-24T18:17:33.621253] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-24T18:17:33.659032] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-24T18:17:33.693122] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:17:33.693536] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-24T18:17:33.693844] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-24T18:17:33.694344] [DEBUG] [LOCAL ] DAO: Trimmed 32649 records to 21138 (keeping 200 days of data) [2025-09-24T18:17:33.695050] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-24T18:17:33.695118] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-24T18:17:34.103841] [DEBUG] [LOCAL ] DAO: Primary data saved (21138 records). [2025-09-24T18:17:34.104011] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-24T18:17:34.109772] [INFO ] [MAIN ] Update Progress: 587/2373 symbols completed. DAO took 22.2s. Estimated remaining: 3h 55m 49s. Rate: 7.6 symbols/min [2025-09-24T18:17:34.290637] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:34.365026] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:34.410685] [DEBUG] [LOCAL ] DAY: Loaded 49894 existing records from primary storage. [2025-09-24T18:17:34.410907] [INFO ] [MAIN ] DAY: Loaded 49894 existing records. [2025-09-24T18:17:34.443604] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-24T18:17:34.617028] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:17:34.618735] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T18:17:34.626217] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-24T18:17:34.626603] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-24T18:17:34.628496] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-24T18:17:34.628558] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-24T18:17:34.671724] [INFO ] [REMOTE ] DAN: Full fetch complete (70486 records). [2025-09-24T18:17:34.698122] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-24T18:17:34.730631] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:17:34.741575] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:17:34.751853] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:17:34.780740] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-24T18:17:34.807368] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-09-24T18:17:34.853319] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-09-24T18:17:34.908561] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-09-24T18:17:34.911004] [INFO ] [MAIN ] Update Progress: 588/2373 symbols completed. DAN took 33.0s. Estimated remaining: 3h 55m 20s. Rate: 7.6 symbols/min [2025-09-24T18:17:35.058806] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:35.169029] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:35.169188] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-24T18:17:35.169225] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-24T18:17:35.169400] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-24T18:17:35.169463] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-24T18:17:35.169547] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-24T18:17:35.169610] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-24T18:17:35.234033] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-24T18:17:35.568741] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:35.600058] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T18:17:35.723753] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T18:17:36.016084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-24T18:17:36.816091] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-24T18:17:36.960921] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:17:37.621147] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-24T18:17:37.640085] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:17:38.416072] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-24T18:17:38.587322] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T18:17:39.172778] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:17:39.216054] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-24T18:17:39.647217] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T18:17:40.016090] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-24T18:17:40.692315] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T18:17:40.816073] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-24T18:17:41.309355] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T18:17:41.616090] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-24T18:17:42.416070] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-24T18:17:42.528030] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T18:17:42.615469] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T18:17:43.216119] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-24T18:17:44.016782] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-24T18:17:44.016708] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:17:44.816080] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-24T18:17:45.113945] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T18:17:45.419168] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T18:17:45.616138] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-24T18:17:46.424023] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-24T18:17:46.444549] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T18:17:47.216048] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-24T18:17:47.606800] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T18:17:47.982957] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:17:48.016044] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-24T18:17:48.816059] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-24T18:17:48.979529] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T18:17:49.616180] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-24T18:17:49.920700] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T18:17:50.416100] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-24T18:17:50.882157] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T18:17:51.191253] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T18:17:51.216032] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-24T18:17:52.016063] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-24T18:17:52.203878] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T18:17:52.816050] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-24T18:17:52.928429] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T18:17:53.616145] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-24T18:17:53.991498] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T18:17:54.416114] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-24T18:17:54.508424] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T18:17:54.517526] [INFO ] [REMOTE ] DAR: Full fetch complete (74532 records). [2025-09-24T18:17:54.517670] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-24T18:17:54.935024] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-24T18:17:54.935192] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-24T18:17:54.936087] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-24T18:17:54.936152] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-24T18:17:54.941793] [DEBUG] [LOCAL ] DAR: Trimmed 74532 records to 51838 (keeping 200 days of data) [2025-09-24T18:17:55.231469] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-24T18:17:55.255061] [DEBUG] [LOCAL ] DAR: Primary data saved (51838 records). [2025-09-24T18:17:55.255170] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-24T18:17:55.255285] [INFO ] [MAIN ] Update Progress: 589/2373 symbols completed. DAR took 36.4s. Estimated remaining: 3h 55m 50s. Rate: 7.6 symbols/min [2025-09-24T18:17:55.443856] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:17:55.444363] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-24T18:17:55.444434] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-24T18:17:55.444903] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-24T18:17:55.444990] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-24T18:17:55.445117] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-24T18:17:55.445228] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-24T18:17:55.624842] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T18:17:55.850428] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:17:56.016054] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-24T18:17:56.157610] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T18:17:56.816057] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-24T18:17:56.974108] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T18:17:57.221587] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:17:57.616061] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-24T18:17:58.371083] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:17:58.416100] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-24T18:17:59.216061] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-24T18:17:59.504895] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T18:17:59.891395] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T18:18:00.016039] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-24T18:18:00.053377] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:18:00.816070] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-24T18:18:01.582918] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T18:18:01.616082] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-24T18:18:01.921817] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T18:18:02.416124] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-24T18:18:03.216114] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-24T18:18:04.016099] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-24T18:18:05.178271] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T18:18:05.183091] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-24T18:18:05.328764] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (3.71 seconds). [2025-09-24T18:18:05.355165] [INFO ] [REMOTE ] DAVA: Full fetch complete (55351 records). [2025-09-24T18:18:05.367576] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-24T18:18:05.375704] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-24T18:18:05.641135] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-24T18:18:05.774163] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-24T18:18:05.774266] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-24T18:18:05.775072] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-24T18:18:05.775153] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-24T18:18:05.776613] [DEBUG] [LOCAL ] DAVA: Trimmed 55351 records to 40609 (keeping 200 days of data) [2025-09-24T18:18:06.021231] [DEBUG] [LOCAL ] DAVA: Primary data saved (40609 records). [2025-09-24T18:18:06.021378] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-24T18:18:06.021509] [INFO ] [MAIN ] Update Progress: 590/2373 symbols completed. DAVA took 33.2s. Estimated remaining: 3h 55m 50s. Rate: 7.6 symbols/min [2025-09-24T18:18:06.205629] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:06.254580] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (3.84 seconds). [2025-09-24T18:18:06.283551] [INFO ] [REMOTE ] DB: Full fetch complete (73793 records). [2025-09-24T18:18:06.285274] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T18:18:06.285691] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-24T18:18:06.305382] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:18:06.305577] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:18:06.305678] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:18:06.305752] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-24T18:18:06.306258] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-24T18:18:06.306400] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-24T18:18:06.306471] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-09-24T18:18:06.306544] [INFO ] [MAIN ] Update Progress: 591/2373 symbols completed. DB took 31.4s. Estimated remaining: 3h 55m 19s. Rate: 7.6 symbols/min [2025-09-24T18:18:06.307813] [DEBUG] [LOCAL ] DBI: Loaded 45060 existing records from primary storage. [2025-09-24T18:18:06.351172] [INFO ] [MAIN ] DBI: Loaded 45060 existing records. [2025-09-24T18:18:06.420706] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-24T18:18:06.653026] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:06.673621] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:06.674203] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-24T18:18:06.674268] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-24T18:18:06.676155] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-24T18:18:06.676221] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-24T18:18:06.784731] [DEBUG] [LOCAL ] DBL: Loaded 9081 existing records from primary storage. [2025-09-24T18:18:06.790601] [INFO ] [MAIN ] DBL: Loaded 9081 existing records. [2025-09-24T18:18:07.176117] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:07.206899] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-24T18:18:07.225361] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-24T18:18:07.250999] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:07.251680] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-24T18:18:07.251798] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-24T18:18:07.253542] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-24T18:18:07.646198] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:07.651426] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T18:18:07.669443] [INFO ] [REMOTE ] DAY: Full fetch complete (71719 records). [2025-09-24T18:18:07.674303] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-24T18:18:07.675906] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T18:18:08.025263] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-24T18:18:08.074028] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-24T18:18:08.074118] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-24T18:18:08.075082] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-24T18:18:08.075160] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-24T18:18:08.076861] [DEBUG] [LOCAL ] DAY: Trimmed 71719 records to 49845 (keeping 200 days of data) [2025-09-24T18:18:08.375867] [DEBUG] [LOCAL ] DAY: Primary data saved (49845 records). [2025-09-24T18:18:08.376040] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-24T18:18:08.376147] [INFO ] [MAIN ] Update Progress: 592/2373 symbols completed. DAY took 34.3s. Estimated remaining: 3h 54m 54s. Rate: 7.6 symbols/min [2025-09-24T18:18:08.593327] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:08.593929] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-09-24T18:18:08.594187] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-09-24T18:18:08.594606] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-24T18:18:08.594712] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-24T18:18:08.594848] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-24T18:18:08.594905] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-24T18:18:08.831328] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-24T18:18:09.075428] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:09.091636] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T18:18:09.276423] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T18:18:09.616046] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-24T18:18:09.688294] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T18:18:10.416140] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-24T18:18:10.801704] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T18:18:11.216100] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-24T18:18:12.016061] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-24T18:18:12.063851] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T18:18:12.342249] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T18:18:12.473103] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T18:18:12.816088] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-24T18:18:13.616058] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-24T18:18:13.899261] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T18:18:13.903909] [INFO ] [REMOTE ] DBD: Full fetch complete (30508 records). [2025-09-24T18:18:13.903994] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-24T18:18:13.904527] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:18:13.904630] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:18:13.904769] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:18:13.904864] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-24T18:18:13.904963] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-24T18:18:13.905027] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-24T18:18:13.905133] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-24T18:18:13.905212] [INFO ] [MAIN ] Update Progress: 593/2373 symbols completed. DBD took 18.6s. Estimated remaining: 3h 54m 39s. Rate: 7.6 symbols/min [2025-09-24T18:18:14.074105] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:14.123132] [DEBUG] [LOCAL ] DCI: Loaded 37606 existing records from primary storage. [2025-09-24T18:18:14.123283] [INFO ] [MAIN ] DCI: Loaded 37606 existing records. [2025-09-24T18:18:14.309987] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:14.310344] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-24T18:18:14.310398] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-24T18:18:14.311285] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-24T18:18:14.311347] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-24T18:18:14.421151] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-24T18:18:14.681485] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:15.216101] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-24T18:18:15.388849] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T18:18:16.016143] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-24T18:18:16.153120] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T18:18:16.816125] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-24T18:18:17.599854] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-24T18:18:17.616039] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-24T18:18:18.416150] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-24T18:18:18.741244] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T18:18:19.025846] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-09-24T18:18:19.136331] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T18:18:19.165839] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-24T18:18:19.216048] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-24T18:18:19.912231] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T18:18:20.016045] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-24T18:18:20.816129] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-24T18:18:21.622376] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-24T18:18:21.625198] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:18:22.409124] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T18:18:22.416024] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-24T18:18:22.452128] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T18:18:23.082190] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T18:18:23.216081] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-24T18:18:24.016095] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-24T18:18:24.816110] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-24T18:18:25.015421] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:18:25.618439] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-24T18:18:25.622761] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T18:18:26.264926] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T18:18:26.416115] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-24T18:18:27.216105] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-24T18:18:27.832156] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-24T18:18:28.018827] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-24T18:18:28.033067] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T18:18:28.033586] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T18:18:28.816111] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-24T18:18:29.616108] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-24T18:18:29.742539] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:18:30.195979] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T18:18:30.292204] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T18:18:30.416120] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-24T18:18:30.883439] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T18:18:31.216105] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-24T18:18:32.016116] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-24T18:18:32.440382] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T18:18:32.816141] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-24T18:18:33.616070] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-24T18:18:33.705491] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T18:18:34.285095] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T18:18:34.298149] [INFO ] [REMOTE ] DBL: Full fetch complete (12460 records). [2025-09-24T18:18:34.319571] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-24T18:18:34.329035] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T18:18:34.419912] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-24T18:18:34.725550] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-24T18:18:34.725756] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-24T18:18:34.726110] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-24T18:18:34.726163] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-24T18:18:34.726772] [DEBUG] [LOCAL ] DBL: Trimmed 12460 records to 9131 (keeping 200 days of data) [2025-09-24T18:18:34.782832] [DEBUG] [LOCAL ] DBL: Primary data saved (9131 records). [2025-09-24T18:18:34.782981] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-24T18:18:34.783236] [INFO ] [MAIN ] Update Progress: 594/2373 symbols completed. DBL took 28.5s. Estimated remaining: 3h 55m 10s. Rate: 7.6 symbols/min [2025-09-24T18:18:34.961816] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:34.978731] [DEBUG] [LOCAL ] DCO: Loaded 13718 existing records from primary storage. [2025-09-24T18:18:34.978849] [INFO ] [MAIN ] DCO: Loaded 13718 existing records. [2025-09-24T18:18:35.167236] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:35.167496] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-24T18:18:35.167557] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-24T18:18:35.168022] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-24T18:18:35.168093] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-24T18:18:35.223674] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-24T18:18:35.546916] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:35.819378] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T18:18:36.016080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-24T18:18:36.739664] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T18:18:36.750977] [INFO ] [REMOTE ] DBI: Full fetch complete (66429 records). [2025-09-24T18:18:36.751328] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-24T18:18:36.821505] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-24T18:18:37.174948] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T18:18:37.194925] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-24T18:18:37.195036] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-24T18:18:37.200289] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-24T18:18:37.200367] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-24T18:18:37.201789] [DEBUG] [LOCAL ] DBI: Trimmed 66429 records to 45023 (keeping 200 days of data) [2025-09-24T18:18:37.480031] [DEBUG] [LOCAL ] DBI: Primary data saved (45023 records). [2025-09-24T18:18:37.480264] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-24T18:18:37.480387] [INFO ] [MAIN ] Update Progress: 595/2373 symbols completed. DBI took 31.5s. Estimated remaining: 3h 54m 46s. Rate: 7.6 symbols/min [2025-09-24T18:18:37.621310] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-24T18:18:37.682502] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:37.746330] [DEBUG] [LOCAL ] DD: Loaded 52827 existing records from primary storage. [2025-09-24T18:18:37.746612] [INFO ] [MAIN ] DD: Loaded 52827 existing records. [2025-09-24T18:18:37.942154] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:37.942574] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-24T18:18:37.942628] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-24T18:18:37.944348] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-24T18:18:37.944415] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-24T18:18:38.319414] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:38.427266] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-24T18:18:38.433809] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:18:38.593603] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T18:18:39.216102] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-24T18:18:40.016044] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-24T18:18:40.270789] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T18:18:40.547023] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T18:18:40.816055] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-24T18:18:40.901679] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T18:18:41.616081] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-24T18:18:42.296060] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T18:18:42.416075] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-24T18:18:42.453097] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T18:18:43.216119] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-24T18:18:44.016149] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-24T18:18:44.235417] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T18:18:44.499746] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T18:18:44.816080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-24T18:18:45.584836] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T18:18:45.620958] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-24T18:18:45.628574] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T18:18:46.416080] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-24T18:18:46.603619] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T18:18:47.216079] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-24T18:18:47.864878] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T18:18:48.016142] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-24T18:18:48.182571] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T18:18:48.816127] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-24T18:18:48.921254] [DEBUG] [REMOTE ] DCI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-24T18:18:48.921596] [WARN ] [REMOTE ] DCI: No data returned for month 2025-08 [2025-09-24T18:18:49.621405] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-24T18:18:49.648197] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T18:18:50.416105] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-24T18:18:51.216074] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-24T18:18:51.418283] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T18:18:51.427980] [INFO ] [REMOTE ] DBRG: Full fetch complete (72216 records). [2025-09-24T18:18:51.428223] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-24T18:18:51.866544] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-24T18:18:51.866674] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-24T18:18:51.867936] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-24T18:18:51.868021] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-24T18:18:51.869830] [DEBUG] [LOCAL ] DBRG: Trimmed 72216 records to 49812 (keeping 200 days of data) [2025-09-24T18:18:52.058417] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-24T18:18:52.208636] [DEBUG] [LOCAL ] DBRG: Primary data saved (49812 records). [2025-09-24T18:18:52.209461] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-24T18:18:52.210027] [INFO ] [MAIN ] Update Progress: 596/2373 symbols completed. DBRG took 43.8s. Estimated remaining: 3h 54m 58s. Rate: 7.6 symbols/min [2025-09-24T18:18:52.209888] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T18:18:52.398212] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:18:52.429673] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T18:18:52.488701] [DEBUG] [LOCAL ] DDD: Loaded 50863 existing records from primary storage. [2025-09-24T18:18:52.488861] [INFO ] [MAIN ] DDD: Loaded 50863 existing records. [2025-09-24T18:18:52.665124] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:18:52.665404] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-24T18:18:52.665454] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-24T18:18:52.666578] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-24T18:18:52.666672] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-24T18:18:52.821189] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-24T18:18:53.040080] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:18:53.616159] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-24T18:18:53.987628] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T18:18:53.995104] [INFO ] [REMOTE ] DCI: Full fetch complete (48282 records). [2025-09-24T18:18:53.995259] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-24T18:18:54.200790] [WARN ] [VALIDATOR ] DCI: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T18:18:54.201484] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:18:54.201567] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:18:54.201670] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-24T18:18:54.201770] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-24T18:18:54.201831] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-09-24T18:18:54.202364] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-09-24T18:18:54.202487] [INFO ] [MAIN ] Update Progress: 597/2373 symbols completed. DCI took 40.3s. Estimated remaining: 3h 54m 33s. Rate: 7.6 symbols/min [2025-09-24T18:18:54.416090] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-24T18:18:54.822544] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T18:18:55.216132] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-24T18:18:55.366260] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T18:18:55.410833] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T18:18:55.414237] [INFO ] [REMOTE ] DCO: Full fetch complete (19394 records). [2025-09-24T18:18:55.414316] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-24T18:18:55.780911] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-24T18:18:55.781005] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-24T18:18:55.781472] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-24T18:18:55.781512] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-24T18:18:55.782202] [DEBUG] [LOCAL ] DCO: Trimmed 19394 records to 13784 (keeping 200 days of data) [2025-09-24T18:18:55.878150] [DEBUG] [LOCAL ] DCO: Primary data saved (13784 records). [2025-09-24T18:18:55.878311] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-24T18:18:55.878436] [INFO ] [MAIN ] Update Progress: 598/2373 symbols completed. DCO took 21.1s. Estimated remaining: 3h 54m 6s. Rate: 7.6 symbols/min [2025-09-24T18:18:56.016102] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-24T18:18:57.122138] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T18:18:57.134412] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-24T18:18:57.742011] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:18:57.752320] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-24T18:18:58.759301] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T18:18:58.769990] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-24T18:18:59.565973] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T18:18:59.576164] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-24T18:19:00.565716] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T18:19:00.577616] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-24T18:19:01.188753] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T18:19:01.199825] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-24T18:19:02.595301] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T18:19:02.607139] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-24T18:19:02.864557] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T18:19:02.875629] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-24T18:19:04.236444] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:19:04.245929] [INFO ] [REMOTE ] DD: Full fetch complete (76276 records). [2025-09-24T18:19:04.246068] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-24T18:19:04.659171] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-24T18:19:04.659409] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-24T18:19:04.660487] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-24T18:19:04.660633] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-24T18:19:04.662242] [DEBUG] [LOCAL ] DD: Trimmed 76276 records to 52828 (keeping 200 days of data) [2025-09-24T18:19:04.796244] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T18:19:04.817010] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-24T18:19:05.048202] [DEBUG] [LOCAL ] DD: Primary data saved (52828 records). [2025-09-24T18:19:05.048369] [INFO ] [MAIN ] DD: Full history saved. [2025-09-24T18:19:05.048477] [INFO ] [MAIN ] Update Progress: 599/2373 symbols completed. DD took 27.6s. Estimated remaining: 3h 54m 2s. Rate: 7.6 symbols/min [2025-09-24T18:19:06.685626] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T18:19:06.696118] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-24T18:19:08.573430] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T18:19:08.592954] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-24T18:19:10.479700] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T18:19:10.491324] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-24T18:19:12.360706] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:19:12.371909] [INFO ] [REMOTE ] DDD: Full fetch complete (73661 records). [2025-09-24T18:19:12.372142] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-24T18:19:12.780038] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-24T18:19:12.780176] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-24T18:19:12.781085] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-24T18:19:12.781150] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-24T18:19:12.782680] [DEBUG] [LOCAL ] DDD: Trimmed 73661 records to 50881 (keeping 200 days of data) [2025-09-24T18:19:13.073808] [DEBUG] [LOCAL ] DDD: Primary data saved (50881 records). [2025-09-24T18:19:13.073956] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-24T18:19:13.074059] [INFO ] [MAIN ] Update Progress: 600/2373 symbols completed. DDD took 20.9s. Estimated remaining: 3h 53m 54s. Rate: 7.6 symbols/min [2025-09-24T18:19:13.719429] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:13.718506] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:13.753110] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-09-24T18:19:13.772687] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:13.777182] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-09-24T18:19:13.797437] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-24T18:19:13.797157] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:13.798170] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-24T18:19:13.798413] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-09-24T18:19:13.798688] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-24T18:19:13.906252] [DEBUG] [LOCAL ] DDS: Loaded 13255 existing records from primary storage. [2025-09-24T18:19:13.926330] [INFO ] [MAIN ] DDS: Loaded 13255 existing records. [2025-09-24T18:19:14.267786] [DEBUG] [LOCAL ] DDL: Loaded 36276 existing records from primary storage. [2025-09-24T18:19:14.303561] [INFO ] [MAIN ] DDL: Loaded 36276 existing records. [2025-09-24T18:19:14.554385] [DEBUG] [LOCAL ] DE: Loaded 47738 existing records from primary storage. [2025-09-24T18:19:14.537549] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:14.581199] [INFO ] [MAIN ] DE: Loaded 47738 existing records. [2025-09-24T18:19:14.621683] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:14.645926] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-24T18:19:14.682003] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-24T18:19:14.746501] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-24T18:19:14.816990] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-24T18:19:14.830955] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:14.856880] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-24T18:19:14.862379] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-24T18:19:14.905533] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:14.916422] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-24T18:19:14.965219] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-24T18:19:14.972048] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-24T18:19:14.998051] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-24T18:19:14.997996] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-24T18:19:15.002008] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-24T18:19:15.039855] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-24T18:19:15.367087] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T18:19:15.479944] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-24T18:19:15.987762] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:16.020895] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-24T18:19:16.142426] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:16.162850] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-24T18:19:16.166241] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:16.171350] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T18:19:16.173112] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-24T18:19:16.173417] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-24T18:19:16.660116] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T18:19:16.661244] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-24T18:19:17.134959] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T18:19:17.139063] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-24T18:19:17.174847] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-24T18:19:17.176302] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-24T18:19:17.754130] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T18:19:17.754949] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T18:19:17.765463] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-24T18:19:17.766293] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-24T18:19:18.027339] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T18:19:18.039593] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-24T18:19:18.086925] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T18:19:18.090466] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-24T18:19:18.260299] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T18:19:18.261404] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-24T18:19:18.709117] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T18:19:18.710332] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-24T18:19:18.984534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T18:19:18.992383] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-24T18:19:19.012963] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T18:19:19.208178] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T18:19:19.216036] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-24T18:19:19.688565] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T18:19:19.993902] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T18:19:20.016056] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-24T18:19:20.152256] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T18:19:20.816115] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-24T18:19:21.616078] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-24T18:19:21.819300] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T18:19:21.820436] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T18:19:22.182567] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T18:19:22.183481] [INFO ] [REMOTE ] DDT: Full fetch complete (2887 records). [2025-09-24T18:19:22.183552] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-24T18:19:22.183955] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:19:22.184038] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:19:22.184081] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:19:22.184118] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-24T18:19:22.184174] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-09-24T18:19:22.184209] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-09-24T18:19:22.184276] [DEBUG] [LOCAL ] DDT: No derivative data file found to delete. [2025-09-24T18:19:22.184354] [INFO ] [MAIN ] Update Progress: 601/2373 symbols completed. DDT took 9.1s. Estimated remaining: 3h 53m 50s. Rate: 7.6 symbols/min [2025-09-24T18:19:22.365663] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:22.405805] [DEBUG] [LOCAL ] DEA: Loaded 41499 existing records from primary storage. [2025-09-24T18:19:22.405965] [INFO ] [MAIN ] DEA: Loaded 41499 existing records. [2025-09-24T18:19:22.426269] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-24T18:19:22.586350] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:22.586633] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-24T18:19:22.586721] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-24T18:19:22.588095] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-24T18:19:22.588157] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-24T18:19:22.938741] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:23.216079] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-24T18:19:24.016094] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-24T18:19:24.365585] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:19:24.494935] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T18:19:24.816081] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-24T18:19:25.531317] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T18:19:25.616044] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-24T18:19:26.384936] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:19:26.416052] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-24T18:19:27.208168] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:19:27.218001] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-24T18:19:27.930466] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T18:19:28.016034] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-24T18:19:28.363381] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T18:19:28.816115] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-24T18:19:29.616069] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-24T18:19:29.680466] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T18:19:29.740382] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T18:19:30.416083] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-24T18:19:30.890847] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T18:19:31.216086] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-24T18:19:31.973831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T18:19:32.016072] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-24T18:19:32.037030] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T18:19:32.816085] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-24T18:19:33.483035] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T18:19:33.591526] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T18:19:33.616044] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-24T18:19:34.416106] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-24T18:19:34.720559] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:19:35.216075] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-24T18:19:35.323094] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T18:19:36.016148] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-24T18:19:36.435267] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T18:19:36.816104] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-24T18:19:37.616090] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-24T18:19:37.934353] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T18:19:38.416082] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-24T18:19:38.547736] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T18:19:38.555940] [INFO ] [REMOTE ] DDL: Full fetch complete (53379 records). [2025-09-24T18:19:38.556091] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-24T18:19:38.720716] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T18:19:39.043896] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-24T18:19:39.043991] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-24T18:19:39.044804] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-24T18:19:39.044872] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-24T18:19:39.046122] [DEBUG] [LOCAL ] DDL: Trimmed 53379 records to 36335 (keeping 200 days of data) [2025-09-24T18:19:39.237414] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-24T18:19:39.269097] [DEBUG] [LOCAL ] DDL: Primary data saved (36335 records). [2025-09-24T18:19:39.269256] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-24T18:19:39.269350] [INFO ] [MAIN ] Update Progress: 602/2373 symbols completed. DDL took 26.2s. Estimated remaining: 3h 54m 9s. Rate: 7.6 symbols/min [2025-09-24T18:19:39.467464] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:39.467758] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-09-24T18:19:39.467810] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-09-24T18:19:39.467922] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-24T18:19:39.467971] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-24T18:19:39.468022] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-24T18:19:39.468063] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-24T18:19:39.866010] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:40.016098] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-24T18:19:40.225140] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T18:19:40.229886] [INFO ] [REMOTE ] DDS: Full fetch complete (19232 records). [2025-09-24T18:19:40.229762] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T18:19:40.230109] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-24T18:19:40.637021] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-24T18:19:40.637120] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-24T18:19:40.637632] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-24T18:19:40.637713] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-24T18:19:40.638323] [DEBUG] [LOCAL ] DDS: Trimmed 19232 records to 13202 (keeping 200 days of data) [2025-09-24T18:19:40.721951] [DEBUG] [LOCAL ] DDS: Primary data saved (13202 records). [2025-09-24T18:19:40.722086] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-24T18:19:40.722171] [INFO ] [MAIN ] Update Progress: 603/2373 symbols completed. DDS took 27.6s. Estimated remaining: 3h 53m 42s. Rate: 7.6 symbols/min [2025-09-24T18:19:40.822080] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-24T18:19:40.892573] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:40.957258] [DEBUG] [LOCAL ] DECK: Loaded 53303 existing records from primary storage. [2025-09-24T18:19:40.957418] [INFO ] [MAIN ] DECK: Loaded 53303 existing records. [2025-09-24T18:19:41.140948] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:41.141537] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-24T18:19:41.141668] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-24T18:19:41.148440] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-24T18:19:41.155262] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-24T18:19:41.230880] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:19:41.524420] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:41.616040] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-24T18:19:42.416108] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-24T18:19:42.573944] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T18:19:43.216149] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-24T18:19:43.502378] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:19:43.999863] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:19:44.016024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-24T18:19:44.816065] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-24T18:19:45.032825] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T18:19:45.568892] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T18:19:45.616129] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-24T18:19:46.416103] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-24T18:19:46.513386] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:19:46.749382] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T18:19:47.216080] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-24T18:19:48.016137] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-24T18:19:48.317434] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T18:19:48.522005] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T18:19:48.816099] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-24T18:19:49.616048] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-24T18:19:49.877038] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-24T18:19:50.416124] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-24T18:19:50.635779] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T18:19:50.644373] [INFO ] [REMOTE ] DE: Full fetch complete (69602 records). [2025-09-24T18:19:50.644527] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-24T18:19:51.045036] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-24T18:19:51.045212] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-24T18:19:51.046112] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-24T18:19:51.046207] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-24T18:19:51.060636] [DEBUG] [LOCAL ] DE: Trimmed 69602 records to 47704 (keeping 200 days of data) [2025-09-24T18:19:51.070585] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:19:51.258334] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-24T18:19:51.378839] [DEBUG] [LOCAL ] DE: Primary data saved (47704 records). [2025-09-24T18:19:51.378987] [INFO ] [MAIN ] DE: Full history saved. [2025-09-24T18:19:51.379074] [INFO ] [MAIN ] Update Progress: 604/2373 symbols completed. DE took 38.3s. Estimated remaining: 3h 53m 42s. Rate: 7.6 symbols/min [2025-09-24T18:19:51.556427] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:51.556598] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-24T18:19:51.556638] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-24T18:19:51.556810] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-24T18:19:51.556854] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-24T18:19:51.556894] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-24T18:19:51.556926] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-24T18:19:51.922200] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:52.020620] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-24T18:19:52.025413] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T18:19:52.816057] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-24T18:19:52.889713] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:19:52.896868] [INFO ] [REMOTE ] DEA: Full fetch complete (62985 records). [2025-09-24T18:19:52.896986] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-24T18:19:53.288159] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-24T18:19:53.288317] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-24T18:19:53.289306] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-24T18:19:53.289387] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-24T18:19:53.290829] [DEBUG] [LOCAL ] DEA: Trimmed 62985 records to 41343 (keeping 200 days of data) [2025-09-24T18:19:53.553570] [DEBUG] [LOCAL ] DEA: Primary data saved (41343 records). [2025-09-24T18:19:53.553735] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-24T18:19:53.553832] [INFO ] [MAIN ] Update Progress: 605/2373 symbols completed. DEA took 31.4s. Estimated remaining: 3h 53m 18s. Rate: 7.6 symbols/min [2025-09-24T18:19:53.622505] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-24T18:19:53.738855] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:19:53.767872] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T18:19:53.825996] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-24T18:19:53.826149] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-09-24T18:19:54.017273] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:19:54.017770] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-24T18:19:54.017831] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-24T18:19:54.019767] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-24T18:19:54.019852] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-24T18:19:54.258245] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T18:19:54.420861] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-24T18:19:54.420753] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:19:55.216085] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-24T18:19:55.947204] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-24T18:19:55.993628] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:19:56.016037] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-24T18:19:56.816089] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-24T18:19:57.484724] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T18:19:57.616091] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-24T18:19:57.782706] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-24T18:19:58.416081] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-24T18:19:58.769626] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T18:19:58.917155] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T18:19:59.216133] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-24T18:20:00.016076] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-24T18:20:00.126322] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:20:00.816107] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-24T18:20:01.408157] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T18:20:01.616067] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-24T18:20:01.879815] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-24T18:20:02.416126] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-24T18:20:02.739982] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T18:20:03.216096] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-24T18:20:03.575637] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T18:20:04.016099] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-24T18:20:04.568380] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-24T18:20:04.816067] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-24T18:20:05.113941] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T18:20:05.616187] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-24T18:20:06.130663] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T18:20:06.347355] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T18:20:06.416142] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-24T18:20:07.216102] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-24T18:20:08.016158] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-24T18:20:08.213594] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-24T18:20:08.239716] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T18:20:08.610872] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T18:20:08.816074] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-24T18:20:09.552438] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:20:09.616038] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-24T18:20:10.149383] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T18:20:10.154879] [INFO ] [REMOTE ] DEC: Full fetch complete (42854 records). [2025-09-24T18:20:10.154984] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-24T18:20:10.421237] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-24T18:20:10.547394] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-24T18:20:10.547488] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-24T18:20:10.548228] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-24T18:20:10.548292] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-24T18:20:10.549255] [DEBUG] [LOCAL ] DEC: Trimmed 42854 records to 30630 (keeping 200 days of data) [2025-09-24T18:20:10.737105] [DEBUG] [LOCAL ] DEC: Primary data saved (30630 records). [2025-09-24T18:20:10.737250] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-24T18:20:10.737352] [INFO ] [MAIN ] Update Progress: 606/2373 symbols completed. DEC took 31.5s. Estimated remaining: 3h 53m 37s. Rate: 7.6 symbols/min [2025-09-24T18:20:10.917242] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:10.976494] [DEBUG] [LOCAL ] DEO: Loaded 49010 existing records from primary storage. [2025-09-24T18:20:10.976747] [INFO ] [MAIN ] DEO: Loaded 49010 existing records. [2025-09-24T18:20:11.168082] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:11.168717] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-24T18:20:11.168992] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-24T18:20:11.180038] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-24T18:20:11.199401] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-24T18:20:11.231406] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-24T18:20:11.269151] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:20:11.581874] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:12.016061] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-24T18:20:12.463430] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T18:20:12.816096] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-24T18:20:13.616089] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-24T18:20:13.652430] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-24T18:20:14.011203] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T18:20:14.416083] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-24T18:20:14.965232] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-24T18:20:14.974869] [INFO ] [REMOTE ] DECK: Full fetch complete (76601 records). [2025-09-24T18:20:14.975019] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-24T18:20:15.221211] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-24T18:20:15.424955] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-24T18:20:15.425189] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-24T18:20:15.427309] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-24T18:20:15.427438] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-24T18:20:15.430471] [DEBUG] [LOCAL ] DECK: Trimmed 76601 records to 53301 (keeping 200 days of data) [2025-09-24T18:20:15.790699] [DEBUG] [LOCAL ] DECK: Primary data saved (53301 records). [2025-09-24T18:20:15.790917] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-24T18:20:15.791121] [INFO ] [MAIN ] Update Progress: 607/2373 symbols completed. DECK took 35.1s. Estimated remaining: 3h 53m 20s. Rate: 7.6 symbols/min [2025-09-24T18:20:16.040038] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:16.074285] [DEBUG] [LOCAL ] DFH: Loaded 32858 existing records from primary storage. [2025-09-24T18:20:16.074425] [INFO ] [MAIN ] DFH: Loaded 32858 existing records. [2025-09-24T18:20:16.282834] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:16.283528] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-24T18:20:16.284120] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-24T18:20:16.285148] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-24T18:20:16.285211] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-24T18:20:16.663100] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:16.663628] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-24T18:20:16.696110] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-24T18:20:16.746618] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:20:16.816029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-24T18:20:17.323715] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (3.71 seconds). [2025-09-24T18:20:17.616113] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-24T18:20:18.336075] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T18:20:18.416037] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-24T18:20:19.210255] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-24T18:20:19.217989] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-24T18:20:19.567874] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T18:20:19.831818] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T18:20:20.016076] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-24T18:20:20.746151] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T18:20:20.757253] [INFO ] [REMOTE ] DEI: Full fetch complete (69530 records). [2025-09-24T18:20:20.757670] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-24T18:20:20.823152] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-24T18:20:21.392432] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-24T18:20:21.392685] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-24T18:20:21.394481] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-24T18:20:21.394786] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-24T18:20:21.431841] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T18:20:21.444160] [DEBUG] [LOCAL ] DEI: Trimmed 69530 records to 48491 (keeping 200 days of data) [2025-09-24T18:20:21.644515] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-24T18:20:21.801253] [DEBUG] [LOCAL ] DEI: Primary data saved (48491 records). [2025-09-24T18:20:21.801838] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-24T18:20:21.802204] [INFO ] [MAIN ] Update Progress: 608/2373 symbols completed. DEI took 30.4s. Estimated remaining: 3h 53m 7s. Rate: 7.6 symbols/min [2025-09-24T18:20:22.037350] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:22.070624] [DEBUG] [LOCAL ] DFIN: Loaded 23344 existing records from primary storage. [2025-09-24T18:20:22.070901] [INFO ] [MAIN ] DFIN: Loaded 23344 existing records. [2025-09-24T18:20:22.277448] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:22.277842] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-24T18:20:22.277915] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-24T18:20:22.278962] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-24T18:20:22.279066] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-24T18:20:22.421280] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-24T18:20:22.693922] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:23.144441] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T18:20:23.209787] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T18:20:23.220396] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-24T18:20:23.743689] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:20:24.016111] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-24T18:20:24.518885] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T18:20:24.816100] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-24T18:20:25.400225] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T18:20:25.616111] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-24T18:20:25.898943] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T18:20:26.416106] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-24T18:20:27.216152] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-24T18:20:27.773926] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T18:20:27.816740] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T18:20:28.016129] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-24T18:20:28.816106] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-24T18:20:28.899498] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T18:20:29.432717] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T18:20:29.616122] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-24T18:20:29.715723] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T18:20:30.416103] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-24T18:20:31.216099] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-24T18:20:31.788457] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T18:20:32.016158] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-24T18:20:32.051946] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-24T18:20:32.061042] [INFO ] [REMOTE ] DELL: Full fetch complete (77430 records). [2025-09-24T18:20:32.061181] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-24T18:20:32.062271] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:20:32.062367] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:20:32.062425] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:20:32.062490] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-24T18:20:32.062552] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-24T18:20:32.062601] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-24T18:20:32.063083] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-09-24T18:20:32.063195] [INFO ] [MAIN ] Update Progress: 609/2373 symbols completed. DELL took 38.5s. Estimated remaining: 3h 53m 6s. Rate: 7.6 symbols/min [2025-09-24T18:20:32.242386] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:32.255771] [DEBUG] [LOCAL ] DFP: Loaded 11666 existing records from primary storage. [2025-09-24T18:20:32.255900] [INFO ] [MAIN ] DFP: Loaded 11666 existing records. [2025-09-24T18:20:32.457030] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:32.457297] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-24T18:20:32.457346] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-24T18:20:32.457913] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-24T18:20:32.457973] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-24T18:20:32.819921] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-24T18:20:32.826233] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:32.997417] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T18:20:33.484463] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T18:20:33.616102] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-24T18:20:34.154826] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:20:34.244865] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T18:20:34.416083] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-24T18:20:35.166600] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T18:20:35.216073] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-24T18:20:36.016132] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-24T18:20:36.033887] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T18:20:36.816129] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-24T18:20:37.241486] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T18:20:37.616082] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-24T18:20:37.638874] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T18:20:38.416131] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-24T18:20:38.945489] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T18:20:38.950922] [INFO ] [REMOTE ] DFH: Full fetch complete (49104 records). [2025-09-24T18:20:38.951021] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-24T18:20:39.220392] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-24T18:20:39.342396] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T18:20:39.363696] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-24T18:20:39.364047] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-24T18:20:39.364807] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-24T18:20:39.364871] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-24T18:20:39.365863] [DEBUG] [LOCAL ] DFH: Trimmed 49104 records to 32733 (keeping 200 days of data) [2025-09-24T18:20:39.565662] [DEBUG] [LOCAL ] DFH: Primary data saved (32733 records). [2025-09-24T18:20:39.565935] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-24T18:20:39.566030] [INFO ] [MAIN ] Update Progress: 610/2373 symbols completed. DFH took 23.8s. Estimated remaining: 3h 52m 57s. Rate: 7.6 symbols/min [2025-09-24T18:20:39.737032] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:39.792314] [DEBUG] [LOCAL ] DG: Loaded 53308 existing records from primary storage. [2025-09-24T18:20:39.792465] [INFO ] [MAIN ] DG: Loaded 53308 existing records. [2025-09-24T18:20:39.973135] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:39.973464] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-24T18:20:39.973526] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-24T18:20:39.975224] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-24T18:20:39.975298] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-24T18:20:40.021182] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-24T18:20:40.364144] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:40.816105] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-24T18:20:41.033779] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T18:20:41.060195] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T18:20:41.616083] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-24T18:20:42.416073] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-24T18:20:42.687379] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T18:20:43.111183] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-24T18:20:43.216099] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-24T18:20:43.629121] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T18:20:44.016064] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-24T18:20:44.102889] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T18:20:44.816138] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-24T18:20:45.616161] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-24T18:20:45.988849] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T18:20:46.416047] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-24T18:20:46.649192] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T18:20:46.805794] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:20:47.216122] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-24T18:20:48.016070] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-24T18:20:48.258775] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T18:20:48.816059] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-24T18:20:48.858133] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T18:20:49.382077] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T18:20:49.616123] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-24T18:20:50.416072] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-24T18:20:50.699569] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T18:20:51.216110] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-24T18:20:51.349976] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T18:20:51.472919] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:20:51.483044] [INFO ] [REMOTE ] DEO: Full fetch complete (71512 records). [2025-09-24T18:20:51.483198] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-24T18:20:51.873394] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-24T18:20:51.873484] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-24T18:20:51.874335] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-24T18:20:51.874398] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-24T18:20:51.875846] [DEBUG] [LOCAL ] DEO: Trimmed 71512 records to 49022 (keeping 200 days of data) [2025-09-24T18:20:52.060876] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-24T18:20:52.190035] [DEBUG] [LOCAL ] DEO: Primary data saved (49022 records). [2025-09-24T18:20:52.190177] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-24T18:20:52.190260] [INFO ] [MAIN ] Update Progress: 611/2373 symbols completed. DEO took 41.5s. Estimated remaining: 3h 53m 2s. Rate: 7.6 symbols/min [2025-09-24T18:20:52.364379] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:52.415171] [DEBUG] [LOCAL ] DGX: Loaded 45287 existing records from primary storage. [2025-09-24T18:20:52.415332] [INFO ] [MAIN ] DGX: Loaded 45287 existing records. [2025-09-24T18:20:52.595152] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:52.595479] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-24T18:20:52.595530] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-24T18:20:52.597062] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-24T18:20:52.597127] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-24T18:20:52.841225] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-24T18:20:52.969815] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:52.982359] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T18:20:52.985247] [INFO ] [REMOTE ] DFP: Full fetch complete (16220 records). [2025-09-24T18:20:52.985319] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-24T18:20:53.294144] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T18:20:53.409283] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-24T18:20:53.409361] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-24T18:20:53.409734] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-24T18:20:53.409795] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-24T18:20:53.411020] [DEBUG] [LOCAL ] DFP: Trimmed 16220 records to 11684 (keeping 200 days of data) [2025-09-24T18:20:53.486857] [DEBUG] [LOCAL ] DFP: Primary data saved (11684 records). [2025-09-24T18:20:53.487018] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-24T18:20:53.487110] [INFO ] [MAIN ] Update Progress: 612/2373 symbols completed. DFP took 21.4s. Estimated remaining: 3h 52m 35s. Rate: 7.6 symbols/min [2025-09-24T18:20:53.627398] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-24T18:20:53.661059] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:53.683090] [DEBUG] [LOCAL ] DHF: Loaded 20704 existing records from primary storage. [2025-09-24T18:20:53.683225] [INFO ] [MAIN ] DHF: Loaded 20704 existing records. [2025-09-24T18:20:53.863583] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:53.864151] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-24T18:20:53.864252] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-24T18:20:53.865045] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-24T18:20:53.865108] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-24T18:20:54.170048] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T18:20:54.242131] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:54.416097] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-24T18:20:55.022088] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:20:55.216123] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-24T18:20:56.016092] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-24T18:20:56.276299] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T18:20:56.794055] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:20:56.816044] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-24T18:20:57.183117] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T18:20:57.187492] [INFO ] [REMOTE ] DFIN: Full fetch complete (33466 records). [2025-09-24T18:20:57.187582] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-24T18:20:57.577053] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-24T18:20:57.577140] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-24T18:20:57.577809] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-24T18:20:57.577874] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-24T18:20:57.578709] [DEBUG] [LOCAL ] DFIN: Trimmed 33466 records to 23295 (keeping 200 days of data) [2025-09-24T18:20:57.637313] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-24T18:20:57.730791] [DEBUG] [LOCAL ] DFIN: Primary data saved (23295 records). [2025-09-24T18:20:57.730968] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-24T18:20:57.731077] [INFO ] [MAIN ] Update Progress: 613/2373 symbols completed. DFIN took 35.9s. Estimated remaining: 3h 52m 17s. Rate: 7.6 symbols/min [2025-09-24T18:20:57.900107] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:20:57.960156] [DEBUG] [LOCAL ] DHI: Loaded 53376 existing records from primary storage. [2025-09-24T18:20:57.960311] [INFO ] [MAIN ] DHI: Loaded 53376 existing records. [2025-09-24T18:20:58.144213] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:20:58.144704] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-24T18:20:58.144820] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-24T18:20:58.146422] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-24T18:20:58.146489] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-24T18:20:58.299001] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T18:20:58.423129] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-24T18:20:58.538474] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:20:59.216098] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-24T18:20:59.626184] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T18:21:00.021550] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-24T18:21:00.040806] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:21:00.816123] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-24T18:21:01.267019] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T18:21:01.616081] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-24T18:21:02.021908] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:21:02.146979] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T18:21:02.416090] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-24T18:21:03.216138] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-24T18:21:04.016152] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-24T18:21:04.620409] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-24T18:21:04.649965] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T18:21:04.816102] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-24T18:21:05.126109] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-24T18:21:05.616152] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-24T18:21:06.083508] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T18:21:06.323197] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-24T18:21:06.416140] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-24T18:21:07.216058] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-24T18:21:07.526344] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:21:07.538001] [INFO ] [REMOTE ] DG: Full fetch complete (77227 records). [2025-09-24T18:21:07.538232] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-24T18:21:08.017026] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-24T18:21:08.048821] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-24T18:21:08.049044] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-24T18:21:08.050507] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-24T18:21:08.050615] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-24T18:21:08.052796] [DEBUG] [LOCAL ] DG: Trimmed 77227 records to 53299 (keeping 200 days of data) [2025-09-24T18:21:08.347225] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T18:21:08.421514] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:21:08.487673] [DEBUG] [LOCAL ] DG: Primary data saved (53299 records). [2025-09-24T18:21:08.487861] [INFO ] [MAIN ] DG: Full history saved. [2025-09-24T18:21:08.487954] [INFO ] [MAIN ] Update Progress: 614/2373 symbols completed. DG took 28.9s. Estimated remaining: 3h 52m 17s. Rate: 7.6 symbols/min [2025-09-24T18:21:08.688146] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:08.688351] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-24T18:21:08.688393] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-24T18:21:08.688552] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-24T18:21:08.688599] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-24T18:21:08.688665] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-24T18:21:08.688722] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-24T18:21:08.821233] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-24T18:21:09.077247] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:09.616101] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-24T18:21:10.322231] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T18:21:10.351812] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T18:21:10.416137] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-24T18:21:10.450345] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-24T18:21:11.216110] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-24T18:21:12.016059] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-24T18:21:12.138526] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T18:21:12.170820] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:21:12.816117] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-24T18:21:13.616148] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-24T18:21:13.796627] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T18:21:13.942193] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T18:21:14.416151] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-24T18:21:15.216111] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-24T18:21:15.707606] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T18:21:16.015885] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T18:21:16.016300] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-24T18:21:16.368035] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T18:21:16.816120] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-24T18:21:17.616126] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-24T18:21:18.067837] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T18:21:18.416132] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-24T18:21:18.701834] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T18:21:18.761732] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T18:21:19.216087] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-24T18:21:20.016087] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-24T18:21:20.226462] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T18:21:20.230722] [INFO ] [REMOTE ] DHF: Full fetch complete (29461 records). [2025-09-24T18:21:20.230912] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-24T18:21:20.650457] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-24T18:21:20.675422] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-24T18:21:20.675708] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-24T18:21:20.676317] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-24T18:21:20.676431] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-24T18:21:20.677886] [DEBUG] [LOCAL ] DHF: Trimmed 29461 records to 20496 (keeping 200 days of data) [2025-09-24T18:21:20.812973] [DEBUG] [LOCAL ] DHF: Primary data saved (20496 records). [2025-09-24T18:21:20.813122] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-24T18:21:20.813214] [INFO ] [MAIN ] Update Progress: 615/2373 symbols completed. DHF took 27.3s. Estimated remaining: 3h 52m 21s. Rate: 7.6 symbols/min [2025-09-24T18:21:20.824695] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-24T18:21:21.005804] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:21.062699] [DEBUG] [LOCAL ] DHT: Loaded 47960 existing records from primary storage. [2025-09-24T18:21:21.062935] [INFO ] [MAIN ] DHT: Loaded 47960 existing records. [2025-09-24T18:21:21.278191] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:21:21.278667] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-24T18:21:21.278738] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-24T18:21:21.280469] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-24T18:21:21.280537] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-24T18:21:21.617117] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-24T18:21:21.712872] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T18:21:21.726833] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:21.728022] [INFO ] [REMOTE ] DGX: Full fetch complete (65196 records). [2025-09-24T18:21:21.728156] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-24T18:21:22.123636] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-24T18:21:22.123756] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-24T18:21:22.124666] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-24T18:21:22.124732] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-24T18:21:22.126216] [DEBUG] [LOCAL ] DGX: Trimmed 65196 records to 45219 (keeping 200 days of data) [2025-09-24T18:21:22.408940] [DEBUG] [LOCAL ] DGX: Primary data saved (45219 records). [2025-09-24T18:21:22.409100] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-24T18:21:22.409198] [INFO ] [MAIN ] Update Progress: 616/2373 symbols completed. DGX took 30.2s. Estimated remaining: 3h 51m 55s. Rate: 7.6 symbols/min [2025-09-24T18:21:22.421340] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-24T18:21:22.606194] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:22.609767] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-24T18:21:22.609841] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-24T18:21:22.610016] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-24T18:21:22.610060] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-24T18:21:22.610103] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-24T18:21:22.610139] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-24T18:21:23.043028] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:23.063810] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-24T18:21:23.216090] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-24T18:21:23.449552] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T18:21:24.016052] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-24T18:21:24.360904] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T18:21:24.816073] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-24T18:21:24.966622] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T18:21:25.582357] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T18:21:25.616038] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-24T18:21:26.416063] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-24T18:21:26.545413] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:21:27.216125] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-24T18:21:28.016105] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-24T18:21:28.645577] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-24T18:21:28.735701] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T18:21:28.816092] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-24T18:21:29.403472] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-09-24T18:21:29.582395] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T18:21:29.616137] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-24T18:21:30.321180] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T18:21:30.416128] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-24T18:21:30.670022] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T18:21:31.216080] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-24T18:21:32.016129] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-24T18:21:32.153782] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T18:21:32.612567] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T18:21:32.816076] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-24T18:21:33.616083] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-24T18:21:33.837948] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T18:21:33.846915] [INFO ] [REMOTE ] DHI: Full fetch complete (76836 records). [2025-09-24T18:21:33.847057] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-24T18:21:33.847930] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:21:33.848045] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:21:33.848103] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:21:33.848191] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-24T18:21:33.848275] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-24T18:21:33.848328] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-24T18:21:33.848866] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-09-24T18:21:33.848995] [INFO ] [MAIN ] Update Progress: 617/2373 symbols completed. DHI took 36.1s. Estimated remaining: 3h 51m 58s. Rate: 7.6 symbols/min [2025-09-24T18:21:34.016942] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:34.030491] [DEBUG] [LOCAL ] DIAX: Loaded 12421 existing records from primary storage. [2025-09-24T18:21:34.030607] [INFO ] [MAIN ] DIAX: Loaded 12421 existing records. [2025-09-24T18:21:34.222597] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:21:34.223090] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-24T18:21:34.223230] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-24T18:21:34.223757] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-24T18:21:34.223832] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-24T18:21:34.432243] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-24T18:21:34.496912] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T18:21:34.648611] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:34.673209] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T18:21:35.216106] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-24T18:21:36.016102] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-24T18:21:36.652230] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T18:21:36.816064] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-24T18:21:36.916704] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T18:21:37.031235] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T18:21:37.498093] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T18:21:37.616106] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-24T18:21:38.416126] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-24T18:21:39.204480] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T18:21:39.216051] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-24T18:21:39.328374] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T18:21:39.979448] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T18:21:40.016146] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-24T18:21:40.569385] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T18:21:40.816105] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-24T18:21:41.616098] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-24T18:21:42.416057] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-24T18:21:42.736517] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T18:21:42.793089] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T18:21:43.084620] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-24T18:21:43.216086] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-24T18:21:44.016093] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-24T18:21:44.816065] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-24T18:21:45.009519] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T18:21:45.284940] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T18:21:45.294524] [INFO ] [REMOTE ] DHR: Full fetch complete (77266 records). [2025-09-24T18:21:45.294720] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-24T18:21:45.616113] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-24T18:21:45.634899] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T18:21:45.720661] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-24T18:21:45.720767] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-24T18:21:45.721781] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-24T18:21:45.721851] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-24T18:21:45.723438] [DEBUG] [LOCAL ] DHR: Trimmed 77266 records to 53359 (keeping 200 days of data) [2025-09-24T18:21:46.053015] [DEBUG] [LOCAL ] DHR: Primary data saved (53359 records). [2025-09-24T18:21:46.053159] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-24T18:21:46.053237] [INFO ] [MAIN ] Update Progress: 618/2373 symbols completed. DHR took 37.6s. Estimated remaining: 3h 52m 2s. Rate: 7.6 symbols/min [2025-09-24T18:21:46.221085] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:46.257695] [DEBUG] [LOCAL ] DIN: Loaded 37264 existing records from primary storage. [2025-09-24T18:21:46.257846] [INFO ] [MAIN ] DIN: Loaded 37264 existing records. [2025-09-24T18:21:46.429012] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-24T18:21:46.434349] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:21:46.435582] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-24T18:21:46.435634] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-24T18:21:46.436948] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-24T18:21:46.437015] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-24T18:21:46.793279] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:47.216069] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-24T18:21:47.332109] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T18:21:47.371326] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T18:21:47.979511] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T18:21:48.016057] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-24T18:21:48.784047] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T18:21:48.816035] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-24T18:21:49.591956] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T18:21:49.616019] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-24T18:21:50.416053] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-24T18:21:50.613006] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T18:21:50.616335] [INFO ] [REMOTE ] DHX: Full fetch complete (20900 records). [2025-09-24T18:21:50.616483] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-24T18:21:50.999105] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-24T18:21:50.999190] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-24T18:21:50.999729] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-24T18:21:50.999791] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-24T18:21:51.000407] [DEBUG] [LOCAL ] DHX: Trimmed 20900 records to 13224 (keeping 200 days of data) [2025-09-24T18:21:51.081885] [DEBUG] [LOCAL ] DHX: Primary data saved (13224 records). [2025-09-24T18:21:51.082072] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-24T18:21:51.082162] [INFO ] [MAIN ] Update Progress: 619/2373 symbols completed. DHX took 28.7s. Estimated remaining: 3h 51m 46s. Rate: 7.6 symbols/min [2025-09-24T18:21:51.221168] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-24T18:21:51.271117] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:51.328526] [DEBUG] [LOCAL ] DINO: Loaded 52963 existing records from primary storage. [2025-09-24T18:21:51.329161] [INFO ] [MAIN ] DINO: Loaded 52963 existing records. [2025-09-24T18:21:51.520338] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:21:51.520673] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-24T18:21:51.520735] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-24T18:21:51.522225] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-24T18:21:51.522312] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-24T18:21:51.842007] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T18:21:51.925703] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:52.016079] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-24T18:21:52.816083] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-24T18:21:53.536464] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T18:21:53.616062] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-24T18:21:54.409807] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-24T18:21:54.433974] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-24T18:21:54.453129] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T18:21:54.926411] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:21:54.934771] [INFO ] [REMOTE ] DHT: Full fetch complete (69693 records). [2025-09-24T18:21:54.934939] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-24T18:21:54.935845] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:21:54.935941] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:21:54.935985] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:21:54.936052] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-24T18:21:54.936120] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-24T18:21:54.936157] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-24T18:21:54.940850] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-24T18:21:54.941104] [INFO ] [MAIN ] Update Progress: 620/2373 symbols completed. DHT took 34.1s. Estimated remaining: 3h 51m 26s. Rate: 7.6 symbols/min [2025-09-24T18:21:55.112110] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:21:55.158331] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T18:21:55.182974] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-24T18:21:55.183137] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-24T18:21:55.221330] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-24T18:21:55.374519] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:21:55.374810] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-24T18:21:55.374866] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-24T18:21:55.376230] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-24T18:21:55.376298] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-24T18:21:55.746071] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:21:56.016115] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-24T18:21:56.816887] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-24T18:21:56.822766] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T18:21:57.279447] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T18:21:57.616099] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-24T18:21:58.416141] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-24T18:21:59.071539] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T18:21:59.216097] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-24T18:21:59.355177] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-24T18:21:59.396737] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T18:21:59.399778] [INFO ] [REMOTE ] DIAX: Full fetch complete (17259 records). [2025-09-24T18:21:59.399858] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-24T18:21:59.768253] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-24T18:21:59.768371] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-24T18:21:59.768804] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-24T18:21:59.768866] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-24T18:21:59.769398] [DEBUG] [LOCAL ] DIAX: Trimmed 17259 records to 12538 (keeping 200 days of data) [2025-09-24T18:21:59.846673] [DEBUG] [LOCAL ] DIAX: Primary data saved (12538 records). [2025-09-24T18:21:59.846843] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-24T18:21:59.846936] [INFO ] [MAIN ] Update Progress: 621/2373 symbols completed. DIAX took 26.0s. Estimated remaining: 3h 51m 10s. Rate: 7.6 symbols/min [2025-09-24T18:22:00.018622] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:00.016928] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-24T18:22:00.019022] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-24T18:22:00.020348] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-24T18:22:00.020515] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-24T18:22:00.020560] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-24T18:22:00.020604] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-24T18:22:00.020638] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-24T18:22:00.396724] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:00.490067] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T18:22:00.816081] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-24T18:22:01.616155] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-24T18:22:02.110158] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T18:22:02.184556] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-24T18:22:02.416104] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-24T18:22:02.849101] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T18:22:03.216111] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-24T18:22:03.266390] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-24T18:22:03.567766] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T18:22:04.016105] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-24T18:22:04.816109] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-24T18:22:05.274804] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T18:22:05.616144] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-24T18:22:06.085967] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T18:22:06.416152] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-24T18:22:06.479453] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-24T18:22:06.802489] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-24T18:22:07.216108] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-24T18:22:08.016115] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-24T18:22:08.651233] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T18:22:08.816085] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-24T18:22:09.616090] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-24T18:22:09.955694] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:22:10.022183] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T18:22:10.416092] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-24T18:22:11.216142] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-24T18:22:11.549297] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T18:22:11.581789] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-24T18:22:12.016108] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-24T18:22:12.518461] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T18:22:12.520578] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T18:22:12.816101] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-24T18:22:13.224832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T18:22:13.616109] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-24T18:22:14.416103] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-24T18:22:15.216082] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-24T18:22:16.016075] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-24T18:22:16.107492] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-24T18:22:16.188998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T18:22:16.416806] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T18:22:16.541079] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T18:22:16.541972] [INFO ] [REMOTE ] DIVY: Full fetch complete (1715 records). [2025-09-24T18:22:16.542047] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-24T18:22:16.735159] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T18:22:16.735419] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:22:16.735498] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:22:16.735572] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-24T18:22:16.735678] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-24T18:22:16.735742] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-24T18:22:16.735804] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-24T18:22:16.735925] [INFO ] [MAIN ] Update Progress: 622/2373 symbols completed. DIVY took 16.9s. Estimated remaining: 3h 51m 27s. Rate: 7.6 symbols/min [2025-09-24T18:22:16.821301] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-24T18:22:16.933003] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:16.988337] [DEBUG] [LOCAL ] DK: Loaded 49391 existing records from primary storage. [2025-09-24T18:22:16.988523] [INFO ] [MAIN ] DK: Loaded 49391 existing records. [2025-09-24T18:22:17.194199] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:22:17.194792] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-24T18:22:17.194870] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-24T18:22:17.196257] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-24T18:22:17.196386] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-24T18:22:17.583589] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:17.616077] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-24T18:22:18.416087] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-24T18:22:18.574554] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T18:22:19.203961] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T18:22:19.216035] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-24T18:22:20.016076] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-24T18:22:20.794342] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-24T18:22:20.816058] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-24T18:22:20.848310] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:22:21.627316] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-24T18:22:21.635596] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:22:22.416134] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-24T18:22:23.104252] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T18:22:23.144557] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-24T18:22:23.216067] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-24T18:22:24.016159] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-24T18:22:24.279137] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T18:22:24.816144] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-24T18:22:25.642846] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-24T18:22:25.678300] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T18:22:25.675896] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-24T18:22:26.251781] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:22:26.416132] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-24T18:22:27.216119] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-24T18:22:27.553668] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:22:27.565359] [INFO ] [REMOTE ] DINO: Full fetch complete (76677 records). [2025-09-24T18:22:27.565581] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-24T18:22:27.995707] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-24T18:22:27.995997] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-24T18:22:27.997160] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-24T18:22:27.997328] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-24T18:22:28.001076] [DEBUG] [LOCAL ] DINO: Trimmed 76677 records to 52958 (keeping 200 days of data) [2025-09-24T18:22:28.062959] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-24T18:22:28.141582] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:22:28.397799] [DEBUG] [LOCAL ] DINO: Primary data saved (52958 records). [2025-09-24T18:22:28.398064] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-24T18:22:28.398289] [INFO ] [MAIN ] Update Progress: 623/2373 symbols completed. DINO took 37.3s. Estimated remaining: 3h 51m 30s. Rate: 7.6 symbols/min [2025-09-24T18:22:28.575951] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:28.576186] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-09-24T18:22:28.576244] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-09-24T18:22:28.576454] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-24T18:22:28.576515] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-24T18:22:28.576585] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-24T18:22:28.576631] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-24T18:22:28.822035] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-24T18:22:28.968164] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:29.380034] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T18:22:29.387809] [INFO ] [REMOTE ] DIN: Full fetch complete (55164 records). [2025-09-24T18:22:29.388043] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-24T18:22:29.532529] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T18:22:29.628869] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-24T18:22:29.827955] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-24T18:22:29.828043] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-24T18:22:29.828800] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-24T18:22:29.828863] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-24T18:22:29.831488] [DEBUG] [LOCAL ] DIN: Trimmed 55164 records to 37275 (keeping 200 days of data) [2025-09-24T18:22:30.076724] [DEBUG] [LOCAL ] DIN: Primary data saved (37275 records). [2025-09-24T18:22:30.076870] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-24T18:22:30.076982] [INFO ] [MAIN ] Update Progress: 624/2373 symbols completed. DIN took 44.0s. Estimated remaining: 3h 51m 4s. Rate: 7.6 symbols/min [2025-09-24T18:22:30.251082] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:30.313264] [DEBUG] [LOCAL ] DKS: Loaded 49949 existing records from primary storage. [2025-09-24T18:22:30.313427] [INFO ] [MAIN ] DKS: Loaded 49949 existing records. [2025-09-24T18:22:30.419473] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-24T18:22:30.509136] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:22:30.509599] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-24T18:22:30.509727] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-24T18:22:30.511722] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-24T18:22:30.511798] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-24T18:22:30.859918] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-24T18:22:30.951924] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:31.216151] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-24T18:22:31.634539] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T18:22:32.021427] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-24T18:22:32.037450] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-24T18:22:32.050017] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-24T18:22:32.050240] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-24T18:22:32.486023] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-24T18:22:32.486112] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-24T18:22:32.487063] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-24T18:22:32.487126] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-24T18:22:32.489080] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-24T18:22:32.818310] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-24T18:22:32.856132] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-24T18:22:32.856490] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-24T18:22:32.856734] [INFO ] [MAIN ] Update Progress: 625/2373 symbols completed. DIS took 37.9s. Estimated remaining: 3h 50m 42s. Rate: 7.6 symbols/min [2025-09-24T18:22:33.059691] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:33.060173] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-09-24T18:22:33.060220] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-09-24T18:22:33.078423] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-24T18:22:33.101473] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-24T18:22:33.105865] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-24T18:22:33.106351] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-24T18:22:33.115173] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T18:22:33.525734] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:33.557952] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T18:22:33.616089] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-24T18:22:33.820042] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T18:22:34.416096] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-24T18:22:35.196108] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:22:35.216048] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-24T18:22:35.794186] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:22:36.016165] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-24T18:22:36.828420] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-24T18:22:36.831619] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T18:22:36.900604] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T18:22:37.616099] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-24T18:22:38.268387] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:22:38.416134] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-24T18:22:38.699067] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T18:22:39.216169] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-24T18:22:39.993868] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T18:22:40.016068] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-24T18:22:40.056999] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:22:40.816166] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-24T18:22:41.616153] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-24T18:22:41.697090] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T18:22:42.126745] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T18:22:42.416245] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-24T18:22:42.802051] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T18:22:43.216167] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-24T18:22:43.554568] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T18:22:44.016111] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-24T18:22:44.816225] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-24T18:22:44.974008] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T18:22:45.174189] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T18:22:45.616160] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-24T18:22:45.702693] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T18:22:46.416100] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-24T18:22:46.976403] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T18:22:46.990162] [INFO ] [REMOTE ] DK: Full fetch complete (70676 records). [2025-09-24T18:22:46.990370] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-24T18:22:47.221374] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-24T18:22:47.429208] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-24T18:22:47.429313] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-24T18:22:47.430245] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-24T18:22:47.430313] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-24T18:22:47.431885] [DEBUG] [LOCAL ] DK: Trimmed 70676 records to 49380 (keeping 200 days of data) [2025-09-24T18:22:47.746256] [DEBUG] [LOCAL ] DK: Primary data saved (49380 records). [2025-09-24T18:22:47.746446] [INFO ] [MAIN ] DK: Full history saved. [2025-09-24T18:22:47.746609] [INFO ] [MAIN ] Update Progress: 626/2373 symbols completed. DK took 31.0s. Estimated remaining: 3h 50m 53s. Rate: 7.6 symbols/min [2025-09-24T18:22:47.942256] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:22:47.951373] [DEBUG] [LOCAL ] DLNG: Loaded 6188 existing records from primary storage. [2025-09-24T18:22:47.951482] [INFO ] [MAIN ] DLNG: Loaded 6188 existing records. [2025-09-24T18:22:48.019517] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-24T18:22:48.131486] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:22:48.176487] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:22:48.185067] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-24T18:22:48.185155] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-24T18:22:48.185561] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-24T18:22:48.185624] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-24T18:22:48.357330] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T18:22:48.584632] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:22:48.816106] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-24T18:22:49.616066] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-24T18:22:49.835893] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T18:22:49.977614] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T18:22:50.416121] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-24T18:22:50.479664] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T18:22:51.216149] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-24T18:22:52.016149] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-24T18:22:52.292153] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T18:22:52.816147] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-24T18:22:53.616146] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-24T18:23:05.175512] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (13.16 seconds). [2025-09-24T18:23:05.179636] [INFO ] [REMOTE ] DKL: Full fetch complete (29195 records). [2025-09-24T18:23:05.179868] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-24T18:23:05.180639] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:23:05.180751] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:23:05.180808] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:23:05.180883] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-24T18:23:05.180963] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-24T18:23:05.181030] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-24T18:23:05.181113] [DEBUG] [LOCAL ] DKL: No derivative data file found to delete. [2025-09-24T18:23:05.181212] [INFO ] [MAIN ] Update Progress: 627/2373 symbols completed. DKL took 36.8s. Estimated remaining: 3h 51m 12s. Rate: 7.6 symbols/min [2025-09-24T18:23:05.399077] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:05.401278] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (14.19 seconds). [2025-09-24T18:23:05.406595] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-24T18:23:05.467380] [DEBUG] [LOCAL ] DLR: Loaded 51180 existing records from primary storage. [2025-09-24T18:23:05.467533] [INFO ] [MAIN ] DLR: Loaded 51180 existing records. [2025-09-24T18:23:05.662487] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:05.662786] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-24T18:23:05.662839] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-24T18:23:05.664499] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-24T18:23:05.664560] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-24T18:23:06.038523] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:06.039001] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-24T18:23:06.070354] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (13.25 seconds). [2025-09-24T18:23:06.082448] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-24T18:23:06.236501] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (12.62 seconds). [2025-09-24T18:23:06.244782] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-24T18:23:07.044045] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T18:23:07.048902] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-24T18:23:07.558944] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T18:23:07.566866] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-24T18:23:07.725051] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T18:23:07.736092] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-24T18:23:07.889816] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T18:23:07.892867] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-24T18:23:08.658754] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-24T18:23:08.677008] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T18:23:08.676537] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-24T18:23:08.680771] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-24T18:23:08.886932] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:23:08.893953] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-24T18:23:09.123118] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T18:23:09.125910] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-24T18:23:09.167276] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T18:23:09.178325] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-24T18:23:09.594338] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T18:23:09.596280] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-24T18:23:09.887200] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T18:23:09.894535] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-24T18:23:10.086792] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T18:23:10.097089] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-24T18:23:10.190752] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T18:23:10.192690] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-24T18:23:10.634396] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T18:23:10.636177] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-24T18:23:10.917306] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T18:23:10.923381] [INFO ] [REMOTE ] DLB: Full fetch complete (46932 records). [2025-09-24T18:23:10.923486] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-24T18:23:11.175376] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T18:23:11.199543] [INFO ] [REMOTE ] DLNG: Full fetch complete (12009 records). [2025-09-24T18:23:11.238981] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-24T18:23:11.412745] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-24T18:23:11.418195] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-24T18:23:11.435425] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-24T18:23:11.435676] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-24T18:23:11.505976] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-24T18:23:11.536470] [DEBUG] [LOCAL ] DLB: Trimmed 46932 records to 32152 (keeping 200 days of data) [2025-09-24T18:23:11.614537] [INFO ] [REMOTE ] DKS: Full fetch complete (71590 records). [2025-09-24T18:23:11.693530] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-24T18:23:12.011064] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-24T18:23:12.016598] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-24T18:23:12.017455] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-24T18:23:12.040479] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-24T18:23:12.110422] [DEBUG] [LOCAL ] DLNG: Trimmed 12009 records to 6175 (keeping 200 days of data) [2025-09-24T18:23:12.230133] [DEBUG] [LOCAL ] DLNG: Primary data saved (6175 records). [2025-09-24T18:23:12.252223] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-24T18:23:12.291225] [INFO ] [MAIN ] Update Progress: 628/2373 symbols completed. DLNG took 24.5s. Estimated remaining: 3h 51m 2s. Rate: 7.6 symbols/min [2025-09-24T18:23:12.418338] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-24T18:23:12.570794] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-24T18:23:12.579772] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-24T18:23:12.581144] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-24T18:23:12.582175] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-24T18:23:12.588069] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-24T18:23:12.655556] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:12.660077] [DEBUG] [LOCAL ] DKS: Trimmed 71590 records to 49904 (keeping 200 days of data) [2025-09-24T18:23:12.849196] [DEBUG] [LOCAL ] DLX: Loaded 29096 existing records from primary storage. [2025-09-24T18:23:12.852357] [INFO ] [MAIN ] DLX: Loaded 29096 existing records. [2025-09-24T18:23:12.979028] [DEBUG] [LOCAL ] DLB: Primary data saved (32152 records). [2025-09-24T18:23:12.985887] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-24T18:23:12.991721] [INFO ] [MAIN ] Update Progress: 629/2373 symbols completed. DLB took 40.1s. Estimated remaining: 3h 50m 34s. Rate: 7.6 symbols/min [2025-09-24T18:23:13.126385] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:13.160612] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-24T18:23:13.168039] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-24T18:23:13.178245] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-24T18:23:13.183063] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-24T18:23:13.343138] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:13.541157] [DEBUG] [LOCAL ] DLY: Loaded 19442 existing records from primary storage. [2025-09-24T18:23:13.556501] [INFO ] [MAIN ] DLY: Loaded 19442 existing records. [2025-09-24T18:23:13.806415] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:13.818291] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-24T18:23:13.883137] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:13.889863] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-24T18:23:13.889995] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-24T18:23:13.890605] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-24T18:23:13.890696] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-24T18:23:14.373018] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:14.375091] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-24T18:23:14.477816] [DEBUG] [LOCAL ] DKS: Primary data saved (49904 records). [2025-09-24T18:23:14.477971] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-24T18:23:14.478061] [INFO ] [MAIN ] Update Progress: 630/2373 symbols completed. DKS took 44.4s. Estimated remaining: 3h 50m 8s. Rate: 7.6 symbols/min [2025-09-24T18:23:14.674394] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:14.711870] [DEBUG] [LOCAL ] DMA: Loaded 4506 existing records from primary storage. [2025-09-24T18:23:14.714328] [INFO ] [MAIN ] DMA: Loaded 4506 existing records. [2025-09-24T18:23:14.714181] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-24T18:23:14.781947] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-24T18:23:14.950923] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:14.951389] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-24T18:23:14.951465] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-24T18:23:14.951775] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-24T18:23:14.951857] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-24T18:23:15.062509] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T18:23:15.090985] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-24T18:23:15.357899] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:15.358458] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-24T18:23:15.604963] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T18:23:15.610405] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-24T18:23:15.947758] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T18:23:15.949876] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-24T18:23:16.242118] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T18:23:16.247271] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-24T18:23:16.514822] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-24T18:23:16.516504] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-24T18:23:16.565898] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T18:23:16.623075] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T18:23:16.816083] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-24T18:23:17.069046] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T18:23:17.552134] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T18:23:17.616067] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-24T18:23:17.656450] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T18:23:18.416160] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-24T18:23:18.548113] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T18:23:19.216087] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-24T18:23:19.431134] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T18:23:20.016047] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-24T18:23:20.305948] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T18:23:20.816148] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-24T18:23:21.377101] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T18:23:21.616070] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-24T18:23:21.719714] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T18:23:22.155175] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T18:23:22.416108] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-24T18:23:23.216083] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-24T18:23:23.695074] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T18:23:23.790963] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T18:23:24.016135] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-24T18:23:24.716411] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T18:23:24.816129] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-24T18:23:25.616099] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-24T18:23:26.047774] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T18:23:26.226940] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T18:23:26.416081] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-24T18:23:26.980473] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T18:23:27.216134] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-24T18:23:28.016131] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-24T18:23:28.623521] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T18:23:28.816090] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-24T18:23:28.949705] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T18:23:29.616147] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-24T18:23:29.667934] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T18:23:29.670088] [INFO ] [REMOTE ] DMA: Full fetch complete (6553 records). [2025-09-24T18:23:29.670182] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-24T18:23:30.117218] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-24T18:23:30.117308] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-24T18:23:30.117518] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-24T18:23:30.117599] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-24T18:23:30.118056] [DEBUG] [LOCAL ] DMA: Trimmed 6553 records to 4525 (keeping 200 days of data) [2025-09-24T18:23:30.147511] [DEBUG] [LOCAL ] DMA: Primary data saved (4525 records). [2025-09-24T18:23:30.147664] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-24T18:23:30.147807] [INFO ] [MAIN ] Update Progress: 631/2373 symbols completed. DMA took 15.7s. Estimated remaining: 3h 50m 21s. Rate: 7.6 symbols/min [2025-09-24T18:23:30.334167] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:30.345202] [DEBUG] [LOCAL ] DMB: Loaded 10158 existing records from primary storage. [2025-09-24T18:23:30.345321] [INFO ] [MAIN ] DMB: Loaded 10158 existing records. [2025-09-24T18:23:30.421300] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-24T18:23:30.533703] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:30.534583] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-24T18:23:30.534634] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-24T18:23:30.535097] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-24T18:23:30.535157] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-24T18:23:30.844697] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T18:23:30.930167] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:31.216085] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-24T18:23:32.016075] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-24T18:23:32.118093] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T18:23:32.223702] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T18:23:32.816125] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-24T18:23:33.224972] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T18:23:33.616063] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-24T18:23:33.889526] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T18:23:34.416142] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-24T18:23:34.690380] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T18:23:35.216115] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-24T18:23:35.565170] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T18:23:35.569914] [INFO ] [REMOTE ] DLY: Full fetch complete (28123 records). [2025-09-24T18:23:35.570005] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-24T18:23:35.857027] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T18:23:35.985662] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-24T18:23:35.985759] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-24T18:23:35.986324] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-24T18:23:35.986392] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-24T18:23:35.987199] [DEBUG] [LOCAL ] DLY: Trimmed 28123 records to 19433 (keeping 200 days of data) [2025-09-24T18:23:36.037303] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-24T18:23:36.107038] [DEBUG] [LOCAL ] DLY: Primary data saved (19433 records). [2025-09-24T18:23:36.107202] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-24T18:23:36.107297] [INFO ] [MAIN ] Update Progress: 632/2373 symbols completed. DLY took 23.1s. Estimated remaining: 3h 50m 8s. Rate: 7.6 symbols/min [2025-09-24T18:23:36.275535] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:36.286517] [DEBUG] [LOCAL ] DMO: Loaded 9855 existing records from primary storage. [2025-09-24T18:23:36.286631] [INFO ] [MAIN ] DMO: Loaded 9855 existing records. [2025-09-24T18:23:36.462520] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:36.462827] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-24T18:23:36.462884] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-24T18:23:36.463324] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-24T18:23:36.463382] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-24T18:23:36.822411] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-24T18:23:36.855475] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T18:23:36.886454] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:37.616174] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-24T18:23:38.198843] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T18:23:38.416099] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-24T18:23:38.667023] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T18:23:39.216677] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-24T18:23:39.218580] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T18:23:40.016101] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-24T18:23:40.720556] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T18:23:40.816105] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-24T18:23:40.904261] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T18:23:40.913791] [INFO ] [REMOTE ] DLR: Full fetch complete (74227 records). [2025-09-24T18:23:40.913944] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-24T18:23:41.311319] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-24T18:23:41.311428] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-24T18:23:41.312355] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-24T18:23:41.312422] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-24T18:23:41.314009] [DEBUG] [LOCAL ] DLR: Trimmed 74227 records to 51149 (keeping 200 days of data) [2025-09-24T18:23:41.419165] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T18:23:41.629256] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-24T18:23:41.651751] [DEBUG] [LOCAL ] DLR: Primary data saved (51149 records). [2025-09-24T18:23:41.651857] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-24T18:23:41.651941] [INFO ] [MAIN ] Update Progress: 633/2373 symbols completed. DLR took 36.5s. Estimated remaining: 3h 49m 53s. Rate: 7.6 symbols/min [2025-09-24T18:23:41.826507] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:41.873400] [DEBUG] [LOCAL ] DNA: Loaded 48395 existing records from primary storage. [2025-09-24T18:23:41.873540] [INFO ] [MAIN ] DNA: Loaded 48395 existing records. [2025-09-24T18:23:42.054006] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:42.054273] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-24T18:23:42.054322] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-24T18:23:42.055411] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-24T18:23:42.055473] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-24T18:23:42.421304] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-24T18:23:42.427275] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:42.436591] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T18:23:43.216081] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-24T18:23:43.238445] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T18:23:44.016106] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-24T18:23:44.523019] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T18:23:44.816141] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-24T18:23:45.586493] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T18:23:45.616082] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-24T18:23:45.896104] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T18:23:46.416076] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-24T18:23:47.142517] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:23:47.216058] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-24T18:23:47.225260] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T18:23:48.001441] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T18:23:48.016037] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-24T18:23:48.774288] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T18:23:48.816109] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-24T18:23:49.616125] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-24T18:23:49.681199] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T18:23:50.416150] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-24T18:23:50.445133] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T18:23:51.216085] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-24T18:23:51.419535] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T18:23:51.422368] [INFO ] [REMOTE ] DMB: Full fetch complete (15052 records). [2025-09-24T18:23:51.422447] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-24T18:23:51.816800] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-24T18:23:51.816906] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-24T18:23:51.817555] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-24T18:23:51.817597] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-24T18:23:51.818241] [DEBUG] [LOCAL ] DMB: Trimmed 15052 records to 10136 (keeping 200 days of data) [2025-09-24T18:23:51.879289] [DEBUG] [LOCAL ] DMB: Primary data saved (10136 records). [2025-09-24T18:23:51.879436] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-24T18:23:51.879525] [INFO ] [MAIN ] Update Progress: 634/2373 symbols completed. DMB took 21.7s. Estimated remaining: 3h 49m 52s. Rate: 7.6 symbols/min [2025-09-24T18:23:52.023790] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-24T18:23:52.049580] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:52.095476] [DEBUG] [LOCAL ] DNOW: Loaded 43520 existing records from primary storage. [2025-09-24T18:23:52.095625] [INFO ] [MAIN ] DNOW: Loaded 43520 existing records. [2025-09-24T18:23:52.278186] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:52.278460] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-24T18:23:52.278509] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-24T18:23:52.279732] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-24T18:23:52.279795] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-24T18:23:52.652221] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:52.816044] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-24T18:23:52.903853] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T18:23:52.929559] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T18:23:53.616111] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-24T18:23:54.282551] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T18:23:54.416079] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-24T18:23:54.877280] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T18:23:54.882114] [INFO ] [REMOTE ] DLX: Full fetch complete (41279 records). [2025-09-24T18:23:54.882206] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-24T18:23:55.221264] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-24T18:23:55.292545] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-24T18:23:55.292639] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-24T18:23:55.293519] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-24T18:23:55.293624] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-24T18:23:55.295253] [DEBUG] [LOCAL ] DLX: Trimmed 41279 records to 28990 (keeping 200 days of data) [2025-09-24T18:23:55.484530] [DEBUG] [LOCAL ] DLX: Primary data saved (28990 records). [2025-09-24T18:23:55.484725] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-24T18:23:55.484837] [INFO ] [MAIN ] Update Progress: 635/2373 symbols completed. DLX took 43.2s. Estimated remaining: 3h 49m 32s. Rate: 7.6 symbols/min [2025-09-24T18:23:55.674198] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:55.708638] [DEBUG] [LOCAL ] DNP: Loaded 33340 existing records from primary storage. [2025-09-24T18:23:55.708874] [INFO ] [MAIN ] DNP: Loaded 33340 existing records. [2025-09-24T18:23:55.909843] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:23:55.932455] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-24T18:23:55.932554] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-24T18:23:55.934763] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-24T18:23:55.934682] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:23:55.934955] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-24T18:23:56.023574] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-24T18:23:56.330906] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:23:56.816067] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-24T18:23:56.860785] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T18:23:57.061059] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T18:23:57.616103] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-24T18:23:58.313886] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:23:58.391951] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T18:23:58.416032] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-24T18:23:59.080833] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T18:23:59.083110] [INFO ] [REMOTE ] DMO: Full fetch complete (14551 records). [2025-09-24T18:23:59.083215] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-24T18:23:59.230154] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-24T18:23:59.465551] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-24T18:23:59.465638] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-24T18:23:59.466059] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-24T18:23:59.466102] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-24T18:23:59.466751] [DEBUG] [LOCAL ] DMO: Trimmed 14551 records to 9841 (keeping 200 days of data) [2025-09-24T18:23:59.530330] [DEBUG] [LOCAL ] DMO: Primary data saved (9841 records). [2025-09-24T18:23:59.530488] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-24T18:23:59.530579] [INFO ] [MAIN ] Update Progress: 636/2373 symbols completed. DMO took 23.4s. Estimated remaining: 3h 49m 14s. Rate: 7.6 symbols/min [2025-09-24T18:23:59.700948] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:23:59.701145] [DEBUG] [LOCAL ] DOC: No existing data file found in primary storage. [2025-09-24T18:23:59.701182] [WARN ] [MAIN ] DOC: No existing data found, performing full refresh instead. [2025-09-24T18:23:59.701328] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-24T18:23:59.701370] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-24T18:23:59.701412] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-24T18:23:59.701446] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-24T18:24:00.021255] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-24T18:24:00.057974] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:00.816127] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-24T18:24:01.213054] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T18:24:01.541749] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:24:01.616073] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-24T18:24:02.416073] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-24T18:24:02.614226] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T18:24:03.216155] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-24T18:24:03.762436] [DEBUG] [REMOTE ] DNA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-24T18:24:03.762930] [WARN ] [REMOTE ] DNA: No data returned for month 2025-04 [2025-09-24T18:24:04.016147] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-24T18:24:04.666918] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (3.05 seconds). [2025-09-24T18:24:04.816084] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-24T18:24:05.576583] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-24T18:24:05.616037] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-24T18:24:06.086781] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T18:24:06.171708] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T18:24:06.416081] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-24T18:24:07.216059] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-24T18:24:07.331565] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T18:24:07.872563] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T18:24:08.016087] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-24T18:24:08.816101] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-24T18:24:08.931248] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T18:24:09.105921] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T18:24:09.616083] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-24T18:24:10.218520] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T18:24:10.416127] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-24T18:24:10.968912] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T18:24:11.216141] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-24T18:24:12.016122] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-24T18:24:12.154770] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:24:12.816110] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-24T18:24:12.903274] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:24:13.356691] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T18:24:13.616119] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-24T18:24:14.419131] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-24T18:24:14.432312] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:24:15.136514] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T18:24:15.216144] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-24T18:24:15.430943] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T18:24:16.016107] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-24T18:24:16.816143] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-24T18:24:17.182392] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T18:24:17.321850] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:24:17.327930] [INFO ] [REMOTE ] DNP: Full fetch complete (49432 records). [2025-09-24T18:24:17.328056] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-24T18:24:17.623298] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-24T18:24:17.753208] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-24T18:24:17.753305] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-24T18:24:17.754209] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-24T18:24:17.754280] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-24T18:24:17.755529] [DEBUG] [LOCAL ] DNP: Trimmed 49432 records to 33331 (keeping 200 days of data) [2025-09-24T18:24:17.968825] [DEBUG] [LOCAL ] DNP: Primary data saved (33331 records). [2025-09-24T18:24:17.969007] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-24T18:24:17.969104] [INFO ] [MAIN ] Update Progress: 637/2373 symbols completed. DNP took 22.5s. Estimated remaining: 3h 49m 34s. Rate: 7.6 symbols/min [2025-09-24T18:24:18.416213] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-24T18:24:18.852637] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T18:24:19.164818] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:24:19.216043] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-24T18:24:20.016128] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-24T18:24:20.337978] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T18:24:20.431176] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T18:24:20.816130] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-24T18:24:21.616155] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-24T18:24:21.836317] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T18:24:22.416095] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-24T18:24:23.020382] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-24T18:24:23.216105] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-24T18:24:23.728535] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-24T18:24:24.016142] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-24T18:24:25.099241] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-24T18:24:25.108229] [INFO ] [REMOTE ] DNA: Full fetch complete (63053 records). [2025-09-24T18:24:25.108409] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-24T18:24:25.109381] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:24:25.109509] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:24:25.109594] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:24:25.109712] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-24T18:24:25.109833] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-24T18:24:25.109908] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-09-24T18:24:25.110510] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-09-24T18:24:25.110628] [INFO ] [MAIN ] Update Progress: 638/2373 symbols completed. DNA took 43.5s. Estimated remaining: 3h 49m 24s. Rate: 7.6 symbols/min [2025-09-24T18:24:25.365693] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T18:24:25.377733] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-24T18:24:25.421689] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T18:24:25.429472] [INFO ] [REMOTE ] DNOW: Full fetch complete (62385 records). [2025-09-24T18:24:25.429596] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-24T18:24:25.834836] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-24T18:24:25.834936] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-24T18:24:25.835954] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-24T18:24:25.836018] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-24T18:24:25.838764] [DEBUG] [LOCAL ] DNOW: Trimmed 62385 records to 43493 (keeping 200 days of data) [2025-09-24T18:24:26.092530] [DEBUG] [LOCAL ] DNOW: Primary data saved (43493 records). [2025-09-24T18:24:26.092703] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-24T18:24:26.092854] [INFO ] [MAIN ] Update Progress: 639/2373 symbols completed. DNOW took 34.2s. Estimated remaining: 3h 48m 57s. Rate: 7.6 symbols/min [2025-09-24T18:24:27.546112] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-24T18:24:27.558516] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-24T18:24:29.465817] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T18:24:29.474946] [INFO ] [REMOTE ] DOC: Full fetch complete (76985 records). [2025-09-24T18:24:29.475104] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-24T18:24:29.476038] [FATAL] [VALIDATOR ] DOC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:24:29.476177] [FATAL] [MAIN ] DOC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:24:29.476254] [WARN ] [MAIN ] DOC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:24:29.476333] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-24T18:24:29.476447] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-24T18:24:29.476499] [INFO ] [LOCAL ] DOC: Starting deletion of derivative data. [2025-09-24T18:24:29.476542] [DEBUG] [LOCAL ] DOC: No derivative data file found to delete. [2025-09-24T18:24:29.476634] [INFO ] [MAIN ] Update Progress: 640/2373 symbols completed. DOC took 29.9s. Estimated remaining: 3h 48m 37s. Rate: 7.6 symbols/min [2025-09-24T18:24:30.088889] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:30.163024] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:30.218836] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:30.288694] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:30.358715] [DEBUG] [LOCAL ] DOUG: Loaded 34780 existing records from primary storage. [2025-09-24T18:24:30.359172] [INFO ] [MAIN ] DOUG: Loaded 34780 existing records. [2025-09-24T18:24:30.542744] [DEBUG] [LOCAL ] DOCS: Loaded 51264 existing records from primary storage. [2025-09-24T18:24:30.582453] [DEBUG] [LOCAL ] DOCN: Loaded 50488 existing records from primary storage. [2025-09-24T18:24:30.582977] [INFO ] [MAIN ] DOCN: Loaded 50488 existing records. [2025-09-24T18:24:30.582840] [INFO ] [MAIN ] DOCS: Loaded 51264 existing records. [2025-09-24T18:24:30.594700] [DEBUG] [LOCAL ] DOLE: Loaded 37844 existing records from primary storage. [2025-09-24T18:24:30.801319] [INFO ] [MAIN ] DOLE: Loaded 37844 existing records. [2025-09-24T18:24:30.819633] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:24:30.975979] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-24T18:24:30.991764] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-24T18:24:31.077241] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-24T18:24:31.095847] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-24T18:24:31.218872] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:24:31.292270] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-24T18:24:31.298172] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-24T18:24:31.331797] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:24:31.359691] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-24T18:24:31.370452] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-24T18:24:31.417966] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-24T18:24:31.424677] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-24T18:24:31.500230] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-24T18:24:31.510788] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-24T18:24:31.505512] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:24:31.652722] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-24T18:24:31.699200] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-24T18:24:31.858396] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-24T18:24:31.946860] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-24T18:24:32.457696] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:32.449433] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:32.496203] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-24T18:24:32.509448] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-24T18:24:32.835802] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:32.858134] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-24T18:24:32.881339] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:32.883971] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-24T18:24:34.142083] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:24:34.151043] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-24T18:24:34.225921] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T18:24:34.240896] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-24T18:24:34.337830] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T18:24:34.345060] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-24T18:24:34.635424] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T18:24:34.646104] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-24T18:24:35.536204] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:24:35.544161] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-24T18:24:35.585446] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T18:24:35.593686] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-24T18:24:35.761072] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T18:24:35.770785] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-24T18:24:36.178207] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:24:36.188031] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-24T18:24:36.859234] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:24:36.867807] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T18:24:36.874744] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-24T18:24:36.876071] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-24T18:24:37.388718] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T18:24:37.616151] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-24T18:24:37.676690] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T18:24:37.759137] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-24T18:24:37.868711] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T18:24:38.416124] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-24T18:24:39.216113] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-24T18:24:39.315521] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T18:24:39.771731] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T18:24:40.016092] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-24T18:24:40.816093] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-24T18:24:41.192107] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T18:24:41.354039] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T18:24:41.616100] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-24T18:24:42.270353] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T18:24:42.416100] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-24T18:24:43.216097] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-24T18:24:43.453379] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T18:24:43.900534] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:24:44.016114] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-24T18:24:44.816143] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-24T18:24:45.145779] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T18:24:45.591843] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T18:24:45.616043] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-24T18:24:46.416070] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-24T18:24:46.655055] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T18:24:46.945043] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T18:24:47.216212] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-24T18:24:47.768522] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T18:24:48.016113] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-24T18:24:48.785340] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T18:24:48.816062] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-24T18:24:49.220276] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T18:24:49.616095] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-24T18:24:50.205387] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T18:24:50.416124] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-24T18:24:51.216069] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-24T18:24:51.294548] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T18:24:52.016052] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-24T18:24:52.305351] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T18:24:52.371313] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:24:52.816094] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-24T18:24:53.403607] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T18:24:53.616108] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-24T18:24:54.005032] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T18:24:54.416136] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-24T18:24:55.216066] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-24T18:24:55.379999] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T18:24:56.016110] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-24T18:24:56.480886] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T18:24:56.588242] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T18:24:56.596499] [INFO ] [REMOTE ] DOLE: Full fetch complete (53205 records). [2025-09-24T18:24:56.596764] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-24T18:24:56.870111] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-24T18:24:57.089663] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-24T18:24:57.089768] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-24T18:24:57.090531] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-24T18:24:57.090595] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-24T18:24:57.095150] [DEBUG] [LOCAL ] DOLE: Trimmed 53205 records to 37919 (keeping 200 days of data) [2025-09-24T18:24:57.349945] [DEBUG] [LOCAL ] DOLE: Primary data saved (37919 records). [2025-09-24T18:24:57.350099] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-24T18:24:57.350209] [INFO ] [MAIN ] Update Progress: 641/2373 symbols completed. DOLE took 27.9s. Estimated remaining: 3h 49m 23s. Rate: 7.6 symbols/min [2025-09-24T18:24:57.486961] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T18:24:57.540849] [INFO ] [REMOTE ] DOCS: Full fetch complete (74230 records). [2025-09-24T18:24:57.549446] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-24T18:24:57.610058] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:57.622068] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-24T18:24:58.015543] [DEBUG] [LOCAL ] DOV: Loaded 45742 existing records from primary storage. [2025-09-24T18:24:58.036124] [INFO ] [MAIN ] DOV: Loaded 45742 existing records. [2025-09-24T18:24:58.086701] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-24T18:24:58.109755] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-24T18:24:58.128865] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-24T18:24:58.150385] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-24T18:24:58.235043] [DEBUG] [LOCAL ] DOCS: Trimmed 74230 records to 51247 (keeping 200 days of data) [2025-09-24T18:24:58.239170] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:24:58.239991] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-24T18:24:58.240096] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-24T18:24:58.242881] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-24T18:24:58.242975] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-24T18:24:58.828804] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:24:58.830039] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-24T18:24:58.893853] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-24T18:24:58.920149] [INFO ] [REMOTE ] DOCN: Full fetch complete (71244 records). [2025-09-24T18:24:58.925922] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-24T18:24:59.110384] [DEBUG] [LOCAL ] DOCS: Primary data saved (51247 records). [2025-09-24T18:24:59.116257] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-24T18:24:59.121811] [INFO ] [MAIN ] Update Progress: 642/2373 symbols completed. DOCS took 29.6s. Estimated remaining: 3h 48m 59s. Rate: 7.6 symbols/min [2025-09-24T18:24:59.398234] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T18:24:59.532767] [INFO ] [REMOTE ] DOUG: Full fetch complete (51538 records). [2025-09-24T18:24:59.546990] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:24:59.560219] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-24T18:24:59.778935] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-24T18:24:59.794837] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-24T18:24:59.806461] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-24T18:24:59.880486] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-24T18:25:00.000408] [DEBUG] [LOCAL ] DOCN: Trimmed 71244 records to 50513 (keeping 200 days of data) [2025-09-24T18:25:00.187939] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-24T18:25:00.202085] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-09-24T18:25:00.205219] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-24T18:25:00.215122] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-24T18:25:00.252569] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-24T18:25:00.265318] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-24T18:25:00.334937] [DEBUG] [LOCAL ] DOUG: Trimmed 51538 records to 34747 (keeping 200 days of data) [2025-09-24T18:25:00.466318] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:00.504780] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-24T18:25:00.515314] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-24T18:25:00.550084] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-24T18:25:00.550880] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-24T18:25:00.620299] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T18:25:00.685449] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-24T18:25:00.887684] [DEBUG] [LOCAL ] DOUG: Primary data saved (34747 records). [2025-09-24T18:25:00.958937] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-24T18:25:00.966099] [INFO ] [MAIN ] Update Progress: 643/2373 symbols completed. DOUG took 31.5s. Estimated remaining: 3h 48m 34s. Rate: 7.6 symbols/min [2025-09-24T18:25:01.172897] [DEBUG] [LOCAL ] DOCN: Primary data saved (50513 records). [2025-09-24T18:25:01.190205] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-24T18:25:01.214179] [INFO ] [MAIN ] Update Progress: 644/2373 symbols completed. DOCN took 31.7s. Estimated remaining: 3h 48m 6s. Rate: 7.6 symbols/min [2025-09-24T18:25:01.576202] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:01.615941] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:01.626798] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-24T18:25:01.714233] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:01.715936] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-09-24T18:25:01.716022] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-09-24T18:25:01.716378] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-24T18:25:01.716453] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-24T18:25:01.716516] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-24T18:25:01.716566] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-24T18:25:01.830297] [DEBUG] [LOCAL ] DPG: Loaded 13368 existing records from primary storage. [2025-09-24T18:25:01.851372] [INFO ] [MAIN ] DPG: Loaded 13368 existing records. [2025-09-24T18:25:02.220859] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:02.256772] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-24T18:25:02.281003] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-24T18:25:02.286952] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-24T18:25:02.302634] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-24T18:25:02.417330] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:02.440362] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-24T18:25:02.852056] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-24T18:25:02.860134] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:02.873995] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-24T18:25:02.876241] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-24T18:25:03.736018] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T18:25:03.739729] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-24T18:25:03.818016] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-24T18:25:04.016150] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-24T18:25:04.098264] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T18:25:04.308383] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:25:04.681531] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T18:25:04.816128] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-24T18:25:05.590553] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:25:05.616039] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-24T18:25:06.187148] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T18:25:06.416087] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-24T18:25:07.197025] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T18:25:07.216077] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-24T18:25:07.591353] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T18:25:07.781483] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T18:25:08.016098] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-24T18:25:08.816092] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-24T18:25:09.508017] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:25:09.616111] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-24T18:25:10.416094] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-24T18:25:10.876637] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T18:25:11.216160] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-24T18:25:11.492970] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T18:25:12.016061] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-24T18:25:12.242845] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T18:25:12.462969] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T18:25:12.816079] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-24T18:25:13.595894] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T18:25:13.616078] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-24T18:25:14.416063] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-24T18:25:14.471237] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T18:25:14.803571] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T18:25:15.216082] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-24T18:25:15.807007] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T18:25:15.994409] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T18:25:16.016036] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-24T18:25:16.816117] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-24T18:25:16.960540] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T18:25:17.616088] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-24T18:25:18.416117] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-24T18:25:18.587969] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T18:25:19.077517] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-24T18:25:19.216087] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-24T18:25:20.016058] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-24T18:25:20.073275] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T18:25:20.816098] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-24T18:25:20.960077] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:25:21.605168] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T18:25:21.616022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-24T18:25:21.882624] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T18:25:21.885635] [INFO ] [REMOTE ] DPG: Full fetch complete (19006 records). [2025-09-24T18:25:21.885755] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-24T18:25:22.259481] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-24T18:25:22.259572] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-24T18:25:22.260039] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-24T18:25:22.260101] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-24T18:25:22.261137] [DEBUG] [LOCAL ] DPG: Trimmed 19006 records to 13420 (keeping 200 days of data) [2025-09-24T18:25:22.348372] [DEBUG] [LOCAL ] DPG: Primary data saved (13420 records). [2025-09-24T18:25:22.348522] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-24T18:25:22.348615] [INFO ] [MAIN ] Update Progress: 645/2373 symbols completed. DPG took 21.4s. Estimated remaining: 3h 48m 33s. Rate: 7.6 symbols/min [2025-09-24T18:25:22.422869] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-24T18:25:22.522601] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:22.564983] [DEBUG] [LOCAL ] DRD: Loaded 36687 existing records from primary storage. [2025-09-24T18:25:22.565146] [INFO ] [MAIN ] DRD: Loaded 36687 existing records. [2025-09-24T18:25:22.779873] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:22.780441] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-24T18:25:22.780686] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-24T18:25:22.782373] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-24T18:25:22.782435] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-24T18:25:23.036012] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T18:25:23.202239] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:23.216035] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-24T18:25:23.874098] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T18:25:24.016106] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-24T18:25:24.300202] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T18:25:24.816076] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-24T18:25:25.616096] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-24T18:25:25.840160] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T18:25:26.416126] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-24T18:25:26.462505] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:25:27.216111] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-24T18:25:27.800379] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T18:25:27.932256] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T18:25:28.016093] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-24T18:25:28.526845] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T18:25:28.816079] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-24T18:25:29.616168] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-24T18:25:29.885013] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:25:29.893708] [INFO ] [REMOTE ] DQ: Full fetch complete (62949 records). [2025-09-24T18:25:29.893852] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-24T18:25:30.283763] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-24T18:25:30.283850] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-24T18:25:30.284715] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-24T18:25:30.284779] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-24T18:25:30.286079] [DEBUG] [LOCAL ] DQ: Trimmed 62949 records to 43139 (keeping 200 days of data) [2025-09-24T18:25:30.457354] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-24T18:25:30.570721] [DEBUG] [LOCAL ] DQ: Primary data saved (43139 records). [2025-09-24T18:25:30.571730] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-24T18:25:30.572868] [INFO ] [MAIN ] Update Progress: 646/2373 symbols completed. DQ took 29.3s. Estimated remaining: 3h 48m 26s. Rate: 7.6 symbols/min [2025-09-24T18:25:30.572715] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T18:25:30.651556] [INFO ] [REMOTE ] DOV: Full fetch complete (64915 records). [2025-09-24T18:25:30.669165] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-24T18:25:30.783597] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T18:25:30.899045] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:30.909541] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-09-24T18:25:30.914752] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-09-24T18:25:30.920152] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-24T18:25:30.925407] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-24T18:25:30.942421] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-09-24T18:25:30.942513] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-24T18:25:31.220397] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-24T18:25:31.568972] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-24T18:25:31.593754] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-24T18:25:31.611435] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-24T18:25:31.628966] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-24T18:25:31.632736] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:31.634989] [DEBUG] [LOCAL ] DOV: Trimmed 64915 records to 45676 (keeping 200 days of data) [2025-09-24T18:25:31.929187] [DEBUG] [LOCAL ] DOV: Primary data saved (45676 records). [2025-09-24T18:25:31.929377] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-24T18:25:31.929473] [INFO ] [MAIN ] Update Progress: 647/2373 symbols completed. DOV took 34.6s. Estimated remaining: 3h 48m 1s. Rate: 7.6 symbols/min [2025-09-24T18:25:32.021806] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-24T18:25:32.105951] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:32.156405] [DEBUG] [LOCAL ] DRI: Loaded 47866 existing records from primary storage. [2025-09-24T18:25:32.156563] [INFO ] [MAIN ] DRI: Loaded 47866 existing records. [2025-09-24T18:25:32.339917] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:32.340151] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-24T18:25:32.340199] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-24T18:25:32.341788] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-24T18:25:32.341850] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-24T18:25:32.707034] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T18:25:32.735331] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:32.768607] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-24T18:25:32.816040] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-24T18:25:33.616138] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-24T18:25:33.736437] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:25:34.416064] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-24T18:25:34.535153] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T18:25:34.545534] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-24T18:25:34.545759] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-24T18:25:34.957436] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-24T18:25:34.957634] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-24T18:25:34.958896] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-24T18:25:34.958966] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-24T18:25:34.960781] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-24T18:25:35.099886] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T18:25:35.216712] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-24T18:25:35.343960] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-24T18:25:35.344141] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-24T18:25:35.344250] [INFO ] [MAIN ] Update Progress: 648/2373 symbols completed. DOW took 36.2s. Estimated remaining: 3h 47m 41s. Rate: 7.6 symbols/min [2025-09-24T18:25:35.519330] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:35.530982] [DEBUG] [LOCAL ] DRLL: Loaded 9710 existing records from primary storage. [2025-09-24T18:25:35.531109] [INFO ] [MAIN ] DRLL: Loaded 9710 existing records. [2025-09-24T18:25:35.726934] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:35.727226] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-24T18:25:35.727280] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-24T18:25:35.727726] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-24T18:25:35.727786] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-24T18:25:36.017417] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-24T18:25:36.100829] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:36.129373] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:25:36.816053] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-24T18:25:36.897942] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T18:25:37.616043] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-24T18:25:37.714842] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:25:37.836589] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T18:25:38.416095] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-24T18:25:39.164062] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T18:25:39.216095] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-24T18:25:39.834806] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T18:25:40.016183] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-24T18:25:40.777220] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T18:25:40.816035] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-24T18:25:41.240821] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T18:25:41.616095] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-24T18:25:42.409939] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T18:25:42.416022] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-24T18:25:42.824176] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T18:25:43.205136] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T18:25:43.216030] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-24T18:25:44.016128] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-24T18:25:44.109436] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T18:25:44.816130] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-24T18:25:45.616112] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-24T18:25:45.851803] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T18:25:45.852962] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T18:25:46.416092] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-24T18:25:47.216055] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-24T18:25:47.246786] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T18:25:47.574990] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T18:25:48.016104] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-24T18:25:48.671526] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T18:25:48.816072] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-24T18:25:49.616089] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-24T18:25:49.679085] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T18:25:50.377000] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T18:25:50.416040] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-24T18:25:50.448768] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:25:51.216131] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-24T18:25:51.982729] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T18:25:52.016095] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-24T18:25:52.812845] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T18:25:52.822571] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-24T18:25:53.581284] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T18:25:53.616071] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-24T18:25:54.132223] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T18:25:54.157110] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T18:25:54.416122] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-24T18:25:55.216147] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-24T18:25:56.016178] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-24T18:25:56.485717] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-24T18:25:56.629321] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:25:56.633809] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T18:25:56.816079] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-24T18:25:57.616096] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-24T18:25:57.826255] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T18:25:57.828410] [INFO ] [REMOTE ] DRLL: Full fetch complete (15925 records). [2025-09-24T18:25:57.828498] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-24T18:25:58.197019] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-24T18:25:58.197108] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-24T18:25:58.197543] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-24T18:25:58.197583] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-24T18:25:58.198168] [DEBUG] [LOCAL ] DRLL: Trimmed 15925 records to 9645 (keeping 200 days of data) [2025-09-24T18:25:58.259578] [DEBUG] [LOCAL ] DRLL: Primary data saved (9645 records). [2025-09-24T18:25:58.259759] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-24T18:25:58.259859] [INFO ] [MAIN ] Update Progress: 649/2373 symbols completed. DRLL took 22.9s. Estimated remaining: 3h 48m 13s. Rate: 7.6 symbols/min [2025-09-24T18:25:58.423023] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-24T18:25:58.459161] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:25:58.488307] [DEBUG] [LOCAL ] DSL: Loaded 28179 existing records from primary storage. [2025-09-24T18:25:58.488445] [INFO ] [MAIN ] DSL: Loaded 28179 existing records. [2025-09-24T18:25:58.677985] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:25:58.678274] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-24T18:25:58.678328] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-24T18:25:58.679367] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-24T18:25:58.679432] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-24T18:25:59.074427] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:25:59.109562] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T18:25:59.216044] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-24T18:26:00.016142] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-24T18:26:00.291550] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:26:00.300320] [INFO ] [REMOTE ] DRI: Full fetch complete (69589 records). [2025-09-24T18:26:00.300481] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-24T18:26:00.727248] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-24T18:26:00.728085] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-24T18:26:00.729084] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-24T18:26:00.731092] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-24T18:26:00.730991] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T18:26:00.740428] [DEBUG] [LOCAL ] DRI: Trimmed 69589 records to 47861 (keeping 200 days of data) [2025-09-24T18:26:00.832703] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-24T18:26:01.042520] [DEBUG] [LOCAL ] DRI: Primary data saved (47861 records). [2025-09-24T18:26:01.042691] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-24T18:26:01.042796] [INFO ] [MAIN ] Update Progress: 650/2373 symbols completed. DRI took 29.1s. Estimated remaining: 3h 47m 51s. Rate: 7.6 symbols/min [2025-09-24T18:26:01.212733] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:01.229237] [DEBUG] [LOCAL ] DSM: Loaded 15765 existing records from primary storage. [2025-09-24T18:26:01.229358] [INFO ] [MAIN ] DSM: Loaded 15765 existing records. [2025-09-24T18:26:01.426372] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T18:26:01.430267] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:01.440132] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-24T18:26:01.441053] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-24T18:26:01.441735] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-24T18:26:01.441796] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-24T18:26:01.620261] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-24T18:26:01.832802] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:02.156628] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T18:26:02.416099] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-24T18:26:03.216094] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-24T18:26:03.409744] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T18:26:03.418599] [INFO ] [REMOTE ] DRH: Full fetch complete (71822 records). [2025-09-24T18:26:03.418764] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-24T18:26:03.838846] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-24T18:26:03.838948] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-24T18:26:03.839900] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-24T18:26:03.839975] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-24T18:26:03.841529] [DEBUG] [LOCAL ] DRH: Trimmed 71822 records to 50463 (keeping 200 days of data) [2025-09-24T18:26:04.018833] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-24T18:26:04.122268] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T18:26:04.133245] [INFO ] [REMOTE ] DRD: Full fetch complete (48993 records). [2025-09-24T18:26:04.133924] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-24T18:26:04.493531] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T18:26:04.678389] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-24T18:26:04.678263] [DEBUG] [LOCAL ] DRH: Primary data saved (50463 records). [2025-09-24T18:26:04.678605] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-24T18:26:04.679488] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-24T18:26:04.679565] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-24T18:26:04.679809] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-24T18:26:04.679931] [INFO ] [MAIN ] Update Progress: 651/2373 symbols completed. DRH took 34.1s. Estimated remaining: 3h 47m 32s. Rate: 7.6 symbols/min [2025-09-24T18:26:04.725192] [DEBUG] [LOCAL ] DRD: Trimmed 48993 records to 36744 (keeping 200 days of data) [2025-09-24T18:26:04.822093] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-24T18:26:04.953591] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:04.971809] [DEBUG] [LOCAL ] DSMC: Loaded 1954 existing records from primary storage. [2025-09-24T18:26:04.973770] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T18:26:04.974164] [INFO ] [MAIN ] DSMC: Loaded 1954 existing records. [2025-09-24T18:26:05.182865] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:05.185917] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-24T18:26:05.186274] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-24T18:26:05.187373] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-24T18:26:05.187750] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-24T18:26:05.577752] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:05.619678] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-24T18:26:05.682662] [DEBUG] [LOCAL ] DRD: Primary data saved (36744 records). [2025-09-24T18:26:05.682820] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-24T18:26:05.682913] [INFO ] [MAIN ] Update Progress: 652/2373 symbols completed. DRD took 43.3s. Estimated remaining: 3h 47m 5s. Rate: 7.6 symbols/min [2025-09-24T18:26:05.855060] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:05.877450] [DEBUG] [LOCAL ] DSU: Loaded 21929 existing records from primary storage. [2025-09-24T18:26:05.877584] [INFO ] [MAIN ] DSU: Loaded 21929 existing records. [2025-09-24T18:26:06.078154] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:06.078545] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-24T18:26:06.078671] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-24T18:26:06.086496] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-24T18:26:06.097528] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-24T18:26:06.098354] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:26:06.419399] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-24T18:26:06.516411] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:06.529563] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T18:26:07.039728] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T18:26:07.216119] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-24T18:26:08.016094] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-24T18:26:08.251479] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T18:26:08.816105] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-24T18:26:09.122537] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T18:26:09.616143] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-24T18:26:09.979224] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T18:26:10.028093] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-24T18:26:10.416123] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-24T18:26:11.216061] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-24T18:26:11.372835] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T18:26:12.016148] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-24T18:26:12.245197] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T18:26:12.543564] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T18:26:12.816106] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-24T18:26:13.616091] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-24T18:26:13.686269] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:26:14.113713] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T18:26:14.416092] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-24T18:26:15.216107] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-24T18:26:15.591495] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T18:26:15.776929] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T18:26:16.016119] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-24T18:26:16.816110] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-24T18:26:17.147171] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T18:26:17.616058] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-24T18:26:17.765093] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T18:26:18.026524] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T18:26:18.416093] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-24T18:26:19.216086] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-24T18:26:19.493339] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T18:26:19.867799] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T18:26:20.016066] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-24T18:26:20.350770] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-24T18:26:20.816072] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-24T18:26:21.251690] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T18:26:21.616167] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-24T18:26:22.416146] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-24T18:26:23.141214] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T18:26:23.204932] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T18:26:23.216034] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-24T18:26:24.016051] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-24T18:26:24.170952] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:26:24.816088] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-24T18:26:24.956551] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T18:26:25.616126] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-24T18:26:25.871314] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T18:26:26.403432] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T18:26:26.416027] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-24T18:26:27.216110] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-24T18:26:27.565952] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T18:26:27.656070] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T18:26:28.016090] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-24T18:26:28.816075] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-24T18:26:28.918775] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T18:26:28.921794] [INFO ] [REMOTE ] DSM: Full fetch complete (24760 records). [2025-09-24T18:26:28.921877] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-24T18:26:29.284559] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-24T18:26:29.284663] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-24T18:26:29.285245] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-24T18:26:29.285286] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-24T18:26:29.285969] [DEBUG] [LOCAL ] DSM: Trimmed 24760 records to 15676 (keeping 200 days of data) [2025-09-24T18:26:29.377984] [DEBUG] [LOCAL ] DSM: Primary data saved (15676 records). [2025-09-24T18:26:29.378136] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-24T18:26:29.378225] [INFO ] [MAIN ] Update Progress: 653/2373 symbols completed. DSM took 28.3s. Estimated remaining: 3h 47m 39s. Rate: 7.6 symbols/min [2025-09-24T18:26:29.548614] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:29.573243] [DEBUG] [LOCAL ] DSX: Loaded 24442 existing records from primary storage. [2025-09-24T18:26:29.573376] [INFO ] [MAIN ] DSX: Loaded 24442 existing records. [2025-09-24T18:26:29.626675] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-24T18:26:29.755517] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:29.755814] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-24T18:26:29.755868] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-24T18:26:29.756773] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-24T18:26:29.756839] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-24T18:26:30.114746] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T18:26:30.152870] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:30.306191] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T18:26:30.307465] [INFO ] [REMOTE ] DSMC: Full fetch complete (2879 records). [2025-09-24T18:26:30.307543] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-24T18:26:30.417492] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-24T18:26:30.693909] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-24T18:26:30.693994] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-24T18:26:30.694116] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-24T18:26:30.694156] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-24T18:26:30.694504] [DEBUG] [LOCAL ] DSMC: Trimmed 2879 records to 1947 (keeping 200 days of data) [2025-09-24T18:26:30.706800] [DEBUG] [LOCAL ] DSMC: Primary data saved (1947 records). [2025-09-24T18:26:30.706874] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-24T18:26:30.706956] [INFO ] [MAIN ] Update Progress: 654/2373 symbols completed. DSMC took 26.0s. Estimated remaining: 3h 47m 14s. Rate: 7.6 symbols/min [2025-09-24T18:26:30.885233] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:30.945859] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-09-24T18:26:30.946057] [INFO ] [MAIN ] DT: Loaded 52944 existing records. [2025-09-24T18:26:31.143919] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:31.144185] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-24T18:26:31.144236] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-24T18:26:31.145685] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-24T18:26:31.145751] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-24T18:26:31.221320] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-24T18:26:31.534128] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:31.861947] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:26:32.016038] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-24T18:26:32.050472] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T18:26:32.816142] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-24T18:26:33.157822] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T18:26:33.616096] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-24T18:26:33.922006] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T18:26:34.416114] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-24T18:26:34.976763] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T18:26:34.982264] [INFO ] [REMOTE ] DSL: Full fetch complete (41352 records). [2025-09-24T18:26:34.982404] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-24T18:26:35.218492] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-24T18:26:35.413864] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-24T18:26:35.413963] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-24T18:26:35.414860] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-24T18:26:35.414936] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-24T18:26:35.416191] [DEBUG] [LOCAL ] DSL: Trimmed 41352 records to 28220 (keeping 200 days of data) [2025-09-24T18:26:35.523436] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T18:26:35.619525] [DEBUG] [LOCAL ] DSL: Primary data saved (28220 records). [2025-09-24T18:26:35.619730] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-24T18:26:35.619842] [INFO ] [MAIN ] Update Progress: 655/2373 symbols completed. DSL took 37.4s. Estimated remaining: 3h 46m 58s. Rate: 7.6 symbols/min [2025-09-24T18:26:35.815569] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:35.823242] [DEBUG] [LOCAL ] DTB: Loaded 4728 existing records from primary storage. [2025-09-24T18:26:35.823348] [INFO ] [MAIN ] DTB: Loaded 4728 existing records. [2025-09-24T18:26:36.016739] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-24T18:26:36.016497] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:36.018172] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-24T18:26:36.018233] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-24T18:26:36.018694] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-24T18:26:36.018757] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-24T18:26:36.429262] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:36.541942] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T18:26:36.816078] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-24T18:26:37.466217] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T18:26:37.616081] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-24T18:26:37.896938] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T18:26:38.173828] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-24T18:26:38.416106] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-24T18:26:39.216126] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-24T18:26:39.601947] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T18:26:40.016088] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-24T18:26:40.568923] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T18:26:40.574044] [INFO ] [REMOTE ] DSU: Full fetch complete (32293 records). [2025-09-24T18:26:40.574130] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-24T18:26:40.823509] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-24T18:26:40.950032] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-24T18:26:40.950115] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-24T18:26:40.950711] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-24T18:26:40.950772] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-24T18:26:40.951517] [DEBUG] [LOCAL ] DSU: Trimmed 32293 records to 22116 (keeping 200 days of data) [2025-09-24T18:26:41.091043] [DEBUG] [LOCAL ] DSU: Primary data saved (22116 records). [2025-09-24T18:26:41.091253] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-24T18:26:41.091501] [INFO ] [MAIN ] Update Progress: 656/2373 symbols completed. DSU took 35.4s. Estimated remaining: 3h 46m 44s. Rate: 7.6 symbols/min [2025-09-24T18:26:41.265369] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:41.317060] [DEBUG] [LOCAL ] DTE: Loaded 47998 existing records from primary storage. [2025-09-24T18:26:41.317213] [INFO ] [MAIN ] DTE: Loaded 47998 existing records. [2025-09-24T18:26:41.532505] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:26:41.533250] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-24T18:26:41.534981] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:26:41.533829] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-24T18:26:41.539449] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-24T18:26:41.546058] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-24T18:26:41.622915] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-24T18:26:41.921255] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:42.092607] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T18:26:42.416121] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-24T18:26:43.216063] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-24T18:26:43.355210] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T18:26:43.500038] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T18:26:44.016090] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-24T18:26:44.795705] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T18:26:44.816051] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-24T18:26:45.231739] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T18:26:45.616104] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-24T18:26:46.416072] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-24T18:26:46.483085] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T18:26:46.963513] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:26:47.216245] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-24T18:26:47.521702] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T18:26:48.016151] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-24T18:26:48.501034] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T18:26:48.816123] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-24T18:26:48.966219] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:26:49.616055] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-24T18:26:49.862023] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T18:26:49.910489] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-24T18:26:50.416154] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-24T18:26:51.216114] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-24T18:26:52.017409] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-24T18:26:52.023380] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T18:26:52.816102] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-24T18:26:52.936988] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:26:53.452133] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T18:26:53.457054] [INFO ] [REMOTE ] DSX: Full fetch complete (37115 records). [2025-09-24T18:26:53.457247] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-24T18:26:53.626387] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-24T18:26:53.857540] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-24T18:26:53.857711] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-24T18:26:53.858609] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-24T18:26:53.858720] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-24T18:26:53.859756] [DEBUG] [LOCAL ] DSX: Trimmed 37115 records to 24351 (keeping 200 days of data) [2025-09-24T18:26:54.015949] [DEBUG] [LOCAL ] DSX: Primary data saved (24351 records). [2025-09-24T18:26:54.016106] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-24T18:26:54.016280] [INFO ] [MAIN ] Update Progress: 657/2373 symbols completed. DSX took 24.6s. Estimated remaining: 3h 46m 49s. Rate: 7.6 symbols/min [2025-09-24T18:26:54.193599] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:26:54.193853] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-24T18:26:54.193911] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-24T18:26:54.194168] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-24T18:26:54.194235] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-24T18:26:54.194305] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-24T18:26:54.194342] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-24T18:26:54.431328] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-24T18:26:54.621423] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:26:54.624360] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T18:26:55.095297] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T18:26:55.216058] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-24T18:26:55.412621] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T18:26:56.003530] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T18:26:56.016031] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-24T18:26:56.657769] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T18:26:56.816072] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-24T18:26:57.542617] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T18:26:57.616079] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-24T18:26:58.356465] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:26:58.416074] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-24T18:26:59.020686] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T18:26:59.216080] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-24T18:27:00.016099] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-24T18:27:00.797580] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:27:00.816057] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-24T18:27:01.616097] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-24T18:27:02.065117] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T18:27:02.416089] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-24T18:27:02.978844] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:27:03.221421] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-24T18:27:03.243434] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-24T18:27:03.953289] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T18:27:04.016117] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-24T18:27:04.573002] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T18:27:04.575145] [INFO ] [REMOTE ] DTB: Full fetch complete (6786 records). [2025-09-24T18:27:04.575223] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-24T18:27:04.575860] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:27:04.575972] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:27:04.576076] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:27:04.576157] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-24T18:27:04.576378] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-24T18:27:04.576504] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-09-24T18:27:04.577217] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-09-24T18:27:04.577401] [INFO ] [MAIN ] Update Progress: 658/2373 symbols completed. DTB took 29.0s. Estimated remaining: 3h 46m 48s. Rate: 7.6 symbols/min [2025-09-24T18:27:04.764390] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:04.786852] [DEBUG] [LOCAL ] DTG: Loaded 5902 existing records from primary storage. [2025-09-24T18:27:04.787089] [INFO ] [MAIN ] DTG: Loaded 5902 existing records. [2025-09-24T18:27:04.821399] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-24T18:27:04.997032] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:04.997403] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-24T18:27:04.997457] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-24T18:27:04.997850] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-24T18:27:04.997913] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-24T18:27:05.405186] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:05.616083] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-24T18:27:06.196495] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T18:27:06.333780] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T18:27:06.421189] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-24T18:27:06.433104] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:27:07.216108] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-24T18:27:07.714047] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T18:27:08.016072] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-24T18:27:08.350360] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T18:27:08.360395] [INFO ] [REMOTE ] DT: Full fetch complete (76644 records). [2025-09-24T18:27:08.360696] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-24T18:27:08.558826] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T18:27:08.803904] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-24T18:27:08.804064] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-24T18:27:08.805530] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-24T18:27:08.805687] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-24T18:27:08.810720] [DEBUG] [LOCAL ] DT: Trimmed 76644 records to 52944 (keeping 200 days of data) [2025-09-24T18:27:08.816102] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-24T18:27:09.165296] [DEBUG] [LOCAL ] DT: Primary data saved (52944 records). [2025-09-24T18:27:09.165511] [INFO ] [MAIN ] DT: Full history saved. [2025-09-24T18:27:09.165705] [INFO ] [MAIN ] Update Progress: 659/2373 symbols completed. DT took 38.5s. Estimated remaining: 3h 46m 31s. Rate: 7.6 symbols/min [2025-09-24T18:27:09.332491] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T18:27:09.364250] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:09.364500] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-24T18:27:09.364539] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-24T18:27:09.364741] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-24T18:27:09.364795] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-24T18:27:09.364839] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-24T18:27:09.364880] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-24T18:27:09.621305] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-24T18:27:09.788850] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:10.416115] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-24T18:27:10.764544] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T18:27:11.216116] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-24T18:27:11.363567] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:27:11.927408] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T18:27:12.016137] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-24T18:27:12.634202] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T18:27:12.816115] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-24T18:27:13.017640] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:13.018053] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-24T18:27:13.616085] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-24T18:27:14.280067] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T18:27:14.416118] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-24T18:27:14.689342] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:14.689725] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-24T18:27:15.216123] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-24T18:27:16.016122] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-24T18:27:16.678737] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:16.679111] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-24T18:27:16.816096] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-24T18:27:17.454401] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T18:27:17.616083] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-24T18:27:17.646519] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-24T18:27:18.290925] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T18:27:18.416090] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-24T18:27:19.016030] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T18:27:19.216103] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-24T18:27:20.016148] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-24T18:27:20.593564] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T18:27:20.816106] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-24T18:27:21.056757] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:27:21.065820] [INFO ] [REMOTE ] DTE: Full fetch complete (68885 records). [2025-09-24T18:27:21.065969] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-24T18:27:21.066858] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:27:21.066990] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:27:21.067034] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:27:21.067095] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-24T18:27:21.067179] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-24T18:27:21.067229] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-09-24T18:27:21.067866] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-09-24T18:27:21.067970] [INFO ] [MAIN ] Update Progress: 660/2373 symbols completed. DTE took 40.0s. Estimated remaining: 3h 46m 33s. Rate: 7.6 symbols/min [2025-09-24T18:27:21.258721] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:21.259584] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T18:27:21.318603] [DEBUG] [LOCAL ] DTM: Loaded 44507 existing records from primary storage. [2025-09-24T18:27:21.318802] [INFO ] [MAIN ] DTM: Loaded 44507 existing records. [2025-09-24T18:27:21.514675] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:21.515211] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-24T18:27:21.515269] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-24T18:27:21.516750] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-24T18:27:21.516810] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-24T18:27:21.619922] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-24T18:27:21.885945] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:22.329931] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T18:27:22.331788] [INFO ] [REMOTE ] DTG: Full fetch complete (8978 records). [2025-09-24T18:27:22.331892] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-24T18:27:22.332351] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:27:22.332441] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:27:22.332497] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:27:22.332689] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-24T18:27:22.332907] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-24T18:27:22.332969] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-24T18:27:22.333451] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-09-24T18:27:22.333584] [INFO ] [MAIN ] Update Progress: 661/2373 symbols completed. DTG took 17.8s. Estimated remaining: 3h 46m 8s. Rate: 7.6 symbols/min [2025-09-24T18:27:22.421243] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-24T18:27:22.513861] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:22.521617] [DEBUG] [LOCAL ] DTW: Loaded 4899 existing records from primary storage. [2025-09-24T18:27:22.521759] [INFO ] [MAIN ] DTW: Loaded 4899 existing records. [2025-09-24T18:27:22.700177] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:22.700468] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-24T18:27:22.700517] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-24T18:27:22.700861] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-24T18:27:22.700923] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-24T18:27:23.086010] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:23.216095] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-24T18:27:23.922172] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T18:27:23.969325] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T18:27:24.016119] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-24T18:27:24.816062] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-24T18:27:24.953171] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-24T18:27:25.100573] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-24T18:27:25.616130] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-24T18:27:26.072358] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T18:27:26.073444] [INFO ] [REMOTE ] DTF: Full fetch complete (2149 records). [2025-09-24T18:27:26.073518] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-24T18:27:26.265349] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-24T18:27:26.265565] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:27:26.265634] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:27:26.265737] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-24T18:27:26.265803] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-24T18:27:26.265843] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-24T18:27:26.265902] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-24T18:27:26.265999] [INFO ] [MAIN ] Update Progress: 662/2373 symbols completed. DTF took 32.2s. Estimated remaining: 3h 45m 50s. Rate: 7.6 symbols/min [2025-09-24T18:27:26.431620] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-24T18:27:26.467411] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:26.541915] [DEBUG] [LOCAL ] DUK: Loaded 53460 existing records from primary storage. [2025-09-24T18:27:26.542063] [INFO ] [MAIN ] DUK: Loaded 53460 existing records. [2025-09-24T18:27:26.695970] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:26.730371] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-24T18:27:26.739023] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:26.739424] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-24T18:27:26.739501] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-24T18:27:26.741537] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-24T18:27:26.741615] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-24T18:27:27.109358] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:27.216091] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-24T18:27:27.406561] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:27.406954] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-24T18:27:28.016140] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-24T18:27:28.816082] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-24T18:27:29.600713] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:27:29.616027] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-24T18:27:30.416103] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-24T18:27:30.709418] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:30.709810] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-24T18:27:31.145006] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-24T18:27:31.182189] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T18:27:31.216041] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-24T18:27:32.016110] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-24T18:27:32.249814] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:32.250174] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-24T18:27:32.816063] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-24T18:27:32.879508] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T18:27:33.616088] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-24T18:27:33.812907] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:33.813269] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-24T18:27:34.416115] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-24T18:27:34.651305] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T18:27:35.216105] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-24T18:27:36.016155] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-24T18:27:36.099675] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T18:27:36.294437] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:27:36.294944] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-24T18:27:36.682668] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T18:27:36.816076] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-24T18:27:37.616101] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-24T18:27:38.416058] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-24T18:27:38.455217] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T18:27:39.160245] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T18:27:39.175173] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T18:27:39.176685] [INFO ] [REMOTE ] DTK: Full fetch complete (492 records). [2025-09-24T18:27:39.176769] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-24T18:27:39.221360] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-24T18:27:39.364518] [WARN ] [VALIDATOR ] DTK: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-24T18:27:39.364739] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:27:39.364823] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:27:39.364912] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-24T18:27:39.364996] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-24T18:27:39.365050] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-24T18:27:39.365196] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-24T18:27:39.365320] [INFO ] [MAIN ] Update Progress: 663/2373 symbols completed. DTK took 30.2s. Estimated remaining: 3h 45m 55s. Rate: 7.6 symbols/min [2025-09-24T18:27:39.537139] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:39.545163] [DEBUG] [LOCAL ] DUKB: Loaded 6375 existing records from primary storage. [2025-09-24T18:27:39.545259] [INFO ] [MAIN ] DUKB: Loaded 6375 existing records. [2025-09-24T18:27:39.731758] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:39.732022] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-24T18:27:39.732076] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-24T18:27:39.732431] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-24T18:27:39.732494] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-24T18:27:40.021346] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-24T18:27:40.085606] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:40.816115] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-24T18:27:41.186512] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T18:27:41.301983] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T18:27:41.421348] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T18:27:41.616132] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-24T18:27:42.416092] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-24T18:27:43.075561] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T18:27:43.216158] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-24T18:27:43.589493] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T18:27:43.949367] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T18:27:44.016116] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-24T18:27:44.351835] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-24T18:27:44.816077] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-24T18:27:45.616083] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-24T18:27:46.395394] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:27:46.416043] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-24T18:27:47.226304] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-24T18:27:47.232370] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T18:27:47.911730] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T18:27:48.016074] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-24T18:27:48.316543] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T18:27:48.611461] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T18:27:48.816074] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-24T18:27:49.446997] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T18:27:49.616111] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-24T18:27:50.416094] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-24T18:27:51.153129] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T18:27:51.216088] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-24T18:27:51.477861] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T18:27:51.854400] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T18:27:52.016088] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-24T18:27:52.668684] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T18:27:52.816083] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-24T18:27:53.486162] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-24T18:27:53.616099] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-24T18:27:54.375754] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T18:27:54.416104] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-24T18:27:55.155932] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T18:27:55.216115] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-24T18:27:55.800002] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T18:27:56.016092] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-24T18:27:56.690283] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T18:27:56.691782] [INFO ] [REMOTE ] DTW: Full fetch complete (7749 records). [2025-09-24T18:27:56.691859] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-24T18:27:56.831495] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-24T18:27:57.058477] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-24T18:27:57.058598] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-24T18:27:57.058920] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-24T18:27:57.058988] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-24T18:27:57.059782] [DEBUG] [LOCAL ] DTW: Trimmed 7749 records to 4875 (keeping 200 days of data) [2025-09-24T18:27:57.094939] [DEBUG] [LOCAL ] DTW: Primary data saved (4875 records). [2025-09-24T18:27:57.095102] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-24T18:27:57.095196] [INFO ] [MAIN ] Update Progress: 664/2373 symbols completed. DTW took 34.8s. Estimated remaining: 3h 46m 13s. Rate: 7.6 symbols/min [2025-09-24T18:27:57.268398] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:57.337597] [DEBUG] [LOCAL ] DV: Loaded 51272 existing records from primary storage. [2025-09-24T18:27:57.337786] [INFO ] [MAIN ] DV: Loaded 51272 existing records. [2025-09-24T18:27:57.518573] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:27:57.518863] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-24T18:27:57.518911] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-24T18:27:57.520300] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-24T18:27:57.520362] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-24T18:27:57.621232] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-24T18:27:57.998342] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:27:58.283301] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T18:27:58.416089] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-24T18:27:58.945398] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T18:27:58.954969] [INFO ] [REMOTE ] DUK: Full fetch complete (77400 records). [2025-09-24T18:27:58.955144] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-24T18:27:59.221245] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-24T18:27:59.360612] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-24T18:27:59.360751] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-24T18:27:59.361814] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-24T18:27:59.361886] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-24T18:27:59.363505] [DEBUG] [LOCAL ] DUK: Trimmed 77400 records to 53459 (keeping 200 days of data) [2025-09-24T18:27:59.716004] [DEBUG] [LOCAL ] DUK: Primary data saved (53459 records). [2025-09-24T18:27:59.716155] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-24T18:27:59.716243] [INFO ] [MAIN ] Update Progress: 665/2373 symbols completed. DUK took 33.5s. Estimated remaining: 3h 45m 51s. Rate: 7.6 symbols/min [2025-09-24T18:27:59.906724] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:27:59.943879] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T18:27:59.960998] [DEBUG] [LOCAL ] DVA: Loaded 41451 existing records from primary storage. [2025-09-24T18:27:59.961158] [INFO ] [MAIN ] DVA: Loaded 41451 existing records. [2025-09-24T18:28:00.024228] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-24T18:28:00.225626] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:00.229775] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-24T18:28:00.229636] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T18:28:00.229945] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-24T18:28:00.246755] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-24T18:28:00.246858] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-24T18:28:00.818449] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-24T18:28:00.823609] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:00.829315] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T18:28:00.832223] [INFO ] [REMOTE ] DUKB: Full fetch complete (9522 records). [2025-09-24T18:28:00.832457] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-24T18:28:01.330238] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-24T18:28:01.330321] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-24T18:28:01.330631] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-24T18:28:01.330729] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-24T18:28:01.331189] [DEBUG] [LOCAL ] DUKB: Trimmed 9522 records to 6341 (keeping 200 days of data) [2025-09-24T18:28:01.370217] [DEBUG] [LOCAL ] DUKB: Primary data saved (6341 records). [2025-09-24T18:28:01.370363] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-24T18:28:01.370455] [INFO ] [MAIN ] Update Progress: 666/2373 symbols completed. DUKB took 22.0s. Estimated remaining: 3h 45m 27s. Rate: 7.6 symbols/min [2025-09-24T18:28:01.571774] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:01.632356] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-24T18:28:01.637909] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-24T18:28:01.638077] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-24T18:28:01.852091] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:01.852365] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-24T18:28:01.852416] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-24T18:28:01.853962] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-24T18:28:01.854025] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-24T18:28:02.227104] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:02.407631] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T18:28:02.416892] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-24T18:28:03.226580] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-24T18:28:03.231422] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T18:28:04.016095] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-24T18:28:04.148201] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T18:28:04.816078] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-24T18:28:04.845299] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T18:28:05.450320] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T18:28:05.616149] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-24T18:28:06.416189] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-24T18:28:06.966674] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-24T18:28:07.216065] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-24T18:28:07.331342] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:28:07.566056] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T18:28:08.016090] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-24T18:28:08.749915] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:28:08.816087] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-24T18:28:09.616060] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-24T18:28:09.710989] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:28:10.416095] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-24T18:28:10.905618] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-24T18:28:11.216071] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-24T18:28:11.288370] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T18:28:12.016067] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-24T18:28:12.040204] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:28:12.048594] [INFO ] [REMOTE ] DTM: Full fetch complete (64817 records). [2025-09-24T18:28:12.048806] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-24T18:28:12.450683] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-24T18:28:12.450774] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-24T18:28:12.451617] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-24T18:28:12.451685] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-24T18:28:12.453106] [DEBUG] [LOCAL ] DTM: Trimmed 64817 records to 44408 (keeping 200 days of data) [2025-09-24T18:28:12.731955] [DEBUG] [LOCAL ] DTM: Primary data saved (44408 records). [2025-09-24T18:28:12.732098] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-24T18:28:12.732189] [INFO ] [MAIN ] Update Progress: 667/2373 symbols completed. DTM took 51.7s. Estimated remaining: 3h 45m 28s. Rate: 7.6 symbols/min [2025-09-24T18:28:12.822712] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-24T18:28:12.918218] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:12.972921] [DEBUG] [LOCAL ] DX: Loaded 52482 existing records from primary storage. [2025-09-24T18:28:12.973098] [INFO ] [MAIN ] DX: Loaded 52482 existing records. [2025-09-24T18:28:13.164713] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:13.165226] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-24T18:28:13.165297] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-24T18:28:13.176477] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-24T18:28:13.191521] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-24T18:28:13.221658] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:28:13.590442] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:13.616065] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-24T18:28:13.764608] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T18:28:14.416128] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-24T18:28:14.744200] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T18:28:15.216156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-24T18:28:15.612192] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T18:28:16.016056] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-24T18:28:16.048637] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:28:16.816085] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-24T18:28:17.015774] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:28:17.539484] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:28:17.616055] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-24T18:28:18.416071] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-24T18:28:18.685912] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T18:28:19.216055] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-24T18:28:19.376466] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T18:28:19.685087] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T18:28:20.016099] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-24T18:28:20.816102] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-24T18:28:21.494138] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-24T18:28:21.616035] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-24T18:28:21.785521] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T18:28:22.419106] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-24T18:28:22.423051] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T18:28:23.216078] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-24T18:28:23.765831] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T18:28:23.886097] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T18:28:24.016059] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-24T18:28:24.816076] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-24T18:28:25.104981] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T18:28:25.615430] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T18:28:25.618747] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-24T18:28:26.416068] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-24T18:28:26.765187] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T18:28:26.775576] [INFO ] [REMOTE ] DV: Full fetch complete (73264 records). [2025-09-24T18:28:26.775804] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-24T18:28:27.216868] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-24T18:28:27.217198] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-24T18:28:27.218198] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-24T18:28:27.219342] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-24T18:28:27.219581] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-24T18:28:27.221289] [DEBUG] [LOCAL ] DV: Trimmed 73264 records to 51274 (keeping 200 days of data) [2025-09-24T18:28:27.543629] [DEBUG] [LOCAL ] DV: Primary data saved (51274 records). [2025-09-24T18:28:27.543942] [INFO ] [MAIN ] DV: Full history saved. [2025-09-24T18:28:27.544064] [INFO ] [MAIN ] Update Progress: 668/2373 symbols completed. DV took 30.4s. Estimated remaining: 3h 45m 38s. Rate: 7.6 symbols/min [2025-09-24T18:28:27.726330] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:27.781454] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-24T18:28:27.792687] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T18:28:27.848892] [DEBUG] [LOCAL ] DXC: Loaded 49661 existing records from primary storage. [2025-09-24T18:28:27.849082] [INFO ] [MAIN ] DXC: Loaded 49661 existing records. [2025-09-24T18:28:28.024720] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-24T18:28:28.030401] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:28.031630] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-24T18:28:28.031716] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-24T18:28:28.032777] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-24T18:28:28.032842] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-24T18:28:28.393790] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:28.816083] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-24T18:28:28.898781] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T18:28:29.616156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-24T18:28:29.899736] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T18:28:30.398252] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T18:28:30.405857] [INFO ] [REMOTE ] DVA: Full fetch complete (59698 records). [2025-09-24T18:28:30.405972] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-24T18:28:30.421311] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-24T18:28:30.808972] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-24T18:28:30.809089] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-24T18:28:30.809976] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-24T18:28:30.810046] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-24T18:28:30.814088] [DEBUG] [LOCAL ] DVA: Trimmed 59698 records to 41348 (keeping 200 days of data) [2025-09-24T18:28:31.085434] [DEBUG] [LOCAL ] DVA: Primary data saved (41348 records). [2025-09-24T18:28:31.085591] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-24T18:28:31.085722] [INFO ] [MAIN ] Update Progress: 669/2373 symbols completed. DVA took 31.4s. Estimated remaining: 3h 45m 18s. Rate: 7.6 symbols/min [2025-09-24T18:28:31.221245] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-24T18:28:31.283200] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:31.324441] [DEBUG] [LOCAL ] DXYZ: Loaded 36762 existing records from primary storage. [2025-09-24T18:28:31.324615] [INFO ] [MAIN ] DXYZ: Loaded 36762 existing records. [2025-09-24T18:28:31.510127] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:31.510679] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-24T18:28:31.510746] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-24T18:28:31.511665] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-24T18:28:31.511729] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-24T18:28:31.888990] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:31.931484] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T18:28:31.988355] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T18:28:32.016056] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-24T18:28:32.478795] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T18:28:32.816111] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-24T18:28:33.616128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-24T18:28:33.950976] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T18:28:34.416106] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-24T18:28:35.181799] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-24T18:28:35.216039] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-24T18:28:35.521529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T18:28:36.016063] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-24T18:28:36.464191] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T18:28:36.474208] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-24T18:28:36.474367] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-24T18:28:36.821195] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-24T18:28:36.912206] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-24T18:28:36.912326] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-24T18:28:36.913475] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-24T18:28:36.913549] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-24T18:28:36.915173] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-24T18:28:37.259408] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-24T18:28:37.259773] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-24T18:28:37.259965] [INFO ] [MAIN ] Update Progress: 670/2373 symbols completed. DVN took 35.9s. Estimated remaining: 3h 45m 6s. Rate: 7.6 symbols/min [2025-09-24T18:28:37.448704] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:37.488924] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T18:28:37.543416] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-24T18:28:37.565377] [DEBUG] [LOCAL ] DY: Loaded 29868 existing records from primary storage. [2025-09-24T18:28:37.565534] [INFO ] [MAIN ] DY: Loaded 29868 existing records. [2025-09-24T18:28:37.624102] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-24T18:28:37.762844] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:37.763192] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-24T18:28:37.763252] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-24T18:28:37.764264] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-24T18:28:37.764327] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-24T18:28:38.150461] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:38.416105] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-24T18:28:39.013179] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T18:28:39.023251] [INFO ] [REMOTE ] DX: Full fetch complete (75321 records). [2025-09-24T18:28:39.023397] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-24T18:28:39.219568] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-24T18:28:39.385257] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T18:28:39.488499] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-24T18:28:39.488592] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-24T18:28:39.489545] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-24T18:28:39.489708] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-24T18:28:39.491172] [DEBUG] [LOCAL ] DX: Trimmed 75321 records to 52476 (keeping 200 days of data) [2025-09-24T18:28:39.615148] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T18:28:39.844259] [DEBUG] [LOCAL ] DX: Primary data saved (52476 records). [2025-09-24T18:28:39.844397] [INFO ] [MAIN ] DX: Full history saved. [2025-09-24T18:28:39.844508] [INFO ] [MAIN ] Update Progress: 671/2373 symbols completed. DX took 27.1s. Estimated remaining: 3h 44m 45s. Rate: 7.6 symbols/min [2025-09-24T18:28:40.020422] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:28:40.018718] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-24T18:28:40.053958] [DEBUG] [LOCAL ] E: Loaded 33441 existing records from primary storage. [2025-09-24T18:28:40.054094] [INFO ] [MAIN ] E: Loaded 33441 existing records. [2025-09-24T18:28:40.256908] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:28:40.257233] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-24T18:28:40.257285] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-24T18:28:40.258166] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-24T18:28:40.258228] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-24T18:28:40.640284] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:28:40.816039] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-24T18:28:41.156552] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T18:28:41.220537] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T18:28:41.616099] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-24T18:28:42.234348] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T18:28:42.416083] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-24T18:28:42.745138] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T18:28:43.216081] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-24T18:28:43.448046] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T18:28:44.016092] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-24T18:28:44.816051] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-24T18:28:45.007902] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:28:45.067158] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T18:28:45.616097] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-24T18:28:46.333334] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T18:28:46.416115] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-24T18:28:47.216065] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-24T18:28:47.583635] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T18:28:48.016093] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-24T18:28:48.156865] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T18:28:48.701157] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:28:48.816066] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-24T18:28:49.572909] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T18:28:49.616039] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-24T18:28:49.951592] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T18:28:50.416087] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-24T18:28:51.197884] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T18:28:51.216048] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-24T18:28:51.830133] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:28:52.016128] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-24T18:28:52.816161] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-24T18:28:53.043143] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T18:28:53.331398] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T18:28:53.616367] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-24T18:28:54.222699] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:28:54.416101] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-24T18:28:55.216047] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-24T18:28:55.725420] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T18:28:55.877153] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T18:28:56.016164] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-24T18:28:56.816060] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-24T18:28:56.910329] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:28:57.069477] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T18:28:57.616132] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-24T18:28:58.363053] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T18:28:58.416083] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-24T18:28:58.990400] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:28:59.216137] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-24T18:29:00.016058] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-24T18:29:00.064919] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:29:00.422371] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T18:29:00.816079] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-24T18:29:01.359055] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T18:29:01.364882] [INFO ] [REMOTE ] E: Full fetch complete (48421 records). [2025-09-24T18:29:01.365038] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-24T18:29:01.621218] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-24T18:29:01.775996] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-24T18:29:01.776097] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-24T18:29:01.776996] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-24T18:29:01.777068] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-24T18:29:01.778365] [DEBUG] [LOCAL ] E: Trimmed 48421 records to 33384 (keeping 200 days of data) [2025-09-24T18:29:02.005423] [DEBUG] [LOCAL ] E: Primary data saved (33384 records). [2025-09-24T18:29:02.006139] [INFO ] [MAIN ] E: Full history saved. [2025-09-24T18:29:02.006488] [INFO ] [MAIN ] Update Progress: 672/2373 symbols completed. E took 22.2s. Estimated remaining: 3h 45m 13s. Rate: 7.6 symbols/min [2025-09-24T18:29:02.222299] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T18:29:02.227156] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:02.279188] [DEBUG] [LOCAL ] EAF: Loaded 43932 existing records from primary storage. [2025-09-24T18:29:02.279382] [INFO ] [MAIN ] EAF: Loaded 43932 existing records. [2025-09-24T18:29:02.421192] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-24T18:29:02.465352] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:02.465721] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-24T18:29:02.465798] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-24T18:29:02.466758] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-24T18:29:02.466838] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-24T18:29:02.849114] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:03.058277] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:29:03.216159] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-24T18:29:03.845620] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T18:29:04.016086] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-24T18:29:04.816122] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-24T18:29:04.944338] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T18:29:04.955592] [INFO ] [REMOTE ] DXC: Full fetch complete (68718 records). [2025-09-24T18:29:04.955885] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-24T18:29:05.400442] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-24T18:29:05.414636] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-24T18:29:05.416684] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-24T18:29:05.417462] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-24T18:29:05.417349] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T18:29:05.424242] [INFO ] [REMOTE ] DY: Full fetch complete (44936 records). [2025-09-24T18:29:05.424548] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-24T18:29:05.459168] [DEBUG] [LOCAL ] DXC: Trimmed 68718 records to 49682 (keeping 200 days of data) [2025-09-24T18:29:05.624937] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-24T18:29:05.921696] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-24T18:29:05.922128] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-24T18:29:05.923604] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-24T18:29:05.923968] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-24T18:29:05.928930] [DEBUG] [LOCAL ] DY: Trimmed 44936 records to 29758 (keeping 200 days of data) [2025-09-24T18:29:06.138471] [DEBUG] [LOCAL ] DY: Primary data saved (29758 records). [2025-09-24T18:29:06.139716] [INFO ] [MAIN ] DY: Full history saved. [2025-09-24T18:29:06.140098] [INFO ] [MAIN ] Update Progress: 673/2373 symbols completed. DY took 28.9s. Estimated remaining: 3h 44m 55s. Rate: 7.6 symbols/min [2025-09-24T18:29:06.458584] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T18:29:06.488801] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:06.502147] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-24T18:29:06.523563] [DEBUG] [LOCAL ] EAI: Loaded 3975 existing records from primary storage. [2025-09-24T18:29:06.555003] [INFO ] [MAIN ] EAI: Loaded 3975 existing records. [2025-09-24T18:29:06.766100] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:06.768868] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-24T18:29:06.768952] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-24T18:29:06.770496] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-24T18:29:06.770848] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-24T18:29:06.925065] [DEBUG] [LOCAL ] DXC: Primary data saved (49682 records). [2025-09-24T18:29:06.940275] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-24T18:29:06.959621] [INFO ] [MAIN ] Update Progress: 674/2373 symbols completed. DXC took 39.4s. Estimated remaining: 3h 44m 29s. Rate: 7.6 symbols/min [2025-09-24T18:29:07.337904] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:07.342916] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:07.343724] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-24T18:29:07.409996] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T18:29:07.408698] [DEBUG] [LOCAL ] EARN: Loaded 30366 existing records from primary storage. [2025-09-24T18:29:07.417802] [INFO ] [MAIN ] EARN: Loaded 30366 existing records. [2025-09-24T18:29:07.663313] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:07.663672] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-24T18:29:07.663737] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-24T18:29:07.664558] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-24T18:29:07.664623] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-24T18:29:08.020440] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-24T18:29:08.066411] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:08.073200] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T18:29:08.156224] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T18:29:08.816087] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-24T18:29:09.616151] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-24T18:29:10.046249] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T18:29:10.052804] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58030 records). [2025-09-24T18:29:10.052957] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-24T18:29:10.224501] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T18:29:10.424706] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-24T18:29:10.482522] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-24T18:29:10.485050] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-24T18:29:10.486224] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-24T18:29:10.486428] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-24T18:29:10.489002] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T18:29:10.498936] [DEBUG] [LOCAL ] DXYZ: Trimmed 58030 records to 36652 (keeping 200 days of data) [2025-09-24T18:29:10.738514] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36652 records). [2025-09-24T18:29:10.738701] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-24T18:29:10.738846] [INFO ] [MAIN ] Update Progress: 675/2373 symbols completed. DXYZ took 39.7s. Estimated remaining: 3h 44m 11s. Rate: 7.6 symbols/min [2025-09-24T18:29:10.945444] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:10.945733] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-09-24T18:29:10.945785] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-09-24T18:29:10.945935] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-24T18:29:10.945983] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-24T18:29:10.946095] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-24T18:29:10.946145] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-24T18:29:11.063410] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T18:29:11.223418] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-24T18:29:11.353712] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:12.016118] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-24T18:29:12.816084] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-24T18:29:12.923675] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T18:29:13.616081] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-24T18:29:13.686914] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T18:29:14.204482] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T18:29:14.205701] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T18:29:14.416188] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-24T18:29:15.216201] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-24T18:29:15.819064] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T18:29:16.016143] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-24T18:29:16.108490] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T18:29:16.591626] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T18:29:16.816119] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-24T18:29:17.616099] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-24T18:29:18.158680] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-24T18:29:18.416112] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-24T18:29:18.575028] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T18:29:19.216116] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-24T18:29:19.821820] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T18:29:20.016073] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-24T18:29:20.205052] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:29:20.816120] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-24T18:29:21.533483] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T18:29:21.616090] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-24T18:29:22.044513] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T18:29:22.416115] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-24T18:29:22.488965] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:29:23.216085] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-24T18:29:23.941390] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T18:29:24.016207] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-24T18:29:24.816058] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-24T18:29:24.916829] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T18:29:25.616068] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-24T18:29:25.788962] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T18:29:26.309975] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T18:29:26.312404] [INFO ] [REMOTE ] EAI: Full fetch complete (6139 records). [2025-09-24T18:29:26.312721] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-24T18:29:26.428989] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-24T18:29:26.528375] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T18:29:26.759264] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-24T18:29:26.759368] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-24T18:29:26.759579] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-24T18:29:26.759621] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-24T18:29:26.760068] [DEBUG] [LOCAL ] EAI: Trimmed 6139 records to 3961 (keeping 200 days of data) [2025-09-24T18:29:26.785617] [DEBUG] [LOCAL ] EAI: Primary data saved (3961 records). [2025-09-24T18:29:26.785765] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-24T18:29:26.785915] [INFO ] [MAIN ] Update Progress: 676/2373 symbols completed. EAI took 20.6s. Estimated remaining: 3h 44m 23s. Rate: 7.6 symbols/min [2025-09-24T18:29:26.957075] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:27.003206] [DEBUG] [LOCAL ] EB: Loaded 37872 existing records from primary storage. [2025-09-24T18:29:27.003390] [INFO ] [MAIN ] EB: Loaded 37872 existing records. [2025-09-24T18:29:27.207885] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:27.208546] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-24T18:29:27.208827] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-24T18:29:27.209855] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-24T18:29:27.209937] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-24T18:29:27.222722] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-24T18:29:27.587779] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:27.949614] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T18:29:28.016095] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-24T18:29:28.816066] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-24T18:29:28.963830] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T18:29:29.574890] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T18:29:29.616072] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-24T18:29:30.184759] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T18:29:30.416080] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-24T18:29:31.216097] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-24T18:29:31.245521] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:29:32.016083] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-24T18:29:32.129126] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T18:29:32.200762] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T18:29:32.816166] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-24T18:29:33.318365] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T18:29:33.616093] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-24T18:29:33.938411] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T18:29:34.416151] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-24T18:29:35.216054] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-24T18:29:35.468496] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T18:29:35.597962] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T18:29:36.016103] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-24T18:29:36.434606] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T18:29:36.816155] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-24T18:29:37.616058] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-24T18:29:37.670479] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:29:38.015467] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:29:38.019709] [INFO ] [REMOTE ] EARN: Full fetch complete (46382 records). [2025-09-24T18:29:38.019813] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-24T18:29:38.418419] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-24T18:29:38.460730] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-24T18:29:38.460809] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-24T18:29:38.461577] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-24T18:29:38.461749] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-24T18:29:38.463004] [DEBUG] [LOCAL ] EARN: Trimmed 46382 records to 30263 (keeping 200 days of data) [2025-09-24T18:29:38.663265] [DEBUG] [LOCAL ] EARN: Primary data saved (30263 records). [2025-09-24T18:29:38.664404] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T18:29:38.663958] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-24T18:29:38.664567] [INFO ] [MAIN ] Update Progress: 677/2373 symbols completed. EARN took 31.7s. Estimated remaining: 3h 44m 25s. Rate: 7.6 symbols/min [2025-09-24T18:29:38.673742] [INFO ] [REMOTE ] EAF: Full fetch complete (64660 records). [2025-09-24T18:29:38.673832] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-24T18:29:39.068898] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-24T18:29:39.068985] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-24T18:29:39.070269] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-24T18:29:39.070353] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-24T18:29:39.071756] [DEBUG] [LOCAL ] EAF: Trimmed 64660 records to 43750 (keeping 200 days of data) [2025-09-24T18:29:39.248146] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-24T18:29:39.349576] [DEBUG] [LOCAL ] EAF: Primary data saved (43750 records). [2025-09-24T18:29:39.349745] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-24T18:29:39.349855] [INFO ] [MAIN ] Update Progress: 678/2373 symbols completed. EAF took 37.3s. Estimated remaining: 3h 43m 59s. Rate: 7.6 symbols/min [2025-09-24T18:29:40.166988] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T18:29:40.176105] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-24T18:29:40.888590] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T18:29:40.900339] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-24T18:29:41.716629] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T18:29:41.727398] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-24T18:29:42.622515] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T18:29:42.633198] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-24T18:29:43.178906] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T18:29:43.216091] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-24T18:29:44.591268] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T18:29:44.621429] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T18:29:44.620085] [INFO ] [REMOTE ] EAT: Full fetch complete (71761 records). [2025-09-24T18:29:44.621586] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-24T18:29:44.629362] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-24T18:29:45.071955] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-24T18:29:45.072085] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-24T18:29:45.073672] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-24T18:29:45.073763] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-24T18:29:45.078846] [DEBUG] [LOCAL ] EAT: Trimmed 71761 records to 49810 (keeping 200 days of data) [2025-09-24T18:29:45.511880] [DEBUG] [LOCAL ] EAT: Primary data saved (49810 records). [2025-09-24T18:29:45.512089] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-24T18:29:45.512228] [INFO ] [MAIN ] Update Progress: 679/2373 symbols completed. EAT took 34.8s. Estimated remaining: 3h 43m 47s. Rate: 7.6 symbols/min [2025-09-24T18:29:46.088598] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:29:46.103493] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-24T18:29:47.567201] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T18:29:47.575770] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-24T18:29:48.909237] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T18:29:48.915181] [INFO ] [REMOTE ] EB: Full fetch complete (56833 records). [2025-09-24T18:29:48.915295] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-24T18:29:49.362528] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-24T18:29:49.362611] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-24T18:29:49.363457] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-24T18:29:49.363526] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-24T18:29:49.364774] [DEBUG] [LOCAL ] EB: Trimmed 56833 records to 37674 (keeping 200 days of data) [2025-09-24T18:29:49.578958] [DEBUG] [LOCAL ] EB: Primary data saved (37674 records). [2025-09-24T18:29:49.579107] [INFO ] [MAIN ] EB: Full history saved. [2025-09-24T18:29:49.579196] [INFO ] [MAIN ] Update Progress: 680/2373 symbols completed. EB took 22.8s. Estimated remaining: 3h 43m 29s. Rate: 7.6 symbols/min [2025-09-24T18:29:50.309002] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:50.300069] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:50.298570] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:50.396749] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:29:50.425979] [DEBUG] [LOCAL ] EBF: Loaded 19531 existing records from primary storage. [2025-09-24T18:29:50.426207] [INFO ] [MAIN ] EBF: Loaded 19531 existing records. [2025-09-24T18:29:50.580913] [DEBUG] [LOCAL ] EBS: Loaded 46807 existing records from primary storage. [2025-09-24T18:29:50.581405] [INFO ] [MAIN ] EBS: Loaded 46807 existing records. [2025-09-24T18:29:50.722127] [DEBUG] [LOCAL ] EC: Loaded 49369 existing records from primary storage. [2025-09-24T18:29:50.732775] [INFO ] [MAIN ] EC: Loaded 49369 existing records. [2025-09-24T18:29:50.824172] [DEBUG] [LOCAL ] EBR: Loaded 43083 existing records from primary storage. [2025-09-24T18:29:50.879032] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:50.853846] [INFO ] [MAIN ] EBR: Loaded 43083 existing records. [2025-09-24T18:29:50.931529] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-24T18:29:50.997146] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-24T18:29:51.035387] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-24T18:29:51.100235] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:51.064394] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-24T18:29:51.147353] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-24T18:29:51.170243] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-24T18:29:51.233866] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-24T18:29:51.284893] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-24T18:29:51.333774] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:51.509996] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-24T18:29:51.556385] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-24T18:29:51.567082] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:29:51.590520] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-24T18:29:51.615666] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-24T18:29:51.615737] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-24T18:29:51.649356] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-24T18:29:51.701070] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-24T18:29:51.715951] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-24T18:29:52.285734] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:52.452837] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-24T18:29:52.808607] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:52.813879] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:52.814755] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-24T18:29:52.814188] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-24T18:29:52.897261] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:29:52.897548] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-24T18:29:53.790917] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T18:29:53.795028] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-24T18:29:54.529215] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T18:29:54.539209] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-24T18:29:54.656071] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T18:29:54.669912] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-24T18:29:54.700311] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:29:54.710947] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-24T18:29:54.799433] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T18:29:54.803336] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-24T18:29:55.642112] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T18:29:55.646493] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-24T18:29:56.011620] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T18:29:56.021075] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-24T18:29:56.228161] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T18:29:56.237926] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-24T18:29:56.422254] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T18:29:56.427896] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-24T18:29:56.488927] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T18:29:56.816083] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-24T18:29:57.276690] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T18:29:57.445542] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T18:29:57.616097] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-24T18:29:57.679986] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T18:29:58.154321] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T18:29:58.416115] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-24T18:29:58.950940] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:29:59.216085] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-24T18:30:00.021197] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-24T18:30:00.037126] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:30:00.816088] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-24T18:30:00.948781] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:30:01.616176] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-24T18:30:02.207902] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-24T18:30:02.416136] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-24T18:30:03.221873] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-24T18:30:03.251554] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-24T18:30:04.016195] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-24T18:30:04.518075] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-24T18:30:04.816209] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-24T18:30:05.868511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-24T18:30:05.875972] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-24T18:30:05.967239] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (3.55 seconds). [2025-09-24T18:30:06.026047] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:30:06.416062] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-24T18:30:06.629551] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T18:30:06.827342] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:30:07.216116] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-24T18:30:08.016204] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-24T18:30:08.153331] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:30:08.278182] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T18:30:08.816138] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-24T18:30:09.616056] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-24T18:30:09.705276] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:30:09.830906] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T18:30:10.416150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-24T18:30:11.216065] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-24T18:30:11.375092] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T18:30:11.378886] [INFO ] [REMOTE ] EBF: Full fetch complete (27301 records). [2025-09-24T18:30:11.379050] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-24T18:30:11.379795] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:30:11.379941] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:30:11.380041] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:30:11.380218] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-24T18:30:11.380288] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-09-24T18:30:11.395686] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-09-24T18:30:11.410118] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-09-24T18:30:11.411701] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T18:30:11.411867] [INFO ] [MAIN ] Update Progress: 681/2373 symbols completed. EBF took 21.8s. Estimated remaining: 3h 43m 56s. Rate: 7.6 symbols/min [2025-09-24T18:30:11.611112] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:11.645465] [DEBUG] [LOCAL ] ECAT: Loaded 29687 existing records from primary storage. [2025-09-24T18:30:11.645701] [INFO ] [MAIN ] ECAT: Loaded 29687 existing records. [2025-09-24T18:30:11.834051] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:30:11.834382] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-24T18:30:11.834443] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-24T18:30:11.835373] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-24T18:30:11.835455] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-24T18:30:12.021473] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-24T18:30:12.212728] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:12.714809] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T18:30:12.816112] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-24T18:30:13.616053] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-24T18:30:13.889753] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T18:30:14.107420] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T18:30:14.416086] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-24T18:30:14.883574] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T18:30:15.216081] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-24T18:30:15.603355] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T18:30:16.016110] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-24T18:30:16.785136] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T18:30:16.816069] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-24T18:30:17.616072] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-24T18:30:17.789949] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T18:30:18.266201] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T18:30:18.274490] [INFO ] [REMOTE ] EC: Full fetch complete (71966 records). [2025-09-24T18:30:18.274607] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-24T18:30:18.416266] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-24T18:30:18.681322] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T18:30:18.704711] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-24T18:30:18.705213] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-24T18:30:18.706516] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-24T18:30:18.706583] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-24T18:30:18.708006] [DEBUG] [LOCAL ] EC: Trimmed 71966 records to 49335 (keeping 200 days of data) [2025-09-24T18:30:19.001070] [DEBUG] [LOCAL ] EC: Primary data saved (49335 records). [2025-09-24T18:30:19.001219] [INFO ] [MAIN ] EC: Full history saved. [2025-09-24T18:30:19.001307] [INFO ] [MAIN ] Update Progress: 682/2373 symbols completed. EC took 29.4s. Estimated remaining: 3h 43m 47s. Rate: 7.6 symbols/min [2025-09-24T18:30:19.168809] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:19.207945] [DEBUG] [LOCAL ] ECC: Loaded 43440 existing records from primary storage. [2025-09-24T18:30:19.208095] [INFO ] [MAIN ] ECC: Loaded 43440 existing records. [2025-09-24T18:30:19.221191] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-24T18:30:19.387295] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:30:19.387561] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-24T18:30:19.387611] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-24T18:30:19.388755] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-24T18:30:19.388816] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-24T18:30:19.756177] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:20.016072] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-24T18:30:20.168075] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:30:20.816083] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-24T18:30:21.043147] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T18:30:21.051429] [INFO ] [REMOTE ] EBS: Full fetch complete (67057 records). [2025-09-24T18:30:21.051579] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-24T18:30:21.052304] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:30:21.052434] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:30:21.052512] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:30:21.052607] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-24T18:30:21.052717] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-09-24T18:30:21.052766] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-09-24T18:30:21.053102] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-09-24T18:30:21.053212] [INFO ] [MAIN ] Update Progress: 683/2373 symbols completed. EBS took 31.5s. Estimated remaining: 3h 43m 25s. Rate: 7.6 symbols/min [2025-09-24T18:30:21.229733] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:21.230020] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-24T18:30:21.230085] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-24T18:30:21.230590] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-24T18:30:21.230705] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-24T18:30:21.230777] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-24T18:30:21.230815] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-24T18:30:21.567260] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T18:30:21.620428] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-24T18:30:21.644456] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:22.416061] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-24T18:30:22.562365] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T18:30:22.572242] [INFO ] [REMOTE ] EBR: Full fetch complete (62790 records). [2025-09-24T18:30:22.572376] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-24T18:30:23.006597] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-24T18:30:23.006967] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-24T18:30:23.010997] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-24T18:30:23.011363] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-24T18:30:23.011422] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-24T18:30:23.015155] [DEBUG] [LOCAL ] EBR: Trimmed 62790 records to 43088 (keeping 200 days of data) [2025-09-24T18:30:23.141363] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T18:30:23.230781] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-24T18:30:23.320281] [DEBUG] [LOCAL ] EBR: Primary data saved (43088 records). [2025-09-24T18:30:23.320435] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-24T18:30:23.320527] [INFO ] [MAIN ] Update Progress: 684/2373 symbols completed. EBR took 33.7s. Estimated remaining: 3h 43m 3s. Rate: 7.6 symbols/min [2025-09-24T18:30:23.492312] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:23.492542] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-24T18:30:23.492600] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-24T18:30:23.492773] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-24T18:30:23.492820] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-24T18:30:23.492862] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-24T18:30:23.492896] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-24T18:30:23.859558] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:24.016084] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-24T18:30:24.635901] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:30:24.648420] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T18:30:24.816120] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-24T18:30:25.616122] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-24T18:30:26.170431] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T18:30:26.201754] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T18:30:26.416083] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-24T18:30:26.745916] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T18:30:27.216115] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-24T18:30:27.540992] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-24T18:30:28.016142] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-24T18:30:28.816111] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-24T18:30:29.616107] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-24T18:30:30.414906] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:30:30.416041] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-24T18:30:30.499099] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-24T18:30:30.750476] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-24T18:30:31.216087] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-24T18:30:31.570702] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-24T18:30:31.570541] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T18:30:32.016140] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-24T18:30:32.466683] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T18:30:32.816098] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-24T18:30:33.616086] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-24T18:30:34.019029] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T18:30:34.208549] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T18:30:34.416085] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-24T18:30:35.216089] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-24T18:30:35.934979] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T18:30:36.016092] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-24T18:30:36.082197] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T18:30:36.461084] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T18:30:36.816098] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-24T18:30:37.616113] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-24T18:30:38.206141] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T18:30:38.302519] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:30:38.416170] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-24T18:30:38.772287] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-24T18:30:39.216177] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-24T18:30:40.016146] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-24T18:30:40.513181] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:30:40.816097] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-24T18:30:41.616056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-24T18:30:41.697911] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T18:30:41.933697] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-24T18:30:42.233335] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T18:30:42.239764] [INFO ] [REMOTE ] ECAT: Full fetch complete (42614 records). [2025-09-24T18:30:42.239956] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-24T18:30:42.424485] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-24T18:30:42.663265] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-24T18:30:42.663361] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-24T18:30:42.664077] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-24T18:30:42.664146] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-24T18:30:42.665315] [DEBUG] [LOCAL ] ECAT: Trimmed 42614 records to 29712 (keeping 200 days of data) [2025-09-24T18:30:42.857319] [DEBUG] [LOCAL ] ECAT: Primary data saved (29712 records). [2025-09-24T18:30:42.857484] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-24T18:30:42.857585] [INFO ] [MAIN ] Update Progress: 685/2373 symbols completed. ECAT took 31.4s. Estimated remaining: 3h 43m 23s. Rate: 7.6 symbols/min [2025-09-24T18:30:42.928830] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T18:30:43.044201] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:43.044428] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-24T18:30:43.044474] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-24T18:30:43.044621] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-24T18:30:43.044698] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-24T18:30:43.044756] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-24T18:30:43.044791] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-24T18:30:43.222052] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-24T18:30:43.413593] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:43.785331] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T18:30:44.016099] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-24T18:30:44.448869] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T18:30:44.449728] [INFO ] [REMOTE ] ECCC: Full fetch complete (1281 records). [2025-09-24T18:30:44.449799] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-24T18:30:44.632361] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-24T18:30:44.632610] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:30:44.632721] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:30:44.632813] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-24T18:30:44.632899] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-24T18:30:44.632940] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-24T18:30:44.633002] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-24T18:30:44.633090] [INFO ] [MAIN ] Update Progress: 686/2373 symbols completed. ECCC took 23.6s. Estimated remaining: 3h 43m 0s. Rate: 7.6 symbols/min [2025-09-24T18:30:44.847241] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:44.844068] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-24T18:30:44.847467] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-24T18:30:44.848321] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-24T18:30:44.848480] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-24T18:30:44.848528] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-24T18:30:44.848574] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-24T18:30:44.848608] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-24T18:30:45.218176] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:45.334169] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T18:30:45.616114] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-24T18:30:46.416090] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-24T18:30:46.750841] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T18:30:47.216078] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-24T18:30:47.324813] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T18:30:47.762523] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T18:30:48.016127] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-24T18:30:48.567702] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T18:30:48.568661] [INFO ] [REMOTE ] ECCU: Full fetch complete (4428 records). [2025-09-24T18:30:48.568739] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-24T18:30:48.749351] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-24T18:30:48.749563] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:30:48.749662] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:30:48.749727] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-24T18:30:48.749798] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-24T18:30:48.749834] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-24T18:30:48.749873] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-24T18:30:48.749931] [INFO ] [MAIN ] Update Progress: 687/2373 symbols completed. ECCU took 25.4s. Estimated remaining: 3h 42m 43s. Rate: 7.6 symbols/min [2025-09-24T18:30:48.821257] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-24T18:30:48.924696] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:30:48.961178] [DEBUG] [LOCAL ] ECG: Loaded 34265 existing records from primary storage. [2025-09-24T18:30:48.961319] [INFO ] [MAIN ] ECG: Loaded 34265 existing records. [2025-09-24T18:30:49.139550] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:30:49.139817] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-24T18:30:49.139869] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-24T18:30:49.140901] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-24T18:30:49.140963] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-24T18:30:49.448020] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T18:30:49.531374] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:30:49.616081] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-24T18:30:50.416087] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-24T18:30:50.994378] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:30:51.216073] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-24T18:30:51.776979] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T18:30:52.016095] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-24T18:30:52.816328] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-24T18:30:52.897393] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T18:30:53.077519] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-24T18:30:53.536101] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:30:53.616079] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-24T18:30:54.416090] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-24T18:30:55.216048] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-24T18:30:55.408278] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T18:30:55.637739] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-24T18:30:56.016081] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-24T18:30:56.354167] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T18:30:56.816077] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-24T18:30:57.240835] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-24T18:30:57.242269] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T18:30:57.616080] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-24T18:30:58.038880] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-24T18:30:58.416076] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-24T18:30:59.216080] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-24T18:31:00.016121] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-24T18:31:00.159017] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:31:00.167180] [INFO ] [REMOTE ] ECC: Full fetch complete (60971 records). [2025-09-24T18:31:00.167354] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-24T18:31:00.586134] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-24T18:31:00.586870] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-24T18:31:00.586769] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T18:31:00.588161] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-24T18:31:00.589840] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-24T18:31:00.591488] [DEBUG] [LOCAL ] ECC: Trimmed 60971 records to 43428 (keeping 200 days of data) [2025-09-24T18:31:00.817492] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-24T18:31:00.848244] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T18:31:00.903907] [DEBUG] [LOCAL ] ECC: Primary data saved (43428 records). [2025-09-24T18:31:00.904069] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-24T18:31:00.904166] [INFO ] [MAIN ] Update Progress: 688/2373 symbols completed. ECC took 41.9s. Estimated remaining: 3h 42m 45s. Rate: 7.6 symbols/min [2025-09-24T18:31:01.078790] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:01.079084] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-09-24T18:31:01.079166] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-09-24T18:31:01.079447] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-24T18:31:01.079524] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-24T18:31:01.079613] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-24T18:31:01.079706] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-24T18:31:01.386067] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T18:31:01.491331] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:01.616088] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-24T18:31:02.416107] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-24T18:31:02.766306] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T18:31:03.216099] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-24T18:31:03.311505] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T18:31:04.016101] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-24T18:31:04.338676] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-24T18:31:04.816092] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-24T18:31:04.861135] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T18:31:05.203679] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-24T18:31:05.616138] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-24T18:31:06.050214] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T18:31:06.416149] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-24T18:31:07.216102] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-24T18:31:07.557035] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T18:31:07.660760] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T18:31:08.016102] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-24T18:31:08.816126] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-24T18:31:09.155994] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T18:31:09.616088] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-24T18:31:09.732418] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T18:31:10.048739] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T18:31:10.416096] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-24T18:31:11.216097] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-24T18:31:11.552236] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-24T18:31:12.016117] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-24T18:31:12.112481] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T18:31:12.452519] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T18:31:12.454338] [INFO ] [REMOTE ] ECCW: Full fetch complete (1426 records). [2025-09-24T18:31:12.454588] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-24T18:31:12.638229] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-24T18:31:12.638545] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:31:12.638618] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:31:12.638711] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-24T18:31:12.638840] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-24T18:31:12.638893] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-24T18:31:12.638953] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-24T18:31:12.639072] [INFO ] [MAIN ] Update Progress: 689/2373 symbols completed. ECCW took 29.8s. Estimated remaining: 3h 42m 47s. Rate: 7.6 symbols/min [2025-09-24T18:31:12.813017] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:12.816111] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-24T18:31:12.832983] [DEBUG] [LOCAL ] ECO: Loaded 18531 existing records from primary storage. [2025-09-24T18:31:12.833123] [INFO ] [MAIN ] ECO: Loaded 18531 existing records. [2025-09-24T18:31:13.016717] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:13.017032] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-24T18:31:13.017083] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-24T18:31:13.017844] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-24T18:31:13.017909] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-24T18:31:13.379133] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:13.616082] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-24T18:31:14.089007] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T18:31:14.416147] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-24T18:31:14.688536] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T18:31:15.216099] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-24T18:31:15.815348] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T18:31:16.016088] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-24T18:31:16.602417] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:31:16.816106] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-24T18:31:17.195173] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T18:31:17.616146] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-24T18:31:18.416071] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-24T18:31:18.598251] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T18:31:18.790841] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T18:31:18.825786] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-24T18:31:18.827106] [INFO ] [REMOTE ] ECCX: Full fetch complete (1485 records). [2025-09-24T18:31:18.827198] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-24T18:31:18.827750] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:31:18.827866] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:31:18.827945] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:31:18.828031] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-24T18:31:18.828114] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-24T18:31:18.828163] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-24T18:31:18.828219] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-24T18:31:18.828344] [INFO ] [MAIN ] Update Progress: 690/2373 symbols completed. ECCX took 34.2s. Estimated remaining: 3h 42m 35s. Rate: 7.6 symbols/min [2025-09-24T18:31:19.004536] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:19.049620] [DEBUG] [LOCAL ] ECVT: Loaded 43046 existing records from primary storage. [2025-09-24T18:31:19.049834] [INFO ] [MAIN ] ECVT: Loaded 43046 existing records. [2025-09-24T18:31:19.221261] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-24T18:31:19.226319] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:19.226501] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-24T18:31:19.226547] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-24T18:31:19.227829] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-24T18:31:19.227897] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-24T18:31:19.590003] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:20.016102] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-24T18:31:20.397450] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T18:31:20.816117] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-24T18:31:21.458953] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:31:21.616098] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-24T18:31:22.047168] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T18:31:22.052873] [INFO ] [REMOTE ] ECG: Full fetch complete (51540 records). [2025-09-24T18:31:22.052982] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-24T18:31:22.423774] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-24T18:31:22.469821] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-24T18:31:22.469911] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-24T18:31:22.470672] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-24T18:31:22.470737] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-24T18:31:22.471854] [DEBUG] [LOCAL ] ECG: Trimmed 51540 records to 34236 (keeping 200 days of data) [2025-09-24T18:31:22.683636] [DEBUG] [LOCAL ] ECG: Primary data saved (34236 records). [2025-09-24T18:31:22.683827] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-24T18:31:22.683939] [INFO ] [MAIN ] Update Progress: 691/2373 symbols completed. ECG took 33.9s. Estimated remaining: 3h 42m 17s. Rate: 7.6 symbols/min [2025-09-24T18:31:22.859660] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:22.915167] [DEBUG] [LOCAL ] ED: Loaded 52803 existing records from primary storage. [2025-09-24T18:31:22.915350] [INFO ] [MAIN ] ED: Loaded 52803 existing records. [2025-09-24T18:31:23.055842] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T18:31:23.130306] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:23.130622] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-24T18:31:23.130708] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-24T18:31:23.132464] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-24T18:31:23.132531] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-24T18:31:23.223370] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-24T18:31:23.492476] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:24.016153] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-24T18:31:24.149222] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:31:24.400256] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T18:31:24.816084] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-24T18:31:25.616147] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-24T18:31:25.902481] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:31:25.932708] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T18:31:26.416089] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-24T18:31:27.102817] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T18:31:27.216056] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-24T18:31:27.518486] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T18:31:28.016130] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-24T18:31:28.816096] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-24T18:31:28.946051] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T18:31:29.616068] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-24T18:31:29.702266] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T18:31:30.333936] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T18:31:30.416056] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-24T18:31:31.216076] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-24T18:31:31.307380] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T18:31:32.016094] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-24T18:31:32.169728] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T18:31:32.816064] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-24T18:31:32.864281] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T18:31:33.162120] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T18:31:33.616098] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-24T18:31:34.320174] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T18:31:34.416075] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-24T18:31:35.216113] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-24T18:31:35.263840] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T18:31:36.016138] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-24T18:31:36.062332] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:31:36.816087] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-24T18:31:36.852416] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T18:31:37.096413] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T18:31:37.616086] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-24T18:31:38.416070] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-24T18:31:38.660821] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T18:31:38.716913] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T18:31:39.216117] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-24T18:31:40.016087] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-24T18:31:40.249861] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:31:40.260996] [INFO ] [REMOTE ] ECL: Full fetch complete (67681 records). [2025-09-24T18:31:40.261187] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-24T18:31:40.714711] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-24T18:31:40.715001] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-24T18:31:40.715976] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-24T18:31:40.716083] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-24T18:31:40.717936] [DEBUG] [LOCAL ] ECL: Trimmed 67681 records to 46760 (keeping 200 days of data) [2025-09-24T18:31:40.816732] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-24T18:31:40.859668] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T18:31:41.078407] [DEBUG] [LOCAL ] ECL: Primary data saved (46760 records). [2025-09-24T18:31:41.078723] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-24T18:31:41.078933] [INFO ] [MAIN ] Update Progress: 692/2373 symbols completed. ECL took 40.2s. Estimated remaining: 3h 42m 34s. Rate: 7.6 symbols/min [2025-09-24T18:31:41.255083] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:41.284412] [DEBUG] [LOCAL ] EDD: Loaded 27154 existing records from primary storage. [2025-09-24T18:31:41.284584] [INFO ] [MAIN ] EDD: Loaded 27154 existing records. [2025-09-24T18:31:41.465342] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:41.465780] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-24T18:31:41.465955] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-24T18:31:41.466944] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-24T18:31:41.467303] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-24T18:31:41.612594] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T18:31:41.617901] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-24T18:31:41.913577] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:41.973732] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T18:31:41.979855] [INFO ] [REMOTE ] ECO: Full fetch complete (29336 records). [2025-09-24T18:31:41.979983] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-24T18:31:42.357074] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-24T18:31:42.357160] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-24T18:31:42.357729] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-24T18:31:42.357802] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-24T18:31:42.359607] [DEBUG] [LOCAL ] ECO: Trimmed 29336 records to 18536 (keeping 200 days of data) [2025-09-24T18:31:42.416093] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-24T18:31:42.485765] [DEBUG] [LOCAL ] ECO: Primary data saved (18536 records). [2025-09-24T18:31:42.485912] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-24T18:31:42.486001] [INFO ] [MAIN ] Update Progress: 693/2373 symbols completed. ECO took 29.8s. Estimated remaining: 3h 42m 10s. Rate: 7.6 symbols/min [2025-09-24T18:31:42.654535] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:42.672002] [DEBUG] [LOCAL ] EDF: Loaded 13537 existing records from primary storage. [2025-09-24T18:31:42.672107] [INFO ] [MAIN ] EDF: Loaded 13537 existing records. [2025-09-24T18:31:42.860455] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:42.860825] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-24T18:31:42.860880] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-24T18:31:42.861339] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-24T18:31:42.861466] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-24T18:31:43.217686] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-24T18:31:43.221323] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:43.423872] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T18:31:44.016441] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-24T18:31:44.214020] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T18:31:44.479901] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T18:31:44.816113] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-24T18:31:44.892799] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T18:31:45.616137] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-24T18:31:45.794148] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T18:31:46.416054] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-24T18:31:46.644251] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T18:31:47.216074] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-24T18:31:47.432878] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T18:31:48.016082] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-24T18:31:48.793866] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T18:31:48.816114] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-24T18:31:48.870232] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T18:31:48.883213] [INFO ] [REMOTE ] ECVT: Full fetch complete (59925 records). [2025-09-24T18:31:48.883492] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-24T18:31:49.477516] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-24T18:31:49.477669] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-24T18:31:49.479249] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-24T18:31:49.479352] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-24T18:31:49.481330] [DEBUG] [LOCAL ] ECVT: Trimmed 59925 records to 42992 (keeping 200 days of data) [2025-09-24T18:31:49.620920] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-24T18:31:49.772323] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T18:31:49.834291] [DEBUG] [LOCAL ] ECVT: Primary data saved (42992 records). [2025-09-24T18:31:49.834463] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-24T18:31:49.834588] [INFO ] [MAIN ] Update Progress: 694/2373 symbols completed. ECVT took 31.0s. Estimated remaining: 3h 42m 1s. Rate: 7.6 symbols/min [2025-09-24T18:31:50.015446] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:31:50.040936] [DEBUG] [LOCAL ] EDN: Loaded 18115 existing records from primary storage. [2025-09-24T18:31:50.041112] [INFO ] [MAIN ] EDN: Loaded 18115 existing records. [2025-09-24T18:31:50.222192] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:31:50.222482] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-24T18:31:50.222606] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-24T18:31:50.223459] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-24T18:31:50.223532] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-24T18:31:50.422932] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-24T18:31:50.582776] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:31:51.216096] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-24T18:31:51.579404] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T18:31:51.582125] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T18:31:52.016086] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-24T18:31:52.494152] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T18:31:52.816085] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-24T18:31:52.990762] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T18:31:53.616082] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-24T18:31:54.388432] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:31:54.416041] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-24T18:31:54.709910] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T18:31:55.216097] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-24T18:31:55.380916] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T18:31:56.016095] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-24T18:31:56.362469] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T18:31:56.785401] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T18:31:56.816056] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-24T18:31:57.616140] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-24T18:31:58.416051] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-24T18:31:58.502193] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T18:31:58.650061] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T18:31:59.216112] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-24T18:31:59.481886] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T18:32:00.016128] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-24T18:32:00.816093] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-24T18:32:01.059399] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:32:01.069578] [INFO ] [REMOTE ] ED: Full fetch complete (75984 records). [2025-09-24T18:32:01.069746] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-24T18:32:01.070722] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:32:01.070815] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:32:01.070861] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:32:01.070934] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-24T18:32:01.071002] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-09-24T18:32:01.071040] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-09-24T18:32:01.071539] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-09-24T18:32:01.071749] [INFO ] [MAIN ] Update Progress: 695/2373 symbols completed. ED took 38.4s. Estimated remaining: 3h 42m 1s. Rate: 7.6 symbols/min [2025-09-24T18:32:01.254558] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:01.308280] [DEBUG] [LOCAL ] EDU: Loaded 45060 existing records from primary storage. [2025-09-24T18:32:01.308473] [INFO ] [MAIN ] EDU: Loaded 45060 existing records. [2025-09-24T18:32:01.469071] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T18:32:01.518064] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:01.518493] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-24T18:32:01.519017] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-24T18:32:01.520331] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-24T18:32:01.520395] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-24T18:32:01.620153] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-24T18:32:01.839220] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T18:32:01.921698] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:02.416083] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-24T18:32:02.768996] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T18:32:03.216058] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-24T18:32:03.453743] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T18:32:03.830458] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T18:32:04.016126] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-24T18:32:04.776906] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T18:32:04.779756] [INFO ] [REMOTE ] EDF: Full fetch complete (21057 records). [2025-09-24T18:32:04.779831] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-24T18:32:04.821298] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-24T18:32:05.182179] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-24T18:32:05.182270] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-24T18:32:05.182772] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-24T18:32:05.182835] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-24T18:32:05.183402] [DEBUG] [LOCAL ] EDF: Trimmed 21057 records to 13507 (keeping 200 days of data) [2025-09-24T18:32:05.269433] [DEBUG] [LOCAL ] EDF: Primary data saved (13507 records). [2025-09-24T18:32:05.269579] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-24T18:32:05.269707] [INFO ] [MAIN ] Update Progress: 696/2373 symbols completed. EDF took 22.8s. Estimated remaining: 3h 41m 44s. Rate: 7.6 symbols/min [2025-09-24T18:32:05.437054] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:05.473244] [DEBUG] [LOCAL ] EE: Loaded 32586 existing records from primary storage. [2025-09-24T18:32:05.473387] [INFO ] [MAIN ] EE: Loaded 32586 existing records. [2025-09-24T18:32:05.622538] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-24T18:32:05.653923] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:05.654210] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-24T18:32:05.654259] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-24T18:32:05.655984] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-24T18:32:05.656061] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-24T18:32:05.956771] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T18:32:06.039609] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:06.416104] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-24T18:32:07.216087] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-24T18:32:07.400960] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T18:32:07.856004] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:32:08.016094] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-24T18:32:08.185808] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T18:32:08.816138] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-24T18:32:09.500493] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-24T18:32:09.626160] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-24T18:32:09.650590] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:32:10.416128] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-24T18:32:10.893282] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T18:32:10.898481] [INFO ] [REMOTE ] EDD: Full fetch complete (39011 records). [2025-09-24T18:32:10.898575] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-24T18:32:11.217756] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-24T18:32:11.291729] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-24T18:32:11.291871] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-24T18:32:11.292708] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-24T18:32:11.292814] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-24T18:32:11.305590] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T18:32:11.305215] [DEBUG] [LOCAL ] EDD: Trimmed 39011 records to 27081 (keeping 200 days of data) [2025-09-24T18:32:11.473767] [DEBUG] [LOCAL ] EDD: Primary data saved (27081 records). [2025-09-24T18:32:11.473906] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-24T18:32:11.473994] [INFO ] [MAIN ] Update Progress: 697/2373 symbols completed. EDD took 30.4s. Estimated remaining: 3h 41m 32s. Rate: 7.6 symbols/min [2025-09-24T18:32:11.643776] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:11.648192] [DEBUG] [LOCAL ] EEA: Loaded 2710 existing records from primary storage. [2025-09-24T18:32:11.648270] [INFO ] [MAIN ] EEA: Loaded 2710 existing records. [2025-09-24T18:32:11.830479] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:11.830778] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-24T18:32:11.830832] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-24T18:32:11.831050] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-24T18:32:11.831112] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-24T18:32:12.024015] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-24T18:32:12.208100] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:12.816107] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-24T18:32:13.312229] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T18:32:13.390587] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T18:32:13.518312] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T18:32:13.616111] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-24T18:32:14.416174] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-24T18:32:15.216113] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-24T18:32:15.342139] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:32:15.662924] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T18:32:15.667811] [INFO ] [REMOTE ] EDN: Full fetch complete (30574 records). [2025-09-24T18:32:15.667932] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-24T18:32:16.020393] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-24T18:32:16.055796] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-24T18:32:16.055892] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-24T18:32:16.056510] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-24T18:32:16.056572] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-24T18:32:16.057414] [DEBUG] [LOCAL ] EDN: Trimmed 30574 records to 18143 (keeping 200 days of data) [2025-09-24T18:32:16.167633] [DEBUG] [LOCAL ] EDN: Primary data saved (18143 records). [2025-09-24T18:32:16.167818] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-24T18:32:16.167915] [INFO ] [MAIN ] Update Progress: 698/2373 symbols completed. EDN took 26.3s. Estimated remaining: 3h 41m 16s. Rate: 7.6 symbols/min [2025-09-24T18:32:16.342194] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:16.354613] [DEBUG] [LOCAL ] EEX: Loaded 12091 existing records from primary storage. [2025-09-24T18:32:16.354752] [INFO ] [MAIN ] EEX: Loaded 12091 existing records. [2025-09-24T18:32:16.525784] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T18:32:16.562538] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:16.563826] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-24T18:32:16.567776] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T18:32:16.567952] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-24T18:32:16.570191] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-24T18:32:16.570291] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-24T18:32:16.821350] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-24T18:32:16.929982] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:17.616094] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-24T18:32:17.790334] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T18:32:18.048832] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T18:32:18.416090] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-24T18:32:18.984400] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T18:32:19.216133] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-24T18:32:20.016068] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-24T18:32:20.472181] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T18:32:20.640000] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T18:32:20.816113] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-24T18:32:21.616149] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-24T18:32:22.077223] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T18:32:22.088195] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T18:32:22.416282] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-24T18:32:22.885000] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T18:32:23.216108] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-24T18:32:24.016108] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-24T18:32:24.816067] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-24T18:32:24.980557] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T18:32:25.616120] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-24T18:32:25.739660] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:32:25.739832] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T18:32:26.416077] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-24T18:32:26.455329] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:32:26.902716] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T18:32:27.216092] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-24T18:32:28.016115] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-24T18:32:28.506860] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-24T18:32:28.507984] [INFO ] [REMOTE ] EEA: Full fetch complete (3986 records). [2025-09-24T18:32:28.508130] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-24T18:32:28.817790] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-24T18:32:28.945399] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:32:28.979438] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-24T18:32:28.979738] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-24T18:32:28.979931] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-24T18:32:28.980456] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-24T18:32:28.980950] [DEBUG] [LOCAL ] EEA: Trimmed 3986 records to 2702 (keeping 200 days of data) [2025-09-24T18:32:28.998091] [DEBUG] [LOCAL ] EEA: Primary data saved (2702 records). [2025-09-24T18:32:28.998175] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-24T18:32:28.998258] [INFO ] [MAIN ] Update Progress: 699/2373 symbols completed. EEA took 17.5s. Estimated remaining: 3h 41m 20s. Rate: 7.6 symbols/min [2025-09-24T18:32:29.173621] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:29.173867] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-09-24T18:32:29.173912] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-09-24T18:32:29.174059] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-24T18:32:29.174102] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-24T18:32:29.174143] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-24T18:32:29.174176] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-24T18:32:29.548509] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:29.616099] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-24T18:32:29.838838] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T18:32:30.416138] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-24T18:32:30.732832] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T18:32:31.216145] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-24T18:32:31.475418] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T18:32:32.016141] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-24T18:32:32.816124] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-24T18:32:33.183993] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T18:32:33.590518] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T18:32:33.616086] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-24T18:32:34.416090] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-24T18:32:35.216089] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-24T18:32:36.334102] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T18:32:36.341906] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-24T18:32:36.522668] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T18:32:36.816129] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-24T18:32:37.246897] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (3.63 seconds). [2025-09-24T18:32:37.373179] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (4.56 seconds). [2025-09-24T18:32:37.616083] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-24T18:32:38.416179] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-24T18:32:38.446705] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T18:32:38.578782] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T18:32:39.216116] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-24T18:32:39.379198] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T18:32:40.016140] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-24T18:32:40.084499] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T18:32:40.414830] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:32:40.419949] [INFO ] [REMOTE ] EE: Full fetch complete (43444 records). [2025-09-24T18:32:40.420038] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-24T18:32:40.420634] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:32:40.420746] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:32:40.420790] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:32:40.420852] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-24T18:32:40.420918] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-24T18:32:40.420955] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-09-24T18:32:40.421426] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-09-24T18:32:40.421524] [INFO ] [MAIN ] Update Progress: 700/2373 symbols completed. EE took 35.2s. Estimated remaining: 3h 41m 21s. Rate: 7.6 symbols/min [2025-09-24T18:32:40.597399] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:40.613807] [DEBUG] [LOCAL ] EFR: Loaded 14232 existing records from primary storage. [2025-09-24T18:32:40.613953] [INFO ] [MAIN ] EFR: Loaded 14232 existing records. [2025-09-24T18:32:40.791595] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:40.791920] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-24T18:32:40.791976] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-24T18:32:40.792449] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-24T18:32:40.792510] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-24T18:32:40.823190] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-24T18:32:41.158602] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:41.616209] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-24T18:32:41.738607] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T18:32:42.416278] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-24T18:32:42.478795] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T18:32:42.636271] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T18:32:43.216106] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-24T18:32:43.257068] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T18:32:43.805208] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T18:32:44.016083] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-24T18:32:44.816095] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-24T18:32:45.585985] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T18:32:45.616090] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-24T18:32:45.990263] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T18:32:46.140159] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T18:32:46.416119] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-24T18:32:47.216090] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-24T18:32:47.285585] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T18:32:48.016110] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-24T18:32:48.766202] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T18:32:48.816057] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-24T18:32:48.854453] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T18:32:48.863088] [INFO ] [REMOTE ] EDU: Full fetch complete (66182 records). [2025-09-24T18:32:48.863207] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-24T18:32:48.864093] [FATAL] [VALIDATOR ] EDU: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:32:48.864189] [FATAL] [MAIN ] EDU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:32:48.864234] [WARN ] [MAIN ] EDU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:32:48.864302] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-24T18:32:48.864391] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-09-24T18:32:48.864458] [INFO ] [LOCAL ] EDU: Starting deletion of derivative data. [2025-09-24T18:32:48.864889] [DEBUG] [LOCAL ] EDU: Deleted derivative data file. [2025-09-24T18:32:48.864993] [INFO ] [MAIN ] Update Progress: 701/2373 symbols completed. EDU took 47.8s. Estimated remaining: 3h 41m 14s. Rate: 7.6 symbols/min [2025-09-24T18:32:49.040884] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:49.041113] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-09-24T18:32:49.041214] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-09-24T18:32:49.041385] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-24T18:32:49.041432] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-24T18:32:49.041480] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-24T18:32:49.041575] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-24T18:32:49.408224] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:49.616099] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-24T18:32:50.416055] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-24T18:32:50.456385] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T18:32:50.459321] [INFO ] [REMOTE ] EEX: Full fetch complete (19918 records). [2025-09-24T18:32:50.459404] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-24T18:32:50.863007] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T18:32:50.872084] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-24T18:32:50.872385] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-24T18:32:50.872946] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-24T18:32:50.873127] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-24T18:32:50.874042] [DEBUG] [LOCAL ] EEX: Trimmed 19918 records to 11999 (keeping 200 days of data) [2025-09-24T18:32:50.945013] [DEBUG] [LOCAL ] EEX: Primary data saved (11999 records). [2025-09-24T18:32:50.945179] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-24T18:32:50.945286] [INFO ] [MAIN ] Update Progress: 702/2373 symbols completed. EEX took 34.8s. Estimated remaining: 3h 40m 52s. Rate: 7.6 symbols/min [2025-09-24T18:32:51.119090] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:32:51.167485] [DEBUG] [LOCAL ] EFX: Loaded 44864 existing records from primary storage. [2025-09-24T18:32:51.167633] [INFO ] [MAIN ] EFX: Loaded 44864 existing records. [2025-09-24T18:32:51.222306] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-24T18:32:51.379278] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:32:51.379835] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-24T18:32:51.379969] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-24T18:32:51.381330] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-24T18:32:51.381392] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-24T18:32:51.541994] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T18:32:51.770298] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:32:52.016048] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-24T18:32:52.171611] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T18:32:52.816075] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-24T18:32:52.922321] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T18:32:53.616112] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-24T18:32:53.680713] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T18:32:54.416077] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-24T18:32:55.216110] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-24T18:32:55.292247] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T18:32:56.016220] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-24T18:32:56.289664] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T18:32:56.381795] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T18:32:56.777685] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T18:32:56.816038] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-24T18:32:57.447561] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T18:32:57.616092] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-24T18:32:58.416155] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-24T18:32:59.120986] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T18:32:59.151112] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T18:32:59.216033] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-24T18:33:00.016097] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-24T18:33:00.816128] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-24T18:33:01.041138] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T18:33:01.616056] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-24T18:33:01.899292] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T18:33:02.069600] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T18:33:02.416081] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-24T18:33:03.216126] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-24T18:33:04.016094] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-24T18:33:04.429330] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-24T18:33:04.544793] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T18:33:04.816115] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-24T18:33:05.590072] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-09-24T18:33:05.616039] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-24T18:33:05.797105] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T18:33:06.121192] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T18:33:06.416114] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-24T18:33:07.216115] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-24T18:33:07.770292] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-24T18:33:07.778774] [INFO ] [REMOTE ] EFC: Full fetch complete (66179 records). [2025-09-24T18:33:07.778918] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-24T18:33:08.030956] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-24T18:33:08.176275] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T18:33:08.242804] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-24T18:33:08.242932] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-24T18:33:08.244017] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-24T18:33:08.244175] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-24T18:33:08.245714] [DEBUG] [LOCAL ] EFC: Trimmed 66179 records to 46236 (keeping 200 days of data) [2025-09-24T18:33:08.494623] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T18:33:08.575538] [DEBUG] [LOCAL ] EFC: Primary data saved (46236 records). [2025-09-24T18:33:08.575773] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-24T18:33:08.575863] [INFO ] [MAIN ] Update Progress: 703/2373 symbols completed. EFC took 39.6s. Estimated remaining: 3h 41m 7s. Rate: 7.6 symbols/min [2025-09-24T18:33:08.747752] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:08.780883] [DEBUG] [LOCAL ] EFXT: Loaded 29358 existing records from primary storage. [2025-09-24T18:33:08.781036] [INFO ] [MAIN ] EFXT: Loaded 29358 existing records. [2025-09-24T18:33:08.823581] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-24T18:33:08.964940] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:08.965217] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-24T18:33:08.965268] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-24T18:33:08.966185] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-24T18:33:08.966248] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-24T18:33:09.349336] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:09.576889] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T18:33:09.580238] [INFO ] [REMOTE ] EFR: Full fetch complete (18530 records). [2025-09-24T18:33:09.580331] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-24T18:33:09.625060] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-24T18:33:09.952084] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-24T18:33:09.952168] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-24T18:33:09.952847] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-24T18:33:09.952909] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-24T18:33:09.953726] [DEBUG] [LOCAL ] EFR: Trimmed 18530 records to 14270 (keeping 200 days of data) [2025-09-24T18:33:10.043529] [DEBUG] [LOCAL ] EFR: Primary data saved (14270 records). [2025-09-24T18:33:10.043720] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-24T18:33:10.043823] [INFO ] [MAIN ] Update Progress: 704/2373 symbols completed. EFR took 29.6s. Estimated remaining: 3h 40m 44s. Rate: 7.6 symbols/min [2025-09-24T18:33:10.228462] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:10.258507] [DEBUG] [LOCAL ] EG: Loaded 28707 existing records from primary storage. [2025-09-24T18:33:10.258670] [INFO ] [MAIN ] EG: Loaded 28707 existing records. [2025-09-24T18:33:10.420713] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-24T18:33:10.450112] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:10.451279] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-24T18:33:10.451527] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-24T18:33:10.452621] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-24T18:33:10.452704] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-24T18:33:10.565951] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T18:33:10.697136] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:33:10.883841] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:11.216090] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-24T18:33:12.016119] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-24T18:33:12.073696] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:33:12.088253] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T18:33:12.090938] [INFO ] [REMOTE ] EFT: Full fetch complete (17207 records). [2025-09-24T18:33:12.091026] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-24T18:33:12.091695] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:33:12.091784] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:33:12.091830] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:33:12.091874] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-24T18:33:12.091936] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-24T18:33:12.091974] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-24T18:33:12.092073] [DEBUG] [LOCAL ] EFT: No derivative data file found to delete. [2025-09-24T18:33:12.092159] [INFO ] [MAIN ] Update Progress: 705/2373 symbols completed. EFT took 23.2s. Estimated remaining: 3h 40m 22s. Rate: 7.6 symbols/min [2025-09-24T18:33:12.278496] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:12.335111] [DEBUG] [LOCAL ] EGO: Loaded 51496 existing records from primary storage. [2025-09-24T18:33:12.335302] [INFO ] [MAIN ] EGO: Loaded 51496 existing records. [2025-09-24T18:33:12.523543] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:12.523825] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-24T18:33:12.523878] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-24T18:33:12.525343] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-24T18:33:12.525408] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-24T18:33:12.823738] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-24T18:33:12.940096] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:13.487603] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T18:33:13.616088] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-24T18:33:14.268278] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T18:33:14.416107] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-24T18:33:15.023862] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T18:33:15.216120] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-24T18:33:15.906358] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T18:33:16.016126] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-24T18:33:16.816139] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-24T18:33:17.616098] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-24T18:33:17.932357] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T18:33:18.220673] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-24T18:33:18.416115] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-24T18:33:19.099859] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T18:33:19.216051] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-24T18:33:19.393553] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T18:33:20.000807] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T18:33:20.016029] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-24T18:33:20.782485] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:33:20.816090] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-24T18:33:21.616074] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-24T18:33:21.873366] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:33:21.881394] [INFO ] [REMOTE ] EFX: Full fetch complete (64404 records). [2025-09-24T18:33:21.881519] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-24T18:33:22.286790] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-24T18:33:22.287024] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-24T18:33:22.288010] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-24T18:33:22.288250] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-24T18:33:22.289942] [DEBUG] [LOCAL ] EFX: Trimmed 64404 records to 44808 (keeping 200 days of data) [2025-09-24T18:33:22.416175] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-24T18:33:22.552114] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:33:22.626857] [DEBUG] [LOCAL ] EFX: Primary data saved (44808 records). [2025-09-24T18:33:22.627005] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-24T18:33:22.627129] [INFO ] [MAIN ] Update Progress: 706/2373 symbols completed. EFX took 31.7s. Estimated remaining: 3h 40m 20s. Rate: 7.6 symbols/min [2025-09-24T18:33:22.809667] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:22.809895] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-09-24T18:33:22.809950] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-09-24T18:33:22.810105] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-24T18:33:22.810149] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-24T18:33:22.810193] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-24T18:33:22.810237] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-24T18:33:23.191588] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:23.221180] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-24T18:33:23.235705] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:33:24.016060] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-24T18:33:24.054240] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T18:33:24.821201] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-24T18:33:24.840986] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T18:33:24.969992] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T18:33:25.616110] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-24T18:33:26.244165] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T18:33:26.416095] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-24T18:33:26.930699] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T18:33:27.216084] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-24T18:33:28.016054] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-24T18:33:28.224153] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T18:33:28.373172] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T18:33:28.816166] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-24T18:33:29.314121] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T18:33:29.616095] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-24T18:33:30.116965] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:33:30.416125] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-24T18:33:31.079961] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T18:33:31.216144] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-24T18:33:31.642536] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T18:33:32.016093] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-24T18:33:32.816146] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-24T18:33:33.200343] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T18:33:33.306609] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T18:33:33.616147] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-24T18:33:34.005403] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T18:33:34.416222] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-24T18:33:34.884820] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T18:33:35.216137] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-24T18:33:35.826471] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T18:33:36.016152] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-24T18:33:36.816101] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-24T18:33:36.906713] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:33:37.616137] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-24T18:33:37.752129] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T18:33:37.810978] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T18:33:38.416161] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-24T18:33:39.216141] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-24T18:33:39.432786] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T18:33:39.594090] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T18:33:40.016145] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-24T18:33:40.159500] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T18:33:40.165684] [INFO ] [REMOTE ] EG: Full fetch complete (43787 records). [2025-09-24T18:33:40.165843] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-24T18:33:40.571243] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-24T18:33:40.571370] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-24T18:33:40.572170] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-24T18:33:40.572236] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-24T18:33:40.573220] [DEBUG] [LOCAL ] EG: Trimmed 43787 records to 28623 (keeping 200 days of data) [2025-09-24T18:33:40.763884] [DEBUG] [LOCAL ] EG: Primary data saved (28623 records). [2025-09-24T18:33:40.764040] [INFO ] [MAIN ] EG: Full history saved. [2025-09-24T18:33:40.764132] [INFO ] [MAIN ] Update Progress: 707/2373 symbols completed. EG took 30.7s. Estimated remaining: 3h 40m 36s. Rate: 7.6 symbols/min [2025-09-24T18:33:40.821241] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-24T18:33:40.961367] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:41.002972] [DEBUG] [LOCAL ] EGY: Loaded 42328 existing records from primary storage. [2025-09-24T18:33:41.003216] [INFO ] [MAIN ] EGY: Loaded 42328 existing records. [2025-09-24T18:33:41.187615] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:41.188053] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-24T18:33:41.188254] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-24T18:33:41.194769] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-24T18:33:41.203439] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-24T18:33:41.251769] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T18:33:41.576077] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:41.616034] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-24T18:33:42.416098] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-24T18:33:42.778261] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T18:33:43.151102] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T18:33:43.216061] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-24T18:33:43.742752] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T18:33:44.016135] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-24T18:33:44.707484] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T18:33:44.816078] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-24T18:33:45.616061] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-24T18:33:45.637681] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:33:46.416135] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-24T18:33:47.074799] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-24T18:33:47.083564] [INFO ] [REMOTE ] EGO: Full fetch complete (72985 records). [2025-09-24T18:33:47.083746] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-24T18:33:47.084552] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:33:47.084664] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:33:47.084723] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:33:47.084793] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-24T18:33:47.084860] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-24T18:33:47.084897] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-09-24T18:33:47.085369] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-09-24T18:33:47.088035] [INFO ] [MAIN ] Update Progress: 708/2373 symbols completed. EGO took 35.0s. Estimated remaining: 3h 40m 25s. Rate: 7.6 symbols/min [2025-09-24T18:33:47.219181] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-24T18:33:47.270366] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:47.284629] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-09-24T18:33:47.285737] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T18:33:47.285805] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-09-24T18:33:47.291463] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-24T18:33:47.291663] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-24T18:33:47.291736] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-24T18:33:47.291809] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-24T18:33:47.303725] [INFO ] [REMOTE ] EFXT: Full fetch complete (44209 records). [2025-09-24T18:33:47.324836] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-24T18:33:48.028133] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T18:33:48.185726] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:48.186243] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-24T18:33:48.186402] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-24T18:33:48.188372] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-24T18:33:48.188521] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-24T18:33:48.186891] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-24T18:33:48.191290] [DEBUG] [LOCAL ] EFXT: Trimmed 44209 records to 29316 (keeping 200 days of data) [2025-09-24T18:33:48.405935] [DEBUG] [LOCAL ] EFXT: Primary data saved (29316 records). [2025-09-24T18:33:48.406105] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-24T18:33:48.406203] [INFO ] [MAIN ] Update Progress: 709/2373 symbols completed. EFXT took 39.8s. Estimated remaining: 3h 40m 1s. Rate: 7.6 symbols/min [2025-09-24T18:33:48.589906] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:48.631358] [DEBUG] [LOCAL ] EHC: Loaded 41442 existing records from primary storage. [2025-09-24T18:33:48.631508] [INFO ] [MAIN ] EHC: Loaded 41442 existing records. [2025-09-24T18:33:48.821850] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-24T18:33:48.828343] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:48.830205] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-24T18:33:48.830260] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-24T18:33:48.831337] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-24T18:33:48.831506] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-24T18:33:49.187599] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T18:33:49.233949] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:49.618087] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-24T18:33:49.619381] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T18:33:49.627461] [INFO ] [REMOTE ] EGP: Full fetch complete (45336 records). [2025-09-24T18:33:49.627631] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-24T18:33:50.016368] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-24T18:33:50.016483] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-24T18:33:50.017315] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-24T18:33:50.017385] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-24T18:33:50.019479] [DEBUG] [LOCAL ] EGP: Trimmed 45336 records to 31184 (keeping 200 days of data) [2025-09-24T18:33:50.235870] [DEBUG] [LOCAL ] EGP: Primary data saved (31184 records). [2025-09-24T18:33:50.236247] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-24T18:33:50.236439] [INFO ] [MAIN ] Update Progress: 710/2373 symbols completed. EGP took 27.6s. Estimated remaining: 3h 39m 39s. Rate: 7.6 symbols/min [2025-09-24T18:33:50.419739] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-24T18:33:50.424084] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:33:50.445878] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T18:33:50.465446] [DEBUG] [LOCAL ] EHI: Loaded 10315 existing records from primary storage. [2025-09-24T18:33:50.465585] [INFO ] [MAIN ] EHI: Loaded 10315 existing records. [2025-09-24T18:33:50.649166] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:33:50.649428] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-24T18:33:50.649489] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-24T18:33:50.650014] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-24T18:33:50.650076] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-24T18:33:51.006125] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:33:51.216067] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-24T18:33:51.561589] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T18:33:51.917720] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T18:33:51.999328] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T18:33:52.016033] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-24T18:33:52.816103] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-24T18:33:53.179326] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T18:33:53.616148] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-24T18:33:54.082804] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T18:33:54.416083] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-24T18:33:54.934340] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T18:33:55.215195] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T18:33:55.217950] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-24T18:33:56.016102] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-24T18:33:56.821197] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-24T18:33:56.835012] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T18:33:56.936175] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T18:33:57.616093] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-24T18:33:58.416152] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-24T18:33:58.705071] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T18:33:58.762985] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T18:33:59.216091] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-24T18:33:59.238377] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T18:34:00.016100] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-24T18:34:00.253076] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T18:34:00.816089] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-24T18:34:01.621215] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-24T18:34:01.642204] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T18:34:02.012324] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T18:34:02.416086] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-24T18:34:02.802525] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T18:34:03.216127] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-24T18:34:03.858694] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T18:34:04.016133] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-24T18:34:04.708042] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:34:04.816115] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-24T18:34:05.510744] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:34:05.616091] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-24T18:34:06.154765] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T18:34:06.416127] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-24T18:34:07.147958] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:34:07.216096] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-24T18:34:07.562621] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T18:34:08.016072] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-24T18:34:08.128274] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T18:34:08.816110] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-24T18:34:09.608676] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T18:34:09.616107] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-24T18:34:09.618875] [INFO ] [REMOTE ] EGY: Full fetch complete (61731 records). [2025-09-24T18:34:09.619060] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-24T18:34:10.026939] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-24T18:34:10.027046] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-24T18:34:10.027943] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-24T18:34:10.028034] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-24T18:34:10.029537] [DEBUG] [LOCAL ] EGY: Trimmed 61731 records to 42252 (keeping 200 days of data) [2025-09-24T18:34:10.282854] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T18:34:10.338153] [DEBUG] [LOCAL ] EGY: Primary data saved (42252 records). [2025-09-24T18:34:10.338403] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-24T18:34:10.338579] [INFO ] [MAIN ] Update Progress: 711/2373 symbols completed. EGY took 29.6s. Estimated remaining: 3h 39m 59s. Rate: 7.6 symbols/min [2025-09-24T18:34:10.421456] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-24T18:34:10.585888] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:10.619392] [DEBUG] [LOCAL ] EIC: Loaded 24236 existing records from primary storage. [2025-09-24T18:34:10.619613] [INFO ] [MAIN ] EIC: Loaded 24236 existing records. [2025-09-24T18:34:10.816268] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:34:10.816875] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-24T18:34:10.816945] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-24T18:34:10.818090] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-24T18:34:10.818173] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-24T18:34:11.157190] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T18:34:11.218898] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-24T18:34:11.246668] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:11.248958] [INFO ] [REMOTE ] EHAB: Full fetch complete (41554 records). [2025-09-24T18:34:11.249224] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-24T18:34:11.643286] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-24T18:34:11.643380] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-24T18:34:11.644273] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-24T18:34:11.644350] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-24T18:34:11.646820] [DEBUG] [LOCAL ] EHAB: Trimmed 41554 records to 29959 (keeping 200 days of data) [2025-09-24T18:34:11.847960] [DEBUG] [LOCAL ] EHAB: Primary data saved (29959 records). [2025-09-24T18:34:11.848109] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-24T18:34:11.848258] [INFO ] [MAIN ] Update Progress: 712/2373 symbols completed. EHAB took 24.8s. Estimated remaining: 3h 39m 36s. Rate: 7.6 symbols/min [2025-09-24T18:34:12.019761] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-24T18:34:12.050143] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:12.051231] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-24T18:34:12.060272] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-24T18:34:12.064175] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-24T18:34:12.064520] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-24T18:34:12.064680] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-24T18:34:12.066467] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-24T18:34:12.100560] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T18:34:12.220294] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T18:34:12.482499] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:12.816084] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-24T18:34:13.436496] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T18:34:13.616128] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-24T18:34:14.354092] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T18:34:14.427194] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-24T18:34:14.448966] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:34:15.216120] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-24T18:34:15.330216] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T18:34:15.744035] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T18:34:16.016101] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-24T18:34:16.467667] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T18:34:16.816081] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-24T18:34:17.616109] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-24T18:34:18.372350] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T18:34:18.416053] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-24T18:34:18.723969] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T18:34:19.216092] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-24T18:34:19.557907] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-24T18:34:19.826404] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T18:34:20.016132] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-24T18:34:20.816064] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-24T18:34:21.091710] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T18:34:21.616158] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-24T18:34:22.371468] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T18:34:22.378309] [INFO ] [REMOTE ] EHC: Full fetch complete (58911 records). [2025-09-24T18:34:22.378515] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-24T18:34:22.424409] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-24T18:34:22.797764] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-24T18:34:22.797850] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-24T18:34:22.798672] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-24T18:34:22.798738] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-24T18:34:22.802417] [DEBUG] [LOCAL ] EHC: Trimmed 58911 records to 41408 (keeping 200 days of data) [2025-09-24T18:34:22.923332] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T18:34:23.106429] [DEBUG] [LOCAL ] EHC: Primary data saved (41408 records). [2025-09-24T18:34:23.106993] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-24T18:34:23.107219] [INFO ] [MAIN ] Update Progress: 713/2373 symbols completed. EHC took 34.7s. Estimated remaining: 3h 39m 36s. Rate: 7.6 symbols/min [2025-09-24T18:34:23.221307] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-24T18:34:23.287919] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:23.288189] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-24T18:34:23.288235] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-24T18:34:23.288415] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-24T18:34:23.288458] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-24T18:34:23.288549] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-24T18:34:23.288786] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-24T18:34:23.415364] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T18:34:23.664965] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:24.016107] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-24T18:34:24.602756] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T18:34:24.621749] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T18:34:24.816117] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-24T18:34:25.616061] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-24T18:34:25.992316] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T18:34:26.058038] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T18:34:26.416093] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-24T18:34:27.219869] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-24T18:34:27.228409] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T18:34:27.233352] [INFO ] [REMOTE ] EHI: Full fetch complete (16293 records). [2025-09-24T18:34:27.233602] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-24T18:34:27.234475] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:34:27.234702] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:34:27.234800] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:34:27.234891] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-24T18:34:27.234983] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-24T18:34:27.235043] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-09-24T18:34:27.235884] [DEBUG] [LOCAL ] EHI: Deleted derivative data file. [2025-09-24T18:34:27.236086] [INFO ] [MAIN ] Update Progress: 714/2373 symbols completed. EHI took 37.0s. Estimated remaining: 3h 39m 19s. Rate: 7.6 symbols/min [2025-09-24T18:34:27.504122] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:27.504521] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-24T18:34:27.504589] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-24T18:34:27.504824] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-24T18:34:27.504878] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-24T18:34:27.504929] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-24T18:34:27.504971] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-24T18:34:28.002715] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:28.016115] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-24T18:34:28.449724] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T18:34:28.451066] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T18:34:28.816081] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-24T18:34:29.616132] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-24T18:34:29.963555] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T18:34:30.030517] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T18:34:30.416106] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-24T18:34:31.047345] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T18:34:31.216113] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-24T18:34:31.645343] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T18:34:32.016089] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-24T18:34:32.816068] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-24T18:34:33.159584] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T18:34:33.340348] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T18:34:33.616107] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-24T18:34:34.181480] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T18:34:34.416103] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-24T18:34:34.914235] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T18:34:35.216114] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-24T18:34:36.016087] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-24T18:34:36.334276] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T18:34:36.337633] [INFO ] [REMOTE ] EIC: Full fetch complete (35326 records). [2025-09-24T18:34:36.337787] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-24T18:34:36.663359] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T18:34:36.744080] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-24T18:34:36.744168] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-24T18:34:36.744870] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-24T18:34:36.744934] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-24T18:34:36.745915] [DEBUG] [LOCAL ] EIC: Trimmed 35326 records to 24078 (keeping 200 days of data) [2025-09-24T18:34:36.839574] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-24T18:34:36.903678] [DEBUG] [LOCAL ] EIC: Primary data saved (24078 records). [2025-09-24T18:34:36.903810] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-24T18:34:36.903909] [INFO ] [MAIN ] Update Progress: 715/2373 symbols completed. EIC took 26.6s. Estimated remaining: 3h 39m 16s. Rate: 7.6 symbols/min [2025-09-24T18:34:37.072602] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:37.094169] [DEBUG] [LOCAL ] EIG: Loaded 20345 existing records from primary storage. [2025-09-24T18:34:37.094289] [INFO ] [MAIN ] EIG: Loaded 20345 existing records. [2025-09-24T18:34:37.274341] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:34:37.274574] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-24T18:34:37.274619] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-24T18:34:37.275450] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-24T18:34:37.275510] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-24T18:34:37.377979] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T18:34:37.631958] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:37.626603] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-24T18:34:38.329672] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T18:34:38.416075] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-24T18:34:38.845394] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T18:34:39.216125] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-24T18:34:39.679788] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-24T18:34:40.016122] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-24T18:34:40.453940] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T18:34:40.816117] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-24T18:34:41.323789] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T18:34:41.324810] [INFO ] [REMOTE ] EICB: Full fetch complete (2672 records). [2025-09-24T18:34:41.324881] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-24T18:34:41.504509] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T18:34:41.504701] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:34:41.504776] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:34:41.504849] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-24T18:34:41.504916] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-24T18:34:41.504959] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-24T18:34:41.505074] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-24T18:34:41.505143] [INFO ] [MAIN ] Update Progress: 716/2373 symbols completed. EICB took 18.4s. Estimated remaining: 3h 38m 60s. Rate: 7.6 symbols/min [2025-09-24T18:34:41.621268] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-24T18:34:41.677277] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:34:41.736508] [DEBUG] [LOCAL ] EIX: Loaded 53345 existing records from primary storage. [2025-09-24T18:34:41.736704] [INFO ] [MAIN ] EIX: Loaded 53345 existing records. [2025-09-24T18:34:41.914019] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:34:41.914221] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-24T18:34:41.914271] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-24T18:34:41.915394] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-24T18:34:41.915455] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-24T18:34:42.283834] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:34:42.278843] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T18:34:42.416028] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-24T18:34:43.216092] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-24T18:34:43.850938] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T18:34:44.016095] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-24T18:34:44.192748] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T18:34:44.397751] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-24T18:34:44.816081] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-24T18:34:45.183310] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-24T18:34:45.616088] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-24T18:34:45.951317] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T18:34:46.416083] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-24T18:34:47.216087] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-24T18:34:47.656257] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T18:34:47.730698] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-24T18:34:48.016086] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-24T18:34:48.363941] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-24T18:34:48.816083] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-24T18:34:49.440435] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T18:34:49.616113] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-24T18:34:50.416056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-24T18:34:50.457262] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:34:51.216110] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-24T18:34:52.016067] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-24T18:34:52.043389] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T18:34:52.349460] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T18:34:52.481711] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-24T18:34:52.483762] [INFO ] [REMOTE ] EICA: Full fetch complete (1264 records). [2025-09-24T18:34:52.483961] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-24T18:34:52.671305] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-24T18:34:52.671535] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:34:52.671604] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:34:52.671700] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-24T18:34:52.671775] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-24T18:34:52.671813] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-24T18:34:52.671908] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-24T18:34:52.672022] [INFO ] [MAIN ] Update Progress: 717/2373 symbols completed. EICA took 40.8s. Estimated remaining: 3h 38m 59s. Rate: 7.6 symbols/min [2025-09-24T18:34:52.816099] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-24T18:34:53.354430] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T18:34:53.616087] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-24T18:34:54.416139] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-24T18:34:55.216164] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-24T18:34:55.400472] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T18:34:55.402269] [INFO ] [REMOTE ] EICC: Full fetch complete (7925 records). [2025-09-24T18:34:55.402340] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-24T18:34:55.402743] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:34:55.402824] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:34:55.402873] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:34:55.402933] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-24T18:34:55.403000] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-24T18:34:55.403041] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-24T18:34:55.403115] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-24T18:34:55.403193] [INFO ] [MAIN ] Update Progress: 718/2373 symbols completed. EICC took 28.2s. Estimated remaining: 3h 38m 39s. Rate: 7.6 symbols/min [2025-09-24T18:34:55.830899] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-24T18:34:56.016069] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-24T18:34:56.255172] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T18:34:56.816147] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-24T18:34:57.830171] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T18:34:57.841342] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-24T18:34:57.942015] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T18:34:58.416095] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-24T18:34:59.452013] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T18:34:59.464073] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-24T18:34:59.551203] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T18:35:00.016106] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-24T18:35:01.336834] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T18:35:01.341900] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-24T18:35:01.471938] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:35:01.616099] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-24T18:35:02.741810] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T18:35:02.746811] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-24T18:35:03.226970] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:35:03.237994] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-24T18:35:03.949321] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T18:35:04.016047] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-24T18:35:05.232540] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:35:05.244273] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-24T18:35:05.360174] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T18:35:05.364182] [INFO ] [REMOTE ] EIG: Full fetch complete (26977 records). [2025-09-24T18:35:05.364265] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-24T18:35:05.809872] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-24T18:35:05.809953] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-24T18:35:05.810505] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-24T18:35:05.810544] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-24T18:35:05.811272] [DEBUG] [LOCAL ] EIG: Trimmed 26977 records to 20314 (keeping 200 days of data) [2025-09-24T18:35:05.932869] [DEBUG] [LOCAL ] EIG: Primary data saved (20314 records). [2025-09-24T18:35:05.933004] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-24T18:35:05.933090] [INFO ] [MAIN ] Update Progress: 719/2373 symbols completed. EIG took 29.0s. Estimated remaining: 3h 38m 38s. Rate: 7.6 symbols/min [2025-09-24T18:35:07.347543] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T18:35:07.359229] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-24T18:35:09.092238] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T18:35:09.101616] [INFO ] [REMOTE ] EIX: Full fetch complete (76956 records). [2025-09-24T18:35:09.101813] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-24T18:35:09.491926] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-24T18:35:09.492017] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-24T18:35:09.492980] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-24T18:35:09.493044] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-24T18:35:09.494565] [DEBUG] [LOCAL ] EIX: Trimmed 76956 records to 53339 (keeping 200 days of data) [2025-09-24T18:35:09.812500] [DEBUG] [LOCAL ] EIX: Primary data saved (53339 records). [2025-09-24T18:35:09.812660] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-24T18:35:09.812768] [INFO ] [MAIN ] Update Progress: 720/2373 symbols completed. EIX took 28.3s. Estimated remaining: 3h 38m 20s. Rate: 7.6 symbols/min [2025-09-24T18:35:10.457083] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:10.524141] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:10.527622] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:10.546288] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:10.556380] [DEBUG] [LOCAL ] ELC: Loaded 3497 existing records from primary storage. [2025-09-24T18:35:10.556671] [INFO ] [MAIN ] ELC: Loaded 3497 existing records. [2025-09-24T18:35:10.762624] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:10.777238] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-24T18:35:10.777549] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-24T18:35:10.791843] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-24T18:35:10.810597] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-24T18:35:10.810500] [DEBUG] [LOCAL ] ELF: Loaded 52288 existing records from primary storage. [2025-09-24T18:35:10.815913] [INFO ] [MAIN ] ELF: Loaded 52288 existing records. [2025-09-24T18:35:11.043300] [DEBUG] [LOCAL ] ELAN: Loaded 53196 existing records from primary storage. [2025-09-24T18:35:11.069280] [INFO ] [MAIN ] ELAN: Loaded 53196 existing records. [2025-09-24T18:35:11.110830] [DEBUG] [LOCAL ] EL: Loaded 53403 existing records from primary storage. [2025-09-24T18:35:11.255802] [INFO ] [MAIN ] EL: Loaded 53403 existing records. [2025-09-24T18:35:11.494825] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:11.537861] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-24T18:35:11.547831] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-24T18:35:11.557078] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:11.568021] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-24T18:35:11.614382] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-24T18:35:11.591063] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-24T18:35:11.619734] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-24T18:35:11.730512] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-24T18:35:11.736018] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:11.751889] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-24T18:35:11.746737] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-24T18:35:12.033157] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:12.052694] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-24T18:35:12.068133] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-24T18:35:12.081746] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-24T18:35:12.105936] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-24T18:35:12.708703] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:12.757572] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:12.767590] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-24T18:35:12.767367] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-24T18:35:12.859691] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T18:35:12.867416] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-24T18:35:12.942127] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:12.942472] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-24T18:35:13.553235] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T18:35:13.554941] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-24T18:35:14.040367] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T18:35:14.041754] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-24T18:35:14.587504] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T18:35:14.589882] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-24T18:35:14.594092] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T18:35:14.611091] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-24T18:35:14.683926] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T18:35:14.694420] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-24T18:35:14.765970] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T18:35:14.777055] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-24T18:35:15.330500] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T18:35:15.332099] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-24T18:35:16.172497] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T18:35:16.174609] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-24T18:35:16.213181] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T18:35:16.480039] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T18:35:16.532788] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T18:35:16.743698] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T18:35:16.816120] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-24T18:35:17.616090] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-24T18:35:18.185157] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T18:35:18.416074] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-24T18:35:18.459805] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T18:35:18.948623] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-24T18:35:19.216121] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-24T18:35:20.016111] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-24T18:35:20.816108] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-24T18:35:21.176983] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T18:35:21.398435] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T18:35:21.399845] [INFO ] [REMOTE ] ELC: Full fetch complete (5152 records). [2025-09-24T18:35:21.399949] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-24T18:35:21.621929] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-24T18:35:21.799069] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-24T18:35:21.799157] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-24T18:35:21.799335] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-24T18:35:21.799374] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-24T18:35:21.799814] [DEBUG] [LOCAL ] ELC: Trimmed 5152 records to 3493 (keeping 200 days of data) [2025-09-24T18:35:21.822752] [DEBUG] [LOCAL ] ELC: Primary data saved (3493 records). [2025-09-24T18:35:21.822866] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-24T18:35:21.822951] [INFO ] [MAIN ] Update Progress: 721/2373 symbols completed. ELC took 12.0s. Estimated remaining: 3h 38m 22s. Rate: 7.6 symbols/min [2025-09-24T18:35:22.000350] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:22.040789] [DEBUG] [LOCAL ] ELME: Loaded 39265 existing records from primary storage. [2025-09-24T18:35:22.040941] [INFO ] [MAIN ] ELME: Loaded 39265 existing records. [2025-09-24T18:35:22.235483] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:22.252355] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-24T18:35:22.252675] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-24T18:35:22.254260] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-24T18:35:22.254411] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-24T18:35:22.264966] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-24T18:35:22.421205] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-24T18:35:22.654268] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:23.057752] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T18:35:23.216086] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-24T18:35:24.016100] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-24T18:35:24.566622] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-24T18:35:24.816061] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-24T18:35:25.034592] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:35:25.616103] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-24T18:35:25.799042] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T18:35:26.416117] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-24T18:35:27.043529] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T18:35:27.157828] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-24T18:35:27.216041] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-24T18:35:27.724895] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T18:35:28.016078] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-24T18:35:28.816100] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-24T18:35:29.418739] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-24T18:35:29.616103] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-24T18:35:30.287140] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T18:35:30.357959] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-24T18:35:30.416085] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-24T18:35:31.216054] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-24T18:35:31.680797] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-24T18:35:31.941220] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T18:35:32.016040] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-24T18:35:32.816054] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-24T18:35:32.861777] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:35:33.616082] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-24T18:35:33.964296] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T18:35:34.416138] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-24T18:35:34.776234] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T18:35:35.216135] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-24T18:35:35.609392] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:35:36.016058] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-24T18:35:36.124741] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T18:35:36.554774] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T18:35:36.816082] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-24T18:35:37.616138] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-24T18:35:37.769503] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T18:35:38.416167] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-24T18:35:38.980615] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-24T18:35:39.016031] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T18:35:39.216164] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-24T18:35:40.016100] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-24T18:35:40.391389] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T18:35:40.493529] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-24T18:35:40.503403] [INFO ] [REMOTE ] EL: Full fetch complete (77333 records). [2025-09-24T18:35:40.503556] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-24T18:35:40.821195] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-24T18:35:40.939885] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-24T18:35:40.939977] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-24T18:35:40.941578] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-24T18:35:40.941679] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-24T18:35:40.943340] [DEBUG] [LOCAL ] EL: Trimmed 77333 records to 53403 (keeping 200 days of data) [2025-09-24T18:35:41.284364] [DEBUG] [LOCAL ] EL: Primary data saved (53403 records). [2025-09-24T18:35:41.284518] [INFO ] [MAIN ] EL: Full history saved. [2025-09-24T18:35:41.284609] [INFO ] [MAIN ] Update Progress: 722/2373 symbols completed. EL took 31.5s. Estimated remaining: 3h 38m 40s. Rate: 7.6 symbols/min [2025-09-24T18:35:41.455987] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:41.484674] [DEBUG] [LOCAL ] ELP: Loaded 25828 existing records from primary storage. [2025-09-24T18:35:41.484817] [INFO ] [MAIN ] ELP: Loaded 25828 existing records. [2025-09-24T18:35:41.619547] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-24T18:35:41.687500] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:41.688047] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-24T18:35:41.688169] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-24T18:35:41.688958] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-24T18:35:41.689100] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-24T18:35:41.810764] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T18:35:41.857949] [INFO ] [REMOTE ] ELAN: Full fetch complete (76857 records). [2025-09-24T18:35:41.868393] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-24T18:35:42.442562] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:42.461585] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-24T18:35:42.599955] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-24T18:35:42.601600] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T18:35:42.600488] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-24T18:35:42.611522] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-24T18:35:42.612096] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-24T18:35:42.613978] [DEBUG] [LOCAL ] ELAN: Trimmed 76857 records to 53207 (keeping 200 days of data) [2025-09-24T18:35:42.944924] [DEBUG] [LOCAL ] ELAN: Primary data saved (53207 records). [2025-09-24T18:35:42.945089] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-24T18:35:42.945198] [INFO ] [MAIN ] Update Progress: 723/2373 symbols completed. ELAN took 33.1s. Estimated remaining: 3h 38m 18s. Rate: 7.6 symbols/min [2025-09-24T18:35:43.113633] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:43.113868] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-24T18:35:43.113922] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-24T18:35:43.114063] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-24T18:35:43.114107] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-24T18:35:43.114159] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-24T18:35:43.114192] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-24T18:35:43.217829] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-24T18:35:43.477278] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:44.002076] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-24T18:35:44.016028] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-24T18:35:44.071547] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T18:35:44.816051] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-24T18:35:44.854216] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T18:35:45.425587] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T18:35:45.616057] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-24T18:35:45.981138] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-24T18:35:46.039779] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T18:35:46.416095] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-24T18:35:47.216097] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-24T18:35:47.576812] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T18:35:48.016077] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-24T18:35:48.816068] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-24T18:35:49.162615] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T18:35:49.165372] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T18:35:49.315924] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T18:35:49.616090] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-24T18:35:50.416098] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-24T18:35:51.216062] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-24T18:35:51.532617] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T18:35:51.550800] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T18:35:51.557003] [INFO ] [REMOTE ] ELF: Full fetch complete (75372 records). [2025-09-24T18:35:51.557127] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-24T18:35:51.944970] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-24T18:35:51.945066] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-24T18:35:51.946092] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-24T18:35:51.946158] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-24T18:35:51.947704] [DEBUG] [LOCAL ] ELF: Trimmed 75372 records to 52280 (keeping 200 days of data) [2025-09-24T18:35:52.032666] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-24T18:35:52.266226] [DEBUG] [LOCAL ] ELF: Primary data saved (52280 records). [2025-09-24T18:35:52.266402] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-24T18:35:52.269072] [INFO ] [MAIN ] Update Progress: 724/2373 symbols completed. ELF took 42.4s. Estimated remaining: 3h 38m 13s. Rate: 7.6 symbols/min [2025-09-24T18:35:52.440564] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-24T18:35:52.443969] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:52.504494] [DEBUG] [LOCAL ] ELS: Loaded 49399 existing records from primary storage. [2025-09-24T18:35:52.504637] [INFO ] [MAIN ] ELS: Loaded 49399 existing records. [2025-09-24T18:35:52.694454] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:52.712992] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-24T18:35:52.713128] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-24T18:35:52.714572] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T18:35:52.721533] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-24T18:35:52.722087] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-24T18:35:52.755544] [INFO ] [REMOTE ] ELME: Full fetch complete (55744 records). [2025-09-24T18:35:52.788716] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-24T18:35:52.821145] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-24T18:35:53.448416] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:53.540042] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-24T18:35:53.540132] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-24T18:35:53.540983] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-24T18:35:53.541048] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-24T18:35:53.542316] [DEBUG] [LOCAL ] ELME: Trimmed 55744 records to 39255 (keeping 200 days of data) [2025-09-24T18:35:53.631688] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-24T18:35:53.790202] [DEBUG] [LOCAL ] ELME: Primary data saved (39255 records). [2025-09-24T18:35:53.790375] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-24T18:35:53.790473] [INFO ] [MAIN ] Update Progress: 725/2373 symbols completed. ELME took 32.0s. Estimated remaining: 3h 37m 51s. Rate: 7.6 symbols/min [2025-09-24T18:35:53.962690] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:54.020463] [DEBUG] [LOCAL ] ELV: Loaded 50571 existing records from primary storage. [2025-09-24T18:35:54.020701] [INFO ] [MAIN ] ELV: Loaded 50571 existing records. [2025-09-24T18:35:54.207273] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:35:54.228519] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-24T18:35:54.228716] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-24T18:35:54.230299] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:35:54.235841] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-24T18:35:54.236360] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-24T18:35:54.424056] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-24T18:35:54.592704] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:35:54.974365] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T18:35:55.216143] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-24T18:35:55.337963] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:35:56.016158] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-24T18:35:56.494443] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T18:35:56.495395] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:35:56.816119] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-24T18:35:57.139302] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-24T18:35:57.616093] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-24T18:35:57.947970] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T18:35:58.416101] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-24T18:35:58.789570] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-24T18:35:59.216093] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-24T18:35:59.810843] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T18:35:59.811517] [INFO ] [REMOTE ] ELPC: Full fetch complete (1483 records). [2025-09-24T18:35:59.811585] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-24T18:35:59.811995] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:35:59.812079] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:35:59.812137] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:35:59.812227] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-24T18:35:59.812321] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-24T18:35:59.812390] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-24T18:35:59.812481] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-24T18:35:59.812576] [INFO ] [MAIN ] Update Progress: 726/2373 symbols completed. ELPC took 16.9s. Estimated remaining: 3h 37m 38s. Rate: 7.6 symbols/min [2025-09-24T18:35:59.992285] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:35:59.992469] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-24T18:35:59.992524] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-24T18:35:59.992725] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-24T18:35:59.992793] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-24T18:35:59.992866] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-24T18:35:59.992931] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-24T18:36:00.021313] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-24T18:36:00.385795] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:00.816102] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-24T18:36:01.616105] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-24T18:36:02.128217] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T18:36:02.258207] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T18:36:02.416103] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-24T18:36:03.216127] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-24T18:36:04.016104] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-24T18:36:05.477282] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:36:05.477617] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-24T18:36:05.478090] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-24T18:36:06.732077] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:36:06.732580] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-24T18:36:06.733445] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-24T18:36:06.950480] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:36:06.950849] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-24T18:36:06.951327] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-24T18:36:07.086960] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-24T18:36:07.216062] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-24T18:36:07.254581] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (5.64 seconds). [2025-09-24T18:36:07.448759] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:36:07.449110] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-24T18:36:08.016133] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-24T18:36:08.230350] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:36:08.230715] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-24T18:36:08.624428] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (6.21 seconds). [2025-09-24T18:36:08.816098] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-24T18:36:09.107255] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T18:36:09.616096] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-24T18:36:09.980779] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:36:10.416119] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-24T18:36:11.075315] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T18:36:11.216087] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-24T18:36:11.640561] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T18:36:11.645102] [INFO ] [REMOTE ] ELP: Full fetch complete (37619 records). [2025-09-24T18:36:11.645334] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-24T18:36:12.024750] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-24T18:36:12.034261] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-24T18:36:12.035096] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-24T18:36:12.035832] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-24T18:36:12.035985] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-24T18:36:12.036983] [DEBUG] [LOCAL ] ELP: Trimmed 37619 records to 25783 (keeping 200 days of data) [2025-09-24T18:36:12.195538] [DEBUG] [LOCAL ] ELP: Primary data saved (25783 records). [2025-09-24T18:36:12.195790] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-24T18:36:12.195959] [INFO ] [MAIN ] Update Progress: 727/2373 symbols completed. ELP took 30.9s. Estimated remaining: 3h 37m 40s. Rate: 7.6 symbols/min [2025-09-24T18:36:12.375893] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:12.397451] [DEBUG] [LOCAL ] EMD: Loaded 21115 existing records from primary storage. [2025-09-24T18:36:12.397590] [INFO ] [MAIN ] EMD: Loaded 21115 existing records. [2025-09-24T18:36:12.581510] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:36:12.584183] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T18:36:12.585551] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-24T18:36:12.585731] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-24T18:36:12.586523] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-24T18:36:12.586595] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-24T18:36:12.822761] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-24T18:36:12.970524] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:13.006187] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T18:36:13.616174] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-24T18:36:14.416084] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-24T18:36:14.454393] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:36:15.216101] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-24T18:36:16.016131] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-24T18:36:16.227284] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-24T18:36:16.265020] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T18:36:16.337885] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T18:36:16.815515] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T18:36:16.818696] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-24T18:36:17.616063] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-24T18:36:17.914848] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T18:36:18.416060] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-24T18:36:18.631496] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T18:36:19.216095] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-24T18:36:20.016084] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-24T18:36:20.199184] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T18:36:20.816085] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-24T18:36:21.034834] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T18:36:21.085026] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T18:36:21.616089] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-24T18:36:22.416112] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-24T18:36:22.679841] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T18:36:22.905083] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T18:36:23.216084] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-24T18:36:24.016124] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-24T18:36:24.220790] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:36:24.254871] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T18:36:24.816098] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-24T18:36:24.840973] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T18:36:24.844694] [INFO ] [REMOTE ] EMA: Full fetch complete (8068 records). [2025-09-24T18:36:24.844812] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-24T18:36:25.046804] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-24T18:36:25.047084] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:36:25.047173] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:36:25.047285] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-24T18:36:25.047416] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-24T18:36:25.047490] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-24T18:36:25.047575] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-24T18:36:25.047705] [INFO ] [MAIN ] Update Progress: 728/2373 symbols completed. EMA took 25.2s. Estimated remaining: 3h 37m 44s. Rate: 7.6 symbols/min [2025-09-24T18:36:25.236509] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:25.285214] [DEBUG] [LOCAL ] EME: Loaded 31702 existing records from primary storage. [2025-09-24T18:36:25.285369] [INFO ] [MAIN ] EME: Loaded 31702 existing records. [2025-09-24T18:36:25.463259] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:36:25.463706] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-24T18:36:25.463781] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-24T18:36:25.464932] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-24T18:36:25.465015] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-24T18:36:25.622756] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-24T18:36:25.827259] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:26.416116] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-24T18:36:26.903449] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:36:26.918949] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T18:36:26.929801] [INFO ] [REMOTE ] ELS: Full fetch complete (70548 records). [2025-09-24T18:36:26.929979] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-24T18:36:27.225582] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-24T18:36:27.403441] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-24T18:36:27.403569] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-24T18:36:27.404842] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-24T18:36:27.404953] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-24T18:36:27.409495] [DEBUG] [LOCAL ] ELS: Trimmed 70548 records to 49387 (keeping 200 days of data) [2025-09-24T18:36:27.742067] [DEBUG] [LOCAL ] ELS: Primary data saved (49387 records). [2025-09-24T18:36:27.742326] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-24T18:36:27.742580] [INFO ] [MAIN ] Update Progress: 729/2373 symbols completed. ELS took 35.5s. Estimated remaining: 3h 37m 24s. Rate: 7.6 symbols/min [2025-09-24T18:36:27.919777] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:27.927074] [DEBUG] [LOCAL ] EMF: Loaded 3595 existing records from primary storage. [2025-09-24T18:36:27.927157] [INFO ] [MAIN ] EMF: Loaded 3595 existing records. [2025-09-24T18:36:28.024548] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-24T18:36:28.108623] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:36:28.108874] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-24T18:36:28.108922] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-24T18:36:28.109209] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-24T18:36:28.109283] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-24T18:36:28.489599] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:28.503703] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T18:36:28.542576] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-24T18:36:28.816087] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-24T18:36:29.448431] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T18:36:29.616100] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-24T18:36:29.945164] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T18:36:30.416146] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-24T18:36:31.216067] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-24T18:36:31.310213] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T18:36:31.573449] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T18:36:32.016136] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-24T18:36:32.295767] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T18:36:32.816123] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-24T18:36:33.617625] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-24T18:36:33.620600] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T18:36:33.980600] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T18:36:33.984821] [INFO ] [REMOTE ] EMD: Full fetch complete (32215 records). [2025-09-24T18:36:33.984902] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-24T18:36:34.362894] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-24T18:36:34.362975] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-24T18:36:34.363636] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-24T18:36:34.363719] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-24T18:36:34.365716] [DEBUG] [LOCAL ] EMD: Trimmed 32215 records to 21032 (keeping 200 days of data) [2025-09-24T18:36:34.431576] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-24T18:36:34.522041] [DEBUG] [LOCAL ] EMD: Primary data saved (21032 records). [2025-09-24T18:36:34.522277] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-24T18:36:34.522470] [INFO ] [MAIN ] Update Progress: 730/2373 symbols completed. EMD took 22.3s. Estimated remaining: 3h 37m 13s. Rate: 7.6 symbols/min [2025-09-24T18:36:34.702502] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:34.758306] [DEBUG] [LOCAL ] EMN: Loaded 50354 existing records from primary storage. [2025-09-24T18:36:34.758441] [INFO ] [MAIN ] EMN: Loaded 50354 existing records. [2025-09-24T18:36:34.938273] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:36:34.938788] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-24T18:36:34.938866] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-24T18:36:34.940618] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-24T18:36:34.940710] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-24T18:36:35.219513] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-24T18:36:35.324731] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:35.327195] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T18:36:36.016067] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-24T18:36:36.067859] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T18:36:36.439310] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T18:36:36.816131] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-24T18:36:37.459338] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T18:36:37.616058] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-24T18:36:37.685881] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T18:36:38.416105] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-24T18:36:39.168809] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T18:36:39.216070] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-24T18:36:39.343270] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:36:40.016116] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-24T18:36:40.816063] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-24T18:36:41.171959] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T18:36:41.616078] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-24T18:36:41.747550] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T18:36:42.421386] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-24T18:36:42.437161] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T18:36:43.216043] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-24T18:36:43.256213] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T18:36:43.741908] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-24T18:36:43.751026] [INFO ] [REMOTE ] ELV: Full fetch complete (73231 records). [2025-09-24T18:36:43.751161] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-24T18:36:44.025190] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-24T18:36:44.159852] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-24T18:36:44.159997] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-24T18:36:44.160998] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-24T18:36:44.161063] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-24T18:36:44.165546] [DEBUG] [LOCAL ] ELV: Trimmed 73231 records to 50586 (keeping 200 days of data) [2025-09-24T18:36:44.501714] [DEBUG] [LOCAL ] ELV: Primary data saved (50586 records). [2025-09-24T18:36:44.502187] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-24T18:36:44.502390] [INFO ] [MAIN ] Update Progress: 731/2373 symbols completed. ELV took 50.7s. Estimated remaining: 3h 37m 10s. Rate: 7.6 symbols/min [2025-09-24T18:36:44.683476] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T18:36:44.702992] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:44.712674] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-09-24T18:36:44.712741] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-09-24T18:36:44.712927] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-24T18:36:44.712970] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-24T18:36:44.713012] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-24T18:36:44.713044] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-24T18:36:44.821202] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-24T18:36:45.070269] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:45.345115] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T18:36:45.616090] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-24T18:36:45.661947] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T18:36:46.416083] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-24T18:36:47.216036] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-24T18:36:47.332478] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:36:47.429134] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T18:36:47.689464] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T18:36:48.016091] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-24T18:36:48.816098] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-24T18:36:49.312298] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T18:36:49.596639] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T18:36:49.616063] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-24T18:36:50.385241] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T18:36:50.416066] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-24T18:36:51.216110] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-24T18:36:51.249593] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T18:36:51.798371] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T18:36:52.016120] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-24T18:36:52.427560] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T18:36:52.816118] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-24T18:36:53.616090] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-24T18:36:54.245351] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T18:36:54.416042] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-24T18:36:54.494623] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T18:36:55.060457] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T18:36:55.062113] [INFO ] [REMOTE ] EMF: Full fetch complete (7331 records). [2025-09-24T18:36:55.062187] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-24T18:36:55.221151] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-24T18:36:55.433712] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-24T18:36:55.433814] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-24T18:36:55.434109] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-24T18:36:55.434151] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-24T18:36:55.434559] [DEBUG] [LOCAL ] EMF: Trimmed 7331 records to 3547 (keeping 200 days of data) [2025-09-24T18:36:55.456891] [DEBUG] [LOCAL ] EMF: Primary data saved (3547 records). [2025-09-24T18:36:55.456972] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-24T18:36:55.457049] [INFO ] [MAIN ] Update Progress: 732/2373 symbols completed. EMF took 27.7s. Estimated remaining: 3h 37m 9s. Rate: 7.6 symbols/min [2025-09-24T18:36:55.632774] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:36:55.633021] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-09-24T18:36:55.633097] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-09-24T18:36:55.633294] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-24T18:36:55.633356] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-24T18:36:55.633401] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-24T18:36:55.633436] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-24T18:36:56.000713] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:36:56.016036] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-24T18:36:56.092593] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:36:56.816072] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-24T18:36:56.829528] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T18:36:57.616081] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-24T18:36:58.310574] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:36:58.416040] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-24T18:36:59.206400] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:36:59.217128] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-24T18:36:59.673726] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T18:36:59.698877] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T18:37:00.016092] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-24T18:37:00.816123] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-24T18:37:01.443631] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T18:37:01.616155] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-24T18:37:02.172369] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T18:37:02.176716] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-24T18:37:02.416085] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-24T18:37:03.137093] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T18:37:03.216085] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-24T18:37:04.016048] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-24T18:37:04.079855] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T18:37:04.816086] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-24T18:37:05.514818] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T18:37:05.521102] [INFO ] [REMOTE ] EME: Full fetch complete (46991 records). [2025-09-24T18:37:05.521226] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-24T18:37:05.623081] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-24T18:37:05.922812] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T18:37:05.943209] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-24T18:37:05.943685] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-24T18:37:05.944822] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-24T18:37:05.945303] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-24T18:37:05.946629] [DEBUG] [LOCAL ] EME: Trimmed 46991 records to 31647 (keeping 200 days of data) [2025-09-24T18:37:06.168423] [DEBUG] [LOCAL ] EME: Primary data saved (31647 records). [2025-09-24T18:37:06.168580] [INFO ] [MAIN ] EME: Full history saved. [2025-09-24T18:37:06.168703] [INFO ] [MAIN ] Update Progress: 733/2373 symbols completed. EME took 41.1s. Estimated remaining: 3h 37m 7s. Rate: 7.6 symbols/min [2025-09-24T18:37:06.354397] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:06.414273] [DEBUG] [LOCAL ] EMR: Loaded 53256 existing records from primary storage. [2025-09-24T18:37:06.414456] [INFO ] [MAIN ] EMR: Loaded 53256 existing records. [2025-09-24T18:37:06.425899] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-24T18:37:06.617727] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:06.618032] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-24T18:37:06.618087] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-24T18:37:06.620369] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-24T18:37:06.620433] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-24T18:37:07.015951] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:07.183572] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T18:37:07.185100] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:37:07.216030] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-24T18:37:08.016126] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-24T18:37:08.814990] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T18:37:08.818767] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-24T18:37:09.028901] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T18:37:09.616056] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-24T18:37:09.885630] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T18:37:09.889288] [INFO ] [REMOTE ] EMO: Full fetch complete (17088 records). [2025-09-24T18:37:09.889363] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-24T18:37:10.311023] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-24T18:37:10.311155] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-24T18:37:10.311741] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-24T18:37:10.311842] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-24T18:37:10.312928] [DEBUG] [LOCAL ] EMO: Trimmed 17088 records to 12415 (keeping 200 days of data) [2025-09-24T18:37:10.398100] [DEBUG] [LOCAL ] EMO: Primary data saved (12415 records). [2025-09-24T18:37:10.398322] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-24T18:37:10.398483] [INFO ] [MAIN ] Update Progress: 734/2373 symbols completed. EMO took 25.9s. Estimated remaining: 3h 36m 51s. Rate: 7.6 symbols/min [2025-09-24T18:37:10.421275] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-24T18:37:10.599872] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:10.662836] [DEBUG] [LOCAL ] ENB: Loaded 53518 existing records from primary storage. [2025-09-24T18:37:10.663281] [INFO ] [MAIN ] ENB: Loaded 53518 existing records. [2025-09-24T18:37:10.857267] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:10.857604] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-24T18:37:10.857691] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-24T18:37:10.860197] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-24T18:37:10.860261] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-24T18:37:11.217908] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-24T18:37:11.278596] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:11.343847] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:37:11.750543] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-24T18:37:12.016100] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-24T18:37:12.298850] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T18:37:12.816125] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-24T18:37:13.616091] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-24T18:37:13.755943] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T18:37:14.198552] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T18:37:14.416116] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-24T18:37:15.167375] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-24T18:37:15.182770] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T18:37:15.216091] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-24T18:37:16.018854] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-24T18:37:16.019122] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T18:37:16.021515] [INFO ] [REMOTE ] EMP: Full fetch complete (4288 records). [2025-09-24T18:37:16.021628] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-24T18:37:16.410370] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-24T18:37:16.410455] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-24T18:37:16.410621] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-24T18:37:16.410693] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-24T18:37:16.411096] [DEBUG] [LOCAL ] EMP: Trimmed 4288 records to 3041 (keeping 200 days of data) [2025-09-24T18:37:16.429820] [DEBUG] [LOCAL ] EMP: Primary data saved (3041 records). [2025-09-24T18:37:16.429905] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-24T18:37:16.429978] [INFO ] [MAIN ] Update Progress: 735/2373 symbols completed. EMP took 21.0s. Estimated remaining: 3h 36m 39s. Rate: 7.6 symbols/min [2025-09-24T18:37:16.613988] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:16.618836] [DEBUG] [LOCAL ] ENFY: Loaded 3059 existing records from primary storage. [2025-09-24T18:37:16.618921] [INFO ] [MAIN ] ENFY: Loaded 3059 existing records. [2025-09-24T18:37:16.811059] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:16.811325] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-24T18:37:16.811375] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-24T18:37:16.811714] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-24T18:37:16.811790] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-24T18:37:16.823571] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-24T18:37:17.213019] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:17.616068] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-24T18:37:17.986433] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T18:37:17.997241] [INFO ] [REMOTE ] EMN: Full fetch complete (71944 records). [2025-09-24T18:37:17.997417] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-24T18:37:18.321851] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T18:37:18.421880] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-24T18:37:18.427206] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-24T18:37:18.427483] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-24T18:37:18.429039] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-24T18:37:18.429320] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-24T18:37:18.433375] [DEBUG] [LOCAL ] EMN: Trimmed 71944 records to 50362 (keeping 200 days of data) [2025-09-24T18:37:18.585182] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T18:37:18.821183] [DEBUG] [LOCAL ] EMN: Primary data saved (50362 records). [2025-09-24T18:37:18.821346] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-24T18:37:18.821437] [INFO ] [MAIN ] Update Progress: 736/2373 symbols completed. EMN took 44.3s. Estimated remaining: 3h 36m 18s. Rate: 7.6 symbols/min [2025-09-24T18:37:18.999292] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:18.999540] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-09-24T18:37:18.999608] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-09-24T18:37:18.999812] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-24T18:37:18.999866] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-24T18:37:18.999925] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-24T18:37:18.999977] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-24T18:37:19.221358] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-24T18:37:19.374150] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:20.016075] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-24T18:37:20.251601] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T18:37:20.679937] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T18:37:20.816046] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-24T18:37:21.222689] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T18:37:21.433374] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T18:37:21.616054] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-24T18:37:22.046104] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-24T18:37:22.416102] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-24T18:37:23.216167] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-24T18:37:23.580610] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-24T18:37:24.016154] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-24T18:37:24.065448] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:37:24.549174] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T18:37:24.816100] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-24T18:37:25.616106] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-24T18:37:26.416096] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-24T18:37:26.751096] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T18:37:26.767531] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T18:37:27.216071] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-24T18:37:27.660401] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T18:37:28.016121] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-24T18:37:28.816101] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-24T18:37:29.084897] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:37:29.474939] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T18:37:29.616062] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-24T18:37:29.809663] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:37:30.416100] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-24T18:37:30.888809] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T18:37:31.216064] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-24T18:37:31.344157] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T18:37:31.739637] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T18:37:31.740819] [INFO ] [REMOTE ] ENFY: Full fetch complete (5595 records). [2025-09-24T18:37:31.740891] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-24T18:37:31.741302] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:37:31.741416] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:37:31.741467] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:37:31.741537] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-24T18:37:31.741602] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-24T18:37:31.741658] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-09-24T18:37:31.742103] [DEBUG] [LOCAL ] ENFY: Deleted derivative data file. [2025-09-24T18:37:31.742204] [INFO ] [MAIN ] Update Progress: 737/2373 symbols completed. ENFY took 15.3s. Estimated remaining: 3h 36m 22s. Rate: 7.6 symbols/min [2025-09-24T18:37:31.914246] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:31.917876] [DEBUG] [LOCAL ] ENO: Loaded 1954 existing records from primary storage. [2025-09-24T18:37:31.917989] [INFO ] [MAIN ] ENO: Loaded 1954 existing records. [2025-09-24T18:37:32.016288] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-24T18:37:32.098823] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:32.099077] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-24T18:37:32.099126] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-24T18:37:32.099333] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-24T18:37:32.099393] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-24T18:37:32.449551] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:32.816079] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-24T18:37:33.616100] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-24T18:37:34.003417] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T18:37:34.152407] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T18:37:34.416083] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-24T18:37:35.155515] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T18:37:35.216061] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-24T18:37:35.468820] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T18:37:36.016057] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-24T18:37:36.286227] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T18:37:36.326196] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-24T18:37:36.816098] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-24T18:37:37.616109] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-24T18:37:38.416237] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-24T18:37:38.827259] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:37:38.860367] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T18:37:39.216088] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-24T18:37:40.016093] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-24T18:37:40.430912] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T18:37:40.596841] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:37:40.816121] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-24T18:37:41.470361] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T18:37:41.616077] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-24T18:37:42.416100] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-24T18:37:42.605740] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T18:37:43.111476] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T18:37:43.216079] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-24T18:37:44.016048] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-24T18:37:44.186144] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T18:37:44.196358] [INFO ] [REMOTE ] EMR: Full fetch complete (77104 records). [2025-09-24T18:37:44.196519] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-24T18:37:44.609346] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-24T18:37:44.609626] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-24T18:37:44.610694] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-24T18:37:44.610779] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-24T18:37:44.613201] [DEBUG] [LOCAL ] EMR: Trimmed 77104 records to 53249 (keeping 200 days of data) [2025-09-24T18:37:44.732514] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T18:37:44.831632] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-24T18:37:44.989242] [DEBUG] [LOCAL ] EMR: Primary data saved (53249 records). [2025-09-24T18:37:44.989396] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-24T18:37:44.989496] [INFO ] [MAIN ] Update Progress: 738/2373 symbols completed. EMR took 38.8s. Estimated remaining: 3h 36m 25s. Rate: 7.6 symbols/min [2025-09-24T18:37:45.158949] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:45.204184] [DEBUG] [LOCAL ] ENOV: Loaded 45210 existing records from primary storage. [2025-09-24T18:37:45.204362] [INFO ] [MAIN ] ENOV: Loaded 45210 existing records. [2025-09-24T18:37:45.389091] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:45.389374] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-24T18:37:45.389424] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-24T18:37:45.390695] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-24T18:37:45.390757] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-24T18:37:45.617635] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-24T18:37:45.759564] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:45.789886] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T18:37:46.140032] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T18:37:46.297467] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T18:37:46.416041] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-24T18:37:46.944119] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T18:37:47.216147] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-24T18:37:48.016129] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-24T18:37:48.545955] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T18:37:48.816131] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-24T18:37:49.364087] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T18:37:49.616103] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-24T18:37:49.827452] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T18:37:49.836798] [INFO ] [REMOTE ] ENB: Full fetch complete (77490 records). [2025-09-24T18:37:49.836931] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-24T18:37:50.122356] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T18:37:50.248941] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-24T18:37:50.249033] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-24T18:37:50.250051] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-24T18:37:50.250118] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-24T18:37:50.252418] [DEBUG] [LOCAL ] ENB: Trimmed 77490 records to 53516 (keeping 200 days of data) [2025-09-24T18:37:50.441529] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-24T18:37:50.598120] [DEBUG] [LOCAL ] ENB: Primary data saved (53516 records). [2025-09-24T18:37:50.598261] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-24T18:37:50.598348] [INFO ] [MAIN ] Update Progress: 739/2373 symbols completed. ENB took 40.2s. Estimated remaining: 3h 36m 12s. Rate: 7.6 symbols/min [2025-09-24T18:37:50.769463] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:50.813478] [DEBUG] [LOCAL ] ENR: Loaded 42760 existing records from primary storage. [2025-09-24T18:37:50.813673] [INFO ] [MAIN ] ENR: Loaded 42760 existing records. [2025-09-24T18:37:50.995969] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:50.996223] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-24T18:37:50.996273] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-24T18:37:50.997477] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-24T18:37:50.997541] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-24T18:37:51.221231] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-24T18:37:51.380939] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:51.844384] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T18:37:52.016082] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-24T18:37:52.816090] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-24T18:37:52.840028] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T18:37:53.311549] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T18:37:53.402756] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T18:37:53.408824] [INFO ] [REMOTE ] ENIC: Full fetch complete (51315 records). [2025-09-24T18:37:53.408937] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-24T18:37:53.621485] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-24T18:37:53.801257] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-24T18:37:53.801370] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-24T18:37:53.802281] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-24T18:37:53.802349] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-24T18:37:53.803668] [DEBUG] [LOCAL ] ENIC: Trimmed 51315 records to 36528 (keeping 200 days of data) [2025-09-24T18:37:54.022309] [DEBUG] [LOCAL ] ENIC: Primary data saved (36528 records). [2025-09-24T18:37:54.022547] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-24T18:37:54.022674] [INFO ] [MAIN ] Update Progress: 740/2373 symbols completed. ENIC took 35.2s. Estimated remaining: 3h 35m 54s. Rate: 7.6 symbols/min [2025-09-24T18:37:54.143448] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T18:37:54.237255] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:54.273510] [DEBUG] [LOCAL ] ENS: Loaded 29449 existing records from primary storage. [2025-09-24T18:37:54.273682] [INFO ] [MAIN ] ENS: Loaded 29449 existing records. [2025-09-24T18:37:54.421248] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-24T18:37:54.463825] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:54.464088] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-24T18:37:54.464138] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-24T18:37:54.465041] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-24T18:37:54.465134] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-24T18:37:54.834381] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:54.873807] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T18:37:55.216087] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-24T18:37:56.016118] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-24T18:37:56.816101] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-24T18:37:56.965415] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T18:37:57.185867] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T18:37:57.499160] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T18:37:57.500123] [INFO ] [REMOTE ] ENO: Full fetch complete (3120 records). [2025-09-24T18:37:57.500192] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-24T18:37:57.621185] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-24T18:37:57.867982] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-24T18:37:57.868155] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-24T18:37:57.868348] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-24T18:37:57.868393] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-24T18:37:57.868864] [DEBUG] [LOCAL ] ENO: Trimmed 3120 records to 1940 (keeping 200 days of data) [2025-09-24T18:37:57.882662] [DEBUG] [LOCAL ] ENO: Primary data saved (1940 records). [2025-09-24T18:37:57.882870] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-24T18:37:57.882983] [INFO ] [MAIN ] Update Progress: 741/2373 symbols completed. ENO took 26.1s. Estimated remaining: 3h 35m 38s. Rate: 7.6 symbols/min [2025-09-24T18:37:58.066877] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:37:58.097216] [DEBUG] [LOCAL ] ENVA: Loaded 25785 existing records from primary storage. [2025-09-24T18:37:58.097408] [INFO ] [MAIN ] ENVA: Loaded 25785 existing records. [2025-09-24T18:37:58.275066] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:37:58.275323] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-24T18:37:58.275374] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-24T18:37:58.276195] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-24T18:37:58.276257] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-24T18:37:58.426129] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-24T18:37:58.651665] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:37:58.777051] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T18:37:59.216122] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-24T18:37:59.569119] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T18:38:00.016143] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-24T18:38:00.700238] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T18:38:00.816044] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-24T18:38:01.396388] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T18:38:01.616095] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-24T18:38:02.408346] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T18:38:02.416993] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-24T18:38:02.489609] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:38:03.216090] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-24T18:38:03.637410] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T18:38:04.016091] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-24T18:38:04.797613] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T18:38:04.816038] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-24T18:38:04.861160] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T18:38:05.616127] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-24T18:38:06.421171] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-24T18:38:06.438067] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:38:06.929827] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T18:38:07.216084] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-24T18:38:07.870951] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T18:38:08.016130] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-24T18:38:08.382518] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T18:38:08.816091] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-24T18:38:09.554156] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T18:38:09.616120] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-24T18:38:09.727027] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T18:38:10.416118] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-24T18:38:11.221298] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-24T18:38:11.239502] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:38:11.649504] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T18:38:12.016087] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-24T18:38:12.824888] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-24T18:38:12.831020] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:38:13.160459] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T18:38:13.616136] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-24T18:38:14.416060] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-24T18:38:14.727791] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T18:38:14.958373] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T18:38:15.216094] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-24T18:38:15.608877] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T18:38:16.016176] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-24T18:38:16.816167] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-24T18:38:16.961016] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:38:17.116816] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T18:38:17.616080] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-24T18:38:18.416102] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-24T18:38:18.575865] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T18:38:18.980043] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T18:38:19.216092] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-24T18:38:19.805753] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T18:38:20.016122] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-24T18:38:20.799799] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T18:38:20.816069] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-24T18:38:21.616810] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-24T18:38:21.619348] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T18:38:22.421241] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-24T18:38:22.437497] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:38:22.446447] [INFO ] [REMOTE ] ENOV: Full fetch complete (63117 records). [2025-09-24T18:38:22.446559] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-24T18:38:22.863849] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-24T18:38:22.863982] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-24T18:38:22.864880] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-24T18:38:22.865009] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-24T18:38:22.884020] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T18:38:22.889329] [DEBUG] [LOCAL ] ENOV: Trimmed 63117 records to 45200 (keeping 200 days of data) [2025-09-24T18:38:23.165671] [DEBUG] [LOCAL ] ENOV: Primary data saved (45200 records). [2025-09-24T18:38:23.165814] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-24T18:38:23.165900] [INFO ] [MAIN ] Update Progress: 742/2373 symbols completed. ENOV took 38.2s. Estimated remaining: 3h 36m 8s. Rate: 7.5 symbols/min [2025-09-24T18:38:23.221874] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-24T18:38:23.344445] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:38:23.362208] [DEBUG] [LOCAL ] EOD: Loaded 13989 existing records from primary storage. [2025-09-24T18:38:23.362371] [INFO ] [MAIN ] EOD: Loaded 13989 existing records. [2025-09-24T18:38:23.558350] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:38:23.558969] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-24T18:38:23.559056] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-24T18:38:23.559622] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-24T18:38:23.559729] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-24T18:38:23.952436] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:38:24.016126] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-24T18:38:24.148675] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T18:38:24.157333] [INFO ] [REMOTE ] ENR: Full fetch complete (57839 records). [2025-09-24T18:38:24.157591] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-24T18:38:24.158436] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:38:24.158532] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:38:24.158576] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:38:24.158615] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-24T18:38:24.158724] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-24T18:38:24.158822] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-24T18:38:24.159341] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-09-24T18:38:24.159465] [INFO ] [MAIN ] Update Progress: 743/2373 symbols completed. ENR took 33.6s. Estimated remaining: 3h 35m 45s. Rate: 7.6 symbols/min [2025-09-24T18:38:24.317597] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:38:24.420531] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:38:24.486483] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-24T18:38:24.486636] [INFO ] [MAIN ] EOG: Loaded 53341 existing records. [2025-09-24T18:38:24.676506] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:38:24.676886] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-24T18:38:24.676969] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-24T18:38:24.678593] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-24T18:38:24.678693] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-24T18:38:24.821270] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-24T18:38:25.044219] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:38:25.080769] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T18:38:25.616089] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-24T18:38:26.258468] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:38:26.416077] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-24T18:38:27.216102] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-24T18:38:27.552988] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T18:38:27.729357] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:38:27.735370] [INFO ] [REMOTE ] ENS: Full fetch complete (41771 records). [2025-09-24T18:38:27.735519] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-24T18:38:27.736215] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:38:27.736310] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:38:27.736596] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:38:27.736831] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-24T18:38:27.736914] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-24T18:38:27.736966] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-09-24T18:38:27.737538] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-09-24T18:38:27.737735] [INFO ] [MAIN ] Update Progress: 744/2373 symbols completed. ENS took 33.7s. Estimated remaining: 3h 35m 27s. Rate: 7.6 symbols/min [2025-09-24T18:38:27.929734] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:38:27.944699] [DEBUG] [LOCAL ] EOI: Loaded 10531 existing records from primary storage. [2025-09-24T18:38:27.944829] [INFO ] [MAIN ] EOI: Loaded 10531 existing records. [2025-09-24T18:38:28.016274] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-24T18:38:28.139015] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:38:28.139763] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-24T18:38:28.139870] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-24T18:38:28.140270] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-24T18:38:28.140340] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-24T18:38:28.257097] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T18:38:28.525172] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:38:28.816084] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-24T18:38:29.264284] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T18:38:29.269403] [INFO ] [REMOTE ] ENVA: Full fetch complete (36565 records). [2025-09-24T18:38:29.269515] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-24T18:38:29.621246] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-24T18:38:29.661660] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-24T18:38:29.661760] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-24T18:38:29.662494] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-24T18:38:29.662577] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-24T18:38:29.664995] [DEBUG] [LOCAL ] ENVA: Trimmed 36565 records to 25656 (keeping 200 days of data) [2025-09-24T18:38:29.841843] [DEBUG] [LOCAL ] ENVA: Primary data saved (25656 records). [2025-09-24T18:38:29.842003] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-24T18:38:29.842173] [INFO ] [MAIN ] Update Progress: 745/2373 symbols completed. ENVA took 32.0s. Estimated remaining: 3h 35m 6s. Rate: 7.6 symbols/min [2025-09-24T18:38:30.018024] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:38:30.027423] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:38:30.046679] [DEBUG] [LOCAL ] EOS: Loaded 15392 existing records from primary storage. [2025-09-24T18:38:30.046842] [INFO ] [MAIN ] EOS: Loaded 15392 existing records. [2025-09-24T18:38:30.231314] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:38:30.231621] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-24T18:38:30.231715] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-24T18:38:30.232366] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-24T18:38:30.232434] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-24T18:38:30.424009] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-24T18:38:30.607097] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:38:31.216178] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-24T18:38:31.317897] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T18:38:31.450188] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T18:38:32.015248] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T18:38:32.018192] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-24T18:38:32.751556] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T18:38:32.816095] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-24T18:38:33.616104] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-24T18:38:33.659797] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T18:38:34.416093] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-24T18:38:35.221259] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-24T18:38:35.239211] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T18:38:35.340783] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T18:38:36.016079] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-24T18:38:36.088345] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:38:36.816088] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-24T18:38:36.931774] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T18:38:37.616102] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-24T18:38:38.415402] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T18:38:38.419920] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-24T18:38:38.788785] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T18:38:39.216096] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-24T18:38:39.516007] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:38:40.016083] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-24T18:38:40.689673] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T18:38:40.726018] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T18:38:40.816086] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-24T18:38:41.616068] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-24T18:38:41.992460] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T18:38:42.416076] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-24T18:38:43.216050] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-24T18:38:43.269611] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T18:38:43.459441] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T18:38:44.016081] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-24T18:38:44.206875] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-24T18:38:44.816202] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-24T18:38:45.616146] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-24T18:38:45.965458] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T18:38:46.016314] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:38:46.019021] [INFO ] [REMOTE ] EOD: Full fetch complete (19891 records). [2025-09-24T18:38:46.019101] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-24T18:38:46.390864] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-24T18:38:46.390965] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-24T18:38:46.391476] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-24T18:38:46.391625] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-24T18:38:46.392251] [DEBUG] [LOCAL ] EOD: Trimmed 19891 records to 13998 (keeping 200 days of data) [2025-09-24T18:38:46.432453] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-24T18:38:46.493255] [DEBUG] [LOCAL ] EOD: Primary data saved (13998 records). [2025-09-24T18:38:46.493557] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-24T18:38:46.493794] [INFO ] [MAIN ] Update Progress: 746/2373 symbols completed. EOD took 23.3s. Estimated remaining: 3h 35m 17s. Rate: 7.6 symbols/min [2025-09-24T18:38:46.640785] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T18:38:46.703767] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:38:46.704054] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-09-24T18:38:46.704114] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-09-24T18:38:46.704288] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-24T18:38:46.704332] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-24T18:38:46.704377] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-09-24T18:38:46.704414] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-24T18:38:47.076993] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:38:47.216178] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-24T18:38:48.016148] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-24T18:38:48.117479] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:38:48.394540] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T18:38:48.541498] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-24T18:38:48.816124] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-24T18:38:49.616162] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-24T18:38:50.416156] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-24T18:38:50.649296] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T18:38:50.736723] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T18:38:51.202928] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T18:38:51.216061] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-24T18:38:52.016218] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-24T18:38:52.368997] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T18:38:52.764241] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T18:38:52.816122] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-24T18:38:53.616089] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-24T18:38:53.689986] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T18:38:54.416128] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-24T18:38:55.140494] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T18:38:55.216181] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-24T18:38:55.428705] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T18:38:55.670484] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T18:38:56.016094] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-24T18:38:56.532186] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-24T18:38:56.816227] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-24T18:38:57.453050] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T18:38:57.616147] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-24T18:38:58.416116] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-24T18:38:58.463035] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T18:38:59.136287] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T18:38:59.216105] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-24T18:38:59.945779] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T18:39:00.016060] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-24T18:39:00.754246] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T18:39:00.816111] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-24T18:39:01.616142] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-24T18:39:02.416126] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-24T18:39:03.216122] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-24T18:39:03.771975] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-24T18:39:03.781970] [INFO ] [REMOTE ] EOG: Full fetch complete (77270 records). [2025-09-24T18:39:03.782167] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-24T18:39:04.202007] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-24T18:39:04.202165] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-24T18:39:04.203555] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-24T18:39:04.203638] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-24T18:39:04.205584] [DEBUG] [LOCAL ] EOG: Trimmed 77270 records to 53341 (keeping 200 days of data) [2025-09-24T18:39:04.418393] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:39:04.458311] [INFO ] [REMOTE ] EOI: Full fetch complete (15959 records). [2025-09-24T18:39:04.469794] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-24T18:39:04.624622] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (3.01 seconds). [2025-09-24T18:39:04.636497] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-24T18:39:04.652810] [INFO ] [REMOTE ] EOT: Full fetch complete (10804 records). [2025-09-24T18:39:04.655096] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-24T18:39:04.671729] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-24T18:39:05.339265] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-24T18:39:05.344569] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-24T18:39:05.353374] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-24T18:39:05.374905] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-24T18:39:05.374724] [DEBUG] [LOCAL ] EOG: Primary data saved (53341 records). [2025-09-24T18:39:05.393499] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-24T18:39:05.410826] [DEBUG] [LOCAL ] EOI: Trimmed 15959 records to 10569 (keeping 200 days of data) [2025-09-24T18:39:05.430891] [INFO ] [MAIN ] Update Progress: 747/2373 symbols completed. EOG took 41.3s. Estimated remaining: 3h 35m 33s. Rate: 7.5 symbols/min [2025-09-24T18:39:05.553858] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-24T18:39:05.559506] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-24T18:39:05.585487] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-24T18:39:05.585911] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-24T18:39:05.639376] [DEBUG] [LOCAL ] EOT: Trimmed 10804 records to 6858 (keeping 200 days of data) [2025-09-24T18:39:05.779601] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:05.793221] [DEBUG] [LOCAL ] EOT: Primary data saved (6858 records). [2025-09-24T18:39:05.793396] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-24T18:39:05.794210] [INFO ] [MAIN ] Update Progress: 748/2373 symbols completed. EOT took 19.3s. Estimated remaining: 3h 35m 9s. Rate: 7.6 symbols/min [2025-09-24T18:39:05.935258] [DEBUG] [LOCAL ] EOI: Primary data saved (10569 records). [2025-09-24T18:39:05.936777] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-24T18:39:05.936274] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T18:39:05.937198] [INFO ] [MAIN ] Update Progress: 749/2373 symbols completed. EOI took 38.2s. Estimated remaining: 3h 34m 44s. Rate: 7.6 symbols/min [2025-09-24T18:39:05.963410] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-24T18:39:06.048408] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:06.135386] [DEBUG] [LOCAL ] EPAC: Loaded 27051 existing records from primary storage. [2025-09-24T18:39:06.162031] [INFO ] [MAIN ] EPAC: Loaded 27051 existing records. [2025-09-24T18:39:06.344522] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:06.507897] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:06.510032] [DEBUG] [LOCAL ] EPAM: Loaded 39711 existing records from primary storage. [2025-09-24T18:39:06.510779] [INFO ] [MAIN ] EPAM: Loaded 39711 existing records. [2025-09-24T18:39:06.510670] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-24T18:39:06.516219] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-24T18:39:06.534676] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-24T18:39:06.567029] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-24T18:39:06.870631] [DEBUG] [LOCAL ] EPC: Loaded 39891 existing records from primary storage. [2025-09-24T18:39:06.893916] [INFO ] [MAIN ] EPC: Loaded 39891 existing records. [2025-09-24T18:39:06.906945] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:06.952412] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-24T18:39:07.017774] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-24T18:39:07.070956] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-24T18:39:07.092076] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-24T18:39:07.122878] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:39:07.251510] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-24T18:39:07.495145] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:07.529898] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-24T18:39:07.556403] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-24T18:39:07.626443] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-24T18:39:07.727868] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-24T18:39:07.753513] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:07.769602] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-24T18:39:08.111264] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:08.139362] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-24T18:39:08.307119] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:08.307604] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-24T18:39:08.320089] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T18:39:08.324031] [INFO ] [REMOTE ] EOS: Full fetch complete (23044 records). [2025-09-24T18:39:08.324380] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-24T18:39:08.745098] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-24T18:39:08.745260] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-24T18:39:08.746035] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-24T18:39:08.746104] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-24T18:39:08.747354] [DEBUG] [LOCAL ] EOS: Trimmed 23044 records to 15341 (keeping 200 days of data) [2025-09-24T18:39:08.876017] [DEBUG] [LOCAL ] EOS: Primary data saved (15341 records). [2025-09-24T18:39:08.876238] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-24T18:39:08.876376] [INFO ] [MAIN ] Update Progress: 750/2373 symbols completed. EOS took 39.0s. Estimated remaining: 3h 34m 25s. Rate: 7.6 symbols/min [2025-09-24T18:39:09.090096] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:09.110628] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T18:39:09.117563] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-24T18:39:09.177135] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-24T18:39:09.177294] [INFO ] [MAIN ] EPD: Loaded 53616 existing records. [2025-09-24T18:39:09.428585] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:09.429891] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-24T18:39:09.430154] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-24T18:39:09.431829] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-24T18:39:09.432002] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-24T18:39:09.576244] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T18:39:09.663306] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-24T18:39:09.700284] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T18:39:09.894279] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:10.249952] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T18:39:10.416095] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-24T18:39:11.204547] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T18:39:11.216020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-24T18:39:11.300696] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T18:39:12.016114] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-24T18:39:12.393111] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T18:39:12.816138] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-24T18:39:13.308509] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:39:13.616113] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-24T18:39:13.882053] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T18:39:14.416087] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-24T18:39:15.216085] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-24T18:39:16.016118] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-24T18:39:16.554066] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.94 seconds). [2025-09-24T18:39:16.723140] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T18:39:16.816097] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-24T18:39:17.102070] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-24T18:39:17.574178] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T18:39:17.623378] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-24T18:39:17.628244] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:39:18.416099] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-24T18:39:19.216105] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-24T18:39:19.535273] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T18:39:19.872251] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T18:39:20.016088] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-24T18:39:20.816161] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-24T18:39:20.930824] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:39:21.616075] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-24T18:39:21.870866] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T18:39:22.253694] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T18:39:22.416116] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-24T18:39:22.964326] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T18:39:23.216133] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-24T18:39:23.491770] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T18:39:24.016092] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-24T18:39:24.816138] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-24T18:39:25.282005] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T18:39:25.351593] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-24T18:39:25.616136] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-24T18:39:26.139005] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:39:26.416109] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-24T18:39:27.216118] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-24T18:39:27.780279] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T18:39:27.875348] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T18:39:28.016146] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-24T18:39:28.816058] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-24T18:39:28.903515] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T18:39:29.616055] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-24T18:39:29.952780] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T18:39:30.421241] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-24T18:39:30.434917] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:39:30.444763] [INFO ] [REMOTE ] EPC: Full fetch complete (56711 records). [2025-09-24T18:39:30.444936] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-24T18:39:30.870423] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-24T18:39:30.870553] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-24T18:39:30.871482] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-24T18:39:30.871573] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-24T18:39:30.872884] [DEBUG] [LOCAL ] EPC: Trimmed 56711 records to 39852 (keeping 200 days of data) [2025-09-24T18:39:31.133555] [DEBUG] [LOCAL ] EPC: Primary data saved (39852 records). [2025-09-24T18:39:31.133755] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-24T18:39:31.133861] [INFO ] [MAIN ] Update Progress: 751/2373 symbols completed. EPC took 25.2s. Estimated remaining: 3h 34m 48s. Rate: 7.6 symbols/min [2025-09-24T18:39:31.220770] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-24T18:39:31.330396] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:31.354946] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:39:31.401749] [DEBUG] [LOCAL ] EPR: Loaded 44248 existing records from primary storage. [2025-09-24T18:39:31.401924] [INFO ] [MAIN ] EPR: Loaded 44248 existing records. [2025-09-24T18:39:31.586135] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:31.589919] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-24T18:39:31.590017] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-24T18:39:31.591387] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-24T18:39:31.591452] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-24T18:39:31.973544] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:32.016042] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-24T18:39:32.219207] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T18:39:32.555192] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T18:39:32.816088] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-24T18:39:33.616082] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-24T18:39:33.830529] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T18:39:34.243343] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T18:39:34.416121] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-24T18:39:35.216101] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-24T18:39:35.475879] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T18:39:35.561839] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T18:39:36.016081] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-24T18:39:36.601717] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-24T18:39:36.816110] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-24T18:39:37.473613] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T18:39:37.616121] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-24T18:39:38.040247] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T18:39:38.046774] [INFO ] [REMOTE ] EPAC: Full fetch complete (39100 records). [2025-09-24T18:39:38.046986] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-24T18:39:38.418401] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-24T18:39:38.446387] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-24T18:39:38.446495] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-24T18:39:38.447950] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-24T18:39:38.448200] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-24T18:39:38.449775] [DEBUG] [LOCAL ] EPAC: Trimmed 39100 records to 27063 (keeping 200 days of data) [2025-09-24T18:39:38.635185] [DEBUG] [LOCAL ] EPAC: Primary data saved (27063 records). [2025-09-24T18:39:38.635390] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-24T18:39:38.635567] [INFO ] [MAIN ] Update Progress: 752/2373 symbols completed. EPAC took 33.2s. Estimated remaining: 3h 34m 40s. Rate: 7.6 symbols/min [2025-09-24T18:39:38.820133] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:38.870697] [DEBUG] [LOCAL ] EPRT: Loaded 48693 existing records from primary storage. [2025-09-24T18:39:38.870962] [INFO ] [MAIN ] EPRT: Loaded 48693 existing records. [2025-09-24T18:39:39.060137] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:39.060501] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-24T18:39:39.060557] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-24T18:39:39.063278] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-24T18:39:39.063346] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-24T18:39:39.227958] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-24T18:39:39.504777] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:39.619327] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T18:39:39.989490] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T18:39:40.016048] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-24T18:39:40.816072] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-24T18:39:41.053142] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:39:41.061270] [INFO ] [REMOTE ] EPAM: Full fetch complete (56162 records). [2025-09-24T18:39:41.061410] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-24T18:39:41.460753] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-24T18:39:41.460844] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-24T18:39:41.461749] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-24T18:39:41.461815] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-24T18:39:41.463069] [DEBUG] [LOCAL ] EPAM: Trimmed 56162 records to 39772 (keeping 200 days of data) [2025-09-24T18:39:41.632693] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-24T18:39:41.704270] [DEBUG] [LOCAL ] EPAM: Primary data saved (39772 records). [2025-09-24T18:39:41.704441] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-24T18:39:41.704535] [INFO ] [MAIN ] Update Progress: 753/2373 symbols completed. EPAM took 35.9s. Estimated remaining: 3h 34m 21s. Rate: 7.6 symbols/min [2025-09-24T18:39:41.889913] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:41.890239] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-09-24T18:39:41.890374] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-09-24T18:39:41.890800] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-24T18:39:41.890976] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-24T18:39:41.891073] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-09-24T18:39:41.891137] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-24T18:39:42.033987] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T18:39:42.301204] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:42.416080] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-24T18:39:42.669825] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T18:39:42.680574] [INFO ] [REMOTE ] EPD: Full fetch complete (77645 records). [2025-09-24T18:39:42.681091] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-24T18:39:43.105503] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-24T18:39:43.105725] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-24T18:39:43.107018] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-24T18:39:43.107112] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-24T18:39:43.135017] [DEBUG] [LOCAL ] EPD: Trimmed 77645 records to 53615 (keeping 200 days of data) [2025-09-24T18:39:43.137113] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:39:43.220418] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-24T18:39:43.504163] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T18:39:43.537322] [DEBUG] [LOCAL ] EPD: Primary data saved (53615 records). [2025-09-24T18:39:43.537536] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-24T18:39:43.537676] [INFO ] [MAIN ] Update Progress: 754/2373 symbols completed. EPD took 34.7s. Estimated remaining: 3h 34m 0s. Rate: 7.6 symbols/min [2025-09-24T18:39:43.731992] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:39:43.784593] [DEBUG] [LOCAL ] EQH: Loaded 52669 existing records from primary storage. [2025-09-24T18:39:43.784802] [INFO ] [MAIN ] EQH: Loaded 52669 existing records. [2025-09-24T18:39:43.976115] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:39:43.976541] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-24T18:39:43.976599] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-24T18:39:43.978069] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-24T18:39:43.978138] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-24T18:39:44.021346] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-24T18:39:44.418966] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:39:44.816144] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-24T18:39:44.876601] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T18:39:45.498308] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T18:39:45.616048] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-24T18:39:45.644486] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T18:39:46.416086] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-24T18:39:47.110001] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T18:39:47.216094] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-24T18:39:48.016105] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-24T18:39:48.103998] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T18:39:48.724028] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T18:39:48.816039] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-24T18:39:48.937489] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T18:39:49.616099] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-24T18:39:50.326974] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T18:39:50.416050] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-24T18:39:51.178702] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:39:51.216056] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-24T18:39:52.016056] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-24T18:39:52.141357] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:39:52.821197] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-24T18:39:52.835250] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:39:53.616094] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-24T18:39:53.922807] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T18:39:54.421239] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-24T18:39:54.446480] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T18:39:54.447680] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T18:39:55.216137] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-24T18:39:56.016150] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-24T18:39:56.158582] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T18:39:56.816068] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-24T18:39:56.955134] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:39:57.616058] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-24T18:39:57.771714] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T18:39:58.377005] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T18:39:58.416030] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-24T18:39:59.093888] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T18:39:59.216039] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-24T18:40:00.016170] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-24T18:40:00.066079] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T18:40:00.816149] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-24T18:40:01.248518] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T18:40:01.257284] [INFO ] [REMOTE ] EPRT: Full fetch complete (68735 records). [2025-09-24T18:40:01.257447] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-24T18:40:01.621638] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-24T18:40:01.677670] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-24T18:40:01.678086] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-24T18:40:01.679063] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-24T18:40:01.679149] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-24T18:40:01.681419] [DEBUG] [LOCAL ] EPRT: Trimmed 68735 records to 48677 (keeping 200 days of data) [2025-09-24T18:40:01.813829] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T18:40:01.831738] [INFO ] [REMOTE ] EPR: Full fetch complete (62842 records). [2025-09-24T18:40:01.833087] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-24T18:40:02.355286] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-24T18:40:02.355449] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-24T18:40:02.357409] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-24T18:40:02.357493] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-24T18:40:02.361868] [DEBUG] [LOCAL ] EPR: Trimmed 62842 records to 44181 (keeping 200 days of data) [2025-09-24T18:40:02.681719] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:40:02.687540] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-24T18:40:02.705121] [DEBUG] [LOCAL ] EPRT: Primary data saved (48677 records). [2025-09-24T18:40:02.706028] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-24T18:40:02.706469] [INFO ] [MAIN ] Update Progress: 755/2373 symbols completed. EPRT took 24.1s. Estimated remaining: 3h 34m 16s. Rate: 7.6 symbols/min [2025-09-24T18:40:03.018819] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:03.068621] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-24T18:40:03.138078] [DEBUG] [LOCAL ] EQNR: Loaded 53041 existing records from primary storage. [2025-09-24T18:40:03.139412] [INFO ] [MAIN ] EQNR: Loaded 53041 existing records. [2025-09-24T18:40:03.220795] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-24T18:40:03.368169] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:03.370979] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-24T18:40:03.371065] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-24T18:40:03.374278] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-24T18:40:03.375335] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-24T18:40:03.426892] [DEBUG] [LOCAL ] EPR: Primary data saved (44181 records). [2025-09-24T18:40:03.469309] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-24T18:40:03.479955] [INFO ] [MAIN ] Update Progress: 756/2373 symbols completed. EPR took 32.3s. Estimated remaining: 3h 33m 53s. Rate: 7.6 symbols/min [2025-09-24T18:40:03.525863] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T18:40:03.888523] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:04.044939] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-24T18:40:04.051251] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:04.100294] [DEBUG] [LOCAL ] EQR: Loaded 51413 existing records from primary storage. [2025-09-24T18:40:04.100606] [INFO ] [MAIN ] EQR: Loaded 51413 existing records. [2025-09-24T18:40:04.328972] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:04.329311] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-24T18:40:04.329369] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-24T18:40:04.330801] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-24T18:40:04.330868] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-24T18:40:04.726980] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:04.816134] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-24T18:40:04.991344] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T18:40:05.231510] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T18:40:05.616143] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-24T18:40:06.416101] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-24T18:40:06.941513] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T18:40:07.216068] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-24T18:40:07.522259] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T18:40:08.016060] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-24T18:40:08.052081] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T18:40:08.816098] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-24T18:40:09.049769] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T18:40:09.606014] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T18:40:09.616067] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-24T18:40:10.416057] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-24T18:40:10.713858] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T18:40:11.216062] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-24T18:40:11.485235] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T18:40:11.524672] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T18:40:12.016106] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-24T18:40:12.816113] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-24T18:40:12.879174] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T18:40:12.958763] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:40:13.616169] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-24T18:40:14.265918] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:40:14.416119] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-24T18:40:14.589529] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T18:40:14.593717] [INFO ] [REMOTE ] EQBK: Full fetch complete (15373 records). [2025-09-24T18:40:14.593859] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-24T18:40:14.978000] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-24T18:40:14.978095] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-24T18:40:14.978446] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-24T18:40:14.978488] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-24T18:40:14.979188] [DEBUG] [LOCAL ] EQBK: Trimmed 15373 records to 10952 (keeping 200 days of data) [2025-09-24T18:40:15.045931] [DEBUG] [LOCAL ] EQBK: Primary data saved (10952 records). [2025-09-24T18:40:15.046090] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-24T18:40:15.046172] [INFO ] [MAIN ] Update Progress: 757/2373 symbols completed. EQBK took 33.3s. Estimated remaining: 3h 33m 53s. Rate: 7.6 symbols/min [2025-09-24T18:40:15.216130] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-24T18:40:16.016161] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-24T18:40:16.396207] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T18:40:16.406634] [INFO ] [REMOTE ] EQH: Full fetch complete (76329 records). [2025-09-24T18:40:16.406890] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-24T18:40:16.857298] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-24T18:40:16.857532] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-24T18:40:16.858824] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-24T18:40:16.859042] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-24T18:40:16.860853] [DEBUG] [LOCAL ] EQH: Trimmed 76329 records to 52662 (keeping 200 days of data) [2025-09-24T18:40:17.135308] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:40:17.160483] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-24T18:40:17.262195] [DEBUG] [LOCAL ] EQH: Primary data saved (52662 records). [2025-09-24T18:40:17.262398] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-24T18:40:17.262536] [INFO ] [MAIN ] Update Progress: 758/2373 symbols completed. EQH took 33.7s. Estimated remaining: 3h 33m 33s. Rate: 7.6 symbols/min [2025-09-24T18:40:18.174355] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-24T18:40:18.186047] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-24T18:40:20.424848] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-09-24T18:40:20.442453] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-24T18:40:20.844275] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-24T18:40:20.855557] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-24T18:40:22.129515] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T18:40:22.140506] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-24T18:40:22.733982] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T18:40:22.745719] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-24T18:40:23.785769] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:40:23.796384] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-24T18:40:24.284626] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:40:24.298022] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-24T18:40:25.524485] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T18:40:25.536086] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-24T18:40:26.257480] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T18:40:26.269294] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-24T18:40:26.781934] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T18:40:26.793521] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-24T18:40:28.322125] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T18:40:28.336556] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-24T18:40:28.421430] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:40:28.431006] [INFO ] [REMOTE ] EQR: Full fetch complete (73739 records). [2025-09-24T18:40:28.431189] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-24T18:40:28.845322] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-24T18:40:28.845472] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-24T18:40:28.846598] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-24T18:40:28.846688] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-24T18:40:28.849349] [DEBUG] [LOCAL ] EQR: Trimmed 73739 records to 51420 (keeping 200 days of data) [2025-09-24T18:40:29.168864] [DEBUG] [LOCAL ] EQR: Primary data saved (51420 records). [2025-09-24T18:40:29.169025] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-24T18:40:29.169114] [INFO ] [MAIN ] Update Progress: 759/2373 symbols completed. EQR took 25.7s. Estimated remaining: 3h 33m 33s. Rate: 7.6 symbols/min [2025-09-24T18:40:30.062219] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T18:40:30.074921] [INFO ] [REMOTE ] EQNR: Full fetch complete (76753 records). [2025-09-24T18:40:30.075109] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-24T18:40:30.503618] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-24T18:40:30.503775] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-24T18:40:30.504776] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-24T18:40:30.504866] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-24T18:40:30.506589] [DEBUG] [LOCAL ] EQNR: Trimmed 76753 records to 53036 (keeping 200 days of data) [2025-09-24T18:40:30.860592] [DEBUG] [LOCAL ] EQNR: Primary data saved (53036 records). [2025-09-24T18:40:30.860774] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-24T18:40:30.860899] [INFO ] [MAIN ] Update Progress: 760/2373 symbols completed. EQNR took 28.2s. Estimated remaining: 3h 33m 12s. Rate: 7.6 symbols/min [2025-09-24T18:40:31.503737] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:31.499999] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:31.519732] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-24T18:40:31.519929] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-24T18:40:31.592121] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-24T18:40:31.591587] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:31.608327] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-24T18:40:31.618794] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-24T18:40:31.640002] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:31.640886] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-24T18:40:31.730369] [DEBUG] [LOCAL ] EQV: Loaded 2828 existing records from primary storage. [2025-09-24T18:40:31.741774] [INFO ] [MAIN ] EQV: Loaded 2828 existing records. [2025-09-24T18:40:32.174325] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:32.224742] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-24T18:40:32.224631] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-24T18:40:32.228585] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-24T18:40:32.228470] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-24T18:40:32.234996] [DEBUG] [LOCAL ] ERJ: Loaded 50792 existing records from primary storage. [2025-09-24T18:40:32.280037] [INFO ] [MAIN ] ERJ: Loaded 50792 existing records. [2025-09-24T18:40:32.311042] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-24T18:40:32.430519] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:32.436075] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-24T18:40:32.430584] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-24T18:40:32.760178] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:32.813975] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-24T18:40:32.814318] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-24T18:40:32.814220] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:32.824865] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-24T18:40:32.849485] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-24T18:40:32.859921] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-24T18:40:32.849616] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-24T18:40:32.938501] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-24T18:40:32.977608] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-24T18:40:33.129460] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T18:40:33.201406] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-24T18:40:33.393447] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:33.456800] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-24T18:40:33.815546] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:33.809725] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T18:40:33.840121] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-24T18:40:33.834851] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-24T18:40:33.838774] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:33.840521] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-24T18:40:34.282847] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T18:40:34.283969] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-24T18:40:34.587326] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T18:40:34.589340] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-24T18:40:34.649839] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-24T18:40:34.650793] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-24T18:40:35.007885] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-24T18:40:35.008845] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-24T18:40:35.348452] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-24T18:40:35.349791] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-24T18:40:35.436264] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T18:40:35.447337] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-24T18:40:35.520437] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T18:40:35.631230] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-24T18:40:35.824988] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-24T18:40:35.863408] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T18:40:36.016111] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-24T18:40:36.459373] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T18:40:36.816074] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-24T18:40:37.616102] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-24T18:40:38.171567] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T18:40:38.416082] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-24T18:40:38.488504] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T18:40:39.010410] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T18:40:39.216148] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-24T18:40:40.016165] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-24T18:40:40.435901] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T18:40:40.618032] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T18:40:40.816129] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-24T18:40:41.616115] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-24T18:40:42.196294] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T18:40:42.416069] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-24T18:40:42.714867] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T18:40:42.794802] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-24T18:40:43.216123] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-24T18:40:44.016082] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-24T18:40:44.811632] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T18:40:44.812979] [INFO ] [REMOTE ] EQS: Full fetch complete (2536 records). [2025-09-24T18:40:44.813049] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-24T18:40:44.825748] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-24T18:40:45.008813] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-24T18:40:45.009223] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:40:45.009351] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:40:45.009539] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-24T18:40:45.009622] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-24T18:40:45.009724] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-24T18:40:45.009808] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-24T18:40:45.009939] [INFO ] [MAIN ] Update Progress: 761/2373 symbols completed. EQS took 14.1s. Estimated remaining: 3h 33m 17s. Rate: 7.6 symbols/min [2025-09-24T18:40:45.188303] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:45.230319] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T18:40:45.273262] [DEBUG] [LOCAL ] ERO: Loaded 41133 existing records from primary storage. [2025-09-24T18:40:45.273423] [INFO ] [MAIN ] ERO: Loaded 41133 existing records. [2025-09-24T18:40:45.468912] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:45.469254] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-24T18:40:45.469310] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-24T18:40:45.470472] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-24T18:40:45.470535] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-24T18:40:45.566906] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:40:45.621160] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-24T18:40:45.858031] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:46.231211] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T18:40:46.416100] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-24T18:40:47.216093] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-24T18:40:47.762284] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T18:40:47.763266] [INFO ] [REMOTE ] EQV: Full fetch complete (5749 records). [2025-09-24T18:40:47.763353] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-24T18:40:48.018081] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-24T18:40:48.138372] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-24T18:40:48.138454] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-24T18:40:48.138710] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-24T18:40:48.138812] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-24T18:40:48.139317] [DEBUG] [LOCAL ] EQV: Trimmed 5749 records to 2824 (keeping 200 days of data) [2025-09-24T18:40:48.159881] [DEBUG] [LOCAL ] EQV: Primary data saved (2824 records). [2025-09-24T18:40:48.159960] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-24T18:40:48.160130] [INFO ] [MAIN ] Update Progress: 762/2373 symbols completed. EQV took 17.3s. Estimated remaining: 3h 32m 59s. Rate: 7.6 symbols/min [2025-09-24T18:40:48.336629] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:40:48.379033] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T18:40:48.452160] [DEBUG] [LOCAL ] ES: Loaded 52528 existing records from primary storage. [2025-09-24T18:40:48.452332] [INFO ] [MAIN ] ES: Loaded 52528 existing records. [2025-09-24T18:40:48.628862] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:40:48.629103] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-24T18:40:48.629166] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-24T18:40:48.630544] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-24T18:40:48.630615] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-24T18:40:48.822061] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-24T18:40:48.992938] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:40:49.577913] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T18:40:49.616065] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-24T18:40:50.416051] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-24T18:40:50.759708] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T18:40:51.143585] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:40:51.216141] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-24T18:40:52.016097] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-24T18:40:52.052324] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T18:40:52.446275] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T18:40:52.816085] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-24T18:40:53.218488] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T18:40:53.616084] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-24T18:40:54.416100] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-24T18:40:54.740909] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-24T18:40:55.222087] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-24T18:40:55.229310] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T18:40:56.016135] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-24T18:40:56.377505] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T18:40:56.580552] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T18:40:56.816093] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-24T18:40:57.616125] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-24T18:40:57.762930] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T18:40:58.416060] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-24T18:40:58.909343] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T18:40:59.216114] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-24T18:40:59.356761] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T18:40:59.777603] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T18:41:00.016121] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-24T18:41:00.816073] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-24T18:41:01.154661] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T18:41:01.616114] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-24T18:41:01.665802] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T18:41:02.416121] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-24T18:41:02.706923] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T18:41:03.216117] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-24T18:41:03.501012] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T18:41:04.016061] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-24T18:41:04.447851] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T18:41:04.560251] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T18:41:04.816142] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-24T18:41:05.616094] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-24T18:41:06.045748] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T18:41:06.416278] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-24T18:41:06.551894] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T18:41:07.225285] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-24T18:41:07.254244] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T18:41:08.016090] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-24T18:41:08.315392] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T18:41:08.324890] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-24T18:41:08.325031] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-24T18:41:08.799909] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-24T18:41:08.800066] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-24T18:41:08.801106] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-24T18:41:08.801219] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-24T18:41:08.803249] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-24T18:41:08.816068] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-24T18:41:08.976158] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T18:41:09.197191] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-24T18:41:09.197607] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-24T18:41:09.197730] [INFO ] [MAIN ] Update Progress: 763/2373 symbols completed. EQT took 38.3s. Estimated remaining: 3h 33m 19s. Rate: 7.5 symbols/min [2025-09-24T18:41:09.374896] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:09.413582] [DEBUG] [LOCAL ] ESAB: Loaded 26041 existing records from primary storage. [2025-09-24T18:41:09.413769] [INFO ] [MAIN ] ESAB: Loaded 26041 existing records. [2025-09-24T18:41:09.615895] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:09.616152] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-24T18:41:09.616667] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-24T18:41:09.617820] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-24T18:41:09.619225] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-24T18:41:09.619304] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-24T18:41:10.046612] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T18:41:10.079249] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:10.416089] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-24T18:41:10.543284] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T18:41:11.216118] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-24T18:41:11.353899] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:41:12.016166] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-24T18:41:12.254385] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:41:12.270827] [INFO ] [REMOTE ] ERJ: Full fetch complete (72167 records). [2025-09-24T18:41:12.271168] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-24T18:41:12.790156] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T18:41:12.822156] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-24T18:41:12.957521] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-24T18:41:12.957679] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-24T18:41:12.959387] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-24T18:41:12.959482] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-24T18:41:12.964508] [DEBUG] [LOCAL ] ERJ: Trimmed 72167 records to 50732 (keeping 200 days of data) [2025-09-24T18:41:13.330502] [DEBUG] [LOCAL ] ERJ: Primary data saved (50732 records). [2025-09-24T18:41:13.330698] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-24T18:41:13.330810] [INFO ] [MAIN ] Update Progress: 764/2373 symbols completed. ERJ took 42.5s. Estimated remaining: 3h 33m 3s. Rate: 7.6 symbols/min [2025-09-24T18:41:13.509288] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:13.528340] [DEBUG] [LOCAL ] ESE: Loaded 16640 existing records from primary storage. [2025-09-24T18:41:13.528489] [INFO ] [MAIN ] ESE: Loaded 16640 existing records. [2025-09-24T18:41:13.621206] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-24T18:41:13.716789] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:13.717434] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-24T18:41:13.717600] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-24T18:41:13.718270] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-24T18:41:13.718334] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-24T18:41:14.100383] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:14.129755] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-24T18:41:14.348367] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T18:41:14.356233] [INFO ] [REMOTE ] ERO: Full fetch complete (59177 records). [2025-09-24T18:41:14.356384] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-24T18:41:14.421230] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-24T18:41:14.740550] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-24T18:41:14.740668] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-24T18:41:14.741613] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-24T18:41:14.741687] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-24T18:41:14.742978] [DEBUG] [LOCAL ] ERO: Trimmed 59177 records to 41197 (keeping 200 days of data) [2025-09-24T18:41:14.846738] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T18:41:15.013286] [DEBUG] [LOCAL ] ERO: Primary data saved (41197 records). [2025-09-24T18:41:15.013430] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-24T18:41:15.013517] [INFO ] [MAIN ] Update Progress: 765/2373 symbols completed. ERO took 30.0s. Estimated remaining: 3h 32m 42s. Rate: 7.6 symbols/min [2025-09-24T18:41:15.197829] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:15.226788] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-24T18:41:15.249677] [DEBUG] [LOCAL ] ESI: Loaded 50856 existing records from primary storage. [2025-09-24T18:41:15.249985] [INFO ] [MAIN ] ESI: Loaded 50856 existing records. [2025-09-24T18:41:15.382900] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T18:41:15.443032] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:15.443260] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-24T18:41:15.443309] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-24T18:41:15.444734] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-24T18:41:15.444796] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-24T18:41:15.810757] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:16.016076] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-24T18:41:16.249674] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T18:41:16.816091] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-24T18:41:17.616108] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-24T18:41:17.851292] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:41:17.861148] [INFO ] [REMOTE ] ES: Full fetch complete (76153 records). [2025-09-24T18:41:17.861350] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-24T18:41:18.303487] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-24T18:41:18.303606] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-24T18:41:18.304678] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-24T18:41:18.304749] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-24T18:41:18.307616] [DEBUG] [LOCAL ] ES: Trimmed 76153 records to 52529 (keeping 200 days of data) [2025-09-24T18:41:18.416263] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-24T18:41:18.656497] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T18:41:18.685214] [DEBUG] [LOCAL ] ES: Primary data saved (52529 records). [2025-09-24T18:41:18.685380] [INFO ] [MAIN ] ES: Full history saved. [2025-09-24T18:41:18.685475] [INFO ] [MAIN ] Update Progress: 766/2373 symbols completed. ES took 30.5s. Estimated remaining: 3h 32m 25s. Rate: 7.6 symbols/min [2025-09-24T18:41:18.891491] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:18.894133] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-24T18:41:18.940355] [DEBUG] [LOCAL ] ESNT: Loaded 38672 existing records from primary storage. [2025-09-24T18:41:18.940552] [INFO ] [MAIN ] ESNT: Loaded 38672 existing records. [2025-09-24T18:41:19.126736] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:19.127249] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-24T18:41:19.133700] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-24T18:41:19.134613] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T18:41:19.136882] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-24T18:41:19.137577] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-24T18:41:19.221186] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-24T18:41:19.507021] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:20.016146] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-24T18:41:20.278349] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T18:41:20.816123] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-24T18:41:21.361400] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:41:21.616119] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-24T18:41:22.416135] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-24T18:41:22.484245] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T18:41:22.667772] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T18:41:23.216097] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-24T18:41:23.547267] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T18:41:24.016148] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-24T18:41:24.767928] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:41:24.816073] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-24T18:41:25.182451] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T18:41:25.616090] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-24T18:41:26.269981] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T18:41:26.416124] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-24T18:41:26.823325] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T18:41:27.216057] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-24T18:41:27.586151] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T18:41:28.016151] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-24T18:41:28.124206] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T18:41:28.816080] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-24T18:41:29.616088] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-24T18:41:29.844638] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T18:41:30.148837] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T18:41:30.416081] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-24T18:41:30.875329] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T18:41:31.216050] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-24T18:41:31.588547] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T18:41:32.016090] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-24T18:41:32.816065] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-24T18:41:32.971236] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T18:41:33.616056] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-24T18:41:33.719954] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T18:41:33.831090] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T18:41:34.416072] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-24T18:41:35.016918] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T18:41:35.216079] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-24T18:41:35.462550] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T18:41:36.016105] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-24T18:41:36.411373] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T18:41:36.816057] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-24T18:41:37.062293] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T18:41:37.616087] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-24T18:41:38.341841] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T18:41:38.416041] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-24T18:41:38.444817] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T18:41:38.448731] [INFO ] [REMOTE ] ESE: Full fetch complete (22007 records). [2025-09-24T18:41:38.448849] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-24T18:41:38.856820] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-24T18:41:38.856919] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-24T18:41:38.857530] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-24T18:41:38.857572] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-24T18:41:38.858314] [DEBUG] [LOCAL ] ESE: Trimmed 22007 records to 16588 (keeping 200 days of data) [2025-09-24T18:41:38.967247] [DEBUG] [LOCAL ] ESE: Primary data saved (16588 records). [2025-09-24T18:41:38.967409] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-24T18:41:38.967500] [INFO ] [MAIN ] Update Progress: 767/2373 symbols completed. ESE took 25.6s. Estimated remaining: 3h 32m 43s. Rate: 7.6 symbols/min [2025-09-24T18:41:39.149048] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:39.196047] [DEBUG] [LOCAL ] ESRT: Loaded 46352 existing records from primary storage. [2025-09-24T18:41:39.196248] [INFO ] [MAIN ] ESRT: Loaded 46352 existing records. [2025-09-24T18:41:39.221250] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-24T18:41:39.396784] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:39.397082] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-24T18:41:39.397132] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-24T18:41:39.398482] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-24T18:41:39.398543] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-24T18:41:39.758860] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:39.859827] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T18:41:40.016117] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-24T18:41:40.816086] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-24T18:41:41.111266] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T18:41:41.525338] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T18:41:41.616053] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-24T18:41:42.416119] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-24T18:41:42.822005] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T18:41:43.109163] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T18:41:43.216041] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-24T18:41:43.969960] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T18:41:43.975784] [INFO ] [REMOTE ] ESAB: Full fetch complete (35493 records). [2025-09-24T18:41:43.975926] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-24T18:41:44.021181] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-24T18:41:44.355229] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-24T18:41:44.355344] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-24T18:41:44.356019] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-24T18:41:44.356085] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-24T18:41:44.356962] [DEBUG] [LOCAL ] ESAB: Trimmed 35493 records to 26219 (keeping 200 days of data) [2025-09-24T18:41:44.533564] [DEBUG] [LOCAL ] ESAB: Primary data saved (26219 records). [2025-09-24T18:41:44.533753] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-24T18:41:44.533875] [INFO ] [MAIN ] Update Progress: 768/2373 symbols completed. ESAB took 35.3s. Estimated remaining: 3h 32m 30s. Rate: 7.6 symbols/min [2025-09-24T18:41:44.747376] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:44.762944] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T18:41:44.800949] [DEBUG] [LOCAL ] ESS: Loaded 30026 existing records from primary storage. [2025-09-24T18:41:44.801107] [INFO ] [MAIN ] ESS: Loaded 30026 existing records. [2025-09-24T18:41:44.823072] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-24T18:41:45.009135] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:45.009402] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-24T18:41:45.009452] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-24T18:41:45.010489] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-24T18:41:45.010553] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-24T18:41:45.400635] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:45.616078] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-24T18:41:45.713351] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T18:41:46.066750] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T18:41:46.416110] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-24T18:41:47.000021] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T18:41:47.216085] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-24T18:41:48.016102] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-24T18:41:48.082244] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T18:41:48.643495] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:41:48.816095] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-24T18:41:49.253476] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T18:41:49.259842] [INFO ] [REMOTE ] ESNT: Full fetch complete (57171 records). [2025-09-24T18:41:49.259951] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-24T18:41:49.628558] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-24T18:41:49.649577] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-24T18:41:49.649750] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-24T18:41:49.651086] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-24T18:41:49.651167] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-24T18:41:49.654921] [DEBUG] [LOCAL ] ESNT: Trimmed 57171 records to 38568 (keeping 200 days of data) [2025-09-24T18:41:49.917088] [DEBUG] [LOCAL ] ESNT: Primary data saved (38568 records). [2025-09-24T18:41:49.917300] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-24T18:41:49.917601] [INFO ] [MAIN ] Update Progress: 769/2373 symbols completed. ESNT took 31.2s. Estimated remaining: 3h 32m 17s. Rate: 7.6 symbols/min [2025-09-24T18:41:50.105189] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:50.160266] [DEBUG] [LOCAL ] ESTC: Loaded 50162 existing records from primary storage. [2025-09-24T18:41:50.160738] [INFO ] [MAIN ] ESTC: Loaded 50162 existing records. [2025-09-24T18:41:50.356811] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:41:50.357552] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-24T18:41:50.357723] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-24T18:41:50.359317] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-24T18:41:50.359389] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-24T18:41:50.423742] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-24T18:41:50.718465] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T18:41:50.761388] [INFO ] [REMOTE ] ESI: Full fetch complete (72387 records). [2025-09-24T18:41:50.777275] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-24T18:41:50.831087] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:51.216360] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-24T18:41:51.263273] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-24T18:41:51.263381] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-24T18:41:51.264460] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-24T18:41:51.264530] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-24T18:41:51.266995] [DEBUG] [LOCAL ] ESI: Trimmed 72387 records to 50831 (keeping 200 days of data) [2025-09-24T18:41:51.518392] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T18:41:51.623941] [DEBUG] [LOCAL ] ESI: Primary data saved (50831 records). [2025-09-24T18:41:51.624100] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-24T18:41:51.624206] [INFO ] [MAIN ] Update Progress: 770/2373 symbols completed. ESI took 36.6s. Estimated remaining: 3h 31m 56s. Rate: 7.6 symbols/min [2025-09-24T18:41:51.802007] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:41:51.802283] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-09-24T18:41:51.802387] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-09-24T18:41:51.802733] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-24T18:41:51.802853] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-24T18:41:51.802968] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-24T18:41:51.803069] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-24T18:41:51.957237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:41:52.021270] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-24T18:41:52.206143] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:41:52.816065] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-24T18:41:53.135867] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T18:41:53.616059] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-24T18:41:53.888455] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T18:41:54.175371] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T18:41:54.416124] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-24T18:41:55.057815] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T18:41:55.216084] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-24T18:41:56.016114] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-24T18:41:56.642414] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-24T18:41:56.766505] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T18:41:56.816041] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-24T18:41:57.616049] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-24T18:41:57.649564] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T18:41:58.379197] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T18:41:58.416036] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-24T18:41:59.216131] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-24T18:41:59.812841] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-24T18:42:00.009545] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T18:42:00.019444] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-24T18:42:00.816053] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-24T18:42:01.061592] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T18:42:01.616119] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-24T18:42:02.416098] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-24T18:42:02.774259] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-24T18:42:03.117486] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-24T18:42:03.216110] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-24T18:42:04.016121] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-24T18:42:06.050072] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (4.43 seconds). [2025-09-24T18:42:06.062535] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-24T18:42:06.087691] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-24T18:42:06.098075] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-24T18:42:06.543401] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (4.13 seconds). [2025-09-24T18:42:06.553177] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-24T18:42:07.012479] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T18:42:07.216053] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-24T18:42:07.475680] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:42:07.572463] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (4.36 seconds). [2025-09-24T18:42:08.016084] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-24T18:42:08.181351] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T18:42:08.190336] [INFO ] [REMOTE ] ESRT: Full fetch complete (66430 records). [2025-09-24T18:42:08.190503] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-24T18:42:08.521672] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T18:42:08.637729] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-24T18:42:08.637836] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-24T18:42:08.638997] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-24T18:42:08.639068] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-24T18:42:08.640917] [DEBUG] [LOCAL ] ESRT: Trimmed 66430 records to 46377 (keeping 200 days of data) [2025-09-24T18:42:08.840499] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-24T18:42:08.914839] [DEBUG] [LOCAL ] ESRT: Primary data saved (46377 records). [2025-09-24T18:42:08.915000] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-24T18:42:08.915095] [INFO ] [MAIN ] Update Progress: 771/2373 symbols completed. ESRT took 29.9s. Estimated remaining: 3h 32m 7s. Rate: 7.6 symbols/min [2025-09-24T18:42:09.090683] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:09.105295] [DEBUG] [LOCAL ] ETB: Loaded 11919 existing records from primary storage. [2025-09-24T18:42:09.105440] [INFO ] [MAIN ] ETB: Loaded 11919 existing records. [2025-09-24T18:42:09.283166] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:09.283425] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-24T18:42:09.283474] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-24T18:42:09.283923] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-24T18:42:09.283983] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-24T18:42:09.617800] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-24T18:42:09.639929] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:10.191475] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T18:42:10.231772] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-24T18:42:10.416048] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-24T18:42:11.035494] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T18:42:11.216058] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-24T18:42:11.423415] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T18:42:12.016125] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-24T18:42:12.816082] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-24T18:42:12.895781] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T18:42:13.220263] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T18:42:13.520736] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-24T18:42:13.616107] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-24T18:42:14.416100] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-24T18:42:15.216099] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-24T18:42:15.807198] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T18:42:15.812551] [INFO ] [REMOTE ] ESS: Full fetch complete (43275 records). [2025-09-24T18:42:15.812683] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-24T18:42:16.034518] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-24T18:42:16.216624] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-24T18:42:16.216808] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-24T18:42:16.217612] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-24T18:42:16.217687] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-24T18:42:16.218691] [DEBUG] [LOCAL ] ESS: Trimmed 43275 records to 30038 (keeping 200 days of data) [2025-09-24T18:42:16.411121] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-24T18:42:16.436079] [DEBUG] [LOCAL ] ESS: Primary data saved (30038 records). [2025-09-24T18:42:16.436248] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-24T18:42:16.436418] [INFO ] [MAIN ] Update Progress: 772/2373 symbols completed. ESS took 31.9s. Estimated remaining: 3h 31m 58s. Rate: 7.6 symbols/min [2025-09-24T18:42:16.619433] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:16.646640] [DEBUG] [LOCAL ] ETD: Loaded 27418 existing records from primary storage. [2025-09-24T18:42:16.646850] [INFO ] [MAIN ] ETD: Loaded 27418 existing records. [2025-09-24T18:42:16.821425] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-24T18:42:16.826087] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:16.827071] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-24T18:42:16.827124] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-24T18:42:16.828144] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-24T18:42:16.828208] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-24T18:42:17.182923] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:17.616155] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-24T18:42:17.885062] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T18:42:18.032885] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-24T18:42:18.077215] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T18:42:18.393107] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T18:42:18.416064] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-24T18:42:19.216065] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-24T18:42:19.599599] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T18:42:20.016130] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-24T18:42:20.816063] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-24T18:42:20.978466] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:42:21.089027] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T18:42:21.098374] [INFO ] [REMOTE ] ESTC: Full fetch complete (72092 records). [2025-09-24T18:42:21.098557] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-24T18:42:21.536630] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-24T18:42:21.536744] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-24T18:42:21.537730] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-24T18:42:21.537794] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-24T18:42:21.539361] [DEBUG] [LOCAL ] ESTC: Trimmed 72092 records to 50067 (keeping 200 days of data) [2025-09-24T18:42:21.632092] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-24T18:42:21.872084] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:42:21.891300] [DEBUG] [LOCAL ] ESTC: Primary data saved (50067 records). [2025-09-24T18:42:21.891421] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-24T18:42:21.891557] [INFO ] [MAIN ] Update Progress: 773/2373 symbols completed. ESTC took 32.0s. Estimated remaining: 3h 31m 45s. Rate: 7.6 symbols/min [2025-09-24T18:42:22.085744] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:22.103492] [DEBUG] [LOCAL ] ETG: Loaded 16618 existing records from primary storage. [2025-09-24T18:42:22.103607] [INFO ] [MAIN ] ETG: Loaded 16618 existing records. [2025-09-24T18:42:22.313332] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:22.313788] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-24T18:42:22.313869] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-24T18:42:22.314597] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-24T18:42:22.314704] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-24T18:42:22.422725] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-24T18:42:22.755555] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:23.216110] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-24T18:42:23.376314] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:42:23.655311] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-24T18:42:24.002150] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T18:42:24.016027] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-24T18:42:24.816093] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-24T18:42:25.554792] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T18:42:25.616085] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-24T18:42:26.242851] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T18:42:26.416087] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-24T18:42:26.960216] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T18:42:27.216093] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-24T18:42:27.529825] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T18:42:28.016139] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-24T18:42:28.671779] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T18:42:28.816110] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-24T18:42:29.616069] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-24T18:42:29.659285] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-24T18:42:29.846619] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T18:42:30.416083] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-24T18:42:30.572629] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:42:31.006062] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T18:42:31.216097] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-24T18:42:32.016081] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-24T18:42:32.231590] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T18:42:32.816074] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-24T18:42:33.011624] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T18:42:33.616201] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-24T18:42:33.724216] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T18:42:34.416117] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-24T18:42:34.859157] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T18:42:35.075180] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T18:42:35.216112] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-24T18:42:36.016101] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-24T18:42:36.110491] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T18:42:36.816166] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-24T18:42:36.844738] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T18:42:36.849116] [INFO ] [REMOTE ] ETB: Full fetch complete (17779 records). [2025-09-24T18:42:36.849258] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-24T18:42:37.242223] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-24T18:42:37.242375] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-24T18:42:37.243014] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-24T18:42:37.243105] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-24T18:42:37.244280] [DEBUG] [LOCAL ] ETB: Trimmed 17779 records to 11967 (keeping 200 days of data) [2025-09-24T18:42:37.329319] [DEBUG] [LOCAL ] ETB: Primary data saved (11967 records). [2025-09-24T18:42:37.329493] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-24T18:42:37.329712] [INFO ] [MAIN ] Update Progress: 774/2373 symbols completed. ETB took 28.4s. Estimated remaining: 3h 31m 53s. Rate: 7.5 symbols/min [2025-09-24T18:42:37.521588] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:37.540690] [DEBUG] [LOCAL ] ETJ: Loaded 16617 existing records from primary storage. [2025-09-24T18:42:37.540857] [INFO ] [MAIN ] ETJ: Loaded 16617 existing records. [2025-09-24T18:42:37.617859] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-24T18:42:37.744585] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:37.744992] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-24T18:42:37.745062] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-24T18:42:37.745794] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-24T18:42:37.745859] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-24T18:42:37.955028] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T18:42:38.186211] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:38.416123] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-24T18:42:38.991774] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T18:42:38.997411] [INFO ] [REMOTE ] ETD: Full fetch complete (38008 records). [2025-09-24T18:42:38.997545] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-24T18:42:39.221220] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-24T18:42:39.391153] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-24T18:42:39.391252] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-24T18:42:39.392105] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-24T18:42:39.392187] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-24T18:42:39.394970] [DEBUG] [LOCAL ] ETD: Trimmed 38008 records to 27360 (keeping 200 days of data) [2025-09-24T18:42:39.571822] [DEBUG] [LOCAL ] ETD: Primary data saved (27360 records). [2025-09-24T18:42:39.571957] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-24T18:42:39.572068] [INFO ] [MAIN ] Update Progress: 775/2373 symbols completed. ETD took 23.1s. Estimated remaining: 3h 31m 33s. Rate: 7.6 symbols/min [2025-09-24T18:42:39.743493] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:39.803970] [DEBUG] [LOCAL ] ETN: Loaded 52836 existing records from primary storage. [2025-09-24T18:42:39.804115] [INFO ] [MAIN ] ETN: Loaded 52836 existing records. [2025-09-24T18:42:39.984915] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:39.985156] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-24T18:42:39.985217] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-24T18:42:39.988044] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-24T18:42:39.988119] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-24T18:42:40.021245] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-24T18:42:40.388353] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:40.383030] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-24T18:42:40.827450] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-24T18:42:40.835135] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-24T18:42:41.072107] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T18:42:41.616089] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-24T18:42:42.416067] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-24T18:42:42.715718] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:42:42.763908] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T18:42:43.216119] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-24T18:42:43.971351] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T18:42:43.975626] [INFO ] [REMOTE ] ETG: Full fetch complete (24887 records). [2025-09-24T18:42:43.975728] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-24T18:42:44.021362] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-24T18:42:44.363787] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-24T18:42:44.363975] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-24T18:42:44.364544] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-24T18:42:44.364704] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-24T18:42:44.365824] [DEBUG] [LOCAL ] ETG: Trimmed 24887 records to 16563 (keeping 200 days of data) [2025-09-24T18:42:44.483765] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T18:42:44.498035] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-24T18:42:44.499731] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-24T18:42:44.819359] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-24T18:42:44.929185] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-24T18:42:44.929532] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-24T18:42:44.930910] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-24T18:42:44.931367] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-24T18:42:44.935909] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-09-24T18:42:44.940770] [DEBUG] [LOCAL ] ETG: Primary data saved (16563 records). [2025-09-24T18:42:44.940871] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-24T18:42:44.940996] [INFO ] [MAIN ] Update Progress: 776/2373 symbols completed. ETG took 23.0s. Estimated remaining: 3h 31m 20s. Rate: 7.6 symbols/min [2025-09-24T18:42:45.245510] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:45.253483] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T18:42:45.280846] [DEBUG] [LOCAL ] ETO: Loaded 6492 existing records from primary storage. [2025-09-24T18:42:45.284900] [INFO ] [MAIN ] ETO: Loaded 6492 existing records. [2025-09-24T18:42:45.568570] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:45.570840] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-24T18:42:45.571147] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-24T18:42:45.572015] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-24T18:42:45.572620] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-24T18:42:45.617743] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-24T18:42:45.981326] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:46.070592] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-24T18:42:46.070827] [INFO ] [MAIN ] ET: Full history saved. [2025-09-24T18:42:46.070980] [INFO ] [MAIN ] Update Progress: 777/2373 symbols completed. ET took 54.4s. Estimated remaining: 3h 30m 58s. Rate: 7.6 symbols/min [2025-09-24T18:42:46.312934] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:42:46.380330] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-09-24T18:42:46.380504] [INFO ] [MAIN ] ETR: Loaded 53225 existing records. [2025-09-24T18:42:46.431808] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-24T18:42:46.588422] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:42:46.589360] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-24T18:42:46.589491] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-24T18:42:46.601326] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T18:42:46.606025] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-24T18:42:46.606571] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-24T18:42:46.971504] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:42:47.000221] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T18:42:47.216033] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-24T18:42:47.233621] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T18:42:48.016072] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-24T18:42:48.816136] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-24T18:42:48.949241] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T18:42:49.100429] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T18:42:49.616136] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-24T18:42:50.416055] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-24T18:42:50.687436] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T18:42:50.777798] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T18:42:51.043351] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T18:42:51.216126] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-24T18:42:52.016127] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-24T18:42:52.109918] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T18:42:52.816102] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-24T18:42:53.428486] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-24T18:42:53.616048] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-24T18:42:54.103856] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T18:42:54.342224] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T18:42:54.416048] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-24T18:42:55.143832] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T18:42:55.216072] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-24T18:42:55.894738] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T18:42:56.016065] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-24T18:42:56.816086] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-24T18:42:57.616118] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-24T18:42:57.758928] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T18:42:58.027513] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T18:42:58.416101] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-24T18:42:59.216068] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-24T18:42:59.320137] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T18:42:59.426843] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T18:43:00.016122] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-24T18:43:00.816054] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-24T18:43:01.089248] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T18:43:01.236193] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T18:43:01.441960] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:43:01.616148] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-24T18:43:02.416104] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-24T18:43:03.216090] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-24T18:43:03.392618] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T18:43:04.016072] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-24T18:43:04.388584] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T18:43:04.480976] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T18:43:04.539336] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T18:43:04.816115] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-24T18:43:05.524045] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T18:43:05.525591] [INFO ] [REMOTE ] ETO: Full fetch complete (9276 records). [2025-09-24T18:43:05.525690] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-24T18:43:05.621224] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-24T18:43:05.908605] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-24T18:43:05.908715] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-24T18:43:05.908966] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-24T18:43:05.909009] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-24T18:43:05.909427] [DEBUG] [LOCAL ] ETO: Trimmed 9276 records to 6493 (keeping 200 days of data) [2025-09-24T18:43:05.953574] [DEBUG] [LOCAL ] ETO: Primary data saved (6493 records). [2025-09-24T18:43:05.953705] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-24T18:43:05.953810] [INFO ] [MAIN ] Update Progress: 778/2373 symbols completed. ETO took 21.0s. Estimated remaining: 3h 31m 14s. Rate: 7.6 symbols/min [2025-09-24T18:43:06.127874] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:06.152147] [DEBUG] [LOCAL ] ETV: Loaded 21362 existing records from primary storage. [2025-09-24T18:43:06.152397] [INFO ] [MAIN ] ETV: Loaded 21362 existing records. [2025-09-24T18:43:06.330066] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:06.330404] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-24T18:43:06.330461] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-24T18:43:06.331690] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-24T18:43:06.331750] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-24T18:43:06.421197] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-24T18:43:06.643597] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T18:43:06.727371] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:07.216095] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-24T18:43:08.016084] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-24T18:43:08.622404] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T18:43:08.816060] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-24T18:43:08.994731] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T18:43:09.436224] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T18:43:09.616101] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-24T18:43:10.416056] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-24T18:43:10.597208] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T18:43:10.602631] [INFO ] [REMOTE ] ETJ: Full fetch complete (24951 records). [2025-09-24T18:43:10.602754] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-24T18:43:10.985983] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-24T18:43:10.986128] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-24T18:43:10.986962] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-24T18:43:10.987046] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-24T18:43:10.988143] [DEBUG] [LOCAL ] ETJ: Trimmed 24951 records to 16647 (keeping 200 days of data) [2025-09-24T18:43:11.086846] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T18:43:11.125463] [DEBUG] [LOCAL ] ETJ: Primary data saved (16647 records). [2025-09-24T18:43:11.125589] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-24T18:43:11.125693] [INFO ] [MAIN ] Update Progress: 779/2373 symbols completed. ETJ took 33.8s. Estimated remaining: 3h 31m 1s. Rate: 7.6 symbols/min [2025-09-24T18:43:11.221309] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-24T18:43:11.309846] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:11.335792] [DEBUG] [LOCAL ] ETW: Loaded 25080 existing records from primary storage. [2025-09-24T18:43:11.335921] [INFO ] [MAIN ] ETW: Loaded 25080 existing records. [2025-09-24T18:43:11.523231] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:11.523821] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-24T18:43:11.524020] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-24T18:43:11.529817] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-24T18:43:11.537779] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-24T18:43:11.572704] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T18:43:11.906196] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:12.016058] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-24T18:43:12.816074] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-24T18:43:13.147355] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T18:43:13.616059] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-24T18:43:13.766028] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T18:43:14.115255] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T18:43:14.416105] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-24T18:43:15.216165] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-24T18:43:15.492711] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T18:43:15.550325] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T18:43:16.016120] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-24T18:43:16.128092] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T18:43:16.816157] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-24T18:43:17.616167] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-24T18:43:17.915123] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T18:43:18.416149] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-24T18:43:18.994988] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-24T18:43:19.004118] [INFO ] [REMOTE ] ETN: Full fetch complete (76585 records). [2025-09-24T18:43:19.004248] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-24T18:43:19.222875] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-24T18:43:19.240338] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T18:43:19.438017] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-24T18:43:19.438104] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-24T18:43:19.439139] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-24T18:43:19.439204] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-24T18:43:19.441024] [DEBUG] [LOCAL ] ETN: Trimmed 76585 records to 52834 (keeping 200 days of data) [2025-09-24T18:43:19.528023] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T18:43:19.808297] [DEBUG] [LOCAL ] ETN: Primary data saved (52834 records). [2025-09-24T18:43:19.808451] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-24T18:43:19.808542] [INFO ] [MAIN ] Update Progress: 780/2373 symbols completed. ETN took 40.2s. Estimated remaining: 3h 30m 54s. Rate: 7.6 symbols/min [2025-09-24T18:43:19.990878] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:19.998390] [DEBUG] [LOCAL ] ETX: Loaded 4964 existing records from primary storage. [2025-09-24T18:43:19.998503] [INFO ] [MAIN ] ETX: Loaded 4964 existing records. [2025-09-24T18:43:20.021200] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-24T18:43:20.192718] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:20.193001] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-24T18:43:20.193051] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-24T18:43:20.193442] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-24T18:43:20.193503] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-24T18:43:20.555476] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:20.816045] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-24T18:43:21.214612] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T18:43:21.228270] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T18:43:21.616128] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-24T18:43:21.969191] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T18:43:22.416117] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-24T18:43:22.736629] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T18:43:22.868182] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T18:43:23.216100] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-24T18:43:23.851106] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T18:43:24.016114] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-24T18:43:24.489821] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-24T18:43:24.816090] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-24T18:43:25.616080] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-24T18:43:26.180285] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T18:43:26.416134] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-24T18:43:26.517869] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T18:43:26.527563] [INFO ] [REMOTE ] ETR: Full fetch complete (76978 records). [2025-09-24T18:43:26.527796] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-24T18:43:26.926170] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-24T18:43:26.926402] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-24T18:43:26.927730] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-24T18:43:26.927803] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-24T18:43:26.929471] [DEBUG] [LOCAL ] ETR: Trimmed 76978 records to 53223 (keeping 200 days of data) [2025-09-24T18:43:27.180269] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T18:43:27.248733] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-24T18:43:27.307563] [DEBUG] [LOCAL ] ETR: Primary data saved (53223 records). [2025-09-24T18:43:27.307821] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-24T18:43:27.307944] [INFO ] [MAIN ] Update Progress: 781/2373 symbols completed. ETR took 41.2s. Estimated remaining: 3h 30m 46s. Rate: 7.6 symbols/min [2025-09-24T18:43:27.492942] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:27.523409] [DEBUG] [LOCAL ] ETY: Loaded 22694 existing records from primary storage. [2025-09-24T18:43:27.523692] [INFO ] [MAIN ] ETY: Loaded 22694 existing records. [2025-09-24T18:43:27.740134] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:27.740454] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-24T18:43:27.740505] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-24T18:43:27.741426] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-24T18:43:27.741498] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-24T18:43:27.943325] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T18:43:28.021310] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-24T18:43:28.143934] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:28.816089] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-24T18:43:29.316590] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T18:43:29.616122] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-24T18:43:30.317339] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T18:43:30.338517] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T18:43:30.416138] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-24T18:43:31.052019] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T18:43:31.216111] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-24T18:43:32.016082] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-24T18:43:32.288791] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T18:43:32.816108] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-24T18:43:33.119592] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T18:43:33.616070] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-24T18:43:33.959686] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T18:43:33.966215] [INFO ] [REMOTE ] ETV: Full fetch complete (31730 records). [2025-09-24T18:43:33.966418] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-24T18:43:34.354905] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-24T18:43:34.355038] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-24T18:43:34.355709] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-24T18:43:34.355772] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-24T18:43:34.356554] [DEBUG] [LOCAL ] ETV: Trimmed 31730 records to 21358 (keeping 200 days of data) [2025-09-24T18:43:34.423750] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-24T18:43:34.494354] [DEBUG] [LOCAL ] ETV: Primary data saved (21358 records). [2025-09-24T18:43:34.494477] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-24T18:43:34.494557] [INFO ] [MAIN ] Update Progress: 782/2373 symbols completed. ETV took 28.5s. Estimated remaining: 3h 30m 36s. Rate: 7.6 symbols/min [2025-09-24T18:43:34.669497] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:34.683984] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T18:43:34.704093] [DEBUG] [LOCAL ] EVC: Loaded 19546 existing records from primary storage. [2025-09-24T18:43:34.704213] [INFO ] [MAIN ] EVC: Loaded 19546 existing records. [2025-09-24T18:43:34.880202] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:34.880454] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-24T18:43:34.880503] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-24T18:43:34.880996] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-24T18:43:34.881057] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-24T18:43:35.242493] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:35.237086] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-24T18:43:35.873079] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T18:43:36.016068] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-24T18:43:36.115290] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T18:43:36.816091] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-24T18:43:37.249349] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T18:43:37.616085] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-24T18:43:37.954406] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T18:43:38.416053] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-24T18:43:38.795166] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T18:43:39.216080] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-24T18:43:39.755386] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T18:43:40.016074] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-24T18:43:40.513055] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T18:43:40.518080] [INFO ] [REMOTE ] ETW: Full fetch complete (36276 records). [2025-09-24T18:43:40.518191] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-24T18:43:40.818078] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-24T18:43:40.826079] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T18:43:40.856941] [INFO ] [REMOTE ] ETX: Full fetch complete (7030 records). [2025-09-24T18:43:40.861430] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-24T18:43:41.073336] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-24T18:43:41.078565] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-24T18:43:41.084569] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-24T18:43:41.094908] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-24T18:43:41.131012] [DEBUG] [LOCAL ] ETW: Trimmed 36276 records to 25028 (keeping 200 days of data) [2025-09-24T18:43:41.442691] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-24T18:43:41.443038] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-24T18:43:41.444502] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-24T18:43:41.444581] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-24T18:43:41.447691] [DEBUG] [LOCAL ] ETX: Trimmed 7030 records to 4965 (keeping 200 days of data) [2025-09-24T18:43:41.492295] [DEBUG] [LOCAL ] ETX: Primary data saved (4965 records). [2025-09-24T18:43:41.493556] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-24T18:43:41.493992] [INFO ] [MAIN ] Update Progress: 783/2373 symbols completed. ETX took 21.7s. Estimated remaining: 3h 30m 26s. Rate: 7.6 symbols/min [2025-09-24T18:43:41.625051] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-24T18:43:41.739763] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:41.738138] [DEBUG] [LOCAL ] ETW: Primary data saved (25028 records). [2025-09-24T18:43:41.740193] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-24T18:43:41.740282] [INFO ] [MAIN ] Update Progress: 784/2373 symbols completed. ETW took 30.6s. Estimated remaining: 3h 30m 3s. Rate: 7.6 symbols/min [2025-09-24T18:43:41.938788] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:43:41.951263] [DEBUG] [LOCAL ] EVEX: Loaded 29806 existing records from primary storage. [2025-09-24T18:43:41.951445] [INFO ] [MAIN ] EVEX: Loaded 29806 existing records. [2025-09-24T18:43:42.072836] [DEBUG] [LOCAL ] EVF: Loaded 9163 existing records from primary storage. [2025-09-24T18:43:42.073076] [INFO ] [MAIN ] EVF: Loaded 9163 existing records. [2025-09-24T18:43:42.284632] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:42.285838] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T18:43:42.297688] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-24T18:43:42.308098] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-24T18:43:42.314235] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-24T18:43:42.319413] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-24T18:43:42.426688] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-24T18:43:42.454610] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:43:42.468182] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-24T18:43:42.492366] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-24T18:43:42.498182] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-24T18:43:42.513689] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-24T18:43:43.134056] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:43.235680] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-24T18:43:43.272584] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:43:43.276200] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T18:43:43.695092] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T18:43:44.016079] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-24T18:43:44.556773] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T18:43:44.800698] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T18:43:44.816049] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-24T18:43:45.466703] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T18:43:45.616099] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-24T18:43:46.416061] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-24T18:43:46.710785] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T18:43:47.216109] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-24T18:43:47.644669] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T18:43:47.795427] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T18:43:48.016070] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-24T18:43:48.747163] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T18:43:48.816100] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-24T18:43:49.616086] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-24T18:43:49.875786] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T18:43:50.416084] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-24T18:43:50.935129] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T18:43:51.216101] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-24T18:43:51.753569] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T18:43:52.016076] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-24T18:43:52.311100] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T18:43:52.816127] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-24T18:43:53.050407] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T18:43:53.598345] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T18:43:53.616106] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-24T18:43:54.416096] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-24T18:43:54.916982] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T18:43:55.216086] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-24T18:43:55.346504] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T18:43:56.016060] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-24T18:43:56.063807] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T18:43:56.816080] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-24T18:43:57.184875] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T18:43:57.504739] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T18:43:57.616088] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-24T18:43:58.416097] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-24T18:43:58.530152] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T18:43:59.131558] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T18:43:59.216103] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-24T18:43:59.824732] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T18:44:00.016078] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-24T18:44:00.816061] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-24T18:44:00.842205] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T18:44:01.616083] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-24T18:44:02.358821] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T18:44:02.416090] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-24T18:44:03.099557] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T18:44:03.216111] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-24T18:44:03.828631] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T18:44:04.016061] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-24T18:44:04.189834] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T18:44:04.816089] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-24T18:44:05.066052] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T18:44:05.616171] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-24T18:44:05.824099] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T18:44:05.827920] [INFO ] [REMOTE ] ETY: Full fetch complete (33895 records). [2025-09-24T18:44:05.828017] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-24T18:44:05.828516] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:44:05.828605] [FATAL] [MAIN ] ETY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:44:05.828679] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:44:05.828739] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-24T18:44:05.828800] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-09-24T18:44:05.828837] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-09-24T18:44:05.829382] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-09-24T18:44:05.829480] [INFO ] [MAIN ] Update Progress: 785/2373 symbols completed. ETY took 38.5s. Estimated remaining: 3h 30m 27s. Rate: 7.5 symbols/min [2025-09-24T18:44:06.011169] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:06.019734] [DEBUG] [LOCAL ] EVG: Loaded 5777 existing records from primary storage. [2025-09-24T18:44:06.019863] [INFO ] [MAIN ] EVG: Loaded 5777 existing records. [2025-09-24T18:44:06.194271] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:06.194539] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-24T18:44:06.194587] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-24T18:44:06.194974] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-24T18:44:06.195033] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-24T18:44:06.422404] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-24T18:44:06.553179] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:06.568283] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T18:44:07.216097] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-24T18:44:07.245937] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T18:44:07.248475] [INFO ] [REMOTE ] EVF: Full fetch complete (11914 records). [2025-09-24T18:44:07.248557] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-24T18:44:07.664200] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-24T18:44:07.664307] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-24T18:44:07.664684] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-24T18:44:07.664769] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-24T18:44:07.665550] [DEBUG] [LOCAL ] EVF: Trimmed 11914 records to 9239 (keeping 200 days of data) [2025-09-24T18:44:07.724699] [DEBUG] [LOCAL ] EVF: Primary data saved (9239 records). [2025-09-24T18:44:07.724856] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-24T18:44:07.724946] [INFO ] [MAIN ] Update Progress: 786/2373 symbols completed. EVF took 26.0s. Estimated remaining: 3h 30m 7s. Rate: 7.6 symbols/min [2025-09-24T18:44:07.925197] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:07.977679] [DEBUG] [LOCAL ] EVH: Loaded 49348 existing records from primary storage. [2025-09-24T18:44:07.977846] [INFO ] [MAIN ] EVH: Loaded 49348 existing records. [2025-09-24T18:44:08.021218] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-24T18:44:08.187061] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:08.187331] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-24T18:44:08.187381] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-24T18:44:08.188695] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-24T18:44:08.188758] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-24T18:44:08.282934] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T18:44:08.583399] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:08.816061] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-24T18:44:08.983049] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T18:44:09.616155] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-24T18:44:10.416168] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-24T18:44:10.736593] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T18:44:11.167780] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T18:44:11.176832] [INFO ] [REMOTE ] EVEX: Full fetch complete (41673 records). [2025-09-24T18:44:11.177015] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-24T18:44:11.224513] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-24T18:44:11.525099] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T18:44:11.599324] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-24T18:44:11.599424] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-24T18:44:11.600414] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-24T18:44:11.600482] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-24T18:44:11.601773] [DEBUG] [LOCAL ] EVEX: Trimmed 41673 records to 29987 (keeping 200 days of data) [2025-09-24T18:44:11.784728] [DEBUG] [LOCAL ] EVEX: Primary data saved (29987 records). [2025-09-24T18:44:11.784898] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-24T18:44:11.785004] [INFO ] [MAIN ] Update Progress: 787/2373 symbols completed. EVEX took 30.3s. Estimated remaining: 3h 29m 51s. Rate: 7.6 symbols/min [2025-09-24T18:44:11.969138] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:11.981675] [DEBUG] [LOCAL ] EVN: Loaded 10996 existing records from primary storage. [2025-09-24T18:44:11.981823] [INFO ] [MAIN ] EVN: Loaded 10996 existing records. [2025-09-24T18:44:12.023738] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-24T18:44:12.197806] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:12.198097] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-24T18:44:12.198165] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-24T18:44:12.198718] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-24T18:44:12.198786] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-24T18:44:12.564996] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:12.791708] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T18:44:12.816054] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-24T18:44:13.135296] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T18:44:13.138759] [INFO ] [REMOTE ] EVC: Full fetch complete (30991 records). [2025-09-24T18:44:13.138855] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-24T18:44:13.513618] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-24T18:44:13.513729] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-24T18:44:13.514336] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-24T18:44:13.514376] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-24T18:44:13.515130] [DEBUG] [LOCAL ] EVC: Trimmed 30991 records to 19293 (keeping 200 days of data) [2025-09-24T18:44:13.616559] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-24T18:44:13.629117] [DEBUG] [LOCAL ] EVC: Primary data saved (19293 records). [2025-09-24T18:44:13.629247] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-24T18:44:13.629334] [INFO ] [MAIN ] Update Progress: 788/2373 symbols completed. EVC took 39.1s. Estimated remaining: 3h 29m 31s. Rate: 7.6 symbols/min [2025-09-24T18:44:13.800359] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:13.849418] [DEBUG] [LOCAL ] EVR: Loaded 35659 existing records from primary storage. [2025-09-24T18:44:13.849590] [INFO ] [MAIN ] EVR: Loaded 35659 existing records. [2025-09-24T18:44:14.054728] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:14.056802] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-24T18:44:14.056494] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T18:44:14.060298] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-24T18:44:14.062242] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-24T18:44:14.062307] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-24T18:44:14.327174] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T18:44:14.424853] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-24T18:44:14.469597] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:15.216088] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-24T18:44:15.307870] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T18:44:16.016070] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-24T18:44:16.587288] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T18:44:16.791817] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T18:44:16.816077] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-24T18:44:17.616081] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-24T18:44:18.199284] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T18:44:18.416123] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-24T18:44:18.464122] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T18:44:19.216123] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-24T18:44:20.016073] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-24T18:44:20.059374] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T18:44:20.550402] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T18:44:20.796896] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T18:44:20.816033] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-24T18:44:21.487544] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T18:44:21.616070] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-24T18:44:22.416081] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-24T18:44:22.993944] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T18:44:23.109759] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:44:23.216080] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-24T18:44:24.016050] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-24T18:44:24.088401] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:44:24.643398] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T18:44:24.816117] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-24T18:44:25.616083] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-24T18:44:26.416069] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-24T18:44:26.430917] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T18:44:26.502397] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T18:44:27.216086] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-24T18:44:27.964267] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T18:44:27.964598] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T18:44:28.016083] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-24T18:44:28.816092] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-24T18:44:28.896612] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T18:44:29.616092] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-24T18:44:29.853602] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T18:44:29.855179] [INFO ] [REMOTE ] EVG: Full fetch complete (8048 records). [2025-09-24T18:44:29.855249] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-24T18:44:30.263242] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-24T18:44:30.263346] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-24T18:44:30.263578] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-24T18:44:30.263619] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-24T18:44:30.264048] [DEBUG] [LOCAL ] EVG: Trimmed 8048 records to 5816 (keeping 200 days of data) [2025-09-24T18:44:30.301407] [DEBUG] [LOCAL ] EVG: Primary data saved (5816 records). [2025-09-24T18:44:30.301529] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-24T18:44:30.301635] [INFO ] [MAIN ] Update Progress: 789/2373 symbols completed. EVG took 24.5s. Estimated remaining: 3h 29m 41s. Rate: 7.6 symbols/min [2025-09-24T18:44:30.421261] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-24T18:44:30.478934] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:30.479128] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-09-24T18:44:30.479172] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-09-24T18:44:30.479318] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-24T18:44:30.479361] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-24T18:44:30.479402] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-24T18:44:30.479458] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-24T18:44:30.836901] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:31.216110] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-24T18:44:31.338992] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:44:31.703860] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:44:32.016122] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-24T18:44:32.286469] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T18:44:32.816132] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-24T18:44:33.367101] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T18:44:33.395528] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T18:44:33.616130] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-24T18:44:34.416095] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-24T18:44:34.630996] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T18:44:35.216058] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-24T18:44:35.296441] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T18:44:36.016069] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-24T18:44:36.817441] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-24T18:44:36.822161] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T18:44:36.892639] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-24T18:44:37.616087] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-24T18:44:37.792359] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T18:44:38.416100] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-24T18:44:39.216072] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-24T18:44:39.334076] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T18:44:39.443052] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T18:44:40.016068] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-24T18:44:40.067425] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T18:44:40.816079] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-24T18:44:41.616077] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-24T18:44:41.724027] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T18:44:41.726849] [INFO ] [REMOTE ] EVN: Full fetch complete (17498 records). [2025-09-24T18:44:41.726925] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-24T18:44:42.050157] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T18:44:42.109027] [INFO ] [REMOTE ] EVH: Full fetch complete (71755 records). [2025-09-24T18:44:42.118961] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-24T18:44:42.219859] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-24T18:44:42.242101] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-24T18:44:42.253434] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-24T18:44:42.259272] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-24T18:44:42.298290] [DEBUG] [LOCAL ] EVN: Trimmed 17498 records to 11052 (keeping 200 days of data) [2025-09-24T18:44:42.429044] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-24T18:44:42.652273] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-24T18:44:42.654482] [DEBUG] [LOCAL ] EVN: Primary data saved (11052 records). [2025-09-24T18:44:42.654580] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-24T18:44:42.654804] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-24T18:44:42.655921] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-24T18:44:42.656095] [INFO ] [MAIN ] Update Progress: 790/2373 symbols completed. EVN took 30.9s. Estimated remaining: 3h 29m 42s. Rate: 7.5 symbols/min [2025-09-24T18:44:42.656198] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-24T18:44:42.765319] [DEBUG] [LOCAL ] EVH: Trimmed 71755 records to 49356 (keeping 200 days of data) [2025-09-24T18:44:42.924101] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:42.966097] [DEBUG] [LOCAL ] EVTC: Loaded 26511 existing records from primary storage. [2025-09-24T18:44:42.968945] [INFO ] [MAIN ] EVTC: Loaded 26511 existing records. [2025-09-24T18:44:43.244028] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:43.245720] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-24T18:44:43.246251] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-24T18:44:43.269579] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-24T18:44:43.270266] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-24T18:44:43.285017] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T18:44:43.373494] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-24T18:44:43.613046] [DEBUG] [LOCAL ] EVH: Primary data saved (49356 records). [2025-09-24T18:44:43.627587] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-24T18:44:43.640032] [INFO ] [MAIN ] Update Progress: 791/2373 symbols completed. EVH took 35.9s. Estimated remaining: 3h 29m 20s. Rate: 7.6 symbols/min [2025-09-24T18:44:43.667930] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T18:44:43.882408] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:43.944952] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:43.980387] [DEBUG] [LOCAL ] EVTL: Loaded 37168 existing records from primary storage. [2025-09-24T18:44:43.980525] [INFO ] [MAIN ] EVTL: Loaded 37168 existing records. [2025-09-24T18:44:44.022941] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-24T18:44:44.162439] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:44.162724] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-24T18:44:44.162780] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-24T18:44:44.163934] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-24T18:44:44.163994] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-24T18:44:44.536718] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:44.691577] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T18:44:44.816044] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-24T18:44:45.543412] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T18:44:45.616124] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-24T18:44:46.353287] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T18:44:46.416036] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-24T18:44:46.710523] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T18:44:47.216090] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-24T18:44:47.629334] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T18:44:48.016093] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-24T18:44:48.453267] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T18:44:48.816137] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-24T18:44:49.479327] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T18:44:49.485256] [INFO ] [REMOTE ] EVR: Full fetch complete (50790 records). [2025-09-24T18:44:49.485373] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-24T18:44:49.625803] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-24T18:44:49.877117] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-24T18:44:49.877286] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-24T18:44:49.878284] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-24T18:44:49.878401] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-24T18:44:49.885266] [DEBUG] [LOCAL ] EVR: Trimmed 50790 records to 35549 (keeping 200 days of data) [2025-09-24T18:44:49.894231] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T18:44:50.134297] [DEBUG] [LOCAL ] EVR: Primary data saved (35549 records). [2025-09-24T18:44:50.134699] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-24T18:44:50.134908] [INFO ] [MAIN ] Update Progress: 792/2373 symbols completed. EVR took 36.5s. Estimated remaining: 3h 29m 9s. Rate: 7.6 symbols/min [2025-09-24T18:44:50.309946] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:44:50.332621] [DEBUG] [LOCAL ] EVTR: Loaded 23118 existing records from primary storage. [2025-09-24T18:44:50.332788] [INFO ] [MAIN ] EVTR: Loaded 23118 existing records. [2025-09-24T18:44:50.421817] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-24T18:44:50.515634] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:44:50.515967] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-24T18:44:50.516028] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-24T18:44:50.516874] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-24T18:44:50.516935] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-24T18:44:50.909361] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:44:50.925245] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T18:44:51.216133] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-24T18:44:52.005748] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:44:52.016018] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-24T18:44:52.137638] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T18:44:52.816090] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-24T18:44:53.460133] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T18:44:53.616060] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-24T18:44:54.011325] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T18:44:54.416136] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-24T18:44:54.692445] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T18:44:55.216069] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-24T18:44:55.357719] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T18:44:56.016074] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-24T18:44:56.477946] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T18:44:56.600060] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T18:44:56.816089] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-24T18:44:57.616082] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-24T18:44:58.265201] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T18:44:58.416103] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-24T18:44:58.691015] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T18:44:59.216177] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-24T18:44:59.469561] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T18:45:00.016069] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-24T18:45:00.816107] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-24T18:45:00.929442] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T18:45:00.978954] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T18:45:01.616125] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-24T18:45:02.416083] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-24T18:45:02.587234] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T18:45:03.216134] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-24T18:45:04.016107] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-24T18:45:05.546460] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (3.93 seconds). [2025-09-24T18:45:05.551398] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-24T18:45:06.160844] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (3.74 seconds). [2025-09-24T18:45:06.169908] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-24T18:45:06.363538] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-24T18:45:06.416124] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-24T18:45:06.691032] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (3.47 seconds). [2025-09-24T18:45:06.828548] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T18:45:07.216159] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-24T18:45:07.739224] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T18:45:08.016083] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-24T18:45:08.285277] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T18:45:08.309204] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-24T18:45:08.816085] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-24T18:45:09.260806] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T18:45:09.616120] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-24T18:45:10.416063] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-24T18:45:10.684551] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T18:45:11.034659] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T18:45:11.041715] [INFO ] [REMOTE ] EVTC: Full fetch complete (37705 records). [2025-09-24T18:45:11.041910] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-24T18:45:11.042938] [FATAL] [VALIDATOR ] EVTC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:45:11.043066] [FATAL] [MAIN ] EVTC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:45:11.043147] [WARN ] [MAIN ] EVTC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:45:11.043246] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-24T18:45:11.043386] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-24T18:45:11.043508] [INFO ] [LOCAL ] EVTC: Starting deletion of derivative data. [2025-09-24T18:45:11.044020] [DEBUG] [LOCAL ] EVTC: Deleted derivative data file. [2025-09-24T18:45:11.044210] [INFO ] [MAIN ] Update Progress: 793/2373 symbols completed. EVTC took 28.4s. Estimated remaining: 3h 29m 27s. Rate: 7.5 symbols/min [2025-09-24T18:45:11.220670] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-24T18:45:11.222183] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:11.292105] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-24T18:45:11.292296] [INFO ] [MAIN ] EW: Loaded 53396 existing records. [2025-09-24T18:45:11.483230] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:11.483729] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-24T18:45:11.483804] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-24T18:45:11.486265] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-24T18:45:11.486378] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-24T18:45:11.864911] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T18:45:11.887090] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:12.016063] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-24T18:45:12.816098] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-24T18:45:13.616052] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-24T18:45:13.774041] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-24T18:45:13.784767] [INFO ] [REMOTE ] EVTL: Full fetch complete (50573 records). [2025-09-24T18:45:13.784921] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-24T18:45:14.252100] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-24T18:45:14.252273] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-24T18:45:14.253173] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-24T18:45:14.253329] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-24T18:45:14.254957] [DEBUG] [LOCAL ] EVTL: Trimmed 50573 records to 37386 (keeping 200 days of data) [2025-09-24T18:45:14.386243] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-24T18:45:14.452138] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-24T18:45:14.516365] [DEBUG] [LOCAL ] EVTL: Primary data saved (37386 records). [2025-09-24T18:45:14.516529] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-24T18:45:14.516625] [INFO ] [MAIN ] Update Progress: 794/2373 symbols completed. EVTL took 30.9s. Estimated remaining: 3h 29m 10s. Rate: 7.5 symbols/min [2025-09-24T18:45:14.686476] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:14.722007] [DEBUG] [LOCAL ] EXG: Loaded 34386 existing records from primary storage. [2025-09-24T18:45:14.722151] [INFO ] [MAIN ] EXG: Loaded 34386 existing records. [2025-09-24T18:45:14.914246] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:14.914859] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-24T18:45:14.915015] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-24T18:45:14.916183] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-24T18:45:14.916248] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-24T18:45:15.048955] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-24T18:45:15.230593] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-24T18:45:15.330729] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:15.690161] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T18:45:15.693764] [INFO ] [REMOTE ] EVT: Full fetch complete (25307 records). [2025-09-24T18:45:15.693850] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-24T18:45:16.021164] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-24T18:45:16.087890] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-24T18:45:16.087977] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-24T18:45:16.088537] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-24T18:45:16.088577] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-24T18:45:16.090265] [DEBUG] [LOCAL ] EVT: Trimmed 25307 records to 17104 (keeping 200 days of data) [2025-09-24T18:45:16.215935] [DEBUG] [LOCAL ] EVT: Primary data saved (17104 records). [2025-09-24T18:45:16.216093] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-24T18:45:16.216212] [INFO ] [MAIN ] Update Progress: 795/2373 symbols completed. EVT took 45.9s. Estimated remaining: 3h 28m 50s. Rate: 7.6 symbols/min [2025-09-24T18:45:16.390699] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:16.454263] [DEBUG] [LOCAL ] EXK: Loaded 53111 existing records from primary storage. [2025-09-24T18:45:16.454454] [INFO ] [MAIN ] EXK: Loaded 53111 existing records. [2025-09-24T18:45:16.648543] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:16.649351] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-24T18:45:16.649420] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-24T18:45:16.650846] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-24T18:45:16.650926] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-24T18:45:16.812735] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-24T18:45:16.964379] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-24T18:45:16.980134] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T18:45:17.050503] [INFO ] [REMOTE ] EVTR: Full fetch complete (31868 records). [2025-09-24T18:45:17.105235] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:17.101481] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-24T18:45:17.528332] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T18:45:17.528737] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-24T18:45:17.536030] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-24T18:45:17.537480] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-24T18:45:17.537546] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-24T18:45:17.539228] [DEBUG] [LOCAL ] EVTR: Trimmed 31868 records to 23269 (keeping 200 days of data) [2025-09-24T18:45:17.635856] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-24T18:45:17.701351] [DEBUG] [LOCAL ] EVTR: Primary data saved (23269 records). [2025-09-24T18:45:17.701496] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-24T18:45:17.701588] [INFO ] [MAIN ] Update Progress: 796/2373 symbols completed. EVTR took 27.6s. Estimated remaining: 3h 28m 29s. Rate: 7.6 symbols/min [2025-09-24T18:45:17.879057] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:17.920135] [DEBUG] [LOCAL ] EXP: Loaded 30120 existing records from primary storage. [2025-09-24T18:45:17.920299] [INFO ] [MAIN ] EXP: Loaded 30120 existing records. [2025-09-24T18:45:18.096495] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:18.096782] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-24T18:45:18.096839] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-24T18:45:18.097771] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-24T18:45:18.097831] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-24T18:45:18.422219] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-24T18:45:18.452685] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:18.718418] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:45:19.216089] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-24T18:45:19.650605] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T18:45:19.738620] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T18:45:20.016099] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-24T18:45:20.816066] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-24T18:45:21.160262] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T18:45:21.219904] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T18:45:21.616102] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-24T18:45:22.029796] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:45:22.416095] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-24T18:45:22.839915] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T18:45:23.216123] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-24T18:45:24.016062] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-24T18:45:24.156480] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:45:24.553328] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T18:45:24.816077] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-24T18:45:25.215806] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T18:45:25.616084] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-24T18:45:25.903180] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T18:45:26.416087] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-24T18:45:27.216081] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-24T18:45:27.437366] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:45:27.822067] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T18:45:28.016099] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-24T18:45:28.816069] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-24T18:45:28.936234] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:45:29.626443] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-24T18:45:29.633296] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T18:45:30.224719] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T18:45:30.416086] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-24T18:45:31.216179] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-24T18:45:31.311062] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T18:45:32.016173] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-24T18:45:32.355222] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T18:45:32.583622] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T18:45:32.816080] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-24T18:45:33.616110] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-24T18:45:33.745059] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T18:45:34.161279] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T18:45:34.416148] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-24T18:45:34.930564] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T18:45:35.216116] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-24T18:45:36.016067] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-24T18:45:36.160053] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T18:45:36.791985] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T18:45:36.816054] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-24T18:45:37.606810] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T18:45:37.616128] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-24T18:45:38.416049] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-24T18:45:38.453276] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T18:45:38.850380] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T18:45:39.216105] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-24T18:45:40.016059] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-24T18:45:40.281989] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T18:45:40.504840] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T18:45:40.816097] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-24T18:45:41.244418] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T18:45:41.249845] [INFO ] [REMOTE ] EXP: Full fetch complete (43220 records). [2025-09-24T18:45:41.249963] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-24T18:45:41.623599] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-24T18:45:41.641935] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-24T18:45:41.642048] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-24T18:45:41.642918] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-24T18:45:41.642989] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-24T18:45:41.644484] [DEBUG] [LOCAL ] EXP: Trimmed 43220 records to 29985 (keeping 200 days of data) [2025-09-24T18:45:41.844769] [DEBUG] [LOCAL ] EXP: Primary data saved (29985 records). [2025-09-24T18:45:41.844929] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-24T18:45:41.845020] [INFO ] [MAIN ] Update Progress: 797/2373 symbols completed. EXP took 24.1s. Estimated remaining: 3h 28m 53s. Rate: 7.5 symbols/min [2025-09-24T18:45:42.390076] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T18:45:42.416032] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-24T18:45:43.216102] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-24T18:45:43.687392] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T18:45:43.716631] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:45:44.016072] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-24T18:45:44.819692] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-24T18:45:44.828535] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T18:45:44.844598] [INFO ] [REMOTE ] EW: Full fetch complete (77347 records). [2025-09-24T18:45:44.844922] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-24T18:45:45.286544] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-24T18:45:45.286763] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-24T18:45:45.288082] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-24T18:45:45.288185] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-24T18:45:45.311630] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T18:45:45.314724] [DEBUG] [LOCAL ] EW: Trimmed 77347 records to 53396 (keeping 200 days of data) [2025-09-24T18:45:45.320699] [INFO ] [REMOTE ] EXG: Full fetch complete (49883 records). [2025-09-24T18:45:45.320824] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-24T18:45:45.871178] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-24T18:45:45.872120] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-24T18:45:45.873538] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-24T18:45:45.873902] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-24T18:45:45.877249] [DEBUG] [LOCAL ] EXG: Trimmed 49883 records to 34232 (keeping 200 days of data) [2025-09-24T18:45:46.304381] [DEBUG] [LOCAL ] EXG: Primary data saved (34232 records). [2025-09-24T18:45:46.305160] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-24T18:45:46.305537] [INFO ] [MAIN ] Update Progress: 798/2373 symbols completed. EXG took 31.8s. Estimated remaining: 3h 28m 38s. Rate: 7.5 symbols/min [2025-09-24T18:45:46.320323] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-24T18:45:46.320511] [INFO ] [MAIN ] EW: Full history saved. [2025-09-24T18:45:46.320675] [INFO ] [MAIN ] Update Progress: 799/2373 symbols completed. EW took 35.3s. Estimated remaining: 3h 28m 15s. Rate: 7.6 symbols/min [2025-09-24T18:45:46.638027] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T18:45:46.649865] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-24T18:45:48.736853] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-24T18:45:48.746562] [INFO ] [REMOTE ] EXK: Full fetch complete (76456 records). [2025-09-24T18:45:48.746721] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-24T18:45:49.176502] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-24T18:45:49.176595] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-24T18:45:49.177726] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-24T18:45:49.177792] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-24T18:45:49.179253] [DEBUG] [LOCAL ] EXK: Trimmed 76456 records to 53125 (keeping 200 days of data) [2025-09-24T18:45:49.498715] [DEBUG] [LOCAL ] EXK: Primary data saved (53125 records). [2025-09-24T18:45:49.498873] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-24T18:45:49.498960] [INFO ] [MAIN ] Update Progress: 800/2373 symbols completed. EXK took 33.3s. Estimated remaining: 3h 27m 57s. Rate: 7.6 symbols/min [2025-09-24T18:45:50.045888] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:50.115618] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:50.156104] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:50.232810] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:45:50.292996] [DEBUG] [LOCAL ] FAF: Loaded 42006 existing records from primary storage. [2025-09-24T18:45:50.306012] [INFO ] [MAIN ] FAF: Loaded 42006 existing records. [2025-09-24T18:45:50.441395] [DEBUG] [LOCAL ] EXPD: Loaded 48158 existing records from primary storage. [2025-09-24T18:45:50.441695] [INFO ] [MAIN ] EXPD: Loaded 48158 existing records. [2025-09-24T18:45:50.453211] [DEBUG] [LOCAL ] EXR: Loaded 45526 existing records from primary storage. [2025-09-24T18:45:50.500604] [INFO ] [MAIN ] EXR: Loaded 45526 existing records. [2025-09-24T18:45:50.553976] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-24T18:45:50.623145] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-24T18:45:50.900811] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:50.963181] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-24T18:45:50.989954] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-24T18:45:51.009993] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:51.033062] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-24T18:45:51.067930] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-24T18:45:51.156611] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-24T18:45:51.137486] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:51.146087] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:45:51.180866] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-24T18:45:51.181053] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-24T18:45:51.191787] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-24T18:45:51.191600] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-24T18:45:51.207384] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-24T18:45:51.197057] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-24T18:45:51.207559] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-24T18:45:51.236715] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-24T18:45:51.227574] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-24T18:45:51.236921] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-24T18:45:51.243638] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-24T18:45:52.370038] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:52.401970] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-24T18:45:52.551424] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:52.608305] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-24T18:45:52.689866] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:52.711409] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:45:52.711815] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-24T18:45:52.712326] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-24T18:45:53.882034] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T18:45:53.892564] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-24T18:45:54.111749] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:45:54.121179] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-24T18:45:54.343347] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T18:45:54.352489] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-24T18:45:54.951692] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-24T18:45:54.964614] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-24T18:45:55.044574] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T18:45:55.052501] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-24T18:45:55.479598] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:45:55.496255] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-24T18:45:56.187849] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T18:45:56.199437] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-24T18:45:56.330430] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:45:56.340905] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-24T18:45:57.054017] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T18:45:57.064589] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-24T18:45:57.179830] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-24T18:45:57.191196] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-24T18:45:57.572912] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T18:45:57.616088] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-24T18:45:57.948712] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T18:45:58.416060] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-24T18:45:58.475923] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T18:45:59.216112] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-24T18:45:59.296493] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T18:45:59.722320] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-24T18:46:00.016994] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-24T18:46:00.020302] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T18:46:00.816116] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-24T18:46:00.903467] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:46:01.616060] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-24T18:46:01.769012] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T18:46:02.416094] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-24T18:46:03.216103] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-24T18:46:03.282686] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T18:46:03.364600] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-24T18:46:03.983597] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T18:46:04.016043] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-24T18:46:04.811366] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T18:46:04.820625] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-24T18:46:05.616071] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-24T18:46:05.712619] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T18:46:06.416105] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-24T18:46:06.927668] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T18:46:07.216078] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-24T18:46:07.365103] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-24T18:46:07.927443] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T18:46:08.016083] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-24T18:46:08.674490] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:46:08.816078] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-24T18:46:09.616114] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-24T18:46:09.669950] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:46:10.343138] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T18:46:10.416054] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-24T18:46:11.216059] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-24T18:46:11.332270] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T18:46:12.016100] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-24T18:46:12.108013] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T18:46:12.116481] [INFO ] [REMOTE ] EXPD: Full fetch complete (69199 records). [2025-09-24T18:46:12.116607] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-24T18:46:12.502363] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-24T18:46:12.502446] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-24T18:46:12.503375] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-24T18:46:12.503440] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-24T18:46:12.504842] [DEBUG] [LOCAL ] EXPD: Trimmed 69199 records to 48123 (keeping 200 days of data) [2025-09-24T18:46:12.804360] [DEBUG] [LOCAL ] EXPD: Primary data saved (48123 records). [2025-09-24T18:46:12.804496] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-24T18:46:12.804585] [INFO ] [MAIN ] Update Progress: 801/2373 symbols completed. EXPD took 23.3s. Estimated remaining: 3h 28m 20s. Rate: 7.5 symbols/min [2025-09-24T18:46:12.825485] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-24T18:46:12.977934] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:13.024796] [DEBUG] [LOCAL ] FBIN: Loaded 50411 existing records from primary storage. [2025-09-24T18:46:13.024965] [INFO ] [MAIN ] FBIN: Loaded 50411 existing records. [2025-09-24T18:46:13.209555] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:13.209873] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-24T18:46:13.209949] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-24T18:46:13.211627] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-24T18:46:13.211727] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-24T18:46:13.584096] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:13.607614] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T18:46:13.616128] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-24T18:46:13.647397] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-24T18:46:14.258272] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T18:46:14.416099] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-24T18:46:15.216109] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-24T18:46:15.309081] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T18:46:16.016157] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-24T18:46:16.816062] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-24T18:46:16.923317] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-24T18:46:16.966183] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T18:46:16.974321] [INFO ] [REMOTE ] EXR: Full fetch complete (65842 records). [2025-09-24T18:46:16.974432] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-24T18:46:17.359741] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-24T18:46:17.359905] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-24T18:46:17.360829] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-24T18:46:17.360892] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-24T18:46:17.362339] [DEBUG] [LOCAL ] EXR: Trimmed 65842 records to 45492 (keeping 200 days of data) [2025-09-24T18:46:17.616686] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-24T18:46:17.659429] [DEBUG] [LOCAL ] EXR: Primary data saved (45492 records). [2025-09-24T18:46:17.659577] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-24T18:46:17.659688] [INFO ] [MAIN ] Update Progress: 802/2373 symbols completed. EXR took 28.2s. Estimated remaining: 3h 28m 6s. Rate: 7.5 symbols/min [2025-09-24T18:46:17.865437] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:17.862108] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T18:46:17.900204] [DEBUG] [LOCAL ] FBK: Loaded 25604 existing records from primary storage. [2025-09-24T18:46:17.900337] [INFO ] [MAIN ] FBK: Loaded 25604 existing records. [2025-09-24T18:46:18.093949] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:18.094533] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-24T18:46:18.094725] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-24T18:46:18.101660] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-24T18:46:18.112582] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-24T18:46:18.113948] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T18:46:18.187184] [INFO ] [REMOTE ] FAF: Full fetch complete (57499 records). [2025-09-24T18:46:18.204191] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-24T18:46:18.428826] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-24T18:46:18.885049] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:18.982061] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-24T18:46:18.982151] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-24T18:46:18.982966] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-24T18:46:18.983033] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-24T18:46:18.984265] [DEBUG] [LOCAL ] FAF: Trimmed 57499 records to 41902 (keeping 200 days of data) [2025-09-24T18:46:19.218732] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-24T18:46:19.250165] [DEBUG] [LOCAL ] FAF: Primary data saved (41902 records). [2025-09-24T18:46:19.250312] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-24T18:46:19.250401] [INFO ] [MAIN ] Update Progress: 803/2373 symbols completed. FAF took 29.8s. Estimated remaining: 3h 27m 45s. Rate: 7.6 symbols/min [2025-09-24T18:46:19.436738] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:19.484429] [DEBUG] [LOCAL ] FBP: Loaded 46254 existing records from primary storage. [2025-09-24T18:46:19.484606] [INFO ] [MAIN ] FBP: Loaded 46254 existing records. [2025-09-24T18:46:19.680762] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:19.681026] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-24T18:46:19.681075] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-24T18:46:19.682295] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-24T18:46:19.682356] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-24T18:46:20.065301] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:20.065861] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-24T18:46:20.141995] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-24T18:46:20.182926] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:46:20.402836] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T18:46:20.816102] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-24T18:46:21.366150] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T18:46:21.616083] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-24T18:46:22.416087] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-24T18:46:23.090740] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T18:46:23.134949] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:46:23.216063] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-24T18:46:24.016087] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-24T18:46:24.238595] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T18:46:24.263370] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T18:46:24.816116] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-24T18:46:25.528699] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T18:46:25.616076] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-24T18:46:26.416064] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-24T18:46:26.543378] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T18:46:27.141068] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T18:46:27.216072] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-24T18:46:28.016104] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-24T18:46:28.103172] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T18:46:28.758694] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T18:46:28.768328] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-24T18:46:28.768502] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-24T18:46:28.825714] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-24T18:46:29.197135] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-24T18:46:29.197221] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-24T18:46:29.198218] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-24T18:46:29.198283] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-24T18:46:29.199820] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-24T18:46:29.544099] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-24T18:46:29.544262] [INFO ] [MAIN ] F: Full history saved. [2025-09-24T18:46:29.544439] [INFO ] [MAIN ] Update Progress: 804/2373 symbols completed. F took 40.0s. Estimated remaining: 3h 27m 42s. Rate: 7.6 symbols/min [2025-09-24T18:46:29.616138] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-24T18:46:29.748097] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:29.763240] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T18:46:29.803967] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T18:46:29.843803] [DEBUG] [LOCAL ] FBRT: Loaded 34381 existing records from primary storage. [2025-09-24T18:46:29.843961] [INFO ] [MAIN ] FBRT: Loaded 34381 existing records. [2025-09-24T18:46:30.028703] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:30.028988] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-24T18:46:30.029038] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-24T18:46:30.029910] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-24T18:46:30.029975] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-24T18:46:30.400290] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:30.416049] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-24T18:46:31.216052] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-24T18:46:31.472953] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T18:46:31.785262] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T18:46:32.016089] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-24T18:46:32.798291] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T18:46:32.816050] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-24T18:46:33.279533] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T18:46:33.616089] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-24T18:46:34.391599] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:46:34.416037] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-24T18:46:34.903289] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T18:46:35.216073] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-24T18:46:36.016081] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-24T18:46:36.208366] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T18:46:36.245761] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T18:46:36.816088] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-24T18:46:37.616962] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-24T18:46:37.622554] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:46:38.153316] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T18:46:38.416067] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-24T18:46:38.681870] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T18:46:39.216136] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-24T18:46:39.655589] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T18:46:40.016111] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-24T18:46:40.678258] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:46:40.816100] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-24T18:46:41.616079] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-24T18:46:41.763055] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T18:46:42.374385] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T18:46:42.416081] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-24T18:46:43.129111] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T18:46:43.216043] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-24T18:46:44.021427] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-24T18:46:44.031858] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:46:44.040172] [INFO ] [REMOTE ] FBP: Full fetch complete (66263 records). [2025-09-24T18:46:44.040287] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-24T18:46:44.434493] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-24T18:46:44.434598] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-24T18:46:44.435605] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-24T18:46:44.435841] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-24T18:46:44.455835] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T18:46:44.454900] [DEBUG] [LOCAL ] FBP: Trimmed 66263 records to 46232 (keeping 200 days of data) [2025-09-24T18:46:44.746240] [DEBUG] [LOCAL ] FBP: Primary data saved (46232 records). [2025-09-24T18:46:44.746507] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-24T18:46:44.746614] [INFO ] [MAIN ] Update Progress: 805/2373 symbols completed. FBP took 25.5s. Estimated remaining: 3h 27m 48s. Rate: 7.5 symbols/min [2025-09-24T18:46:44.821359] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-24T18:46:44.920411] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:44.939212] [DEBUG] [LOCAL ] FC: Loaded 15388 existing records from primary storage. [2025-09-24T18:46:44.939334] [INFO ] [MAIN ] FC: Loaded 15388 existing records. [2025-09-24T18:46:45.127247] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:45.127498] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-24T18:46:45.127582] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-24T18:46:45.128092] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-24T18:46:45.128152] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-24T18:46:45.487398] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:45.616039] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-24T18:46:45.706301] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T18:46:46.190987] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T18:46:46.351165] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T18:46:46.416096] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-24T18:46:47.216076] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-24T18:46:47.382721] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T18:46:48.016094] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-24T18:46:48.489945] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T18:46:48.816085] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-24T18:46:48.967476] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T18:46:48.971821] [INFO ] [REMOTE ] FBK: Full fetch complete (33019 records). [2025-09-24T18:46:48.971909] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-24T18:46:49.337507] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-24T18:46:49.337591] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-24T18:46:49.338228] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-24T18:46:49.338291] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-24T18:46:49.339092] [DEBUG] [LOCAL ] FBK: Trimmed 33019 records to 25657 (keeping 200 days of data) [2025-09-24T18:46:49.491628] [DEBUG] [LOCAL ] FBK: Primary data saved (25657 records). [2025-09-24T18:46:49.491788] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-24T18:46:49.491875] [INFO ] [MAIN ] Update Progress: 806/2373 symbols completed. FBK took 31.8s. Estimated remaining: 3h 27m 34s. Rate: 7.5 symbols/min [2025-09-24T18:46:49.631275] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-24T18:46:49.662867] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:49.702756] [DEBUG] [LOCAL ] FCF: Loaded 39757 existing records from primary storage. [2025-09-24T18:46:49.702900] [INFO ] [MAIN ] FCF: Loaded 39757 existing records. [2025-09-24T18:46:49.878611] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:49.878900] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-24T18:46:49.878948] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-24T18:46:49.879990] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-24T18:46:49.880051] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-24T18:46:50.258685] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:50.388487] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T18:46:50.397159] [INFO ] [REMOTE ] FBIN: Full fetch complete (72623 records). [2025-09-24T18:46:50.397275] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-24T18:46:50.428182] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-24T18:46:50.803377] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-24T18:46:50.803477] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-24T18:46:50.804404] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-24T18:46:50.804467] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-24T18:46:50.805840] [DEBUG] [LOCAL ] FBIN: Trimmed 72623 records to 50395 (keeping 200 days of data) [2025-09-24T18:46:51.135725] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T18:46:51.161854] [DEBUG] [LOCAL ] FBIN: Primary data saved (50395 records). [2025-09-24T18:46:51.162100] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-24T18:46:51.162319] [INFO ] [MAIN ] Update Progress: 807/2373 symbols completed. FBIN took 38.4s. Estimated remaining: 3h 27m 14s. Rate: 7.6 symbols/min [2025-09-24T18:46:51.221675] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-24T18:46:51.354972] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:51.387393] [DEBUG] [LOCAL ] FCN: Loaded 26312 existing records from primary storage. [2025-09-24T18:46:51.387570] [INFO ] [MAIN ] FCN: Loaded 26312 existing records. [2025-09-24T18:46:51.569989] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T18:46:51.595631] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:51.595931] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-24T18:46:51.595983] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-24T18:46:51.597365] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-24T18:46:51.597590] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-24T18:46:51.963260] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:52.016039] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-24T18:46:52.408764] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T18:46:52.816044] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-24T18:46:53.145800] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T18:46:53.616104] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-24T18:46:53.781905] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T18:46:54.387828] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T18:46:54.416033] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-24T18:46:55.216135] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-24T18:46:55.500955] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T18:46:56.016119] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-24T18:46:56.449876] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T18:46:56.455890] [INFO ] [REMOTE ] FBRT: Full fetch complete (48462 records). [2025-09-24T18:46:56.455986] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-24T18:46:56.823471] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-24T18:46:56.864608] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-24T18:46:56.864736] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-24T18:46:56.865510] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-24T18:46:56.865574] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-24T18:46:56.866809] [DEBUG] [LOCAL ] FBRT: Trimmed 48462 records to 34469 (keeping 200 days of data) [2025-09-24T18:46:57.086153] [DEBUG] [LOCAL ] FBRT: Primary data saved (34469 records). [2025-09-24T18:46:57.086415] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-24T18:46:57.086574] [INFO ] [MAIN ] Update Progress: 808/2373 symbols completed. FBRT took 27.5s. Estimated remaining: 3h 27m 2s. Rate: 7.6 symbols/min [2025-09-24T18:46:57.278901] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:46:57.317708] [DEBUG] [LOCAL ] FCPT: Loaded 37424 existing records from primary storage. [2025-09-24T18:46:57.317884] [INFO ] [MAIN ] FCPT: Loaded 37424 existing records. [2025-09-24T18:46:57.529771] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:46:57.540528] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T18:46:57.539633] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-24T18:46:57.549463] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-24T18:46:57.550605] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-24T18:46:57.550704] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-24T18:46:57.621153] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-24T18:46:57.939412] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:46:57.956554] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T18:46:58.416135] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-24T18:46:58.977285] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:46:59.216060] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-24T18:46:59.295035] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T18:47:00.016060] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-24T18:47:00.430395] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T18:47:00.816096] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-24T18:47:00.917981] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T18:47:01.616118] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-24T18:47:02.233342] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T18:47:02.416108] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-24T18:47:03.011737] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T18:47:03.216118] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-24T18:47:03.787540] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T18:47:03.912579] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T18:47:04.016119] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-24T18:47:04.816105] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-24T18:47:04.967598] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T18:47:05.616120] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-24T18:47:06.157993] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T18:47:06.416131] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-24T18:47:06.588116] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T18:47:07.216142] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-24T18:47:07.249977] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T18:47:08.016176] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-24T18:47:08.660243] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T18:47:08.816040] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-24T18:47:09.279409] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T18:47:09.616082] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-24T18:47:10.416111] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-24T18:47:10.553309] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T18:47:10.689125] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T18:47:11.216098] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-24T18:47:11.640830] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T18:47:12.016155] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-24T18:47:12.816056] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-24T18:47:12.892143] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T18:47:13.259126] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T18:47:13.263480] [INFO ] [REMOTE ] FCN: Full fetch complete (35644 records). [2025-09-24T18:47:13.263573] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-24T18:47:13.616580] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-24T18:47:13.648852] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-24T18:47:13.648935] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-24T18:47:13.649609] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-24T18:47:13.649738] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-24T18:47:13.653813] [DEBUG] [LOCAL ] FCN: Trimmed 35644 records to 26239 (keeping 200 days of data) [2025-09-24T18:47:13.817244] [DEBUG] [LOCAL ] FCN: Primary data saved (26239 records). [2025-09-24T18:47:13.817408] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-24T18:47:13.817570] [INFO ] [MAIN ] Update Progress: 809/2373 symbols completed. FCN took 22.7s. Estimated remaining: 3h 27m 11s. Rate: 7.5 symbols/min [2025-09-24T18:47:13.992449] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:13.992888] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-24T18:47:13.993055] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-24T18:47:13.993425] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-24T18:47:13.993493] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-24T18:47:13.993564] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-24T18:47:13.993607] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-24T18:47:14.401709] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:47:14.422892] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:14.417298] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-24T18:47:15.175737] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T18:47:15.216036] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-24T18:47:15.296205] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T18:47:15.299498] [INFO ] [REMOTE ] FC: Full fetch complete (21471 records). [2025-09-24T18:47:15.299586] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-24T18:47:15.662740] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-24T18:47:15.662829] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-24T18:47:15.663395] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-24T18:47:15.663488] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-24T18:47:15.664145] [DEBUG] [LOCAL ] FC: Trimmed 21471 records to 15339 (keeping 200 days of data) [2025-09-24T18:47:15.764360] [DEBUG] [LOCAL ] FC: Primary data saved (15339 records). [2025-09-24T18:47:15.764504] [INFO ] [MAIN ] FC: Full history saved. [2025-09-24T18:47:15.764604] [INFO ] [MAIN ] Update Progress: 810/2373 symbols completed. FC took 31.0s. Estimated remaining: 3h 26m 52s. Rate: 7.6 symbols/min [2025-09-24T18:47:15.942327] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:15.960079] [DEBUG] [LOCAL ] FCT: Loaded 14327 existing records from primary storage. [2025-09-24T18:47:15.960234] [INFO ] [MAIN ] FCT: Loaded 14327 existing records. [2025-09-24T18:47:16.022611] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-24T18:47:16.142318] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:16.142619] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-24T18:47:16.142700] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-24T18:47:16.143178] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-24T18:47:16.143248] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-24T18:47:16.506938] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:16.528267] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T18:47:16.816090] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-24T18:47:17.493824] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T18:47:17.616040] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-24T18:47:18.136954] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T18:47:18.416105] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-24T18:47:19.202161] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T18:47:19.216027] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-24T18:47:19.829769] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T18:47:20.016080] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-24T18:47:20.638031] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T18:47:20.816063] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-24T18:47:21.050581] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T18:47:21.135193] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-24T18:47:21.616080] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-24T18:47:22.416062] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-24T18:47:22.453891] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T18:47:23.216140] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-24T18:47:23.909811] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T18:47:23.917164] [INFO ] [REMOTE ] FCF: Full fetch complete (58122 records). [2025-09-24T18:47:23.917370] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-24T18:47:24.023057] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-24T18:47:24.325864] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-24T18:47:24.325968] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-24T18:47:24.327141] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-24T18:47:24.327278] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-24T18:47:24.329444] [DEBUG] [LOCAL ] FCF: Trimmed 58122 records to 39725 (keeping 200 days of data) [2025-09-24T18:47:24.527575] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T18:47:24.610689] [DEBUG] [LOCAL ] FCF: Primary data saved (39725 records). [2025-09-24T18:47:24.610982] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-24T18:47:24.611116] [INFO ] [MAIN ] Update Progress: 811/2373 symbols completed. FCF took 35.1s. Estimated remaining: 3h 26m 45s. Rate: 7.6 symbols/min [2025-09-24T18:47:24.822711] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-24T18:47:24.830352] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:24.835438] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:47:24.899889] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-24T18:47:24.900040] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-24T18:47:25.076148] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:25.076430] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-24T18:47:25.076498] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-24T18:47:25.078103] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-24T18:47:25.078176] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-24T18:47:25.476221] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:25.616061] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-24T18:47:25.730381] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T18:47:26.201915] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T18:47:26.416076] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-24T18:47:27.216116] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-24T18:47:27.728925] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T18:47:28.016115] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-24T18:47:28.816092] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-24T18:47:29.248483] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T18:47:29.525486] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T18:47:29.532369] [INFO ] [REMOTE ] FCPT: Full fetch complete (53304 records). [2025-09-24T18:47:29.532497] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-24T18:47:29.616046] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-24T18:47:29.936995] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T18:47:29.959089] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-24T18:47:29.959509] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-24T18:47:29.960344] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-24T18:47:29.960410] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-24T18:47:29.962848] [DEBUG] [LOCAL ] FCPT: Trimmed 53304 records to 37377 (keeping 200 days of data) [2025-09-24T18:47:30.195851] [DEBUG] [LOCAL ] FCPT: Primary data saved (37377 records). [2025-09-24T18:47:30.196088] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-24T18:47:30.196241] [INFO ] [MAIN ] Update Progress: 812/2373 symbols completed. FCPT took 33.1s. Estimated remaining: 3h 26m 33s. Rate: 7.6 symbols/min [2025-09-24T18:47:30.365625] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:30.406425] [DEBUG] [LOCAL ] FDP: Loaded 30430 existing records from primary storage. [2025-09-24T18:47:30.406575] [INFO ] [MAIN ] FDP: Loaded 30430 existing records. [2025-09-24T18:47:30.421318] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-24T18:47:30.589602] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:30.589901] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-24T18:47:30.589965] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-24T18:47:30.590915] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-24T18:47:30.590978] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-24T18:47:30.902942] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T18:47:30.972174] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:31.216051] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-24T18:47:31.548733] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T18:47:31.697792] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T18:47:32.016124] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-24T18:47:32.816088] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-24T18:47:33.095246] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T18:47:33.616129] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-24T18:47:33.803847] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T18:47:34.416145] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-24T18:47:35.216084] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-24T18:47:35.779146] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T18:47:36.016128] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-24T18:47:36.816097] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-24T18:47:37.197267] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T18:47:37.224845] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-24T18:47:37.616083] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-24T18:47:37.861366] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T18:47:37.863716] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (4.25 seconds). [2025-09-24T18:47:38.416084] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-24T18:47:38.740844] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-24T18:47:38.976980] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T18:47:39.216085] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-24T18:47:40.018452] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-24T18:47:40.020437] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T18:47:40.816089] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-24T18:47:41.616129] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-24T18:47:41.978386] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T18:47:42.009945] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T18:47:42.416107] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-24T18:47:42.553040] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T18:47:42.559981] [INFO ] [REMOTE ] FCT: Full fetch complete (21094 records). [2025-09-24T18:47:42.560133] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-24T18:47:42.972964] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-24T18:47:42.973045] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-24T18:47:42.973504] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-24T18:47:42.973543] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-24T18:47:42.974130] [DEBUG] [LOCAL ] FCT: Trimmed 21094 records to 14369 (keeping 200 days of data) [2025-09-24T18:47:43.061619] [DEBUG] [LOCAL ] FCT: Primary data saved (14369 records). [2025-09-24T18:47:43.061788] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-24T18:47:43.061902] [INFO ] [MAIN ] Update Progress: 813/2373 symbols completed. FCT took 27.3s. Estimated remaining: 3h 26m 34s. Rate: 7.6 symbols/min [2025-09-24T18:47:43.228537] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-24T18:47:43.232708] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:43.264344] [DEBUG] [LOCAL ] FDS: Loaded 26130 existing records from primary storage. [2025-09-24T18:47:43.264489] [INFO ] [MAIN ] FDS: Loaded 26130 existing records. [2025-09-24T18:47:43.449925] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:43.450273] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-24T18:47:43.450327] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-24T18:47:43.451070] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-24T18:47:43.451134] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-24T18:47:43.713132] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-24T18:47:43.820086] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:44.016060] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-24T18:47:44.648278] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-24T18:47:44.816139] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-24T18:47:45.247105] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T18:47:45.616199] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-24T18:47:46.416060] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-24T18:47:46.837176] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T18:47:46.860622] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T18:47:46.902622] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T18:47:47.216091] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-24T18:47:48.016110] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-24T18:47:48.816062] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-24T18:47:49.129943] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T18:47:49.163016] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T18:47:49.218298] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-24T18:47:49.616100] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-24T18:47:50.165714] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T18:47:50.166779] [INFO ] [REMOTE ] FCRX: Full fetch complete (1662 records). [2025-09-24T18:47:50.166910] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-24T18:47:50.367485] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-24T18:47:50.367728] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:47:50.367821] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:47:50.367899] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-24T18:47:50.367966] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-24T18:47:50.368016] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-24T18:47:50.368086] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-24T18:47:50.368166] [INFO ] [MAIN ] Update Progress: 814/2373 symbols completed. FCRX took 36.6s. Estimated remaining: 3h 26m 25s. Rate: 7.6 symbols/min [2025-09-24T18:47:50.426548] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-24T18:47:50.627025] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:50.699096] [DEBUG] [LOCAL ] FDX: Loaded 51622 existing records from primary storage. [2025-09-24T18:47:50.699291] [INFO ] [MAIN ] FDX: Loaded 51622 existing records. [2025-09-24T18:47:50.898308] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:50.898560] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-24T18:47:50.898612] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-24T18:47:50.900179] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-24T18:47:50.900245] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-24T18:47:51.221264] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-24T18:47:51.301117] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:47:52.016113] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-24T18:47:52.520105] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T18:47:52.753716] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T18:47:52.816033] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-24T18:47:53.616053] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-24T18:47:53.969523] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T18:47:54.416079] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-24T18:47:54.678213] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T18:47:54.822336] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T18:47:55.216139] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-24T18:47:55.294789] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T18:47:56.016095] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-24T18:47:56.816124] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-24T18:47:57.112734] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-24T18:47:57.178441] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:47:57.616133] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-24T18:47:58.164047] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:47:58.416130] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-24T18:47:58.894932] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T18:47:58.900207] [INFO ] [REMOTE ] FDP: Full fetch complete (42760 records). [2025-09-24T18:47:58.900292] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-24T18:47:59.226073] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-24T18:47:59.276828] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-24T18:47:59.276913] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-24T18:47:59.277608] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-24T18:47:59.277685] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-24T18:47:59.278811] [DEBUG] [LOCAL ] FDP: Trimmed 42760 records to 30413 (keeping 200 days of data) [2025-09-24T18:47:59.463984] [DEBUG] [LOCAL ] FDP: Primary data saved (30413 records). [2025-09-24T18:47:59.464120] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-24T18:47:59.464208] [INFO ] [MAIN ] Update Progress: 815/2373 symbols completed. FDP took 29.3s. Estimated remaining: 3h 26m 19s. Rate: 7.6 symbols/min [2025-09-24T18:47:59.638679] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:47:59.689441] [DEBUG] [LOCAL ] FE: Loaded 53435 existing records from primary storage. [2025-09-24T18:47:59.689757] [INFO ] [MAIN ] FE: Loaded 53435 existing records. [2025-09-24T18:47:59.886827] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:47:59.888569] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T18:47:59.895198] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-24T18:47:59.895617] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-24T18:47:59.896859] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-24T18:47:59.896922] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-24T18:48:00.021258] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-24T18:48:00.284101] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:00.816162] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-24T18:48:01.616072] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-24T18:48:01.683570] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T18:48:01.727718] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-24T18:48:02.416123] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-24T18:48:03.216147] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-24T18:48:03.944161] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-24T18:48:03.954539] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-24T18:48:03.954729] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-24T18:48:04.375512] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-24T18:48:04.375637] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-24T18:48:04.377324] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-24T18:48:04.377412] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-24T18:48:04.379184] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 53700 (keeping 200 days of data) [2025-09-24T18:48:04.723355] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-24T18:48:04.723595] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-24T18:48:04.723746] [INFO ] [MAIN ] Update Progress: 816/2373 symbols completed. FCX took 40.1s. Estimated remaining: 3h 26m 6s. Rate: 7.6 symbols/min [2025-09-24T18:48:04.911802] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:04.929103] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-24T18:48:04.929247] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-24T18:48:04.929503] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-24T18:48:04.930350] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-24T18:48:04.931180] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-24T18:48:04.931083] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-24T18:48:04.931294] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-24T18:48:05.004903] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-24T18:48:05.307781] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:05.308159] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-24T18:48:05.639573] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (4.02 seconds). [2025-09-24T18:48:05.651330] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-24T18:48:05.661890] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-24T18:48:06.173233] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T18:48:06.416142] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-24T18:48:06.886495] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-24T18:48:07.018340] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (3.80 seconds). [2025-09-24T18:48:07.216061] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-24T18:48:07.340142] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T18:48:08.016150] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-24T18:48:08.816062] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-24T18:48:09.083095] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T18:48:09.367866] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T18:48:09.616101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-24T18:48:10.104594] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T18:48:10.118703] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:48:10.416091] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-24T18:48:11.216099] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-24T18:48:11.683039] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-24T18:48:12.016062] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-24T18:48:12.251697] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T18:48:12.816125] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-24T18:48:13.616146] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-24T18:48:14.416110] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-24T18:48:15.129045] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-24T18:48:15.216129] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-24T18:48:15.255689] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T18:48:15.732260] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-24T18:48:16.016137] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-24T18:48:16.515255] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T18:48:16.536675] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-24T18:48:16.543374] [INFO ] [REMOTE ] FDS: Full fetch complete (36921 records). [2025-09-24T18:48:16.543507] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-24T18:48:16.821187] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-24T18:48:16.930960] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-24T18:48:16.931043] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-24T18:48:16.931801] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-24T18:48:16.931864] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-24T18:48:16.932857] [DEBUG] [LOCAL ] FDS: Trimmed 36921 records to 26227 (keeping 200 days of data) [2025-09-24T18:48:17.110207] [DEBUG] [LOCAL ] FDS: Primary data saved (26227 records). [2025-09-24T18:48:17.110727] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-24T18:48:17.110871] [INFO ] [MAIN ] Update Progress: 817/2373 symbols completed. FDS took 34.0s. Estimated remaining: 3h 26m 7s. Rate: 7.5 symbols/min [2025-09-24T18:48:17.241455] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T18:48:17.305003] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:17.336982] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-24T18:48:17.394460] [DEBUG] [LOCAL ] FERG: Loaded 49033 existing records from primary storage. [2025-09-24T18:48:17.394695] [INFO ] [MAIN ] FERG: Loaded 49033 existing records. [2025-09-24T18:48:17.578510] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:17.578898] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-24T18:48:17.578976] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-24T18:48:17.580517] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-24T18:48:17.580582] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-24T18:48:17.621954] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-24T18:48:17.959479] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:18.416095] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-24T18:48:18.763148] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T18:48:19.216108] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-24T18:48:19.559106] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T18:48:19.573554] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-24T18:48:20.016094] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-24T18:48:20.703876] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T18:48:20.705031] [INFO ] [REMOTE ] FENG: Full fetch complete (2236 records). [2025-09-24T18:48:20.705104] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-24T18:48:20.821158] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-24T18:48:20.891555] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T18:48:20.891756] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:48:20.891829] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:48:20.891904] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-24T18:48:20.891971] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-24T18:48:20.892010] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-24T18:48:20.892075] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-24T18:48:20.892136] [INFO ] [MAIN ] Update Progress: 818/2373 symbols completed. FENG took 16.2s. Estimated remaining: 3h 25m 51s. Rate: 7.6 symbols/min [2025-09-24T18:48:21.062497] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:21.076628] [DEBUG] [LOCAL ] FET: Loaded 12690 existing records from primary storage. [2025-09-24T18:48:21.076791] [INFO ] [MAIN ] FET: Loaded 12690 existing records. [2025-09-24T18:48:21.275789] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:21.276146] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-24T18:48:21.276200] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-24T18:48:21.276783] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-24T18:48:21.276846] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-24T18:48:21.621219] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-24T18:48:21.679993] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:22.416121] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-24T18:48:22.646617] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T18:48:23.216092] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-24T18:48:23.742040] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T18:48:23.813262] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T18:48:24.016081] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-24T18:48:24.816072] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-24T18:48:24.873097] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T18:48:24.878091] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T18:48:25.616162] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-24T18:48:26.416183] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-24T18:48:26.438028] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T18:48:26.673425] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T18:48:27.216107] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-24T18:48:28.016100] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-24T18:48:28.126954] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T18:48:28.744373] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T18:48:28.816064] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-24T18:48:29.079397] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T18:48:29.616084] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-24T18:48:30.416146] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-24T18:48:30.700981] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T18:48:31.216055] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-24T18:48:31.382082] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T18:48:31.390369] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T18:48:31.401138] [INFO ] [REMOTE ] FE: Full fetch complete (77197 records). [2025-09-24T18:48:31.401278] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-24T18:48:31.812989] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-24T18:48:31.813276] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-24T18:48:31.814588] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-24T18:48:31.814682] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-24T18:48:31.816311] [DEBUG] [LOCAL ] FE: Trimmed 77197 records to 53428 (keeping 200 days of data) [2025-09-24T18:48:32.032403] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-24T18:48:32.150343] [DEBUG] [LOCAL ] FE: Primary data saved (53428 records). [2025-09-24T18:48:32.150493] [INFO ] [MAIN ] FE: Full history saved. [2025-09-24T18:48:32.150579] [INFO ] [MAIN ] Update Progress: 819/2373 symbols completed. FE took 32.7s. Estimated remaining: 3h 25m 49s. Rate: 7.6 symbols/min [2025-09-24T18:48:32.320360] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:32.345564] [DEBUG] [LOCAL ] FF: Loaded 25538 existing records from primary storage. [2025-09-24T18:48:32.345741] [INFO ] [MAIN ] FF: Loaded 25538 existing records. [2025-09-24T18:48:32.536621] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:32.536899] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-24T18:48:32.536948] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-24T18:48:32.537686] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-24T18:48:32.537758] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-24T18:48:32.829015] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-24T18:48:32.918606] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:32.952187] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T18:48:32.971570] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-24T18:48:33.616079] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-24T18:48:34.337364] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T18:48:34.416052] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-24T18:48:34.876189] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T18:48:34.885434] [INFO ] [REMOTE ] FDX: Full fetch complete (74409 records). [2025-09-24T18:48:34.885585] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-24T18:48:35.221298] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-24T18:48:35.314597] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-24T18:48:35.314719] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-24T18:48:35.315685] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-24T18:48:35.315756] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-24T18:48:35.318902] [DEBUG] [LOCAL ] FDX: Trimmed 74409 records to 51612 (keeping 200 days of data) [2025-09-24T18:48:35.660867] [DEBUG] [LOCAL ] FDX: Primary data saved (51612 records). [2025-09-24T18:48:35.661025] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-24T18:48:35.661167] [INFO ] [MAIN ] Update Progress: 820/2373 symbols completed. FDX took 45.3s. Estimated remaining: 3h 25m 33s. Rate: 7.6 symbols/min [2025-09-24T18:48:35.850843] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:35.858001] [DEBUG] [LOCAL ] FFA: Loaded 5632 existing records from primary storage. [2025-09-24T18:48:35.858093] [INFO ] [MAIN ] FFA: Loaded 5632 existing records. [2025-09-24T18:48:36.024889] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-24T18:48:36.046570] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:36.046966] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-24T18:48:36.047105] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-24T18:48:36.047472] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-24T18:48:36.047578] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-24T18:48:36.162696] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T18:48:36.467043] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T18:48:36.471102] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:36.816131] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-24T18:48:37.174225] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T18:48:37.616091] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-24T18:48:37.664708] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T18:48:38.416135] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-24T18:48:38.674181] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T18:48:39.216097] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-24T18:48:39.369871] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T18:48:40.016146] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-24T18:48:40.653323] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T18:48:40.816146] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-24T18:48:41.162595] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T18:48:41.616190] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-24T18:48:42.314172] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T18:48:42.356430] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T18:48:42.416125] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-24T18:48:43.216093] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-24T18:48:43.410707] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T18:48:44.016107] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-24T18:48:44.402441] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T18:48:44.816103] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-24T18:48:45.616108] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-24T18:48:45.695833] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T18:48:45.930063] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T18:48:45.933625] [INFO ] [REMOTE ] FET: Full fetch complete (18151 records). [2025-09-24T18:48:45.933778] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-24T18:48:46.326454] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-24T18:48:46.326605] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-24T18:48:46.327109] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-24T18:48:46.327167] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-24T18:48:46.327859] [DEBUG] [LOCAL ] FET: Trimmed 18151 records to 12711 (keeping 200 days of data) [2025-09-24T18:48:46.413789] [DEBUG] [LOCAL ] FET: Primary data saved (12711 records). [2025-09-24T18:48:46.413993] [INFO ] [MAIN ] FET: Full history saved. [2025-09-24T18:48:46.414180] [INFO ] [MAIN ] Update Progress: 821/2373 symbols completed. FET took 25.5s. Estimated remaining: 3h 25m 30s. Rate: 7.6 symbols/min [2025-09-24T18:48:46.426692] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-24T18:48:46.596753] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:46.614987] [DEBUG] [LOCAL ] FFC: Loaded 16600 existing records from primary storage. [2025-09-24T18:48:46.615124] [INFO ] [MAIN ] FFC: Loaded 16600 existing records. [2025-09-24T18:48:46.802397] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:46.802823] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-24T18:48:46.802942] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-24T18:48:46.803531] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-24T18:48:46.803594] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-24T18:48:47.000853] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T18:48:47.108974] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T18:48:47.221162] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-24T18:48:47.261919] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:48:48.016120] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-24T18:48:48.043856] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T18:48:48.816114] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-24T18:48:49.118313] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T18:48:49.616092] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-24T18:48:49.887468] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T18:48:50.416110] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-24T18:48:50.493388] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T18:48:51.010129] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-24T18:48:51.216184] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-24T18:48:52.016058] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-24T18:48:52.178618] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T18:48:52.433844] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-24T18:48:52.816146] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-24T18:48:53.616160] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-24T18:48:53.917896] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T18:48:54.048235] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T18:48:54.416126] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-24T18:48:55.216095] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-24T18:48:55.492067] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T18:48:56.016100] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-24T18:48:56.599476] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T18:48:56.816144] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-24T18:48:56.869118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T18:48:57.616082] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-24T18:48:58.341389] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T18:48:58.346087] [INFO ] [REMOTE ] FF: Full fetch complete (37086 records). [2025-09-24T18:48:58.346186] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-24T18:48:58.421155] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-24T18:48:58.675557] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T18:48:58.792778] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-24T18:48:58.792903] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-24T18:48:58.793937] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-24T18:48:58.794015] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-24T18:48:58.795211] [DEBUG] [LOCAL ] FF: Trimmed 37086 records to 25504 (keeping 200 days of data) [2025-09-24T18:48:58.965254] [DEBUG] [LOCAL ] FF: Primary data saved (25504 records). [2025-09-24T18:48:58.965444] [INFO ] [MAIN ] FF: Full history saved. [2025-09-24T18:48:58.965683] [INFO ] [MAIN ] Update Progress: 822/2373 symbols completed. FF took 26.8s. Estimated remaining: 3h 25m 31s. Rate: 7.5 symbols/min [2025-09-24T18:48:59.159592] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:48:59.196153] [DEBUG] [LOCAL ] FFWM: Loaded 36225 existing records from primary storage. [2025-09-24T18:48:59.196302] [INFO ] [MAIN ] FFWM: Loaded 36225 existing records. [2025-09-24T18:48:59.221351] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-24T18:48:59.395227] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:48:59.395596] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-24T18:48:59.395686] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-24T18:48:59.397872] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-24T18:48:59.397955] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-24T18:48:59.822206] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:00.016086] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-24T18:49:00.263138] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T18:49:00.285344] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:49:00.285537] [INFO ] [REMOTE ] FERG: Full fetch complete (71034 records). [2025-09-24T18:49:00.285746] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-24T18:49:00.667587] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T18:49:00.726547] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-24T18:49:00.726634] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-24T18:49:00.727781] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-24T18:49:00.727849] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-24T18:49:00.729668] [DEBUG] [LOCAL ] FERG: Trimmed 71034 records to 48996 (keeping 200 days of data) [2025-09-24T18:49:00.834107] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-24T18:49:01.057006] [DEBUG] [LOCAL ] FERG: Primary data saved (48996 records). [2025-09-24T18:49:01.057151] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-24T18:49:01.057261] [INFO ] [MAIN ] Update Progress: 823/2373 symbols completed. FERG took 43.9s. Estimated remaining: 3h 25m 12s. Rate: 7.6 symbols/min [2025-09-24T18:49:01.239835] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:01.265418] [DEBUG] [LOCAL ] FG: Loaded 22512 existing records from primary storage. [2025-09-24T18:49:01.265738] [INFO ] [MAIN ] FG: Loaded 22512 existing records. [2025-09-24T18:49:01.397448] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T18:49:01.474960] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:01.475253] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-24T18:49:01.475312] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-24T18:49:01.476205] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-24T18:49:01.476274] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-24T18:49:01.622930] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-24T18:49:01.857699] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:02.416110] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-24T18:49:03.016196] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:49:03.180454] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T18:49:03.216068] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-24T18:49:04.004147] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T18:49:04.016035] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-24T18:49:04.816062] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-24T18:49:04.882293] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:49:05.581719] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T18:49:05.583328] [INFO ] [REMOTE ] FFA: Full fetch complete (8234 records). [2025-09-24T18:49:05.583399] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-24T18:49:05.621162] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-24T18:49:05.993573] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-24T18:49:05.993706] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-24T18:49:05.993975] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-24T18:49:05.994041] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-24T18:49:05.994728] [DEBUG] [LOCAL ] FFA: Trimmed 8234 records to 5680 (keeping 200 days of data) [2025-09-24T18:49:06.032051] [DEBUG] [LOCAL ] FFA: Primary data saved (5680 records). [2025-09-24T18:49:06.032209] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-24T18:49:06.032310] [INFO ] [MAIN ] Update Progress: 824/2373 symbols completed. FFA took 30.4s. Estimated remaining: 3h 24m 59s. Rate: 7.6 symbols/min [2025-09-24T18:49:06.217800] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:06.225109] [DEBUG] [LOCAL ] FGN: Loaded 3923 existing records from primary storage. [2025-09-24T18:49:06.225222] [INFO ] [MAIN ] FGN: Loaded 3923 existing records. [2025-09-24T18:49:06.404904] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:06.405199] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-24T18:49:06.405270] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-24T18:49:06.405586] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-24T18:49:06.405676] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-24T18:49:06.421357] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-24T18:49:06.780064] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:06.963730] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T18:49:07.087734] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T18:49:07.216088] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-24T18:49:07.864763] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T18:49:08.016075] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-24T18:49:08.436195] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-24T18:49:08.816086] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-24T18:49:09.616065] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-24T18:49:09.901327] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T18:49:10.092561] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T18:49:10.416101] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-24T18:49:11.216057] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-24T18:49:11.322560] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T18:49:12.016077] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-24T18:49:12.521908] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T18:49:12.816077] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-24T18:49:12.973295] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:49:13.616062] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-24T18:49:13.666989] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T18:49:14.213518] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T18:49:14.416080] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-24T18:49:15.216060] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-24T18:49:15.319921] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T18:49:15.758967] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T18:49:16.016084] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-24T18:49:16.816063] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-24T18:49:17.057706] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T18:49:17.616095] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-24T18:49:17.890623] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T18:49:18.416096] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-24T18:49:18.629799] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T18:49:19.216131] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-24T18:49:19.388141] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T18:49:19.735491] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T18:49:20.016130] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-24T18:49:20.816094] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-24T18:49:21.077250] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T18:49:21.081501] [INFO ] [REMOTE ] FFC: Full fetch complete (24701 records). [2025-09-24T18:49:21.081676] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-24T18:49:21.463501] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-24T18:49:21.463612] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-24T18:49:21.464220] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-24T18:49:21.464345] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-24T18:49:21.465089] [DEBUG] [LOCAL ] FFC: Trimmed 24701 records to 16629 (keeping 200 days of data) [2025-09-24T18:49:21.577176] [DEBUG] [LOCAL ] FFC: Primary data saved (16629 records). [2025-09-24T18:49:21.577335] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-24T18:49:21.577545] [INFO ] [MAIN ] Update Progress: 825/2373 symbols completed. FFC took 35.2s. Estimated remaining: 3h 25m 5s. Rate: 7.5 symbols/min [2025-09-24T18:49:21.621191] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-24T18:49:21.753676] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:21.753837] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-24T18:49:21.753874] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-24T18:49:21.754046] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-24T18:49:21.754089] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-24T18:49:21.754130] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-24T18:49:21.754171] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-24T18:49:22.124803] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:22.150064] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:49:22.416075] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-24T18:49:22.850044] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T18:49:22.854224] [INFO ] [REMOTE ] FG: Full fetch complete (27198 records). [2025-09-24T18:49:22.854305] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-24T18:49:23.221630] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-24T18:49:23.223433] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-24T18:49:23.223523] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-24T18:49:23.224164] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-24T18:49:23.224347] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-24T18:49:23.225780] [DEBUG] [LOCAL ] FG: Trimmed 27198 records to 22540 (keeping 200 days of data) [2025-09-24T18:49:23.386276] [DEBUG] [LOCAL ] FG: Primary data saved (22540 records). [2025-09-24T18:49:23.386454] [INFO ] [MAIN ] FG: Full history saved. [2025-09-24T18:49:23.386782] [INFO ] [MAIN ] Update Progress: 826/2373 symbols completed. FG took 22.3s. Estimated remaining: 3h 24m 46s. Rate: 7.6 symbols/min [2025-09-24T18:49:23.559449] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:23.607622] [DEBUG] [LOCAL ] FHI: Loaded 40816 existing records from primary storage. [2025-09-24T18:49:23.607782] [INFO ] [MAIN ] FHI: Loaded 40816 existing records. [2025-09-24T18:49:23.714949] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T18:49:23.799873] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:23.800334] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-24T18:49:23.800402] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-24T18:49:23.801548] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-24T18:49:23.801625] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-24T18:49:23.978498] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T18:49:24.023104] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-24T18:49:24.201851] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:24.401489] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:49:24.401910] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-24T18:49:24.816098] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-24T18:49:25.378155] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T18:49:25.616109] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-24T18:49:26.416085] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-24T18:49:26.434494] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T18:49:26.948869] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-24T18:49:27.216126] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-24T18:49:27.790554] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T18:49:27.791751] [INFO ] [REMOTE ] FGN: Full fetch complete (5748 records). [2025-09-24T18:49:27.791826] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-24T18:49:28.021305] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-24T18:49:28.163737] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-24T18:49:28.163860] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-24T18:49:28.164102] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-24T18:49:28.164147] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-24T18:49:28.164685] [DEBUG] [LOCAL ] FGN: Trimmed 5748 records to 3883 (keeping 200 days of data) [2025-09-24T18:49:28.194844] [DEBUG] [LOCAL ] FGN: Primary data saved (3883 records). [2025-09-24T18:49:28.195047] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-24T18:49:28.195180] [INFO ] [MAIN ] Update Progress: 827/2373 symbols completed. FGN took 22.2s. Estimated remaining: 3h 24m 32s. Rate: 7.6 symbols/min [2025-09-24T18:49:28.382244] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:28.464432] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-24T18:49:28.464700] [INFO ] [MAIN ] FHN: Loaded 53369 existing records. [2025-09-24T18:49:28.654082] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:28.654477] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-24T18:49:28.654539] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-24T18:49:28.656573] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-24T18:49:28.656668] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-24T18:49:28.825858] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-24T18:49:29.064053] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:29.497744] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T18:49:29.616170] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-24T18:49:30.284201] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T18:49:30.416107] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-24T18:49:31.125115] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T18:49:31.216173] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-24T18:49:31.508253] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T18:49:32.016112] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-24T18:49:32.816149] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-24T18:49:32.884736] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T18:49:33.480866] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:49:33.616102] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-24T18:49:34.109524] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T18:49:34.416085] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-24T18:49:35.058270] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T18:49:35.183174] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T18:49:35.216037] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-24T18:49:36.016085] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-24T18:49:36.562561] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T18:49:36.568575] [INFO ] [REMOTE ] FFWM: Full fetch complete (51701 records). [2025-09-24T18:49:36.568712] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-24T18:49:36.825348] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-24T18:49:36.967882] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-24T18:49:36.967988] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-24T18:49:36.968972] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-24T18:49:36.969037] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-24T18:49:36.970302] [DEBUG] [LOCAL ] FFWM: Trimmed 51701 records to 36155 (keeping 200 days of data) [2025-09-24T18:49:37.194860] [DEBUG] [LOCAL ] FFWM: Primary data saved (36155 records). [2025-09-24T18:49:37.195026] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-24T18:49:37.195156] [INFO ] [MAIN ] Update Progress: 828/2373 symbols completed. FFWM took 38.2s. Estimated remaining: 3h 24m 26s. Rate: 7.6 symbols/min [2025-09-24T18:49:37.376320] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:37.396992] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T18:49:37.462839] [DEBUG] [LOCAL ] FI: Loaded 53505 existing records from primary storage. [2025-09-24T18:49:37.463037] [INFO ] [MAIN ] FI: Loaded 53505 existing records. [2025-09-24T18:49:37.621262] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-24T18:49:37.654366] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:37.654636] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-24T18:49:37.654723] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-24T18:49:37.656080] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-24T18:49:37.656144] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-24T18:49:38.025052] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:38.416107] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-24T18:49:38.459069] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T18:49:38.984995] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T18:49:39.189094] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T18:49:39.216055] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-24T18:49:40.016112] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-24T18:49:40.728550] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T18:49:40.816109] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-24T18:49:41.084038] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T18:49:41.375882] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T18:49:41.616088] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-24T18:49:42.069990] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T18:49:42.416082] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-24T18:49:43.120441] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T18:49:43.216079] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-24T18:49:44.016096] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-24T18:49:44.583035] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T18:49:44.816083] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-24T18:49:44.923840] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:49:45.475460] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T18:49:45.477998] [INFO ] [REMOTE ] FGSN: Full fetch complete (7548 records). [2025-09-24T18:49:45.478164] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-24T18:49:45.621344] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-24T18:49:45.792077] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-24T18:49:45.794095] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:49:45.794353] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:49:45.794459] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-24T18:49:45.794570] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-24T18:49:45.794639] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-24T18:49:45.794762] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-24T18:49:45.794909] [INFO ] [MAIN ] Update Progress: 829/2373 symbols completed. FGSN took 24.2s. Estimated remaining: 3h 24m 19s. Rate: 7.6 symbols/min [2025-09-24T18:49:46.173694] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:49:46.207235] [DEBUG] [LOCAL ] FICO: Loaded 20466 existing records from primary storage. [2025-09-24T18:49:46.207421] [INFO ] [MAIN ] FICO: Loaded 20466 existing records. [2025-09-24T18:49:46.432833] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-24T18:49:46.493139] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:49:46.493407] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-24T18:49:46.493457] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-24T18:49:46.494372] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-24T18:49:46.494438] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-24T18:49:46.877788] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:49:47.216103] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-24T18:49:47.407392] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T18:49:48.016128] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-24T18:49:48.097917] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:49:48.147260] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T18:49:48.816096] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-24T18:49:49.616054] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-24T18:49:50.012597] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T18:49:50.416201] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-24T18:49:50.645005] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T18:49:51.184018] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T18:49:51.216042] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-24T18:49:51.498474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T18:49:52.016106] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-24T18:49:52.731589] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T18:49:52.816099] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-24T18:49:53.232692] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T18:49:53.616096] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-24T18:49:54.416064] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-24T18:49:54.450682] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T18:49:54.752118] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T18:49:55.216175] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-24T18:49:55.871091] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:49:56.016092] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-24T18:49:56.816052] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-24T18:49:56.958861] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T18:49:56.980775] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T18:49:57.616096] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-24T18:49:58.416061] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-24T18:49:58.743978] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T18:49:59.121121] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T18:49:59.216112] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-24T18:49:59.446220] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T18:50:00.016122] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-24T18:50:00.773365] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T18:50:00.780279] [INFO ] [REMOTE ] FHI: Full fetch complete (57937 records). [2025-09-24T18:50:00.780454] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-24T18:50:00.821174] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-24T18:50:01.191208] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-24T18:50:01.191299] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-24T18:50:01.192268] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-24T18:50:01.192332] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-24T18:50:01.193484] [DEBUG] [LOCAL ] FHI: Trimmed 57937 records to 40739 (keeping 200 days of data) [2025-09-24T18:50:01.441143] [DEBUG] [LOCAL ] FHI: Primary data saved (40739 records). [2025-09-24T18:50:01.441279] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-24T18:50:01.441364] [INFO ] [MAIN ] Update Progress: 830/2373 symbols completed. FHI took 38.1s. Estimated remaining: 3h 24m 25s. Rate: 7.5 symbols/min [2025-09-24T18:50:01.622675] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:01.619365] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-24T18:50:01.622942] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-24T18:50:01.623016] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-24T18:50:01.623950] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-24T18:50:01.624009] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-24T18:50:01.624055] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-24T18:50:01.624089] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-24T18:50:02.067498] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:02.090635] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T18:50:02.135269] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T18:50:02.416117] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-24T18:50:03.216119] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-24T18:50:03.549497] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-24T18:50:03.855748] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T18:50:03.886474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T18:50:04.016107] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-24T18:50:04.254395] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-24T18:50:04.816249] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-24T18:50:05.616134] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-24T18:50:06.000123] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-24T18:50:06.416104] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-24T18:50:06.554523] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T18:50:06.666197] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-24T18:50:07.216099] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-24T18:50:07.545593] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-24T18:50:08.016147] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-24T18:50:08.303247] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-24T18:50:08.816091] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-24T18:50:09.018517] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:50:09.018872] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-24T18:50:09.616078] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-24T18:50:10.416085] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-24T18:50:10.732010] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-24T18:50:11.216094] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-24T18:50:11.473753] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:50:11.483310] [INFO ] [REMOTE ] FHN: Full fetch complete (77277 records). [2025-09-24T18:50:11.483491] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-24T18:50:11.882222] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-24T18:50:11.882327] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-24T18:50:11.883473] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-24T18:50:11.883542] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-24T18:50:11.885194] [DEBUG] [LOCAL ] FHN: Trimmed 77277 records to 53369 (keeping 200 days of data) [2025-09-24T18:50:12.017943] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-24T18:50:12.229320] [DEBUG] [LOCAL ] FHN: Primary data saved (53369 records). [2025-09-24T18:50:12.229543] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-24T18:50:12.229673] [INFO ] [MAIN ] Update Progress: 831/2373 symbols completed. FHN took 44.0s. Estimated remaining: 3h 24m 23s. Rate: 7.5 symbols/min [2025-09-24T18:50:12.401372] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:12.445583] [DEBUG] [LOCAL ] FIGS: Loaded 48950 existing records from primary storage. [2025-09-24T18:50:12.445763] [INFO ] [MAIN ] FIGS: Loaded 48950 existing records. [2025-09-24T18:50:12.623798] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:12.624066] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-24T18:50:12.624115] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-24T18:50:12.625164] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-24T18:50:12.625227] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-24T18:50:12.834717] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-24T18:50:12.993366] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:13.558858] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-24T18:50:13.616044] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-24T18:50:13.926568] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T18:50:14.076416] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T18:50:14.416127] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-24T18:50:15.190288] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:50:15.216059] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-24T18:50:16.016119] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-24T18:50:16.372232] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-24T18:50:16.816079] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-24T18:50:16.878989] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T18:50:17.616083] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-24T18:50:17.764776] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T18:50:17.768781] [INFO ] [REMOTE ] FICO: Full fetch complete (28372 records). [2025-09-24T18:50:17.768891] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-24T18:50:18.142412] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-24T18:50:18.142516] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-24T18:50:18.143136] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-24T18:50:18.143198] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-24T18:50:18.144209] [DEBUG] [LOCAL ] FICO: Trimmed 28372 records to 20416 (keeping 200 days of data) [2025-09-24T18:50:18.281989] [DEBUG] [LOCAL ] FICO: Primary data saved (20416 records). [2025-09-24T18:50:18.282122] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-24T18:50:18.282257] [INFO ] [MAIN ] Update Progress: 832/2373 symbols completed. FICO took 32.5s. Estimated remaining: 3h 24m 11s. Rate: 7.5 symbols/min [2025-09-24T18:50:18.421843] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-24T18:50:18.453427] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:18.497793] [DEBUG] [LOCAL ] FIHL: Loaded 40370 existing records from primary storage. [2025-09-24T18:50:18.497950] [INFO ] [MAIN ] FIHL: Loaded 40370 existing records. [2025-09-24T18:50:18.685950] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:18.686208] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-24T18:50:18.686276] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-24T18:50:18.688052] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-24T18:50:18.688117] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-24T18:50:19.082510] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:19.108174] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T18:50:19.129249] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-09-24T18:50:19.138211] [INFO ] [REMOTE ] FIG: Full fetch complete (15413 records). [2025-09-24T18:50:19.138305] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-24T18:50:19.221181] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-24T18:50:19.325207] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-24T18:50:19.325577] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:50:19.325688] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:50:19.325785] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-24T18:50:19.325892] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-24T18:50:19.325967] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-24T18:50:19.326041] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-24T18:50:19.326126] [INFO ] [MAIN ] Update Progress: 833/2373 symbols completed. FIG took 17.9s. Estimated remaining: 3h 23m 51s. Rate: 7.6 symbols/min [2025-09-24T18:50:19.496302] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:19.506690] [DEBUG] [LOCAL ] FINS: Loaded 8218 existing records from primary storage. [2025-09-24T18:50:19.506817] [INFO ] [MAIN ] FINS: Loaded 8218 existing records. [2025-09-24T18:50:19.691764] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:19.692089] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-24T18:50:19.692152] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-24T18:50:19.692518] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-24T18:50:19.692581] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-24T18:50:20.021375] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-24T18:50:20.059100] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:20.260458] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T18:50:20.607062] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:50:20.816078] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-24T18:50:21.464724] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T18:50:21.616078] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-24T18:50:21.786424] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T18:50:22.416089] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-24T18:50:23.218351] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-24T18:50:23.220401] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T18:50:24.016055] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-24T18:50:24.061476] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T18:50:24.061859] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T18:50:24.816117] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-24T18:50:25.602150] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T18:50:25.616036] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-24T18:50:25.628768] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T18:50:26.416086] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-24T18:50:27.216048] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-24T18:50:27.535157] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T18:50:27.544795] [INFO ] [REMOTE ] FI: Full fetch complete (77167 records). [2025-09-24T18:50:27.544978] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-24T18:50:27.726604] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T18:50:27.855809] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T18:50:27.986224] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-24T18:50:27.986309] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-24T18:50:27.987397] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-24T18:50:27.987467] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-24T18:50:27.989071] [DEBUG] [LOCAL ] FI: Trimmed 77167 records to 53505 (keeping 200 days of data) [2025-09-24T18:50:28.042698] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-24T18:50:28.323735] [DEBUG] [LOCAL ] FI: Primary data saved (53505 records). [2025-09-24T18:50:28.323929] [INFO ] [MAIN ] FI: Full history saved. [2025-09-24T18:50:28.324042] [INFO ] [MAIN ] Update Progress: 834/2373 symbols completed. FI took 51.1s. Estimated remaining: 3h 23m 45s. Rate: 7.6 symbols/min [2025-09-24T18:50:28.499925] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:28.553817] [DEBUG] [LOCAL ] FINV: Loaded 45120 existing records from primary storage. [2025-09-24T18:50:28.553969] [INFO ] [MAIN ] FINV: Loaded 45120 existing records. [2025-09-24T18:50:28.737820] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:28.738079] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-24T18:50:28.738129] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-24T18:50:28.739052] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-24T18:50:28.739114] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-24T18:50:28.826083] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-24T18:50:28.997457] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T18:50:29.118573] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:29.616091] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-24T18:50:30.341595] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T18:50:30.416032] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-24T18:50:30.975976] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T18:50:31.216080] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-24T18:50:31.873534] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T18:50:32.016081] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-24T18:50:32.031663] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T18:50:32.816112] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-24T18:50:33.358009] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T18:50:33.616064] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-24T18:50:33.624447] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T18:50:34.416083] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-24T18:50:34.965546] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T18:50:35.216083] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-24T18:50:35.986162] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T18:50:36.016043] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-24T18:50:36.816161] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-24T18:50:36.866564] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T18:50:37.320174] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T18:50:37.551953] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:50:37.616038] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-24T18:50:38.061333] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T18:50:38.416100] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-24T18:50:39.216083] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-24T18:50:39.783075] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T18:50:40.016143] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-24T18:50:40.816069] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-24T18:50:40.965350] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T18:50:40.973971] [INFO ] [REMOTE ] FIGS: Full fetch complete (71057 records). [2025-09-24T18:50:40.974114] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-24T18:50:41.408022] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-24T18:50:41.408301] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-24T18:50:41.410625] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T18:50:41.409689] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-24T18:50:41.419244] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-24T18:50:41.420880] [DEBUG] [LOCAL ] FIGS: Trimmed 71057 records to 48918 (keeping 200 days of data) [2025-09-24T18:50:41.616133] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-24T18:50:41.699912] [DEBUG] [LOCAL ] FIGS: Primary data saved (48918 records). [2025-09-24T18:50:41.700055] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-24T18:50:41.700144] [INFO ] [MAIN ] Update Progress: 835/2373 symbols completed. FIGS took 29.5s. Estimated remaining: 3h 23m 47s. Rate: 7.5 symbols/min [2025-09-24T18:50:41.873515] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:41.926467] [DEBUG] [LOCAL ] FIS: Loaded 53366 existing records from primary storage. [2025-09-24T18:50:41.926683] [INFO ] [MAIN ] FIS: Loaded 53366 existing records. [2025-09-24T18:50:42.123076] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:42.130885] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-24T18:50:42.131046] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-24T18:50:42.132259] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T18:50:42.135094] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-24T18:50:42.140283] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-24T18:50:42.421278] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-24T18:50:42.518461] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:43.216053] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-24T18:50:43.243918] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T18:50:43.565814] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T18:50:44.016105] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-24T18:50:44.678726] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T18:50:44.816100] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-24T18:50:45.625221] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-24T18:50:45.650379] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T18:50:46.416054] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-24T18:50:46.523967] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T18:50:47.070863] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:50:47.216098] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-24T18:50:47.448904] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T18:50:48.016076] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-24T18:50:48.649754] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T18:50:48.652763] [INFO ] [REMOTE ] FINS: Full fetch complete (12742 records). [2025-09-24T18:50:48.653056] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-24T18:50:48.818221] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-24T18:50:48.836132] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:50:48.886926] [INFO ] [REMOTE ] FIHL: Full fetch complete (55851 records). [2025-09-24T18:50:48.901632] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-24T18:50:49.308819] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-24T18:50:49.319998] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-24T18:50:49.355729] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-24T18:50:49.389447] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-24T18:50:49.419055] [DEBUG] [LOCAL ] FINS: Trimmed 12742 records to 8240 (keeping 200 days of data) [2025-09-24T18:50:49.541527] [DEBUG] [LOCAL ] FINS: Primary data saved (8240 records). [2025-09-24T18:50:49.543783] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-24T18:50:49.543940] [INFO ] [MAIN ] Update Progress: 836/2373 symbols completed. FINS took 30.2s. Estimated remaining: 3h 23m 39s. Rate: 7.5 symbols/min [2025-09-24T18:50:49.623472] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-24T18:50:49.660687] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-24T18:50:49.677295] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-24T18:50:49.685736] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-24T18:50:49.689392] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-24T18:50:49.760073] [DEBUG] [LOCAL ] FIHL: Trimmed 55851 records to 40300 (keeping 200 days of data) [2025-09-24T18:50:49.763325] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:50:49.899085] [DEBUG] [LOCAL ] FIX: Loaded 30519 existing records from primary storage. [2025-09-24T18:50:49.899793] [INFO ] [MAIN ] FIX: Loaded 30519 existing records. [2025-09-24T18:50:50.095688] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:50:50.097196] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-24T18:50:50.099717] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-24T18:50:50.100723] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-24T18:50:50.153529] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-24T18:50:50.586538] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:50:50.587946] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-24T18:50:50.625843] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T18:50:50.647859] [DEBUG] [LOCAL ] FIHL: Primary data saved (40300 records). [2025-09-24T18:50:50.648000] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-24T18:50:50.648086] [INFO ] [MAIN ] Update Progress: 837/2373 symbols completed. FIHL took 32.4s. Estimated remaining: 3h 23m 18s. Rate: 7.6 symbols/min [2025-09-24T18:50:51.199264] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:50:51.216042] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-24T18:50:51.881836] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T18:50:52.016091] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-24T18:50:52.816055] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-24T18:50:52.924055] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T18:50:53.206077] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T18:50:53.616137] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-24T18:50:54.416059] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-24T18:50:54.685750] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T18:50:54.757178] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T18:50:55.216097] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-24T18:50:56.016078] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-24T18:50:56.279967] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T18:50:56.816139] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-24T18:50:57.086517] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T18:50:57.621298] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-24T18:50:57.648131] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T18:50:58.269702] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T18:50:58.278529] [INFO ] [REMOTE ] FINV: Full fetch complete (63476 records). [2025-09-24T18:50:58.278700] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-24T18:50:58.428474] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-24T18:50:58.699796] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-24T18:50:58.699905] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-24T18:50:58.701591] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-24T18:50:58.701727] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-24T18:50:58.703746] [DEBUG] [LOCAL ] FINV: Trimmed 63476 records to 45148 (keeping 200 days of data) [2025-09-24T18:50:58.979497] [DEBUG] [LOCAL ] FINV: Primary data saved (45148 records). [2025-09-24T18:50:58.979666] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-24T18:50:58.979801] [INFO ] [MAIN ] Update Progress: 838/2373 symbols completed. FINV took 30.7s. Estimated remaining: 3h 23m 11s. Rate: 7.6 symbols/min [2025-09-24T18:50:59.354885] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T18:50:59.366977] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-24T18:50:59.874873] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T18:51:00.016132] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-24T18:51:01.041767] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T18:51:01.053425] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-24T18:51:01.436300] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T18:51:01.616082] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-24T18:51:03.925688] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-24T18:51:03.937453] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-24T18:51:04.773161] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (3.16 seconds). [2025-09-24T18:51:04.779205] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-24T18:51:06.133451] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T18:51:06.145588] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-24T18:51:06.403542] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:51:06.411139] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-24T18:51:07.709324] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:51:07.716090] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-24T18:51:08.255465] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T18:51:08.265222] [INFO ] [REMOTE ] FIS: Full fetch complete (77172 records). [2025-09-24T18:51:08.265388] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-24T18:51:08.683051] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-24T18:51:08.683134] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-24T18:51:08.684113] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-24T18:51:08.684178] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-24T18:51:08.685670] [DEBUG] [LOCAL ] FIS: Trimmed 77172 records to 53365 (keeping 200 days of data) [2025-09-24T18:51:09.064482] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T18:51:09.074537] [DEBUG] [LOCAL ] FIS: Primary data saved (53365 records). [2025-09-24T18:51:09.074856] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-24T18:51:09.075052] [INFO ] [MAIN ] Update Progress: 839/2373 symbols completed. FIS took 27.4s. Estimated remaining: 3h 23m 7s. Rate: 7.6 symbols/min [2025-09-24T18:51:09.075179] [INFO ] [REMOTE ] FIX: Full fetch complete (45676 records). [2025-09-24T18:51:09.075420] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-24T18:51:09.489307] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-24T18:51:09.489398] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-24T18:51:09.490143] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-24T18:51:09.490206] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-24T18:51:09.491219] [DEBUG] [LOCAL ] FIX: Trimmed 45676 records to 30410 (keeping 200 days of data) [2025-09-24T18:51:09.695227] [DEBUG] [LOCAL ] FIX: Primary data saved (30410 records). [2025-09-24T18:51:09.695367] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-24T18:51:09.695450] [INFO ] [MAIN ] Update Progress: 840/2373 symbols completed. FIX took 20.2s. Estimated remaining: 3h 22m 45s. Rate: 7.6 symbols/min [2025-09-24T18:51:10.273962] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:10.447395] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:10.503110] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:10.499523] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:10.504004] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-24T18:51:10.504107] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-24T18:51:10.504877] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-24T18:51:10.507095] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-24T18:51:10.509004] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-24T18:51:10.509279] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-24T18:51:10.544822] [DEBUG] [LOCAL ] FLC: Loaded 5537 existing records from primary storage. [2025-09-24T18:51:10.557073] [INFO ] [MAIN ] FLC: Loaded 5537 existing records. [2025-09-24T18:51:10.975409] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:10.988669] [DEBUG] [LOCAL ] FLNG: Loaded 34056 existing records from primary storage. [2025-09-24T18:51:11.027817] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-24T18:51:11.033149] [INFO ] [MAIN ] FLNG: Loaded 34056 existing records. [2025-09-24T18:51:11.044173] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-24T18:51:11.117237] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-24T18:51:11.164159] [DEBUG] [LOCAL ] FLG: Loaded 53329 existing records from primary storage. [2025-09-24T18:51:11.170428] [INFO ] [MAIN ] FLG: Loaded 53329 existing records. [2025-09-24T18:51:11.174075] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-24T18:51:11.261425] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:11.327591] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-24T18:51:11.704715] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:11.717692] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:11.733413] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-24T18:51:11.750577] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-24T18:51:11.803973] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-24T18:51:11.778690] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-24T18:51:11.833301] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:11.861955] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-24T18:51:11.856772] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-24T18:51:11.862167] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-24T18:51:11.862529] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-24T18:51:11.878249] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-24T18:51:11.891240] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-24T18:51:12.137540] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:12.212767] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:12.202327] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-24T18:51:12.233997] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-24T18:51:12.269360] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-24T18:51:12.614892] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:12.712587] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-24T18:51:12.724390] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:12.725158] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-24T18:51:12.724939] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-24T18:51:12.816161] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:12.816639] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-24T18:51:12.992381] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:12.992816] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-24T18:51:12.993341] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-24T18:51:13.210771] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:13.211117] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-24T18:51:13.211584] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-24T18:51:13.219060] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T18:51:13.419706] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:13.420053] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-24T18:51:13.616090] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-24T18:51:14.255713] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T18:51:14.360604] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T18:51:14.381498] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T18:51:14.416048] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-24T18:51:15.216084] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-24T18:51:16.016084] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-24T18:51:16.706308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-24T18:51:16.757596] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:51:16.816070] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-24T18:51:16.979720] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:51:17.609447] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T18:51:17.616026] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-24T18:51:18.027376] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T18:51:18.416076] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-24T18:51:19.017476] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-24T18:51:19.018520] [INFO ] [REMOTE ] FIXT: Full fetch complete (1729 records). [2025-09-24T18:51:19.018605] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-24T18:51:19.202995] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-24T18:51:19.203264] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:51:19.203364] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:51:19.203441] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-24T18:51:19.203528] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-24T18:51:19.203606] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-24T18:51:19.203721] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-24T18:51:19.203818] [INFO ] [MAIN ] Update Progress: 841/2373 symbols completed. FIXT took 9.5s. Estimated remaining: 3h 22m 40s. Rate: 7.6 symbols/min [2025-09-24T18:51:19.224630] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-24T18:51:19.377919] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:19.458294] [DEBUG] [LOCAL ] FLO: Loaded 51894 existing records from primary storage. [2025-09-24T18:51:19.458527] [INFO ] [MAIN ] FLO: Loaded 51894 existing records. [2025-09-24T18:51:19.639115] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:19.639432] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-24T18:51:19.639501] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-24T18:51:19.641077] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-24T18:51:19.641139] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-24T18:51:19.994448] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:20.016033] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-24T18:51:20.816051] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-24T18:51:20.938385] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T18:51:21.616206] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-24T18:51:21.833462] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T18:51:22.379502] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T18:51:22.380943] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T18:51:22.416056] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-24T18:51:23.117132] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T18:51:23.216138] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-24T18:51:24.016140] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-24T18:51:24.614341] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T18:51:24.816119] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-24T18:51:25.594306] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T18:51:25.616051] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-24T18:51:26.267547] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T18:51:26.416043] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-24T18:51:27.216101] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-24T18:51:27.277829] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T18:51:27.769821] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T18:51:28.016087] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-24T18:51:28.816096] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-24T18:51:28.911374] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T18:51:29.531358] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T18:51:29.623335] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-24T18:51:29.629607] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T18:51:30.416130] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-24T18:51:31.005574] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T18:51:31.216147] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-24T18:51:32.016129] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-24T18:51:32.066728] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T18:51:32.816098] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-24T18:51:32.910883] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T18:51:33.460054] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T18:51:33.616204] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-24T18:51:34.416072] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-24T18:51:34.500568] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T18:51:34.706742] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T18:51:35.216083] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-24T18:51:35.814676] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T18:51:36.016063] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-24T18:51:36.711777] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T18:51:36.816132] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-24T18:51:36.956951] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T18:51:37.616120] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-24T18:51:38.076024] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T18:51:38.083013] [INFO ] [REMOTE ] FLNG: Full fetch complete (50930 records). [2025-09-24T18:51:38.083118] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-24T18:51:38.432444] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-24T18:51:38.491509] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-24T18:51:38.491629] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-24T18:51:38.492569] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-24T18:51:38.492698] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-24T18:51:38.495164] [DEBUG] [LOCAL ] FLNG: Trimmed 50930 records to 33996 (keeping 200 days of data) [2025-09-24T18:51:38.719784] [DEBUG] [LOCAL ] FLNG: Primary data saved (33996 records). [2025-09-24T18:51:38.719971] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-24T18:51:38.720167] [INFO ] [MAIN ] Update Progress: 842/2373 symbols completed. FLNG took 29.0s. Estimated remaining: 3h 22m 54s. Rate: 7.5 symbols/min [2025-09-24T18:51:38.898559] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:38.898793] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-24T18:51:38.898838] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-24T18:51:38.899019] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-24T18:51:38.899076] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-24T18:51:38.899145] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-24T18:51:38.899192] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-24T18:51:39.221244] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-24T18:51:39.284862] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:39.521784] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T18:51:39.766105] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T18:51:39.938407] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T18:51:40.016051] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-24T18:51:40.816126] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-24T18:51:41.005194] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T18:51:41.005537] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-24T18:51:41.616063] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-24T18:51:41.771886] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T18:51:42.416084] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-24T18:51:42.597214] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T18:51:43.121861] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T18:51:43.123833] [INFO ] [REMOTE ] FLC: Full fetch complete (8024 records). [2025-09-24T18:51:43.123907] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-24T18:51:43.221370] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-24T18:51:43.503147] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-24T18:51:43.503236] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-24T18:51:43.503483] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-24T18:51:43.503523] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-24T18:51:43.503985] [DEBUG] [LOCAL ] FLC: Trimmed 8024 records to 5497 (keeping 200 days of data) [2025-09-24T18:51:43.541084] [DEBUG] [LOCAL ] FLC: Primary data saved (5497 records). [2025-09-24T18:51:43.541224] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-24T18:51:43.541370] [INFO ] [MAIN ] Update Progress: 843/2373 symbols completed. FLC took 33.8s. Estimated remaining: 3h 22m 40s. Rate: 7.5 symbols/min [2025-09-24T18:51:43.783741] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:43.855796] [DEBUG] [LOCAL ] FLR: Loaded 53120 existing records from primary storage. [2025-09-24T18:51:43.855953] [INFO ] [MAIN ] FLR: Loaded 53120 existing records. [2025-09-24T18:51:44.029192] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-24T18:51:44.035867] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:44.037524] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-24T18:51:44.037586] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-24T18:51:44.039610] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-24T18:51:44.039700] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-24T18:51:44.408907] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:44.816062] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-24T18:51:45.020564] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T18:51:45.222000] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T18:51:45.616153] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-24T18:51:46.416079] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-24T18:51:46.640365] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T18:51:47.216058] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-24T18:51:47.321229] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:51:48.016089] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-24T18:51:48.212779] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T18:51:48.546932] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:51:48.816084] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-24T18:51:49.534516] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T18:51:49.616152] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-24T18:51:50.301480] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T18:51:50.416162] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-24T18:51:50.861270] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T18:51:51.216125] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-24T18:51:52.016098] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-24T18:51:52.190732] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T18:51:52.201147] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-09-24T18:51:52.201432] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-24T18:51:52.666832] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-24T18:51:52.666967] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-24T18:51:52.668321] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-24T18:51:52.668394] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-24T18:51:52.670772] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 53329 (keeping 200 days of data) [2025-09-24T18:51:52.817125] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-24T18:51:53.063106] [DEBUG] [LOCAL ] FLG: Primary data saved (53329 records). [2025-09-24T18:51:53.063437] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-24T18:51:53.063570] [INFO ] [MAIN ] Update Progress: 844/2373 symbols completed. FLG took 43.4s. Estimated remaining: 3h 22m 35s. Rate: 7.5 symbols/min [2025-09-24T18:51:53.143276] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T18:51:53.199871] [INFO ] [REMOTE ] FLO: Full fetch complete (74881 records). [2025-09-24T18:51:53.200056] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-24T18:51:53.397432] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:53.699069] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-24T18:51:53.699426] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-24T18:51:53.700884] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-24T18:51:53.701188] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-24T18:51:53.703982] [DEBUG] [LOCAL ] FLO: Trimmed 74881 records to 51884 (keeping 200 days of data) [2025-09-24T18:51:53.836184] [DEBUG] [LOCAL ] FLS: Loaded 50186 existing records from primary storage. [2025-09-24T18:51:53.865400] [INFO ] [MAIN ] FLS: Loaded 50186 existing records. [2025-09-24T18:51:53.892595] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T18:51:53.941120] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-24T18:51:53.998613] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T18:51:54.114727] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:54.116430] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-24T18:51:54.117028] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-24T18:51:54.120055] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-24T18:51:54.120407] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-24T18:51:54.417668] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-24T18:51:54.705720] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:54.718304] [DEBUG] [LOCAL ] FLO: Primary data saved (51884 records). [2025-09-24T18:51:54.718392] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-24T18:51:54.718467] [INFO ] [MAIN ] Update Progress: 845/2373 symbols completed. FLO took 35.5s. Estimated remaining: 3h 22m 15s. Rate: 7.6 symbols/min [2025-09-24T18:51:54.889492] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:51:54.940614] [DEBUG] [LOCAL ] FLUT: Loaded 50884 existing records from primary storage. [2025-09-24T18:51:54.940820] [INFO ] [MAIN ] FLUT: Loaded 50884 existing records. [2025-09-24T18:51:55.116181] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:51:55.116452] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-24T18:51:55.116504] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-24T18:51:55.117936] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-24T18:51:55.117997] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-24T18:51:55.222077] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-24T18:51:55.480703] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:51:55.762698] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T18:51:55.790007] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T18:51:56.016108] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-24T18:51:56.796953] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T18:51:56.816066] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-24T18:51:57.611756] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T18:51:57.621295] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-24T18:51:57.677432] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T18:51:58.416091] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-24T18:51:59.216067] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-24T18:51:59.455683] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T18:51:59.660032] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T18:52:00.016136] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-24T18:52:00.816114] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-24T18:52:01.367210] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T18:52:01.411951] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T18:52:01.416797] [INFO ] [REMOTE ] FLOC: Full fetch complete (37232 records). [2025-09-24T18:52:01.416897] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-24T18:52:01.616125] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-24T18:52:01.616248] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-24T18:52:01.617692] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:52:01.617777] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:52:01.617870] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-24T18:52:01.617975] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-24T18:52:01.618047] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-24T18:52:01.618238] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-24T18:52:01.618323] [INFO ] [MAIN ] Update Progress: 846/2373 symbols completed. FLOC took 22.9s. Estimated remaining: 3h 22m 6s. Rate: 7.6 symbols/min [2025-09-24T18:52:01.808360] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:01.830838] [DEBUG] [LOCAL ] FLXR: Loaded 19843 existing records from primary storage. [2025-09-24T18:52:01.830992] [INFO ] [MAIN ] FLXR: Loaded 19843 existing records. [2025-09-24T18:52:02.013295] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:02.013578] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-24T18:52:02.013630] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-24T18:52:02.014267] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-24T18:52:02.014329] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-24T18:52:02.388871] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:02.416030] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-24T18:52:02.453923] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T18:52:03.205277] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T18:52:03.216019] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-24T18:52:03.473345] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T18:52:04.016191] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-24T18:52:04.042167] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T18:52:04.816086] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-24T18:52:05.596842] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T18:52:05.613563] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T18:52:05.616958] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-24T18:52:06.416117] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-24T18:52:07.152993] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T18:52:07.216105] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-24T18:52:08.016059] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-24T18:52:08.236254] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T18:52:08.337129] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T18:52:08.816142] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-24T18:52:09.616084] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-24T18:52:09.769861] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T18:52:10.416091] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-24T18:52:10.581710] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T18:52:11.216064] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-24T18:52:11.379762] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T18:52:11.507058] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T18:52:12.016080] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-24T18:52:12.816112] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-24T18:52:12.989604] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T18:52:13.548874] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T18:52:13.616082] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-24T18:52:14.416064] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-24T18:52:14.486098] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T18:52:15.216051] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-24T18:52:15.338385] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T18:52:15.917564] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T18:52:15.964732] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T18:52:16.016077] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-24T18:52:16.816077] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-24T18:52:17.616124] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-24T18:52:18.016950] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T18:52:18.026428] [INFO ] [REMOTE ] FLR: Full fetch complete (76304 records). [2025-09-24T18:52:18.026548] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-24T18:52:18.434018] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-24T18:52:18.434786] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-24T18:52:18.436095] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-24T18:52:18.437256] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-24T18:52:18.437570] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-24T18:52:18.481131] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T18:52:18.481296] [DEBUG] [LOCAL ] FLR: Trimmed 76304 records to 53117 (keeping 200 days of data) [2025-09-24T18:52:18.725341] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T18:52:18.851048] [DEBUG] [LOCAL ] FLR: Primary data saved (53117 records). [2025-09-24T18:52:18.851269] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-24T18:52:18.851391] [INFO ] [MAIN ] Update Progress: 847/2373 symbols completed. FLR took 35.3s. Estimated remaining: 3h 22m 14s. Rate: 7.5 symbols/min [2025-09-24T18:52:19.038073] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:19.095208] [DEBUG] [LOCAL ] FMC: Loaded 51787 existing records from primary storage. [2025-09-24T18:52:19.095422] [INFO ] [MAIN ] FMC: Loaded 51787 existing records. [2025-09-24T18:52:19.221278] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-24T18:52:19.293593] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:19.294062] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-24T18:52:19.294117] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-24T18:52:19.295919] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-24T18:52:19.295988] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-24T18:52:19.707002] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:20.016165] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-24T18:52:20.327102] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T18:52:20.752722] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T18:52:20.816079] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-24T18:52:20.883890] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T18:52:21.616111] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-24T18:52:21.652147] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T18:52:22.416191] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-24T18:52:23.216110] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-24T18:52:23.349142] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:52:23.638839] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T18:52:23.643675] [INFO ] [REMOTE ] FLXR: Full fetch complete (24847 records). [2025-09-24T18:52:23.643758] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-24T18:52:24.016229] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-24T18:52:24.027486] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-24T18:52:24.027558] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-24T18:52:24.028288] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-24T18:52:24.028354] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-24T18:52:24.029358] [DEBUG] [LOCAL ] FLXR: Trimmed 24847 records to 19909 (keeping 200 days of data) [2025-09-24T18:52:24.157090] [DEBUG] [LOCAL ] FLXR: Primary data saved (19909 records). [2025-09-24T18:52:24.157299] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-24T18:52:24.157410] [INFO ] [MAIN ] Update Progress: 848/2373 symbols completed. FLXR took 22.5s. Estimated remaining: 3h 22m 2s. Rate: 7.5 symbols/min [2025-09-24T18:52:24.344814] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:24.353162] [DEBUG] [LOCAL ] FMN: Loaded 6172 existing records from primary storage. [2025-09-24T18:52:24.353294] [INFO ] [MAIN ] FMN: Loaded 6172 existing records. [2025-09-24T18:52:24.534093] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:24.534615] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-24T18:52:24.534709] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-24T18:52:24.535106] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-24T18:52:24.535171] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-24T18:52:24.821277] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-24T18:52:24.909752] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:24.945918] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T18:52:25.616083] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-24T18:52:25.805797] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T18:52:25.815582] [INFO ] [REMOTE ] FLUT: Full fetch complete (72749 records). [2025-09-24T18:52:25.815851] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-24T18:52:26.218824] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-24T18:52:26.218905] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-24T18:52:26.219998] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-24T18:52:26.220065] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-24T18:52:26.221524] [DEBUG] [LOCAL ] FLUT: Trimmed 72749 records to 50862 (keeping 200 days of data) [2025-09-24T18:52:26.428998] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-24T18:52:26.532222] [DEBUG] [LOCAL ] FLUT: Primary data saved (50862 records). [2025-09-24T18:52:26.532368] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-24T18:52:26.532455] [INFO ] [MAIN ] Update Progress: 849/2373 symbols completed. FLUT took 31.8s. Estimated remaining: 3h 21m 44s. Rate: 7.6 symbols/min [2025-09-24T18:52:26.716006] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:26.747535] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T18:52:26.787455] [DEBUG] [LOCAL ] FMS: Loaded 30385 existing records from primary storage. [2025-09-24T18:52:26.787625] [INFO ] [MAIN ] FMS: Loaded 30385 existing records. [2025-09-24T18:52:26.983009] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:26.983348] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-24T18:52:26.983468] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-24T18:52:26.984433] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-24T18:52:26.984493] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-24T18:52:27.220183] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T18:52:27.219046] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-24T18:52:27.344730] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:52:27.439771] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:28.016107] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-24T18:52:28.720311] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T18:52:28.744138] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T18:52:28.816049] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-24T18:52:29.456401] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T18:52:29.616079] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-24T18:52:30.393619] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T18:52:30.416060] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-24T18:52:31.055182] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T18:52:31.216102] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-24T18:52:31.717709] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T18:52:32.016091] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-24T18:52:32.816125] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-24T18:52:33.485541] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T18:52:33.616055] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-24T18:52:33.752964] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T18:52:33.762485] [INFO ] [REMOTE ] FLS: Full fetch complete (71350 records). [2025-09-24T18:52:33.762667] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-24T18:52:34.102496] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T18:52:34.183614] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-24T18:52:34.183731] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-24T18:52:34.184685] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-24T18:52:34.184761] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-24T18:52:34.186391] [DEBUG] [LOCAL ] FLS: Trimmed 71350 records to 50170 (keeping 200 days of data) [2025-09-24T18:52:34.416292] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-24T18:52:34.499292] [DEBUG] [LOCAL ] FLS: Primary data saved (50170 records). [2025-09-24T18:52:34.499450] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-24T18:52:34.499555] [INFO ] [MAIN ] Update Progress: 850/2373 symbols completed. FLS took 41.4s. Estimated remaining: 3h 21m 36s. Rate: 7.6 symbols/min [2025-09-24T18:52:34.670457] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:34.709480] [DEBUG] [LOCAL ] FMX: Loaded 40734 existing records from primary storage. [2025-09-24T18:52:34.709624] [INFO ] [MAIN ] FMX: Loaded 40734 existing records. [2025-09-24T18:52:34.892101] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:34.892380] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-24T18:52:34.892440] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-24T18:52:34.893723] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-24T18:52:34.893786] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-24T18:52:35.217176] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-24T18:52:35.279159] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:35.296483] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T18:52:36.016093] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-24T18:52:36.816085] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-24T18:52:37.144061] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T18:52:37.177256] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T18:52:37.419360] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T18:52:37.616080] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-24T18:52:38.416137] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-24T18:52:38.914612] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:52:39.216105] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-24T18:52:39.970083] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T18:52:39.982079] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T18:52:39.983588] [INFO ] [REMOTE ] FMN: Full fetch complete (10134 records). [2025-09-24T18:52:39.983684] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-24T18:52:40.021205] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-24T18:52:40.356394] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-24T18:52:40.356483] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-24T18:52:40.356840] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-24T18:52:40.356903] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-24T18:52:40.357453] [DEBUG] [LOCAL ] FMN: Trimmed 10134 records to 6054 (keeping 200 days of data) [2025-09-24T18:52:40.395523] [DEBUG] [LOCAL ] FMN: Primary data saved (6054 records). [2025-09-24T18:52:40.395684] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-24T18:52:40.395787] [INFO ] [MAIN ] Update Progress: 851/2373 symbols completed. FMN took 16.2s. Estimated remaining: 3h 21m 24s. Rate: 7.6 symbols/min [2025-09-24T18:52:40.569677] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:52:40.573482] [DEBUG] [LOCAL ] FMY: Loaded 1382 existing records from primary storage. [2025-09-24T18:52:40.573560] [INFO ] [MAIN ] FMY: Loaded 1382 existing records. [2025-09-24T18:52:40.755575] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:52:40.755877] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-24T18:52:40.755930] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-24T18:52:40.756123] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-24T18:52:40.756184] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-24T18:52:40.821170] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-24T18:52:41.132041] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:52:41.619224] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-24T18:52:41.621746] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:52:41.956419] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-24T18:52:42.318511] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T18:52:42.416189] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-24T18:52:43.216138] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-24T18:52:43.455389] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T18:52:43.595420] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-24T18:52:44.016130] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-24T18:52:44.816105] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-24T18:52:45.616089] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-24T18:52:45.845211] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T18:52:46.063707] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T18:52:46.065262] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T18:52:46.416085] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-24T18:52:47.216099] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-24T18:52:47.562377] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T18:52:48.016067] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-24T18:52:48.019068] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T18:52:48.816129] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-24T18:52:49.616073] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-24T18:52:49.737424] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T18:52:49.868499] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T18:52:50.126884] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-24T18:52:50.416205] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-24T18:52:51.216162] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-24T18:52:51.766988] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:52:52.016109] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-24T18:52:52.799547] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T18:52:52.816035] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-24T18:52:53.291119] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T18:52:53.616112] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-24T18:52:54.416103] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-24T18:52:54.487080] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T18:52:54.648091] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T18:52:54.857101] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T18:52:55.216104] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-24T18:52:55.538664] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-24T18:52:56.016084] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-24T18:52:56.816100] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-24T18:52:57.572504] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T18:52:57.616045] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-24T18:52:58.417179] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-24T18:52:58.420378] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T18:52:59.221208] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-24T18:52:59.232382] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:52:59.241123] [INFO ] [REMOTE ] FMX: Full fetch complete (57703 records). [2025-09-24T18:52:59.241269] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-24T18:52:59.659752] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-24T18:52:59.660055] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-24T18:52:59.661019] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-24T18:52:59.661105] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-24T18:52:59.680862] [DEBUG] [LOCAL ] FMX: Trimmed 57703 records to 40728 (keeping 200 days of data) [2025-09-24T18:52:59.683009] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T18:52:59.951524] [DEBUG] [LOCAL ] FMX: Primary data saved (40728 records). [2025-09-24T18:52:59.951698] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-24T18:52:59.951804] [INFO ] [MAIN ] Update Progress: 852/2373 symbols completed. FMX took 25.5s. Estimated remaining: 3h 21m 37s. Rate: 7.5 symbols/min [2025-09-24T18:53:00.021290] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-24T18:53:00.133418] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:00.172223] [DEBUG] [LOCAL ] FN: Loaded 39497 existing records from primary storage. [2025-09-24T18:53:00.172376] [INFO ] [MAIN ] FN: Loaded 39497 existing records. [2025-09-24T18:53:00.375234] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:00.375548] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-24T18:53:00.375607] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-24T18:53:00.377133] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-24T18:53:00.377198] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-24T18:53:00.593622] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T18:53:00.743724] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:00.816036] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-24T18:53:01.214471] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T18:53:01.223670] [INFO ] [REMOTE ] FMC: Full fetch complete (74938 records). [2025-09-24T18:53:01.223807] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-24T18:53:01.617428] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-24T18:53:01.618512] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-24T18:53:01.618570] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-24T18:53:01.619687] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-24T18:53:01.619848] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-24T18:53:01.621379] [DEBUG] [LOCAL ] FMC: Trimmed 74938 records to 51787 (keeping 200 days of data) [2025-09-24T18:53:01.953633] [DEBUG] [LOCAL ] FMC: Primary data saved (51787 records). [2025-09-24T18:53:01.953940] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-24T18:53:01.954080] [INFO ] [MAIN ] Update Progress: 853/2373 symbols completed. FMC took 43.1s. Estimated remaining: 3h 21m 19s. Rate: 7.6 symbols/min [2025-09-24T18:53:02.076866] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T18:53:02.162420] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:02.225122] [DEBUG] [LOCAL ] FNB: Loaded 52450 existing records from primary storage. [2025-09-24T18:53:02.225420] [INFO ] [MAIN ] FNB: Loaded 52450 existing records. [2025-09-24T18:53:02.423253] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T18:53:02.421263] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-24T18:53:02.474496] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:02.474891] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-24T18:53:02.474953] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-24T18:53:02.476537] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-24T18:53:02.476605] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-24T18:53:02.871393] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:03.039420] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T18:53:03.040390] [INFO ] [REMOTE ] FMY: Full fetch complete (1963 records). [2025-09-24T18:53:03.040461] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-24T18:53:03.223928] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-24T18:53:03.405172] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-24T18:53:03.405252] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-24T18:53:03.405359] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-24T18:53:03.405398] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-24T18:53:03.405768] [DEBUG] [LOCAL ] FMY: Trimmed 1963 records to 1387 (keeping 200 days of data) [2025-09-24T18:53:03.414829] [DEBUG] [LOCAL ] FMY: Primary data saved (1387 records). [2025-09-24T18:53:03.414893] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-24T18:53:03.414961] [INFO ] [MAIN ] Update Progress: 854/2373 symbols completed. FMY took 23.0s. Estimated remaining: 3h 20m 59s. Rate: 7.6 symbols/min [2025-09-24T18:53:03.586109] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:03.645276] [DEBUG] [LOCAL ] FND: Loaded 52147 existing records from primary storage. [2025-09-24T18:53:03.645474] [INFO ] [MAIN ] FND: Loaded 52147 existing records. [2025-09-24T18:53:03.833689] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:03.834044] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-24T18:53:03.834126] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-24T18:53:03.835325] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-24T18:53:03.835389] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-24T18:53:04.030355] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-24T18:53:04.218701] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:04.749071] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:53:04.816030] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-24T18:53:05.622583] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-24T18:53:05.625819] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T18:53:06.416241] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-24T18:53:06.422831] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:53:07.221217] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-24T18:53:07.240369] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T18:53:08.003609] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T18:53:08.016031] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-24T18:53:08.619147] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T18:53:08.816093] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-24T18:53:09.616077] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-24T18:53:09.697249] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T18:53:09.756986] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T18:53:10.416161] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-24T18:53:10.966613] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:53:11.216140] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-24T18:53:12.016094] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-24T18:53:12.148732] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:53:12.377037] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:53:12.816142] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-24T18:53:13.616133] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-24T18:53:13.706114] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T18:53:14.247925] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T18:53:14.253756] [INFO ] [REMOTE ] FMS: Full fetch complete (42369 records). [2025-09-24T18:53:14.253856] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-24T18:53:14.421373] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-24T18:53:14.643257] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-24T18:53:14.643334] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-24T18:53:14.644060] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-24T18:53:14.644123] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-24T18:53:14.646478] [DEBUG] [LOCAL ] FMS: Trimmed 42369 records to 30407 (keeping 200 days of data) [2025-09-24T18:53:14.832486] [DEBUG] [LOCAL ] FMS: Primary data saved (30407 records). [2025-09-24T18:53:14.832624] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-24T18:53:14.832758] [INFO ] [MAIN ] Update Progress: 855/2373 symbols completed. FMS took 48.3s. Estimated remaining: 3h 20m 57s. Rate: 7.6 symbols/min [2025-09-24T18:53:15.004924] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:15.040771] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T18:53:15.090600] [DEBUG] [LOCAL ] FNF: Loaded 49223 existing records from primary storage. [2025-09-24T18:53:15.090791] [INFO ] [MAIN ] FNF: Loaded 49223 existing records. [2025-09-24T18:53:15.234060] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-24T18:53:15.278379] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:15.279393] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-24T18:53:15.279525] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-24T18:53:15.280733] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-24T18:53:15.280808] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-24T18:53:15.642214] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:15.743282] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T18:53:16.016056] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-24T18:53:16.816103] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-24T18:53:17.028919] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:53:17.516624] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:53:17.616042] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-24T18:53:18.163998] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T18:53:18.416111] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-24T18:53:18.996897] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T18:53:19.216088] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-24T18:53:20.016121] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-24T18:53:20.115048] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T18:53:20.821943] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-24T18:53:20.827763] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:53:21.175440] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T18:53:21.616094] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-24T18:53:22.379936] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T18:53:22.416037] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-24T18:53:23.216101] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-24T18:53:23.244385] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T18:53:23.787613] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T18:53:24.016097] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-24T18:53:24.816055] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-24T18:53:24.927418] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:53:25.616137] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-24T18:53:25.743697] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T18:53:26.416117] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-24T18:53:26.525076] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T18:53:27.161566] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T18:53:27.216038] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-24T18:53:27.742533] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T18:53:28.016121] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-24T18:53:28.816057] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-24T18:53:28.864057] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T18:53:29.616418] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-24T18:53:29.617323] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T18:53:29.625547] [INFO ] [REMOTE ] FN: Full fetch complete (56428 records). [2025-09-24T18:53:29.625762] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-24T18:53:30.036222] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-24T18:53:30.036348] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-24T18:53:30.037322] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-24T18:53:30.037417] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-24T18:53:30.038756] [DEBUG] [LOCAL ] FN: Trimmed 56428 records to 39355 (keeping 200 days of data) [2025-09-24T18:53:30.299865] [DEBUG] [LOCAL ] FN: Primary data saved (39355 records). [2025-09-24T18:53:30.300085] [INFO ] [MAIN ] FN: Full history saved. [2025-09-24T18:53:30.300369] [INFO ] [MAIN ] Update Progress: 856/2373 symbols completed. FN took 30.3s. Estimated remaining: 3h 21m 3s. Rate: 7.5 symbols/min [2025-09-24T18:53:30.419633] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-24T18:53:30.488852] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:30.538261] [DEBUG] [LOCAL ] FNV: Loaded 46430 existing records from primary storage. [2025-09-24T18:53:30.538428] [INFO ] [MAIN ] FNV: Loaded 46430 existing records. [2025-09-24T18:53:30.685928] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T18:53:30.768373] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:30.768707] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-24T18:53:30.768776] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-24T18:53:30.770233] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-24T18:53:30.770305] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-24T18:53:31.150201] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:31.216050] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-24T18:53:31.404099] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T18:53:32.016136] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-24T18:53:32.093751] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T18:53:32.388495] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T18:53:32.816108] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-24T18:53:33.616063] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-24T18:53:33.807778] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T18:53:34.416116] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-24T18:53:34.465508] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T18:53:35.206756] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T18:53:35.221452] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-24T18:53:35.778622] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T18:53:36.016103] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-24T18:53:36.821209] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-24T18:53:36.832524] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T18:53:37.575099] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T18:53:37.616052] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-24T18:53:38.416066] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-24T18:53:38.618544] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T18:53:38.628095] [INFO ] [REMOTE ] FNB: Full fetch complete (75664 records). [2025-09-24T18:53:38.628237] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-24T18:53:39.055784] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-24T18:53:39.055937] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-24T18:53:39.057245] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-24T18:53:39.057332] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-24T18:53:39.059631] [DEBUG] [LOCAL ] FNB: Trimmed 75664 records to 52450 (keeping 200 days of data) [2025-09-24T18:53:39.250779] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-24T18:53:39.392215] [DEBUG] [LOCAL ] FNB: Primary data saved (52450 records). [2025-09-24T18:53:39.392365] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-24T18:53:39.392514] [INFO ] [MAIN ] Update Progress: 857/2373 symbols completed. FNB took 37.4s. Estimated remaining: 3h 20m 57s. Rate: 7.5 symbols/min [2025-09-24T18:53:39.595522] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:39.597600] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T18:53:39.610012] [INFO ] [REMOTE ] FNF: Full fetch complete (69528 records). [2025-09-24T18:53:39.610234] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-24T18:53:39.720404] [DEBUG] [LOCAL ] FOA: Loaded 13184 existing records from primary storage. [2025-09-24T18:53:39.723990] [INFO ] [MAIN ] FOA: Loaded 13184 existing records. [2025-09-24T18:53:40.147929] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:40.207787] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-24T18:53:40.219454] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-24T18:53:40.244055] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-24T18:53:40.244301] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-24T18:53:40.266963] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-24T18:53:40.289731] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-24T18:53:40.330938] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-24T18:53:40.336939] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-24T18:53:40.447419] [DEBUG] [LOCAL ] FNF: Trimmed 69528 records to 49184 (keeping 200 days of data) [2025-09-24T18:53:40.714835] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-24T18:53:40.829738] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-24T18:53:41.016394] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:41.018140] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-24T18:53:41.040032] [DEBUG] [LOCAL ] FNF: Primary data saved (49184 records). [2025-09-24T18:53:41.040354] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-24T18:53:41.041001] [INFO ] [MAIN ] Update Progress: 858/2373 symbols completed. FNF took 26.2s. Estimated remaining: 3h 20m 38s. Rate: 7.6 symbols/min [2025-09-24T18:53:41.223891] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:41.255396] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T18:53:41.277246] [DEBUG] [LOCAL ] FOF: Loaded 8395 existing records from primary storage. [2025-09-24T18:53:41.277598] [INFO ] [MAIN ] FOF: Loaded 8395 existing records. [2025-09-24T18:53:41.471460] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:41.471860] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-24T18:53:41.471927] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-24T18:53:41.472629] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-24T18:53:41.472745] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-24T18:53:41.626456] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-24T18:53:41.840979] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:42.181528] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T18:53:42.416117] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-24T18:53:42.672947] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T18:53:43.216090] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-24T18:53:43.412860] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T18:53:43.446470] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:53:44.016093] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-24T18:53:44.738812] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T18:53:44.816040] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-24T18:53:44.896580] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T18:53:44.905591] [INFO ] [REMOTE ] FND: Full fetch complete (74432 records). [2025-09-24T18:53:44.905742] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-24T18:53:45.312280] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-24T18:53:45.312365] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-24T18:53:45.313413] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-24T18:53:45.313481] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-24T18:53:45.315027] [DEBUG] [LOCAL ] FND: Trimmed 74432 records to 52143 (keeping 200 days of data) [2025-09-24T18:53:45.625894] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-24T18:53:45.650301] [DEBUG] [LOCAL ] FND: Primary data saved (52143 records). [2025-09-24T18:53:45.650402] [INFO ] [MAIN ] FND: Full history saved. [2025-09-24T18:53:45.650576] [INFO ] [MAIN ] Update Progress: 859/2373 symbols completed. FND took 42.2s. Estimated remaining: 3h 20m 24s. Rate: 7.6 symbols/min [2025-09-24T18:53:45.831774] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:45.852541] [DEBUG] [LOCAL ] FOR: Loaded 20132 existing records from primary storage. [2025-09-24T18:53:45.852694] [INFO ] [MAIN ] FOR: Loaded 20132 existing records. [2025-09-24T18:53:46.034060] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:46.034297] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-24T18:53:46.034345] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-24T18:53:46.034988] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-24T18:53:46.035050] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-24T18:53:46.426890] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T18:53:46.425955] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-24T18:53:46.433620] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:53:46.484169] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T18:53:47.216083] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-24T18:53:47.447207] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T18:53:47.757805] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T18:53:48.016139] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-24T18:53:48.816087] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-24T18:53:49.031340] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T18:53:49.616065] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-24T18:53:49.681888] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T18:53:50.329817] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T18:53:50.416104] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-24T18:53:51.216135] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-24T18:53:51.322238] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T18:53:52.016117] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-24T18:53:52.069890] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T18:53:52.816145] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-24T18:53:53.427023] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T18:53:53.616072] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-24T18:53:53.906809] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T18:53:54.416100] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-24T18:53:55.062703] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T18:53:55.134755] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T18:53:55.216090] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-24T18:53:55.945373] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T18:53:56.016137] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-24T18:53:56.638729] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T18:53:56.816134] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-24T18:53:57.403705] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T18:53:57.616125] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-24T18:53:58.416121] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-24T18:53:58.450000] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T18:53:58.452392] [INFO ] [REMOTE ] FOF: Full fetch complete (11860 records). [2025-09-24T18:53:58.452486] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-24T18:53:58.826667] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-24T18:53:58.826760] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-24T18:53:58.827059] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-24T18:53:58.827097] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-24T18:53:58.827571] [DEBUG] [LOCAL ] FOF: Trimmed 11860 records to 8388 (keeping 200 days of data) [2025-09-24T18:53:58.879068] [DEBUG] [LOCAL ] FOF: Primary data saved (8388 records). [2025-09-24T18:53:58.879205] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-24T18:53:58.879289] [INFO ] [MAIN ] Update Progress: 860/2373 symbols completed. FOF took 17.8s. Estimated remaining: 3h 20m 25s. Rate: 7.5 symbols/min [2025-09-24T18:53:59.050732] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:53:59.099754] [DEBUG] [LOCAL ] FOUR: Loaded 49524 existing records from primary storage. [2025-09-24T18:53:59.099934] [INFO ] [MAIN ] FOUR: Loaded 49524 existing records. [2025-09-24T18:53:59.221235] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-24T18:53:59.287949] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:53:59.288185] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-24T18:53:59.288240] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-24T18:53:59.289948] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-24T18:53:59.290025] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-24T18:53:59.651051] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:00.002014] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T18:54:00.016037] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-24T18:54:00.119629] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T18:54:00.816080] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-24T18:54:01.616085] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-24T18:54:01.937620] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T18:54:01.948022] [INFO ] [REMOTE ] FNV: Full fetch complete (66053 records). [2025-09-24T18:54:01.948221] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-24T18:54:02.357174] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T18:54:02.378552] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-24T18:54:02.379065] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-24T18:54:02.380069] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-24T18:54:02.380134] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-24T18:54:02.381691] [DEBUG] [LOCAL ] FNV: Trimmed 66053 records to 46378 (keeping 200 days of data) [2025-09-24T18:54:02.442549] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-24T18:54:02.681237] [DEBUG] [LOCAL ] FNV: Primary data saved (46378 records). [2025-09-24T18:54:02.681373] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-24T18:54:02.681485] [INFO ] [MAIN ] Update Progress: 861/2373 symbols completed. FNV took 32.4s. Estimated remaining: 3h 20m 10s. Rate: 7.6 symbols/min [2025-09-24T18:54:02.858311] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:02.876447] [DEBUG] [LOCAL ] FPF: Loaded 17613 existing records from primary storage. [2025-09-24T18:54:02.876567] [INFO ] [MAIN ] FPF: Loaded 17613 existing records. [2025-09-24T18:54:03.057183] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:03.057460] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-24T18:54:03.057508] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-24T18:54:03.058139] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-24T18:54:03.058200] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-24T18:54:03.223625] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-24T18:54:03.430170] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:04.016079] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-24T18:54:04.242081] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T18:54:04.497164] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T18:54:04.816080] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-24T18:54:05.056917] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (3.44 seconds). [2025-09-24T18:54:05.080403] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T18:54:05.384107] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T18:54:05.616092] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-24T18:54:06.416086] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-24T18:54:06.863842] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T18:54:07.216061] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-24T18:54:07.309282] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T18:54:08.016082] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-24T18:54:08.096331] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T18:54:08.816103] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-24T18:54:09.616112] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-24T18:54:09.743840] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T18:54:09.824053] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T18:54:10.416059] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-24T18:54:10.574168] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:54:11.216108] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-24T18:54:11.430752] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T18:54:12.016098] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-24T18:54:12.816037] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-24T18:54:12.856097] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T18:54:12.875206] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T18:54:13.616054] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-24T18:54:13.757519] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T18:54:14.416077] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-24T18:54:14.678829] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T18:54:14.682185] [INFO ] [REMOTE ] FOA: Full fetch complete (22292 records). [2025-09-24T18:54:14.682306] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-24T18:54:14.682847] [FATAL] [VALIDATOR ] FOA: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T18:54:14.682939] [FATAL] [MAIN ] FOA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:54:14.682987] [WARN ] [MAIN ] FOA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:54:14.683070] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-24T18:54:14.683180] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-24T18:54:14.683258] [INFO ] [LOCAL ] FOA: Starting deletion of derivative data. [2025-09-24T18:54:14.683842] [DEBUG] [LOCAL ] FOA: Deleted derivative data file. [2025-09-24T18:54:14.683982] [INFO ] [MAIN ] Update Progress: 862/2373 symbols completed. FOA took 35.3s. Estimated remaining: 3h 20m 9s. Rate: 7.5 symbols/min [2025-09-24T18:54:14.858131] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:14.878293] [DEBUG] [LOCAL ] FPH: Loaded 19740 existing records from primary storage. [2025-09-24T18:54:14.878415] [INFO ] [MAIN ] FPH: Loaded 19740 existing records. [2025-09-24T18:54:15.066734] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:15.067040] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-24T18:54:15.067120] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-24T18:54:15.067740] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-24T18:54:15.067807] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-24T18:54:15.225823] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-24T18:54:15.459962] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:15.563710] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T18:54:16.016137] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-24T18:54:16.816150] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-24T18:54:17.583459] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-24T18:54:17.616024] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-24T18:54:17.634678] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T18:54:17.638314] [INFO ] [REMOTE ] FOR: Full fetch complete (29900 records). [2025-09-24T18:54:17.638399] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-24T18:54:18.008580] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-24T18:54:18.008696] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-24T18:54:18.009343] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-24T18:54:18.009385] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-24T18:54:18.010185] [DEBUG] [LOCAL ] FOR: Trimmed 29900 records to 20132 (keeping 200 days of data) [2025-09-24T18:54:18.125608] [DEBUG] [LOCAL ] FOR: Primary data saved (20132 records). [2025-09-24T18:54:18.125764] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-24T18:54:18.125851] [INFO ] [MAIN ] Update Progress: 863/2373 symbols completed. FOR took 32.5s. Estimated remaining: 3h 19m 53s. Rate: 7.6 symbols/min [2025-09-24T18:54:18.294529] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:18.327319] [DEBUG] [LOCAL ] FPI: Loaded 31151 existing records from primary storage. [2025-09-24T18:54:18.327449] [INFO ] [MAIN ] FPI: Loaded 31151 existing records. [2025-09-24T18:54:18.421238] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-24T18:54:18.512849] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:18.513159] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-24T18:54:18.513215] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-24T18:54:18.514099] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-24T18:54:18.514160] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-24T18:54:18.615617] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T18:54:18.911405] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:18.947790] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-24T18:54:19.216124] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-24T18:54:19.648481] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T18:54:20.016122] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-24T18:54:20.269462] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T18:54:20.775010] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T18:54:20.816027] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-24T18:54:21.616038] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-24T18:54:21.851797] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T18:54:22.416129] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-24T18:54:22.670687] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T18:54:23.216104] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-24T18:54:23.484475] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T18:54:24.016125] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-24T18:54:24.816105] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-24T18:54:25.021592] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T18:54:25.066396] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T18:54:25.616134] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-24T18:54:26.047033] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T18:54:26.416106] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-24T18:54:27.178058] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T18:54:27.216075] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-24T18:54:27.707768] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:54:28.016088] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-24T18:54:28.816052] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-24T18:54:29.078625] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T18:54:29.128380] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T18:54:29.616098] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-24T18:54:29.793303] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T18:54:30.416118] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-24T18:54:30.835853] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T18:54:31.216081] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-24T18:54:31.242522] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T18:54:31.245915] [INFO ] [REMOTE ] FPF: Full fetch complete (26247 records). [2025-09-24T18:54:31.246003] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-24T18:54:31.641002] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-24T18:54:31.641079] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-24T18:54:31.641671] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-24T18:54:31.641732] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-24T18:54:31.642376] [DEBUG] [LOCAL ] FPF: Trimmed 26247 records to 17660 (keeping 200 days of data) [2025-09-24T18:54:31.748295] [DEBUG] [LOCAL ] FPF: Primary data saved (17660 records). [2025-09-24T18:54:31.748433] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-24T18:54:31.748519] [INFO ] [MAIN ] Update Progress: 864/2373 symbols completed. FPF took 29.1s. Estimated remaining: 3h 19m 55s. Rate: 7.5 symbols/min [2025-09-24T18:54:31.920766] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:31.964898] [DEBUG] [LOCAL ] FR: Loaded 46597 existing records from primary storage. [2025-09-24T18:54:31.965067] [INFO ] [MAIN ] FR: Loaded 46597 existing records. [2025-09-24T18:54:32.022352] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-24T18:54:32.154349] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:32.154600] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-24T18:54:32.154683] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-24T18:54:32.155813] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-24T18:54:32.155875] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-24T18:54:32.530421] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:32.549450] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T18:54:32.816122] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-24T18:54:33.616060] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-24T18:54:33.767632] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T18:54:34.064878] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T18:54:34.416127] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-24T18:54:34.821771] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T18:54:35.216132] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-24T18:54:35.453508] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T18:54:36.016099] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-24T18:54:36.816070] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-24T18:54:36.819514] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T18:54:37.073021] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T18:54:37.616063] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-24T18:54:37.946468] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T18:54:38.416139] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-24T18:54:38.587982] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T18:54:39.216113] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-24T18:54:39.810073] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T18:54:39.815728] [INFO ] [REMOTE ] FPI: Full fetch complete (44082 records). [2025-09-24T18:54:39.815871] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-24T18:54:40.022287] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-24T18:54:40.202604] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T18:54:40.248515] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-24T18:54:40.248613] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-24T18:54:40.249460] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-24T18:54:40.249515] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-24T18:54:40.250516] [DEBUG] [LOCAL ] FPI: Trimmed 44082 records to 31139 (keeping 200 days of data) [2025-09-24T18:54:40.433960] [DEBUG] [LOCAL ] FPI: Primary data saved (31139 records). [2025-09-24T18:54:40.434099] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-24T18:54:40.434188] [INFO ] [MAIN ] Update Progress: 865/2373 symbols completed. FPI took 22.3s. Estimated remaining: 3h 19m 49s. Rate: 7.5 symbols/min [2025-09-24T18:54:40.611280] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:40.627540] [DEBUG] [LOCAL ] FRA: Loaded 14584 existing records from primary storage. [2025-09-24T18:54:40.627697] [INFO ] [MAIN ] FRA: Loaded 14584 existing records. [2025-09-24T18:54:40.816580] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:40.816735] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-24T18:54:40.818079] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-24T18:54:40.818169] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-24T18:54:40.818716] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-24T18:54:40.818782] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-24T18:54:41.188939] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:41.622579] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-24T18:54:41.624944] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T18:54:41.634307] [INFO ] [REMOTE ] FOUR: Full fetch complete (71937 records). [2025-09-24T18:54:41.634435] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-24T18:54:42.049098] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-24T18:54:42.049308] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-24T18:54:42.050282] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-24T18:54:42.050361] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-24T18:54:42.051924] [DEBUG] [LOCAL ] FOUR: Trimmed 71937 records to 49527 (keeping 200 days of data) [2025-09-24T18:54:42.281038] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T18:54:42.378844] [DEBUG] [LOCAL ] FOUR: Primary data saved (49527 records). [2025-09-24T18:54:42.379022] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-24T18:54:42.379114] [INFO ] [MAIN ] Update Progress: 866/2373 symbols completed. FOUR took 43.5s. Estimated remaining: 3h 19m 30s. Rate: 7.6 symbols/min [2025-09-24T18:54:42.422547] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-24T18:54:42.557445] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:42.576712] [DEBUG] [LOCAL ] FRGE: Loaded 18585 existing records from primary storage. [2025-09-24T18:54:42.576851] [INFO ] [MAIN ] FRGE: Loaded 18585 existing records. [2025-09-24T18:54:42.765267] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:42.765514] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-24T18:54:42.765562] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-24T18:54:42.766062] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-24T18:54:42.766121] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-24T18:54:42.924988] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T18:54:43.151800] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:43.216037] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-24T18:54:43.694196] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T18:54:44.016099] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-24T18:54:44.715723] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T18:54:44.816080] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-24T18:54:45.061218] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T18:54:45.616094] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-24T18:54:46.119107] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:54:46.340070] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T18:54:46.346311] [INFO ] [REMOTE ] FPH: Full fetch complete (31503 records). [2025-09-24T18:54:46.346511] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-24T18:54:46.424812] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-24T18:54:46.908771] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-24T18:54:46.908876] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-24T18:54:46.909750] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-24T18:54:46.909818] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-24T18:54:46.910874] [DEBUG] [LOCAL ] FPH: Trimmed 31503 records to 19649 (keeping 200 days of data) [2025-09-24T18:54:47.031816] [DEBUG] [LOCAL ] FPH: Primary data saved (19649 records). [2025-09-24T18:54:47.031977] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-24T18:54:47.032069] [INFO ] [MAIN ] Update Progress: 867/2373 symbols completed. FPH took 32.3s. Estimated remaining: 3h 19m 17s. Rate: 7.6 symbols/min [2025-09-24T18:54:47.224944] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-24T18:54:47.227811] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:54:47.289356] [DEBUG] [LOCAL ] FRO: Loaded 51894 existing records from primary storage. [2025-09-24T18:54:47.289532] [INFO ] [MAIN ] FRO: Loaded 51894 existing records. [2025-09-24T18:54:47.479204] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:54:47.479497] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-24T18:54:47.479553] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-24T18:54:47.481121] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-24T18:54:47.481185] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-24T18:54:47.854389] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:54:47.880726] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T18:54:48.016038] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-24T18:54:48.530383] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T18:54:48.816102] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-24T18:54:49.616066] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-24T18:54:49.733280] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T18:54:49.792471] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T18:54:50.416086] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-24T18:54:51.216114] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-24T18:54:51.349181] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:54:51.377995] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T18:54:52.016070] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-24T18:54:52.081403] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-24T18:54:52.816089] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-24T18:54:53.616053] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-24T18:54:53.777077] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:54:53.969371] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T18:54:54.416087] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-24T18:54:55.097719] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:54:55.216050] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-24T18:54:56.016113] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-24T18:54:56.309193] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T18:54:56.710845] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T18:54:56.816035] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-24T18:54:56.872184] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T18:54:57.616048] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-24T18:54:57.779692] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T18:54:58.416083] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-24T18:54:59.025293] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T18:54:59.216055] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-24T18:54:59.367735] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T18:55:00.016107] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-24T18:55:00.816070] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-24T18:55:00.840779] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T18:55:00.908845] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T18:55:01.616083] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-24T18:55:02.416084] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-24T18:55:02.471704] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T18:55:02.529881] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:55:03.216090] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-24T18:55:03.649857] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T18:55:04.016077] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-24T18:55:04.088503] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T18:55:04.816078] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-24T18:55:05.552821] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T18:55:05.562173] [INFO ] [REMOTE ] FR: Full fetch complete (66576 records). [2025-09-24T18:55:05.562420] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-24T18:55:05.621416] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-24T18:55:05.850346] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T18:55:05.998481] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-24T18:55:05.998567] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-24T18:55:05.999543] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-24T18:55:05.999609] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-24T18:55:06.001028] [DEBUG] [LOCAL ] FR: Trimmed 66576 records to 46558 (keeping 200 days of data) [2025-09-24T18:55:06.302579] [DEBUG] [LOCAL ] FR: Primary data saved (46558 records). [2025-09-24T18:55:06.302826] [INFO ] [MAIN ] FR: Full history saved. [2025-09-24T18:55:06.302948] [INFO ] [MAIN ] Update Progress: 868/2373 symbols completed. FR took 34.6s. Estimated remaining: 3h 19m 28s. Rate: 7.5 symbols/min [2025-09-24T18:55:06.421315] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-24T18:55:06.489574] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:06.531485] [DEBUG] [LOCAL ] FRT: Loaded 42360 existing records from primary storage. [2025-09-24T18:55:06.531675] [INFO ] [MAIN ] FRT: Loaded 42360 existing records. [2025-09-24T18:55:06.713800] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:06.714128] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-24T18:55:06.714184] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-24T18:55:06.715212] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-24T18:55:06.715278] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-24T18:55:07.090118] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:07.216053] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-24T18:55:07.419078] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T18:55:07.609453] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T18:55:08.016086] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-24T18:55:08.751916] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T18:55:08.767403] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T18:55:08.816030] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-24T18:55:09.616059] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-24T18:55:09.730319] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T18:55:09.733408] [INFO ] [REMOTE ] FRA: Full fetch complete (24186 records). [2025-09-24T18:55:09.733498] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-24T18:55:10.099239] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-24T18:55:10.099318] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-24T18:55:10.099790] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-24T18:55:10.099853] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-24T18:55:10.101298] [DEBUG] [LOCAL ] FRA: Trimmed 24186 records to 14534 (keeping 200 days of data) [2025-09-24T18:55:10.188325] [DEBUG] [LOCAL ] FRA: Primary data saved (14534 records). [2025-09-24T18:55:10.188466] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-24T18:55:10.188554] [INFO ] [MAIN ] Update Progress: 869/2373 symbols completed. FRA took 29.8s. Estimated remaining: 3h 19m 13s. Rate: 7.5 symbols/min [2025-09-24T18:55:10.363163] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:10.401830] [DEBUG] [LOCAL ] FSCO: Loaded 36851 existing records from primary storage. [2025-09-24T18:55:10.401975] [INFO ] [MAIN ] FSCO: Loaded 36851 existing records. [2025-09-24T18:55:10.422333] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-24T18:55:10.587040] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:10.587391] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-24T18:55:10.587441] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-24T18:55:10.588306] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-24T18:55:10.588369] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-24T18:55:10.729342] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T18:55:10.968200] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:11.216084] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-24T18:55:11.958848] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T18:55:12.016033] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-24T18:55:12.654801] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T18:55:12.816055] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-24T18:55:13.493162] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T18:55:13.616042] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-24T18:55:14.305711] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T18:55:14.416047] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-24T18:55:15.154417] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T18:55:15.216080] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-24T18:55:15.858945] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T18:55:16.016092] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-24T18:55:16.816174] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-24T18:55:16.950844] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T18:55:17.616101] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-24T18:55:17.971855] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T18:55:18.167054] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T18:55:18.416131] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-24T18:55:18.854837] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T18:55:19.216114] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-24T18:55:19.597456] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T18:55:20.016146] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-24T18:55:20.695690] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T18:55:20.816038] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-24T18:55:21.266479] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T18:55:21.616077] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-24T18:55:22.311341] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T18:55:22.314141] [INFO ] [REMOTE ] FRGE: Full fetch complete (33993 records). [2025-09-24T18:55:22.314230] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-24T18:55:22.421169] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-24T18:55:22.727151] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-24T18:55:22.727330] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-24T18:55:22.728093] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-24T18:55:22.728176] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-24T18:55:22.729391] [DEBUG] [LOCAL ] FRGE: Trimmed 33993 records to 18432 (keeping 200 days of data) [2025-09-24T18:55:22.857373] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T18:55:22.898514] [DEBUG] [LOCAL ] FRGE: Primary data saved (18432 records). [2025-09-24T18:55:22.898745] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-24T18:55:22.898864] [INFO ] [MAIN ] Update Progress: 870/2373 symbols completed. FRGE took 40.5s. Estimated remaining: 3h 19m 14s. Rate: 7.5 symbols/min [2025-09-24T18:55:23.075533] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:23.124402] [DEBUG] [LOCAL ] FSK: Loaded 49398 existing records from primary storage. [2025-09-24T18:55:23.124577] [INFO ] [MAIN ] FSK: Loaded 49398 existing records. [2025-09-24T18:55:23.222604] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-24T18:55:23.307601] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:23.307882] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-24T18:55:23.307931] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-24T18:55:23.309542] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-24T18:55:23.309605] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-24T18:55:23.776713] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:24.005349] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T18:55:24.016029] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-24T18:55:24.756884] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T18:55:24.816044] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-24T18:55:25.197786] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T18:55:25.616121] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-24T18:55:26.416065] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-24T18:55:26.526227] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T18:55:27.208115] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T18:55:27.215271] [INFO ] [REMOTE ] FRT: Full fetch complete (60254 records). [2025-09-24T18:55:27.215389] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-24T18:55:27.223676] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-24T18:55:27.621245] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-24T18:55:27.621349] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-24T18:55:27.622279] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-24T18:55:27.622359] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-24T18:55:27.641292] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T18:55:27.647961] [DEBUG] [LOCAL ] FRT: Trimmed 60254 records to 42294 (keeping 200 days of data) [2025-09-24T18:55:27.936050] [DEBUG] [LOCAL ] FRT: Primary data saved (42294 records). [2025-09-24T18:55:27.936336] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-24T18:55:27.936542] [INFO ] [MAIN ] Update Progress: 871/2373 symbols completed. FRT took 21.6s. Estimated remaining: 3h 19m 1s. Rate: 7.5 symbols/min [2025-09-24T18:55:28.021208] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-24T18:55:28.132830] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:28.182318] [DEBUG] [LOCAL ] FSLY: Loaded 51274 existing records from primary storage. [2025-09-24T18:55:28.182488] [INFO ] [MAIN ] FSLY: Loaded 51274 existing records. [2025-09-24T18:55:28.376827] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:28.377121] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-24T18:55:28.377172] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-24T18:55:28.378248] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-24T18:55:28.378311] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-24T18:55:28.775859] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:28.816045] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-24T18:55:29.058239] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T18:55:29.070182] [INFO ] [REMOTE ] FRO: Full fetch complete (75389 records). [2025-09-24T18:55:29.070357] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-24T18:55:29.493401] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-24T18:55:29.493837] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-24T18:55:29.495128] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-24T18:55:29.495279] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-24T18:55:29.499588] [DEBUG] [LOCAL ] FRO: Trimmed 75389 records to 51855 (keeping 200 days of data) [2025-09-24T18:55:29.617062] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-24T18:55:29.636480] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T18:55:29.866561] [DEBUG] [LOCAL ] FRO: Primary data saved (51855 records). [2025-09-24T18:55:29.866825] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-24T18:55:29.866965] [INFO ] [MAIN ] Update Progress: 872/2373 symbols completed. FRO took 42.8s. Estimated remaining: 3h 18m 42s. Rate: 7.6 symbols/min [2025-09-24T18:55:30.051797] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:30.105896] [DEBUG] [LOCAL ] FSM: Loaded 53288 existing records from primary storage. [2025-09-24T18:55:30.106063] [INFO ] [MAIN ] FSM: Loaded 53288 existing records. [2025-09-24T18:55:30.305324] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:30.305786] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-24T18:55:30.305875] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-24T18:55:30.307022] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-24T18:55:30.307095] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-24T18:55:30.421158] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-24T18:55:30.688276] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:30.781968] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T18:55:31.216056] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-24T18:55:31.340615] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T18:55:31.933776] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T18:55:32.016059] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-24T18:55:32.816108] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-24T18:55:32.975624] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T18:55:33.616055] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-24T18:55:33.671850] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T18:55:34.416069] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-24T18:55:34.650091] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T18:55:35.145000] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T18:55:35.216050] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-24T18:55:35.934691] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T18:55:35.941688] [INFO ] [REMOTE ] FSCO: Full fetch complete (53992 records). [2025-09-24T18:55:35.941792] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-24T18:55:36.021312] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-24T18:55:36.332603] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-24T18:55:36.332747] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-24T18:55:36.333562] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-24T18:55:36.333664] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-24T18:55:36.334822] [DEBUG] [LOCAL ] FSCO: Trimmed 53992 records to 36964 (keeping 200 days of data) [2025-09-24T18:55:36.559409] [DEBUG] [LOCAL ] FSCO: Primary data saved (36964 records). [2025-09-24T18:55:36.559544] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-24T18:55:36.559694] [INFO ] [MAIN ] Update Progress: 873/2373 symbols completed. FSCO took 26.4s. Estimated remaining: 3h 18m 32s. Rate: 7.6 symbols/min [2025-09-24T18:55:36.731376] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:36.773839] [DEBUG] [LOCAL ] FSS: Loaded 34552 existing records from primary storage. [2025-09-24T18:55:36.773978] [INFO ] [MAIN ] FSS: Loaded 34552 existing records. [2025-09-24T18:55:36.839544] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-24T18:55:36.978498] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:36.978957] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-24T18:55:36.979066] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-24T18:55:36.979943] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-24T18:55:36.980004] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-24T18:55:37.110562] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T18:55:37.376508] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:37.616063] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-24T18:55:37.764246] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T18:55:38.416113] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-24T18:55:38.500682] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T18:55:38.532181] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T18:55:39.216155] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-24T18:55:39.901751] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:55:40.016104] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-24T18:55:40.816102] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-24T18:55:41.016196] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:55:41.616160] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-24T18:55:41.784014] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T18:55:42.416097] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-24T18:55:42.584730] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T18:55:42.977923] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T18:55:43.216085] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-24T18:55:43.299055] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T18:55:44.016081] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-24T18:55:44.433866] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T18:55:44.816146] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-24T18:55:44.979561] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T18:55:45.616097] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-24T18:55:46.250013] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T18:55:46.416078] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-24T18:55:47.216067] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-24T18:55:47.309102] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T18:55:47.889128] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T18:55:48.016073] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-24T18:55:48.779336] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T18:55:48.816036] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-24T18:55:49.617722] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-24T18:55:49.623413] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T18:55:50.202623] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T18:55:50.416130] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-24T18:55:50.646104] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T18:55:51.216110] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-24T18:55:51.795710] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T18:55:52.016138] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-24T18:55:52.793201] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T18:55:52.816127] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-24T18:55:53.628207] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-24T18:55:53.651160] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T18:55:54.339520] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T18:55:54.416055] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-24T18:55:55.153157] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T18:55:55.216038] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-24T18:55:55.856688] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:55:56.016037] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-24T18:55:56.816072] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-24T18:55:57.010499] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T18:55:57.021121] [INFO ] [REMOTE ] FSM: Full fetch complete (76692 records). [2025-09-24T18:55:57.021260] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-24T18:55:57.420435] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-24T18:55:57.420519] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-24T18:55:57.421516] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-24T18:55:57.421581] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-24T18:55:57.423137] [DEBUG] [LOCAL ] FSM: Trimmed 76692 records to 53287 (keeping 200 days of data) [2025-09-24T18:55:57.638817] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-24T18:55:57.676162] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T18:55:57.690797] [INFO ] [REMOTE ] FSK: Full fetch complete (71407 records). [2025-09-24T18:55:57.692097] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-24T18:55:58.103506] [DEBUG] [LOCAL ] FSM: Primary data saved (53287 records). [2025-09-24T18:55:58.104079] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-24T18:55:58.114587] [INFO ] [MAIN ] Update Progress: 874/2373 symbols completed. FSM took 28.2s. Estimated remaining: 3h 18m 48s. Rate: 7.5 symbols/min [2025-09-24T18:55:58.313761] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-24T18:55:58.317460] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-24T18:55:58.318672] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-24T18:55:58.318989] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-24T18:55:58.403327] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:58.411807] [DEBUG] [LOCAL ] FSK: Trimmed 71407 records to 49410 (keeping 200 days of data) [2025-09-24T18:55:58.428914] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T18:55:58.443420] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-24T18:55:58.446956] [DEBUG] [LOCAL ] FT: Loaded 6291 existing records from primary storage. [2025-09-24T18:55:58.448437] [INFO ] [MAIN ] FT: Loaded 6291 existing records. [2025-09-24T18:55:58.754190] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:58.757592] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-24T18:55:58.758448] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-24T18:55:58.759613] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-24T18:55:58.760234] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-24T18:55:59.156272] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:55:59.221013] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-24T18:55:59.359529] [DEBUG] [LOCAL ] FSK: Primary data saved (49410 records). [2025-09-24T18:55:59.359717] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-24T18:55:59.359819] [INFO ] [MAIN ] Update Progress: 875/2373 symbols completed. FSK took 36.5s. Estimated remaining: 3h 18m 28s. Rate: 7.5 symbols/min [2025-09-24T18:55:59.624444] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:55:59.642593] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T18:55:59.665293] [DEBUG] [LOCAL ] FTHY: Loaded 11693 existing records from primary storage. [2025-09-24T18:55:59.665443] [INFO ] [MAIN ] FTHY: Loaded 11693 existing records. [2025-09-24T18:55:59.850964] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:55:59.851306] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-24T18:55:59.851435] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-24T18:55:59.852438] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-24T18:55:59.852506] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-24T18:55:59.990565] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T18:56:00.026146] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-24T18:56:00.199791] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T18:56:00.270118] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:00.816083] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-24T18:56:01.616079] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-24T18:56:01.684969] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T18:56:02.073598] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T18:56:02.084020] [INFO ] [REMOTE ] FSLY: Full fetch complete (74961 records). [2025-09-24T18:56:02.084329] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-24T18:56:02.425414] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-24T18:56:02.537845] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-24T18:56:02.537967] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-24T18:56:02.539017] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-24T18:56:02.539176] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-24T18:56:02.540807] [DEBUG] [LOCAL ] FSLY: Trimmed 74961 records to 51254 (keeping 200 days of data) [2025-09-24T18:56:02.845939] [DEBUG] [LOCAL ] FSLY: Primary data saved (51254 records). [2025-09-24T18:56:02.846082] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-24T18:56:02.846191] [INFO ] [MAIN ] Update Progress: 876/2373 symbols completed. FSLY took 34.9s. Estimated remaining: 3h 18m 13s. Rate: 7.6 symbols/min [2025-09-24T18:56:03.031200] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:03.059460] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T18:56:03.126197] [DEBUG] [LOCAL ] FTI: Loaded 53303 existing records from primary storage. [2025-09-24T18:56:03.126466] [INFO ] [MAIN ] FTI: Loaded 53303 existing records. [2025-09-24T18:56:03.213482] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T18:56:03.218716] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-24T18:56:03.329333] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:03.329720] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-24T18:56:03.329784] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-24T18:56:03.331831] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-24T18:56:03.332068] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-24T18:56:03.744172] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:04.016056] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-24T18:56:04.208486] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T18:56:04.593864] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T18:56:04.816090] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-24T18:56:05.415083] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T18:56:05.616129] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-24T18:56:06.416116] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-24T18:56:06.945198] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T18:56:07.216095] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-24T18:56:07.828911] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T18:56:08.016045] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-24T18:56:08.160529] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T18:56:08.768232] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-24T18:56:08.816084] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-24T18:56:09.616140] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-24T18:56:10.416127] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-24T18:56:10.459638] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T18:56:10.652092] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T18:56:10.980464] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T18:56:11.216057] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-24T18:56:11.807304] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T18:56:12.016091] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-24T18:56:12.671751] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T18:56:12.816120] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-24T18:56:13.616098] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-24T18:56:13.768435] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T18:56:14.416112] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-24T18:56:14.816407] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T18:56:14.821533] [INFO ] [REMOTE ] FSS: Full fetch complete (48145 records). [2025-09-24T18:56:14.821715] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-24T18:56:15.223388] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-24T18:56:15.220411] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-24T18:56:15.231606] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-24T18:56:15.234444] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-24T18:56:15.236406] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T18:56:15.240420] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-24T18:56:15.243374] [DEBUG] [LOCAL ] FSS: Trimmed 48145 records to 34449 (keeping 200 days of data) [2025-09-24T18:56:15.485977] [DEBUG] [LOCAL ] FSS: Primary data saved (34449 records). [2025-09-24T18:56:15.486206] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-24T18:56:15.486347] [INFO ] [MAIN ] Update Progress: 877/2373 symbols completed. FSS took 38.9s. Estimated remaining: 3h 18m 13s. Rate: 7.5 symbols/min [2025-09-24T18:56:16.016118] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-24T18:56:16.119734] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-24T18:56:16.755848] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T18:56:16.816089] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-24T18:56:17.615347] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T18:56:17.618607] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-24T18:56:18.416117] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-24T18:56:19.211893] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T18:56:19.214127] [INFO ] [REMOTE ] FT: Full fetch complete (8997 records). [2025-09-24T18:56:19.214206] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-24T18:56:19.225969] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-24T18:56:19.566577] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T18:56:19.639906] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-24T18:56:19.639994] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-24T18:56:19.640270] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-24T18:56:19.640311] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-24T18:56:19.640833] [DEBUG] [LOCAL ] FT: Trimmed 8997 records to 6313 (keeping 200 days of data) [2025-09-24T18:56:19.679871] [DEBUG] [LOCAL ] FT: Primary data saved (6313 records). [2025-09-24T18:56:19.680046] [INFO ] [MAIN ] FT: Full history saved. [2025-09-24T18:56:19.680175] [INFO ] [MAIN ] Update Progress: 878/2373 symbols completed. FT took 21.6s. Estimated remaining: 3h 17m 58s. Rate: 7.6 symbols/min [2025-09-24T18:56:20.016098] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-24T18:56:20.052515] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T18:56:20.816134] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-24T18:56:21.628754] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T18:56:21.631552] [INFO ] [REMOTE ] FTHY: Full fetch complete (17637 records). [2025-09-24T18:56:21.631725] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-24T18:56:22.018112] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T18:56:22.103297] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-24T18:56:22.103150] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-24T18:56:22.103561] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-24T18:56:22.105354] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-24T18:56:22.105544] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-24T18:56:22.106770] [DEBUG] [LOCAL ] FTHY: Trimmed 17637 records to 11752 (keeping 200 days of data) [2025-09-24T18:56:22.190790] [DEBUG] [LOCAL ] FTHY: Primary data saved (11752 records). [2025-09-24T18:56:22.191022] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-24T18:56:22.191159] [INFO ] [MAIN ] Update Progress: 879/2373 symbols completed. FTHY took 22.8s. Estimated remaining: 3h 17m 41s. Rate: 7.6 symbols/min [2025-09-24T18:56:23.862297] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T18:56:23.874056] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-24T18:56:25.596581] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T18:56:25.608556] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-24T18:56:27.254958] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:56:27.270371] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-24T18:56:29.037311] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T18:56:29.049218] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-24T18:56:30.686902] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T18:56:30.697976] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-24T18:56:32.772514] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T18:56:32.785225] [INFO ] [REMOTE ] FTI: Full fetch complete (77127 records). [2025-09-24T18:56:32.785567] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-24T18:56:33.283156] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-24T18:56:33.283260] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-24T18:56:33.284461] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-24T18:56:33.284536] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-24T18:56:33.286447] [DEBUG] [LOCAL ] FTI: Trimmed 77127 records to 53304 (keeping 200 days of data) [2025-09-24T18:56:33.633685] [DEBUG] [LOCAL ] FTI: Primary data saved (53304 records). [2025-09-24T18:56:33.633841] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-24T18:56:33.633936] [INFO ] [MAIN ] Update Progress: 880/2373 symbols completed. FTI took 30.8s. Estimated remaining: 3h 17m 39s. Rate: 7.6 symbols/min [2025-09-24T18:56:34.317848] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:34.316923] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:34.344882] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:34.409428] [DEBUG] [LOCAL ] FTWO: Loaded 1776 existing records from primary storage. [2025-09-24T18:56:34.429247] [INFO ] [MAIN ] FTWO: Loaded 1776 existing records. [2025-09-24T18:56:34.434921] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:34.688924] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:34.690749] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-24T18:56:34.691962] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-24T18:56:34.691810] [DEBUG] [LOCAL ] FTK: Loaded 32220 existing records from primary storage. [2025-09-24T18:56:34.692264] [INFO ] [MAIN ] FTK: Loaded 32220 existing records. [2025-09-24T18:56:34.698483] [DEBUG] [LOCAL ] FTS: Loaded 42123 existing records from primary storage. [2025-09-24T18:56:34.704544] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-24T18:56:34.704825] [INFO ] [MAIN ] FTS: Loaded 42123 existing records. [2025-09-24T18:56:34.704925] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-24T18:56:35.148201] [DEBUG] [LOCAL ] FTV: Loaded 52917 existing records from primary storage. [2025-09-24T18:56:35.187693] [INFO ] [MAIN ] FTV: Loaded 52917 existing records. [2025-09-24T18:56:35.275198] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:35.419749] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-24T18:56:35.464638] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-24T18:56:35.454098] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:35.501486] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-24T18:56:35.556562] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-24T18:56:35.578199] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-24T18:56:35.573553] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-24T18:56:35.603558] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-24T18:56:35.672295] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-24T18:56:35.876911] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:35.941149] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-24T18:56:35.950219] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:36.013364] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-24T18:56:36.034329] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-24T18:56:36.094160] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-24T18:56:36.110009] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-24T18:56:36.684416] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T18:56:36.729398] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:36.779707] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-24T18:56:36.719740] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-24T18:56:36.956078] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:36.971846] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-24T18:56:37.032902] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:37.033272] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-24T18:56:37.458038] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T18:56:37.459740] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-24T18:56:37.922555] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-24T18:56:37.924012] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-24T18:56:37.951994] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T18:56:37.957366] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-24T18:56:38.303342] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-24T18:56:38.305880] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-24T18:56:38.423430] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:56:38.456624] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-24T18:56:38.459700] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T18:56:38.469826] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-24T18:56:38.745250] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-24T18:56:38.746919] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-24T18:56:38.835727] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T18:56:38.841427] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-24T18:56:39.077714] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-24T18:56:39.078767] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-24T18:56:39.520557] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T18:56:39.522133] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-24T18:56:39.545679] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T18:56:39.554752] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-24T18:56:39.592123] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T18:56:39.596897] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-24T18:56:40.013971] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T18:56:40.029364] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-24T18:56:40.050454] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T18:56:40.350710] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-24T18:56:40.525739] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T18:56:40.788988] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T18:56:40.816086] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-24T18:56:41.616082] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-24T18:56:42.386871] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T18:56:42.421029] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-24T18:56:42.423050] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T18:56:43.216068] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-24T18:56:43.770730] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T18:56:43.771779] [INFO ] [REMOTE ] FTWO: Full fetch complete (3498 records). [2025-09-24T18:56:43.771855] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-24T18:56:44.026384] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-24T18:56:44.142259] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:56:44.211846] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-24T18:56:44.211942] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-24T18:56:44.212112] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-24T18:56:44.212155] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-24T18:56:44.212760] [DEBUG] [LOCAL ] FTWO: Trimmed 3498 records to 1778 (keeping 200 days of data) [2025-09-24T18:56:44.226344] [DEBUG] [LOCAL ] FTWO: Primary data saved (1778 records). [2025-09-24T18:56:44.226483] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-24T18:56:44.226608] [INFO ] [MAIN ] Update Progress: 881/2373 symbols completed. FTWO took 10.6s. Estimated remaining: 3h 17m 36s. Rate: 7.6 symbols/min [2025-09-24T18:56:44.399747] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:44.450011] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-24T18:56:44.450182] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-09-24T18:56:44.628613] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:44.628888] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-24T18:56:44.628935] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-24T18:56:44.630251] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-24T18:56:44.630313] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-24T18:56:44.826639] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-24T18:56:44.985569] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:45.616056] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-24T18:56:45.780478] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T18:56:46.348906] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T18:56:46.416097] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-24T18:56:47.216186] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-24T18:56:47.611591] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T18:56:47.983691] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T18:56:48.016094] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-24T18:56:48.728504] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T18:56:48.816072] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-24T18:56:49.236734] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T18:56:49.616079] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-24T18:56:50.416103] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-24T18:56:50.637150] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T18:56:51.216131] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-24T18:56:51.744376] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-24T18:56:51.882521] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T18:56:52.016108] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-24T18:56:52.635802] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T18:56:52.816115] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-24T18:56:53.616149] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-24T18:56:53.666246] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:56:54.416083] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-24T18:56:54.741962] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T18:56:54.775717] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T18:56:55.216079] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-24T18:56:55.833886] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T18:56:56.016106] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-24T18:56:56.816136] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-24T18:56:57.145920] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T18:56:57.404444] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T18:56:57.410389] [INFO ] [REMOTE ] FTK: Full fetch complete (42491 records). [2025-09-24T18:56:57.410491] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-24T18:56:57.621210] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-24T18:56:57.810187] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-24T18:56:57.810275] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-24T18:56:57.811009] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-24T18:56:57.811074] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-24T18:56:57.812143] [DEBUG] [LOCAL ] FTK: Trimmed 42491 records to 32203 (keeping 200 days of data) [2025-09-24T18:56:58.005949] [DEBUG] [LOCAL ] FTK: Primary data saved (32203 records). [2025-09-24T18:56:58.006104] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-24T18:56:58.006197] [INFO ] [MAIN ] Update Progress: 882/2373 symbols completed. FTK took 24.4s. Estimated remaining: 3h 17m 38s. Rate: 7.5 symbols/min [2025-09-24T18:56:58.182173] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:56:58.216128] [DEBUG] [LOCAL ] FUL: Loaded 32980 existing records from primary storage. [2025-09-24T18:56:58.232901] [INFO ] [MAIN ] FUL: Loaded 32980 existing records. [2025-09-24T18:56:58.332032] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T18:56:58.426280] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-24T18:56:58.469604] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:56:58.470874] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-24T18:56:58.470955] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-24T18:56:58.472097] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-24T18:56:58.472163] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-24T18:56:58.832965] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:56:59.216085] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-24T18:56:59.842327] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-24T18:57:00.016085] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-24T18:57:00.065484] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T18:57:00.072758] [INFO ] [REMOTE ] FTS: Full fetch complete (60016 records). [2025-09-24T18:57:00.072892] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-24T18:57:00.484540] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-24T18:57:00.489950] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-24T18:57:00.499260] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-24T18:57:00.499354] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-24T18:57:00.500857] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T18:57:00.507729] [DEBUG] [LOCAL ] FTS: Trimmed 60016 records to 42103 (keeping 200 days of data) [2025-09-24T18:57:00.791049] [DEBUG] [LOCAL ] FTS: Primary data saved (42103 records). [2025-09-24T18:57:00.791190] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-24T18:57:00.791290] [INFO ] [MAIN ] Update Progress: 883/2373 symbols completed. FTS took 27.2s. Estimated remaining: 3h 17m 21s. Rate: 7.6 symbols/min [2025-09-24T18:57:00.825062] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-24T18:57:00.979794] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:01.033182] [DEBUG] [LOCAL ] FUN: Loaded 51566 existing records from primary storage. [2025-09-24T18:57:01.033409] [INFO ] [MAIN ] FUN: Loaded 51566 existing records. [2025-09-24T18:57:01.233502] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:01.233778] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-24T18:57:01.233843] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-24T18:57:01.235080] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-24T18:57:01.235143] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-24T18:57:01.607842] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:01.616037] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-24T18:57:02.416114] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-24T18:57:03.143591] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-24T18:57:03.216099] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-24T18:57:03.857206] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-24T18:57:04.016132] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-24T18:57:04.984066] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-24T18:57:04.991270] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-24T18:57:05.150459] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (3.53 seconds). [2025-09-24T18:57:05.616074] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-24T18:57:06.076947] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-24T18:57:06.121144] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T18:57:06.295058] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T18:57:06.416083] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-24T18:57:06.986605] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T18:57:07.216084] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-24T18:57:08.016077] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-24T18:57:08.144186] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T18:57:08.708741] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T18:57:08.816050] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-24T18:57:09.616102] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-24T18:57:10.154940] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-24T18:57:10.193636] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T18:57:10.416145] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-24T18:57:11.216145] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-24T18:57:11.321130] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T18:57:11.331826] [INFO ] [REMOTE ] FTV: Full fetch complete (76273 records). [2025-09-24T18:57:11.332083] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-24T18:57:11.793695] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-24T18:57:11.793879] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-24T18:57:11.795358] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-24T18:57:11.795457] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-24T18:57:11.820357] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T18:57:11.827054] [DEBUG] [LOCAL ] FTV: Trimmed 76273 records to 52913 (keeping 200 days of data) [2025-09-24T18:57:12.018681] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-24T18:57:12.196610] [DEBUG] [LOCAL ] FTV: Primary data saved (52913 records). [2025-09-24T18:57:12.196870] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-24T18:57:12.196991] [INFO ] [MAIN ] Update Progress: 884/2373 symbols completed. FTV took 38.6s. Estimated remaining: 3h 17m 19s. Rate: 7.5 symbols/min [2025-09-24T18:57:12.392253] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:12.420142] [DEBUG] [LOCAL ] FVR: Loaded 22125 existing records from primary storage. [2025-09-24T18:57:12.420364] [INFO ] [MAIN ] FVR: Loaded 22125 existing records. [2025-09-24T18:57:12.619125] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:12.619722] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-24T18:57:12.619784] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-24T18:57:12.620899] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-24T18:57:12.620963] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-24T18:57:12.826494] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-24T18:57:12.923332] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T18:57:13.081157] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:13.616117] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-24T18:57:13.926257] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T18:57:14.191327] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-24T18:57:14.416223] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-24T18:57:15.216104] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-24T18:57:16.018407] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-24T18:57:16.021211] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-24T18:57:16.492374] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-24T18:57:16.612019] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T18:57:16.816081] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-24T18:57:17.616111] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-24T18:57:18.249332] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-24T18:57:18.259452] [INFO ] [REMOTE ] FUBO: Full fetch complete (77754 records). [2025-09-24T18:57:18.259590] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-24T18:57:18.417455] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-24T18:57:18.708610] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-24T18:57:18.709289] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-24T18:57:18.711357] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-24T18:57:18.713673] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T18:57:18.713794] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-24T18:57:18.740235] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T18:57:18.745231] [DEBUG] [LOCAL ] FUBO: Trimmed 77754 records to 53700 (keeping 200 days of data) [2025-09-24T18:57:19.063466] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-24T18:57:19.063608] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-24T18:57:19.063740] [INFO ] [MAIN ] Update Progress: 885/2373 symbols completed. FUBO took 34.8s. Estimated remaining: 3h 17m 9s. Rate: 7.5 symbols/min [2025-09-24T18:57:19.216069] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-24T18:57:19.236569] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:19.276362] [DEBUG] [LOCAL ] FVRR: Loaded 40210 existing records from primary storage. [2025-09-24T18:57:19.276527] [INFO ] [MAIN ] FVRR: Loaded 40210 existing records. [2025-09-24T18:57:19.466870] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:19.467273] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-24T18:57:19.467331] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-24T18:57:19.470082] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-24T18:57:19.470157] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-24T18:57:19.839067] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:19.856578] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T18:57:20.016083] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-24T18:57:20.816070] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-24T18:57:20.930239] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T18:57:21.395289] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T18:57:21.402726] [INFO ] [REMOTE ] FUL: Full fetch complete (46877 records). [2025-09-24T18:57:21.402903] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-24T18:57:21.621519] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-24T18:57:21.825304] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-24T18:57:21.825429] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-24T18:57:21.826416] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-24T18:57:21.826552] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-24T18:57:21.827855] [DEBUG] [LOCAL ] FUL: Trimmed 46877 records to 32962 (keeping 200 days of data) [2025-09-24T18:57:22.031732] [DEBUG] [LOCAL ] FUL: Primary data saved (32962 records). [2025-09-24T18:57:22.031883] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-24T18:57:22.031999] [INFO ] [MAIN ] Update Progress: 886/2373 symbols completed. FUL took 24.0s. Estimated remaining: 3h 16m 53s. Rate: 7.6 symbols/min [2025-09-24T18:57:22.211998] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:22.216249] [DEBUG] [LOCAL ] FXED: Loaded 1225 existing records from primary storage. [2025-09-24T18:57:22.216390] [INFO ] [MAIN ] FXED: Loaded 1225 existing records. [2025-09-24T18:57:22.406695] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:22.407388] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-24T18:57:22.407467] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-24T18:57:22.407856] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-24T18:57:22.407976] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-24T18:57:22.421330] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-24T18:57:22.545423] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:57:22.842775] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:23.216146] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-24T18:57:23.379338] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T18:57:23.664863] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T18:57:24.016206] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-24T18:57:24.380872] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-24T18:57:24.824634] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-24T18:57:24.834856] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T18:57:25.616164] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-24T18:57:25.962010] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T18:57:26.416163] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-24T18:57:27.221212] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-24T18:57:27.247054] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T18:57:27.528774] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-24T18:57:27.672689] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T18:57:28.016130] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-24T18:57:28.816119] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-24T18:57:29.151013] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-24T18:57:29.614866] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T18:57:29.619144] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-24T18:57:30.416137] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-24T18:57:30.776763] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-24T18:57:31.047284] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T18:57:31.216085] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-24T18:57:32.016106] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-24T18:57:32.816145] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-24T18:57:33.020347] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T18:57:33.076909] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T18:57:33.087396] [INFO ] [REMOTE ] FUN: Full fetch complete (72428 records). [2025-09-24T18:57:33.087627] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-24T18:57:33.516852] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-24T18:57:33.516987] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-24T18:57:33.518291] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-24T18:57:33.518368] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-24T18:57:33.520515] [DEBUG] [LOCAL ] FUN: Trimmed 72428 records to 51571 (keeping 200 days of data) [2025-09-24T18:57:33.617247] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-24T18:57:33.869139] [DEBUG] [LOCAL ] FUN: Primary data saved (51571 records). [2025-09-24T18:57:33.869379] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-24T18:57:33.869595] [INFO ] [MAIN ] Update Progress: 887/2373 symbols completed. FUN took 33.1s. Estimated remaining: 3h 16m 51s. Rate: 7.5 symbols/min [2025-09-24T18:57:34.065100] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:34.143609] [DEBUG] [LOCAL ] G: Loaded 49763 existing records from primary storage. [2025-09-24T18:57:34.145582] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T18:57:34.145755] [INFO ] [MAIN ] G: Loaded 49763 existing records. [2025-09-24T18:57:34.343981] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:34.344240] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-24T18:57:34.344299] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-24T18:57:34.345843] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-24T18:57:34.345904] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-24T18:57:34.424437] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-24T18:57:34.756557] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:34.777721] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T18:57:35.216200] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-24T18:57:35.904535] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:57:36.016174] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-24T18:57:36.371164] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-24T18:57:36.816092] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-24T18:57:36.924412] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T18:57:37.616092] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-24T18:57:38.304291] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T18:57:38.416136] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-24T18:57:39.223463] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-24T18:57:39.242942] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:57:39.435148] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T18:57:39.624453] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-24T18:57:40.016111] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-24T18:57:40.816101] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-24T18:57:41.103759] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T18:57:41.257837] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T18:57:41.616097] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-24T18:57:42.416101] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-24T18:57:43.216120] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-24T18:57:43.218017] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T18:57:43.350096] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T18:57:43.354126] [INFO ] [REMOTE ] FVR: Full fetch complete (30677 records). [2025-09-24T18:57:43.354239] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-24T18:57:43.747843] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T18:57:43.758482] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-24T18:57:43.758601] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-24T18:57:43.759343] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-24T18:57:43.759438] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-24T18:57:43.762017] [DEBUG] [LOCAL ] FVR: Trimmed 30677 records to 22164 (keeping 200 days of data) [2025-09-24T18:57:43.907960] [DEBUG] [LOCAL ] FVR: Primary data saved (22164 records). [2025-09-24T18:57:43.908105] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-24T18:57:43.908277] [INFO ] [MAIN ] Update Progress: 888/2373 symbols completed. FVR took 31.7s. Estimated remaining: 3h 16m 47s. Rate: 7.5 symbols/min [2025-09-24T18:57:44.021215] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-24T18:57:44.084197] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:44.119634] [DEBUG] [LOCAL ] GAB: Loaded 27947 existing records from primary storage. [2025-09-24T18:57:44.119801] [INFO ] [MAIN ] GAB: Loaded 27947 existing records. [2025-09-24T18:57:44.314829] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:44.315088] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-24T18:57:44.315138] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-24T18:57:44.315897] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-24T18:57:44.315987] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-24T18:57:44.512935] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T18:57:44.717342] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:44.816115] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-24T18:57:45.239309] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-24T18:57:45.240226] [INFO ] [REMOTE ] FXED: Full fetch complete (1783 records). [2025-09-24T18:57:45.240298] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-24T18:57:45.611147] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-24T18:57:45.611230] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-24T18:57:45.611323] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-24T18:57:45.611392] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-24T18:57:45.611790] [DEBUG] [LOCAL ] FXED: Trimmed 1783 records to 1228 (keeping 200 days of data) [2025-09-24T18:57:45.616720] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-24T18:57:45.621917] [DEBUG] [LOCAL ] FXED: Primary data saved (1228 records). [2025-09-24T18:57:45.621991] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-24T18:57:45.622095] [INFO ] [MAIN ] Update Progress: 889/2373 symbols completed. FXED took 23.6s. Estimated remaining: 3h 16m 28s. Rate: 7.6 symbols/min [2025-09-24T18:57:45.802846] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:57:45.816020] [DEBUG] [LOCAL ] GAM: Loaded 4195 existing records from primary storage. [2025-09-24T18:57:45.816188] [INFO ] [MAIN ] GAM: Loaded 4195 existing records. [2025-09-24T18:57:46.010447] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:57:46.010816] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-24T18:57:46.010872] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-24T18:57:46.011137] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-24T18:57:46.011196] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-24T18:57:46.362958] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:57:46.416043] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-24T18:57:47.038871] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T18:57:47.216115] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-24T18:57:47.320403] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T18:57:48.016134] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-24T18:57:48.310140] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T18:57:48.816104] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-24T18:57:49.616055] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-24T18:57:49.802409] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T18:57:49.990454] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T18:57:50.416217] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-24T18:57:50.615634] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T18:57:50.796981] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-24T18:57:51.216111] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-24T18:57:52.016213] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-24T18:57:52.640439] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T18:57:52.816099] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-24T18:57:52.966928] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T18:57:53.500569] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T18:57:53.616268] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-24T18:57:54.416123] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-24T18:57:55.020743] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T18:57:55.216066] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-24T18:57:55.311316] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T18:57:55.797267] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T18:57:56.016086] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-24T18:57:56.816147] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-24T18:57:57.282018] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T18:57:57.616095] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-24T18:57:58.107764] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T18:57:58.416079] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-24T18:57:58.815437] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T18:57:59.206140] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T18:57:59.216056] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-24T18:58:00.016102] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-24T18:58:00.579732] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T18:58:00.816084] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-24T18:58:01.569998] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T18:58:01.616079] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-24T18:58:02.172981] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T18:58:02.416078] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-24T18:58:02.768375] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T18:58:03.216087] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-24T18:58:04.016065] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-24T18:58:04.235206] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T18:58:04.816056] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-24T18:58:04.951283] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T18:58:04.973135] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T18:58:04.980854] [INFO ] [REMOTE ] FVRR: Full fetch complete (58790 records). [2025-09-24T18:58:04.981037] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-24T18:58:05.402982] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-24T18:58:05.403161] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-24T18:58:05.404017] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-24T18:58:05.404080] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-24T18:58:05.405336] [DEBUG] [LOCAL ] FVRR: Trimmed 58790 records to 40192 (keeping 200 days of data) [2025-09-24T18:58:05.616344] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-24T18:58:05.655735] [DEBUG] [LOCAL ] FVRR: Primary data saved (40192 records). [2025-09-24T18:58:05.655879] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-24T18:58:05.656020] [INFO ] [MAIN ] Update Progress: 890/2373 symbols completed. FVRR took 46.6s. Estimated remaining: 3h 16m 41s. Rate: 7.5 symbols/min [2025-09-24T18:58:05.846189] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:05.847028] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T18:58:05.907430] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-24T18:58:05.907586] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-24T18:58:06.090821] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:06.091124] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-24T18:58:06.091185] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-24T18:58:06.092688] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-24T18:58:06.092762] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-24T18:58:06.425713] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-24T18:58:06.447250] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:07.216139] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-24T18:58:07.334871] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T18:58:07.343971] [INFO ] [REMOTE ] G: Full fetch complete (71592 records). [2025-09-24T18:58:07.344128] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-24T18:58:07.738760] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T18:58:07.840725] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-24T18:58:07.850762] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-24T18:58:07.851792] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-24T18:58:07.853575] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T18:58:07.852908] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-24T18:58:07.861117] [DEBUG] [LOCAL ] G: Trimmed 71592 records to 49791 (keeping 200 days of data) [2025-09-24T18:58:08.045035] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-24T18:58:08.176521] [DEBUG] [LOCAL ] G: Primary data saved (49791 records). [2025-09-24T18:58:08.176700] [INFO ] [MAIN ] G: Full history saved. [2025-09-24T18:58:08.176831] [INFO ] [MAIN ] Update Progress: 891/2373 symbols completed. G took 34.3s. Estimated remaining: 3h 16m 24s. Rate: 7.5 symbols/min [2025-09-24T18:58:08.354738] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:08.375350] [DEBUG] [LOCAL ] GATX: Loaded 18146 existing records from primary storage. [2025-09-24T18:58:08.375482] [INFO ] [MAIN ] GATX: Loaded 18146 existing records. [2025-09-24T18:58:08.564108] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:08.564375] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-24T18:58:08.564424] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-24T18:58:08.565251] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-24T18:58:08.565312] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-24T18:58:08.674094] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T18:58:08.681113] [INFO ] [REMOTE ] GAM: Full fetch complete (6866 records). [2025-09-24T18:58:08.686360] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-24T18:58:08.817188] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-24T18:58:09.224837] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:09.347307] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-24T18:58:09.347389] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-24T18:58:09.347627] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-24T18:58:09.347713] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-24T18:58:09.348164] [DEBUG] [LOCAL ] GAM: Trimmed 6866 records to 4119 (keeping 200 days of data) [2025-09-24T18:58:09.374084] [DEBUG] [LOCAL ] GAM: Primary data saved (4119 records). [2025-09-24T18:58:09.374249] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-24T18:58:09.374359] [INFO ] [MAIN ] Update Progress: 892/2373 symbols completed. GAM took 23.8s. Estimated remaining: 3h 16m 4s. Rate: 7.6 symbols/min [2025-09-24T18:58:09.542681] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:09.561872] [DEBUG] [LOCAL ] GBAB: Loaded 13017 existing records from primary storage. [2025-09-24T18:58:09.561999] [INFO ] [MAIN ] GBAB: Loaded 13017 existing records. [2025-09-24T18:58:09.625109] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-24T18:58:09.755889] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:09.756139] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-24T18:58:09.756188] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-24T18:58:09.756801] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-24T18:58:09.756866] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-24T18:58:10.136168] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T18:58:10.158276] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:10.416070] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-24T18:58:10.718229] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T18:58:11.216103] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-24T18:58:12.016058] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-24T18:58:12.312251] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-24T18:58:12.391698] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T18:58:12.816056] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-24T18:58:13.064319] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T18:58:13.616073] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-24T18:58:14.416052] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-24T18:58:14.448762] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T18:58:14.954626] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T18:58:14.960372] [INFO ] [REMOTE ] GAB: Full fetch complete (39523 records). [2025-09-24T18:58:14.960488] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-24T18:58:15.221306] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-24T18:58:15.344680] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T18:58:15.362095] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-24T18:58:15.362446] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-24T18:58:15.363161] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-24T18:58:15.363222] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-24T18:58:15.364092] [DEBUG] [LOCAL ] GAB: Trimmed 39523 records to 27984 (keeping 200 days of data) [2025-09-24T18:58:15.534083] [DEBUG] [LOCAL ] GAB: Primary data saved (27984 records). [2025-09-24T18:58:15.534231] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-24T18:58:15.534322] [INFO ] [MAIN ] Update Progress: 893/2373 symbols completed. GAB took 31.6s. Estimated remaining: 3h 15m 54s. Rate: 7.6 symbols/min [2025-09-24T18:58:15.726863] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:15.765878] [DEBUG] [LOCAL ] GBCI: Loaded 40099 existing records from primary storage. [2025-09-24T18:58:15.766051] [INFO ] [MAIN ] GBCI: Loaded 40099 existing records. [2025-09-24T18:58:15.963730] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:15.972455] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-24T18:58:15.972664] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-24T18:58:15.973524] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T18:58:15.976870] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-24T18:58:15.977217] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-24T18:58:16.021285] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-24T18:58:16.368191] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:16.816102] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-24T18:58:17.616123] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-24T18:58:17.787451] [DEBUG] [REMOTE ] GATX: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-24T18:58:17.787808] [WARN ] [REMOTE ] GATX: No data returned for month 2025-03 [2025-09-24T18:58:17.833513] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T18:58:18.367686] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T18:58:18.416152] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-24T18:58:19.216069] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-24T18:58:20.016054] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-24T18:58:20.129500] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T18:58:20.399228] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T18:58:20.816181] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-24T18:58:21.128418] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-24T18:58:21.616120] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-24T18:58:22.416092] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-24T18:58:22.637840] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T18:58:22.785661] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T18:58:23.206119] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T18:58:23.216020] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-24T18:58:24.016168] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-24T18:58:24.120405] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T18:58:24.816131] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-24T18:58:25.616149] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-24T18:58:25.676774] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T18:58:25.926116] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T18:58:26.416135] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-24T18:58:27.036834] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T18:58:27.216059] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-24T18:58:27.338151] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T18:58:28.016127] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-24T18:58:28.816062] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-24T18:58:29.207553] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T18:58:29.420598] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T18:58:29.616081] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-24T18:58:29.803041] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T18:58:30.416114] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-24T18:58:31.216104] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-24T18:58:31.289457] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T18:58:31.496211] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T18:58:32.016101] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-24T18:58:32.816064] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-24T18:58:32.920071] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T18:58:32.922571] [INFO ] [REMOTE ] GBAB: Full fetch complete (20248 records). [2025-09-24T18:58:32.922701] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-24T18:58:33.304441] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-24T18:58:33.304573] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-24T18:58:33.305213] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-24T18:58:33.305272] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-24T18:58:33.305918] [DEBUG] [LOCAL ] GBAB: Trimmed 20248 records to 12998 (keeping 200 days of data) [2025-09-24T18:58:33.405556] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T18:58:33.427159] [DEBUG] [LOCAL ] GBAB: Primary data saved (12998 records). [2025-09-24T18:58:33.427275] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-24T18:58:33.427357] [INFO ] [MAIN ] Update Progress: 894/2373 symbols completed. GBAB took 24.1s. Estimated remaining: 3h 16m 2s. Rate: 7.5 symbols/min [2025-09-24T18:58:33.595830] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:33.596008] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-24T18:58:33.596063] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-24T18:58:33.596246] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-24T18:58:33.596308] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-24T18:58:33.596427] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-24T18:58:33.596490] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-24T18:58:33.627086] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-24T18:58:33.971211] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:34.270119] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T18:58:34.416081] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-24T18:58:35.216261] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-24T18:58:35.431815] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T18:58:35.690751] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T18:58:36.016135] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-24T18:58:36.668400] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T18:58:36.816094] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-24T18:58:37.300319] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-24T18:58:37.570052] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T18:58:37.579587] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-24T18:58:37.579750] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-24T18:58:37.621281] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-24T18:58:37.976833] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-24T18:58:37.976944] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-24T18:58:37.978162] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-24T18:58:37.978233] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-24T18:58:37.980170] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-24T18:58:38.331745] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-24T18:58:38.331953] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-24T18:58:38.332062] [INFO ] [MAIN ] Update Progress: 895/2373 symbols completed. GAP took 32.7s. Estimated remaining: 3h 15m 49s. Rate: 7.5 symbols/min [2025-09-24T18:58:38.421258] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-24T18:58:38.526680] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:38.571809] [DEBUG] [LOCAL ] GBTG: Loaded 40353 existing records from primary storage. [2025-09-24T18:58:38.572005] [INFO ] [MAIN ] GBTG: Loaded 40353 existing records. [2025-09-24T18:58:38.767166] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:38.767447] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-24T18:58:38.767497] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-24T18:58:38.768414] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-24T18:58:38.768479] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-24T18:58:38.827752] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-24T18:58:39.140803] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:39.162200] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T18:58:39.216040] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-24T18:58:40.016089] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-24T18:58:40.605967] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T18:58:40.816098] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-24T18:58:41.442217] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T18:58:41.616083] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-24T18:58:41.722448] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T18:58:41.866397] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-24T18:58:42.416076] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-24T18:58:43.216059] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-24T18:58:43.400874] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T18:58:44.016132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-24T18:58:44.665858] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T18:58:44.816086] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-24T18:58:45.435730] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T18:58:45.616066] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-24T18:58:45.983680] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-24T18:58:46.129933] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T18:58:46.136919] [INFO ] [REMOTE ] GBCI: Full fetch complete (57801 records). [2025-09-24T18:58:46.137038] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-24T18:58:46.421294] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-24T18:58:46.527933] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-24T18:58:46.528020] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-24T18:58:46.528962] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-24T18:58:46.529031] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-24T18:58:46.530742] [DEBUG] [LOCAL ] GBCI: Trimmed 57801 records to 40080 (keeping 200 days of data) [2025-09-24T18:58:46.793265] [DEBUG] [LOCAL ] GBCI: Primary data saved (40080 records). [2025-09-24T18:58:46.793417] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-24T18:58:46.793520] [INFO ] [MAIN ] Update Progress: 896/2373 symbols completed. GBCI took 31.3s. Estimated remaining: 3h 15m 42s. Rate: 7.5 symbols/min [2025-09-24T18:58:46.974379] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:47.005464] [DEBUG] [LOCAL ] GBX: Loaded 29268 existing records from primary storage. [2025-09-24T18:58:47.005619] [INFO ] [MAIN ] GBX: Loaded 29268 existing records. [2025-09-24T18:58:47.199785] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:47.200116] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-24T18:58:47.200172] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-24T18:58:47.201057] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-24T18:58:47.201123] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-24T18:58:47.226929] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-24T18:58:47.581415] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:47.696626] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:58:47.711470] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-24T18:58:48.016130] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-24T18:58:48.816089] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-24T18:58:49.453934] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T18:58:49.616045] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-24T18:58:49.922136] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T18:58:50.416126] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-24T18:58:50.758667] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-24T18:58:50.809051] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T18:58:50.813250] [INFO ] [REMOTE ] GATX: Full fetch complete (22982 records). [2025-09-24T18:58:50.813337] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-24T18:58:51.006772] [WARN ] [VALIDATOR ] GATX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T18:58:51.007186] [FATAL] [MAIN ] GATX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:58:51.007269] [WARN ] [MAIN ] GATX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:58:51.007319] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-24T18:58:51.007384] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-24T18:58:51.007424] [INFO ] [LOCAL ] GATX: Starting deletion of derivative data. [2025-09-24T18:58:51.007935] [DEBUG] [LOCAL ] GATX: Deleted derivative data file. [2025-09-24T18:58:51.008039] [INFO ] [MAIN ] Update Progress: 897/2373 symbols completed. GATX took 42.8s. Estimated remaining: 3h 15m 28s. Rate: 7.6 symbols/min [2025-09-24T18:58:51.186185] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:58:51.216117] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-24T18:58:51.232142] [DEBUG] [LOCAL ] GCI: Loaded 44222 existing records from primary storage. [2025-09-24T18:58:51.232272] [INFO ] [MAIN ] GCI: Loaded 44222 existing records. [2025-09-24T18:58:51.415588] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:58:51.415840] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-24T18:58:51.415889] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-24T18:58:51.417292] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-24T18:58:51.417388] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-24T18:58:51.785665] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:58:52.016074] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-24T18:58:52.692585] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T18:58:52.816107] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-24T18:58:53.510319] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T18:58:53.616088] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-24T18:58:54.352783] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T18:58:54.416103] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-24T18:58:54.914705] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T18:58:55.216066] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-24T18:58:55.827028] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T18:58:56.016088] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-24T18:58:56.492028] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T18:58:56.816093] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-24T18:58:57.167275] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T18:58:57.177104] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-24T18:58:57.616097] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-24T18:58:57.946273] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T18:58:58.416103] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-24T18:58:59.216080] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-24T18:58:59.714498] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T18:59:00.016093] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-24T18:59:00.521844] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T18:59:00.816086] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-24T18:59:01.489793] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T18:59:01.499013] [INFO ] [REMOTE ] GBTG: Full fetch complete (56651 records). [2025-09-24T18:59:01.499270] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-24T18:59:01.621227] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-24T18:59:01.913858] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-24T18:59:01.913938] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-24T18:59:01.914812] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-24T18:59:01.914877] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-24T18:59:01.916092] [DEBUG] [LOCAL ] GBTG: Trimmed 56651 records to 40267 (keeping 200 days of data) [2025-09-24T18:59:02.147967] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T18:59:02.189998] [DEBUG] [LOCAL ] GBTG: Primary data saved (40267 records). [2025-09-24T18:59:02.190335] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-24T18:59:02.195479] [INFO ] [MAIN ] Update Progress: 898/2373 symbols completed. GBTG took 23.9s. Estimated remaining: 3h 15m 25s. Rate: 7.5 symbols/min [2025-09-24T18:59:02.195764] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T18:59:02.382902] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:02.413818] [DEBUG] [LOCAL ] GCO: Loaded 25688 existing records from primary storage. [2025-09-24T18:59:02.414013] [INFO ] [MAIN ] GCO: Loaded 25688 existing records. [2025-09-24T18:59:02.425435] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-24T18:59:02.625408] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:02.625792] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-24T18:59:02.625851] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-24T18:59:02.626623] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-24T18:59:02.626727] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-24T18:59:02.971992] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T18:59:02.984694] [INFO ] [REMOTE ] GBLI: Full fetch complete (1398 records). [2025-09-24T18:59:03.010971] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-24T18:59:03.017533] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:03.207524] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-24T18:59:03.207762] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:59:03.207812] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:59:03.207852] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-24T18:59:03.207909] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-24T18:59:03.207945] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-24T18:59:03.207984] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-24T18:59:03.208042] [INFO ] [MAIN ] Update Progress: 899/2373 symbols completed. GBLI took 29.8s. Estimated remaining: 3h 15m 6s. Rate: 7.6 symbols/min [2025-09-24T18:59:03.221322] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-24T18:59:03.380998] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:03.404688] [DEBUG] [LOCAL ] GCTS: Loaded 19810 existing records from primary storage. [2025-09-24T18:59:03.404855] [INFO ] [MAIN ] GCTS: Loaded 19810 existing records. [2025-09-24T18:59:03.583945] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:03.584187] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-24T18:59:03.584234] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-24T18:59:03.584820] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-24T18:59:03.584880] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-24T18:59:03.946039] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:04.016041] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-24T18:59:04.818903] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-24T18:59:04.825420] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T18:59:05.131065] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T18:59:05.616147] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-24T18:59:06.136104] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T18:59:06.416105] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-24T18:59:06.901510] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T18:59:07.216056] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-24T18:59:07.416119] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T18:59:08.016048] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-24T18:59:08.335916] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T18:59:08.816100] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-24T18:59:09.622718] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-24T18:59:09.628308] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T18:59:09.685829] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T18:59:10.416053] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-24T18:59:10.630428] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T18:59:11.216114] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-24T18:59:11.828877] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T18:59:12.016095] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-24T18:59:12.227692] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T18:59:12.816089] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-24T18:59:13.616059] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-24T18:59:13.676355] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T18:59:13.870982] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T18:59:14.353686] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T18:59:14.416153] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-24T18:59:15.216047] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-24T18:59:15.382301] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T18:59:16.016093] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-24T18:59:16.816068] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-24T18:59:16.864591] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T18:59:17.064785] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T18:59:17.616080] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-24T18:59:17.784177] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T18:59:18.416130] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-24T18:59:18.522770] [DEBUG] [REMOTE ] GCI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-24T18:59:18.522959] [WARN ] [REMOTE ] GCI: No data returned for month 2025-08 [2025-09-24T18:59:18.945998] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T18:59:19.216093] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-24T18:59:20.016048] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-24T18:59:20.392617] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T18:59:20.816136] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-24T18:59:21.616110] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-24T18:59:21.716638] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T18:59:21.724686] [INFO ] [REMOTE ] GCI: Full fetch complete (56466 records). [2025-09-24T18:59:21.724856] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-24T18:59:21.920752] [WARN ] [VALIDATOR ] GCI: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T18:59:21.921394] [FATAL] [MAIN ] GCI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T18:59:21.921537] [WARN ] [MAIN ] GCI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T18:59:21.921671] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-24T18:59:21.921883] [DEBUG] [LOCAL ] GCI: No primary data file found to delete. [2025-09-24T18:59:21.921998] [INFO ] [LOCAL ] GCI: Starting deletion of derivative data. [2025-09-24T18:59:21.922450] [DEBUG] [LOCAL ] GCI: Deleted derivative data file. [2025-09-24T18:59:21.922559] [INFO ] [MAIN ] Update Progress: 900/2373 symbols completed. GCI took 30.9s. Estimated remaining: 3h 15m 16s. Rate: 7.5 symbols/min [2025-09-24T18:59:22.108169] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:22.109488] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T18:59:22.115010] [INFO ] [REMOTE ] GBX: Full fetch complete (42653 records). [2025-09-24T18:59:22.115166] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-24T18:59:22.236549] [DEBUG] [LOCAL ] GCV: Loaded 7128 existing records from primary storage. [2025-09-24T18:59:22.236783] [INFO ] [MAIN ] GCV: Loaded 7128 existing records. [2025-09-24T18:59:22.416422] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-24T18:59:22.634945] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:22.653811] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-24T18:59:22.653909] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-24T18:59:22.660100] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-24T18:59:22.670413] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-24T18:59:22.855164] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-24T18:59:22.868583] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-24T18:59:22.870303] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-24T18:59:22.875997] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-24T18:59:22.932004] [DEBUG] [LOCAL ] GBX: Trimmed 42653 records to 29165 (keeping 200 days of data) [2025-09-24T18:59:22.979769] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T18:59:23.221936] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-24T18:59:23.270171] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:23.363311] [DEBUG] [LOCAL ] GBX: Primary data saved (29165 records). [2025-09-24T18:59:23.363470] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-24T18:59:23.363562] [INFO ] [MAIN ] Update Progress: 901/2373 symbols completed. GBX took 36.6s. Estimated remaining: 3h 14m 57s. Rate: 7.6 symbols/min [2025-09-24T18:59:23.583546] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:23.634239] [DEBUG] [LOCAL ] GD: Loaded 47274 existing records from primary storage. [2025-09-24T18:59:23.634404] [INFO ] [MAIN ] GD: Loaded 47274 existing records. [2025-09-24T18:59:23.836003] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:23.836415] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-24T18:59:23.836474] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-24T18:59:23.837909] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-24T18:59:23.837975] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-24T18:59:24.021164] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-24T18:59:24.135229] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T18:59:24.248847] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:24.426633] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T18:59:24.780424] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T18:59:24.816062] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-24T18:59:25.616308] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-24T18:59:25.823473] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T18:59:26.416088] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-24T18:59:27.216090] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-24T18:59:27.503736] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T18:59:27.669462] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T18:59:28.016159] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-24T18:59:28.127506] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T18:59:28.434153] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-24T18:59:28.816089] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-24T18:59:29.616126] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-24T18:59:29.880228] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T18:59:29.884636] [INFO ] [REMOTE ] GCTS: Full fetch complete (26995 records). [2025-09-24T18:59:29.884794] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-24T18:59:30.269806] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-24T18:59:30.269896] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-24T18:59:30.270555] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-24T18:59:30.270618] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-24T18:59:30.271513] [DEBUG] [LOCAL ] GCTS: Trimmed 26995 records to 19844 (keeping 200 days of data) [2025-09-24T18:59:30.398276] [DEBUG] [LOCAL ] GCTS: Primary data saved (19844 records). [2025-09-24T18:59:30.398445] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-24T18:59:30.398537] [INFO ] [MAIN ] Update Progress: 902/2373 symbols completed. GCTS took 27.2s. Estimated remaining: 3h 14m 48s. Rate: 7.6 symbols/min [2025-09-24T18:59:30.421205] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-24T18:59:30.581092] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:30.638712] [DEBUG] [LOCAL ] GDDY: Loaded 49746 existing records from primary storage. [2025-09-24T18:59:30.638859] [INFO ] [MAIN ] GDDY: Loaded 49746 existing records. [2025-09-24T18:59:30.825122] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:30.825771] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-24T18:59:30.825904] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-24T18:59:30.828062] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-24T18:59:30.828126] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-24T18:59:30.947362] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T18:59:31.153963] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T18:59:31.229292] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-24T18:59:31.234779] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:31.846156] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T18:59:32.016151] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-24T18:59:32.816149] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-24T18:59:33.370334] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T18:59:33.616114] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-24T18:59:33.833369] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T18:59:34.416063] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-24T18:59:34.650680] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T18:59:35.216069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-24T18:59:35.817108] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T18:59:36.016105] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-24T18:59:36.173551] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T18:59:36.816143] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-24T18:59:37.616090] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-24T18:59:37.744243] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T18:59:38.349327] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T18:59:38.416034] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-24T18:59:38.618729] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T18:59:39.106208] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T18:59:39.216070] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-24T18:59:39.901749] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T18:59:40.016091] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-24T18:59:40.816088] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-24T18:59:41.616095] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-24T18:59:41.800181] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T18:59:41.905143] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T18:59:42.416095] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-24T18:59:42.699755] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T18:59:42.702616] [INFO ] [REMOTE ] GCV: Full fetch complete (9275 records). [2025-09-24T18:59:42.702815] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-24T18:59:43.101248] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-24T18:59:43.101404] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-24T18:59:43.101721] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-24T18:59:43.101785] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-24T18:59:43.102260] [DEBUG] [LOCAL ] GCV: Trimmed 9275 records to 7177 (keeping 200 days of data) [2025-09-24T18:59:43.145088] [DEBUG] [LOCAL ] GCV: Primary data saved (7177 records). [2025-09-24T18:59:43.145225] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-24T18:59:43.145348] [INFO ] [MAIN ] Update Progress: 903/2373 symbols completed. GCV took 21.2s. Estimated remaining: 3h 14m 47s. Rate: 7.5 symbols/min [2025-09-24T18:59:43.222556] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-24T18:59:43.328220] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:43.334345] [DEBUG] [LOCAL ] GDIV: Loaded 3705 existing records from primary storage. [2025-09-24T18:59:43.334467] [INFO ] [MAIN ] GDIV: Loaded 3705 existing records. [2025-09-24T18:59:43.518774] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:43.519051] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-24T18:59:43.519099] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-24T18:59:43.519351] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-24T18:59:43.519423] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-24T18:59:43.829071] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T18:59:43.855694] [INFO ] [REMOTE ] GCO: Full fetch complete (35930 records). [2025-09-24T18:59:43.866153] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-24T18:59:44.017520] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-24T18:59:44.010895] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:44.342286] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-24T18:59:44.342390] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-24T18:59:44.343244] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-24T18:59:44.343329] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-24T18:59:44.344420] [DEBUG] [LOCAL ] GCO: Trimmed 35930 records to 25438 (keeping 200 days of data) [2025-09-24T18:59:44.505611] [DEBUG] [LOCAL ] GCO: Primary data saved (25438 records). [2025-09-24T18:59:44.505797] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-24T18:59:44.505944] [INFO ] [MAIN ] Update Progress: 904/2373 symbols completed. GCO took 42.3s. Estimated remaining: 3h 14m 29s. Rate: 7.6 symbols/min [2025-09-24T18:59:44.693301] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T18:59:44.698055] [DEBUG] [LOCAL ] GDL: Loaded 2482 existing records from primary storage. [2025-09-24T18:59:44.698135] [INFO ] [MAIN ] GDL: Loaded 2482 existing records. [2025-09-24T18:59:44.820882] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-24T18:59:44.945504] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T18:59:44.946116] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-24T18:59:44.946193] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-24T18:59:44.946897] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-24T18:59:44.946957] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-24T18:59:45.285464] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T18:59:45.360010] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T18:59:45.497496] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-24T18:59:45.616093] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-24T18:59:45.934062] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T18:59:46.089015] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-24T18:59:46.416079] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-24T18:59:46.934856] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T18:59:47.216066] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-24T18:59:48.016150] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-24T18:59:48.469677] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T18:59:48.816121] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-24T18:59:48.930789] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T18:59:49.242985] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T18:59:49.616097] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-24T18:59:50.190159] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T18:59:50.416087] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-24T18:59:51.216116] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-24T18:59:52.004567] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T18:59:52.016030] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-24T18:59:52.816056] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-24T18:59:52.913935] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T18:59:53.388620] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T18:59:53.616073] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-24T18:59:53.764806] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T18:59:54.416104] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-24T18:59:55.216085] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-24T18:59:55.329302] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T18:59:55.692670] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-24T18:59:56.016099] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-24T18:59:56.068774] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T18:59:56.451548] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-24T18:59:56.816123] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-24T18:59:57.616093] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-24T18:59:58.198240] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T18:59:58.416113] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-24T18:59:58.655195] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T18:59:58.908294] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T18:59:59.216092] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-24T18:59:59.722088] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T19:00:00.016082] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-24T19:00:00.643304] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T19:00:00.816132] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-24T19:00:01.616134] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-24T19:00:02.416213] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-24T19:00:03.216180] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-24T19:00:04.950325] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-09-24T19:00:04.951810] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-24T19:00:05.231421] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T19:00:05.233186] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-24T19:00:05.705885] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (4.89 seconds). [2025-09-24T19:00:05.717209] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-24T19:00:05.834763] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-24T19:00:05.976789] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T19:00:06.162122] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (3.75 seconds). [2025-09-24T19:00:06.416137] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-24T19:00:06.876361] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T19:00:07.216082] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-24T19:00:07.981158] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-24T19:00:08.016058] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-24T19:00:08.489426] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T19:00:08.490520] [INFO ] [REMOTE ] GDIV: Full fetch complete (5439 records). [2025-09-24T19:00:08.490607] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-24T19:00:08.821207] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-24T19:00:08.890602] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-24T19:00:08.890732] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-24T19:00:08.890952] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-24T19:00:08.891041] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-24T19:00:08.891869] [DEBUG] [LOCAL ] GDIV: Trimmed 5439 records to 3686 (keeping 200 days of data) [2025-09-24T19:00:08.917835] [DEBUG] [LOCAL ] GDIV: Primary data saved (3686 records). [2025-09-24T19:00:08.918004] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-24T19:00:08.918184] [INFO ] [MAIN ] Update Progress: 905/2373 symbols completed. GDIV took 25.8s. Estimated remaining: 3h 14m 48s. Rate: 7.5 symbols/min [2025-09-24T19:00:09.108956] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:09.122109] [DEBUG] [LOCAL ] GDO: Loaded 6025 existing records from primary storage. [2025-09-24T19:00:09.122267] [INFO ] [MAIN ] GDO: Loaded 6025 existing records. [2025-09-24T19:00:09.312992] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:09.313241] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-24T19:00:09.313291] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-24T19:00:09.313621] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-24T19:00:09.313738] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-24T19:00:09.621295] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-24T19:00:09.712171] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:10.269778] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-24T19:00:10.284738] [INFO ] [REMOTE ] GDDY: Full fetch complete (71190 records). [2025-09-24T19:00:10.284943] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-24T19:00:10.429935] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-24T19:00:10.596744] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T19:00:10.598308] [INFO ] [REMOTE ] GDL: Full fetch complete (3644 records). [2025-09-24T19:00:10.598815] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-24T19:00:10.830637] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-24T19:00:10.836018] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-24T19:00:10.870511] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-24T19:00:10.879918] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-24T19:00:10.997378] [DEBUG] [LOCAL ] GDDY: Trimmed 71190 records to 49705 (keeping 200 days of data) [2025-09-24T19:00:11.223290] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-24T19:00:11.223685] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-24T19:00:11.224229] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-24T19:00:11.224606] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-24T19:00:11.226184] [DEBUG] [LOCAL ] GDL: Trimmed 3644 records to 2521 (keeping 200 days of data) [2025-09-24T19:00:11.228325] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-24T19:00:11.269087] [DEBUG] [LOCAL ] GDL: Primary data saved (2521 records). [2025-09-24T19:00:11.269716] [INFO ] [REMOTE ] GD: Full fetch complete (70516 records). [2025-09-24T19:00:11.270677] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-24T19:00:11.271813] [INFO ] [MAIN ] Update Progress: 906/2373 symbols completed. GDL took 26.8s. Estimated remaining: 3h 14m 31s. Rate: 7.5 symbols/min [2025-09-24T19:00:11.271348] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:00:11.273707] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-24T19:00:11.277457] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-24T19:00:11.702808] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:12.064158] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-24T19:00:12.063703] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T19:00:12.066052] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-24T19:00:12.068106] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-24T19:00:12.069924] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-24T19:00:12.069504] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-24T19:00:12.086522] [DEBUG] [LOCAL ] GDOT: Loaded 38662 existing records from primary storage. [2025-09-24T19:00:12.088337] [INFO ] [MAIN ] GDOT: Loaded 38662 existing records. [2025-09-24T19:00:12.103194] [DEBUG] [LOCAL ] GD: Trimmed 70516 records to 47267 (keeping 200 days of data) [2025-09-24T19:00:12.404091] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:12.410456] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-24T19:00:12.411298] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-24T19:00:12.413171] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-24T19:00:12.413508] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-24T19:00:12.741695] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T19:00:12.850171] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-24T19:00:13.001727] [DEBUG] [LOCAL ] GDDY: Primary data saved (49705 records). [2025-09-24T19:00:13.013676] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-24T19:00:13.046818] [INFO ] [MAIN ] Update Progress: 907/2373 symbols completed. GDDY took 42.6s. Estimated remaining: 3h 14m 13s. Rate: 7.5 symbols/min [2025-09-24T19:00:13.054563] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:13.054731] [DEBUG] [LOCAL ] GD: Primary data saved (47267 records). [2025-09-24T19:00:13.098017] [INFO ] [MAIN ] GD: Full history saved. [2025-09-24T19:00:13.124476] [INFO ] [MAIN ] Update Progress: 908/2373 symbols completed. GD took 49.8s. Estimated remaining: 3h 13m 52s. Rate: 7.6 symbols/min [2025-09-24T19:00:13.356145] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:13.401121] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:13.419748] [DEBUG] [LOCAL ] GDV: Loaded 19729 existing records from primary storage. [2025-09-24T19:00:13.419879] [INFO ] [MAIN ] GDV: Loaded 19729 existing records. [2025-09-24T19:00:13.572770] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T19:00:13.619036] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-24T19:00:13.635633] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:13.649729] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-24T19:00:13.650871] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-24T19:00:13.651935] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-24T19:00:13.651893] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-24T19:00:13.652059] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-24T19:00:13.652119] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-24T19:00:14.176304] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:14.212477] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-24T19:00:14.222436] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-24T19:00:14.247377] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-24T19:00:14.253980] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:14.254480] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-24T19:00:14.420674] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-24T19:00:14.630556] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:15.216033] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-24T19:00:15.613292] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-24T19:00:16.016125] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-24T19:00:16.020287] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T19:00:16.696865] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:00:16.816124] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-24T19:00:17.432530] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T19:00:17.616079] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-24T19:00:17.830793] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T19:00:18.207758] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T19:00:18.416097] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-24T19:00:19.216106] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-24T19:00:20.016228] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-24T19:00:20.409348] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T19:00:20.490898] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T19:00:20.515138] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T19:00:20.816136] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-24T19:00:21.519800] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T19:00:21.616121] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-24T19:00:22.416048] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-24T19:00:22.591530] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:00:23.216068] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-24T19:00:24.016141] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-24T19:00:24.111823] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T19:00:24.405009] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T19:00:24.735477] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T19:00:24.737567] [INFO ] [REMOTE ] GDO: Full fetch complete (9489 records). [2025-09-24T19:00:24.738098] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-24T19:00:24.821233] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-24T19:00:25.110764] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-24T19:00:25.110868] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-24T19:00:25.111179] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-24T19:00:25.111221] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-24T19:00:25.111725] [DEBUG] [LOCAL ] GDO: Trimmed 9489 records to 6037 (keeping 200 days of data) [2025-09-24T19:00:25.154305] [DEBUG] [LOCAL ] GDO: Primary data saved (6037 records). [2025-09-24T19:00:25.154446] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-24T19:00:25.154534] [INFO ] [MAIN ] Update Progress: 909/2373 symbols completed. GDO took 16.2s. Estimated remaining: 3h 13m 51s. Rate: 7.6 symbols/min [2025-09-24T19:00:25.331198] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:25.356799] [DEBUG] [LOCAL ] GEF: Loaded 20743 existing records from primary storage. [2025-09-24T19:00:25.356975] [INFO ] [MAIN ] GEF: Loaded 20743 existing records. [2025-09-24T19:00:25.542279] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:25.542561] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-24T19:00:25.542610] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-24T19:00:25.543586] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-24T19:00:25.543689] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-24T19:00:25.621227] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-24T19:00:25.914079] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:25.927757] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T19:00:26.416118] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-24T19:00:27.216118] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-24T19:00:27.735909] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T19:00:27.940880] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:00:28.016096] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-24T19:00:28.292712] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T19:00:28.816050] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-24T19:00:28.985783] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T19:00:29.616092] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-24T19:00:30.416070] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-24T19:00:30.529033] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T19:00:30.595794] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T19:00:31.216092] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-24T19:00:32.016091] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-24T19:00:32.510193] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:00:32.579202] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T19:00:32.816059] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-24T19:00:33.017230] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T19:00:33.616087] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-24T19:00:33.923393] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T19:00:34.416093] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-24T19:00:35.216107] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-24T19:00:35.428538] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T19:00:35.698120] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T19:00:36.016080] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-24T19:00:36.583336] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T19:00:36.769304] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T19:00:36.772756] [INFO ] [REMOTE ] GDV: Full fetch complete (28836 records). [2025-09-24T19:00:36.772861] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-24T19:00:36.821179] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-24T19:00:37.162673] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-24T19:00:37.162779] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-24T19:00:37.163448] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-24T19:00:37.163493] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-24T19:00:37.164488] [DEBUG] [LOCAL ] GDV: Trimmed 28836 records to 19752 (keeping 200 days of data) [2025-09-24T19:00:37.291924] [DEBUG] [LOCAL ] GDV: Primary data saved (19752 records). [2025-09-24T19:00:37.292102] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-24T19:00:37.292207] [INFO ] [MAIN ] Update Progress: 910/2373 symbols completed. GDV took 24.2s. Estimated remaining: 3h 13m 49s. Rate: 7.5 symbols/min [2025-09-24T19:00:37.503074] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:37.546621] [DEBUG] [LOCAL ] GEL: Loaded 34033 existing records from primary storage. [2025-09-24T19:00:37.546845] [INFO ] [MAIN ] GEL: Loaded 34033 existing records. [2025-09-24T19:00:37.625338] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-24T19:00:37.738691] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:37.738964] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-24T19:00:37.739012] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-24T19:00:37.739876] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-24T19:00:37.739937] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-24T19:00:38.123230] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:38.416094] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-24T19:00:39.033544] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-24T19:00:39.099880] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T19:00:39.216125] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-24T19:00:39.376515] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T19:00:40.016066] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-24T19:00:40.370057] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T19:00:40.732382] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T19:00:40.816050] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-24T19:00:41.616117] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-24T19:00:42.262906] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:00:42.416094] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-24T19:00:42.932952] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T19:00:43.216065] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-24T19:00:43.519203] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T19:00:44.016094] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-24T19:00:44.413360] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T19:00:44.816232] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-24T19:00:45.318167] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T19:00:45.616097] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-24T19:00:46.124804] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:00:46.416087] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-24T19:00:46.969556] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T19:00:46.977159] [INFO ] [REMOTE ] GDOT: Full fetch complete (52693 records). [2025-09-24T19:00:46.977345] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-24T19:00:47.221531] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-24T19:00:47.391026] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-24T19:00:47.391118] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-24T19:00:47.392006] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-24T19:00:47.392071] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-24T19:00:47.394713] [DEBUG] [LOCAL ] GDOT: Trimmed 52693 records to 38669 (keeping 200 days of data) [2025-09-24T19:00:47.643475] [DEBUG] [LOCAL ] GDOT: Primary data saved (38669 records). [2025-09-24T19:00:47.643639] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-24T19:00:47.643799] [INFO ] [MAIN ] Update Progress: 911/2373 symbols completed. GDOT took 36.4s. Estimated remaining: 3h 13m 45s. Rate: 7.5 symbols/min [2025-09-24T19:00:47.831575] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:47.885525] [DEBUG] [LOCAL ] GENI: Loaded 52913 existing records from primary storage. [2025-09-24T19:00:47.885704] [INFO ] [MAIN ] GENI: Loaded 52913 existing records. [2025-09-24T19:00:48.029433] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-24T19:00:48.127996] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:48.129010] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-24T19:00:48.129105] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-24T19:00:48.131350] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-24T19:00:48.131465] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-24T19:00:48.474779] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T19:00:48.549356] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:48.584997] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-24T19:00:48.816083] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-24T19:00:49.239775] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T19:00:49.616080] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-24T19:00:50.376468] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T19:00:50.416083] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-24T19:00:50.454508] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T19:00:51.216132] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-24T19:00:52.016083] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-24T19:00:52.085183] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T19:00:52.816090] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-24T19:00:53.362239] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:00:53.394564] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T19:00:53.616082] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-24T19:00:54.416093] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-24T19:00:54.497778] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T19:00:54.966095] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T19:00:55.216096] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-24T19:00:56.016097] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-24T19:00:56.300589] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:00:56.310815] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-24T19:00:56.310986] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-24T19:00:56.662889] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T19:00:56.750051] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-24T19:00:56.750130] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-24T19:00:56.751116] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-24T19:00:56.751181] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-24T19:00:56.752607] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-24T19:00:56.817034] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-24T19:00:57.100184] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-24T19:00:57.100361] [INFO ] [MAIN ] GE: Full history saved. [2025-09-24T19:00:57.100519] [INFO ] [MAIN ] Update Progress: 912/2373 symbols completed. GE took 44.0s. Estimated remaining: 3h 13m 40s. Rate: 7.5 symbols/min [2025-09-24T19:00:57.273181] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:00:57.327772] [DEBUG] [LOCAL ] GEO: Loaded 52152 existing records from primary storage. [2025-09-24T19:00:57.327938] [INFO ] [MAIN ] GEO: Loaded 52152 existing records. [2025-09-24T19:00:57.518093] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:00:57.519017] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-24T19:00:57.519107] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-24T19:00:57.520765] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-24T19:00:57.520976] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-24T19:00:57.617465] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-24T19:00:57.672543] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T19:00:57.968456] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:00:57.983066] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T19:00:58.416028] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-24T19:00:59.164765] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T19:00:59.216070] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-24T19:01:00.016128] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-24T19:01:00.092321] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T19:01:00.556755] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T19:01:00.816099] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-24T19:01:01.616129] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-24T19:01:02.000754] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T19:01:02.275358] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T19:01:02.416129] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-24T19:01:02.805254] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T19:01:02.812866] [INFO ] [REMOTE ] GEL: Full fetch complete (48700 records). [2025-09-24T19:01:02.813042] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-24T19:01:03.225920] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-24T19:01:03.230213] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-24T19:01:03.231215] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-24T19:01:03.232084] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-24T19:01:03.232258] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-24T19:01:03.233525] [DEBUG] [LOCAL ] GEL: Trimmed 48700 records to 33914 (keeping 200 days of data) [2025-09-24T19:01:03.440049] [DEBUG] [LOCAL ] GEL: Primary data saved (33914 records). [2025-09-24T19:01:03.440212] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-24T19:01:03.440307] [INFO ] [MAIN ] Update Progress: 913/2373 symbols completed. GEL took 26.1s. Estimated remaining: 3h 13m 29s. Rate: 7.5 symbols/min [2025-09-24T19:01:03.628522] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:03.672201] [DEBUG] [LOCAL ] GES: Loaded 40095 existing records from primary storage. [2025-09-24T19:01:03.672433] [INFO ] [MAIN ] GES: Loaded 40095 existing records. [2025-09-24T19:01:03.890562] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T19:01:03.888261] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:03.901284] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-24T19:01:03.901351] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-24T19:01:03.902308] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-24T19:01:03.902371] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-24T19:01:04.021165] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-24T19:01:04.271886] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:04.816073] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-24T19:01:05.036197] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:01:05.616138] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-24T19:01:05.844399] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T19:01:05.906259] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T19:01:06.416127] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-24T19:01:07.216053] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-24T19:01:07.307499] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T19:01:07.771036] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T19:01:08.016094] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-24T19:01:08.816058] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-24T19:01:08.902514] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T19:01:08.939994] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T19:01:08.944554] [INFO ] [REMOTE ] GEF: Full fetch complete (29464 records). [2025-09-24T19:01:08.944677] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-24T19:01:09.321112] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-24T19:01:09.321196] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-24T19:01:09.321901] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-24T19:01:09.321964] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-24T19:01:09.322766] [DEBUG] [LOCAL ] GEF: Trimmed 29464 records to 20704 (keeping 200 days of data) [2025-09-24T19:01:09.464367] [DEBUG] [LOCAL ] GEF: Primary data saved (20704 records). [2025-09-24T19:01:09.464509] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-24T19:01:09.464595] [INFO ] [MAIN ] Update Progress: 914/2373 symbols completed. GEF took 44.3s. Estimated remaining: 3h 13m 18s. Rate: 7.5 symbols/min [2025-09-24T19:01:09.616099] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-24T19:01:09.633511] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:09.672911] [DEBUG] [LOCAL ] GETY: Loaded 36040 existing records from primary storage. [2025-09-24T19:01:09.673042] [INFO ] [MAIN ] GETY: Loaded 36040 existing records. [2025-09-24T19:01:09.851812] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:09.852060] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-24T19:01:09.852108] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-24T19:01:09.852853] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-24T19:01:09.852913] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-24T19:01:10.213285] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:10.416062] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-24T19:01:10.731421] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T19:01:11.128020] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:01:11.216067] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-24T19:01:12.016058] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-24T19:01:12.247414] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T19:01:12.257253] [INFO ] [REMOTE ] GENI: Full fetch complete (75440 records). [2025-09-24T19:01:12.257409] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-24T19:01:12.760804] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-24T19:01:12.761047] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-24T19:01:12.763070] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-24T19:01:12.763340] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-24T19:01:12.779180] [DEBUG] [LOCAL ] GENI: Trimmed 75440 records to 52912 (keeping 200 days of data) [2025-09-24T19:01:12.803720] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:01:12.866031] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-24T19:01:13.297724] [DEBUG] [LOCAL ] GENI: Primary data saved (52912 records). [2025-09-24T19:01:13.297945] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-24T19:01:13.298085] [INFO ] [MAIN ] Update Progress: 915/2373 symbols completed. GENI took 25.7s. Estimated remaining: 3h 13m 4s. Rate: 7.6 symbols/min [2025-09-24T19:01:13.564670] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:13.602366] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T19:01:13.616047] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-24T19:01:13.686194] [DEBUG] [LOCAL ] GEV: Loaded 53146 existing records from primary storage. [2025-09-24T19:01:13.686416] [INFO ] [MAIN ] GEV: Loaded 53146 existing records. [2025-09-24T19:01:13.903791] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:13.904089] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-24T19:01:13.904140] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-24T19:01:13.905294] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-24T19:01:13.905357] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-24T19:01:14.272706] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:14.416123] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-24T19:01:14.824691] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T19:01:15.216101] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-24T19:01:15.553372] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T19:01:16.016172] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-24T19:01:16.277958] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T19:01:16.636658] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T19:01:16.816101] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-24T19:01:17.510991] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:01:17.616043] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-24T19:01:18.416170] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-24T19:01:18.446716] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T19:01:18.948046] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T19:01:19.216156] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-24T19:01:19.390754] [DEBUG] [REMOTE ] GETY: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-24T19:01:19.391087] [WARN ] [REMOTE ] GETY: No data returned for month 2025-04 [2025-09-24T19:01:20.016077] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-24T19:01:20.239994] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T19:01:20.816101] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-24T19:01:21.597726] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T19:01:21.616037] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-24T19:01:22.416397] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-24T19:01:22.416258] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T19:01:22.914026] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T19:01:23.216093] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-24T19:01:24.016144] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-24T19:01:24.274050] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T19:01:24.816143] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-24T19:01:24.987369] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T19:01:25.603278] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:01:25.616020] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-24T19:01:26.416125] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-24T19:01:26.657600] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T19:01:27.074734] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T19:01:27.216123] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-24T19:01:27.779679] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T19:01:27.789237] [INFO ] [REMOTE ] GEO: Full fetch complete (75565 records). [2025-09-24T19:01:27.789432] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-24T19:01:28.026728] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-24T19:01:28.207158] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-24T19:01:28.207300] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-24T19:01:28.208811] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-24T19:01:28.208888] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-24T19:01:28.211196] [DEBUG] [LOCAL ] GEO: Trimmed 75565 records to 52106 (keeping 200 days of data) [2025-09-24T19:01:28.552100] [DEBUG] [LOCAL ] GEO: Primary data saved (52106 records). [2025-09-24T19:01:28.552397] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-24T19:01:28.552539] [INFO ] [MAIN ] Update Progress: 916/2373 symbols completed. GEO took 31.5s. Estimated remaining: 3h 13m 7s. Rate: 7.5 symbols/min [2025-09-24T19:01:28.763343] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T19:01:28.767219] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:28.781993] [DEBUG] [LOCAL ] GF: Loaded 3269 existing records from primary storage. [2025-09-24T19:01:28.782125] [INFO ] [MAIN ] GF: Loaded 3269 existing records. [2025-09-24T19:01:28.824523] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-24T19:01:28.964426] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:28.964713] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-24T19:01:28.964771] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-24T19:01:28.965026] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-24T19:01:28.965085] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-24T19:01:29.339026] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:29.359422] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T19:01:29.616083] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-24T19:01:30.345237] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T19:01:30.352207] [INFO ] [REMOTE ] GES: Full fetch complete (60017 records). [2025-09-24T19:01:30.352350] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-24T19:01:30.427939] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-24T19:01:30.779968] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-24T19:01:30.780111] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-24T19:01:30.781061] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-24T19:01:30.781140] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-24T19:01:30.782639] [DEBUG] [LOCAL ] GES: Trimmed 60017 records to 39989 (keeping 200 days of data) [2025-09-24T19:01:31.019004] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T19:01:31.063387] [DEBUG] [LOCAL ] GES: Primary data saved (39989 records). [2025-09-24T19:01:31.063574] [INFO ] [MAIN ] GES: Full history saved. [2025-09-24T19:01:31.063708] [INFO ] [MAIN ] Update Progress: 917/2373 symbols completed. GES took 27.6s. Estimated remaining: 3h 12m 51s. Rate: 7.6 symbols/min [2025-09-24T19:01:31.216085] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-24T19:01:31.827633] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T19:01:32.016031] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-24T19:01:32.296122] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T19:01:32.595461] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T19:01:32.816096] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-24T19:01:33.616096] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-24T19:01:34.416194] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-24T19:01:34.731168] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T19:01:34.932800] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T19:01:34.961174] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T19:01:35.216100] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-24T19:01:36.016096] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-24T19:01:36.148455] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T19:01:36.816089] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-24T19:01:37.616086] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-24T19:01:38.249786] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T19:01:38.256347] [INFO ] [REMOTE ] GETY: Full fetch complete (50034 records). [2025-09-24T19:01:38.256455] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-24T19:01:38.384817] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T19:01:38.424486] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-24T19:01:38.484448] [WARN ] [VALIDATOR ] GETY: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T19:01:38.502230] [FATAL] [MAIN ] GETY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:01:38.506730] [WARN ] [MAIN ] GETY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:01:38.507045] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-24T19:01:38.507637] [DEBUG] [LOCAL ] GETY: No primary data file found to delete. [2025-09-24T19:01:38.509600] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-24T19:01:38.521878] [INFO ] [LOCAL ] GETY: Starting deletion of derivative data. [2025-09-24T19:01:38.522972] [DEBUG] [LOCAL ] GETY: Deleted derivative data file. [2025-09-24T19:01:38.523125] [INFO ] [MAIN ] Update Progress: 918/2373 symbols completed. GETY took 29.1s. Estimated remaining: 3h 12m 42s. Rate: 7.6 symbols/min [2025-09-24T19:01:39.079491] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T19:01:39.216081] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-24T19:01:40.016103] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-24T19:01:40.629252] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:01:40.816130] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-24T19:01:40.932102] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T19:01:41.166030] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T19:01:41.616092] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-24T19:01:42.089124] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-24T19:01:42.416114] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-24T19:01:42.906094] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T19:01:43.216079] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-24T19:01:44.016105] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-24T19:01:44.633700] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T19:01:44.634569] [INFO ] [REMOTE ] GF: Full fetch complete (5359 records). [2025-09-24T19:01:44.634638] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-24T19:01:45.031282] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-24T19:01:45.031373] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-24T19:01:45.031556] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-24T19:01:45.031595] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-24T19:01:45.032027] [DEBUG] [LOCAL ] GF: Trimmed 5359 records to 3202 (keeping 200 days of data) [2025-09-24T19:01:45.051528] [DEBUG] [LOCAL ] GF: Primary data saved (3202 records). [2025-09-24T19:01:45.051674] [INFO ] [MAIN ] GF: Full history saved. [2025-09-24T19:01:45.051778] [INFO ] [MAIN ] Update Progress: 919/2373 symbols completed. GF took 16.5s. Estimated remaining: 3h 12m 32s. Rate: 7.6 symbols/min [2025-09-24T19:01:45.708001] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-24T19:01:45.719876] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-24T19:01:47.991765] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T19:01:48.002882] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-24T19:01:50.537715] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-24T19:01:50.548693] [INFO ] [REMOTE ] GEV: Full fetch complete (76974 records). [2025-09-24T19:01:50.548946] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-24T19:01:50.948209] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-24T19:01:50.948314] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-24T19:01:50.949487] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-24T19:01:50.949563] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-24T19:01:50.951284] [DEBUG] [LOCAL ] GEV: Trimmed 76974 records to 53114 (keeping 200 days of data) [2025-09-24T19:01:51.308093] [DEBUG] [LOCAL ] GEV: Primary data saved (53114 records). [2025-09-24T19:01:51.308326] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-24T19:01:51.308597] [INFO ] [MAIN ] Update Progress: 920/2373 symbols completed. GEV took 38.0s. Estimated remaining: 3h 12m 21s. Rate: 7.6 symbols/min [2025-09-24T19:01:51.987935] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:51.987035] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:52.047444] [DEBUG] [LOCAL ] GFR: No existing data file found in primary storage. [2025-09-24T19:01:52.050148] [WARN ] [MAIN ] GFR: No existing data found, performing full refresh instead. [2025-09-24T19:01:52.068503] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:52.092161] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-24T19:01:52.093989] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-24T19:01:52.094102] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-09-24T19:01:52.093393] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:01:52.094269] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-24T19:01:52.265822] [DEBUG] [LOCAL ] GFF: Loaded 30900 existing records from primary storage. [2025-09-24T19:01:52.289434] [INFO ] [MAIN ] GFF: Loaded 30900 existing records. [2025-09-24T19:01:52.588320] [DEBUG] [LOCAL ] GFL: Loaded 48045 existing records from primary storage. [2025-09-24T19:01:52.628401] [INFO ] [MAIN ] GFL: Loaded 48045 existing records. [2025-09-24T19:01:52.744160] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:52.759125] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-24T19:01:52.772268] [DEBUG] [LOCAL ] GFI: Loaded 53106 existing records from primary storage. [2025-09-24T19:01:52.877896] [INFO ] [MAIN ] GFI: Loaded 53106 existing records. [2025-09-24T19:01:52.872586] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:52.915984] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-24T19:01:52.948053] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-24T19:01:52.971590] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-24T19:01:52.986844] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-24T19:01:53.278396] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:53.314294] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-24T19:01:53.314400] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-24T19:01:53.314072] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:01:53.329972] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-24T19:01:53.330178] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-24T19:01:53.387264] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-24T19:01:53.557196] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-24T19:01:53.617163] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-24T19:01:53.638848] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-24T19:01:53.837975] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T19:01:53.885410] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-24T19:01:54.088273] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:54.126755] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-24T19:01:54.474011] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:54.498784] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-24T19:01:54.498411] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:01:54.500001] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-24T19:01:54.754105] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-24T19:01:54.756594] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-24T19:01:55.255423] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-24T19:01:55.257813] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-24T19:01:55.525842] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T19:01:55.531975] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-24T19:01:55.651927] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T19:01:55.661091] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-24T19:01:55.762879] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-24T19:01:55.766158] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-24T19:01:55.972811] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:01:55.983788] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-24T19:01:56.415603] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T19:01:56.421942] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-24T19:01:56.542833] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T19:01:56.546818] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-24T19:01:57.233112] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:01:57.243276] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-24T19:01:57.313583] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T19:01:57.598985] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T19:01:57.616035] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-24T19:01:57.765919] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T19:01:58.234955] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T19:01:58.416056] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-24T19:01:58.641244] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T19:01:59.216069] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-24T19:02:00.016073] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-24T19:02:00.359911] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T19:02:00.523304] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:02:00.816127] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-24T19:02:01.497478] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:02:01.616047] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-24T19:02:02.416122] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-24T19:02:02.701664] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T19:02:03.038017] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T19:02:03.216129] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-24T19:02:03.959196] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:02:04.016089] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-24T19:02:04.816159] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-24T19:02:05.295210] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T19:02:05.347818] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T19:02:05.616112] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-24T19:02:06.416134] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-24T19:02:06.548743] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:02:06.847228] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T19:02:06.899794] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T19:02:07.216073] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-24T19:02:08.016108] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-24T19:02:08.816105] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-24T19:02:09.056971] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T19:02:09.169912] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T19:02:09.616115] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-24T19:02:10.183884] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T19:02:10.416096] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-24T19:02:10.646240] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T19:02:10.943273] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-24T19:02:11.216063] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-24T19:02:12.016120] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-24T19:02:12.816066] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-24T19:02:13.193225] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T19:02:13.429108] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T19:02:13.616084] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-24T19:02:13.663913] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T19:02:13.665788] [INFO ] [REMOTE ] GFR: Full fetch complete (12879 records). [2025-09-24T19:02:13.665922] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-24T19:02:14.041125] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-24T19:02:14.041220] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-24T19:02:14.041556] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-24T19:02:14.041676] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-24T19:02:14.042265] [DEBUG] [LOCAL ] GFR: Trimmed 12879 records to 8471 (keeping 200 days of data) [2025-09-24T19:02:14.100157] [DEBUG] [LOCAL ] GFR: Primary data saved (8471 records). [2025-09-24T19:02:14.100333] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-24T19:02:14.100491] [INFO ] [MAIN ] Update Progress: 921/2373 symbols completed. GFR took 22.8s. Estimated remaining: 3h 12m 37s. Rate: 7.5 symbols/min [2025-09-24T19:02:14.286782] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:14.350006] [DEBUG] [LOCAL ] GGB: Loaded 51019 existing records from primary storage. [2025-09-24T19:02:14.350254] [INFO ] [MAIN ] GGB: Loaded 51019 existing records. [2025-09-24T19:02:14.421373] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-24T19:02:14.553188] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:14.553510] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-24T19:02:14.553564] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-24T19:02:14.554976] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-24T19:02:14.555231] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-24T19:02:14.922793] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:15.026072] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T19:02:15.216077] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-24T19:02:15.921049] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T19:02:15.932299] [INFO ] [REMOTE ] GFF: Full fetch complete (44283 records). [2025-09-24T19:02:15.932470] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-24T19:02:16.021232] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-24T19:02:16.351209] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-24T19:02:16.351299] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-24T19:02:16.352837] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-24T19:02:16.352905] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-24T19:02:16.354271] [DEBUG] [LOCAL ] GFF: Trimmed 44283 records to 30830 (keeping 200 days of data) [2025-09-24T19:02:16.598682] [DEBUG] [LOCAL ] GFF: Primary data saved (30830 records). [2025-09-24T19:02:16.598851] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-24T19:02:16.599039] [INFO ] [MAIN ] Update Progress: 922/2373 symbols completed. GFF took 25.3s. Estimated remaining: 3h 12m 20s. Rate: 7.5 symbols/min [2025-09-24T19:02:16.780348] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:16.816093] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-24T19:02:16.833266] [DEBUG] [LOCAL ] GGG: Loaded 40996 existing records from primary storage. [2025-09-24T19:02:16.833420] [INFO ] [MAIN ] GGG: Loaded 40996 existing records. [2025-09-24T19:02:17.043826] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:17.045015] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-24T19:02:17.045313] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-24T19:02:17.046978] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-24T19:02:17.047079] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-24T19:02:17.246849] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T19:02:17.501582] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:17.616109] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-24T19:02:17.726739] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T19:02:17.737046] [INFO ] [REMOTE ] GFL: Full fetch complete (68748 records). [2025-09-24T19:02:17.737300] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-24T19:02:18.194331] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-24T19:02:18.194728] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-24T19:02:18.195978] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-24T19:02:18.196094] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-24T19:02:18.198149] [DEBUG] [LOCAL ] GFL: Trimmed 68748 records to 48025 (keeping 200 days of data) [2025-09-24T19:02:18.326664] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T19:02:18.431687] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-24T19:02:18.562475] [DEBUG] [LOCAL ] GFL: Primary data saved (48025 records). [2025-09-24T19:02:18.562634] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-24T19:02:18.562779] [INFO ] [MAIN ] Update Progress: 923/2373 symbols completed. GFL took 27.2s. Estimated remaining: 3h 12m 3s. Rate: 7.6 symbols/min [2025-09-24T19:02:18.739485] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:18.756111] [DEBUG] [LOCAL ] GGT: Loaded 14153 existing records from primary storage. [2025-09-24T19:02:18.756234] [INFO ] [MAIN ] GGT: Loaded 14153 existing records. [2025-09-24T19:02:18.937582] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:18.937856] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-24T19:02:18.937905] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-24T19:02:18.938439] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-24T19:02:18.938500] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-24T19:02:19.221626] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-24T19:02:19.322286] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:19.335437] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:02:20.025920] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-24T19:02:20.032098] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:02:20.721756] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T19:02:20.816108] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-24T19:02:21.498813] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T19:02:21.616096] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-24T19:02:22.416087] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-24T19:02:22.561997] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:02:23.216131] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-24T19:02:24.024128] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-24T19:02:24.062869] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:02:24.139699] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-24T19:02:24.162792] [INFO ] [REMOTE ] GFI: Full fetch complete (76307 records). [2025-09-24T19:02:24.163144] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-24T19:02:24.786389] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-24T19:02:24.786541] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-24T19:02:24.788727] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-24T19:02:24.788934] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-24T19:02:24.791184] [DEBUG] [LOCAL ] GFI: Trimmed 76307 records to 53109 (keeping 200 days of data) [2025-09-24T19:02:24.860707] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-24T19:02:24.947618] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T19:02:25.133194] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T19:02:25.228951] [DEBUG] [LOCAL ] GFI: Primary data saved (53109 records). [2025-09-24T19:02:25.229185] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-24T19:02:25.229361] [INFO ] [MAIN ] Update Progress: 924/2373 symbols completed. GFI took 33.9s. Estimated remaining: 3h 11m 53s. Rate: 7.6 symbols/min [2025-09-24T19:02:25.404581] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:25.410573] [DEBUG] [LOCAL ] GGZ: Loaded 2462 existing records from primary storage. [2025-09-24T19:02:25.410731] [INFO ] [MAIN ] GGZ: Loaded 2462 existing records. [2025-09-24T19:02:25.595841] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:25.596237] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-24T19:02:25.596296] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-24T19:02:25.596601] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-24T19:02:25.596698] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-24T19:02:25.621332] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-24T19:02:25.995219] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:26.352872] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:02:26.416167] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-24T19:02:27.216219] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-24T19:02:27.469752] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T19:02:27.724503] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:02:27.747408] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T19:02:28.016101] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-24T19:02:28.816094] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-24T19:02:29.616135] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-24T19:02:29.782441] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T19:02:29.902237] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:02:30.416086] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-24T19:02:30.530348] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T19:02:30.962400] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T19:02:31.216083] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-24T19:02:31.654600] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T19:02:32.016121] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-24T19:02:32.491125] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T19:02:32.816138] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-24T19:02:33.616155] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-24T19:02:34.416122] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-24T19:02:34.502102] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T19:02:34.922080] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T19:02:35.091362] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T19:02:35.216122] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-24T19:02:36.016097] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-24T19:02:36.756704] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:02:36.816033] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-24T19:02:37.616102] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-24T19:02:37.902599] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T19:02:38.096171] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-24T19:02:38.118148] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:02:38.416058] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-24T19:02:39.216077] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-24T19:02:40.016123] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-24T19:02:40.225868] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T19:02:40.629842] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:02:40.816047] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-24T19:02:40.931075] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:02:40.937971] [INFO ] [REMOTE ] GGG: Full fetch complete (59271 records). [2025-09-24T19:02:40.938091] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-24T19:02:41.339991] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-24T19:02:41.340071] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-24T19:02:41.340916] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-24T19:02:41.340982] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-24T19:02:41.342159] [DEBUG] [LOCAL ] GGG: Trimmed 59271 records to 40958 (keeping 200 days of data) [2025-09-24T19:02:41.598595] [DEBUG] [LOCAL ] GGG: Primary data saved (40958 records). [2025-09-24T19:02:41.598751] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-24T19:02:41.598866] [INFO ] [MAIN ] Update Progress: 925/2373 symbols completed. GGG took 25.0s. Estimated remaining: 3h 11m 58s. Rate: 7.5 symbols/min [2025-09-24T19:02:41.621159] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-24T19:02:41.775270] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:41.779741] [DEBUG] [LOCAL ] GHC: Loaded 2627 existing records from primary storage. [2025-09-24T19:02:41.779830] [INFO ] [MAIN ] GHC: Loaded 2627 existing records. [2025-09-24T19:02:41.962493] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:41.962791] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-24T19:02:41.962844] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-24T19:02:41.963230] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-24T19:02:41.963288] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-24T19:02:42.136985] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T19:02:42.382152] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:42.416041] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-24T19:02:42.580345] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:02:42.593830] [INFO ] [REMOTE ] GGB: Full fetch complete (73989 records). [2025-09-24T19:02:42.594020] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-24T19:02:42.835265] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-24T19:02:43.006513] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-24T19:02:43.006604] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-24T19:02:43.007563] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-24T19:02:43.007632] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-24T19:02:43.009218] [DEBUG] [LOCAL ] GGB: Trimmed 73989 records to 51045 (keeping 200 days of data) [2025-09-24T19:02:43.227820] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-24T19:02:43.332158] [DEBUG] [LOCAL ] GGB: Primary data saved (51045 records). [2025-09-24T19:02:43.332293] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-24T19:02:43.332376] [INFO ] [MAIN ] Update Progress: 926/2373 symbols completed. GGB took 29.2s. Estimated remaining: 3h 11m 40s. Rate: 7.5 symbols/min [2025-09-24T19:02:43.514320] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:43.515000] [DEBUG] [LOCAL ] GHG: No existing data file found in primary storage. [2025-09-24T19:02:43.515179] [WARN ] [MAIN ] GHG: No existing data found, performing full refresh instead. [2025-09-24T19:02:43.515380] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-24T19:02:43.515429] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-24T19:02:43.515476] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-24T19:02:43.515514] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-24T19:02:43.829130] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T19:02:43.917035] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:44.016085] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-24T19:02:44.447589] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-24T19:02:44.816084] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-24T19:02:45.254831] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T19:02:45.616097] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-24T19:02:46.064965] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T19:02:46.416075] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-24T19:02:47.202873] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T19:02:47.216027] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-24T19:02:48.016100] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-24T19:02:48.061787] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T19:02:48.388236] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-24T19:02:48.816088] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-24T19:02:49.445810] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T19:02:49.447294] [INFO ] [REMOTE ] GGZ: Full fetch complete (4162 records). [2025-09-24T19:02:49.447405] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-24T19:02:49.616149] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-24T19:02:49.843150] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-24T19:02:49.843245] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-24T19:02:49.843396] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-24T19:02:49.843436] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-24T19:02:49.843899] [DEBUG] [LOCAL ] GGZ: Trimmed 4162 records to 2437 (keeping 200 days of data) [2025-09-24T19:02:49.859472] [DEBUG] [LOCAL ] GGZ: Primary data saved (2437 records). [2025-09-24T19:02:49.859613] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-24T19:02:49.859736] [INFO ] [MAIN ] Update Progress: 927/2373 symbols completed. GGZ took 24.6s. Estimated remaining: 3h 11m 30s. Rate: 7.6 symbols/min [2025-09-24T19:02:50.065958] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:02:50.075928] [DEBUG] [LOCAL ] GHI: Loaded 6895 existing records from primary storage. [2025-09-24T19:02:50.076059] [INFO ] [MAIN ] GHI: Loaded 6895 existing records. [2025-09-24T19:02:50.205840] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T19:02:50.282273] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:02:50.282562] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-24T19:02:50.282690] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-24T19:02:50.283113] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-24T19:02:50.283197] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-24T19:02:50.421266] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-24T19:02:50.671631] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:02:51.004241] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T19:02:51.216078] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-24T19:02:51.730766] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-24T19:02:52.016099] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-24T19:02:52.469499] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T19:02:52.816092] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-24T19:02:53.376419] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T19:02:53.616085] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-24T19:02:54.416146] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-24T19:02:54.712944] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T19:02:54.955195] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T19:02:55.216086] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-24T19:02:55.730618] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T19:02:56.016093] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-24T19:02:56.816074] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-24T19:02:56.954859] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T19:02:57.397402] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T19:02:57.616092] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-24T19:02:58.416077] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-24T19:02:58.628039] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T19:02:59.078304] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T19:02:59.216083] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-24T19:03:00.016125] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-24T19:03:00.146398] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T19:03:00.430889] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T19:03:00.816159] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-24T19:03:01.551370] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T19:03:01.616118] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-24T19:03:02.416093] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-24T19:03:03.216073] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-24T19:03:03.328095] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T19:03:03.841850] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T19:03:04.016153] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-24T19:03:04.377675] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T19:03:04.534885] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T19:03:04.816144] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-24T19:03:05.616102] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-24T19:03:05.656379] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T19:03:05.657535] [INFO ] [REMOTE ] GHC: Full fetch complete (3260 records). [2025-09-24T19:03:05.657605] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-24T19:03:06.018827] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-24T19:03:06.018902] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-24T19:03:06.019008] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-24T19:03:06.019045] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-24T19:03:06.019388] [DEBUG] [LOCAL ] GHC: Trimmed 3260 records to 2634 (keeping 200 days of data) [2025-09-24T19:03:06.036461] [DEBUG] [LOCAL ] GHC: Primary data saved (2634 records). [2025-09-24T19:03:06.036529] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-24T19:03:06.036600] [INFO ] [MAIN ] Update Progress: 928/2373 symbols completed. GHC took 24.4s. Estimated remaining: 3h 11m 35s. Rate: 7.5 symbols/min [2025-09-24T19:03:06.213292] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:06.219389] [DEBUG] [LOCAL ] GHLD: Loaded 4110 existing records from primary storage. [2025-09-24T19:03:06.219492] [INFO ] [MAIN ] GHLD: Loaded 4110 existing records. [2025-09-24T19:03:06.396594] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T19:03:06.419175] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-24T19:03:06.419376] [INFO ] [REMOTE ] GHG: Full fetch complete (4016 records). [2025-09-24T19:03:06.420204] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-24T19:03:06.419100] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:06.426150] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-24T19:03:06.442171] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-24T19:03:06.487460] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-24T19:03:06.504073] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-24T19:03:07.194754] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:07.194924] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-24T19:03:07.195377] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-24T19:03:07.195539] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-24T19:03:07.195742] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-24T19:03:07.203385] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T19:03:07.203491] [DEBUG] [LOCAL ] GHG: Trimmed 4016 records to 3194 (keeping 200 days of data) [2025-09-24T19:03:07.220527] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-24T19:03:07.226964] [DEBUG] [LOCAL ] GHG: Primary data saved (3194 records). [2025-09-24T19:03:07.227107] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-24T19:03:07.227189] [INFO ] [MAIN ] Update Progress: 929/2373 symbols completed. GHG took 23.9s. Estimated remaining: 3h 11m 17s. Rate: 7.5 symbols/min [2025-09-24T19:03:07.469306] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:07.484507] [DEBUG] [LOCAL ] GHM: Loaded 14136 existing records from primary storage. [2025-09-24T19:03:07.484622] [INFO ] [MAIN ] GHM: Loaded 14136 existing records. [2025-09-24T19:03:07.668741] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:07.669007] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-24T19:03:07.669080] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-24T19:03:07.669736] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-24T19:03:07.669801] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-24T19:03:08.021963] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-24T19:03:08.055827] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:08.081669] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T19:03:08.509820] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T19:03:08.816106] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-24T19:03:09.616104] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-24T19:03:09.677826] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T19:03:10.141371] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T19:03:10.416082] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-24T19:03:11.216105] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-24T19:03:11.236838] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T19:03:11.658448] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T19:03:12.016126] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-24T19:03:12.816078] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-24T19:03:12.968847] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T19:03:12.972039] [INFO ] [REMOTE ] GGT: Full fetch complete (18729 records). [2025-09-24T19:03:12.972124] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-24T19:03:13.389235] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-24T19:03:13.389332] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-24T19:03:13.390035] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-24T19:03:13.390133] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-24T19:03:13.391414] [DEBUG] [LOCAL ] GGT: Trimmed 18729 records to 14152 (keeping 200 days of data) [2025-09-24T19:03:13.482855] [DEBUG] [LOCAL ] GGT: Primary data saved (14152 records). [2025-09-24T19:03:13.483006] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-24T19:03:13.483095] [INFO ] [MAIN ] Update Progress: 930/2373 symbols completed. GGT took 54.9s. Estimated remaining: 3h 11m 6s. Rate: 7.6 symbols/min [2025-09-24T19:03:13.579516] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T19:03:13.621158] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-24T19:03:13.679972] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:13.701449] [DEBUG] [LOCAL ] GHY: Loaded 20835 existing records from primary storage. [2025-09-24T19:03:13.701571] [INFO ] [MAIN ] GHY: Loaded 20835 existing records. [2025-09-24T19:03:13.878221] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:13.878476] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-24T19:03:13.878523] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-24T19:03:13.879411] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-24T19:03:13.879472] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-24T19:03:14.058607] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T19:03:14.245747] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:14.416082] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-24T19:03:15.216134] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-24T19:03:16.016101] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-24T19:03:16.290855] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T19:03:16.691308] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T19:03:16.848794] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T19:03:16.837825] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-24T19:03:17.606263] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T19:03:17.616037] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-24T19:03:18.345741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T19:03:18.416090] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-24T19:03:18.873593] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T19:03:19.216145] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-24T19:03:20.016056] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-24T19:03:20.093827] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T19:03:20.095879] [INFO ] [REMOTE ] GHI: Full fetch complete (11733 records). [2025-09-24T19:03:20.095953] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-24T19:03:20.458256] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-24T19:03:20.458339] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-24T19:03:20.458633] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-24T19:03:20.458712] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-24T19:03:20.459171] [DEBUG] [LOCAL ] GHI: Trimmed 11733 records to 6853 (keeping 200 days of data) [2025-09-24T19:03:20.502907] [DEBUG] [LOCAL ] GHI: Primary data saved (6853 records). [2025-09-24T19:03:20.503028] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-24T19:03:20.503119] [INFO ] [MAIN ] Update Progress: 931/2373 symbols completed. GHI took 30.6s. Estimated remaining: 3h 10m 57s. Rate: 7.6 symbols/min [2025-09-24T19:03:20.685532] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:20.723741] [DEBUG] [LOCAL ] GIB: Loaded 32109 existing records from primary storage. [2025-09-24T19:03:20.723921] [INFO ] [MAIN ] GIB: Loaded 32109 existing records. [2025-09-24T19:03:20.821210] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-24T19:03:20.934510] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:20.934804] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-24T19:03:20.934862] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-24T19:03:20.935962] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-24T19:03:20.936040] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-24T19:03:21.339412] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:21.354517] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-24T19:03:21.357789] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T19:03:21.616093] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-24T19:03:22.062622] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T19:03:22.416106] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-24T19:03:23.216126] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-24T19:03:23.596844] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T19:03:24.016115] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-24T19:03:24.361698] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T19:03:24.629008] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T19:03:24.816116] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-24T19:03:25.616104] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-24T19:03:25.922637] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T19:03:26.416100] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-24T19:03:26.634994] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T19:03:27.216087] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-24T19:03:27.477109] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T19:03:28.016089] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-24T19:03:28.110407] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T19:03:28.816090] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-24T19:03:29.278496] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T19:03:29.616112] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-24T19:03:29.667422] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T19:03:30.335989] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:03:30.416115] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-24T19:03:31.216115] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-24T19:03:31.565394] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T19:03:32.016100] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-24T19:03:32.534949] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T19:03:32.816112] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-24T19:03:33.326859] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:03:33.616094] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-24T19:03:33.960831] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T19:03:34.416110] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-24T19:03:35.104733] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T19:03:35.128837] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:03:35.216063] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-24T19:03:35.940818] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T19:03:35.942957] [INFO ] [REMOTE ] GHLD: Full fetch complete (4733 records). [2025-09-24T19:03:35.943066] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-24T19:03:36.021217] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-24T19:03:36.313743] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-24T19:03:36.313830] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-24T19:03:36.313993] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-24T19:03:36.314032] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-24T19:03:36.314417] [DEBUG] [LOCAL ] GHLD: Trimmed 4733 records to 4117 (keeping 200 days of data) [2025-09-24T19:03:36.340740] [DEBUG] [LOCAL ] GHLD: Primary data saved (4117 records). [2025-09-24T19:03:36.340859] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-24T19:03:36.340942] [INFO ] [MAIN ] Update Progress: 932/2373 symbols completed. GHLD took 30.3s. Estimated remaining: 3h 11m 1s. Rate: 7.5 symbols/min [2025-09-24T19:03:36.514266] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:36.530727] [DEBUG] [LOCAL ] GIC: Loaded 13706 existing records from primary storage. [2025-09-24T19:03:36.530865] [INFO ] [MAIN ] GIC: Loaded 13706 existing records. [2025-09-24T19:03:36.712532] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:36.712832] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-24T19:03:36.712884] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-24T19:03:36.713411] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-24T19:03:36.713473] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-24T19:03:36.821162] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-24T19:03:37.092331] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:37.257604] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T19:03:37.616099] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-24T19:03:37.752989] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T19:03:38.365608] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T19:03:38.416078] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-24T19:03:39.216099] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-24T19:03:39.405633] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T19:03:40.016099] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-24T19:03:40.487040] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T19:03:40.816130] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-24T19:03:40.949048] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T19:03:41.616126] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-24T19:03:42.261074] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T19:03:42.416090] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-24T19:03:42.588414] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:03:42.591558] [INFO ] [REMOTE ] GHM: Full fetch complete (21620 records). [2025-09-24T19:03:42.591638] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-24T19:03:42.956177] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-24T19:03:42.956259] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-24T19:03:42.956793] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-24T19:03:42.956854] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-24T19:03:42.957448] [DEBUG] [LOCAL ] GHM: Trimmed 21620 records to 14139 (keeping 200 days of data) [2025-09-24T19:03:43.042296] [DEBUG] [LOCAL ] GHM: Primary data saved (14139 records). [2025-09-24T19:03:43.042439] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-24T19:03:43.042524] [INFO ] [MAIN ] Update Progress: 933/2373 symbols completed. GHM took 35.8s. Estimated remaining: 3h 10m 51s. Rate: 7.5 symbols/min [2025-09-24T19:03:43.211952] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:43.216070] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-24T19:03:43.254421] [DEBUG] [LOCAL ] GIL: Loaded 43161 existing records from primary storage. [2025-09-24T19:03:43.254564] [INFO ] [MAIN ] GIL: Loaded 43161 existing records. [2025-09-24T19:03:43.437463] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:43.437751] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-24T19:03:43.437810] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-24T19:03:43.439008] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-24T19:03:43.439070] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-24T19:03:43.816813] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:43.845356] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T19:03:44.016062] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-24T19:03:44.126725] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T19:03:44.816081] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-24T19:03:45.550932] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T19:03:45.616045] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-24T19:03:45.981727] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T19:03:46.416083] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-24T19:03:47.094238] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T19:03:47.216085] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-24T19:03:47.749272] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T19:03:47.755154] [INFO ] [REMOTE ] GIB: Full fetch complete (45061 records). [2025-09-24T19:03:47.755281] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-24T19:03:48.021182] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-24T19:03:48.139869] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-24T19:03:48.139960] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-24T19:03:48.140709] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-24T19:03:48.140772] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-24T19:03:48.141945] [DEBUG] [LOCAL ] GIB: Trimmed 45061 records to 32049 (keeping 200 days of data) [2025-09-24T19:03:48.351231] [DEBUG] [LOCAL ] GIB: Primary data saved (32049 records). [2025-09-24T19:03:48.351379] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-24T19:03:48.351468] [INFO ] [MAIN ] Update Progress: 934/2373 symbols completed. GIB took 27.8s. Estimated remaining: 3h 10m 39s. Rate: 7.5 symbols/min [2025-09-24T19:03:48.533537] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:48.588670] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-24T19:03:48.588820] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-09-24T19:03:48.778190] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:48.778790] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-24T19:03:48.778908] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-24T19:03:48.786593] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-24T19:03:48.799751] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-24T19:03:48.822105] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-24T19:03:48.822045] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T19:03:49.154921] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T19:03:49.197463] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:49.616095] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-24T19:03:49.954163] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:03:50.416093] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-24T19:03:51.216055] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-24T19:03:51.384783] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T19:03:51.387639] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T19:03:52.016100] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-24T19:03:52.704552] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:03:52.816137] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-24T19:03:53.405146] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T19:03:53.616053] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-24T19:03:53.975687] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T19:03:53.979564] [INFO ] [REMOTE ] GHY: Full fetch complete (31819 records). [2025-09-24T19:03:53.979784] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-24T19:03:54.399269] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-24T19:03:54.399402] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-24T19:03:54.400186] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-24T19:03:54.400255] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-24T19:03:54.401739] [DEBUG] [LOCAL ] GHY: Trimmed 31819 records to 20728 (keeping 200 days of data) [2025-09-24T19:03:54.458975] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-24T19:03:54.543184] [DEBUG] [LOCAL ] GHY: Primary data saved (20728 records). [2025-09-24T19:03:54.543324] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-24T19:03:54.543415] [INFO ] [MAIN ] Update Progress: 935/2373 symbols completed. GHY took 41.1s. Estimated remaining: 3h 10m 28s. Rate: 7.5 symbols/min [2025-09-24T19:03:54.740937] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:03:54.783496] [DEBUG] [LOCAL ] GKOS: Loaded 43115 existing records from primary storage. [2025-09-24T19:03:54.783674] [INFO ] [MAIN ] GKOS: Loaded 43115 existing records. [2025-09-24T19:03:54.987618] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:03:54.988134] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-24T19:03:54.988266] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-24T19:03:54.989912] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-24T19:03:54.989980] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-24T19:03:55.222103] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-24T19:03:55.397533] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:03:55.431576] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T19:03:55.625746] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T19:03:56.016131] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-24T19:03:56.816082] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-24T19:03:56.956300] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:03:57.512510] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T19:03:57.616138] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-24T19:03:58.230409] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T19:03:58.416106] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-24T19:03:59.189733] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T19:03:59.216053] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-24T19:03:59.416720] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T19:04:00.016099] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-24T19:04:00.690944] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:04:00.816104] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-24T19:04:01.616105] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-24T19:04:01.688935] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T19:04:01.982660] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T19:04:02.416145] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-24T19:04:03.169796] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:04:03.216071] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-24T19:04:04.016053] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-24T19:04:04.402100] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T19:04:04.714047] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:04:04.816064] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-24T19:04:05.616209] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-24T19:04:05.649157] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T19:04:06.416059] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-24T19:04:06.464780] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T19:04:07.216101] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-24T19:04:07.371001] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T19:04:08.003691] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T19:04:08.024276] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-24T19:04:08.028766] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T19:04:08.036936] [INFO ] [REMOTE ] GIL: Full fetch complete (61334 records). [2025-09-24T19:04:08.037039] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-24T19:04:08.421792] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-24T19:04:08.421877] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-24T19:04:08.422747] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-24T19:04:08.422813] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-24T19:04:08.424067] [DEBUG] [LOCAL ] GIL: Trimmed 61334 records to 43210 (keeping 200 days of data) [2025-09-24T19:04:08.711192] [DEBUG] [LOCAL ] GIL: Primary data saved (43210 records). [2025-09-24T19:04:08.711585] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-24T19:04:08.711815] [INFO ] [MAIN ] Update Progress: 936/2373 symbols completed. GIL took 25.7s. Estimated remaining: 3h 10m 30s. Rate: 7.5 symbols/min [2025-09-24T19:04:08.817109] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-24T19:04:08.860703] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T19:04:08.955577] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:09.015630] [DEBUG] [LOCAL ] GL: Loaded 37987 existing records from primary storage. [2025-09-24T19:04:09.015845] [INFO ] [MAIN ] GL: Loaded 37987 existing records. [2025-09-24T19:04:09.296225] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:09.296945] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-24T19:04:09.297049] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-24T19:04:09.298610] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-24T19:04:09.298722] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-24T19:04:09.622556] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-24T19:04:09.892864] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:10.416134] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-24T19:04:10.903780] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-24T19:04:11.216153] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-24T19:04:11.395237] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T19:04:11.439918] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T19:04:12.016091] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-24T19:04:12.816080] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-24T19:04:12.861844] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:04:13.065244] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T19:04:13.068367] [INFO ] [REMOTE ] GIC: Full fetch complete (20384 records). [2025-09-24T19:04:13.068460] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-24T19:04:13.497589] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-24T19:04:13.497750] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-24T19:04:13.498395] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-24T19:04:13.498481] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-24T19:04:13.499593] [DEBUG] [LOCAL ] GIC: Trimmed 20384 records to 13671 (keeping 200 days of data) [2025-09-24T19:04:13.601210] [DEBUG] [LOCAL ] GIC: Primary data saved (13671 records). [2025-09-24T19:04:13.601411] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-24T19:04:13.601583] [INFO ] [MAIN ] Update Progress: 937/2373 symbols completed. GIC took 37.3s. Estimated remaining: 3h 10m 17s. Rate: 7.5 symbols/min [2025-09-24T19:04:13.624742] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-24T19:04:13.790370] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:13.845585] [DEBUG] [LOCAL ] GLOB: Loaded 47351 existing records from primary storage. [2025-09-24T19:04:13.845867] [INFO ] [MAIN ] GLOB: Loaded 47351 existing records. [2025-09-24T19:04:14.049050] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:14.049556] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-24T19:04:14.049636] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-24T19:04:14.051371] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-24T19:04:14.051457] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-24T19:04:14.421246] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-24T19:04:14.535740] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:14.716669] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T19:04:15.216059] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-24T19:04:15.376526] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T19:04:15.796011] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:04:16.016095] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-24T19:04:16.447168] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:04:16.816086] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-24T19:04:17.473305] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T19:04:17.616076] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-24T19:04:18.416083] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-24T19:04:18.499108] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T19:04:19.151838] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T19:04:19.216061] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-24T19:04:19.993662] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:04:20.016080] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-24T19:04:20.502489] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:04:20.816092] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-24T19:04:21.431264] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T19:04:21.616127] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-24T19:04:22.416094] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-24T19:04:22.972952] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:04:23.106022] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T19:04:23.119086] [INFO ] [REMOTE ] GIS: Full fetch complete (77650 records). [2025-09-24T19:04:23.119221] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-24T19:04:23.220565] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-24T19:04:23.515614] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-24T19:04:23.515727] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-24T19:04:23.516732] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-24T19:04:23.516798] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-24T19:04:23.518338] [DEBUG] [LOCAL ] GIS: Trimmed 77650 records to 53675 (keeping 200 days of data) [2025-09-24T19:04:23.861317] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-09-24T19:04:23.861520] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-24T19:04:23.861750] [INFO ] [MAIN ] Update Progress: 938/2373 symbols completed. GIS took 35.5s. Estimated remaining: 3h 10m 13s. Rate: 7.5 symbols/min [2025-09-24T19:04:24.035367] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:24.032723] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-24T19:04:24.066365] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T19:04:24.080736] [DEBUG] [LOCAL ] GLP: Loaded 9512 existing records from primary storage. [2025-09-24T19:04:24.080865] [INFO ] [MAIN ] GLP: Loaded 9512 existing records. [2025-09-24T19:04:24.258268] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:24.258612] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-24T19:04:24.258707] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-24T19:04:24.259148] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-24T19:04:24.259218] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-24T19:04:24.670791] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:24.816059] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-24T19:04:24.855827] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:04:25.626027] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-24T19:04:25.644494] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:04:25.673091] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T19:04:26.416129] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-24T19:04:26.971504] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T19:04:27.216111] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-24T19:04:27.229912] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T19:04:28.016083] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-24T19:04:28.723061] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T19:04:28.816064] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-24T19:04:29.616065] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-24T19:04:29.619220] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T19:04:29.636826] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T19:04:30.416087] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-24T19:04:31.188450] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T19:04:31.216047] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-24T19:04:31.879704] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T19:04:32.016092] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-24T19:04:32.816047] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-24T19:04:33.173065] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T19:04:33.411429] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T19:04:33.418487] [INFO ] [REMOTE ] GL: Full fetch complete (55609 records). [2025-09-24T19:04:33.418597] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-24T19:04:33.587448] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T19:04:33.616991] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-24T19:04:33.837311] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-24T19:04:33.837414] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-24T19:04:33.838305] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-24T19:04:33.838374] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-24T19:04:33.840180] [DEBUG] [LOCAL ] GL: Trimmed 55609 records to 37907 (keeping 200 days of data) [2025-09-24T19:04:34.105504] [DEBUG] [LOCAL ] GL: Primary data saved (37907 records). [2025-09-24T19:04:34.105722] [INFO ] [MAIN ] GL: Full history saved. [2025-09-24T19:04:34.105848] [INFO ] [MAIN ] Update Progress: 939/2373 symbols completed. GL took 25.4s. Estimated remaining: 3h 10m 9s. Rate: 7.5 symbols/min [2025-09-24T19:04:34.293946] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:34.350256] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-24T19:04:34.350426] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-24T19:04:34.421321] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-24T19:04:34.556215] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:34.557590] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-24T19:04:34.557679] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-24T19:04:34.559769] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-24T19:04:34.559832] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-24T19:04:34.932285] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:35.119786] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T19:04:35.216047] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-24T19:04:35.993820] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T19:04:36.002870] [INFO ] [REMOTE ] GKOS: Full fetch complete (59913 records). [2025-09-24T19:04:36.003063] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-24T19:04:36.026060] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-24T19:04:36.397963] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-24T19:04:36.398049] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-24T19:04:36.398929] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-24T19:04:36.398994] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-24T19:04:36.401411] [DEBUG] [LOCAL ] GKOS: Trimmed 59913 records to 43007 (keeping 200 days of data) [2025-09-24T19:04:36.667126] [DEBUG] [LOCAL ] GKOS: Primary data saved (43007 records). [2025-09-24T19:04:36.667261] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-24T19:04:36.667360] [INFO ] [MAIN ] Update Progress: 940/2373 symbols completed. GKOS took 42.1s. Estimated remaining: 3h 9m 52s. Rate: 7.5 symbols/min [2025-09-24T19:04:36.845174] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:36.842463] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-24T19:04:36.901292] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-24T19:04:36.901446] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-24T19:04:37.100380] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:37.100757] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-24T19:04:37.100954] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-24T19:04:37.102451] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-24T19:04:37.102513] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-24T19:04:37.322971] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T19:04:37.530706] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:37.616059] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-24T19:04:37.873340] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T19:04:37.999500] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T19:04:38.416105] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-24T19:04:38.987226] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T19:04:39.216107] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-24T19:04:39.999989] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-24T19:04:40.016029] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-24T19:04:40.816109] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-24T19:04:41.061456] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T19:04:41.616131] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-24T19:04:42.191570] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T19:04:42.416150] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-24T19:04:42.469259] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:04:43.185710] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T19:04:43.195004] [INFO ] [REMOTE ] GLOB: Full fetch complete (63362 records). [2025-09-24T19:04:43.195200] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-24T19:04:43.226845] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-24T19:04:43.616822] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-24T19:04:43.616943] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-24T19:04:43.618213] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-24T19:04:43.618286] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-24T19:04:43.622136] [DEBUG] [LOCAL ] GLOB: Trimmed 63362 records to 47365 (keeping 200 days of data) [2025-09-24T19:04:43.921018] [DEBUG] [LOCAL ] GLOB: Primary data saved (47365 records). [2025-09-24T19:04:43.921191] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-24T19:04:43.921315] [INFO ] [MAIN ] Update Progress: 941/2373 symbols completed. GLOB took 30.3s. Estimated remaining: 3h 9m 43s. Rate: 7.5 symbols/min [2025-09-24T19:04:44.031088] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-24T19:04:44.105363] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:44.160511] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-24T19:04:44.160717] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-09-24T19:04:44.347770] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:44.348255] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-24T19:04:44.348365] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-24T19:04:44.349803] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-24T19:04:44.349866] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-24T19:04:44.727556] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:44.752246] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-24T19:04:44.816030] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-24T19:04:44.865095] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T19:04:44.935966] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T19:04:45.616095] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-24T19:04:46.377789] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T19:04:46.416031] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-24T19:04:47.001201] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-24T19:04:47.028993] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T19:04:47.216058] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-24T19:04:48.016085] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-24T19:04:48.816060] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-24T19:04:49.236988] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T19:04:49.616075] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-24T19:04:49.976478] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T19:04:50.400320] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T19:04:50.403129] [INFO ] [REMOTE ] GLP: Full fetch complete (14390 records). [2025-09-24T19:04:50.403199] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-24T19:04:50.424146] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-24T19:04:50.779491] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-24T19:04:50.779576] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-24T19:04:50.779963] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-24T19:04:50.780027] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-24T19:04:50.780518] [DEBUG] [LOCAL ] GLP: Trimmed 14390 records to 9463 (keeping 200 days of data) [2025-09-24T19:04:50.837902] [DEBUG] [LOCAL ] GLP: Primary data saved (9463 records). [2025-09-24T19:04:50.838017] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-24T19:04:50.838098] [INFO ] [MAIN ] Update Progress: 942/2373 symbols completed. GLP took 27.0s. Estimated remaining: 3h 9m 34s. Rate: 7.5 symbols/min [2025-09-24T19:04:51.017229] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:04:51.067077] [DEBUG] [LOCAL ] GMED: Loaded 48308 existing records from primary storage. [2025-09-24T19:04:51.067223] [INFO ] [MAIN ] GMED: Loaded 48308 existing records. [2025-09-24T19:04:51.223202] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-24T19:04:51.254979] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:04:51.255339] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-24T19:04:51.255407] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-24T19:04:51.256840] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-24T19:04:51.256904] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-24T19:04:51.669588] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:04:51.664361] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-24T19:04:52.016060] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-24T19:04:52.056228] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T19:04:52.816144] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-24T19:04:53.169377] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T19:04:53.616106] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-24T19:04:53.654923] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T19:04:54.420247] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-24T19:04:54.429494] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T19:04:55.216073] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-24T19:04:55.558969] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T19:04:56.016135] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-24T19:04:56.816103] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-24T19:04:57.018230] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-24T19:04:57.066385] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T19:04:57.324881] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T19:04:57.616087] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-24T19:04:58.416106] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-24T19:04:58.873242] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T19:04:59.216138] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-24T19:04:59.707163] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T19:05:00.016155] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-24T19:05:00.465639] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T19:05:00.816117] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-24T19:05:01.063828] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T19:05:01.616165] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-24T19:05:02.345084] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-24T19:05:02.416128] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-24T19:05:02.907919] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T19:05:02.961445] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T19:05:03.216103] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-24T19:05:04.016103] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-24T19:05:04.816129] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-24T19:05:04.974457] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T19:05:05.027453] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-24T19:05:05.616088] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-24T19:05:06.221939] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-24T19:05:06.231443] [INFO ] [REMOTE ] GLW: Full fetch complete (77616 records). [2025-09-24T19:05:06.231567] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-24T19:05:06.419232] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-24T19:05:06.656154] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-24T19:05:06.656341] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-24T19:05:06.658056] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-24T19:05:06.658161] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-24T19:05:06.660775] [DEBUG] [LOCAL ] GLW: Trimmed 77616 records to 53635 (keeping 200 days of data) [2025-09-24T19:05:06.805675] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T19:05:06.833352] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-24T19:05:06.839731] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-24T19:05:07.504574] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-24T19:05:07.504953] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-24T19:05:07.509243] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-24T19:05:07.510668] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-24T19:05:07.518442] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-24T19:05:07.624217] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-24T19:05:07.624915] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-24T19:05:07.625829] [INFO ] [MAIN ] Update Progress: 943/2373 symbols completed. GLW took 33.5s. Estimated remaining: 3h 9m 39s. Rate: 7.5 symbols/min [2025-09-24T19:05:07.851140] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:08.027929] [DEBUG] [LOCAL ] GMRE: Loaded 37709 existing records from primary storage. [2025-09-24T19:05:08.029180] [INFO ] [MAIN ] GMRE: Loaded 37709 existing records. [2025-09-24T19:05:08.305980] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:08.326692] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-24T19:05:08.333675] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-24T19:05:08.353883] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-24T19:05:08.369330] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-24T19:05:08.415506] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-24T19:05:08.504509] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-24T19:05:08.580124] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T19:05:08.646950] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-24T19:05:08.811387] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-24T19:05:08.814414] [INFO ] [MAIN ] GM: Full history saved. [2025-09-24T19:05:08.814908] [INFO ] [MAIN ] Update Progress: 944/2373 symbols completed. GM took 32.1s. Estimated remaining: 3h 9m 21s. Rate: 7.5 symbols/min [2025-09-24T19:05:09.062875] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:09.074129] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-24T19:05:09.138148] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:09.158862] [DEBUG] [LOCAL ] GNE: Loaded 17661 existing records from primary storage. [2025-09-24T19:05:09.159060] [INFO ] [MAIN ] GNE: Loaded 17661 existing records. [2025-09-24T19:05:09.349246] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:09.349609] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-24T19:05:09.349693] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-24T19:05:09.350465] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-24T19:05:09.350530] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-24T19:05:09.716868] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:09.717220] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-24T19:05:10.401779] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T19:05:10.416030] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-24T19:05:10.445385] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T19:05:10.585729] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T19:05:11.200789] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-24T19:05:11.216029] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-24T19:05:12.016781] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-24T19:05:12.020732] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:05:12.816097] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-24T19:05:12.953007] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T19:05:13.631205] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-24T19:05:13.669000] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-24T19:05:13.959555] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T19:05:14.416103] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-24T19:05:15.216061] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-24T19:05:15.413459] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T19:05:16.016093] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-24T19:05:16.353681] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T19:05:16.801373] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-24T19:05:16.816021] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-24T19:05:17.474072] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T19:05:17.616092] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-24T19:05:18.416130] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-24T19:05:18.966189] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T19:05:18.982916] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T19:05:19.123547] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T19:05:19.133979] [INFO ] [REMOTE ] GME: Full fetch complete (77917 records). [2025-09-24T19:05:19.134182] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-24T19:05:19.221171] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-24T19:05:19.580205] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-24T19:05:19.580299] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-24T19:05:19.581411] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-24T19:05:19.581480] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-24T19:05:19.583350] [DEBUG] [LOCAL ] GME: Trimmed 77917 records to 53761 (keeping 200 days of data) [2025-09-24T19:05:19.923274] [DEBUG] [LOCAL ] GME: Primary data saved (53761 records). [2025-09-24T19:05:19.923429] [INFO ] [MAIN ] GME: Full history saved. [2025-09-24T19:05:19.923517] [INFO ] [MAIN ] Update Progress: 945/2373 symbols completed. GME took 36.0s. Estimated remaining: 3h 9m 18s. Rate: 7.5 symbols/min [2025-09-24T19:05:20.021205] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-24T19:05:20.094391] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:20.137470] [DEBUG] [LOCAL ] GNK: Loaded 40652 existing records from primary storage. [2025-09-24T19:05:20.137624] [INFO ] [MAIN ] GNK: Loaded 40652 existing records. [2025-09-24T19:05:20.317370] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:20.317664] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-24T19:05:20.317728] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-24T19:05:20.318775] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-24T19:05:20.318837] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-24T19:05:20.693672] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:20.731301] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T19:05:20.756842] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T19:05:20.765682] [INFO ] [REMOTE ] GMED: Full fetch complete (69181 records). [2025-09-24T19:05:20.765870] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-24T19:05:20.823632] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-24T19:05:21.170815] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-24T19:05:21.170957] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-24T19:05:21.171897] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-24T19:05:21.171962] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-24T19:05:21.173376] [DEBUG] [LOCAL ] GMED: Trimmed 69181 records to 48335 (keeping 200 days of data) [2025-09-24T19:05:21.461058] [DEBUG] [LOCAL ] GMED: Primary data saved (48335 records). [2025-09-24T19:05:21.461201] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-24T19:05:21.461306] [INFO ] [MAIN ] Update Progress: 946/2373 symbols completed. GMED took 30.6s. Estimated remaining: 3h 9m 0s. Rate: 7.6 symbols/min [2025-09-24T19:05:21.616721] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-24T19:05:21.649665] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:21.657902] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T19:05:21.715436] [DEBUG] [LOCAL ] GNL: Loaded 47288 existing records from primary storage. [2025-09-24T19:05:21.715604] [INFO ] [MAIN ] GNL: Loaded 47288 existing records. [2025-09-24T19:05:21.897301] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:21.897539] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-24T19:05:21.897587] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-24T19:05:21.898572] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-24T19:05:21.898634] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-24T19:05:22.250043] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:22.416108] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-24T19:05:22.746186] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T19:05:23.216120] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-24T19:05:23.804050] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T19:05:23.975979] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T19:05:24.016099] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-24T19:05:24.816108] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-24T19:05:25.616062] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-24T19:05:25.698688] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:05:26.296185] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T19:05:26.416055] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-24T19:05:26.731715] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T19:05:27.216096] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-24T19:05:27.870832] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:05:28.016094] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-24T19:05:28.598464] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T19:05:28.816057] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-24T19:05:28.943974] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T19:05:29.616154] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-24T19:05:30.365125] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:05:30.416036] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-24T19:05:30.783078] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T19:05:31.216103] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-24T19:05:31.936602] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T19:05:32.016142] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-24T19:05:32.524147] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:05:32.816135] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-24T19:05:33.616152] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-24T19:05:33.770731] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T19:05:34.060237] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:05:34.416108] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-24T19:05:34.764548] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T19:05:35.216097] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-24T19:05:35.712976] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:05:36.016107] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-24T19:05:36.816058] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-24T19:05:36.880535] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T19:05:37.317497] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T19:05:37.320998] [INFO ] [REMOTE ] GNE: Full fetch complete (22336 records). [2025-09-24T19:05:37.321094] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-24T19:05:37.621245] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-24T19:05:37.696722] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-24T19:05:37.696808] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-24T19:05:37.697368] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-24T19:05:37.697408] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-24T19:05:37.698169] [DEBUG] [LOCAL ] GNE: Trimmed 22336 records to 17738 (keeping 200 days of data) [2025-09-24T19:05:37.810606] [DEBUG] [LOCAL ] GNE: Primary data saved (17738 records). [2025-09-24T19:05:37.810775] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-24T19:05:37.810865] [INFO ] [MAIN ] Update Progress: 947/2373 symbols completed. GNE took 28.9s. Estimated remaining: 3h 9m 5s. Rate: 7.5 symbols/min [2025-09-24T19:05:37.982883] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:38.026629] [DEBUG] [LOCAL ] GNRC: Loaded 45194 existing records from primary storage. [2025-09-24T19:05:38.026816] [INFO ] [MAIN ] GNRC: Loaded 45194 existing records. [2025-09-24T19:05:38.215014] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:38.215573] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-24T19:05:38.215722] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-24T19:05:38.223952] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-24T19:05:38.235529] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-24T19:05:38.314927] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T19:05:38.417391] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-24T19:05:38.663462] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:39.078786] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T19:05:39.216084] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-24T19:05:39.633165] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T19:05:40.016138] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-24T19:05:40.816140] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-24T19:05:40.912982] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T19:05:40.919979] [INFO ] [REMOTE ] GMRE: Full fetch complete (53720 records). [2025-09-24T19:05:40.920124] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-24T19:05:41.306576] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-24T19:05:41.306696] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-24T19:05:41.307516] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-24T19:05:41.307560] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-24T19:05:41.308783] [DEBUG] [LOCAL ] GMRE: Trimmed 53720 records to 37754 (keeping 200 days of data) [2025-09-24T19:05:41.540793] [DEBUG] [LOCAL ] GMRE: Primary data saved (37754 records). [2025-09-24T19:05:41.540950] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-24T19:05:41.541045] [INFO ] [MAIN ] Update Progress: 948/2373 symbols completed. GMRE took 33.9s. Estimated remaining: 3h 8m 51s. Rate: 7.5 symbols/min [2025-09-24T19:05:41.617506] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-24T19:05:41.723594] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:41.733981] [DEBUG] [LOCAL ] GNT: Loaded 8021 existing records from primary storage. [2025-09-24T19:05:41.734140] [INFO ] [MAIN ] GNT: Loaded 8021 existing records. [2025-09-24T19:05:41.970199] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:41.973944] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-24T19:05:41.974092] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-24T19:05:41.973216] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:05:41.982864] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-24T19:05:41.983143] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-24T19:05:42.366483] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:42.378974] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T19:05:42.416030] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-24T19:05:43.184942] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T19:05:43.216039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-24T19:05:43.864535] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T19:05:43.903230] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T19:05:44.016072] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-24T19:05:44.816079] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-24T19:05:45.506170] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T19:05:45.616081] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-24T19:05:45.777881] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T19:05:46.416132] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-24T19:05:47.114783] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T19:05:47.216111] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-24T19:05:48.016107] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-24T19:05:48.107976] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T19:05:48.371373] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T19:05:48.816122] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-24T19:05:49.257919] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:05:49.616114] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-24T19:05:50.350337] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T19:05:50.372417] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:05:50.379391] [INFO ] [REMOTE ] GNK: Full fetch complete (56948 records). [2025-09-24T19:05:50.379502] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-24T19:05:50.421300] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-24T19:05:50.777753] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-24T19:05:50.777885] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-24T19:05:50.779464] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-24T19:05:50.779540] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-24T19:05:50.781436] [DEBUG] [LOCAL ] GNK: Trimmed 56948 records to 40546 (keeping 200 days of data) [2025-09-24T19:05:51.037950] [DEBUG] [LOCAL ] GNK: Primary data saved (40546 records). [2025-09-24T19:05:51.038082] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-24T19:05:51.038190] [INFO ] [MAIN ] Update Progress: 949/2373 symbols completed. GNK took 31.1s. Estimated remaining: 3h 8m 45s. Rate: 7.5 symbols/min [2025-09-24T19:05:51.206066] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:51.216071] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-24T19:05:51.215995] [DEBUG] [LOCAL ] GNTY: Loaded 7173 existing records from primary storage. [2025-09-24T19:05:51.217428] [INFO ] [MAIN ] GNTY: Loaded 7173 existing records. [2025-09-24T19:05:51.405304] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:51.406024] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-24T19:05:51.406138] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-24T19:05:51.406563] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-24T19:05:51.406676] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-24T19:05:51.764122] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:51.911186] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T19:05:52.016076] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-24T19:05:52.159552] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:05:52.170155] [INFO ] [REMOTE ] GNL: Full fetch complete (68529 records). [2025-09-24T19:05:52.170289] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-24T19:05:52.568783] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-24T19:05:52.568943] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-24T19:05:52.569979] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-24T19:05:52.570146] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-24T19:05:52.573909] [DEBUG] [LOCAL ] GNL: Trimmed 68529 records to 47224 (keeping 200 days of data) [2025-09-24T19:05:52.789391] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T19:05:52.816121] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-24T19:05:52.866498] [DEBUG] [LOCAL ] GNL: Primary data saved (47224 records). [2025-09-24T19:05:52.866672] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-24T19:05:52.866819] [INFO ] [MAIN ] Update Progress: 950/2373 symbols completed. GNL took 31.4s. Estimated remaining: 3h 8m 28s. Rate: 7.6 symbols/min [2025-09-24T19:05:53.060159] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:05:53.125521] [DEBUG] [LOCAL ] GNW: Loaded 51348 existing records from primary storage. [2025-09-24T19:05:53.125752] [INFO ] [MAIN ] GNW: Loaded 51348 existing records. [2025-09-24T19:05:53.321695] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:05:53.322064] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-24T19:05:53.322760] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-24T19:05:53.323885] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-24T19:05:53.323961] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-24T19:05:53.620576] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-24T19:05:53.633898] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T19:05:53.732946] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:05:54.360387] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T19:05:54.416039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-24T19:05:55.175016] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T19:05:55.216121] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-24T19:05:55.963608] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T19:05:56.016113] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-24T19:05:56.816093] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-24T19:05:57.411510] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T19:05:57.605935] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T19:05:57.616468] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-24T19:05:58.416092] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-24T19:05:59.004697] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:05:59.216099] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-24T19:05:59.285126] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T19:05:59.839421] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T19:06:00.016091] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-24T19:06:00.816108] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-24T19:06:01.616100] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-24T19:06:02.209532] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-24T19:06:02.416118] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-24T19:06:03.016266] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-24T19:06:03.139026] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:06:03.216037] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-24T19:06:04.016166] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-24T19:06:04.255708] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-24T19:06:04.696510] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T19:06:04.816052] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-24T19:06:04.910548] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:06:05.429992] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T19:06:05.432762] [INFO ] [REMOTE ] GNT: Full fetch complete (10638 records). [2025-09-24T19:06:05.432858] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-24T19:06:05.618051] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-24T19:06:05.809879] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-24T19:06:05.809977] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-24T19:06:05.810310] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-24T19:06:05.810393] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-24T19:06:05.812011] [DEBUG] [LOCAL ] GNT: Trimmed 10638 records to 8041 (keeping 200 days of data) [2025-09-24T19:06:05.871896] [DEBUG] [LOCAL ] GNT: Primary data saved (8041 records). [2025-09-24T19:06:05.872114] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-24T19:06:05.872353] [INFO ] [MAIN ] Update Progress: 951/2373 symbols completed. GNT took 24.3s. Estimated remaining: 3h 8m 28s. Rate: 7.5 symbols/min [2025-09-24T19:06:06.049227] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:06.112289] [DEBUG] [LOCAL ] GOF: Loaded 42873 existing records from primary storage. [2025-09-24T19:06:06.112569] [INFO ] [MAIN ] GOF: Loaded 42873 existing records. [2025-09-24T19:06:06.302283] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:06:06.302627] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-24T19:06:06.302741] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-24T19:06:06.303977] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-24T19:06:06.304055] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-24T19:06:06.421282] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-24T19:06:06.729496] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:07.216166] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-24T19:06:07.236795] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T19:06:07.530736] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T19:06:08.016090] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-24T19:06:08.816153] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-24T19:06:08.908587] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T19:06:09.616069] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-24T19:06:09.746548] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T19:06:10.416054] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-24T19:06:10.496259] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T19:06:11.097721] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T19:06:11.216078] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-24T19:06:12.016134] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-24T19:06:12.273376] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T19:06:12.359619] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T19:06:12.816197] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-24T19:06:13.526390] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:06:13.616113] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-24T19:06:14.416146] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-24T19:06:15.216205] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-24T19:06:15.285049] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-24T19:06:16.014675] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-24T19:06:16.017695] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-24T19:06:16.826876] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-24T19:06:16.832558] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-24T19:06:16.922255] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T19:06:17.616050] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-24T19:06:17.692835] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T19:06:17.828228] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T19:06:18.416098] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-24T19:06:19.216057] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-24T19:06:19.394093] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T19:06:20.016051] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-24T19:06:20.070300] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T19:06:20.561605] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:06:20.816083] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-24T19:06:21.416741] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T19:06:21.616083] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-24T19:06:22.315328] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T19:06:22.317398] [INFO ] [REMOTE ] GNTY: Full fetch complete (10302 records). [2025-09-24T19:06:22.317475] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-24T19:06:22.421504] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-24T19:06:22.702450] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-24T19:06:22.702784] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-24T19:06:22.703390] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-24T19:06:22.703476] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-24T19:06:22.704430] [DEBUG] [LOCAL ] GNTY: Trimmed 10302 records to 7230 (keeping 200 days of data) [2025-09-24T19:06:22.756346] [DEBUG] [LOCAL ] GNTY: Primary data saved (7230 records). [2025-09-24T19:06:22.756806] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-24T19:06:22.756939] [INFO ] [MAIN ] Update Progress: 952/2373 symbols completed. GNTY took 31.7s. Estimated remaining: 3h 8m 33s. Rate: 7.5 symbols/min [2025-09-24T19:06:22.868461] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T19:06:22.919097] [INFO ] [REMOTE ] GNRC: Full fetch complete (65234 records). [2025-09-24T19:06:22.929673] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-24T19:06:22.993403] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:23.228146] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-24T19:06:23.341004] [DEBUG] [LOCAL ] GOLF: Loaded 31727 existing records from primary storage. [2025-09-24T19:06:23.351767] [INFO ] [MAIN ] GOLF: Loaded 31727 existing records. [2025-09-24T19:06:23.576804] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-24T19:06:23.582057] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-24T19:06:23.583394] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-24T19:06:23.583487] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-24T19:06:23.666895] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:06:23.667672] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-24T19:06:23.667761] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-24T19:06:23.667972] [DEBUG] [LOCAL ] GNRC: Trimmed 65234 records to 45192 (keeping 200 days of data) [2025-09-24T19:06:23.669339] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-24T19:06:23.669433] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-24T19:06:24.229785] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:24.231272] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-24T19:06:24.364777] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T19:06:24.378581] [INFO ] [REMOTE ] GNW: Full fetch complete (73476 records). [2025-09-24T19:06:24.379772] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-24T19:06:24.867033] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:06:24.929254] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-24T19:06:24.931225] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-24T19:06:24.933151] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-24T19:06:24.933791] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-24T19:06:24.934331] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-24T19:06:24.938046] [DEBUG] [LOCAL ] GNRC: Primary data saved (45192 records). [2025-09-24T19:06:24.938231] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-24T19:06:24.938421] [INFO ] [MAIN ] Update Progress: 953/2373 symbols completed. GNRC took 47.1s. Estimated remaining: 3h 8m 16s. Rate: 7.5 symbols/min [2025-09-24T19:06:25.013419] [DEBUG] [LOCAL ] GNW: Trimmed 73476 records to 51325 (keeping 200 days of data) [2025-09-24T19:06:25.207265] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:25.266856] [DEBUG] [LOCAL ] GOOS: Loaded 45569 existing records from primary storage. [2025-09-24T19:06:25.269925] [INFO ] [MAIN ] GOOS: Loaded 45569 existing records. [2025-09-24T19:06:25.498532] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T19:06:25.561909] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:06:25.563677] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-24T19:06:25.564075] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-24T19:06:25.566120] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-24T19:06:25.566772] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-24T19:06:25.633837] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-24T19:06:26.010447] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:26.051944] [DEBUG] [LOCAL ] GNW: Primary data saved (51325 records). [2025-09-24T19:06:26.052110] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-24T19:06:26.052220] [INFO ] [MAIN ] Update Progress: 954/2373 symbols completed. GNW took 33.2s. Estimated remaining: 3h 7m 58s. Rate: 7.5 symbols/min [2025-09-24T19:06:26.229452] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:26.269171] [DEBUG] [LOCAL ] GOTU: Loaded 39025 existing records from primary storage. [2025-09-24T19:06:26.269405] [INFO ] [MAIN ] GOTU: Loaded 39025 existing records. [2025-09-24T19:06:26.416214] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-24T19:06:26.455097] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:06:26.455326] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-24T19:06:26.455386] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-24T19:06:26.456173] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-24T19:06:26.456235] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-24T19:06:26.838313] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:26.860185] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T19:06:26.917321] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T19:06:27.216290] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-24T19:06:28.016057] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-24T19:06:28.252188] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T19:06:28.487776] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T19:06:28.816101] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-24T19:06:29.286397] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T19:06:29.616085] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-24T19:06:30.202507] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T19:06:30.416086] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-24T19:06:31.199496] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:06:31.216026] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-24T19:06:31.613550] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T19:06:32.016118] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-24T19:06:32.654022] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T19:06:32.816091] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-24T19:06:33.252024] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:06:33.616088] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-24T19:06:34.416177] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-24T19:06:34.677971] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T19:06:35.106042] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:06:35.216094] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-24T19:06:36.016106] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-24T19:06:36.064568] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T19:06:36.713819] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T19:06:36.816043] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-24T19:06:37.287877] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T19:06:37.616167] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-24T19:06:38.328927] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T19:06:38.416054] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-24T19:06:39.216080] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-24T19:06:39.428705] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T19:06:39.437999] [INFO ] [REMOTE ] GOF: Full fetch complete (62241 records). [2025-09-24T19:06:39.438192] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-24T19:06:39.821837] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T19:06:39.876994] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-24T19:06:39.877089] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-24T19:06:39.877992] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-24T19:06:39.878058] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-24T19:06:39.879416] [DEBUG] [LOCAL ] GOF: Trimmed 62241 records to 42829 (keeping 200 days of data) [2025-09-24T19:06:40.064705] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-24T19:06:40.159543] [DEBUG] [LOCAL ] GOF: Primary data saved (42829 records). [2025-09-24T19:06:40.159738] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-24T19:06:40.159890] [INFO ] [MAIN ] Update Progress: 955/2373 symbols completed. GOF took 34.3s. Estimated remaining: 3h 7m 59s. Rate: 7.5 symbols/min [2025-09-24T19:06:40.333952] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:40.385982] [DEBUG] [LOCAL ] GPC: Loaded 46703 existing records from primary storage. [2025-09-24T19:06:40.386155] [INFO ] [MAIN ] GPC: Loaded 46703 existing records. [2025-09-24T19:06:40.592350] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:06:40.592906] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-24T19:06:40.592966] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-24T19:06:40.594235] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-24T19:06:40.594297] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-24T19:06:40.824732] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-24T19:06:40.916143] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T19:06:41.002252] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:41.616090] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-24T19:06:41.651303] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T19:06:42.317138] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T19:06:42.416078] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-24T19:06:42.739073] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T19:06:43.216096] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-24T19:06:44.016101] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-24T19:06:44.136348] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:06:44.502697] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T19:06:44.816119] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-24T19:06:45.175137] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T19:06:45.616118] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-24T19:06:46.416073] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-24T19:06:46.544619] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T19:06:46.988605] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T19:06:47.216088] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-24T19:06:48.016093] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-24T19:06:48.069151] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:06:48.319829] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T19:06:48.816094] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-24T19:06:49.616131] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-24T19:06:49.901819] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T19:06:49.911786] [INFO ] [REMOTE ] GOTU: Full fetch complete (59795 records). [2025-09-24T19:06:49.911923] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-24T19:06:50.299430] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-24T19:06:50.299616] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-24T19:06:50.300498] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-24T19:06:50.300610] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-24T19:06:50.301923] [DEBUG] [LOCAL ] GOTU: Trimmed 59795 records to 38964 (keeping 200 days of data) [2025-09-24T19:06:50.417706] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-24T19:06:50.545901] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:06:50.580839] [DEBUG] [LOCAL ] GOTU: Primary data saved (38964 records). [2025-09-24T19:06:50.582207] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T19:06:50.581546] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-24T19:06:50.588929] [INFO ] [MAIN ] Update Progress: 956/2373 symbols completed. GOTU took 24.5s. Estimated remaining: 3h 7m 55s. Rate: 7.5 symbols/min [2025-09-24T19:06:50.768608] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:06:50.768849] [DEBUG] [LOCAL ] GPI: No existing data file found in primary storage. [2025-09-24T19:06:50.768905] [WARN ] [MAIN ] GPI: No existing data found, performing full refresh instead. [2025-09-24T19:06:50.769065] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-24T19:06:50.769109] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-24T19:06:50.769152] [DEBUG] [LOCAL ] GPI: No primary data file found to delete. [2025-09-24T19:06:50.769184] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-24T19:06:51.137497] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:06:51.216064] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-24T19:06:52.016076] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-24T19:06:52.252957] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T19:06:52.381176] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T19:06:52.816087] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-24T19:06:53.572736] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T19:06:53.616106] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-24T19:06:54.416099] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-24T19:06:54.455876] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T19:06:54.464437] [INFO ] [REMOTE ] GOOS: Full fetch complete (65905 records). [2025-09-24T19:06:54.464880] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-24T19:06:54.887907] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-24T19:06:54.888022] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-24T19:06:54.889358] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-24T19:06:54.889433] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-24T19:06:54.891355] [DEBUG] [LOCAL ] GOOS: Trimmed 65905 records to 45448 (keeping 200 days of data) [2025-09-24T19:06:55.159980] [DEBUG] [LOCAL ] GOOS: Primary data saved (45448 records). [2025-09-24T19:06:55.160221] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-24T19:06:55.160338] [INFO ] [MAIN ] Update Progress: 957/2373 symbols completed. GOOS took 30.2s. Estimated remaining: 3h 7m 42s. Rate: 7.5 symbols/min [2025-09-24T19:06:55.216104] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-24T19:06:55.405616] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T19:06:55.417801] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:06:56.016181] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-24T19:06:56.199857] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T19:06:56.205250] [INFO ] [REMOTE ] GOLF: Full fetch complete (44892 records). [2025-09-24T19:06:56.205396] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-24T19:06:56.594702] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-24T19:06:56.594988] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-24T19:06:56.595710] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-24T19:06:56.595772] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-24T19:06:56.596757] [DEBUG] [LOCAL ] GOLF: Trimmed 44892 records to 31640 (keeping 200 days of data) [2025-09-24T19:06:56.794057] [DEBUG] [LOCAL ] GOLF: Primary data saved (31640 records). [2025-09-24T19:06:56.794197] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-24T19:06:56.794299] [INFO ] [MAIN ] Update Progress: 958/2373 symbols completed. GOLF took 34.0s. Estimated remaining: 3h 7m 25s. Rate: 7.6 symbols/min [2025-09-24T19:06:56.816135] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-24T19:06:57.809800] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T19:06:57.820703] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-24T19:06:57.830380] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T19:06:58.416163] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-24T19:06:59.080496] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T19:06:59.216082] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-24T19:06:59.800550] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T19:07:00.016095] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-24T19:07:01.357732] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T19:07:01.362284] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-24T19:07:01.865482] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-24T19:07:01.880118] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-24T19:07:02.072260] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T19:07:02.416158] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-24T19:07:03.348148] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T19:07:03.352153] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-24T19:07:03.655489] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:07:04.016114] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-24T19:07:04.338883] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T19:07:04.816094] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-24T19:07:05.641349] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:07:05.651160] [INFO ] [REMOTE ] GPC: Full fetch complete (69171 records). [2025-09-24T19:07:05.651404] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-24T19:07:05.842326] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T19:07:05.874897] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-24T19:07:06.147127] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-24T19:07:06.147227] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-24T19:07:06.148188] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-24T19:07:06.148260] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-24T19:07:06.149806] [DEBUG] [LOCAL ] GPC: Trimmed 69171 records to 46651 (keeping 200 days of data) [2025-09-24T19:07:06.450110] [DEBUG] [LOCAL ] GPC: Primary data saved (46651 records). [2025-09-24T19:07:06.450256] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-24T19:07:06.450341] [INFO ] [MAIN ] Update Progress: 959/2373 symbols completed. GPC took 26.3s. Estimated remaining: 3h 7m 19s. Rate: 7.5 symbols/min [2025-09-24T19:07:06.858998] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T19:07:06.863823] [INFO ] [REMOTE ] GPI: Full fetch complete (20822 records). [2025-09-24T19:07:06.864013] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-24T19:07:07.427568] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-24T19:07:07.427766] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-24T19:07:07.428997] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-24T19:07:07.429088] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-24T19:07:07.430310] [DEBUG] [LOCAL ] GPI: Trimmed 20822 records to 14850 (keeping 200 days of data) [2025-09-24T19:07:07.563921] [DEBUG] [LOCAL ] GPI: Primary data saved (14850 records). [2025-09-24T19:07:07.564128] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-24T19:07:07.564233] [INFO ] [MAIN ] Update Progress: 960/2373 symbols completed. GPI took 17.0s. Estimated remaining: 3h 7m 1s. Rate: 7.6 symbols/min [2025-09-24T19:07:08.295260] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:08.447477] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:08.454941] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:08.478695] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:08.488952] [DEBUG] [LOCAL ] GPJA: Loaded 4086 existing records from primary storage. [2025-09-24T19:07:08.489328] [INFO ] [MAIN ] GPJA: Loaded 4086 existing records. [2025-09-24T19:07:08.685771] [DEBUG] [LOCAL ] GPMT: Loaded 26759 existing records from primary storage. [2025-09-24T19:07:08.700811] [INFO ] [MAIN ] GPMT: Loaded 26759 existing records. [2025-09-24T19:07:08.770932] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:08.836519] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-24T19:07:08.868688] [DEBUG] [LOCAL ] GPK: Loaded 52678 existing records from primary storage. [2025-09-24T19:07:08.857483] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-24T19:07:08.874638] [INFO ] [MAIN ] GPK: Loaded 52678 existing records. [2025-09-24T19:07:08.941338] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-24T19:07:08.951974] [DEBUG] [LOCAL ] GPN: Loaded 52113 existing records from primary storage. [2025-09-24T19:07:08.962863] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-24T19:07:08.998611] [INFO ] [MAIN ] GPN: Loaded 52113 existing records. [2025-09-24T19:07:09.195283] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:09.288228] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-24T19:07:09.380166] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-24T19:07:09.434020] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:09.456059] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-24T19:07:09.445665] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-24T19:07:09.498798] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-24T19:07:09.498713] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-24T19:07:09.519458] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-24T19:07:09.525243] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-24T19:07:09.945838] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:09.966496] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-24T19:07:09.966708] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-24T19:07:09.984207] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-24T19:07:10.004969] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-24T19:07:10.189440] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:10.237514] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-24T19:07:10.898437] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:10.931014] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-24T19:07:10.970326] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:10.982491] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-24T19:07:11.062844] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:11.063398] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-24T19:07:11.080258] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:07:11.082372] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-24T19:07:12.062180] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:07:12.065758] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-24T19:07:12.175375] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T19:07:12.181629] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-24T19:07:12.604550] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T19:07:12.606721] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-24T19:07:12.708340] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T19:07:12.816074] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-24T19:07:12.881015] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T19:07:13.161632] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:07:13.188312] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T19:07:13.616141] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-24T19:07:14.416128] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-24T19:07:14.510064] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T19:07:14.556850] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T19:07:15.216120] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-24T19:07:15.903034] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T19:07:16.016075] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-24T19:07:16.801732] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:07:16.816036] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-24T19:07:17.253527] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:07:17.616104] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-24T19:07:18.416065] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-24T19:07:18.485822] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T19:07:18.513989] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T19:07:19.020212] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T19:07:19.216101] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-24T19:07:20.016083] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-24T19:07:20.811927] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T19:07:20.818879] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-24T19:07:21.596101] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T19:07:21.616046] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-24T19:07:22.416053] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-24T19:07:22.753475] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T19:07:22.892920] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T19:07:22.948671] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T19:07:23.216118] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-24T19:07:24.016083] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-24T19:07:24.519047] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T19:07:24.816131] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-24T19:07:25.616110] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-24T19:07:25.771877] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T19:07:26.139061] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T19:07:26.416098] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-24T19:07:27.216064] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-24T19:07:27.467785] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T19:07:27.562826] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T19:07:27.833549] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T19:07:28.016077] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-24T19:07:28.816146] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-24T19:07:29.599079] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T19:07:29.616037] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-24T19:07:29.762412] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T19:07:30.416082] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-24T19:07:31.216116] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-24T19:07:31.348877] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:07:31.388222] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T19:07:31.577534] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-24T19:07:32.016124] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-24T19:07:32.816137] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-24T19:07:33.554343] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T19:07:33.616118] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-24T19:07:33.908289] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T19:07:33.917723] [INFO ] [REMOTE ] GPN: Full fetch complete (74790 records). [2025-09-24T19:07:33.917899] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-24T19:07:34.327131] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-24T19:07:34.327230] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-24T19:07:34.328364] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-24T19:07:34.328434] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-24T19:07:34.329995] [DEBUG] [LOCAL ] GPN: Trimmed 74790 records to 52089 (keeping 200 days of data) [2025-09-24T19:07:34.420621] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-24T19:07:34.654953] [DEBUG] [LOCAL ] GPN: Primary data saved (52089 records). [2025-09-24T19:07:34.655097] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-24T19:07:34.655197] [INFO ] [MAIN ] Update Progress: 961/2373 symbols completed. GPN took 27.1s. Estimated remaining: 3h 7m 22s. Rate: 7.5 symbols/min [2025-09-24T19:07:34.839167] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:34.866204] [DEBUG] [LOCAL ] GPOR: Loaded 22959 existing records from primary storage. [2025-09-24T19:07:34.866410] [INFO ] [MAIN ] GPOR: Loaded 22959 existing records. [2025-09-24T19:07:35.055120] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:35.055444] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-24T19:07:35.055502] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-24T19:07:35.056270] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-24T19:07:35.059780] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-24T19:07:35.220291] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-24T19:07:35.428436] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:35.458778] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T19:07:35.614666] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T19:07:35.618592] [INFO ] [REMOTE ] GPMT: Full fetch complete (37754 records). [2025-09-24T19:07:35.618810] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-24T19:07:36.021552] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T19:07:36.020984] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-24T19:07:36.021334] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-24T19:07:36.022012] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-24T19:07:36.023135] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-24T19:07:36.025879] [INFO ] [REMOTE ] GPJA: Full fetch complete (7282 records). [2025-09-24T19:07:36.026006] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-24T19:07:36.026118] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-24T19:07:36.135667] [DEBUG] [LOCAL ] GPMT: Trimmed 37754 records to 26624 (keeping 200 days of data) [2025-09-24T19:07:36.538924] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-24T19:07:36.540798] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-24T19:07:36.545959] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-24T19:07:36.546102] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-24T19:07:36.546812] [DEBUG] [LOCAL ] GPJA: Trimmed 7282 records to 4086 (keeping 200 days of data) [2025-09-24T19:07:36.604485] [DEBUG] [LOCAL ] GPJA: Primary data saved (4086 records). [2025-09-24T19:07:36.605407] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-24T19:07:36.606235] [INFO ] [MAIN ] Update Progress: 962/2373 symbols completed. GPJA took 29.0s. Estimated remaining: 3h 7m 5s. Rate: 7.5 symbols/min [2025-09-24T19:07:36.790494] [DEBUG] [LOCAL ] GPMT: Primary data saved (26624 records). [2025-09-24T19:07:36.792188] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:36.792505] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-24T19:07:36.793109] [INFO ] [MAIN ] Update Progress: 963/2373 symbols completed. GPMT took 29.2s. Estimated remaining: 3h 6m 45s. Rate: 7.5 symbols/min [2025-09-24T19:07:36.828168] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-24T19:07:37.000896] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:37.016933] [DEBUG] [LOCAL ] GPRK: Loaded 39112 existing records from primary storage. [2025-09-24T19:07:37.017135] [INFO ] [MAIN ] GPRK: Loaded 39112 existing records. [2025-09-24T19:07:37.244231] [DEBUG] [LOCAL ] GRBK: Loaded 27075 existing records from primary storage. [2025-09-24T19:07:37.244349] [INFO ] [MAIN ] GRBK: Loaded 27075 existing records. [2025-09-24T19:07:37.243319] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:37.256791] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-24T19:07:37.280105] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-24T19:07:37.340837] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-24T19:07:37.359403] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-24T19:07:37.562418] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:37.580558] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T19:07:37.591633] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-24T19:07:37.597222] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-24T19:07:37.613572] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-24T19:07:37.634866] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-24T19:07:37.640056] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-24T19:07:38.099183] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:38.244566] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:38.416105] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-24T19:07:38.572891] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T19:07:39.058737] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:07:39.216094] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-24T19:07:39.889498] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:07:40.016049] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-24T19:07:40.816102] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-24T19:07:40.966779] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T19:07:41.554226] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T19:07:41.616047] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-24T19:07:42.183399] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T19:07:42.416110] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-24T19:07:43.085128] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T19:07:43.216122] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-24T19:07:44.016082] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-24T19:07:44.257593] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T19:07:44.269790] [INFO ] [REMOTE ] GPK: Full fetch complete (75433 records). [2025-09-24T19:07:44.269969] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-24T19:07:44.694784] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-24T19:07:44.695487] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-24T19:07:44.696741] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-24T19:07:44.698000] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T19:07:44.704296] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-24T19:07:44.706489] [DEBUG] [LOCAL ] GPK: Trimmed 75433 records to 52671 (keeping 200 days of data) [2025-09-24T19:07:44.816476] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-24T19:07:44.958855] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T19:07:45.057686] [DEBUG] [LOCAL ] GPK: Primary data saved (52671 records). [2025-09-24T19:07:45.057841] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-24T19:07:45.057956] [INFO ] [MAIN ] Update Progress: 964/2373 symbols completed. GPK took 37.5s. Estimated remaining: 3h 6m 38s. Rate: 7.5 symbols/min [2025-09-24T19:07:45.249112] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:07:45.262192] [DEBUG] [LOCAL ] GRC: Loaded 8886 existing records from primary storage. [2025-09-24T19:07:45.262317] [INFO ] [MAIN ] GRC: Loaded 8886 existing records. [2025-09-24T19:07:45.449519] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:07:45.449835] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-24T19:07:45.449893] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-24T19:07:45.450381] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-24T19:07:45.450442] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-24T19:07:45.624904] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-24T19:07:45.811408] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:07:46.294958] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:07:46.416087] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-24T19:07:46.995254] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T19:07:47.216121] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-24T19:07:47.236032] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-24T19:07:48.016117] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-24T19:07:48.745944] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T19:07:48.789693] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T19:07:48.816043] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-24T19:07:49.616138] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-24T19:07:50.291803] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T19:07:50.317686] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T19:07:50.416035] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-24T19:07:51.216116] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-24T19:07:51.661033] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T19:07:52.016111] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-24T19:07:52.344726] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T19:07:52.761944] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T19:07:52.816027] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-24T19:07:53.606685] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T19:07:53.616043] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-24T19:07:54.416191] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-24T19:07:54.902331] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T19:07:55.197311] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T19:07:55.216027] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-24T19:07:55.761165] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T19:07:56.016103] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-24T19:07:56.816125] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-24T19:07:57.404519] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T19:07:57.616057] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-24T19:07:57.668415] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T19:07:58.416060] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-24T19:07:58.663442] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T19:07:59.178471] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T19:07:59.216105] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-24T19:08:00.016164] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-24T19:08:00.069563] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T19:08:00.074581] [INFO ] [REMOTE ] GRC: Full fetch complete (13069 records). [2025-09-24T19:08:00.074979] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-24T19:08:00.628491] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-24T19:08:00.628608] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-24T19:08:00.629215] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-24T19:08:00.629325] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-24T19:08:00.631064] [DEBUG] [LOCAL ] GRC: Trimmed 13069 records to 8920 (keeping 200 days of data) [2025-09-24T19:08:00.726954] [DEBUG] [LOCAL ] GRC: Primary data saved (8920 records). [2025-09-24T19:08:00.727287] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-24T19:08:00.727628] [INFO ] [MAIN ] Update Progress: 965/2373 symbols completed. GRC took 15.7s. Estimated remaining: 3h 6m 41s. Rate: 7.5 symbols/min [2025-09-24T19:08:00.821393] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-24T19:08:01.011409] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:01.040936] [DEBUG] [LOCAL ] GRDN: Loaded 19693 existing records from primary storage. [2025-09-24T19:08:01.041087] [INFO ] [MAIN ] GRDN: Loaded 19693 existing records. [2025-09-24T19:08:01.244840] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:01.245425] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-24T19:08:01.245570] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-24T19:08:01.246442] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-24T19:08:01.246592] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-24T19:08:01.395612] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:08:01.623552] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-24T19:08:01.671945] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:02.377468] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T19:08:02.416098] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-24T19:08:02.768902] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T19:08:03.216054] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-24T19:08:03.238710] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-24T19:08:04.016087] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-24T19:08:04.816086] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-24T19:08:04.848028] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:08:04.855507] [INFO ] [REMOTE ] GPRK: Full fetch complete (57194 records). [2025-09-24T19:08:04.855707] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-24T19:08:05.286560] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-24T19:08:05.286866] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-24T19:08:05.289038] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T19:08:05.288252] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-24T19:08:05.294473] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-24T19:08:05.295928] [DEBUG] [LOCAL ] GPRK: Trimmed 57194 records to 39123 (keeping 200 days of data) [2025-09-24T19:08:05.556797] [DEBUG] [LOCAL ] GPRK: Primary data saved (39123 records). [2025-09-24T19:08:05.557127] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-24T19:08:05.557393] [INFO ] [MAIN ] Update Progress: 966/2373 symbols completed. GPRK took 29.0s. Estimated remaining: 3h 6m 29s. Rate: 7.5 symbols/min [2025-09-24T19:08:05.625680] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-24T19:08:05.767116] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:05.822537] [DEBUG] [LOCAL ] GRMN: Loaded 41489 existing records from primary storage. [2025-09-24T19:08:05.822748] [INFO ] [MAIN ] GRMN: Loaded 41489 existing records. [2025-09-24T19:08:06.018743] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:06.019022] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-24T19:08:06.019092] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-24T19:08:06.020669] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-24T19:08:06.020750] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-24T19:08:06.275818] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T19:08:06.419459] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:06.419526] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-24T19:08:06.438119] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T19:08:07.216161] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-24T19:08:07.702164] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T19:08:07.854862] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T19:08:08.016145] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-24T19:08:08.816086] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-24T19:08:08.932490] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T19:08:09.616152] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-24T19:08:10.033685] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T19:08:10.416203] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-24T19:08:10.910076] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T19:08:11.216158] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-24T19:08:11.415384] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T19:08:12.016078] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-24T19:08:12.402239] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T19:08:12.816120] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-24T19:08:13.082341] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T19:08:13.616113] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-24T19:08:14.118521] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T19:08:14.416065] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-24T19:08:14.722520] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T19:08:15.216087] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-24T19:08:15.801254] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T19:08:15.807175] [INFO ] [REMOTE ] GPOR: Full fetch complete (34927 records). [2025-09-24T19:08:15.807344] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-24T19:08:16.021263] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-24T19:08:16.147410] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T19:08:16.238676] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-24T19:08:16.238803] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-24T19:08:16.239816] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-24T19:08:16.239928] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-24T19:08:16.241257] [DEBUG] [LOCAL ] GPOR: Trimmed 34927 records to 22883 (keeping 200 days of data) [2025-09-24T19:08:16.399874] [DEBUG] [LOCAL ] GPOR: Primary data saved (22883 records). [2025-09-24T19:08:16.400080] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-24T19:08:16.400257] [INFO ] [MAIN ] Update Progress: 967/2373 symbols completed. GPOR took 41.7s. Estimated remaining: 3h 6m 25s. Rate: 7.5 symbols/min [2025-09-24T19:08:16.588443] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:16.649044] [DEBUG] [LOCAL ] GRND: Loaded 50047 existing records from primary storage. [2025-09-24T19:08:16.649196] [INFO ] [MAIN ] GRND: Loaded 50047 existing records. [2025-09-24T19:08:16.821945] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-24T19:08:16.836434] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:16.837471] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-24T19:08:16.837525] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-24T19:08:16.839210] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-24T19:08:16.839277] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-24T19:08:17.212880] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:17.373849] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:08:17.616136] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-24T19:08:17.766426] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T19:08:18.416126] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-24T19:08:19.143557] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T19:08:19.216095] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-24T19:08:19.746558] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T19:08:20.016078] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-24T19:08:20.596209] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T19:08:20.816122] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-24T19:08:21.616124] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-24T19:08:21.826016] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T19:08:21.859567] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T19:08:22.416119] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-24T19:08:22.918820] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T19:08:23.216162] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-24T19:08:23.781748] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T19:08:23.787429] [INFO ] [REMOTE ] GRDN: Full fetch complete (25962 records). [2025-09-24T19:08:23.787533] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-24T19:08:24.022754] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-24T19:08:24.196752] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-24T19:08:24.196898] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-24T19:08:24.198036] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-24T19:08:24.198121] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-24T19:08:24.199684] [DEBUG] [LOCAL ] GRDN: Trimmed 25962 records to 19770 (keeping 200 days of data) [2025-09-24T19:08:24.346338] [DEBUG] [LOCAL ] GRDN: Primary data saved (19770 records). [2025-09-24T19:08:24.346572] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-24T19:08:24.346738] [INFO ] [MAIN ] Update Progress: 968/2373 symbols completed. GRDN took 23.6s. Estimated remaining: 3h 6m 17s. Rate: 7.5 symbols/min [2025-09-24T19:08:24.544819] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:24.591728] [DEBUG] [LOCAL ] GRNT: Loaded 33785 existing records from primary storage. [2025-09-24T19:08:24.591924] [INFO ] [MAIN ] GRNT: Loaded 33785 existing records. [2025-09-24T19:08:24.778435] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:24.778795] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-24T19:08:24.778903] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-24T19:08:24.780359] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-24T19:08:24.780458] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-24T19:08:24.824744] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-24T19:08:25.166455] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:25.199691] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T19:08:25.232475] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T19:08:25.246927] [INFO ] [REMOTE ] GRBK: Full fetch complete (40637 records). [2025-09-24T19:08:25.248164] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-24T19:08:25.628705] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-24T19:08:25.661236] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-24T19:08:25.661349] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-24T19:08:25.662394] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-24T19:08:25.662489] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-24T19:08:25.665288] [DEBUG] [LOCAL ] GRBK: Trimmed 40637 records to 26986 (keeping 200 days of data) [2025-09-24T19:08:25.878416] [DEBUG] [LOCAL ] GRBK: Primary data saved (26986 records). [2025-09-24T19:08:25.878819] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-24T19:08:25.878998] [INFO ] [MAIN ] Update Progress: 969/2373 symbols completed. GRBK took 49.1s. Estimated remaining: 3h 5m 60s. Rate: 7.5 symbols/min [2025-09-24T19:08:26.064391] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:26.079483] [DEBUG] [LOCAL ] GROV: Loaded 9074 existing records from primary storage. [2025-09-24T19:08:26.079721] [INFO ] [MAIN ] GROV: Loaded 9074 existing records. [2025-09-24T19:08:26.278262] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:26.278635] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-24T19:08:26.278729] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-24T19:08:26.279621] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-24T19:08:26.279759] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-24T19:08:26.417187] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-24T19:08:26.681949] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:26.712285] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T19:08:27.216126] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-24T19:08:27.290673] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T19:08:27.983051] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T19:08:28.004510] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T19:08:28.016046] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-24T19:08:28.816093] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-24T19:08:28.835466] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T19:08:29.616117] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-24T19:08:30.117773] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T19:08:30.416089] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-24T19:08:31.199748] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T19:08:31.216040] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-24T19:08:31.880604] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T19:08:32.016126] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-24T19:08:32.596925] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:08:32.816121] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-24T19:08:33.597349] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:08:33.616028] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-24T19:08:33.992481] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T19:08:34.416085] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-24T19:08:35.019033] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T19:08:35.216087] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-24T19:08:36.021170] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-24T19:08:36.038068] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:08:36.309701] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T19:08:36.816095] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-24T19:08:36.863856] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T19:08:37.616118] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-24T19:08:38.297382] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T19:08:38.379609] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T19:08:38.416037] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-24T19:08:39.216124] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-24T19:08:40.016161] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-24T19:08:40.048384] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:08:40.055351] [INFO ] [REMOTE ] GRMN: Full fetch complete (60180 records). [2025-09-24T19:08:40.055468] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-24T19:08:40.458301] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-24T19:08:40.458533] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-24T19:08:40.459409] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-24T19:08:40.459474] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-24T19:08:40.461092] [DEBUG] [LOCAL ] GRMN: Trimmed 60180 records to 41352 (keeping 200 days of data) [2025-09-24T19:08:40.567761] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T19:08:40.724699] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:08:40.773349] [DEBUG] [LOCAL ] GRMN: Primary data saved (41352 records). [2025-09-24T19:08:40.773477] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-24T19:08:40.773556] [INFO ] [MAIN ] Update Progress: 970/2373 symbols completed. GRMN took 35.2s. Estimated remaining: 3h 6m 2s. Rate: 7.5 symbols/min [2025-09-24T19:08:40.821230] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-24T19:08:40.945208] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:40.951661] [DEBUG] [LOCAL ] GRX: Loaded 4444 existing records from primary storage. [2025-09-24T19:08:40.951794] [INFO ] [MAIN ] GRX: Loaded 4444 existing records. [2025-09-24T19:08:41.131882] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:41.132144] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-24T19:08:41.132192] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-24T19:08:41.132504] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-24T19:08:41.132563] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-24T19:08:41.485711] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:41.616050] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-24T19:08:42.081420] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T19:08:42.335607] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T19:08:42.416058] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-24T19:08:43.216099] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-24T19:08:44.016059] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-24T19:08:44.059940] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T19:08:44.150580] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:08:44.816123] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-24T19:08:45.376143] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:08:45.388677] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T19:08:45.616105] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-24T19:08:46.416085] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-24T19:08:47.216120] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-24T19:08:47.496637] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:08:47.505784] [INFO ] [REMOTE ] GRND: Full fetch complete (70247 records). [2025-09-24T19:08:47.505919] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-24T19:08:47.857788] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T19:08:47.967693] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T19:08:47.998773] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-24T19:08:47.999300] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-24T19:08:48.000573] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-24T19:08:48.000672] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-24T19:08:48.002249] [DEBUG] [LOCAL ] GRND: Trimmed 70247 records to 49997 (keeping 200 days of data) [2025-09-24T19:08:48.057315] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-24T19:08:48.316966] [DEBUG] [LOCAL ] GRND: Primary data saved (49997 records). [2025-09-24T19:08:48.317126] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-24T19:08:48.317239] [INFO ] [MAIN ] Update Progress: 971/2373 symbols completed. GRND took 31.9s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-24T19:08:48.510782] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:48.566126] [DEBUG] [LOCAL ] GS: Loaded 52068 existing records from primary storage. [2025-09-24T19:08:48.566291] [INFO ] [MAIN ] GS: Loaded 52068 existing records. [2025-09-24T19:08:48.777970] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:48.778253] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-24T19:08:48.778305] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-24T19:08:48.779754] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-24T19:08:48.779819] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-24T19:08:48.821265] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-24T19:08:49.172575] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:49.421413] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T19:08:49.545962] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T19:08:49.616080] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-24T19:08:50.237588] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T19:08:50.416083] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-24T19:08:50.983348] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T19:08:51.216089] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-24T19:08:51.778991] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T19:08:52.016162] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-24T19:08:52.816166] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-24T19:08:53.002861] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T19:08:53.616100] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-24T19:08:54.420721] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-24T19:08:54.422710] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T19:08:54.760349] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T19:08:54.990536] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T19:08:55.216097] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-24T19:08:55.933586] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T19:08:55.935044] [INFO ] [REMOTE ] GROV: Full fetch complete (14577 records). [2025-09-24T19:08:55.935122] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-24T19:08:56.021395] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-24T19:08:56.320739] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-24T19:08:56.320867] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-24T19:08:56.321203] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-24T19:08:56.321243] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-24T19:08:56.321741] [DEBUG] [LOCAL ] GROV: Trimmed 14577 records to 9051 (keeping 200 days of data) [2025-09-24T19:08:56.381919] [DEBUG] [LOCAL ] GROV: Primary data saved (9051 records). [2025-09-24T19:08:56.382102] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-24T19:08:56.382213] [INFO ] [MAIN ] Update Progress: 972/2373 symbols completed. GROV took 30.5s. Estimated remaining: 3h 5m 46s. Rate: 7.5 symbols/min [2025-09-24T19:08:56.584759] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:56.629542] [DEBUG] [LOCAL ] GSBD: Loaded 39136 existing records from primary storage. [2025-09-24T19:08:56.629765] [INFO ] [MAIN ] GSBD: Loaded 39136 existing records. [2025-09-24T19:08:56.810569] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:56.810833] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-24T19:08:56.810883] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-24T19:08:56.812129] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-24T19:08:56.812190] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-24T19:08:56.823428] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-24T19:08:57.183307] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:57.217780] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T19:08:57.223976] [INFO ] [REMOTE ] GRNT: Full fetch complete (48504 records). [2025-09-24T19:08:57.224073] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-24T19:08:57.554764] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:08:57.624766] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-24T19:08:57.628067] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-24T19:08:57.628445] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-24T19:08:57.630101] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-24T19:08:57.630281] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-24T19:08:57.631704] [DEBUG] [LOCAL ] GRNT: Trimmed 48504 records to 33695 (keeping 200 days of data) [2025-09-24T19:08:57.829400] [DEBUG] [LOCAL ] GRNT: Primary data saved (33695 records). [2025-09-24T19:08:57.829549] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-24T19:08:57.829640] [INFO ] [MAIN ] Update Progress: 973/2373 symbols completed. GRNT took 33.5s. Estimated remaining: 3h 5m 28s. Rate: 7.5 symbols/min [2025-09-24T19:08:58.016696] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:08:58.067378] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-09-24T19:08:58.067529] [INFO ] [MAIN ] GSK: Loaded 53493 existing records. [2025-09-24T19:08:58.244010] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:08:58.244250] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-24T19:08:58.244298] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-24T19:08:58.246154] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-24T19:08:58.246216] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-24T19:08:58.427413] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-24T19:08:58.607178] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:08:59.114123] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T19:08:59.221221] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-24T19:08:59.239964] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T19:09:00.016094] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-24T19:09:00.816148] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-24T19:09:01.616168] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-24T19:09:02.027029] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T19:09:02.169519] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-24T19:09:02.416143] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-24T19:09:03.216217] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-24T19:09:03.347406] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T19:09:03.350030] [INFO ] [REMOTE ] GRX: Full fetch complete (6436 records). [2025-09-24T19:09:03.350179] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-24T19:09:03.789927] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-24T19:09:03.790074] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-24T19:09:03.790367] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-24T19:09:03.790444] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-24T19:09:03.819971] [DEBUG] [LOCAL ] GRX: Trimmed 6436 records to 4477 (keeping 200 days of data) [2025-09-24T19:09:03.826198] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-24T19:09:03.864215] [DEBUG] [LOCAL ] GRX: Primary data saved (4477 records). [2025-09-24T19:09:03.864322] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-24T19:09:03.864404] [INFO ] [MAIN ] Update Progress: 974/2373 symbols completed. GRX took 23.1s. Estimated remaining: 3h 5m 18s. Rate: 7.6 symbols/min [2025-09-24T19:09:04.018087] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-24T19:09:04.038592] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:04.073335] [DEBUG] [LOCAL ] GSL: Loaded 33536 existing records from primary storage. [2025-09-24T19:09:04.073494] [INFO ] [MAIN ] GSL: Loaded 33536 existing records. [2025-09-24T19:09:04.264173] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:04.264462] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-24T19:09:04.264530] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-24T19:09:04.265936] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-24T19:09:04.266002] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-24T19:09:04.637615] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:04.816052] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-24T19:09:04.914355] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T19:09:05.192629] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-24T19:09:05.616067] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-24T19:09:05.728186] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T19:09:05.779320] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T19:09:06.416090] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-24T19:09:07.216085] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-24T19:09:07.662346] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T19:09:07.859922] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-24T19:09:08.016081] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-24T19:09:08.780706] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T19:09:08.816068] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-24T19:09:09.616180] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-24T19:09:10.416117] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-24T19:09:10.491621] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T19:09:10.725356] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T19:09:10.875400] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T19:09:11.216119] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-24T19:09:11.431809] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T19:09:12.016109] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-24T19:09:12.816083] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-24T19:09:13.195615] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T19:09:13.444457] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T19:09:13.616098] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-24T19:09:14.416113] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-24T19:09:14.937387] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-24T19:09:15.138445] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:09:15.216095] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-24T19:09:16.016121] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-24T19:09:16.230272] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T19:09:16.765469] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:09:16.816061] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-24T19:09:17.616093] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-24T19:09:18.416128] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-24T19:09:18.554668] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-24T19:09:19.216173] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-24T19:09:19.398955] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-24T19:09:19.691609] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-24T19:09:20.016049] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-24T19:09:20.488013] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-24T19:09:20.729364] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:09:20.816042] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-24T19:09:21.616096] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-24T19:09:22.052795] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T19:09:22.115454] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T19:09:22.416087] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-24T19:09:23.216085] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-24T19:09:23.859515] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T19:09:23.922105] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-24T19:09:24.016060] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-24T19:09:24.435219] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T19:09:24.816133] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-24T19:09:25.616118] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-24T19:09:26.048982] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T19:09:26.092961] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T19:09:26.416160] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-24T19:09:27.084761] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T19:09:27.095191] [INFO ] [REMOTE ] GSBD: Full fetch complete (58399 records). [2025-09-24T19:09:27.095372] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-24T19:09:27.221259] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-24T19:09:27.493672] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-24T19:09:27.493811] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-24T19:09:27.494708] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-24T19:09:27.494809] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-24T19:09:27.498081] [DEBUG] [LOCAL ] GSBD: Trimmed 58399 records to 39133 (keeping 200 days of data) [2025-09-24T19:09:27.614950] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T19:09:27.780311] [DEBUG] [LOCAL ] GSBD: Primary data saved (39133 records). [2025-09-24T19:09:27.780474] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-24T19:09:27.780583] [INFO ] [MAIN ] Update Progress: 975/2373 symbols completed. GSBD took 31.4s. Estimated remaining: 3h 5m 33s. Rate: 7.5 symbols/min [2025-09-24T19:09:27.963390] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:28.013196] [DEBUG] [LOCAL ] GTES: Loaded 50681 existing records from primary storage. [2025-09-24T19:09:28.013357] [INFO ] [MAIN ] GTES: Loaded 50681 existing records. [2025-09-24T19:09:28.024717] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-24T19:09:28.204065] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:28.204340] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-24T19:09:28.204390] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-24T19:09:28.205621] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-24T19:09:28.205709] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-24T19:09:28.573703] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:28.797841] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T19:09:28.816030] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-24T19:09:29.616065] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-24T19:09:29.693746] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T19:09:29.699747] [INFO ] [REMOTE ] GSL: Full fetch complete (47937 records). [2025-09-24T19:09:29.699861] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-24T19:09:30.097139] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-24T19:09:30.097253] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-24T19:09:30.098048] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-24T19:09:30.098157] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-24T19:09:30.099279] [DEBUG] [LOCAL ] GSL: Trimmed 47937 records to 33432 (keeping 200 days of data) [2025-09-24T19:09:30.306884] [DEBUG] [LOCAL ] GSL: Primary data saved (33432 records). [2025-09-24T19:09:30.307049] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-24T19:09:30.307153] [INFO ] [MAIN ] Update Progress: 976/2373 symbols completed. GSL took 26.4s. Estimated remaining: 3h 5m 17s. Rate: 7.5 symbols/min [2025-09-24T19:09:30.421233] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-24T19:09:30.478597] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:30.520268] [DEBUG] [LOCAL ] GTLS: Loaded 42996 existing records from primary storage. [2025-09-24T19:09:30.520425] [INFO ] [MAIN ] GTLS: Loaded 42996 existing records. [2025-09-24T19:09:30.703910] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:30.704210] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-24T19:09:30.704266] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-24T19:09:30.705495] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-24T19:09:30.705559] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-24T19:09:31.074442] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:31.133616] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-24T19:09:31.144527] [INFO ] [REMOTE ] GSK: Full fetch complete (77472 records). [2025-09-24T19:09:31.144876] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-24T19:09:31.221252] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-24T19:09:31.576734] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-24T19:09:31.576838] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-24T19:09:31.578157] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-24T19:09:31.578240] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-24T19:09:31.579985] [DEBUG] [LOCAL ] GSK: Trimmed 77472 records to 53493 (keeping 200 days of data) [2025-09-24T19:09:31.955896] [DEBUG] [LOCAL ] GSK: Primary data saved (53493 records). [2025-09-24T19:09:31.957482] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:09:31.967870] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-24T19:09:31.968462] [INFO ] [MAIN ] Update Progress: 977/2373 symbols completed. GSK took 34.1s. Estimated remaining: 3h 4m 60s. Rate: 7.5 symbols/min [2025-09-24T19:09:32.037074] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-24T19:09:32.144331] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:32.187219] [DEBUG] [LOCAL ] GTN: Loaded 45680 existing records from primary storage. [2025-09-24T19:09:32.187394] [INFO ] [MAIN ] GTN: Loaded 45680 existing records. [2025-09-24T19:09:32.384364] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:32.393797] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-24T19:09:32.394693] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-24T19:09:32.394600] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-24T19:09:32.403822] [INFO ] [REMOTE ] GS: Full fetch complete (75818 records). [2025-09-24T19:09:32.403932] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-24T19:09:32.404123] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-24T19:09:32.404270] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-24T19:09:33.166922] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:33.206870] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-24T19:09:33.261769] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-24T19:09:33.262073] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-24T19:09:33.263731] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-24T19:09:33.263955] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-24T19:09:33.290495] [DEBUG] [LOCAL ] GS: Trimmed 75818 records to 52038 (keeping 200 days of data) [2025-09-24T19:09:33.291596] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-24T19:09:33.584287] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:09:33.621940] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-24T19:09:33.700076] [DEBUG] [LOCAL ] GS: Primary data saved (52038 records). [2025-09-24T19:09:33.700239] [INFO ] [MAIN ] GS: Full history saved. [2025-09-24T19:09:33.700333] [INFO ] [MAIN ] Update Progress: 978/2373 symbols completed. GS took 45.4s. Estimated remaining: 3h 4m 43s. Rate: 7.6 symbols/min [2025-09-24T19:09:33.872418] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:33.902555] [DEBUG] [LOCAL ] GTY: Loaded 30403 existing records from primary storage. [2025-09-24T19:09:33.902738] [INFO ] [MAIN ] GTY: Loaded 30403 existing records. [2025-09-24T19:09:34.085264] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:34.085543] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-24T19:09:34.085594] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-24T19:09:34.086363] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-24T19:09:34.086427] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-24T19:09:34.424448] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-24T19:09:34.446628] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:34.836750] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T19:09:35.192095] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T19:09:35.216030] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-24T19:09:35.704325] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T19:09:36.016073] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-24T19:09:36.566718] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T19:09:36.816115] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-24T19:09:36.851358] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:09:37.616139] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-24T19:09:38.291408] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T19:09:38.416116] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-24T19:09:39.158346] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T19:09:39.216034] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-24T19:09:39.238205] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T19:09:40.016083] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-24T19:09:40.415442] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T19:09:40.816160] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-24T19:09:41.616103] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-24T19:09:41.731965] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T19:09:42.135625] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T19:09:42.416082] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-24T19:09:43.169038] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T19:09:43.216043] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-24T19:09:43.413816] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T19:09:44.016124] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-24T19:09:44.828338] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-24T19:09:44.831300] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T19:09:45.269193] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T19:09:45.616086] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-24T19:09:46.416055] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-24T19:09:46.554076] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:09:47.051513] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T19:09:47.216174] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-24T19:09:48.016109] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-24T19:09:48.169116] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T19:09:48.534974] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T19:09:48.816110] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-24T19:09:49.576729] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T19:09:49.616059] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-24T19:09:50.280105] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T19:09:50.416101] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-24T19:09:51.216039] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-24T19:09:51.328050] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T19:09:52.016164] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-24T19:09:52.108504] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T19:09:52.380985] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T19:09:52.816122] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-24T19:09:53.533054] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T19:09:53.616174] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-24T19:09:54.416053] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-24T19:09:54.475087] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T19:09:55.170825] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T19:09:55.216147] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-24T19:09:56.016442] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-24T19:09:56.021691] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T19:09:56.673250] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T19:09:56.684532] [INFO ] [REMOTE ] GTES: Full fetch complete (73976 records). [2025-09-24T19:09:56.684888] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-24T19:09:56.821281] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-24T19:09:57.115131] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-24T19:09:57.115315] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-24T19:09:57.116800] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-24T19:09:57.116876] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-24T19:09:57.124336] [DEBUG] [LOCAL ] GTES: Trimmed 73976 records to 50654 (keeping 200 days of data) [2025-09-24T19:09:57.481308] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T19:09:57.507894] [DEBUG] [LOCAL ] GTES: Primary data saved (50654 records). [2025-09-24T19:09:57.508125] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-24T19:09:57.508295] [INFO ] [MAIN ] Update Progress: 979/2373 symbols completed. GTES took 29.7s. Estimated remaining: 3h 4m 58s. Rate: 7.5 symbols/min [2025-09-24T19:09:57.621276] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-24T19:09:57.693414] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:09:57.708976] [DEBUG] [LOCAL ] GUG: Loaded 12019 existing records from primary storage. [2025-09-24T19:09:57.709189] [INFO ] [MAIN ] GUG: Loaded 12019 existing records. [2025-09-24T19:09:57.913219] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:09:57.913862] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-24T19:09:57.913938] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-24T19:09:57.914634] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-24T19:09:57.914735] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-24T19:09:58.285850] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:09:58.416125] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-24T19:09:58.516085] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T19:09:58.869377] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T19:09:59.216191] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-24T19:09:59.836752] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T19:10:00.016190] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-24T19:10:00.205457] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T19:10:00.211306] [INFO ] [REMOTE ] GTY: Full fetch complete (43236 records). [2025-09-24T19:10:00.211453] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-24T19:10:00.735972] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-24T19:10:00.736103] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-24T19:10:00.737186] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-24T19:10:00.737260] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-24T19:10:00.738857] [DEBUG] [LOCAL ] GTY: Trimmed 43236 records to 30364 (keeping 200 days of data) [2025-09-24T19:10:00.843016] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-24T19:10:00.961378] [DEBUG] [LOCAL ] GTY: Primary data saved (30364 records). [2025-09-24T19:10:00.961682] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-24T19:10:00.961943] [INFO ] [MAIN ] Update Progress: 980/2373 symbols completed. GTY took 27.3s. Estimated remaining: 3h 4m 43s. Rate: 7.5 symbols/min [2025-09-24T19:10:01.155352] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:01.174719] [DEBUG] [LOCAL ] GUT: Loaded 15489 existing records from primary storage. [2025-09-24T19:10:01.174893] [INFO ] [MAIN ] GUT: Loaded 15489 existing records. [2025-09-24T19:10:01.356969] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T19:10:01.402870] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:01.403235] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-24T19:10:01.403292] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-24T19:10:01.404307] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-24T19:10:01.404375] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-24T19:10:01.623066] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-24T19:10:01.834887] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:02.416192] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-24T19:10:02.639212] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T19:10:03.216169] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-24T19:10:03.558943] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T19:10:03.629998] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T19:10:03.645574] [INFO ] [REMOTE ] GTLS: Full fetch complete (61357 records). [2025-09-24T19:10:03.645908] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-24T19:10:04.021278] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-24T19:10:04.208839] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-24T19:10:04.208966] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-24T19:10:04.210075] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-24T19:10:04.210169] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-24T19:10:04.212770] [DEBUG] [LOCAL ] GTLS: Trimmed 61357 records to 42900 (keeping 200 days of data) [2025-09-24T19:10:04.556632] [DEBUG] [LOCAL ] GTLS: Primary data saved (42900 records). [2025-09-24T19:10:04.556936] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-24T19:10:04.557212] [INFO ] [MAIN ] Update Progress: 981/2373 symbols completed. GTLS took 34.2s. Estimated remaining: 3h 4m 29s. Rate: 7.5 symbols/min [2025-09-24T19:10:04.735895] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:04.774356] [DEBUG] [LOCAL ] GVA: Loaded 33873 existing records from primary storage. [2025-09-24T19:10:04.774495] [INFO ] [MAIN ] GVA: Loaded 33873 existing records. [2025-09-24T19:10:04.839040] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-24T19:10:04.961661] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:04.961920] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-24T19:10:04.961970] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-24T19:10:04.962902] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-24T19:10:04.962973] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-24T19:10:05.267756] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T19:10:05.354248] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:05.377301] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T19:10:05.385855] [INFO ] [REMOTE ] GTN: Full fetch complete (66442 records). [2025-09-24T19:10:05.385991] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-24T19:10:05.621273] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-24T19:10:05.770530] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-24T19:10:05.795469] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-24T19:10:05.795842] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-24T19:10:05.796821] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-24T19:10:05.797204] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-24T19:10:05.798411] [DEBUG] [LOCAL ] GTN: Trimmed 66442 records to 45696 (keeping 200 days of data) [2025-09-24T19:10:06.077333] [DEBUG] [LOCAL ] GTN: Primary data saved (45696 records). [2025-09-24T19:10:06.077474] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-24T19:10:06.077561] [INFO ] [MAIN ] Update Progress: 982/2373 symbols completed. GTN took 34.1s. Estimated remaining: 3h 4m 12s. Rate: 7.6 symbols/min [2025-09-24T19:10:06.249385] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:06.266762] [DEBUG] [LOCAL ] GWH: Loaded 15438 existing records from primary storage. [2025-09-24T19:10:06.266898] [INFO ] [MAIN ] GWH: Loaded 15438 existing records. [2025-09-24T19:10:06.422912] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-24T19:10:06.459996] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:06.460313] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-24T19:10:06.460373] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-24T19:10:06.460865] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-24T19:10:06.460929] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-24T19:10:06.822838] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:07.205568] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T19:10:07.220588] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-24T19:10:07.226122] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T19:10:08.016097] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-24T19:10:08.068017] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T19:10:08.816136] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-24T19:10:08.831879] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T19:10:09.465231] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T19:10:09.616094] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-24T19:10:10.416068] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-24T19:10:10.619013] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T19:10:11.216058] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-24T19:10:11.375629] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T19:10:12.016126] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-24T19:10:12.037916] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T19:10:12.816076] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-24T19:10:13.032047] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T19:10:13.249883] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-24T19:10:13.616121] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-24T19:10:14.403782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T19:10:14.416020] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-24T19:10:15.216074] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-24T19:10:15.409283] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T19:10:15.986031] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T19:10:16.016048] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-24T19:10:16.816102] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-24T19:10:16.948572] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T19:10:17.571171] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-24T19:10:17.616089] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-24T19:10:18.418034] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-24T19:10:18.419116] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T19:10:19.216082] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-24T19:10:19.521858] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T19:10:20.016146] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-24T19:10:20.596818] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T19:10:20.816150] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-24T19:10:21.282899] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T19:10:21.616160] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-24T19:10:21.678602] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T19:10:22.416108] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-24T19:10:22.639702] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T19:10:23.216158] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-24T19:10:23.899279] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T19:10:24.016086] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-24T19:10:24.168245] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T19:10:24.816061] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-24T19:10:24.910692] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T19:10:25.616048] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-24T19:10:25.884531] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T19:10:25.887846] [INFO ] [REMOTE ] GWH: Full fetch complete (20755 records). [2025-09-24T19:10:25.887923] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-24T19:10:26.269616] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-24T19:10:26.269767] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-24T19:10:26.270610] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-24T19:10:26.270687] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-24T19:10:26.272157] [DEBUG] [LOCAL ] GWH: Trimmed 20755 records to 15510 (keeping 200 days of data) [2025-09-24T19:10:26.369731] [DEBUG] [LOCAL ] GWH: Primary data saved (15510 records). [2025-09-24T19:10:26.369930] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-24T19:10:26.370064] [INFO ] [MAIN ] Update Progress: 983/2373 symbols completed. GWH took 20.3s. Estimated remaining: 3h 4m 22s. Rate: 7.5 symbols/min [2025-09-24T19:10:26.421218] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-24T19:10:26.557288] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:26.604233] [DEBUG] [LOCAL ] GWRE: Loaded 41107 existing records from primary storage. [2025-09-24T19:10:26.604377] [INFO ] [MAIN ] GWRE: Loaded 41107 existing records. [2025-09-24T19:10:26.794412] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:26.794952] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-24T19:10:26.795019] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-24T19:10:26.796314] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-24T19:10:26.796390] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-24T19:10:27.164558] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:27.175841] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T19:10:27.182691] [INFO ] [REMOTE ] GUG: Full fetch complete (20005 records). [2025-09-24T19:10:27.182999] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-24T19:10:27.216433] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-24T19:10:27.297389] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T19:10:27.666954] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-24T19:10:27.667153] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-24T19:10:27.667677] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-24T19:10:27.667740] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-24T19:10:27.668487] [DEBUG] [LOCAL ] GUG: Trimmed 20005 records to 12013 (keeping 200 days of data) [2025-09-24T19:10:27.753811] [DEBUG] [LOCAL ] GUG: Primary data saved (12013 records). [2025-09-24T19:10:27.753968] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-24T19:10:27.754104] [INFO ] [MAIN ] Update Progress: 984/2373 symbols completed. GUG took 30.2s. Estimated remaining: 3h 4m 4s. Rate: 7.5 symbols/min [2025-09-24T19:10:27.922020] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:27.944946] [DEBUG] [LOCAL ] GWW: Loaded 19907 existing records from primary storage. [2025-09-24T19:10:27.945099] [INFO ] [MAIN ] GWW: Loaded 19907 existing records. [2025-09-24T19:10:28.021233] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-24T19:10:28.125434] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:28.125720] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-24T19:10:28.125777] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-24T19:10:28.126550] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-24T19:10:28.126616] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-24T19:10:28.467052] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T19:10:28.512780] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:28.816111] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-24T19:10:29.616082] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-24T19:10:29.782448] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T19:10:29.825984] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T19:10:30.416170] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-24T19:10:31.058572] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T19:10:31.216104] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-24T19:10:31.303725] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T19:10:31.306814] [INFO ] [REMOTE ] GUT: Full fetch complete (23011 records). [2025-09-24T19:10:31.306903] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-24T19:10:31.680136] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-24T19:10:31.680226] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-24T19:10:31.680832] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-24T19:10:31.680897] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-24T19:10:31.681711] [DEBUG] [LOCAL ] GUT: Trimmed 23011 records to 15414 (keeping 200 days of data) [2025-09-24T19:10:31.778629] [DEBUG] [LOCAL ] GUT: Primary data saved (15414 records). [2025-09-24T19:10:31.778792] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-24T19:10:31.778902] [INFO ] [MAIN ] Update Progress: 985/2373 symbols completed. GUT took 30.8s. Estimated remaining: 3h 3m 51s. Rate: 7.5 symbols/min [2025-09-24T19:10:31.950034] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:32.000363] [DEBUG] [LOCAL ] GXO: Loaded 47612 existing records from primary storage. [2025-09-24T19:10:32.000531] [INFO ] [MAIN ] GXO: Loaded 47612 existing records. [2025-09-24T19:10:32.021391] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-24T19:10:32.177067] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T19:10:32.211047] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:32.211292] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-24T19:10:32.211341] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-24T19:10:32.212761] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-24T19:10:32.212825] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-24T19:10:32.565285] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:32.816106] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-24T19:10:33.616120] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-24T19:10:33.857276] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T19:10:34.167938] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:10:34.416115] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-24T19:10:34.709728] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T19:10:35.216109] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-24T19:10:35.919591] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:10:36.016086] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-24T19:10:36.608992] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T19:10:36.816090] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-24T19:10:37.616079] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-24T19:10:37.705521] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:10:38.358713] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T19:10:38.416052] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-24T19:10:38.807416] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T19:10:39.216134] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-24T19:10:40.016072] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-24T19:10:40.204057] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T19:10:40.806257] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T19:10:40.816044] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-24T19:10:41.177006] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T19:10:41.616085] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-24T19:10:42.416061] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-24T19:10:42.643198] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T19:10:42.926109] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T19:10:43.216090] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-24T19:10:43.907559] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:10:44.016099] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-24T19:10:44.152028] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T19:10:44.816107] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-24T19:10:45.616140] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-24T19:10:45.680156] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T19:10:46.392375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T19:10:46.416032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-24T19:10:46.841246] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T19:10:47.216139] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-24T19:10:48.021210] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-24T19:10:48.039064] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T19:10:48.322163] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-24T19:10:48.816119] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-24T19:10:49.420549] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T19:10:49.426123] [INFO ] [REMOTE ] GVA: Full fetch complete (48815 records). [2025-09-24T19:10:49.426242] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-24T19:10:49.621670] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-24T19:10:49.825679] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-24T19:10:49.825796] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-24T19:10:49.826747] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-24T19:10:49.826811] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-24T19:10:49.828153] [DEBUG] [LOCAL ] GVA: Trimmed 48815 records to 33696 (keeping 200 days of data) [2025-09-24T19:10:49.904154] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:10:50.057760] [DEBUG] [LOCAL ] GVA: Primary data saved (33696 records). [2025-09-24T19:10:50.057916] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-24T19:10:50.058069] [INFO ] [MAIN ] Update Progress: 986/2373 symbols completed. GVA took 45.5s. Estimated remaining: 3h 3m 57s. Rate: 7.5 symbols/min [2025-09-24T19:10:50.230106] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:10:50.233503] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-09-24T19:10:50.233576] [INFO ] [MAIN ] GYLD: Loaded 1553 existing records. [2025-09-24T19:10:50.409360] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:10:50.409661] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-24T19:10:50.409725] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-24T19:10:50.409949] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-24T19:10:50.410008] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-24T19:10:50.421268] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-24T19:10:50.788279] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:10:51.216100] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-24T19:10:51.261789] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:10:51.474955] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T19:10:52.016128] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-24T19:10:52.644375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:10:52.816077] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-24T19:10:53.166893] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T19:10:53.616141] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-24T19:10:54.070266] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-24T19:10:54.348836] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:10:54.416163] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-24T19:10:55.216109] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-24T19:10:56.016161] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-24T19:10:56.077485] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:10:56.374160] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-24T19:10:56.423518] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T19:10:56.816227] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-24T19:10:57.169925] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T19:10:57.616092] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-24T19:10:58.416141] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-24T19:10:59.184086] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T19:10:59.191682] [INFO ] [REMOTE ] GWRE: Full fetch complete (61522 records). [2025-09-24T19:10:59.191826] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-24T19:10:59.223688] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-24T19:10:59.556550] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T19:10:59.634439] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-24T19:10:59.634558] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-24T19:10:59.635636] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-24T19:10:59.635726] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-24T19:10:59.637356] [DEBUG] [LOCAL ] GWRE: Trimmed 61522 records to 41025 (keeping 200 days of data) [2025-09-24T19:10:59.894098] [DEBUG] [LOCAL ] GWRE: Primary data saved (41025 records). [2025-09-24T19:10:59.894283] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-24T19:10:59.894425] [INFO ] [MAIN ] Update Progress: 987/2373 symbols completed. GWRE took 33.5s. Estimated remaining: 3h 3m 52s. Rate: 7.5 symbols/min [2025-09-24T19:11:00.021397] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-24T19:11:00.072813] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:00.124315] [DEBUG] [LOCAL ] H: Loaded 44881 existing records from primary storage. [2025-09-24T19:11:00.124466] [INFO ] [MAIN ] H: Loaded 44881 existing records. [2025-09-24T19:11:00.305867] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:00.306145] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-24T19:11:00.306204] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-24T19:11:00.307340] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-24T19:11:00.307404] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-24T19:11:00.666499] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:00.769358] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T19:11:00.816069] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-24T19:11:01.410924] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T19:11:01.419391] [INFO ] [REMOTE ] GXO: Full fetch complete (70069 records). [2025-09-24T19:11:01.419565] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-24T19:11:01.621241] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-24T19:11:01.826701] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-24T19:11:01.826792] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-24T19:11:01.827838] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-24T19:11:01.827908] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-24T19:11:01.829380] [DEBUG] [LOCAL ] GXO: Trimmed 70069 records to 47561 (keeping 200 days of data) [2025-09-24T19:11:02.105792] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:11:02.120827] [DEBUG] [LOCAL ] GXO: Primary data saved (47561 records). [2025-09-24T19:11:02.120955] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-24T19:11:02.121057] [INFO ] [MAIN ] Update Progress: 988/2373 symbols completed. GXO took 30.3s. Estimated remaining: 3h 3m 36s. Rate: 7.5 symbols/min [2025-09-24T19:11:02.291270] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:02.335704] [DEBUG] [LOCAL ] HAE: Loaded 39544 existing records from primary storage. [2025-09-24T19:11:02.335890] [INFO ] [MAIN ] HAE: Loaded 39544 existing records. [2025-09-24T19:11:02.425829] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-24T19:11:02.518353] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:02.518586] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-24T19:11:02.518636] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-24T19:11:02.519609] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-24T19:11:02.519701] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-24T19:11:02.877976] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:03.216095] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-24T19:11:03.444056] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T19:11:03.448088] [INFO ] [REMOTE ] GWW: Full fetch complete (29244 records). [2025-09-24T19:11:03.448171] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-24T19:11:03.827858] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-24T19:11:03.828045] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-24T19:11:03.828724] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-24T19:11:03.828805] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-24T19:11:03.829857] [DEBUG] [LOCAL ] GWW: Trimmed 29244 records to 19844 (keeping 200 days of data) [2025-09-24T19:11:03.960937] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:11:03.994559] [DEBUG] [LOCAL ] GWW: Primary data saved (19844 records). [2025-09-24T19:11:03.994730] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-24T19:11:03.994831] [INFO ] [MAIN ] Update Progress: 989/2373 symbols completed. GWW took 36.2s. Estimated remaining: 3h 3m 20s. Rate: 7.5 symbols/min [2025-09-24T19:11:04.024049] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-24T19:11:04.170019] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:04.216240] [DEBUG] [LOCAL ] HAFN: Loaded 43614 existing records from primary storage. [2025-09-24T19:11:04.216426] [INFO ] [MAIN ] HAFN: Loaded 43614 existing records. [2025-09-24T19:11:04.409964] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:04.410219] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-24T19:11:04.410267] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-24T19:11:04.411250] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-24T19:11:04.411315] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-24T19:11:04.513780] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T19:11:04.787704] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T19:11:04.827744] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-24T19:11:04.840981] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:05.229911] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T19:11:05.616092] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-24T19:11:06.416109] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-24T19:11:06.860968] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T19:11:06.944939] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T19:11:07.216132] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-24T19:11:08.016129] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-24T19:11:08.816097] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-24T19:11:08.916160] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T19:11:09.518219] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T19:11:09.616050] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-24T19:11:10.421178] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-24T19:11:10.442879] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T19:11:11.062488] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T19:11:11.216093] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-24T19:11:12.016116] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-24T19:11:12.348729] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T19:11:12.790978] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T19:11:12.816032] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-24T19:11:13.600227] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T19:11:13.616042] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-24T19:11:13.960519] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T19:11:14.416192] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-24T19:11:14.705479] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-24T19:11:14.994830] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T19:11:15.216062] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-24T19:11:16.016109] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-24T19:11:16.816183] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-24T19:11:17.100690] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T19:11:17.497149] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T19:11:17.616080] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-24T19:11:18.416051] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-24T19:11:18.563021] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:11:18.863175] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T19:11:19.040111] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T19:11:19.041110] [INFO ] [REMOTE ] GYLD: Full fetch complete (2039 records). [2025-09-24T19:11:19.041182] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-24T19:11:19.224934] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-24T19:11:19.401225] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-24T19:11:19.401301] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-24T19:11:19.401401] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-24T19:11:19.401438] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-24T19:11:19.401805] [DEBUG] [LOCAL ] GYLD: Trimmed 2039 records to 1540 (keeping 200 days of data) [2025-09-24T19:11:19.411842] [DEBUG] [LOCAL ] GYLD: Primary data saved (1540 records). [2025-09-24T19:11:19.411903] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-24T19:11:19.411972] [INFO ] [MAIN ] Update Progress: 990/2373 symbols completed. GYLD took 29.4s. Estimated remaining: 3h 3m 22s. Rate: 7.5 symbols/min [2025-09-24T19:11:19.579851] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:19.632680] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-24T19:11:19.632862] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-24T19:11:19.809357] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:19.809580] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-24T19:11:19.809638] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-24T19:11:19.810938] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-24T19:11:19.811000] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-24T19:11:20.021169] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-24T19:11:20.167168] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:20.816105] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-24T19:11:20.962865] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:11:21.489421] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:11:21.616088] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-24T19:11:22.416056] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-24T19:11:22.804234] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T19:11:22.850764] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T19:11:23.216087] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-24T19:11:24.016101] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-24T19:11:24.139164] [DEBUG] [REMOTE ] H: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-24T19:11:24.152688] [WARN ] [REMOTE ] H: No data returned for month 2025-06 [2025-09-24T19:11:24.155268] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T19:11:24.816078] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-24T19:11:25.155073] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T19:11:25.616083] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-24T19:11:26.326456] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T19:11:26.416116] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-24T19:11:27.216080] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-24T19:11:27.600763] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T19:11:27.992590] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:11:28.016112] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-24T19:11:28.641038] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T19:11:28.649567] [INFO ] [REMOTE ] HAE: Full fetch complete (57872 records). [2025-09-24T19:11:28.649763] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-24T19:11:28.822119] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-24T19:11:29.070724] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-24T19:11:29.070856] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-24T19:11:29.071932] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-24T19:11:29.072012] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-24T19:11:29.073844] [DEBUG] [LOCAL ] HAE: Trimmed 57872 records to 39488 (keeping 200 days of data) [2025-09-24T19:11:29.316430] [DEBUG] [LOCAL ] HAE: Primary data saved (39488 records). [2025-09-24T19:11:29.316964] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-24T19:11:29.317175] [INFO ] [MAIN ] Update Progress: 991/2373 symbols completed. HAE took 27.2s. Estimated remaining: 3h 3m 17s. Rate: 7.5 symbols/min [2025-09-24T19:11:29.502453] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:29.551986] [DEBUG] [LOCAL ] HASI: Loaded 47221 existing records from primary storage. [2025-09-24T19:11:29.552306] [INFO ] [MAIN ] HASI: Loaded 47221 existing records. [2025-09-24T19:11:29.617191] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-24T19:11:29.772105] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:29.775864] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-24T19:11:29.775574] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T19:11:29.785028] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-24T19:11:29.786532] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-24T19:11:29.786629] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-24T19:11:30.168547] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:30.241486] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T19:11:30.416114] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-24T19:11:31.216159] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-24T19:11:31.605492] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T19:11:31.686117] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T19:11:32.016106] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-24T19:11:32.795005] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T19:11:32.816087] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-24T19:11:33.616082] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-24T19:11:33.918142] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T19:11:34.417542] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-24T19:11:34.421554] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T19:11:34.430790] [INFO ] [REMOTE ] H: Full fetch complete (55378 records). [2025-09-24T19:11:34.431031] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-24T19:11:34.638921] [WARN ] [VALIDATOR ] H: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T19:11:34.639566] [FATAL] [MAIN ] H: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:11:34.639664] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:11:34.639750] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-24T19:11:34.639898] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-09-24T19:11:34.639958] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-09-24T19:11:34.640488] [DEBUG] [LOCAL ] H: Deleted derivative data file. [2025-09-24T19:11:34.640613] [INFO ] [MAIN ] Update Progress: 992/2373 symbols completed. H took 34.7s. Estimated remaining: 3h 3m 5s. Rate: 7.5 symbols/min [2025-09-24T19:11:34.819441] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:34.819862] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-09-24T19:11:34.819935] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-09-24T19:11:34.820177] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-24T19:11:34.820253] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-24T19:11:34.820344] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-24T19:11:34.820442] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-24T19:11:35.192123] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:35.218346] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-24T19:11:35.234944] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T19:11:36.016123] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-24T19:11:36.594418] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T19:11:36.816851] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-24T19:11:36.816680] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:11:37.510562] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T19:11:37.616043] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-24T19:11:38.416122] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-24T19:11:38.835460] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-24T19:11:38.883274] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T19:11:39.216136] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-24T19:11:40.016151] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-24T19:11:40.063754] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T19:11:40.072233] [INFO ] [REMOTE ] HAFN: Full fetch complete (65943 records). [2025-09-24T19:11:40.072402] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-24T19:11:40.464762] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-24T19:11:40.464853] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-24T19:11:40.465772] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-24T19:11:40.465838] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-24T19:11:40.467393] [DEBUG] [LOCAL ] HAFN: Trimmed 65943 records to 43545 (keeping 200 days of data) [2025-09-24T19:11:40.723202] [DEBUG] [LOCAL ] HAFN: Primary data saved (43545 records). [2025-09-24T19:11:40.723377] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-24T19:11:40.723483] [INFO ] [MAIN ] Update Progress: 993/2373 symbols completed. HAFN took 36.7s. Estimated remaining: 3h 2m 55s. Rate: 7.5 symbols/min [2025-09-24T19:11:40.822685] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-24T19:11:40.900167] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:40.909314] [DEBUG] [LOCAL ] HBB: Loaded 6910 existing records from primary storage. [2025-09-24T19:11:40.909420] [INFO ] [MAIN ] HBB: Loaded 6910 existing records. [2025-09-24T19:11:41.098810] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:41.099362] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-24T19:11:41.099533] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-24T19:11:41.100145] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-24T19:11:41.100231] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-24T19:11:41.393406] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T19:11:41.525063] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:41.601460] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:11:41.616017] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-24T19:11:42.339132] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:11:42.416042] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-24T19:11:42.871405] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T19:11:43.216135] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-24T19:11:44.016114] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-24T19:11:44.053196] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:11:44.812135] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T19:11:44.821483] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-24T19:11:44.876533] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T19:11:45.616091] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-24T19:11:46.416108] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-24T19:11:46.718595] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T19:11:47.225310] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-24T19:11:47.253132] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T19:11:48.016113] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-24T19:11:48.072231] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T19:11:48.512435] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T19:11:48.816154] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-24T19:11:49.141294] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T19:11:49.153700] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-24T19:11:49.153975] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-24T19:11:49.621854] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-24T19:11:49.782914] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-24T19:11:49.783050] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-24T19:11:49.784998] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-24T19:11:49.785105] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-24T19:11:49.789775] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-24T19:11:50.207402] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-24T19:11:50.207560] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-24T19:11:50.207710] [INFO ] [MAIN ] Update Progress: 994/2373 symbols completed. HAL took 30.8s. Estimated remaining: 3h 2m 49s. Rate: 7.5 symbols/min [2025-09-24T19:11:50.382613] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:11:50.416098] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-24T19:11:50.434203] [DEBUG] [LOCAL ] HBI: Loaded 53017 existing records from primary storage. [2025-09-24T19:11:50.434416] [INFO ] [MAIN ] HBI: Loaded 53017 existing records. [2025-09-24T19:11:50.592890] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T19:11:50.656906] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T19:11:50.662591] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:11:50.672859] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-24T19:11:50.673077] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-24T19:11:50.674213] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-24T19:11:50.674293] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-24T19:11:51.029967] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:11:51.216106] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-24T19:11:51.973851] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T19:11:52.016022] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-24T19:11:52.073799] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T19:11:52.816101] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-24T19:11:52.950094] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T19:11:53.616181] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-24T19:11:54.103152] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T19:11:54.416084] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-24T19:11:55.208627] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T19:11:55.221130] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-24T19:11:55.238094] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T19:11:56.016129] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-24T19:11:56.816157] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-24T19:11:56.901904] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:11:57.465747] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:11:57.616081] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-24T19:11:58.416108] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-24T19:11:58.549308] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T19:11:59.216048] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-24T19:11:59.317768] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T19:11:59.745148] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T19:11:59.753831] [INFO ] [REMOTE ] HASI: Full fetch complete (67999 records). [2025-09-24T19:11:59.754004] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-24T19:12:00.021193] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-24T19:12:00.154055] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-24T19:12:00.154135] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-24T19:12:00.155065] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-24T19:12:00.155131] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-24T19:12:00.156574] [DEBUG] [LOCAL ] HASI: Trimmed 67999 records to 47223 (keeping 200 days of data) [2025-09-24T19:12:00.442058] [DEBUG] [LOCAL ] HASI: Primary data saved (47223 records). [2025-09-24T19:12:00.442193] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-24T19:12:00.442282] [INFO ] [MAIN ] Update Progress: 995/2373 symbols completed. HASI took 31.1s. Estimated remaining: 3h 2m 44s. Rate: 7.5 symbols/min [2025-09-24T19:12:00.614016] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:00.682228] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-09-24T19:12:00.682485] [INFO ] [MAIN ] HBM: Loaded 52903 existing records. [2025-09-24T19:12:00.819916] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-24T19:12:00.881762] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:00.886807] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T19:12:00.886891] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-24T19:12:00.888560] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-24T19:12:00.890072] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-24T19:12:00.890135] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-24T19:12:01.281714] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:01.395592] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T19:12:01.616096] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-24T19:12:02.416091] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-24T19:12:03.216141] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-24T19:12:03.861521] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-24T19:12:04.016094] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-24T19:12:04.223489] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-09-24T19:12:04.788310] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T19:12:04.816047] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-24T19:12:05.158920] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T19:12:05.193586] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-24T19:12:05.203762] [INFO ] [REMOTE ] HAYW: Full fetch complete (70988 records). [2025-09-24T19:12:05.203915] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-24T19:12:05.517919] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T19:12:05.522676] [INFO ] [REMOTE ] HBB: Full fetch complete (9929 records). [2025-09-24T19:12:05.522810] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-24T19:12:05.619159] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-24T19:12:05.758506] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-24T19:12:05.779389] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-24T19:12:05.801310] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-24T19:12:05.822415] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-24T19:12:05.959347] [DEBUG] [LOCAL ] HAYW: Trimmed 70988 records to 48718 (keeping 200 days of data) [2025-09-24T19:12:06.143774] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-24T19:12:06.144245] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-24T19:12:06.144586] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-24T19:12:06.172127] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-24T19:12:06.176243] [DEBUG] [LOCAL ] HBB: Trimmed 9929 records to 6870 (keeping 200 days of data) [2025-09-24T19:12:06.224559] [DEBUG] [LOCAL ] HBB: Primary data saved (6870 records). [2025-09-24T19:12:06.226142] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-24T19:12:06.226951] [INFO ] [MAIN ] Update Progress: 996/2373 symbols completed. HBB took 25.5s. Estimated remaining: 3h 2m 33s. Rate: 7.5 symbols/min [2025-09-24T19:12:06.418532] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-24T19:12:06.461176] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:06.673682] [DEBUG] [LOCAL ] HAYW: Primary data saved (48718 records). [2025-09-24T19:12:06.673982] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-24T19:12:06.674156] [INFO ] [MAIN ] Update Progress: 997/2373 symbols completed. HAYW took 32.0s. Estimated remaining: 3h 2m 15s. Rate: 7.6 symbols/min [2025-09-24T19:12:06.713606] [DEBUG] [LOCAL ] HCA: Loaded 47271 existing records from primary storage. [2025-09-24T19:12:06.713869] [INFO ] [MAIN ] HCA: Loaded 47271 existing records. [2025-09-24T19:12:06.920372] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:06.920962] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-24T19:12:06.921070] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-24T19:12:06.922475] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-24T19:12:06.922569] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-24T19:12:07.350700] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:07.351354] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-24T19:12:07.395152] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T19:12:08.016085] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-24T19:12:08.271339] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T19:12:08.816135] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-24T19:12:09.447398] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-24T19:12:09.535013] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:12:09.616038] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-24T19:12:10.416146] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-24T19:12:10.512265] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T19:12:11.216190] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-24T19:12:11.422472] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T19:12:12.016199] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-24T19:12:12.233081] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T19:12:12.816076] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-24T19:12:13.053077] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T19:12:13.616140] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-24T19:12:13.786285] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T19:12:14.416088] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-24T19:12:15.706972] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-24T19:12:15.717562] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-24T19:12:15.786590] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-24T19:12:16.016145] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-24T19:12:17.052699] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-24T19:12:17.064350] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-24T19:12:17.585510] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T19:12:17.616032] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-24T19:12:17.722289] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T19:12:18.416056] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-24T19:12:18.482500] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T19:12:19.216064] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-24T19:12:19.330630] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T19:12:20.016121] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-24T19:12:20.223459] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T19:12:20.816048] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-24T19:12:20.974725] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T19:12:21.616128] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-24T19:12:21.818686] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T19:12:22.416061] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-24T19:12:22.582828] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T19:12:22.596912] [INFO ] [REMOTE ] HBI: Full fetch complete (76909 records). [2025-09-24T19:12:22.597125] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-24T19:12:23.005931] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-24T19:12:23.006092] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-24T19:12:23.007153] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-24T19:12:23.007249] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-24T19:12:23.008826] [DEBUG] [LOCAL ] HBI: Trimmed 76909 records to 53012 (keeping 200 days of data) [2025-09-24T19:12:23.341459] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:12:23.371717] [DEBUG] [LOCAL ] HBI: Primary data saved (53012 records). [2025-09-24T19:12:23.372042] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-24T19:12:23.372178] [INFO ] [MAIN ] Update Progress: 998/2373 symbols completed. HBI took 33.2s. Estimated remaining: 3h 2m 19s. Rate: 7.5 symbols/min [2025-09-24T19:12:23.373757] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-24T19:12:23.708411] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T19:12:24.016094] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-24T19:12:25.427792] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T19:12:25.438308] [INFO ] [REMOTE ] HBM: Full fetch complete (76092 records). [2025-09-24T19:12:25.438461] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-24T19:12:25.869090] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-24T19:12:25.869286] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-24T19:12:25.870538] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-24T19:12:25.870708] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-24T19:12:25.912346] [DEBUG] [LOCAL ] HBM: Trimmed 76092 records to 52903 (keeping 200 days of data) [2025-09-24T19:12:25.916766] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T19:12:26.012612] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-24T19:12:26.255045] [DEBUG] [LOCAL ] HBM: Primary data saved (52903 records). [2025-09-24T19:12:26.255205] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-24T19:12:26.255325] [INFO ] [MAIN ] Update Progress: 999/2373 symbols completed. HBM took 25.8s. Estimated remaining: 3h 2m 4s. Rate: 7.5 symbols/min [2025-09-24T19:12:27.710104] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T19:12:27.720738] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-24T19:12:29.514403] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T19:12:29.522596] [INFO ] [REMOTE ] HCA: Full fetch complete (69100 records). [2025-09-24T19:12:29.522766] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-24T19:12:29.916831] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-24T19:12:29.916930] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-24T19:12:29.917904] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-24T19:12:29.917977] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-24T19:12:29.921144] [DEBUG] [LOCAL ] HCA: Trimmed 69100 records to 47182 (keeping 200 days of data) [2025-09-24T19:12:30.246969] [DEBUG] [LOCAL ] HCA: Primary data saved (47182 records). [2025-09-24T19:12:30.247129] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-24T19:12:30.247222] [INFO ] [MAIN ] Update Progress: 1000/2373 symbols completed. HCA took 24.0s. Estimated remaining: 3h 1m 51s. Rate: 7.6 symbols/min [2025-09-24T19:12:30.966150] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:30.939508] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:31.000501] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-24T19:12:30.999780] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:31.001068] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-24T19:12:31.019154] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:31.020905] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-24T19:12:31.021254] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-24T19:12:31.021491] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-24T19:12:31.021679] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-24T19:12:31.187189] [DEBUG] [LOCAL ] HCI: Loaded 13926 existing records from primary storage. [2025-09-24T19:12:31.198458] [INFO ] [MAIN ] HCI: Loaded 13926 existing records. [2025-09-24T19:12:31.524191] [DEBUG] [LOCAL ] HD: Loaded 53520 existing records from primary storage. [2025-09-24T19:12:31.549795] [INFO ] [MAIN ] HD: Loaded 53520 existing records. [2025-09-24T19:12:31.602240] [DEBUG] [LOCAL ] HCC: Loaded 45383 existing records from primary storage. [2025-09-24T19:12:31.637026] [INFO ] [MAIN ] HCC: Loaded 45383 existing records. [2025-09-24T19:12:31.719748] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:31.793721] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:31.850714] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-24T19:12:31.868856] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-24T19:12:31.880717] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-24T19:12:31.917766] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-24T19:12:31.988594] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:31.964221] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-24T19:12:31.994429] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-24T19:12:32.013690] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-24T19:12:32.043128] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-24T19:12:32.059239] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-24T19:12:32.261369] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:32.304749] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-24T19:12:32.363331] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T19:12:32.380894] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-24T19:12:32.347910] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-24T19:12:32.435233] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-24T19:12:32.445765] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-24T19:12:32.750383] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-24T19:12:32.803886] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-24T19:12:32.977118] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:33.128096] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-24T19:12:33.169098] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:33.178095] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-24T19:12:33.262137] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:33.262522] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-24T19:12:33.301667] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-24T19:12:33.302583] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-24T19:12:33.549268] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-24T19:12:33.550156] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-24T19:12:33.779471] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-24T19:12:33.780462] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-24T19:12:34.010704] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-24T19:12:34.011615] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-24T19:12:34.214944] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T19:12:34.260307] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-24T19:12:34.372120] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T19:12:34.416032] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-24T19:12:35.144405] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T19:12:35.216037] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-24T19:12:35.842456] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T19:12:36.016087] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-24T19:12:36.816125] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-24T19:12:37.616127] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-24T19:12:37.863581] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T19:12:38.259622] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-09-24T19:12:38.416134] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-24T19:12:39.083097] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-24T19:12:39.216165] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-24T19:12:39.266805] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T19:12:39.319493] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T19:12:40.016090] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-24T19:12:40.817241] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-24T19:12:40.820421] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T19:12:40.947378] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T19:12:41.616159] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-24T19:12:42.416128] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-24T19:12:42.804766] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T19:12:43.022426] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T19:12:43.216058] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-24T19:12:43.294496] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T19:12:44.016104] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-24T19:12:44.116901] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T19:12:44.367983] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-24T19:12:44.816149] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-24T19:12:45.616110] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-24T19:12:46.406333] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T19:12:46.416148] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-24T19:12:47.216114] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-24T19:12:47.848028] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-24T19:12:47.923201] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:12:48.016146] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-24T19:12:48.207699] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T19:12:48.816116] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-24T19:12:49.616108] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-24T19:12:50.416109] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-24T19:12:50.446866] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T19:12:50.447819] [INFO ] [REMOTE ] HCXY: Full fetch complete (601 records). [2025-09-24T19:12:50.447900] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-24T19:12:50.701719] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-24T19:12:50.702838] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:12:50.706171] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T19:12:50.703283] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:12:50.706950] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-24T19:12:50.717668] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-24T19:12:50.718591] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-24T19:12:50.719546] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-24T19:12:50.719869] [INFO ] [MAIN ] Update Progress: 1001/2373 symbols completed. HCXY took 20.5s. Estimated remaining: 3h 1m 60s. Rate: 7.5 symbols/min [2025-09-24T19:12:50.883660] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-24T19:12:50.960084] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:51.015597] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-09-24T19:12:51.015778] [INFO ] [MAIN ] HDB: Loaded 51936 existing records. [2025-09-24T19:12:51.208206] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:51.208568] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-24T19:12:51.208664] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-24T19:12:51.215612] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-24T19:12:51.222749] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-24T19:12:51.223683] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-24T19:12:51.224265] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T19:12:51.632539] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:52.016087] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-24T19:12:52.816107] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-24T19:12:53.368857] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T19:12:53.616099] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-24T19:12:53.754324] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T19:12:53.831017] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T19:12:54.416113] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-24T19:12:55.125960] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T19:12:55.216091] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-24T19:12:56.016067] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-24T19:12:56.155410] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T19:12:56.682621] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T19:12:56.685935] [INFO ] [REMOTE ] HCI: Full fetch complete (19315 records). [2025-09-24T19:12:56.686053] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-24T19:12:56.821334] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-24T19:12:57.078957] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-24T19:12:57.079050] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-24T19:12:57.079570] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-24T19:12:57.079612] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-24T19:12:57.080247] [DEBUG] [LOCAL ] HCI: Trimmed 19315 records to 13906 (keeping 200 days of data) [2025-09-24T19:12:57.168052] [DEBUG] [LOCAL ] HCI: Primary data saved (13906 records). [2025-09-24T19:12:57.168216] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-24T19:12:57.168313] [INFO ] [MAIN ] Update Progress: 1002/2373 symbols completed. HCI took 26.9s. Estimated remaining: 3h 1m 50s. Rate: 7.5 symbols/min [2025-09-24T19:12:57.339699] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:57.389251] [DEBUG] [LOCAL ] HE: Loaded 49238 existing records from primary storage. [2025-09-24T19:12:57.389434] [INFO ] [MAIN ] HE: Loaded 49238 existing records. [2025-09-24T19:12:57.571766] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:57.572332] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-24T19:12:57.572396] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-24T19:12:57.573757] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-24T19:12:57.573819] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-24T19:12:57.638215] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-24T19:12:57.943943] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:57.972200] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T19:12:57.980223] [INFO ] [REMOTE ] HCC: Full fetch complete (64288 records). [2025-09-24T19:12:57.980369] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-24T19:12:58.384547] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-24T19:12:58.384723] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-24T19:12:58.386310] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-24T19:12:58.386441] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-24T19:12:58.388278] [DEBUG] [LOCAL ] HCC: Trimmed 64288 records to 45391 (keeping 200 days of data) [2025-09-24T19:12:58.442685] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-24T19:12:58.531949] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T19:12:58.715302] [DEBUG] [LOCAL ] HCC: Primary data saved (45391 records). [2025-09-24T19:12:58.715503] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-24T19:12:58.715617] [INFO ] [MAIN ] Update Progress: 1003/2373 symbols completed. HCC took 28.5s. Estimated remaining: 3h 1m 33s. Rate: 7.5 symbols/min [2025-09-24T19:12:58.885628] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:12:58.922564] [DEBUG] [LOCAL ] HEI: Loaded 32626 existing records from primary storage. [2025-09-24T19:12:58.922736] [INFO ] [MAIN ] HEI: Loaded 32626 existing records. [2025-09-24T19:12:59.108149] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:12:59.108467] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-24T19:12:59.108543] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-24T19:12:59.109713] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-24T19:12:59.109798] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-24T19:12:59.221205] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-24T19:12:59.542087] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:12:59.740368] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-24T19:13:00.016059] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-24T19:13:00.339677] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T19:13:00.816113] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-24T19:13:01.616136] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-24T19:13:02.082465] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-24T19:13:02.416164] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-24T19:13:03.499157] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (3.48 seconds). [2025-09-24T19:13:03.512996] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-24T19:13:03.645171] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-24T19:13:03.679986] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-24T19:13:03.941464] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:13:04.016099] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-24T19:13:04.816093] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-24T19:13:05.263017] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T19:13:05.616046] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-24T19:13:05.695401] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T19:13:06.416185] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-24T19:13:06.749833] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T19:13:07.216127] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-24T19:13:07.460696] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T19:13:08.016138] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-24T19:13:08.312382] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T19:13:08.322016] [INFO ] [REMOTE ] HD: Full fetch complete (77446 records). [2025-09-24T19:13:08.322151] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-24T19:13:08.758012] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-24T19:13:08.758176] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-24T19:13:08.759582] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-24T19:13:08.759745] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-24T19:13:08.761790] [DEBUG] [LOCAL ] HD: Trimmed 77446 records to 53515 (keeping 200 days of data) [2025-09-24T19:13:08.822186] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-24T19:13:09.134392] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T19:13:09.164715] [DEBUG] [LOCAL ] HD: Primary data saved (53515 records). [2025-09-24T19:13:09.164876] [INFO ] [MAIN ] HD: Full history saved. [2025-09-24T19:13:09.164977] [INFO ] [MAIN ] Update Progress: 1004/2373 symbols completed. HD took 38.9s. Estimated remaining: 3h 1m 29s. Rate: 7.5 symbols/min [2025-09-24T19:13:09.334164] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:09.342518] [DEBUG] [LOCAL ] HEQ: Loaded 6183 existing records from primary storage. [2025-09-24T19:13:09.342689] [INFO ] [MAIN ] HEQ: Loaded 6183 existing records. [2025-09-24T19:13:09.526823] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:13:09.527290] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-24T19:13:09.527457] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-24T19:13:09.527950] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-24T19:13:09.528013] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-24T19:13:09.617991] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-24T19:13:09.824725] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T19:13:09.920756] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:10.416110] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-24T19:13:10.790331] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T19:13:11.167147] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T19:13:11.216036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-24T19:13:11.377797] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T19:13:12.016118] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-24T19:13:12.725481] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T19:13:12.816073] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-24T19:13:12.952987] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T19:13:13.616090] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-24T19:13:14.338228] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:13:14.381743] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:13:14.416090] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-24T19:13:14.966621] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T19:13:15.216085] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-24T19:13:16.016091] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-24T19:13:16.758054] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T19:13:16.816113] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-24T19:13:16.968368] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T19:13:17.616136] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-24T19:13:18.261519] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T19:13:18.416092] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-24T19:13:19.216058] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-24T19:13:19.473665] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T19:13:19.483745] [INFO ] [REMOTE ] HDB: Full fetch complete (75226 records). [2025-09-24T19:13:19.483900] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-24T19:13:19.918113] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-24T19:13:19.918296] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-24T19:13:19.919331] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-24T19:13:19.919454] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-24T19:13:19.921357] [DEBUG] [LOCAL ] HDB: Trimmed 75226 records to 51926 (keeping 200 days of data) [2025-09-24T19:13:20.016430] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-24T19:13:20.042541] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:13:20.271941] [DEBUG] [LOCAL ] HDB: Primary data saved (51926 records). [2025-09-24T19:13:20.272085] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-24T19:13:20.272175] [INFO ] [MAIN ] Update Progress: 1005/2373 symbols completed. HDB took 29.6s. Estimated remaining: 3h 1m 25s. Rate: 7.5 symbols/min [2025-09-24T19:13:20.440355] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:20.485866] [DEBUG] [LOCAL ] HESM: Loaded 48167 existing records from primary storage. [2025-09-24T19:13:20.486012] [INFO ] [MAIN ] HESM: Loaded 48167 existing records. [2025-09-24T19:13:20.662521] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T19:13:20.689806] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:13:20.690056] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-24T19:13:20.690107] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-24T19:13:20.691304] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-24T19:13:20.691366] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-24T19:13:20.830757] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-24T19:13:21.056631] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:21.097166] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T19:13:21.616118] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-24T19:13:22.204537] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T19:13:22.291192] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T19:13:22.416091] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-24T19:13:23.216102] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-24T19:13:24.016059] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-24T19:13:24.091270] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T19:13:24.816133] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-24T19:13:24.860959] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T19:13:25.389477] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T19:13:25.531342] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:13:25.616165] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-24T19:13:26.081384] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T19:13:26.416157] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-24T19:13:27.216131] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-24T19:13:28.016077] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-24T19:13:28.162948] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T19:13:28.566079] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:13:28.816112] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-24T19:13:28.876395] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T19:13:28.878727] [INFO ] [REMOTE ] HEQ: Full fetch complete (9079 records). [2025-09-24T19:13:28.878811] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-24T19:13:29.249454] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-24T19:13:29.249542] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-24T19:13:29.249847] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-24T19:13:29.249910] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-24T19:13:29.250441] [DEBUG] [LOCAL ] HEQ: Trimmed 9079 records to 6152 (keeping 200 days of data) [2025-09-24T19:13:29.290302] [DEBUG] [LOCAL ] HEQ: Primary data saved (6152 records). [2025-09-24T19:13:29.290447] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-24T19:13:29.290541] [INFO ] [MAIN ] Update Progress: 1006/2373 symbols completed. HEQ took 20.1s. Estimated remaining: 3h 1m 18s. Rate: 7.5 symbols/min [2025-09-24T19:13:29.464760] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:29.464953] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-24T19:13:29.465009] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-24T19:13:29.465161] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-24T19:13:29.465205] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-24T19:13:29.465248] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-24T19:13:29.465283] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-24T19:13:29.623545] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-24T19:13:29.840151] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:30.399472] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T19:13:30.416054] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-24T19:13:31.096723] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T19:13:31.216087] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-24T19:13:31.757144] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T19:13:32.016143] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-24T19:13:32.816067] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-24T19:13:33.008492] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T19:13:33.371536] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T19:13:33.377380] [INFO ] [REMOTE ] HEI: Full fetch complete (49083 records). [2025-09-24T19:13:33.377555] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-24T19:13:33.625610] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-24T19:13:33.810799] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-24T19:13:33.810927] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-24T19:13:33.812090] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-24T19:13:33.812163] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-24T19:13:33.813906] [DEBUG] [LOCAL ] HEI: Trimmed 49083 records to 32518 (keeping 200 days of data) [2025-09-24T19:13:34.018194] [DEBUG] [LOCAL ] HEI: Primary data saved (32518 records). [2025-09-24T19:13:34.018348] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-24T19:13:34.018450] [INFO ] [MAIN ] Update Progress: 1007/2373 symbols completed. HEI took 35.3s. Estimated remaining: 3h 1m 6s. Rate: 7.5 symbols/min [2025-09-24T19:13:34.194916] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:34.195200] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-24T19:13:34.195259] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-24T19:13:34.195405] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-24T19:13:34.195451] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-24T19:13:34.195494] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-24T19:13:34.195527] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-24T19:13:34.424396] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-24T19:13:34.573963] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:34.602843] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T19:13:34.747014] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-24T19:13:35.216074] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-24T19:13:35.478160] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-24T19:13:35.480052] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T19:13:35.490360] [INFO ] [REMOTE ] HE: Full fetch complete (72479 records). [2025-09-24T19:13:35.490526] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-24T19:13:35.888917] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-24T19:13:35.889058] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-24T19:13:35.890171] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-24T19:13:35.890239] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-24T19:13:35.891909] [DEBUG] [LOCAL ] HE: Trimmed 72479 records to 49192 (keeping 200 days of data) [2025-09-24T19:13:36.061773] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-24T19:13:36.192337] [DEBUG] [LOCAL ] HE: Primary data saved (49192 records). [2025-09-24T19:13:36.192489] [INFO ] [MAIN ] HE: Full history saved. [2025-09-24T19:13:36.192582] [INFO ] [MAIN ] Update Progress: 1008/2373 symbols completed. HE took 39.0s. Estimated remaining: 3h 0m 50s. Rate: 7.5 symbols/min [2025-09-24T19:13:36.365171] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:36.383434] [DEBUG] [LOCAL ] HFRO: Loaded 17383 existing records from primary storage. [2025-09-24T19:13:36.383632] [INFO ] [MAIN ] HFRO: Loaded 17383 existing records. [2025-09-24T19:13:36.430908] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T19:13:36.571241] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:13:36.571517] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-24T19:13:36.571569] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-24T19:13:36.572280] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-24T19:13:36.572341] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-24T19:13:36.821290] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-24T19:13:36.938768] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:37.616129] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-24T19:13:38.308101] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:13:38.416047] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-24T19:13:38.867332] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T19:13:39.216126] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-24T19:13:39.528152] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-24T19:13:40.021224] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-24T19:13:40.044562] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T19:13:40.364417] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-24T19:13:40.816111] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-24T19:13:41.616107] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-24T19:13:41.860873] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-24T19:13:41.967749] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T19:13:42.416106] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-24T19:13:43.216132] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-24T19:13:43.456020] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T19:13:43.634612] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-24T19:13:44.016089] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-24T19:13:44.816086] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-24T19:13:45.015299] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T19:13:45.149079] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T19:13:45.616124] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-24T19:13:46.416101] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-24T19:13:46.851400] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T19:13:47.216096] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-24T19:13:47.368755] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T19:13:47.472678] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-24T19:13:48.016127] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-24T19:13:48.320759] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-24T19:13:48.816174] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-24T19:13:49.085778] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-24T19:13:49.616122] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-24T19:13:50.420065] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-24T19:13:50.421444] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T19:13:51.216091] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-24T19:13:51.708275] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-24T19:13:51.969557] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T19:13:52.016098] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-24T19:13:52.816150] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-24T19:13:53.393614] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T19:13:53.616043] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-24T19:13:53.851558] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T19:13:53.860466] [INFO ] [REMOTE ] HESM: Full fetch complete (68873 records). [2025-09-24T19:13:53.860589] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-24T19:13:54.251858] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-24T19:13:54.251950] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-24T19:13:54.252915] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-24T19:13:54.252979] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-24T19:13:54.254436] [DEBUG] [LOCAL ] HESM: Trimmed 68873 records to 48169 (keeping 200 days of data) [2025-09-24T19:13:54.434013] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-24T19:13:54.559543] [DEBUG] [LOCAL ] HESM: Primary data saved (48169 records). [2025-09-24T19:13:54.559768] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-24T19:13:54.559868] [INFO ] [MAIN ] Update Progress: 1009/2373 symbols completed. HESM took 34.3s. Estimated remaining: 3h 0m 56s. Rate: 7.5 symbols/min [2025-09-24T19:13:54.678871] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T19:13:54.787036] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:13:54.804144] [DEBUG] [LOCAL ] HGER: Loaded 13005 existing records from primary storage. [2025-09-24T19:13:54.804332] [INFO ] [MAIN ] HGER: Loaded 13005 existing records. [2025-09-24T19:13:54.926716] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T19:13:55.013009] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:13:55.013335] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-24T19:13:55.013410] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-24T19:13:55.014040] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-24T19:13:55.014114] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-24T19:13:55.225176] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-24T19:13:55.388067] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:13:56.016083] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-24T19:13:56.325048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T19:13:56.485579] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-24T19:13:56.816083] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-24T19:13:57.616084] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-24T19:13:58.069873] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T19:13:58.269225] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T19:13:58.416093] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-24T19:13:58.928154] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T19:13:59.216115] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-24T19:13:59.932323] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T19:14:00.016138] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-24T19:14:00.412026] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-24T19:14:00.816164] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-24T19:14:01.254115] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T19:14:01.255091] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-24T19:14:01.255177] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-24T19:14:01.255610] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T19:14:01.255758] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:14:01.255860] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:14:01.255947] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-24T19:14:01.256049] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-24T19:14:01.256109] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-24T19:14:01.256179] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-24T19:14:01.256277] [INFO ] [MAIN ] Update Progress: 1010/2373 symbols completed. HF took 32.0s. Estimated remaining: 3h 0m 47s. Rate: 7.5 symbols/min [2025-09-24T19:14:01.460304] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:01.473148] [DEBUG] [LOCAL ] HGLB: Loaded 9713 existing records from primary storage. [2025-09-24T19:14:01.473295] [INFO ] [MAIN ] HGLB: Loaded 9713 existing records. [2025-09-24T19:14:01.621209] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-24T19:14:01.662398] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:01.662686] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-24T19:14:01.662746] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-24T19:14:01.663215] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-24T19:14:01.663275] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-24T19:14:02.018896] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:02.074026] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T19:14:02.416089] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-24T19:14:03.141178] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T19:14:03.216138] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-24T19:14:04.016184] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-24T19:14:04.412850] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T19:14:04.417343] [INFO ] [REMOTE ] HFRO: Full fetch complete (28832 records). [2025-09-24T19:14:04.417490] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-24T19:14:04.540457] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T19:14:04.825380] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-24T19:14:04.827450] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-24T19:14:04.828805] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-24T19:14:04.829779] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-24T19:14:04.829844] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-24T19:14:04.831355] [DEBUG] [LOCAL ] HFRO: Trimmed 28832 records to 17448 (keeping 200 days of data) [2025-09-24T19:14:04.940435] [DEBUG] [LOCAL ] HFRO: Primary data saved (17448 records). [2025-09-24T19:14:04.940618] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-24T19:14:04.940766] [INFO ] [MAIN ] Update Progress: 1011/2373 symbols completed. HFRO took 28.7s. Estimated remaining: 3h 0m 33s. Rate: 7.5 symbols/min [2025-09-24T19:14:05.129800] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:05.130014] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-09-24T19:14:05.130053] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-09-24T19:14:05.130217] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-24T19:14:05.130258] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-24T19:14:05.130299] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-09-24T19:14:05.130330] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-24T19:14:05.333524] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T19:14:05.559099] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:05.616138] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-24T19:14:06.313474] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-24T19:14:06.416062] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-24T19:14:07.189543] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:14:07.216030] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-24T19:14:08.016115] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-24T19:14:08.076460] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T19:14:08.816151] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-24T19:14:08.850325] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T19:14:09.396496] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T19:14:09.616076] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-24T19:14:10.416087] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-24T19:14:10.431193] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T19:14:11.216123] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-24T19:14:11.278625] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T19:14:11.933744] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T19:14:12.016091] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-24T19:14:12.512389] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T19:14:12.513346] [INFO ] [REMOTE ] HFND: Full fetch complete (1790 records). [2025-09-24T19:14:12.513415] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-24T19:14:12.701582] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-24T19:14:12.702006] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:14:12.702120] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:14:12.702273] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-24T19:14:12.702397] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-24T19:14:12.702482] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-24T19:14:12.702571] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-24T19:14:12.702800] [INFO ] [MAIN ] Update Progress: 1012/2373 symbols completed. HFND took 38.7s. Estimated remaining: 3h 0m 25s. Rate: 7.5 symbols/min [2025-09-24T19:14:12.821215] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-24T19:14:12.880218] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:12.941487] [DEBUG] [LOCAL ] HGV: Loaded 46971 existing records from primary storage. [2025-09-24T19:14:12.941638] [INFO ] [MAIN ] HGV: Loaded 46971 existing records. [2025-09-24T19:14:13.189877] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:13.190130] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-24T19:14:13.190182] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-24T19:14:13.191539] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-24T19:14:13.191602] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-24T19:14:13.592024] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:13.595424] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:14:13.616034] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-24T19:14:14.416073] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-24T19:14:14.534168] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T19:14:15.223967] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-24T19:14:15.226594] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T19:14:15.987417] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T19:14:16.016083] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-24T19:14:16.816114] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-24T19:14:16.854196] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T19:14:17.616118] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-24T19:14:18.416105] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-24T19:14:18.552169] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T19:14:18.552782] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T19:14:19.163065] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T19:14:19.216058] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-24T19:14:19.890313] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T19:14:20.016110] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-24T19:14:20.764460] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T19:14:20.767440] [INFO ] [REMOTE ] HGLB: Full fetch complete (14357 records). [2025-09-24T19:14:20.767529] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-24T19:14:20.823004] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-24T19:14:21.176201] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-24T19:14:21.176385] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-24T19:14:21.176955] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-24T19:14:21.177048] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-24T19:14:21.177694] [DEBUG] [LOCAL ] HGLB: Trimmed 14357 records to 9759 (keeping 200 days of data) [2025-09-24T19:14:21.248325] [DEBUG] [LOCAL ] HGLB: Primary data saved (9759 records). [2025-09-24T19:14:21.248532] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-24T19:14:21.248700] [INFO ] [MAIN ] Update Progress: 1013/2373 symbols completed. HGLB took 20.0s. Estimated remaining: 3h 0m 18s. Rate: 7.5 symbols/min [2025-09-24T19:14:21.430253] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:21.479702] [DEBUG] [LOCAL ] HHH: Loaded 32677 existing records from primary storage. [2025-09-24T19:14:21.479929] [INFO ] [MAIN ] HHH: Loaded 32677 existing records. [2025-09-24T19:14:21.619612] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-24T19:14:21.726510] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:21.729465] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T19:14:21.729866] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-24T19:14:21.733366] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-24T19:14:21.734784] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-24T19:14:21.734869] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-24T19:14:22.094803] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:22.416079] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-24T19:14:22.512930] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T19:14:23.163181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:14:23.216134] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-24T19:14:23.999971] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T19:14:24.016030] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-24T19:14:24.800895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T19:14:24.816028] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-24T19:14:25.616210] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-24T19:14:25.834941] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T19:14:26.416127] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-24T19:14:26.736418] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T19:14:26.740841] [INFO ] [REMOTE ] HGER: Full fetch complete (16237 records). [2025-09-24T19:14:26.740993] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-24T19:14:27.151147] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-24T19:14:27.151237] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-24T19:14:27.151800] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-24T19:14:27.151864] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-24T19:14:27.152415] [DEBUG] [LOCAL ] HGER: Trimmed 16237 records to 13138 (keeping 200 days of data) [2025-09-24T19:14:27.217917] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-24T19:14:27.243791] [DEBUG] [LOCAL ] HGER: Primary data saved (13138 records). [2025-09-24T19:14:27.243966] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-24T19:14:27.244186] [INFO ] [MAIN ] Update Progress: 1014/2373 symbols completed. HGER took 32.7s. Estimated remaining: 3h 0m 7s. Rate: 7.5 symbols/min [2025-09-24T19:14:27.426616] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:27.480164] [DEBUG] [LOCAL ] HI: Loaded 35121 existing records from primary storage. [2025-09-24T19:14:27.480326] [INFO ] [MAIN ] HI: Loaded 35121 existing records. [2025-09-24T19:14:27.664669] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:27.664947] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-24T19:14:27.665022] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-24T19:14:27.666118] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-24T19:14:27.666222] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-24T19:14:28.019615] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-24T19:14:28.045684] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:28.080982] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T19:14:28.400912] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T19:14:28.407389] [INFO ] [REMOTE ] HGTY: Full fetch complete (17180 records). [2025-09-24T19:14:28.407549] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-24T19:14:28.802765] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-24T19:14:28.802873] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-24T19:14:28.803357] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-24T19:14:28.803397] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-24T19:14:28.804108] [DEBUG] [LOCAL ] HGTY: Trimmed 17180 records to 13112 (keeping 200 days of data) [2025-09-24T19:14:28.845620] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-24T19:14:28.897936] [DEBUG] [LOCAL ] HGTY: Primary data saved (13112 records). [2025-09-24T19:14:28.898180] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-24T19:14:28.898286] [INFO ] [MAIN ] Update Progress: 1015/2373 symbols completed. HGTY took 24.0s. Estimated remaining: 2h 59m 51s. Rate: 7.6 symbols/min [2025-09-24T19:14:29.083179] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:29.183304] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T19:14:29.185607] [DEBUG] [LOCAL ] HIG: Loaded 51268 existing records from primary storage. [2025-09-24T19:14:29.193707] [INFO ] [MAIN ] HIG: Loaded 51268 existing records. [2025-09-24T19:14:29.399579] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:29.400116] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-24T19:14:29.400190] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-24T19:14:29.402508] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-24T19:14:29.402625] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-24T19:14:29.623416] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-24T19:14:29.787225] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:30.227520] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T19:14:30.416104] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-24T19:14:31.193332] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T19:14:31.216033] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-24T19:14:32.022563] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-24T19:14:32.041061] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T19:14:32.816103] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-24T19:14:32.912396] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T19:14:33.351138] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T19:14:33.616111] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-24T19:14:34.416090] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-24T19:14:34.552721] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T19:14:35.216063] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-24T19:14:35.325830] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T19:14:35.512358] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T19:14:36.016083] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-24T19:14:36.614180] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T19:14:36.816119] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-24T19:14:37.397942] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T19:14:37.616107] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-24T19:14:38.086345] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T19:14:38.416128] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-24T19:14:38.954119] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T19:14:39.216090] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-24T19:14:39.737841] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T19:14:40.016081] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-24T19:14:40.459310] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:14:40.816120] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-24T19:14:41.616134] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-24T19:14:41.706888] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:14:42.281001] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T19:14:42.416064] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-24T19:14:43.087606] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T19:14:43.216068] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-24T19:14:43.941818] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T19:14:44.016087] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-24T19:14:44.616682] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T19:14:44.816171] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-24T19:14:45.560048] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:14:45.616142] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-24T19:14:46.253120] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T19:14:46.416091] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-24T19:14:46.665217] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T19:14:47.216108] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-24T19:14:47.963810] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:14:48.016112] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-24T19:14:48.573873] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:14:48.816109] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-24T19:14:49.616072] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-24T19:14:49.831217] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T19:14:50.197631] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T19:14:50.416056] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-24T19:14:50.856349] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:14:51.216104] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-24T19:14:51.830760] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T19:14:52.016096] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-24T19:14:52.816113] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-24T19:14:53.047142] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T19:14:53.616090] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-24T19:14:53.761132] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T19:14:54.416115] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-24T19:14:54.535867] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:14:54.545285] [INFO ] [REMOTE ] HHH: Full fetch complete (45142 records). [2025-09-24T19:14:54.545487] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-24T19:14:54.950972] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-24T19:14:54.967776] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-24T19:14:54.968754] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-24T19:14:54.969017] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-24T19:14:54.970813] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T19:14:54.978493] [INFO ] [REMOTE ] HI: Full fetch complete (49686 records). [2025-09-24T19:14:54.978700] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-24T19:14:54.984728] [DEBUG] [LOCAL ] HHH: Trimmed 45142 records to 32641 (keeping 200 days of data) [2025-09-24T19:14:55.216264] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-24T19:14:55.624118] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-24T19:14:55.624790] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-24T19:14:55.625615] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-24T19:14:55.627778] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-24T19:14:55.645088] [DEBUG] [LOCAL ] HHH: Primary data saved (32641 records). [2025-09-24T19:14:55.645306] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-24T19:14:55.645590] [INFO ] [MAIN ] Update Progress: 1016/2373 symbols completed. HHH took 34.4s. Estimated remaining: 3h 0m 8s. Rate: 7.5 symbols/min [2025-09-24T19:14:55.645918] [DEBUG] [LOCAL ] HI: Trimmed 49686 records to 35136 (keeping 200 days of data) [2025-09-24T19:14:55.949788] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:56.110386] [DEBUG] [LOCAL ] HI: Primary data saved (35136 records). [2025-09-24T19:14:56.111588] [INFO ] [MAIN ] HI: Full history saved. [2025-09-24T19:14:56.111926] [INFO ] [MAIN ] Update Progress: 1017/2373 symbols completed. HI took 28.9s. Estimated remaining: 2h 59m 50s. Rate: 7.5 symbols/min [2025-09-24T19:14:56.122388] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T19:14:56.198863] [DEBUG] [LOCAL ] HII: Loaded 35268 existing records from primary storage. [2025-09-24T19:14:56.216578] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-24T19:14:56.222050] [INFO ] [MAIN ] HII: Loaded 35268 existing records. [2025-09-24T19:14:56.420984] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:56.504150] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:56.504437] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-24T19:14:56.504489] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-24T19:14:56.505840] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-24T19:14:56.505923] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-24T19:14:56.747596] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-24T19:14:56.770336] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-24T19:14:57.036748] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:57.037790] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-24T19:14:57.122453] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:57.122845] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-24T19:14:57.123020] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-24T19:14:57.124876] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-24T19:14:57.125066] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-24T19:14:57.389183] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-24T19:14:57.539332] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:57.616051] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-24T19:14:57.875580] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T19:14:57.884099] [INFO ] [REMOTE ] HGV: Full fetch complete (65650 records). [2025-09-24T19:14:57.884259] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-24T19:14:58.317556] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-24T19:14:58.317679] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-24T19:14:58.318855] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-24T19:14:58.318923] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-24T19:14:58.320377] [DEBUG] [LOCAL ] HGV: Trimmed 65650 records to 46877 (keeping 200 days of data) [2025-09-24T19:14:58.420203] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-24T19:14:58.616853] [DEBUG] [LOCAL ] HGV: Primary data saved (46877 records). [2025-09-24T19:14:58.617012] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-24T19:14:58.617117] [INFO ] [MAIN ] Update Progress: 1018/2373 symbols completed. HGV took 45.9s. Estimated remaining: 2h 59m 35s. Rate: 7.5 symbols/min [2025-09-24T19:14:58.800714] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:14:58.815584] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T19:14:58.848871] [DEBUG] [LOCAL ] HIO: Loaded 23711 existing records from primary storage. [2025-09-24T19:14:58.849070] [INFO ] [MAIN ] HIO: Loaded 23711 existing records. [2025-09-24T19:14:59.036692] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:14:59.036976] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-24T19:14:59.037209] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-24T19:14:59.038045] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-24T19:14:59.038105] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-24T19:14:59.223743] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-24T19:14:59.421954] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:14:59.965589] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-24T19:15:00.016038] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-24T19:15:00.075171] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T19:15:00.816074] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-24T19:15:00.939481] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T19:15:01.616097] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-24T19:15:02.416127] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-24T19:15:02.759759] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-24T19:15:03.216086] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-24T19:15:03.576892] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-24T19:15:03.585852] [INFO ] [REMOTE ] HIG: Full fetch complete (73256 records). [2025-09-24T19:15:03.585982] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-24T19:15:04.018783] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-24T19:15:04.018915] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-24T19:15:04.020111] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-24T19:15:04.020183] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-24T19:15:04.022322] [DEBUG] [LOCAL ] HIG: Trimmed 73256 records to 51237 (keeping 200 days of data) [2025-09-24T19:15:04.386733] [DEBUG] [LOCAL ] HIG: Primary data saved (51237 records). [2025-09-24T19:15:04.386951] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-24T19:15:04.387062] [INFO ] [MAIN ] Update Progress: 1019/2373 symbols completed. HIG took 35.5s. Estimated remaining: 2h 59m 24s. Rate: 7.5 symbols/min [2025-09-24T19:15:04.579084] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:04.602731] [DEBUG] [LOCAL ] HIPO: Loaded 22692 existing records from primary storage. [2025-09-24T19:15:04.602884] [INFO ] [MAIN ] HIPO: Loaded 22692 existing records. [2025-09-24T19:15:04.846494] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:04.846796] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-24T19:15:04.846848] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-24T19:15:04.847496] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-24T19:15:04.847555] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-24T19:15:05.222167] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:05.222515] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-24T19:15:05.446473] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (3.83 seconds). [2025-09-24T19:15:05.455312] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-24T19:15:05.665520] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-24T19:15:05.672003] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-24T19:15:06.965564] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T19:15:06.973602] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-24T19:15:07.035495] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T19:15:07.096547] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:15:07.216110] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-24T19:15:07.332744] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (4.12 seconds). [2025-09-24T19:15:07.990379] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T19:15:08.016089] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-24T19:15:08.271578] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T19:15:08.816095] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-24T19:15:09.122994] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T19:15:09.616172] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-24T19:15:09.949722] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T19:15:10.416095] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-24T19:15:10.486188] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T19:15:11.216134] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-24T19:15:12.016087] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-24T19:15:12.399061] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T19:15:12.816070] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-24T19:15:13.110199] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-24T19:15:13.616060] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-24T19:15:13.760769] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-24T19:15:13.815567] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T19:15:14.416067] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-24T19:15:15.216083] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-24T19:15:16.016113] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-24T19:15:16.042626] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T19:15:16.660151] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T19:15:16.816091] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-24T19:15:17.026448] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-09-24T19:15:17.097621] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T19:15:17.508367] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T19:15:17.616090] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-24T19:15:18.416141] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-24T19:15:19.061220] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T19:15:19.216141] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-24T19:15:19.474845] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T19:15:20.016144] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-24T19:15:20.455027] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:15:20.816118] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-24T19:15:21.236797] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T19:15:21.616096] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-24T19:15:22.416131] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-24T19:15:22.929445] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T19:15:22.935159] [INFO ] [REMOTE ] HIO: Full fetch complete (36794 records). [2025-09-24T19:15:22.935295] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-24T19:15:23.219800] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-24T19:15:23.351155] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-24T19:15:23.351293] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-24T19:15:23.352209] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-24T19:15:23.352978] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-24T19:15:23.354501] [DEBUG] [LOCAL ] HIO: Trimmed 36794 records to 23601 (keeping 200 days of data) [2025-09-24T19:15:23.511308] [DEBUG] [LOCAL ] HIO: Primary data saved (23601 records). [2025-09-24T19:15:23.511693] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-24T19:15:23.511832] [INFO ] [MAIN ] Update Progress: 1020/2373 symbols completed. HIO took 24.9s. Estimated remaining: 2h 59m 31s. Rate: 7.5 symbols/min [2025-09-24T19:15:23.734422] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:23.743933] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-24T19:15:23.783433] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T19:15:23.832139] [DEBUG] [LOCAL ] HIW: Loaded 44739 existing records from primary storage. [2025-09-24T19:15:23.832301] [INFO ] [MAIN ] HIW: Loaded 44739 existing records. [2025-09-24T19:15:24.017485] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-24T19:15:24.033996] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:24.034536] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-24T19:15:24.034702] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-24T19:15:24.041392] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-24T19:15:24.050674] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-24T19:15:24.057793] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T19:15:24.442896] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:24.816167] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-24T19:15:25.616167] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-24T19:15:25.803408] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T19:15:26.416091] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-24T19:15:26.657583] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-24T19:15:27.216070] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-24T19:15:27.339950] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T19:15:27.345173] [INFO ] [REMOTE ] HIPO: Full fetch complete (31703 records). [2025-09-24T19:15:27.345327] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-24T19:15:27.624011] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T19:15:27.788510] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-24T19:15:27.788616] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-24T19:15:27.789530] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-24T19:15:27.789589] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-24T19:15:27.790731] [DEBUG] [LOCAL ] HIPO: Trimmed 31703 records to 22567 (keeping 200 days of data) [2025-09-24T19:15:27.930308] [DEBUG] [LOCAL ] HIPO: Primary data saved (22567 records). [2025-09-24T19:15:27.930506] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-24T19:15:27.930617] [INFO ] [MAIN ] Update Progress: 1021/2373 symbols completed. HIPO took 23.5s. Estimated remaining: 2h 59m 18s. Rate: 7.5 symbols/min [2025-09-24T19:15:28.021309] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-24T19:15:28.121969] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:28.144467] [DEBUG] [LOCAL ] HIX: Loaded 20270 existing records from primary storage. [2025-09-24T19:15:28.144759] [INFO ] [MAIN ] HIX: Loaded 20270 existing records. [2025-09-24T19:15:28.351938] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:28.352511] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-24T19:15:28.352678] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-24T19:15:28.353719] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-24T19:15:28.353796] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-24T19:15:28.773568] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T19:15:28.789259] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:28.816046] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-24T19:15:29.306688] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T19:15:29.313531] [INFO ] [REMOTE ] HII: Full fetch complete (53403 records). [2025-09-24T19:15:29.313837] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-24T19:15:29.622236] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-24T19:15:29.727460] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-24T19:15:29.727772] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-24T19:15:29.729385] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-24T19:15:29.729595] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-24T19:15:29.731764] [DEBUG] [LOCAL ] HII: Trimmed 53403 records to 35179 (keeping 200 days of data) [2025-09-24T19:15:29.853556] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T19:15:30.001345] [DEBUG] [LOCAL ] HII: Primary data saved (35179 records). [2025-09-24T19:15:30.001586] [INFO ] [MAIN ] HII: Full history saved. [2025-09-24T19:15:30.001730] [INFO ] [MAIN ] Update Progress: 1022/2373 symbols completed. HII took 34.4s. Estimated remaining: 2h 59m 2s. Rate: 7.5 symbols/min [2025-09-24T19:15:30.182866] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:30.201770] [DEBUG] [LOCAL ] HKD: Loaded 18303 existing records from primary storage. [2025-09-24T19:15:30.201890] [INFO ] [MAIN ] HKD: Loaded 18303 existing records. [2025-09-24T19:15:30.380446] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:30.380754] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-24T19:15:30.380813] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-24T19:15:30.381326] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-24T19:15:30.381386] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-24T19:15:30.422951] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-24T19:15:30.743340] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:31.216141] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-24T19:15:31.475750] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T19:15:32.016076] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-24T19:15:32.427807] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-24T19:15:32.565504] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T19:15:32.816124] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-24T19:15:33.502144] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T19:15:33.616133] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-24T19:15:33.723840] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T19:15:34.416100] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-24T19:15:35.216103] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-24T19:15:35.583706] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T19:15:35.798153] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-24T19:15:36.016133] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-24T19:15:36.816096] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-24T19:15:37.118894] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T19:15:37.616133] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-24T19:15:38.031451] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-24T19:15:38.130017] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T19:15:38.416121] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-24T19:15:38.679079] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T19:15:39.216101] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-24T19:15:39.310811] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T19:15:40.016104] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-24T19:15:40.816186] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-24T19:15:41.616132] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-24T19:15:41.709533] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:15:41.982900] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-24T19:15:41.993141] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-24T19:15:41.993361] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-24T19:15:42.118718] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T19:15:42.416948] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-24T19:15:42.461347] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-24T19:15:42.461462] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-24T19:15:42.462843] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-24T19:15:42.462916] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-24T19:15:42.465170] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-24T19:15:42.699337] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T19:15:42.833821] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-24T19:15:42.834042] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-24T19:15:42.834151] [INFO ] [MAIN ] Update Progress: 1023/2373 symbols completed. HIMS took 46.7s. Estimated remaining: 2h 59m 1s. Rate: 7.5 symbols/min [2025-09-24T19:15:43.014784] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:43.075414] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-24T19:15:43.075667] [INFO ] [MAIN ] HL: Loaded 53670 existing records. [2025-09-24T19:15:43.220531] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-24T19:15:43.282377] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:43.282793] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-24T19:15:43.282854] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-24T19:15:43.284904] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-24T19:15:43.285137] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-24T19:15:43.514391] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T19:15:43.774788] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:44.016131] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-24T19:15:44.700474] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T19:15:44.816072] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-24T19:15:45.031311] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:15:45.616145] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-24T19:15:46.263852] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T19:15:46.416087] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-24T19:15:46.799145] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T19:15:47.216087] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-24T19:15:47.876616] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T19:15:48.016109] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-24T19:15:48.246198] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T19:15:48.816133] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-24T19:15:49.292817] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T19:15:49.616110] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-24T19:15:50.416082] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-24T19:15:50.682837] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T19:15:50.781076] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:15:51.216094] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-24T19:15:51.715743] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T19:15:52.016103] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-24T19:15:52.328056] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T19:15:52.331895] [INFO ] [REMOTE ] HIX: Full fetch complete (30666 records). [2025-09-24T19:15:52.332008] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-24T19:15:52.714668] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-24T19:15:52.714770] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-24T19:15:52.715407] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-24T19:15:52.715449] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-24T19:15:52.716433] [DEBUG] [LOCAL ] HIX: Trimmed 30666 records to 20343 (keeping 200 days of data) [2025-09-24T19:15:52.818005] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-24T19:15:52.846758] [DEBUG] [LOCAL ] HIX: Primary data saved (20343 records). [2025-09-24T19:15:52.846910] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-24T19:15:52.847004] [INFO ] [MAIN ] Update Progress: 1024/2373 symbols completed. HIX took 24.9s. Estimated remaining: 2h 58m 56s. Rate: 7.5 symbols/min [2025-09-24T19:15:53.017841] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:53.062938] [DEBUG] [LOCAL ] HLF: Loaded 48724 existing records from primary storage. [2025-09-24T19:15:53.063101] [INFO ] [MAIN ] HLF: Loaded 48724 existing records. [2025-09-24T19:15:53.250474] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:53.250839] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-24T19:15:53.250897] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-24T19:15:53.252031] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-24T19:15:53.252093] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-24T19:15:53.617636] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-24T19:15:53.648119] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:53.683377] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T19:15:54.416056] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-24T19:15:54.452503] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T19:15:54.725155] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:15:55.216092] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-24T19:15:56.016059] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-24T19:15:56.125498] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T19:15:56.134944] [INFO ] [REMOTE ] HIW: Full fetch complete (64736 records). [2025-09-24T19:15:56.135190] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-24T19:15:56.574937] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-24T19:15:56.575088] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-24T19:15:56.577080] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-24T19:15:56.577207] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-24T19:15:56.596096] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:15:56.602236] [DEBUG] [LOCAL ] HIW: Trimmed 64736 records to 44709 (keeping 200 days of data) [2025-09-24T19:15:56.602434] [INFO ] [REMOTE ] HKD: Full fetch complete (28742 records). [2025-09-24T19:15:56.603401] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-24T19:15:56.817105] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-24T19:15:57.116215] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-24T19:15:57.116609] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-24T19:15:57.117793] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-24T19:15:57.117881] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-24T19:15:57.122334] [DEBUG] [LOCAL ] HKD: Trimmed 28742 records to 18353 (keeping 200 days of data) [2025-09-24T19:15:57.367770] [DEBUG] [LOCAL ] HKD: Primary data saved (18353 records). [2025-09-24T19:15:57.369815] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-24T19:15:57.370265] [INFO ] [MAIN ] Update Progress: 1025/2373 symbols completed. HKD took 27.4s. Estimated remaining: 2h 58m 43s. Rate: 7.5 symbols/min [2025-09-24T19:15:57.578129] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:57.626561] [DEBUG] [LOCAL ] HIW: Primary data saved (44709 records). [2025-09-24T19:15:57.626896] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-24T19:15:57.627150] [INFO ] [MAIN ] Update Progress: 1026/2373 symbols completed. HIW took 34.1s. Estimated remaining: 2h 58m 25s. Rate: 7.5 symbols/min [2025-09-24T19:15:57.861897] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:15:57.864112] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T19:15:57.865694] [DEBUG] [LOCAL ] HLI: Loaded 31220 existing records from primary storage. [2025-09-24T19:15:57.877607] [INFO ] [MAIN ] HLI: Loaded 31220 existing records. [2025-09-24T19:15:57.879048] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-24T19:15:58.118241] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:58.119242] [DEBUG] [LOCAL ] HLIO: Loaded 28199 existing records from primary storage. [2025-09-24T19:15:58.119554] [INFO ] [MAIN ] HLIO: Loaded 28199 existing records. [2025-09-24T19:15:58.119852] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-24T19:15:58.125116] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-24T19:15:58.198526] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-24T19:15:58.209031] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-24T19:15:58.428108] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:15:58.439888] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-24T19:15:58.450693] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-24T19:15:58.466468] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-24T19:15:58.481115] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-24T19:15:58.975454] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:58.998559] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-24T19:15:59.118702] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-24T19:15:59.162498] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:15:59.216045] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-24T19:15:59.964663] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T19:16:00.016052] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-24T19:16:00.206827] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T19:16:00.279455] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T19:16:00.816108] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-24T19:16:01.616093] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-24T19:16:01.955991] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T19:16:01.982113] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T19:16:02.416250] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-24T19:16:03.183183] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:16:03.216042] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-24T19:16:03.838161] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:16:04.016111] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-24T19:16:04.816065] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-24T19:16:04.929203] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T19:16:05.269241] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T19:16:05.616079] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-24T19:16:05.831769] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T19:16:06.416068] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-24T19:16:07.196997] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T19:16:07.216051] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-24T19:16:08.016125] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-24T19:16:08.429410] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T19:16:08.566951] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T19:16:08.816087] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-24T19:16:09.121283] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T19:16:09.616138] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-24T19:16:10.416070] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-24T19:16:10.793131] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T19:16:11.008150] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T19:16:11.216092] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-24T19:16:11.658354] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:16:12.016085] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-24T19:16:12.816175] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-24T19:16:13.273398] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T19:16:13.616076] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-24T19:16:13.690107] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T19:16:14.194045] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T19:16:14.416114] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-24T19:16:14.951273] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T19:16:15.216135] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-24T19:16:15.965291] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T19:16:16.016097] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-24T19:16:16.475952] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T19:16:16.816120] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-24T19:16:17.493620] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T19:16:17.616080] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-24T19:16:17.929678] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T19:16:18.416054] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-24T19:16:18.474521] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T19:16:19.216091] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-24T19:16:20.016051] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-24T19:16:20.109751] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T19:16:20.565013] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T19:16:20.816151] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-24T19:16:21.616084] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-24T19:16:21.947562] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:16:22.201175] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-24T19:16:22.416087] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-24T19:16:22.831388] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T19:16:23.216118] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-24T19:16:24.016113] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-24T19:16:24.510160] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-24T19:16:24.522323] [INFO ] [REMOTE ] HL: Full fetch complete (77653 records). [2025-09-24T19:16:24.522549] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-24T19:16:24.689555] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T19:16:24.824712] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-24T19:16:24.996455] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-24T19:16:24.996604] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-24T19:16:24.998094] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-24T19:16:24.998262] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-24T19:16:25.000586] [DEBUG] [LOCAL ] HL: Trimmed 77653 records to 53671 (keeping 200 days of data) [2025-09-24T19:16:25.360814] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-09-24T19:16:25.361069] [INFO ] [MAIN ] HL: Full history saved. [2025-09-24T19:16:25.361378] [INFO ] [MAIN ] Update Progress: 1027/2373 symbols completed. HL took 42.5s. Estimated remaining: 2h 58m 43s. Rate: 7.5 symbols/min [2025-09-24T19:16:25.552925] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:25.594442] [DEBUG] [LOCAL ] HLLY: Loaded 33384 existing records from primary storage. [2025-09-24T19:16:25.594702] [INFO ] [MAIN ] HLLY: Loaded 33384 existing records. [2025-09-24T19:16:25.627273] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-24T19:16:25.896351] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:25.925859] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-24T19:16:25.928073] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-24T19:16:25.929869] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-24T19:16:25.931304] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T19:16:25.931509] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-24T19:16:25.932236] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T19:16:25.978044] [INFO ] [REMOTE ] HLIO: Full fetch complete (36170 records). [2025-09-24T19:16:25.977833] [INFO ] [REMOTE ] HLF: Full fetch complete (71424 records). [2025-09-24T19:16:26.011853] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-24T19:16:26.024203] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-24T19:16:26.880212] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:16:26.927021] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-24T19:16:27.216184] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-24T19:16:27.216423] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-24T19:16:27.218299] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-24T19:16:27.216785] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-24T19:16:27.218463] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-24T19:16:27.219070] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-24T19:16:27.227167] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-24T19:16:27.236029] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-24T19:16:27.239159] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T19:16:27.245588] [INFO ] [REMOTE ] HLI: Full fetch complete (45333 records). [2025-09-24T19:16:27.245439] [DEBUG] [LOCAL ] HLIO: Trimmed 36170 records to 28212 (keeping 200 days of data) [2025-09-24T19:16:27.245915] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-24T19:16:27.247498] [DEBUG] [LOCAL ] HLF: Trimmed 71424 records to 48699 (keeping 200 days of data) [2025-09-24T19:16:27.865128] [DEBUG] [LOCAL ] HLIO: Primary data saved (28212 records). [2025-09-24T19:16:27.883567] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-24T19:16:27.900360] [INFO ] [MAIN ] Update Progress: 1028/2373 symbols completed. HLIO took 30.3s. Estimated remaining: 2h 58m 28s. Rate: 7.5 symbols/min [2025-09-24T19:16:28.336825] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:28.347030] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-24T19:16:28.347248] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-24T19:16:28.348470] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-24T19:16:28.346584] [DEBUG] [LOCAL ] HLF: Primary data saved (48699 records). [2025-09-24T19:16:28.348980] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-24T19:16:28.348587] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-24T19:16:28.349384] [INFO ] [MAIN ] Update Progress: 1029/2373 symbols completed. HLF took 35.5s. Estimated remaining: 2h 58m 10s. Rate: 7.5 symbols/min [2025-09-24T19:16:28.447720] [DEBUG] [LOCAL ] HLI: Trimmed 45333 records to 31188 (keeping 200 days of data) [2025-09-24T19:16:28.635714] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T19:16:28.689354] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-24T19:16:28.699447] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:28.830962] [DEBUG] [LOCAL ] HLN: Loaded 53090 existing records from primary storage. [2025-09-24T19:16:28.834631] [INFO ] [MAIN ] HLN: Loaded 53090 existing records. [2025-09-24T19:16:28.852943] [DEBUG] [LOCAL ] HLI: Primary data saved (31188 records). [2025-09-24T19:16:28.879246] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-24T19:16:28.897919] [INFO ] [MAIN ] Update Progress: 1030/2373 symbols completed. HLI took 31.5s. Estimated remaining: 2h 57m 53s. Rate: 7.6 symbols/min [2025-09-24T19:16:29.202569] [DEBUG] [LOCAL ] HLT: Loaded 50736 existing records from primary storage. [2025-09-24T19:16:29.250749] [INFO ] [MAIN ] HLT: Loaded 50736 existing records. [2025-09-24T19:16:29.273148] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:29.323679] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:29.382469] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-24T19:16:29.402401] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-24T19:16:29.409427] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-24T19:16:29.426368] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-24T19:16:29.577958] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:29.623090] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-24T19:16:29.670664] [DEBUG] [LOCAL ] HLX: Loaded 48067 existing records from primary storage. [2025-09-24T19:16:29.670782] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-24T19:16:29.677635] [INFO ] [MAIN ] HLX: Loaded 48067 existing records. [2025-09-24T19:16:29.694123] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-24T19:16:29.726127] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-24T19:16:30.537976] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T19:16:30.674421] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-24T19:16:30.725795] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:30.785514] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:16:30.808930] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-24T19:16:30.816588] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-24T19:16:30.832959] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-24T19:16:30.857091] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-24T19:16:30.857626] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-24T19:16:31.199049] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:16:31.227735] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-24T19:16:31.419958] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:16:31.420316] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-24T19:16:31.893416] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T19:16:31.898851] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-24T19:16:32.548341] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T19:16:32.560637] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-24T19:16:32.965303] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:16:32.978392] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-24T19:16:33.085349] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T19:16:33.191677] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T19:16:33.616192] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-24T19:16:34.353945] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T19:16:34.416070] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-24T19:16:34.630219] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T19:16:35.074366] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T19:16:35.216133] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-24T19:16:35.921388] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T19:16:36.016099] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-24T19:16:36.680834] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T19:16:36.816101] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-24T19:16:37.616187] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-24T19:16:37.689343] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T19:16:37.852000] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T19:16:38.416113] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-24T19:16:39.216165] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-24T19:16:39.291898] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T19:16:39.970311] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:16:40.016125] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-24T19:16:40.612784] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T19:16:40.816181] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-24T19:16:41.616124] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-24T19:16:41.686185] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T19:16:42.416150] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-24T19:16:42.795374] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T19:16:43.051476] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T19:16:43.216118] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-24T19:16:43.818140] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T19:16:44.016135] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-24T19:16:44.697826] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T19:16:44.705508] [INFO ] [REMOTE ] HLLY: Full fetch complete (46216 records). [2025-09-24T19:16:44.705701] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-24T19:16:44.821271] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-24T19:16:45.125685] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-24T19:16:45.125809] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-24T19:16:45.126712] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-24T19:16:45.126781] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-24T19:16:45.128204] [DEBUG] [LOCAL ] HLLY: Trimmed 46216 records to 33404 (keeping 200 days of data) [2025-09-24T19:16:45.339180] [DEBUG] [LOCAL ] HLLY: Primary data saved (33404 records). [2025-09-24T19:16:45.339351] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-24T19:16:45.339452] [INFO ] [MAIN ] Update Progress: 1031/2373 symbols completed. HLLY took 20.0s. Estimated remaining: 2h 57m 56s. Rate: 7.5 symbols/min [2025-09-24T19:16:45.536862] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:45.589932] [DEBUG] [LOCAL ] HMC: Loaded 46861 existing records from primary storage. [2025-09-24T19:16:45.590146] [INFO ] [MAIN ] HMC: Loaded 46861 existing records. [2025-09-24T19:16:45.621270] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-24T19:16:45.826373] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:45.826992] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-24T19:16:45.827086] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-24T19:16:45.838673] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-24T19:16:45.843921] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-24T19:16:45.955862] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T19:16:46.326818] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:16:46.366391] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:16:46.416147] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-24T19:16:47.216113] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-24T19:16:47.606738] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T19:16:48.016174] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-24T19:16:48.288290] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T19:16:48.816068] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-24T19:16:49.124353] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T19:16:49.616122] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-24T19:16:49.906102] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T19:16:50.416110] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-24T19:16:50.569124] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T19:16:50.733742] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T19:16:51.216108] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-24T19:16:52.016184] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-24T19:16:52.161262] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T19:16:52.816128] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-24T19:16:52.969171] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:16:53.479760] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T19:16:53.616124] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-24T19:16:54.416156] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-24T19:16:54.695730] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T19:16:54.995065] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T19:16:55.216092] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-24T19:16:56.016147] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-24T19:16:56.092432] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T19:16:56.705759] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T19:16:56.816122] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-24T19:16:57.618864] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-24T19:16:57.627714] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T19:16:58.416080] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-24T19:16:58.538335] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:16:58.547159] [INFO ] [REMOTE ] HLX: Full fetch complete (69213 records). [2025-09-24T19:16:58.547386] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-24T19:16:58.958059] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-24T19:16:58.958183] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-24T19:16:58.959454] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-24T19:16:58.959527] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-24T19:16:58.961355] [DEBUG] [LOCAL ] HLX: Trimmed 69213 records to 48031 (keeping 200 days of data) [2025-09-24T19:16:59.228115] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-24T19:16:59.281784] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T19:16:59.311325] [DEBUG] [LOCAL ] HLX: Primary data saved (48031 records). [2025-09-24T19:16:59.311518] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-24T19:16:59.311631] [INFO ] [MAIN ] Update Progress: 1032/2373 symbols completed. HLX took 30.4s. Estimated remaining: 2h 57m 56s. Rate: 7.5 symbols/min [2025-09-24T19:16:59.496564] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:16:59.521749] [DEBUG] [LOCAL ] HMN: Loaded 23395 existing records from primary storage. [2025-09-24T19:16:59.521941] [INFO ] [MAIN ] HMN: Loaded 23395 existing records. [2025-09-24T19:16:59.723249] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:16:59.723608] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-24T19:16:59.723818] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-24T19:16:59.724731] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-24T19:16:59.724794] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-24T19:17:00.022951] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-24T19:17:00.119384] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:00.205515] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T19:17:00.816121] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-24T19:17:01.333002] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T19:17:01.342924] [INFO ] [REMOTE ] HLN: Full fetch complete (76785 records). [2025-09-24T19:17:01.343058] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-24T19:17:01.618142] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-24T19:17:01.768451] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T19:17:01.800233] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-24T19:17:01.800943] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-24T19:17:01.803168] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-24T19:17:01.803263] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-24T19:17:01.805569] [DEBUG] [LOCAL ] HLN: Trimmed 76785 records to 53094 (keeping 200 days of data) [2025-09-24T19:17:02.145882] [DEBUG] [LOCAL ] HLN: Primary data saved (53094 records). [2025-09-24T19:17:02.146212] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-24T19:17:02.146440] [INFO ] [MAIN ] Update Progress: 1033/2373 symbols completed. HLN took 34.2s. Estimated remaining: 2h 57m 41s. Rate: 7.5 symbols/min [2025-09-24T19:17:02.364054] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:02.368186] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T19:17:02.416857] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-24T19:17:02.435693] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-24T19:17:02.435869] [INFO ] [MAIN ] HMY: Loaded 53136 existing records. [2025-09-24T19:17:02.618044] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:02.618333] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-24T19:17:02.618382] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-24T19:17:02.619621] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-24T19:17:02.619746] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-24T19:17:02.844345] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:17:02.997725] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:03.216087] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-24T19:17:04.016125] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-24T19:17:04.190747] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T19:17:04.816103] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-24T19:17:05.032793] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T19:17:05.068722] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T19:17:05.616072] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-24T19:17:06.416050] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-24T19:17:06.530455] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T19:17:07.216169] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-24T19:17:07.284321] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T19:17:08.016151] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-24T19:17:08.451883] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T19:17:08.816077] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-24T19:17:08.973040] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:17:08.981381] [INFO ] [REMOTE ] HMC: Full fetch complete (69550 records). [2025-09-24T19:17:08.981511] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-24T19:17:09.185954] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T19:17:09.437957] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-24T19:17:09.438059] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-24T19:17:09.439111] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-24T19:17:09.439179] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-24T19:17:09.440567] [DEBUG] [LOCAL ] HMC: Trimmed 69550 records to 46818 (keeping 200 days of data) [2025-09-24T19:17:09.621299] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-24T19:17:09.727976] [DEBUG] [LOCAL ] HMC: Primary data saved (46818 records). [2025-09-24T19:17:09.728140] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-24T19:17:09.728234] [INFO ] [MAIN ] Update Progress: 1034/2373 symbols completed. HMC took 24.4s. Estimated remaining: 2h 57m 32s. Rate: 7.5 symbols/min [2025-09-24T19:17:09.903914] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:09.904172] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-24T19:17:09.904232] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-24T19:17:09.904389] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-24T19:17:09.904435] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-24T19:17:09.904480] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-24T19:17:09.904516] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-24T19:17:10.264672] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:10.416099] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-24T19:17:10.598363] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:17:11.216059] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-24T19:17:11.408345] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T19:17:11.461157] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T19:17:12.016116] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-24T19:17:12.217181] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:17:12.217524] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-24T19:17:12.796203] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T19:17:12.806621] [INFO ] [REMOTE ] HLT: Full fetch complete (73447 records). [2025-09-24T19:17:12.806828] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-24T19:17:12.821179] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-24T19:17:13.257289] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-24T19:17:13.257395] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-24T19:17:13.258558] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-24T19:17:13.258636] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-24T19:17:13.260396] [DEBUG] [LOCAL ] HLT: Trimmed 73447 records to 50720 (keeping 200 days of data) [2025-09-24T19:17:13.602129] [DEBUG] [LOCAL ] HLT: Primary data saved (50720 records). [2025-09-24T19:17:13.602291] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-24T19:17:13.602382] [INFO ] [MAIN ] Update Progress: 1035/2373 symbols completed. HLT took 45.3s. Estimated remaining: 2h 57m 19s. Rate: 7.5 symbols/min [2025-09-24T19:17:13.623353] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-24T19:17:13.777688] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:13.806521] [DEBUG] [LOCAL ] HNI: Loaded 28779 existing records from primary storage. [2025-09-24T19:17:13.806699] [INFO ] [MAIN ] HNI: Loaded 28779 existing records. [2025-09-24T19:17:13.988384] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:13.988698] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-24T19:17:13.988760] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-24T19:17:13.989489] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-24T19:17:13.989552] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-24T19:17:14.369866] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:14.416078] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-24T19:17:14.884266] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T19:17:14.932087] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T19:17:15.216107] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-24T19:17:15.562516] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T19:17:16.016140] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-24T19:17:16.816109] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-24T19:17:17.527633] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-24T19:17:17.545351] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:17:17.616057] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-24T19:17:17.980254] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T19:17:18.416042] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-24T19:17:18.665324] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T19:17:19.216051] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-24T19:17:19.614892] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T19:17:20.016093] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-24T19:17:20.533044] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T19:17:20.816159] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-24T19:17:21.616092] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-24T19:17:21.974198] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T19:17:22.105809] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T19:17:22.416124] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-24T19:17:22.687262] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:17:22.687585] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-24T19:17:22.711351] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T19:17:23.216090] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-24T19:17:24.016122] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-24T19:17:24.211313] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:17:24.211683] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-24T19:17:24.472308] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T19:17:24.816098] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-24T19:17:25.616142] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-24T19:17:26.068454] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T19:17:26.072591] [INFO ] [REMOTE ] HMN: Full fetch complete (31679 records). [2025-09-24T19:17:26.072721] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-24T19:17:26.421222] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-24T19:17:26.461119] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-24T19:17:26.461205] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-24T19:17:26.461969] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-24T19:17:26.462034] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-24T19:17:26.462941] [DEBUG] [LOCAL ] HMN: Trimmed 31679 records to 23386 (keeping 200 days of data) [2025-09-24T19:17:26.612219] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T19:17:26.644373] [DEBUG] [LOCAL ] HMN: Primary data saved (23386 records). [2025-09-24T19:17:26.644567] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-24T19:17:26.644705] [INFO ] [MAIN ] Update Progress: 1036/2373 symbols completed. HMN took 27.3s. Estimated remaining: 2h 57m 18s. Rate: 7.5 symbols/min [2025-09-24T19:17:26.768684] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:17:26.796993] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-24T19:17:26.823917] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:26.876559] [DEBUG] [LOCAL ] HOG: Loaded 51251 existing records from primary storage. [2025-09-24T19:17:26.876763] [INFO ] [MAIN ] HOG: Loaded 51251 existing records. [2025-09-24T19:17:27.059060] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:27.059324] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-24T19:17:27.059374] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-24T19:17:27.060503] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-24T19:17:27.060565] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-24T19:17:27.221527] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-24T19:17:27.453827] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:28.016089] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-24T19:17:28.816135] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-24T19:17:29.008848] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:17:29.009217] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-24T19:17:29.231104] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T19:17:29.616974] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-24T19:17:29.616825] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T19:17:30.416158] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-24T19:17:31.216095] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-24T19:17:31.311610] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T19:17:31.622664] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T19:17:32.016069] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-24T19:17:32.142712] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T19:17:32.816098] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-24T19:17:33.616114] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-24T19:17:33.983057] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-24T19:17:34.329487] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:17:34.416039] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-24T19:17:34.607035] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T19:17:35.216115] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-24T19:17:35.954820] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:17:36.016043] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-24T19:17:36.816177] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-24T19:17:37.486252] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-24T19:17:37.496008] [INFO ] [REMOTE ] HMY: Full fetch complete (76656 records). [2025-09-24T19:17:37.496179] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-24T19:17:37.622848] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-24T19:17:37.947232] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-24T19:17:37.942977] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T19:17:37.947559] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-24T19:17:37.957190] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-24T19:17:37.957324] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-24T19:17:37.960120] [DEBUG] [LOCAL ] HMY: Trimmed 76656 records to 53136 (keeping 200 days of data) [2025-09-24T19:17:38.074802] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T19:17:38.322976] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-24T19:17:38.323168] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-24T19:17:38.323280] [INFO ] [MAIN ] Update Progress: 1037/2373 symbols completed. HMY took 36.2s. Estimated remaining: 2h 57m 15s. Rate: 7.5 symbols/min [2025-09-24T19:17:38.416075] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-24T19:17:39.216125] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-24T19:17:39.437036] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:17:39.903865] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T19:17:39.911359] [INFO ] [REMOTE ] HNI: Full fetch complete (41190 records). [2025-09-24T19:17:39.911579] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-24T19:17:40.021298] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-24T19:17:40.296227] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-24T19:17:40.296336] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-24T19:17:40.297137] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-24T19:17:40.297200] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-24T19:17:40.298331] [DEBUG] [LOCAL ] HNI: Trimmed 41190 records to 28817 (keeping 200 days of data) [2025-09-24T19:17:40.508401] [DEBUG] [LOCAL ] HNI: Primary data saved (28817 records). [2025-09-24T19:17:40.508712] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-24T19:17:40.508825] [INFO ] [MAIN ] Update Progress: 1038/2373 symbols completed. HNI took 26.9s. Estimated remaining: 2h 56m 59s. Rate: 7.5 symbols/min [2025-09-24T19:17:40.750351] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T19:17:40.761419] [INFO ] [REMOTE ] HNGE: Full fetch complete (26470 records). [2025-09-24T19:17:40.761679] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-24T19:17:41.028078] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 86 unique days, need 200 days [2025-09-24T19:17:41.028800] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:17:41.028899] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:17:41.028996] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-24T19:17:41.029117] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-24T19:17:41.029196] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-24T19:17:41.029289] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-24T19:17:41.029413] [INFO ] [MAIN ] Update Progress: 1039/2373 symbols completed. HNGE took 31.3s. Estimated remaining: 2h 56m 42s. Rate: 7.5 symbols/min [2025-09-24T19:17:41.768333] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:17:41.780260] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-24T19:17:43.647501] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T19:17:43.659826] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-24T19:17:45.416507] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T19:17:45.427970] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-24T19:17:47.199280] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T19:17:47.211157] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-24T19:17:48.848200] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:17:48.859430] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-24T19:17:50.731625] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:17:50.742848] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-24T19:17:52.335031] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T19:17:52.346678] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-24T19:17:54.110787] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:17:54.120283] [INFO ] [REMOTE ] HOG: Full fetch complete (74249 records). [2025-09-24T19:17:54.120478] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-24T19:17:54.537227] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-24T19:17:54.537357] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-24T19:17:54.538562] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-24T19:17:54.538628] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-24T19:17:54.540200] [DEBUG] [LOCAL ] HOG: Trimmed 74249 records to 51232 (keeping 200 days of data) [2025-09-24T19:17:54.879378] [DEBUG] [LOCAL ] HOG: Primary data saved (51232 records). [2025-09-24T19:17:54.879535] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-24T19:17:54.879628] [INFO ] [MAIN ] Update Progress: 1040/2373 symbols completed. HOG took 28.2s. Estimated remaining: 2h 56m 41s. Rate: 7.5 symbols/min [2025-09-24T19:17:55.391082] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:55.583637] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:55.626464] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:55.645962] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:17:55.673840] [DEBUG] [LOCAL ] HOV: Loaded 13783 existing records from primary storage. [2025-09-24T19:17:55.674089] [INFO ] [MAIN ] HOV: Loaded 13783 existing records. [2025-09-24T19:17:55.801948] [DEBUG] [LOCAL ] HOUS: Loaded 44099 existing records from primary storage. [2025-09-24T19:17:55.814669] [INFO ] [MAIN ] HOUS: Loaded 44099 existing records. [2025-09-24T19:17:56.005588] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:56.036142] [DEBUG] [LOCAL ] HOMB: Loaded 43632 existing records from primary storage. [2025-09-24T19:17:56.051445] [INFO ] [MAIN ] HOMB: Loaded 43632 existing records. [2025-09-24T19:17:56.036572] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-24T19:17:56.057340] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-24T19:17:56.103861] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-24T19:17:56.079064] [DEBUG] [LOCAL ] HP: Loaded 51614 existing records from primary storage. [2025-09-24T19:17:56.104026] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-24T19:17:56.178480] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:56.223409] [INFO ] [MAIN ] HP: Loaded 51614 existing records. [2025-09-24T19:17:56.316269] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-24T19:17:56.427836] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-24T19:17:56.460001] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-24T19:17:56.477665] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-24T19:17:56.771355] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:56.907572] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-24T19:17:56.965675] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-24T19:17:56.944678] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:17:56.998188] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-24T19:17:57.018380] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-24T19:17:57.050686] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-24T19:17:57.130731] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-24T19:17:57.191381] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-24T19:17:57.201606] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-24T19:17:57.363199] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:57.417589] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-24T19:17:57.786238] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:57.832586] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-24T19:17:58.161969] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:58.181334] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-24T19:17:58.204582] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:17:58.206589] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-24T19:17:58.547851] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T19:17:58.553514] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-24T19:17:59.349631] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T19:17:59.352894] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-24T19:17:59.380102] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T19:17:59.388865] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-24T19:17:59.719972] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:17:59.728765] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-24T19:17:59.854781] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:17:59.864772] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-24T19:17:59.953858] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T19:17:59.956946] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-24T19:18:00.810986] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T19:18:00.813960] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-24T19:18:00.956536] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:18:00.966195] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-24T19:18:01.155047] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T19:18:01.164931] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-24T19:18:01.308025] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:18:01.318713] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-24T19:18:01.895160] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T19:18:01.900827] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-24T19:18:02.558517] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:18:02.567293] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-24T19:18:03.935374] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T19:18:03.938360] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-24T19:18:04.453539] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (3.13 seconds). [2025-09-24T19:18:04.463554] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-24T19:18:04.563811] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-09-24T19:18:04.575345] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-24T19:18:04.942476] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:18:04.947116] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-24T19:18:05.380159] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-24T19:18:05.392445] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-24T19:18:05.759422] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T19:18:05.769545] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-24T19:18:05.982938] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T19:18:05.987333] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-24T19:18:06.439892] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T19:18:06.450864] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-24T19:18:06.607027] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T19:18:06.618396] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-24T19:18:06.642790] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T19:18:06.656252] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-24T19:18:07.425792] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T19:18:07.436857] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-24T19:18:07.624716] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:18:07.627740] [INFO ] [REMOTE ] HOV: Full fetch complete (19511 records). [2025-09-24T19:18:07.627867] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-24T19:18:08.036799] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-24T19:18:08.037508] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-24T19:18:08.038356] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-24T19:18:08.039007] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-24T19:18:08.040195] [DEBUG] [LOCAL ] HOV: Trimmed 19511 records to 13773 (keeping 200 days of data) [2025-09-24T19:18:08.169564] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T19:18:08.207928] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-24T19:18:08.207368] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T19:18:08.225579] [DEBUG] [LOCAL ] HOV: Primary data saved (13773 records). [2025-09-24T19:18:08.226318] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-24T19:18:08.226637] [INFO ] [MAIN ] Update Progress: 1041/2373 symbols completed. HOV took 13.3s. Estimated remaining: 2h 56m 40s. Rate: 7.5 symbols/min [2025-09-24T19:18:08.483540] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:08.511395] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T19:18:08.582585] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-24T19:18:08.582767] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-24T19:18:08.763823] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:08.764087] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-24T19:18:08.764136] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-24T19:18:08.765636] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-24T19:18:08.765720] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-24T19:18:08.820677] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-24T19:18:09.138242] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:09.616087] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-24T19:18:10.018798] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T19:18:10.306234] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T19:18:10.416071] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-24T19:18:10.954998] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T19:18:11.216180] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-24T19:18:11.742140] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T19:18:12.016149] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-24T19:18:12.816091] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-24T19:18:12.913077] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T19:18:13.616106] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-24T19:18:13.743832] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T19:18:14.341612] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:18:14.416071] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-24T19:18:15.216174] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-24T19:18:16.016156] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-24T19:18:16.353344] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-24T19:18:16.791597] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-24T19:18:16.816043] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-24T19:18:17.616054] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-24T19:18:17.719339] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T19:18:17.805092] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-24T19:18:18.416068] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-24T19:18:18.720937] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T19:18:18.733380] [INFO ] [REMOTE ] HOUS: Full fetch complete (62795 records). [2025-09-24T19:18:18.733505] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-24T19:18:19.190547] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-24T19:18:19.190851] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-24T19:18:19.191801] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-24T19:18:19.191882] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-24T19:18:19.194570] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T19:18:19.205909] [DEBUG] [LOCAL ] HOUS: Trimmed 62795 records to 44130 (keeping 200 days of data) [2025-09-24T19:18:19.216030] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-24T19:18:19.466390] [DEBUG] [LOCAL ] HOUS: Primary data saved (44130 records). [2025-09-24T19:18:19.466540] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-24T19:18:19.466685] [INFO ] [MAIN ] Update Progress: 1042/2373 symbols completed. HOUS took 24.6s. Estimated remaining: 2h 56m 37s. Rate: 7.5 symbols/min [2025-09-24T19:18:19.642378] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:19.660502] [DEBUG] [LOCAL ] HPF: Loaded 7292 existing records from primary storage. [2025-09-24T19:18:19.660947] [INFO ] [MAIN ] HPF: Loaded 7292 existing records. [2025-09-24T19:18:19.867274] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:19.875386] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-24T19:18:19.876343] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T19:18:19.875464] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-24T19:18:19.884678] [INFO ] [REMOTE ] HOMB: Full fetch complete (63756 records). [2025-09-24T19:18:19.884721] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-24T19:18:19.884863] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-24T19:18:19.884927] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-24T19:18:20.020100] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-24T19:18:20.605885] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:20.653772] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-24T19:18:20.653932] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-24T19:18:20.654997] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-24T19:18:20.655156] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-24T19:18:20.656918] [DEBUG] [LOCAL ] HOMB: Trimmed 63756 records to 43638 (keeping 200 days of data) [2025-09-24T19:18:20.791901] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T19:18:20.812298] [INFO ] [REMOTE ] HP: Full fetch complete (73899 records). [2025-09-24T19:18:20.816870] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-24T19:18:20.820224] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-24T19:18:21.401474] [DEBUG] [LOCAL ] HOMB: Primary data saved (43638 records). [2025-09-24T19:18:21.402032] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-24T19:18:21.402344] [INFO ] [MAIN ] Update Progress: 1043/2373 symbols completed. HOMB took 26.5s. Estimated remaining: 2h 56m 21s. Rate: 7.5 symbols/min [2025-09-24T19:18:21.401897] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-24T19:18:21.440195] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-24T19:18:21.462088] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-24T19:18:21.471922] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-24T19:18:21.540520] [DEBUG] [LOCAL ] HP: Trimmed 73899 records to 51587 (keeping 200 days of data) [2025-09-24T19:18:21.662571] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:21.701331] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T19:18:21.714602] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-24T19:18:21.744052] [DEBUG] [LOCAL ] HPI: Loaded 10123 existing records from primary storage. [2025-09-24T19:18:21.753330] [INFO ] [MAIN ] HPI: Loaded 10123 existing records. [2025-09-24T19:18:22.079448] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:22.099016] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T19:18:22.099230] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-24T19:18:22.115471] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-24T19:18:22.123754] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-24T19:18:22.124421] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-24T19:18:22.423449] [DEBUG] [LOCAL ] HP: Primary data saved (51587 records). [2025-09-24T19:18:22.440275] [INFO ] [MAIN ] HP: Full history saved. [2025-09-24T19:18:22.421142] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-24T19:18:22.440998] [INFO ] [MAIN ] Update Progress: 1044/2373 symbols completed. HP took 27.6s. Estimated remaining: 2h 56m 4s. Rate: 7.5 symbols/min [2025-09-24T19:18:22.440581] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T19:18:22.738103] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:22.788261] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:22.838509] [DEBUG] [LOCAL ] HPP: Loaded 50822 existing records from primary storage. [2025-09-24T19:18:22.838737] [INFO ] [MAIN ] HPP: Loaded 50822 existing records. [2025-09-24T19:18:23.030391] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:23.030711] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-24T19:18:23.030769] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-24T19:18:23.032201] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-24T19:18:23.032263] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-24T19:18:23.221235] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-24T19:18:23.388900] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:23.992808] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:18:24.016054] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-24T19:18:24.342808] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T19:18:24.462744] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T19:18:24.816085] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-24T19:18:25.616124] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-24T19:18:26.349048] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T19:18:26.416050] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-24T19:18:26.932809] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T19:18:27.165385] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:18:27.216089] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-24T19:18:28.016078] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-24T19:18:28.046386] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T19:18:28.816120] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-24T19:18:29.616113] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-24T19:18:30.088060] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T19:18:30.359630] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T19:18:30.416065] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-24T19:18:30.654006] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T19:18:31.172874] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T19:18:31.216104] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-24T19:18:32.016119] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-24T19:18:32.825741] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-24T19:18:32.862398] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:18:33.361290] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T19:18:33.616149] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-24T19:18:34.021064] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-24T19:18:34.343777] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T19:18:34.416110] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-24T19:18:35.216093] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-24T19:18:36.020912] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-24T19:18:36.027851] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T19:18:36.639157] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T19:18:36.816086] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-24T19:18:36.993883] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T19:18:37.616141] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-24T19:18:37.681879] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T19:18:37.683978] [INFO ] [REMOTE ] HPF: Full fetch complete (10782 records). [2025-09-24T19:18:37.684051] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-24T19:18:38.054728] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-24T19:18:38.054821] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-24T19:18:38.055086] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-24T19:18:38.055126] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-24T19:18:38.055571] [DEBUG] [LOCAL ] HPF: Trimmed 10782 records to 7289 (keeping 200 days of data) [2025-09-24T19:18:38.103947] [DEBUG] [LOCAL ] HPF: Primary data saved (7289 records). [2025-09-24T19:18:38.104115] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-24T19:18:38.104243] [INFO ] [MAIN ] Update Progress: 1045/2373 symbols completed. HPF took 18.6s. Estimated remaining: 2h 56m 6s. Rate: 7.5 symbols/min [2025-09-24T19:18:38.276495] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:38.333025] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-24T19:18:38.333229] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-24T19:18:38.421182] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-24T19:18:38.517093] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:38.517360] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-24T19:18:38.517409] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-24T19:18:38.519134] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-24T19:18:38.519197] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-24T19:18:38.881268] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:38.966498] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T19:18:39.216152] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-24T19:18:40.016194] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-24T19:18:40.244331] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T19:18:40.454626] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:18:40.715554] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T19:18:40.816107] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-24T19:18:41.616137] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-24T19:18:41.674980] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T19:18:42.416116] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-24T19:18:43.007556] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T19:18:43.024074] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:18:43.216106] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-24T19:18:44.016088] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-24T19:18:44.821204] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-24T19:18:44.840066] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T19:18:45.616065] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-24T19:18:45.693881] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:18:46.416090] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-24T19:18:46.662104] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T19:18:46.671630] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-24T19:18:46.671807] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-24T19:18:47.100734] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-24T19:18:47.101073] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-24T19:18:47.102397] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-24T19:18:47.102674] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-24T19:18:47.112507] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T19:18:47.111921] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-24T19:18:47.222553] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-24T19:18:47.253152] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:18:47.527738] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-24T19:18:47.527953] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-24T19:18:47.528129] [INFO ] [MAIN ] Update Progress: 1046/2373 symbols completed. HPE took 39.3s. Estimated remaining: 2h 55m 60s. Rate: 7.5 symbols/min [2025-09-24T19:18:47.710409] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:47.723000] [DEBUG] [LOCAL ] HPS: Loaded 10223 existing records from primary storage. [2025-09-24T19:18:47.723159] [INFO ] [MAIN ] HPS: Loaded 10223 existing records. [2025-09-24T19:18:47.909324] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:47.909669] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-24T19:18:47.909735] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-24T19:18:47.910328] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-24T19:18:47.910393] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-24T19:18:48.020127] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-24T19:18:48.034203] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T19:18:48.298843] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:48.816092] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-24T19:18:49.616056] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-24T19:18:49.729228] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T19:18:49.865803] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T19:18:50.416124] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-24T19:18:51.112716] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T19:18:51.216036] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-24T19:18:51.974972] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T19:18:52.016091] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-24T19:18:52.816128] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-24T19:18:52.966977] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T19:18:52.976955] [INFO ] [REMOTE ] HPP: Full fetch complete (73369 records). [2025-09-24T19:18:52.977182] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-24T19:18:53.405677] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-24T19:18:53.405816] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-24T19:18:53.407342] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-24T19:18:53.407416] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-24T19:18:53.409575] [DEBUG] [LOCAL ] HPP: Trimmed 73369 records to 50831 (keeping 200 days of data) [2025-09-24T19:18:53.622037] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-24T19:18:53.735153] [DEBUG] [LOCAL ] HPP: Primary data saved (50831 records). [2025-09-24T19:18:53.735463] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-24T19:18:53.735735] [INFO ] [MAIN ] Update Progress: 1047/2373 symbols completed. HPP took 31.3s. Estimated remaining: 2h 55m 50s. Rate: 7.5 symbols/min [2025-09-24T19:18:53.881750] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T19:18:53.934661] [INFO ] [REMOTE ] HPI: Full fetch complete (13457 records). [2025-09-24T19:18:53.961413] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-24T19:18:53.963865] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-24T19:18:53.961292] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:54.287392] [DEBUG] [LOCAL ] HQH: Loaded 24832 existing records from primary storage. [2025-09-24T19:18:54.290504] [INFO ] [MAIN ] HQH: Loaded 24832 existing records. [2025-09-24T19:18:54.437994] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-24T19:18:54.488173] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-24T19:18:54.489370] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-24T19:18:54.489812] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-24T19:18:54.506078] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-24T19:18:54.580404] [DEBUG] [LOCAL ] HPI: Trimmed 13457 records to 10154 (keeping 200 days of data) [2025-09-24T19:18:54.551309] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T19:18:54.597064] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:54.597520] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-24T19:18:54.597602] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-24T19:18:54.628688] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-24T19:18:54.642665] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-24T19:18:54.934476] [DEBUG] [LOCAL ] HPI: Primary data saved (10154 records). [2025-09-24T19:18:54.950417] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-24T19:18:54.950573] [INFO ] [MAIN ] Update Progress: 1048/2373 symbols completed. HPI took 33.5s. Estimated remaining: 2h 55m 33s. Rate: 7.5 symbols/min [2025-09-24T19:18:55.157717] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:55.219773] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-24T19:18:55.219618] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:18:55.238343] [DEBUG] [LOCAL ] HQL: Loaded 15826 existing records from primary storage. [2025-09-24T19:18:55.238478] [INFO ] [MAIN ] HQL: Loaded 15826 existing records. [2025-09-24T19:18:55.419469] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:18:55.419767] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-24T19:18:55.419826] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-24T19:18:55.420343] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-24T19:18:55.420408] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-24T19:18:55.779277] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:18:55.927401] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T19:18:56.016069] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-24T19:18:56.470852] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T19:18:56.816101] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-24T19:18:56.907472] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T19:18:57.467469] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T19:18:57.616106] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-24T19:18:58.416121] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-24T19:18:59.015935] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T19:18:59.216100] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-24T19:19:00.024632] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-24T19:19:00.026889] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T19:19:00.277411] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T19:19:00.816083] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-24T19:19:01.029564] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:19:01.616154] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-24T19:19:02.416069] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-24T19:19:02.491979] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T19:19:02.750340] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-24T19:19:03.166003] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T19:19:03.216035] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-24T19:19:04.016108] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-24T19:19:04.315008] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T19:19:04.700704] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T19:19:04.816096] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-24T19:19:05.616055] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-24T19:19:05.879156] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T19:19:06.416138] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-24T19:19:07.165450] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:19:07.216062] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-24T19:19:07.427219] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T19:19:07.800875] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T19:19:08.016124] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-24T19:19:08.816142] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-24T19:19:09.616137] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-24T19:19:09.787479] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T19:19:09.833423] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T19:19:10.161496] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T19:19:10.416087] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-24T19:19:11.216179] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-24T19:19:11.339674] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T19:19:12.016113] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-24T19:19:12.816124] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-24T19:19:13.167474] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T19:19:13.267600] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T19:19:13.277841] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-24T19:19:13.278055] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-24T19:19:13.628818] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-24T19:19:13.690961] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-24T19:19:13.691063] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-24T19:19:13.692176] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-24T19:19:13.692244] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-24T19:19:13.693967] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-24T19:19:13.884136] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T19:19:14.042875] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-24T19:19:14.043029] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-24T19:19:14.043122] [INFO ] [MAIN ] Update Progress: 1049/2373 symbols completed. HPQ took 35.9s. Estimated remaining: 2h 55m 39s. Rate: 7.5 symbols/min [2025-09-24T19:19:14.214602] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:14.268704] [DEBUG] [LOCAL ] HR: Loaded 51956 existing records from primary storage. [2025-09-24T19:19:14.268875] [INFO ] [MAIN ] HR: Loaded 51956 existing records. [2025-09-24T19:19:14.421291] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-24T19:19:14.453337] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:14.461502] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-24T19:19:14.461777] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-24T19:19:14.462673] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T19:19:14.465670] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-24T19:19:14.465770] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-24T19:19:14.819787] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:15.216088] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-24T19:19:15.348229] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T19:19:16.016126] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-24T19:19:16.152730] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T19:19:16.155091] [INFO ] [REMOTE ] HPS: Full fetch complete (15138 records). [2025-09-24T19:19:16.155286] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-24T19:19:16.548557] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-24T19:19:16.548697] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-24T19:19:16.549325] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-24T19:19:16.549392] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-24T19:19:16.550092] [DEBUG] [LOCAL ] HPS: Trimmed 15138 records to 10153 (keeping 200 days of data) [2025-09-24T19:19:16.619985] [DEBUG] [LOCAL ] HPS: Primary data saved (10153 records). [2025-09-24T19:19:16.620185] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-24T19:19:16.620298] [INFO ] [MAIN ] Update Progress: 1050/2373 symbols completed. HPS took 29.1s. Estimated remaining: 2h 55m 25s. Rate: 7.5 symbols/min [2025-09-24T19:19:16.810435] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:16.816113] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-24T19:19:16.867625] [DEBUG] [LOCAL ] HRB: Loaded 48618 existing records from primary storage. [2025-09-24T19:19:16.868068] [INFO ] [MAIN ] HRB: Loaded 48618 existing records. [2025-09-24T19:19:17.077027] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:17.077341] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-24T19:19:17.077396] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-24T19:19:17.078892] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-24T19:19:17.078954] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-24T19:19:17.423108] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T19:19:17.492574] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:17.616122] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-24T19:19:18.416069] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-24T19:19:18.562521] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T19:19:18.713866] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T19:19:19.216139] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-24T19:19:19.875694] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T19:19:19.910318] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T19:19:20.016074] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-24T19:19:20.816088] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-24T19:19:21.522564] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:19:21.616108] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-24T19:19:22.416137] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-24T19:19:22.554593] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T19:19:22.928900] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T19:19:23.216072] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-24T19:19:23.493251] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T19:19:24.016107] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-24T19:19:24.816116] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-24T19:19:24.905922] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:19:25.567352] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:19:25.616167] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-24T19:19:25.945252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T19:19:26.416153] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-24T19:19:27.216159] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-24T19:19:27.303228] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T19:19:27.528397] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:19:28.016098] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-24T19:19:28.261338] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T19:19:28.266296] [INFO ] [REMOTE ] HQL: Full fetch complete (24145 records). [2025-09-24T19:19:28.266391] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-24T19:19:28.655194] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-24T19:19:28.655275] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-24T19:19:28.655910] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-24T19:19:28.656008] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-24T19:19:28.657007] [DEBUG] [LOCAL ] HQL: Trimmed 24145 records to 15812 (keeping 200 days of data) [2025-09-24T19:19:28.755687] [DEBUG] [LOCAL ] HQL: Primary data saved (15812 records). [2025-09-24T19:19:28.755846] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-24T19:19:28.755939] [INFO ] [MAIN ] Update Progress: 1051/2373 symbols completed. HQL took 33.8s. Estimated remaining: 2h 55m 22s. Rate: 7.5 symbols/min [2025-09-24T19:19:28.827111] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-24T19:19:28.944759] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:28.984998] [DEBUG] [LOCAL ] HRI: Loaded 33171 existing records from primary storage. [2025-09-24T19:19:28.985145] [INFO ] [MAIN ] HRI: Loaded 33171 existing records. [2025-09-24T19:19:29.123998] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T19:19:29.173097] [INFO ] [REMOTE ] HQH: Full fetch complete (37240 records). [2025-09-24T19:19:29.190702] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-24T19:19:29.194295] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:29.227609] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-24T19:19:29.261338] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-24T19:19:29.291717] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-24T19:19:29.301889] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-24T19:19:29.627274] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-24T19:19:29.941327] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-24T19:19:29.951987] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-24T19:19:29.952864] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-24T19:19:29.952945] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-24T19:19:29.984883] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:29.985487] [DEBUG] [LOCAL ] HQH: Trimmed 37240 records to 24925 (keeping 200 days of data) [2025-09-24T19:19:30.143086] [DEBUG] [LOCAL ] HQH: Primary data saved (24925 records). [2025-09-24T19:19:30.143247] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-24T19:19:30.143347] [INFO ] [MAIN ] Update Progress: 1052/2373 symbols completed. HQH took 36.4s. Estimated remaining: 2h 55m 6s. Rate: 7.5 symbols/min [2025-09-24T19:19:30.339677] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:30.392512] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-24T19:19:30.392698] [INFO ] [MAIN ] HRL: Loaded 53088 existing records. [2025-09-24T19:19:30.424059] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-24T19:19:30.583915] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:30.584330] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-24T19:19:30.584551] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-24T19:19:30.595834] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-24T19:19:30.611237] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-24T19:19:30.693158] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T19:19:30.991471] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:31.216075] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-24T19:19:31.382970] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T19:19:31.756106] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T19:19:32.016172] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-24T19:19:32.816085] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-24T19:19:33.090049] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T19:19:33.121039] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T19:19:33.616165] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-24T19:19:34.213362] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T19:19:34.416129] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-24T19:19:34.925247] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T19:19:35.216153] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-24T19:19:35.463501] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T19:19:36.016196] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-24T19:19:36.428117] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T19:19:36.816127] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-24T19:19:37.616136] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-24T19:19:37.879221] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-24T19:19:37.957147] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T19:19:38.416113] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-24T19:19:39.097914] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T19:19:39.216105] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-24T19:19:40.016063] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-24T19:19:40.125225] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T19:19:40.773258] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T19:19:40.816067] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-24T19:19:41.616206] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-24T19:19:41.694134] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T19:19:42.416131] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-24T19:19:42.728580] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T19:19:43.091281] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:19:43.216063] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-24T19:19:44.016062] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-24T19:19:44.205167] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T19:19:44.214612] [INFO ] [REMOTE ] HRB: Full fetch complete (69779 records). [2025-09-24T19:19:44.214952] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-24T19:19:44.634927] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-24T19:19:44.635059] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-24T19:19:44.636360] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-24T19:19:44.636452] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-24T19:19:44.638590] [DEBUG] [LOCAL ] HRB: Trimmed 69779 records to 48582 (keeping 200 days of data) [2025-09-24T19:19:44.755951] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:19:44.858759] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-24T19:19:44.988570] [DEBUG] [LOCAL ] HRB: Primary data saved (48582 records). [2025-09-24T19:19:44.988771] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-24T19:19:44.988876] [INFO ] [MAIN ] Update Progress: 1053/2373 symbols completed. HRB took 28.4s. Estimated remaining: 2h 55m 6s. Rate: 7.5 symbols/min [2025-09-24T19:19:45.163253] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:45.199743] [DEBUG] [LOCAL ] HRTG: Loaded 32918 existing records from primary storage. [2025-09-24T19:19:45.199924] [INFO ] [MAIN ] HRTG: Loaded 32918 existing records. [2025-09-24T19:19:45.385187] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:45.385500] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-24T19:19:45.385554] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-24T19:19:45.386539] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-24T19:19:45.386606] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-24T19:19:45.628050] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-24T19:19:45.749305] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:45.783395] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T19:19:46.416049] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-24T19:19:46.812693] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T19:19:47.216065] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-24T19:19:47.255058] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:19:48.016074] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-24T19:19:48.170890] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T19:19:48.816128] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-24T19:19:48.857970] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:19:48.933429] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T19:19:49.616116] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-24T19:19:50.416078] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-24T19:19:50.537036] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:19:50.546577] [INFO ] [REMOTE ] HR: Full fetch complete (74816 records). [2025-09-24T19:19:50.546811] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-24T19:19:50.960453] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-24T19:19:50.960707] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-24T19:19:50.962097] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-24T19:19:50.962332] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-24T19:19:50.973877] [DEBUG] [LOCAL ] HR: Trimmed 74816 records to 51962 (keeping 200 days of data) [2025-09-24T19:19:50.991916] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:19:51.218293] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-24T19:19:51.328265] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T19:19:51.354614] [DEBUG] [LOCAL ] HR: Primary data saved (51962 records). [2025-09-24T19:19:51.354804] [INFO ] [MAIN ] HR: Full history saved. [2025-09-24T19:19:51.354899] [INFO ] [MAIN ] Update Progress: 1054/2373 symbols completed. HR took 37.3s. Estimated remaining: 2h 54m 57s. Rate: 7.5 symbols/min [2025-09-24T19:19:51.527484] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:51.576922] [DEBUG] [LOCAL ] HSBC: Loaded 51156 existing records from primary storage. [2025-09-24T19:19:51.577078] [INFO ] [MAIN ] HSBC: Loaded 51156 existing records. [2025-09-24T19:19:51.758217] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:51.758527] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-24T19:19:51.758583] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-24T19:19:51.760574] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-24T19:19:51.760636] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-24T19:19:52.021267] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-24T19:19:52.122607] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:52.679492] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T19:19:52.816116] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-24T19:19:53.564075] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:19:53.616092] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-24T19:19:54.116146] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T19:19:54.416117] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-24T19:19:55.216118] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-24T19:19:55.362362] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T19:19:56.016114] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-24T19:19:56.142731] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T19:19:56.222168] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:19:56.816090] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-24T19:19:57.616092] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-24T19:19:57.751355] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:19:57.765717] [INFO ] [REMOTE ] HRL: Full fetch complete (76687 records). [2025-09-24T19:19:57.766001] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-24T19:19:58.110674] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T19:19:58.211571] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-24T19:19:58.211704] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-24T19:19:58.212808] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-24T19:19:58.212884] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-24T19:19:58.214758] [DEBUG] [LOCAL ] HRL: Trimmed 76687 records to 53088 (keeping 200 days of data) [2025-09-24T19:19:58.437763] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-24T19:19:58.559989] [DEBUG] [LOCAL ] HRL: Primary data saved (53088 records). [2025-09-24T19:19:58.560313] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-24T19:19:58.560696] [INFO ] [MAIN ] Update Progress: 1055/2373 symbols completed. HRL took 28.4s. Estimated remaining: 2h 54m 48s. Rate: 7.5 symbols/min [2025-09-24T19:19:58.684486] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T19:19:58.764227] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:19:58.782370] [DEBUG] [LOCAL ] HSHP: Loaded 15671 existing records from primary storage. [2025-09-24T19:19:58.782551] [INFO ] [MAIN ] HSHP: Loaded 15671 existing records. [2025-09-24T19:19:58.965823] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:19:58.966179] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-24T19:19:58.966242] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-24T19:19:58.966857] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-24T19:19:58.966931] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-24T19:19:59.221250] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-24T19:19:59.331896] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:19:59.914255] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T19:19:59.920746] [INFO ] [REMOTE ] HRI: Full fetch complete (45997 records). [2025-09-24T19:19:59.920863] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-24T19:20:00.022536] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-24T19:20:00.312597] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-24T19:20:00.312714] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-24T19:20:00.313700] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-24T19:20:00.313767] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-24T19:20:00.314893] [DEBUG] [LOCAL ] HRI: Trimmed 45997 records to 33102 (keeping 200 days of data) [2025-09-24T19:20:00.545866] [DEBUG] [LOCAL ] HRI: Primary data saved (33102 records). [2025-09-24T19:20:00.546016] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-24T19:20:00.546108] [INFO ] [MAIN ] Update Progress: 1056/2373 symbols completed. HRI took 31.8s. Estimated remaining: 2h 54m 32s. Rate: 7.5 symbols/min [2025-09-24T19:20:00.738616] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:00.767040] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:20:00.821224] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-24T19:20:00.825396] [DEBUG] [LOCAL ] HSY: Loaded 50459 existing records from primary storage. [2025-09-24T19:20:00.825612] [INFO ] [MAIN ] HSY: Loaded 50459 existing records. [2025-09-24T19:20:01.012271] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:01.012762] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-24T19:20:01.012850] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-24T19:20:01.014134] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-24T19:20:01.014200] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-24T19:20:01.372916] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T19:20:01.408791] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:01.616139] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-24T19:20:02.416140] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-24T19:20:02.981543] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-24T19:20:03.216091] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-24T19:20:03.309538] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T19:20:03.848349] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-24T19:20:04.016123] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-24T19:20:04.816091] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-24T19:20:05.119251] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T19:20:05.185447] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T19:20:05.616085] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-24T19:20:06.416110] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-24T19:20:06.877060] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T19:20:07.186469] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T19:20:07.216040] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-24T19:20:07.447777] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T19:20:08.016135] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-24T19:20:08.816064] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-24T19:20:09.045015] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T19:20:09.104573] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T19:20:09.616146] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-24T19:20:10.028888] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T19:20:10.416161] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-24T19:20:10.473266] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T19:20:11.216097] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-24T19:20:12.016138] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-24T19:20:12.350316] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-24T19:20:12.816122] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-24T19:20:13.195178] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T19:20:13.371440] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:20:13.616138] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-24T19:20:14.416115] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-24T19:20:14.574485] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T19:20:14.853297] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T19:20:15.216154] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-24T19:20:16.016197] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-24T19:20:16.277357] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T19:20:16.388273] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T19:20:16.816108] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-24T19:20:17.320850] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:20:17.616120] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-24T19:20:18.342028] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:20:18.416161] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-24T19:20:19.216154] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-24T19:20:19.417994] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T19:20:19.556860] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T19:20:20.016121] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-24T19:20:20.712531] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T19:20:20.720987] [INFO ] [REMOTE ] HRTG: Full fetch complete (42286 records). [2025-09-24T19:20:20.721110] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-24T19:20:20.823909] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-24T19:20:21.111417] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-24T19:20:21.111527] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-24T19:20:21.112321] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-24T19:20:21.112415] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-24T19:20:21.113731] [DEBUG] [LOCAL ] HRTG: Trimmed 42286 records to 33109 (keeping 200 days of data) [2025-09-24T19:20:21.322111] [DEBUG] [LOCAL ] HRTG: Primary data saved (33109 records). [2025-09-24T19:20:21.322391] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-24T19:20:21.322639] [INFO ] [MAIN ] Update Progress: 1057/2373 symbols completed. HRTG took 36.3s. Estimated remaining: 2h 54m 40s. Rate: 7.5 symbols/min [2025-09-24T19:20:21.494596] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:21.494812] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-24T19:20:21.494861] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-24T19:20:21.495007] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-24T19:20:21.495060] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-24T19:20:21.495128] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-24T19:20:21.495172] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-24T19:20:21.621265] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-24T19:20:21.860176] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:22.083890] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T19:20:22.416148] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-24T19:20:22.478806] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T19:20:22.489270] [INFO ] [REMOTE ] HSBC: Full fetch complete (73631 records). [2025-09-24T19:20:22.489497] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-24T19:20:22.628534] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:20:22.693630] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-24T19:20:22.696181] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T19:20:22.942303] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-24T19:20:22.942422] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-24T19:20:22.943622] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-24T19:20:22.943718] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-24T19:20:22.945864] [DEBUG] [LOCAL ] HSBC: Trimmed 73631 records to 51123 (keeping 200 days of data) [2025-09-24T19:20:23.217321] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-24T19:20:23.287846] [DEBUG] [LOCAL ] HSBC: Primary data saved (51123 records). [2025-09-24T19:20:23.288021] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-24T19:20:23.288195] [INFO ] [MAIN ] Update Progress: 1058/2373 symbols completed. HSBC took 31.9s. Estimated remaining: 2h 54m 25s. Rate: 7.5 symbols/min [2025-09-24T19:20:23.462387] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:20:23.482710] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-24T19:20:23.486745] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:23.507101] [DEBUG] [LOCAL ] HTD: Loaded 13506 existing records from primary storage. [2025-09-24T19:20:23.507280] [INFO ] [MAIN ] HTD: Loaded 13506 existing records. [2025-09-24T19:20:23.716781] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:23.717085] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-24T19:20:23.717168] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-24T19:20:23.717704] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-24T19:20:23.717798] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-24T19:20:24.021244] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-24T19:20:24.108319] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:24.375397] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T19:20:24.816111] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-24T19:20:25.616120] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-24T19:20:25.710185] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T19:20:26.416104] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-24T19:20:26.491441] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T19:20:26.496028] [INFO ] [REMOTE ] HSHP: Full fetch complete (23558 records). [2025-09-24T19:20:26.496143] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-24T19:20:26.871378] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-24T19:20:26.871459] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-24T19:20:26.872017] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-24T19:20:26.872078] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-24T19:20:26.872784] [DEBUG] [LOCAL ] HSHP: Trimmed 23558 records to 15569 (keeping 200 days of data) [2025-09-24T19:20:26.987484] [DEBUG] [LOCAL ] HSHP: Primary data saved (15569 records). [2025-09-24T19:20:26.987683] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-24T19:20:26.987865] [INFO ] [MAIN ] Update Progress: 1059/2373 symbols completed. HSHP took 28.4s. Estimated remaining: 2h 54m 12s. Rate: 7.5 symbols/min [2025-09-24T19:20:27.219087] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-24T19:20:27.253217] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:27.254153] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-24T19:20:27.254291] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-24T19:20:27.254500] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-24T19:20:27.254547] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-24T19:20:27.254591] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-24T19:20:27.254888] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-24T19:20:27.393831] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:20:27.642526] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:28.016105] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-24T19:20:28.536246] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T19:20:28.816108] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-24T19:20:29.098588] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T19:20:29.431967] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T19:20:29.616115] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-24T19:20:30.361888] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-24T19:20:30.416075] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-24T19:20:31.152840] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T19:20:31.216119] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-24T19:20:32.016126] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-24T19:20:32.722321] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T19:20:32.816094] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-24T19:20:32.927927] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T19:20:33.616145] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-24T19:20:33.705051] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T19:20:34.344992] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:20:34.416057] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-24T19:20:35.216105] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-24T19:20:35.349275] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T19:20:35.530759] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-24T19:20:36.016085] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-24T19:20:36.613707] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T19:20:36.816114] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-24T19:20:37.616093] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-24T19:20:37.809552] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T19:20:37.811980] [INFO ] [REMOTE ] HTB: Full fetch complete (7642 records). [2025-09-24T19:20:37.812053] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-24T19:20:38.038503] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-24T19:20:38.038898] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:20:38.038972] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:20:38.039024] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-24T19:20:38.039085] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-24T19:20:38.039123] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-24T19:20:38.039179] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-24T19:20:38.039269] [INFO ] [MAIN ] Update Progress: 1060/2373 symbols completed. HTB took 16.7s. Estimated remaining: 2h 54m 7s. Rate: 7.5 symbols/min [2025-09-24T19:20:38.227766] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:38.291228] [DEBUG] [LOCAL ] HTGC: Loaded 47566 existing records from primary storage. [2025-09-24T19:20:38.291383] [INFO ] [MAIN ] HTGC: Loaded 47566 existing records. [2025-09-24T19:20:38.421261] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-24T19:20:38.494943] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:38.495296] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-24T19:20:38.495351] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-24T19:20:38.496913] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-24T19:20:38.496975] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-24T19:20:38.607974] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T19:20:38.854581] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T19:20:38.878261] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:39.216122] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-24T19:20:39.542417] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-24T19:20:40.016158] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-24T19:20:40.816095] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-24T19:20:41.616067] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-24T19:20:41.793445] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:20:42.096778] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T19:20:42.165106] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T19:20:42.416089] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-24T19:20:43.216098] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-24T19:20:44.016059] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-24T19:20:44.044973] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T19:20:44.348770] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-24T19:20:44.816056] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-24T19:20:44.945366] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T19:20:44.954318] [INFO ] [REMOTE ] HSY: Full fetch complete (73812 records). [2025-09-24T19:20:44.954488] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-24T19:20:45.369455] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-24T19:20:45.369810] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-24T19:20:45.370986] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-24T19:20:45.371055] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-24T19:20:45.375634] [DEBUG] [LOCAL ] HSY: Trimmed 73812 records to 50426 (keeping 200 days of data) [2025-09-24T19:20:45.617761] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-24T19:20:45.701944] [DEBUG] [LOCAL ] HSY: Primary data saved (50426 records). [2025-09-24T19:20:45.702105] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-24T19:20:45.702330] [INFO ] [MAIN ] Update Progress: 1061/2373 symbols completed. HSY took 45.2s. Estimated remaining: 2h 53m 59s. Rate: 7.5 symbols/min [2025-09-24T19:20:45.831375] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T19:20:45.903858] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:45.940564] [DEBUG] [LOCAL ] HTH: Loaded 32495 existing records from primary storage. [2025-09-24T19:20:45.940750] [INFO ] [MAIN ] HTH: Loaded 32495 existing records. [2025-09-24T19:20:46.121061] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T19:20:46.126791] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:46.128230] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-24T19:20:46.128288] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-24T19:20:46.129338] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-24T19:20:46.129402] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-24T19:20:46.421272] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-24T19:20:46.495596] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:46.801295] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-24T19:20:47.216084] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-24T19:20:47.565588] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T19:20:48.016155] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-24T19:20:48.815901] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T19:20:48.816053] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-24T19:20:49.132461] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-24T19:20:49.616083] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-24T19:20:50.416074] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-24T19:20:50.522612] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T19:20:50.525957] [INFO ] [REMOTE ] HTD: Full fetch complete (18865 records). [2025-09-24T19:20:50.526054] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-24T19:20:50.769439] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-24T19:20:50.912481] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-24T19:20:50.912565] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-24T19:20:50.913150] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-24T19:20:50.913216] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-24T19:20:50.913880] [DEBUG] [LOCAL ] HTD: Trimmed 18865 records to 13524 (keeping 200 days of data) [2025-09-24T19:20:50.999113] [DEBUG] [LOCAL ] HTD: Primary data saved (13524 records). [2025-09-24T19:20:50.999273] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-24T19:20:50.999370] [INFO ] [MAIN ] Update Progress: 1062/2373 symbols completed. HTD took 27.7s. Estimated remaining: 2h 53m 48s. Rate: 7.5 symbols/min [2025-09-24T19:20:51.172615] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:51.215334] [DEBUG] [LOCAL ] HUBB: Loaded 37249 existing records from primary storage. [2025-09-24T19:20:51.215517] [INFO ] [MAIN ] HUBB: Loaded 37249 existing records. [2025-09-24T19:20:51.221215] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-24T19:20:51.398673] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:51.398944] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-24T19:20:51.399001] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-24T19:20:51.400122] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-24T19:20:51.400187] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-24T19:20:51.765869] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:52.016086] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-24T19:20:52.412282] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-24T19:20:52.413066] [INFO ] [REMOTE ] HTFC: Full fetch complete (848 records). [2025-09-24T19:20:52.413134] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-24T19:20:52.598913] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-24T19:20:52.599183] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:20:52.599272] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:20:52.599365] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-24T19:20:52.599451] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-24T19:20:52.599492] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-24T19:20:52.599571] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-24T19:20:52.599681] [INFO ] [MAIN ] Update Progress: 1063/2373 symbols completed. HTFC took 25.6s. Estimated remaining: 2h 53m 32s. Rate: 7.5 symbols/min [2025-09-24T19:20:52.775755] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:20:52.816105] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-24T19:20:52.829351] [DEBUG] [LOCAL ] HUBS: Loaded 39541 existing records from primary storage. [2025-09-24T19:20:52.829480] [INFO ] [MAIN ] HUBS: Loaded 39541 existing records. [2025-09-24T19:20:53.027049] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:20:53.027442] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-24T19:20:53.027524] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-24T19:20:53.037964] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-24T19:20:53.043228] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-24T19:20:53.136563] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T19:20:53.448346] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:20:53.616048] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-24T19:20:53.795099] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T19:20:54.416140] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-24T19:20:54.825077] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T19:20:55.216086] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-24T19:20:55.612119] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T19:20:56.016091] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-24T19:20:56.614904] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T19:20:56.816099] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-24T19:20:57.386090] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T19:20:57.616086] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-24T19:20:58.416053] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-24T19:20:58.672581] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T19:20:59.020161] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T19:20:59.216141] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-24T19:20:59.528810] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T19:21:00.016105] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-24T19:21:00.816132] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-24T19:21:01.195178] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T19:21:01.616131] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-24T19:21:01.880739] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T19:21:02.416087] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-24T19:21:02.740145] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T19:21:03.216123] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-24T19:21:04.016164] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-24T19:21:04.877248] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (3.26 seconds). [2025-09-24T19:21:04.888024] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-24T19:21:05.479827] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-24T19:21:05.532112] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (3.12 seconds). [2025-09-24T19:21:05.616052] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-24T19:21:05.755815] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T19:21:06.125907] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T19:21:06.416095] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-24T19:21:07.216129] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-24T19:21:07.508866] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T19:21:08.016098] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-24T19:21:08.183891] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T19:21:08.816122] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-24T19:21:08.957502] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:21:09.151706] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T19:21:09.616117] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-24T19:21:10.200462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T19:21:10.416074] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-24T19:21:11.060201] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T19:21:11.216180] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-24T19:21:12.016130] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-24T19:21:12.076477] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:21:12.362910] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T19:21:12.816107] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-24T19:21:13.552611] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T19:21:13.616134] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-24T19:21:14.109731] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T19:21:14.118805] [INFO ] [REMOTE ] HTGC: Full fetch complete (68159 records). [2025-09-24T19:21:14.118959] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-24T19:21:14.420494] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-24T19:21:14.518381] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-24T19:21:14.518471] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-24T19:21:14.519436] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-24T19:21:14.519500] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-24T19:21:14.521050] [DEBUG] [LOCAL ] HTGC: Trimmed 68159 records to 47557 (keeping 200 days of data) [2025-09-24T19:21:14.837555] [DEBUG] [LOCAL ] HTGC: Primary data saved (47557 records). [2025-09-24T19:21:14.837737] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-24T19:21:14.837843] [INFO ] [MAIN ] Update Progress: 1064/2373 symbols completed. HTGC took 36.8s. Estimated remaining: 2h 53m 42s. Rate: 7.5 symbols/min [2025-09-24T19:21:15.015385] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T19:21:15.059060] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:15.105126] [DEBUG] [LOCAL ] HUM: Loaded 48892 existing records from primary storage. [2025-09-24T19:21:15.105285] [INFO ] [MAIN ] HUM: Loaded 48892 existing records. [2025-09-24T19:21:15.221243] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-24T19:21:15.293326] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:15.293622] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-24T19:21:15.293726] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-24T19:21:15.295120] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-24T19:21:15.295187] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-24T19:21:15.683482] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:16.016126] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-24T19:21:16.227153] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T19:21:16.816088] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-24T19:21:17.540879] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T19:21:17.616094] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-24T19:21:18.043671] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T19:21:18.365114] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T19:21:18.416041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-24T19:21:18.629519] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T19:21:19.216093] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-24T19:21:20.012758] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:21:20.016159] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-24T19:21:20.777585] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T19:21:20.816150] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-24T19:21:21.616212] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-24T19:21:21.757808] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T19:21:21.803079] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T19:21:21.809207] [INFO ] [REMOTE ] HTH: Full fetch complete (46625 records). [2025-09-24T19:21:21.809373] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-24T19:21:22.189348] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-24T19:21:22.189456] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-24T19:21:22.190246] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-24T19:21:22.190309] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-24T19:21:22.191304] [DEBUG] [LOCAL ] HTH: Trimmed 46625 records to 32387 (keeping 200 days of data) [2025-09-24T19:21:22.389059] [DEBUG] [LOCAL ] HTH: Primary data saved (32387 records). [2025-09-24T19:21:22.389209] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-24T19:21:22.389301] [INFO ] [MAIN ] Update Progress: 1065/2373 symbols completed. HTH took 36.7s. Estimated remaining: 2h 53m 33s. Rate: 7.5 symbols/min [2025-09-24T19:21:22.421175] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-24T19:21:22.563041] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:22.620621] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-09-24T19:21:22.620839] [INFO ] [MAIN ] HUN: Loaded 53203 existing records. [2025-09-24T19:21:22.805882] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:22.806183] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-24T19:21:22.806236] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-24T19:21:22.811214] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-24T19:21:22.811278] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-24T19:21:23.177489] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:23.216031] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-24T19:21:23.297236] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T19:21:23.304769] [INFO ] [REMOTE ] HUBS: Full fetch complete (55435 records). [2025-09-24T19:21:23.304907] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-24T19:21:23.698369] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-24T19:21:23.698562] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-24T19:21:23.699685] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-24T19:21:23.699774] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-24T19:21:23.719395] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:21:23.726995] [DEBUG] [LOCAL ] HUBS: Trimmed 55435 records to 39485 (keeping 200 days of data) [2025-09-24T19:21:23.974532] [DEBUG] [LOCAL ] HUBS: Primary data saved (39485 records). [2025-09-24T19:21:23.974752] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-24T19:21:23.974876] [INFO ] [MAIN ] Update Progress: 1066/2373 symbols completed. HUBS took 31.4s. Estimated remaining: 2h 53m 18s. Rate: 7.5 symbols/min [2025-09-24T19:21:24.021334] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-24T19:21:24.148007] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:24.189217] [DEBUG] [LOCAL ] HUYA: Loaded 44441 existing records from primary storage. [2025-09-24T19:21:24.189390] [INFO ] [MAIN ] HUYA: Loaded 44441 existing records. [2025-09-24T19:21:24.369594] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:24.369887] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-24T19:21:24.369937] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-24T19:21:24.370971] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-24T19:21:24.371037] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-24T19:21:24.737833] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:24.816043] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-24T19:21:24.850776] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T19:21:25.616057] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-24T19:21:25.787516] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T19:21:26.116779] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T19:21:26.416166] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-24T19:21:27.216116] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-24T19:21:27.439712] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T19:21:27.743856] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T19:21:27.753881] [INFO ] [REMOTE ] HUBB: Full fetch complete (53597 records). [2025-09-24T19:21:27.754080] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-24T19:21:28.021287] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-24T19:21:28.168380] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-24T19:21:28.168465] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-24T19:21:28.169370] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-24T19:21:28.169433] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-24T19:21:28.170729] [DEBUG] [LOCAL ] HUBB: Trimmed 53597 records to 37168 (keeping 200 days of data) [2025-09-24T19:21:28.412086] [DEBUG] [LOCAL ] HUBB: Primary data saved (37168 records). [2025-09-24T19:21:28.412271] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-24T19:21:28.412384] [INFO ] [MAIN ] Update Progress: 1067/2373 symbols completed. HUBB took 37.4s. Estimated remaining: 2h 53m 5s. Rate: 7.5 symbols/min [2025-09-24T19:21:28.607591] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:28.624795] [DEBUG] [LOCAL ] HVT: Loaded 16034 existing records from primary storage. [2025-09-24T19:21:28.624926] [INFO ] [MAIN ] HVT: Loaded 16034 existing records. [2025-09-24T19:21:28.828615] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T19:21:28.826463] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-24T19:21:28.843740] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:28.844048] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-24T19:21:28.844100] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-24T19:21:28.844999] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-24T19:21:28.845115] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-24T19:21:29.209926] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:29.616235] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-24T19:21:29.821502] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T19:21:30.328210] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T19:21:30.416132] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-24T19:21:31.079092] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T19:21:31.216130] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-24T19:21:32.016123] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-24T19:21:32.153536] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:21:32.816208] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-24T19:21:33.161019] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T19:21:33.616053] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-24T19:21:33.717256] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T19:21:33.947668] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T19:21:34.416153] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-24T19:21:35.216060] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-24T19:21:35.378117] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T19:21:35.419419] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:21:36.016104] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-24T19:21:36.760802] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:21:36.816125] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-24T19:21:37.110947] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T19:21:37.616115] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-24T19:21:38.416144] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-24T19:21:38.492315] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T19:21:39.169628] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T19:21:39.216116] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-24T19:21:39.710993] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T19:21:40.016115] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-24T19:21:40.499622] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T19:21:40.816073] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-24T19:21:41.118519] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T19:21:41.616104] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-24T19:21:42.416160] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-24T19:21:42.554951] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T19:21:43.216103] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-24T19:21:43.319451] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T19:21:44.021299] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-24T19:21:44.039715] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T19:21:44.156701] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-24T19:21:44.816109] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-24T19:21:45.616130] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-24T19:21:45.899919] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T19:21:46.396896] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T19:21:46.416046] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-24T19:21:46.532684] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T19:21:47.063398] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T19:21:47.216091] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-24T19:21:47.935863] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T19:21:48.016120] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-24T19:21:48.816100] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-24T19:21:48.921436] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T19:21:48.926036] [INFO ] [REMOTE ] HVT: Full fetch complete (23711 records). [2025-09-24T19:21:48.926144] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-24T19:21:49.328024] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-24T19:21:49.328116] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-24T19:21:49.328819] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-24T19:21:49.328883] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-24T19:21:49.329689] [DEBUG] [LOCAL ] HVT: Trimmed 23711 records to 16003 (keeping 200 days of data) [2025-09-24T19:21:49.429281] [DEBUG] [LOCAL ] HVT: Primary data saved (16003 records). [2025-09-24T19:21:49.429453] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-24T19:21:49.429550] [INFO ] [MAIN ] Update Progress: 1068/2373 symbols completed. HVT took 21.0s. Estimated remaining: 2h 53m 13s. Rate: 7.5 symbols/min [2025-09-24T19:21:49.609346] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:49.616135] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-24T19:21:49.668687] [DEBUG] [LOCAL ] HWM: Loaded 53013 existing records from primary storage. [2025-09-24T19:21:49.668900] [INFO ] [MAIN ] HWM: Loaded 53013 existing records. [2025-09-24T19:21:49.854250] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:49.854548] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-24T19:21:49.854601] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-24T19:21:49.855981] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-24T19:21:49.856045] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-24T19:21:50.224467] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:50.253517] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T19:21:50.416101] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-24T19:21:51.216102] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-24T19:21:51.398209] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:21:52.016139] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-24T19:21:52.096080] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T19:21:52.105220] [INFO ] [REMOTE ] HUYA: Full fetch complete (63828 records). [2025-09-24T19:21:52.105383] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-24T19:21:52.507018] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-24T19:21:52.507166] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-24T19:21:52.508119] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-24T19:21:52.508238] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-24T19:21:52.509849] [DEBUG] [LOCAL ] HUYA: Trimmed 63828 records to 44413 (keeping 200 days of data) [2025-09-24T19:21:52.782810] [DEBUG] [LOCAL ] HUYA: Primary data saved (44413 records). [2025-09-24T19:21:52.783047] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-24T19:21:52.783216] [INFO ] [MAIN ] Update Progress: 1069/2373 symbols completed. HUYA took 28.8s. Estimated remaining: 2h 52m 60s. Rate: 7.5 symbols/min [2025-09-24T19:21:52.816827] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-24T19:21:52.938841] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T19:21:53.015577] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:53.066289] [DEBUG] [LOCAL ] HXL: Loaded 46079 existing records from primary storage. [2025-09-24T19:21:53.066572] [INFO ] [MAIN ] HXL: Loaded 46079 existing records. [2025-09-24T19:21:53.246498] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:53.246806] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-24T19:21:53.246862] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-24T19:21:53.249460] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-24T19:21:53.249523] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-24T19:21:53.620004] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:53.620190] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-24T19:21:53.691610] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:21:54.383166] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T19:21:54.392503] [INFO ] [REMOTE ] HUM: Full fetch complete (70968 records). [2025-09-24T19:21:54.392692] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-24T19:21:54.425579] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-24T19:21:54.792611] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-24T19:21:54.792772] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-24T19:21:54.793779] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-24T19:21:54.793844] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-24T19:21:54.795424] [DEBUG] [LOCAL ] HUM: Trimmed 70968 records to 48864 (keeping 200 days of data) [2025-09-24T19:21:55.122771] [DEBUG] [LOCAL ] HUM: Primary data saved (48864 records). [2025-09-24T19:21:55.122941] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-24T19:21:55.123040] [INFO ] [MAIN ] Update Progress: 1070/2373 symbols completed. HUM took 40.3s. Estimated remaining: 2h 52m 45s. Rate: 7.5 symbols/min [2025-09-24T19:21:55.224223] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-24T19:21:55.297471] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:21:55.309225] [DEBUG] [LOCAL ] HY: Loaded 10134 existing records from primary storage. [2025-09-24T19:21:55.309366] [INFO ] [MAIN ] HY: Loaded 10134 existing records. [2025-09-24T19:21:55.491605] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:21:55.492202] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-24T19:21:55.492260] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-24T19:21:55.492635] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-24T19:21:55.492724] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-24T19:21:55.643415] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T19:21:55.919869] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:21:56.016054] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-24T19:21:56.062023] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T19:21:56.816099] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-24T19:21:56.841715] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T19:21:57.035207] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:21:57.616143] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-24T19:21:58.187730] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:21:58.416102] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-24T19:21:59.067248] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T19:21:59.216127] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-24T19:21:59.409852] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T19:22:00.016120] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-24T19:22:00.816112] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-24T19:22:01.616088] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-24T19:22:01.728501] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T19:22:01.771045] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T19:22:01.840102] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-24T19:22:01.850437] [INFO ] [REMOTE ] HUN: Full fetch complete (76603 records). [2025-09-24T19:22:01.850611] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-24T19:22:02.291750] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-24T19:22:02.291878] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-24T19:22:02.293205] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-24T19:22:02.293296] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-24T19:22:02.295434] [DEBUG] [LOCAL ] HUN: Trimmed 76603 records to 53196 (keeping 200 days of data) [2025-09-24T19:22:02.416124] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-24T19:22:02.657884] [DEBUG] [LOCAL ] HUN: Primary data saved (53196 records). [2025-09-24T19:22:02.658087] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-24T19:22:02.658213] [INFO ] [MAIN ] Update Progress: 1071/2373 symbols completed. HUN took 40.3s. Estimated remaining: 2h 52m 36s. Rate: 7.5 symbols/min [2025-09-24T19:22:02.851459] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:02.851743] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-24T19:22:02.851794] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-24T19:22:02.851973] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-24T19:22:02.852021] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-24T19:22:02.852063] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-24T19:22:02.852109] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-24T19:22:03.218670] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-24T19:22:03.267495] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:03.421733] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T19:22:03.447217] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T19:22:04.016153] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-24T19:22:04.816097] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-24T19:22:04.874245] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T19:22:05.148729] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-24T19:22:05.616087] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-24T19:22:05.817772] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T19:22:06.416104] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-24T19:22:07.150304] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:22:07.216038] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-24T19:22:08.016105] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-24T19:22:08.384502] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T19:22:08.797040] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T19:22:08.816037] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-24T19:22:08.931370] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T19:22:09.616128] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-24T19:22:10.217711] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T19:22:10.416097] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-24T19:22:10.425735] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T19:22:11.216121] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-24T19:22:11.797963] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T19:22:12.016064] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-24T19:22:12.369668] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T19:22:12.722438] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T19:22:12.816116] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-24T19:22:13.615699] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T19:22:13.618821] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-24T19:22:13.938135] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-24T19:22:14.416110] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-24T19:22:14.741256] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-24T19:22:15.216133] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-24T19:22:16.016134] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-24T19:22:16.816167] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-24T19:22:16.975396] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T19:22:16.978428] [INFO ] [REMOTE ] HY: Full fetch complete (15254 records). [2025-09-24T19:22:16.978516] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-24T19:22:17.391676] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-24T19:22:17.391970] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-24T19:22:17.394002] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T19:22:17.392819] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-24T19:22:17.404770] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-24T19:22:17.405886] [DEBUG] [LOCAL ] HY: Trimmed 15254 records to 10087 (keeping 200 days of data) [2025-09-24T19:22:17.482139] [DEBUG] [LOCAL ] HY: Primary data saved (10087 records). [2025-09-24T19:22:17.482809] [INFO ] [MAIN ] HY: Full history saved. [2025-09-24T19:22:17.483023] [INFO ] [MAIN ] Update Progress: 1072/2373 symbols completed. HY took 22.4s. Estimated remaining: 2h 52m 37s. Rate: 7.5 symbols/min [2025-09-24T19:22:17.631803] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-24T19:22:17.672334] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:17.672573] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-24T19:22:17.672631] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-24T19:22:17.672819] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-24T19:22:17.672874] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-24T19:22:17.672944] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-24T19:22:17.673019] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-24T19:22:18.065002] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:18.416158] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-24T19:22:18.502974] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T19:22:18.809637] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-24T19:22:19.216088] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-24T19:22:19.619052] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T19:22:20.016109] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-24T19:22:20.325212] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-24T19:22:20.699322] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T19:22:20.816111] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-24T19:22:21.616151] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-24T19:22:22.416153] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-24T19:22:22.748547] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T19:22:23.175350] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:22:23.183371] [INFO ] [REMOTE ] HXL: Full fetch complete (66127 records). [2025-09-24T19:22:23.183521] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-24T19:22:23.221178] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-24T19:22:23.620964] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-24T19:22:23.621277] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-24T19:22:23.622792] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-24T19:22:23.623996] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-24T19:22:23.624091] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-24T19:22:23.625735] [DEBUG] [LOCAL ] HXL: Trimmed 66127 records to 45976 (keeping 200 days of data) [2025-09-24T19:22:23.926479] [DEBUG] [LOCAL ] HXL: Primary data saved (45976 records). [2025-09-24T19:22:23.926634] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-24T19:22:23.926799] [INFO ] [MAIN ] Update Progress: 1073/2373 symbols completed. HXL took 31.1s. Estimated remaining: 2h 52m 27s. Rate: 7.5 symbols/min [2025-09-24T19:22:24.023937] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-24T19:22:24.097268] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:24.107722] [DEBUG] [LOCAL ] HYI: Loaded 8893 existing records from primary storage. [2025-09-24T19:22:24.107832] [INFO ] [MAIN ] HYI: Loaded 8893 existing records. [2025-09-24T19:22:24.282193] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:22:24.282426] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-24T19:22:24.282484] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-24T19:22:24.283197] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-24T19:22:24.283258] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-24T19:22:24.385217] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-24T19:22:24.649602] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:24.816088] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-24T19:22:25.616071] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-24T19:22:25.854298] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T19:22:25.946080] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-24T19:22:26.416048] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-24T19:22:26.530608] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (5.71 seconds). [2025-09-24T19:22:26.543888] [INFO ] [REMOTE ] HWM: Full fetch complete (76644 records). [2025-09-24T19:22:26.544055] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-24T19:22:26.834324] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-24T19:22:26.972919] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-24T19:22:26.973043] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-24T19:22:26.974119] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-24T19:22:26.974218] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-24T19:22:26.979940] [DEBUG] [LOCAL ] HWM: Trimmed 76644 records to 53011 (keeping 200 days of data) [2025-09-24T19:22:27.216193] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-24T19:22:27.344306] [DEBUG] [LOCAL ] HWM: Primary data saved (53011 records). [2025-09-24T19:22:27.344477] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-24T19:22:27.344635] [INFO ] [MAIN ] Update Progress: 1074/2373 symbols completed. HWM took 37.9s. Estimated remaining: 2h 52m 14s. Rate: 7.5 symbols/min [2025-09-24T19:22:27.533421] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:27.552186] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T19:22:27.577314] [DEBUG] [LOCAL ] HYT: Loaded 33213 existing records from primary storage. [2025-09-24T19:22:27.577459] [INFO ] [MAIN ] HYT: Loaded 33213 existing records. [2025-09-24T19:22:27.825330] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:22:27.825609] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-24T19:22:27.825686] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-24T19:22:27.826494] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-24T19:22:27.826557] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-24T19:22:28.023836] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-24T19:22:28.209853] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:28.816071] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-24T19:22:28.872443] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T19:22:29.616089] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-24T19:22:30.068009] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T19:22:30.360703] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T19:22:30.416119] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-24T19:22:31.216128] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-24T19:22:31.713458] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T19:22:31.738787] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T19:22:32.016138] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-24T19:22:32.427756] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-24T19:22:32.816160] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-24T19:22:33.128718] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-24T19:22:33.616126] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-24T19:22:34.374498] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T19:22:34.416120] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-24T19:22:35.216065] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-24T19:22:35.288563] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T19:22:35.452292] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-24T19:22:36.016088] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-24T19:22:36.348948] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-24T19:22:36.349907] [INFO ] [REMOTE ] HYAC: Full fetch complete (868 records). [2025-09-24T19:22:36.349996] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-24T19:22:36.350541] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T19:22:36.350713] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:22:36.350778] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:22:36.350915] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-24T19:22:36.351139] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-24T19:22:36.351281] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-24T19:22:36.351388] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-24T19:22:36.351523] [INFO ] [MAIN ] Update Progress: 1075/2373 symbols completed. HYAC took 33.7s. Estimated remaining: 2h 52m 7s. Rate: 7.5 symbols/min [2025-09-24T19:22:36.536858] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:36.547196] [DEBUG] [LOCAL ] HYTR: Loaded 3182 existing records from primary storage. [2025-09-24T19:22:36.547320] [INFO ] [MAIN ] HYTR: Loaded 3182 existing records. [2025-09-24T19:22:36.728493] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:22:36.728807] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-24T19:22:36.728893] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-24T19:22:36.729334] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-24T19:22:36.729421] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-24T19:22:36.821184] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-24T19:22:37.112798] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:37.610715] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T19:22:37.616023] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-24T19:22:38.334154] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T19:22:38.416081] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-24T19:22:39.216104] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-24T19:22:39.263324] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T19:22:39.476740] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-24T19:22:40.016091] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-24T19:22:40.816060] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-24T19:22:40.826035] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T19:22:41.142144] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-24T19:22:41.616102] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-24T19:22:42.416101] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-24T19:22:42.690579] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T19:22:42.753049] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T19:22:43.216121] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-24T19:22:43.743716] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-24T19:22:44.016121] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-24T19:22:44.556730] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T19:22:44.816106] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-24T19:22:45.544781] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T19:22:45.616050] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-24T19:22:45.936682] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-24T19:22:46.416084] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-24T19:22:46.769482] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-24T19:22:46.770216] [INFO ] [REMOTE ] HYBX: Full fetch complete (802 records). [2025-09-24T19:22:46.770285] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-24T19:22:46.946156] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-24T19:22:46.946383] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:22:46.946436] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:22:46.946478] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-24T19:22:46.946541] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-24T19:22:46.946578] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-24T19:22:46.946639] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-24T19:22:46.946766] [INFO ] [MAIN ] Update Progress: 1076/2373 symbols completed. HYBX took 29.5s. Estimated remaining: 2h 52m 2s. Rate: 7.5 symbols/min [2025-09-24T19:22:47.126755] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:22:47.168226] [DEBUG] [LOCAL ] HZO: Loaded 29357 existing records from primary storage. [2025-09-24T19:22:47.168416] [INFO ] [MAIN ] HZO: Loaded 29357 existing records. [2025-09-24T19:22:47.225284] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-24T19:22:47.360760] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:22:47.361024] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-24T19:22:47.361076] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-24T19:22:47.362232] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-24T19:22:47.362299] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-24T19:22:47.735785] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:22:48.016083] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-24T19:22:48.496970] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T19:22:48.816099] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-24T19:22:49.080561] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T19:22:49.616072] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-24T19:22:50.312332] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T19:22:50.416079] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-24T19:22:50.835155] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T19:22:51.216387] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-24T19:22:51.755860] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T19:22:52.016137] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-24T19:22:52.816131] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-24T19:22:53.616147] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-24T19:23:04.815328] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (12.00 seconds). [2025-09-24T19:23:04.817062] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-24T19:23:05.031923] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (13.02 seconds). [2025-09-24T19:23:05.039059] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-24T19:23:05.538235] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (14.32 seconds). [2025-09-24T19:23:05.543493] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-24T19:23:05.600408] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (11.98 seconds). [2025-09-24T19:23:05.601115] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T19:23:05.604989] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-24T19:23:05.604688] [INFO ] [REMOTE ] HYI: Full fetch complete (12854 records). [2025-09-24T19:23:05.605913] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-24T19:23:05.985605] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-24T19:23:05.985965] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-24T19:23:05.986362] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-24T19:23:05.986424] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-24T19:23:05.986991] [DEBUG] [LOCAL ] HYI: Trimmed 12854 records to 8938 (keeping 200 days of data) [2025-09-24T19:23:06.053284] [DEBUG] [LOCAL ] HYI: Primary data saved (8938 records). [2025-09-24T19:23:06.053456] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-24T19:23:06.053709] [INFO ] [MAIN ] Update Progress: 1077/2373 symbols completed. HYI took 42.1s. Estimated remaining: 2h 52m 8s. Rate: 7.5 symbols/min [2025-09-24T19:23:06.412187] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T19:23:06.413745] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-24T19:23:06.492743] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T19:23:06.500592] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-24T19:23:06.664621] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T19:23:06.671401] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-24T19:23:06.765490] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T19:23:06.767018] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-24T19:23:07.310768] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T19:23:07.312154] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-24T19:23:07.800508] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:23:07.808490] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-24T19:23:07.906902] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T19:23:07.908016] [INFO ] [REMOTE ] HYTR: Full fetch complete (4449 records). [2025-09-24T19:23:07.908085] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-24T19:23:08.294170] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-24T19:23:08.294353] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-24T19:23:08.294673] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-24T19:23:08.303929] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-24T19:23:08.319238] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T19:23:08.318424] [DEBUG] [LOCAL ] HYTR: Trimmed 4449 records to 3166 (keeping 200 days of data) [2025-09-24T19:23:08.328141] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-24T19:23:08.348411] [DEBUG] [LOCAL ] HYTR: Primary data saved (3166 records). [2025-09-24T19:23:08.348518] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-24T19:23:08.348603] [INFO ] [MAIN ] Update Progress: 1078/2373 symbols completed. HYTR took 32.0s. Estimated remaining: 2h 51m 53s. Rate: 7.5 symbols/min [2025-09-24T19:23:09.189316] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:23:09.195327] [INFO ] [REMOTE ] HYT: Full fetch complete (46911 records). [2025-09-24T19:23:09.195483] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-24T19:23:09.607396] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T19:23:09.631625] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-24T19:23:09.631904] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-24T19:23:09.632248] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-24T19:23:09.633237] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-24T19:23:09.633427] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-24T19:23:09.635716] [DEBUG] [LOCAL ] HYT: Trimmed 46911 records to 33293 (keeping 200 days of data) [2025-09-24T19:23:09.858603] [DEBUG] [LOCAL ] HYT: Primary data saved (33293 records). [2025-09-24T19:23:09.858786] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-24T19:23:09.858896] [INFO ] [MAIN ] Update Progress: 1079/2373 symbols completed. HYT took 42.5s. Estimated remaining: 2h 51m 37s. Rate: 7.5 symbols/min [2025-09-24T19:23:10.916072] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T19:23:10.922433] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-24T19:23:12.264599] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T19:23:12.274227] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-24T19:23:13.350943] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T19:23:13.357262] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-24T19:23:14.599238] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T19:23:14.608811] [INFO ] [REMOTE ] HZO: Full fetch complete (40704 records). [2025-09-24T19:23:14.609112] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-24T19:23:15.207392] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-24T19:23:15.207529] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-24T19:23:15.209332] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-24T19:23:15.209430] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-24T19:23:15.211179] [DEBUG] [LOCAL ] HZO: Trimmed 40704 records to 29309 (keeping 200 days of data) [2025-09-24T19:23:15.426061] [DEBUG] [LOCAL ] HZO: Primary data saved (29309 records). [2025-09-24T19:23:15.426336] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-24T19:23:15.426483] [INFO ] [MAIN ] Update Progress: 1080/2373 symbols completed. HZO took 28.5s. Estimated remaining: 2h 51m 26s. Rate: 7.5 symbols/min [2025-09-24T19:23:16.014691] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:16.064001] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:16.105016] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:16.156173] [DEBUG] [LOCAL ] IAE: Loaded 5892 existing records from primary storage. [2025-09-24T19:23:16.191867] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:16.192186] [INFO ] [MAIN ] IAE: Loaded 5892 existing records. [2025-09-24T19:23:16.445857] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:16.446314] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-24T19:23:16.446400] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-24T19:23:16.447384] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-24T19:23:16.447466] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-24T19:23:16.611901] [DEBUG] [LOCAL ] IBN: Loaded 52892 existing records from primary storage. [2025-09-24T19:23:16.624087] [INFO ] [MAIN ] IBN: Loaded 52892 existing records. [2025-09-24T19:23:16.630202] [DEBUG] [LOCAL ] IAG: Loaded 53442 existing records from primary storage. [2025-09-24T19:23:16.630428] [INFO ] [MAIN ] IAG: Loaded 53442 existing records. [2025-09-24T19:23:16.642845] [DEBUG] [LOCAL ] IBM: Loaded 53639 existing records from primary storage. [2025-09-24T19:23:16.733990] [INFO ] [MAIN ] IBM: Loaded 53639 existing records. [2025-09-24T19:23:17.263931] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:17.410846] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-24T19:23:17.410705] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:17.414596] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-24T19:23:17.415138] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-24T19:23:17.414746] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:17.421088] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-24T19:23:17.431754] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-24T19:23:17.421007] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-24T19:23:17.437127] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-24T19:23:17.473250] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-24T19:23:17.533142] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:17.542348] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-24T19:23:17.505087] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-24T19:23:17.567286] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-24T19:23:17.600678] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-24T19:23:17.646670] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-24T19:23:18.453626] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T19:23:18.532999] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:18.542671] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-24T19:23:18.568159] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-24T19:23:18.627666] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:18.628421] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-24T19:23:18.716574] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:18.716994] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-24T19:23:19.228824] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T19:23:19.230602] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-24T19:23:19.876894] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T19:23:19.879031] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-24T19:23:20.384045] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T19:23:20.394517] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-24T19:23:20.444465] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T19:23:20.447180] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-24T19:23:20.450393] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T19:23:20.461788] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-24T19:23:20.591395] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T19:23:20.602230] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-24T19:23:21.062180] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T19:23:21.063982] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-24T19:23:21.781946] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T19:23:21.784079] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-24T19:23:22.055594] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T19:23:22.068946] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-24T19:23:22.289538] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T19:23:22.300669] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-24T19:23:22.536901] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T19:23:22.548820] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-24T19:23:22.596991] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T19:23:22.599378] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-24T19:23:23.001969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-24T19:23:23.004244] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-24T19:23:23.382751] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-24T19:23:23.385121] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-24T19:23:23.754712] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T19:23:23.770411] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-24T19:23:23.848278] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T19:23:23.858434] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-24T19:23:24.216303] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T19:23:24.218836] [INFO ] [REMOTE ] IAE: Full fetch complete (8642 records). [2025-09-24T19:23:24.218935] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-24T19:23:24.631390] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-24T19:23:24.631554] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-24T19:23:24.631857] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-24T19:23:24.631964] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-24T19:23:24.632619] [DEBUG] [LOCAL ] IAE: Trimmed 8642 records to 5981 (keeping 200 days of data) [2025-09-24T19:23:24.692073] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-24T19:23:24.706977] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-24T19:23:24.710410] [DEBUG] [LOCAL ] IAE: Primary data saved (5981 records). [2025-09-24T19:23:24.710487] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-24T19:23:24.710573] [INFO ] [MAIN ] Update Progress: 1081/2373 symbols completed. IAE took 9.3s. Estimated remaining: 2h 51m 20s. Rate: 7.5 symbols/min [2025-09-24T19:23:24.882622] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:24.913547] [DEBUG] [LOCAL ] IBP: Loaded 29338 existing records from primary storage. [2025-09-24T19:23:24.913708] [INFO ] [MAIN ] IBP: Loaded 29338 existing records. [2025-09-24T19:23:25.095565] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:25.096064] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-24T19:23:25.096114] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-24T19:23:25.097101] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-24T19:23:25.097162] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-24T19:23:25.468510] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:25.468975] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-24T19:23:25.567214] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T19:23:25.578302] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-24T19:23:25.778529] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T19:23:25.789691] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-24T19:23:26.574003] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T19:23:26.582128] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-24T19:23:26.961388] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-24T19:23:27.124200] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:23:27.216126] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-24T19:23:27.399704] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T19:23:27.795833] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T19:23:28.016097] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-24T19:23:28.816159] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-24T19:23:29.330408] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T19:23:29.600594] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T19:23:29.616035] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-24T19:23:30.416074] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-24T19:23:30.453139] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T19:23:31.216100] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-24T19:23:31.806239] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-24T19:23:32.016100] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-24T19:23:32.408404] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-24T19:23:32.644964] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:23:32.816087] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-24T19:23:33.183963] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T19:23:33.616359] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-24T19:23:34.416112] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-24T19:23:34.708050] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T19:23:34.910142] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:23:35.216114] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-24T19:23:36.016062] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-24T19:23:36.347675] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T19:23:36.816128] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-24T19:23:37.457135] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-24T19:23:37.543284] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:23:37.616042] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-24T19:23:38.416048] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-24T19:23:38.583178] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T19:23:39.216096] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-24T19:23:39.577276] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T19:23:40.016135] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-24T19:23:40.869109] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-24T19:23:40.899381] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-24T19:23:41.090818] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T19:23:41.100047] [INFO ] [REMOTE ] IBN: Full fetch complete (76271 records). [2025-09-24T19:23:41.100188] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-24T19:23:41.515595] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-24T19:23:41.515748] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-24T19:23:41.517303] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-24T19:23:41.517633] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-24T19:23:41.519787] [DEBUG] [LOCAL ] IBN: Trimmed 76271 records to 52894 (keeping 200 days of data) [2025-09-24T19:23:41.618178] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-24T19:23:41.873510] [DEBUG] [LOCAL ] IBN: Primary data saved (52894 records). [2025-09-24T19:23:41.873683] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-24T19:23:41.873799] [INFO ] [MAIN ] Update Progress: 1082/2373 symbols completed. IBN took 26.4s. Estimated remaining: 2h 51m 23s. Rate: 7.5 symbols/min [2025-09-24T19:23:42.055599] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:42.086033] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T19:23:42.096820] [INFO ] [REMOTE ] IAG: Full fetch complete (77212 records). [2025-09-24T19:23:42.097093] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-24T19:23:42.427343] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T19:23:42.438893] [DEBUG] [LOCAL ] IBTA: Loaded 38052 existing records from primary storage. [2025-09-24T19:23:42.454763] [INFO ] [MAIN ] IBTA: Loaded 38052 existing records. [2025-09-24T19:23:42.501610] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-24T19:23:42.762153] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-24T19:23:42.779069] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-24T19:23:42.787001] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-24T19:23:42.787143] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:42.787319] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-24T19:23:42.787595] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-24T19:23:42.787686] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-24T19:23:42.788913] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-24T19:23:42.788981] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-24T19:23:42.818394] [DEBUG] [LOCAL ] IAG: Trimmed 77212 records to 53445 (keeping 200 days of data) [2025-09-24T19:23:43.309631] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:43.324047] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-24T19:23:43.549964] [DEBUG] [LOCAL ] IAG: Primary data saved (53445 records). [2025-09-24T19:23:43.550194] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-24T19:23:43.550307] [INFO ] [MAIN ] Update Progress: 1083/2373 symbols completed. IAG took 28.1s. Estimated remaining: 2h 51m 7s. Rate: 7.5 symbols/min [2025-09-24T19:23:43.753371] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:43.811522] [DEBUG] [LOCAL ] ICE: Loaded 53019 existing records from primary storage. [2025-09-24T19:23:43.811721] [INFO ] [MAIN ] ICE: Loaded 53019 existing records. [2025-09-24T19:23:44.000988] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:44.021174] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T19:23:44.021544] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-24T19:23:44.028211] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-24T19:23:44.028860] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-24T19:23:44.029975] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-24T19:23:44.030184] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-24T19:23:44.362567] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-24T19:23:44.446910] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:44.660372] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T19:23:44.816085] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-24T19:23:45.224809] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:23:45.616083] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-24T19:23:46.416072] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-24T19:23:46.838928] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T19:23:47.072497] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-24T19:23:47.082076] [INFO ] [REMOTE ] IBM: Full fetch complete (77617 records). [2025-09-24T19:23:47.082229] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-24T19:23:47.226766] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-24T19:23:47.582785] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-24T19:23:47.582919] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-24T19:23:47.584781] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-24T19:23:47.584872] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-24T19:23:47.586778] [DEBUG] [LOCAL ] IBM: Trimmed 77617 records to 53636 (keeping 200 days of data) [2025-09-24T19:23:47.942346] [DEBUG] [LOCAL ] IBM: Primary data saved (53636 records). [2025-09-24T19:23:47.942551] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-24T19:23:47.942703] [INFO ] [MAIN ] Update Progress: 1084/2373 symbols completed. IBM took 32.5s. Estimated remaining: 2h 50m 55s. Rate: 7.5 symbols/min [2025-09-24T19:23:48.024316] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-24T19:23:48.121851] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:48.161024] [DEBUG] [LOCAL ] ICL: Loaded 38666 existing records from primary storage. [2025-09-24T19:23:48.161308] [INFO ] [MAIN ] ICL: Loaded 38666 existing records. [2025-09-24T19:23:48.355565] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:48.356291] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-24T19:23:48.356414] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-24T19:23:48.367879] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-24T19:23:48.373526] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-24T19:23:48.503411] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-24T19:23:48.825985] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-24T19:23:48.824729] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:48.825903] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:23:49.193684] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T19:23:49.616084] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-24T19:23:50.416067] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-24T19:23:50.480132] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:23:51.041808] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:23:51.216110] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-24T19:23:51.883250] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T19:23:51.890005] [INFO ] [REMOTE ] IBP: Full fetch complete (41062 records). [2025-09-24T19:23:51.890195] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-24T19:23:52.021258] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-24T19:23:52.287524] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-24T19:23:52.287602] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-24T19:23:52.288354] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-24T19:23:52.288417] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-24T19:23:52.289379] [DEBUG] [LOCAL ] IBP: Trimmed 41062 records to 29270 (keeping 200 days of data) [2025-09-24T19:23:52.486451] [DEBUG] [LOCAL ] IBP: Primary data saved (29270 records). [2025-09-24T19:23:52.486583] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-24T19:23:52.486696] [INFO ] [MAIN ] Update Progress: 1085/2373 symbols completed. IBP took 27.8s. Estimated remaining: 2h 50m 43s. Rate: 7.5 symbols/min [2025-09-24T19:23:52.663970] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:23:52.702484] [DEBUG] [LOCAL ] IDA: Loaded 32000 existing records from primary storage. [2025-09-24T19:23:52.702678] [INFO ] [MAIN ] IDA: Loaded 32000 existing records. [2025-09-24T19:23:52.845887] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-24T19:23:52.905268] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T19:23:52.915036] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:23:52.922276] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-24T19:23:52.922849] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-24T19:23:52.923843] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-24T19:23:52.923909] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-24T19:23:53.313031] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:23:53.616104] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-24T19:23:53.856345] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T19:23:54.416104] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-24T19:23:54.561754] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T19:23:55.078242] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T19:23:55.216050] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-24T19:23:55.721325] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T19:23:56.016170] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-24T19:23:56.824755] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-24T19:23:56.830484] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:23:57.550020] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:23:57.616086] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-24T19:23:58.283678] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T19:23:58.416040] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-24T19:23:58.930450] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T19:23:59.216084] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-24T19:23:59.728146] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:24:00.016090] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-24T19:24:00.399140] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T19:24:00.816085] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-24T19:24:01.616117] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-24T19:24:02.416105] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-24T19:24:02.459142] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-24T19:24:02.516673] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T19:24:03.216138] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-24T19:24:04.016071] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-24T19:24:04.430796] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-24T19:24:04.667774] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T19:24:04.816059] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-24T19:24:05.141682] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-24T19:24:05.616071] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-24T19:24:05.906217] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T19:24:06.067599] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T19:24:06.416169] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-24T19:24:07.067763] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T19:24:07.216404] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-24T19:24:07.961211] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T19:24:08.016094] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-24T19:24:08.301292] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T19:24:08.816093] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-24T19:24:09.578388] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T19:24:09.616129] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-24T19:24:10.416088] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-24T19:24:10.544634] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T19:24:10.960348] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T19:24:11.216107] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-24T19:24:11.751127] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T19:24:12.016087] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-24T19:24:12.816158] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-24T19:24:13.007973] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T19:24:13.358014] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T19:24:13.364539] [INFO ] [REMOTE ] ICL: Full fetch complete (56273 records). [2025-09-24T19:24:13.364639] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-24T19:24:13.621189] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-24T19:24:13.784333] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-24T19:24:13.784425] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-24T19:24:13.785397] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-24T19:24:13.785467] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-24T19:24:13.786980] [DEBUG] [LOCAL ] ICL: Trimmed 56273 records to 38635 (keeping 200 days of data) [2025-09-24T19:24:14.010723] [DEBUG] [LOCAL ] ICL: Primary data saved (38635 records). [2025-09-24T19:24:14.011003] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-24T19:24:14.011137] [INFO ] [MAIN ] Update Progress: 1086/2373 symbols completed. ICL took 26.1s. Estimated remaining: 2h 50m 51s. Rate: 7.5 symbols/min [2025-09-24T19:24:14.195600] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:14.207001] [DEBUG] [LOCAL ] IDE: Loaded 8535 existing records from primary storage. [2025-09-24T19:24:14.207115] [INFO ] [MAIN ] IDE: Loaded 8535 existing records. [2025-09-24T19:24:14.401041] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:14.401801] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-24T19:24:14.402059] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-24T19:24:14.422634] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-24T19:24:14.424273] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-24T19:24:14.424768] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-24T19:24:14.431110] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T19:24:14.802503] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:15.216136] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-24T19:24:15.871625] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T19:24:16.016129] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-24T19:24:16.816062] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-24T19:24:17.104717] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-24T19:24:17.433386] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T19:24:17.593175] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T19:24:17.616033] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-24T19:24:17.697672] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T19:24:17.705010] [INFO ] [REMOTE ] IBTA: Full fetch complete (50553 records). [2025-09-24T19:24:17.705112] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-24T19:24:18.110436] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-24T19:24:18.110527] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-24T19:24:18.111338] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-24T19:24:18.111402] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-24T19:24:18.112571] [DEBUG] [LOCAL ] IBTA: Trimmed 50553 records to 37926 (keeping 200 days of data) [2025-09-24T19:24:18.314454] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-24T19:24:18.349442] [DEBUG] [LOCAL ] IBTA: Primary data saved (37926 records). [2025-09-24T19:24:18.349604] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-24T19:24:18.349717] [INFO ] [MAIN ] Update Progress: 1087/2373 symbols completed. IBTA took 36.5s. Estimated remaining: 2h 50m 39s. Rate: 7.5 symbols/min [2025-09-24T19:24:18.421151] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-24T19:24:18.532456] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:18.551808] [DEBUG] [LOCAL ] IDT: Loaded 17675 existing records from primary storage. [2025-09-24T19:24:18.551960] [INFO ] [MAIN ] IDT: Loaded 17675 existing records. [2025-09-24T19:24:18.730799] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:18.731125] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-24T19:24:18.731183] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-24T19:24:18.731814] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-24T19:24:18.731876] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-24T19:24:19.102430] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:19.216105] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-24T19:24:19.734209] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T19:24:19.739224] [INFO ] [REMOTE ] IDA: Full fetch complete (44615 records). [2025-09-24T19:24:19.739348] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-24T19:24:20.027127] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-24T19:24:20.133672] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-24T19:24:20.134527] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T19:24:20.134253] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-24T19:24:20.138897] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-24T19:24:20.138965] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-24T19:24:20.140282] [DEBUG] [LOCAL ] IDA: Trimmed 44615 records to 31989 (keeping 200 days of data) [2025-09-24T19:24:20.346494] [DEBUG] [LOCAL ] IDA: Primary data saved (31989 records). [2025-09-24T19:24:20.346660] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-24T19:24:20.346803] [INFO ] [MAIN ] Update Progress: 1088/2373 symbols completed. IDA took 27.9s. Estimated remaining: 2h 50m 24s. Rate: 7.5 symbols/min [2025-09-24T19:24:20.520581] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:20.562162] [DEBUG] [LOCAL ] IEX: Loaded 38405 existing records from primary storage. [2025-09-24T19:24:20.562363] [INFO ] [MAIN ] IEX: Loaded 38405 existing records. [2025-09-24T19:24:20.742488] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:20.742866] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-24T19:24:20.742934] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-24T19:24:20.744067] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-24T19:24:20.744133] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-24T19:24:20.821162] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-24T19:24:21.113206] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:21.616052] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-24T19:24:21.632994] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T19:24:22.027282] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T19:24:22.038099] [INFO ] [REMOTE ] ICE: Full fetch complete (76769 records). [2025-09-24T19:24:22.038272] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-24T19:24:22.161636] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T19:24:22.417545] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-24T19:24:22.437451] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-24T19:24:22.437538] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-24T19:24:22.438600] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-24T19:24:22.438775] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-24T19:24:22.440401] [DEBUG] [LOCAL ] ICE: Trimmed 76769 records to 53025 (keeping 200 days of data) [2025-09-24T19:24:22.781898] [DEBUG] [LOCAL ] ICE: Primary data saved (53025 records). [2025-09-24T19:24:22.782070] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-24T19:24:22.782162] [INFO ] [MAIN ] Update Progress: 1089/2373 symbols completed. ICE took 39.2s. Estimated remaining: 2h 50m 10s. Rate: 7.5 symbols/min [2025-09-24T19:24:22.970832] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:23.025914] [DEBUG] [LOCAL ] IFF: Loaded 50969 existing records from primary storage. [2025-09-24T19:24:23.026077] [INFO ] [MAIN ] IFF: Loaded 50969 existing records. [2025-09-24T19:24:23.154253] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T19:24:23.214313] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:23.214537] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-24T19:24:23.214586] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-24T19:24:23.215774] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-24T19:24:23.215837] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-24T19:24:23.221171] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-24T19:24:23.572211] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:23.948401] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T19:24:24.016075] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-24T19:24:24.760534] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T19:24:24.816078] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-24T19:24:25.607494] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T19:24:25.616024] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-24T19:24:26.362940] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T19:24:26.416107] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-24T19:24:27.124728] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T19:24:27.216146] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-24T19:24:28.016132] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-24T19:24:28.259808] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T19:24:28.262078] [INFO ] [REMOTE ] IDE: Full fetch complete (12790 records). [2025-09-24T19:24:28.262162] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-24T19:24:28.620913] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-24T19:24:28.620990] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-24T19:24:28.621275] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-24T19:24:28.621313] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-24T19:24:28.621819] [DEBUG] [LOCAL ] IDE: Trimmed 12790 records to 8581 (keeping 200 days of data) [2025-09-24T19:24:28.674849] [DEBUG] [LOCAL ] IDE: Primary data saved (8581 records). [2025-09-24T19:24:28.674953] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-24T19:24:28.675054] [INFO ] [MAIN ] Update Progress: 1090/2373 symbols completed. IDE took 14.7s. Estimated remaining: 2h 49m 59s. Rate: 7.5 symbols/min [2025-09-24T19:24:28.821239] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-24T19:24:28.845959] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:28.866844] [DEBUG] [LOCAL ] IFN: Loaded 18212 existing records from primary storage. [2025-09-24T19:24:28.867007] [INFO ] [MAIN ] IFN: Loaded 18212 existing records. [2025-09-24T19:24:29.057977] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:29.058289] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-24T19:24:29.058344] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-24T19:24:29.059011] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-24T19:24:29.059072] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-24T19:24:29.422963] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:29.492248] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:24:29.588521] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:24:29.616053] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-24T19:24:30.416059] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-24T19:24:30.695734] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T19:24:31.216078] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-24T19:24:32.016075] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-24T19:24:32.113693] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T19:24:32.724014] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:24:32.816062] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-24T19:24:33.200394] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T19:24:33.616078] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-24T19:24:33.688611] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T19:24:34.416112] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-24T19:24:34.743682] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T19:24:35.216105] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-24T19:24:35.893276] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T19:24:36.016059] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-24T19:24:36.176436] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T19:24:36.816101] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-24T19:24:37.608165] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T19:24:37.616291] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-24T19:24:37.857389] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T19:24:38.416086] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-24T19:24:38.834233] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T19:24:39.216106] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-24T19:24:39.899344] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T19:24:40.016050] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-24T19:24:40.189769] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T19:24:40.816087] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-24T19:24:41.547390] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:24:41.610704] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T19:24:41.616027] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-24T19:24:42.416098] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-24T19:24:42.830252] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T19:24:42.834069] [INFO ] [REMOTE ] IDT: Full fetch complete (22619 records). [2025-09-24T19:24:42.834178] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-24T19:24:43.209922] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-24T19:24:43.210063] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-24T19:24:43.210691] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-24T19:24:43.210792] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-24T19:24:43.211575] [DEBUG] [LOCAL ] IDT: Trimmed 22619 records to 17671 (keeping 200 days of data) [2025-09-24T19:24:43.216132] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-24T19:24:43.326771] [DEBUG] [LOCAL ] IDT: Primary data saved (17671 records). [2025-09-24T19:24:43.326924] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-24T19:24:43.327077] [INFO ] [MAIN ] Update Progress: 1091/2373 symbols completed. IDT took 25.0s. Estimated remaining: 2h 49m 59s. Rate: 7.5 symbols/min [2025-09-24T19:24:43.497310] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:43.520705] [DEBUG] [LOCAL ] IFS: Loaded 23131 existing records from primary storage. [2025-09-24T19:24:43.520832] [INFO ] [MAIN ] IFS: Loaded 23131 existing records. [2025-09-24T19:24:43.699851] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:43.700136] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-24T19:24:43.700199] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-24T19:24:43.700831] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-24T19:24:43.700892] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-24T19:24:44.079009] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:44.054820] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-24T19:24:44.108825] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T19:24:44.760166] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T19:24:44.816101] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-24T19:24:44.929603] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T19:24:45.616085] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-24T19:24:46.301511] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T19:24:46.416196] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-24T19:24:46.566748] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T19:24:47.216115] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-24T19:24:48.011902] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:24:48.020246] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-24T19:24:48.215085] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:24:48.816130] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-24T19:24:49.186247] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T19:24:49.616051] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-24T19:24:49.987753] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T19:24:50.416100] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-24T19:24:51.208113] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:24:51.218817] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-24T19:24:51.466318] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T19:24:52.016207] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-24T19:24:52.772092] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:24:52.781801] [INFO ] [REMOTE ] IEX: Full fetch complete (53377 records). [2025-09-24T19:24:52.782713] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-24T19:24:52.821234] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-24T19:24:53.213741] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-24T19:24:53.214058] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-24T19:24:53.215555] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-24T19:24:53.215698] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-24T19:24:53.218713] [DEBUG] [LOCAL ] IEX: Trimmed 53377 records to 38371 (keeping 200 days of data) [2025-09-24T19:24:53.322061] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:24:53.528881] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T19:24:53.579062] [DEBUG] [LOCAL ] IEX: Primary data saved (38371 records). [2025-09-24T19:24:53.579320] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-24T19:24:53.579515] [INFO ] [MAIN ] Update Progress: 1092/2373 symbols completed. IEX took 33.2s. Estimated remaining: 2h 49m 54s. Rate: 7.5 symbols/min [2025-09-24T19:24:53.621241] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-24T19:24:53.788762] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:24:53.802831] [DEBUG] [LOCAL ] IGA: Loaded 9692 existing records from primary storage. [2025-09-24T19:24:53.802988] [INFO ] [MAIN ] IGA: Loaded 9692 existing records. [2025-09-24T19:24:53.994827] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:24:53.995474] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-24T19:24:53.995547] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-24T19:24:53.996347] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-24T19:24:53.996446] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-24T19:24:54.381896] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:24:54.416121] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-24T19:24:54.896606] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T19:24:55.216045] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-24T19:24:55.291509] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-24T19:24:56.016071] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-24T19:24:56.359433] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T19:24:56.421318] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-24T19:24:56.816179] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-24T19:24:57.616092] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-24T19:24:57.782677] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T19:24:58.416056] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-24T19:24:58.682496] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T19:24:59.216050] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-24T19:24:59.287450] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T19:24:59.764152] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T19:25:00.016111] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-24T19:25:00.816049] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-24T19:25:00.947212] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T19:25:01.538622] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T19:25:01.616139] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-24T19:25:02.416125] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-24T19:25:03.216135] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-24T19:25:03.514049] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T19:25:03.678712] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T19:25:03.683460] [INFO ] [REMOTE ] IFS: Full fetch complete (31472 records). [2025-09-24T19:25:03.683576] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-24T19:25:04.065476] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-24T19:25:04.081094] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-24T19:25:04.090772] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-24T19:25:04.091796] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T19:25:04.093858] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-24T19:25:04.096218] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-24T19:25:04.097231] [INFO ] [REMOTE ] IFN: Full fetch complete (29036 records). [2025-09-24T19:25:04.097517] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-24T19:25:04.131772] [DEBUG] [LOCAL ] IFS: Trimmed 31472 records to 23056 (keeping 200 days of data) [2025-09-24T19:25:04.599744] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-24T19:25:04.600153] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-24T19:25:04.601904] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-24T19:25:04.601989] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-24T19:25:04.612108] [DEBUG] [LOCAL ] IFN: Trimmed 29036 records to 18198 (keeping 200 days of data) [2025-09-24T19:25:04.728314] [DEBUG] [LOCAL ] IFS: Primary data saved (23056 records). [2025-09-24T19:25:04.729834] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-24T19:25:04.730243] [INFO ] [MAIN ] Update Progress: 1093/2373 symbols completed. IFS took 21.4s. Estimated remaining: 2h 49m 50s. Rate: 7.5 symbols/min [2025-09-24T19:25:04.821152] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-24T19:25:04.933054] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:04.950715] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T19:25:04.970423] [DEBUG] [LOCAL ] IGD: Loaded 18878 existing records from primary storage. [2025-09-24T19:25:04.971086] [INFO ] [MAIN ] IGD: Loaded 18878 existing records. [2025-09-24T19:25:05.164302] [DEBUG] [LOCAL ] IFN: Primary data saved (18198 records). [2025-09-24T19:25:05.187212] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-24T19:25:05.187440] [INFO ] [MAIN ] Update Progress: 1094/2373 symbols completed. IFN took 36.5s. Estimated remaining: 2h 49m 33s. Rate: 7.5 symbols/min [2025-09-24T19:25:05.187000] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:05.221237] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-24T19:25:05.254719] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-24T19:25:05.283252] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-24T19:25:05.294011] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-24T19:25:05.488467] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:05.592539] [DEBUG] [LOCAL ] IGI: Loaded 3685 existing records from primary storage. [2025-09-24T19:25:05.629320] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-24T19:25:05.654174] [INFO ] [MAIN ] IGI: Loaded 3685 existing records. [2025-09-24T19:25:05.932345] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:05.967258] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:05.967514] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-24T19:25:05.967564] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-24T19:25:05.967835] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-24T19:25:05.967895] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-24T19:25:06.331864] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:06.416044] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-24T19:25:06.710712] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T19:25:06.713275] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T19:25:06.996029] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T19:25:07.216095] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-24T19:25:07.676355] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T19:25:08.016153] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-24T19:25:08.782709] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T19:25:08.816057] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-24T19:25:09.483303] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T19:25:09.616098] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-24T19:25:10.068859] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T19:25:10.416125] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-24T19:25:11.216097] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-24T19:25:11.868946] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T19:25:12.016123] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-24T19:25:12.221797] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T19:25:12.661971] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T19:25:12.816154] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-24T19:25:13.588158] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T19:25:13.616049] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-24T19:25:14.386669] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T19:25:14.416043] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-24T19:25:15.216062] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-24T19:25:15.447302] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T19:25:15.449838] [INFO ] [REMOTE ] IGA: Full fetch complete (13594 records). [2025-09-24T19:25:15.449924] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-24T19:25:15.827582] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-24T19:25:15.827684] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-24T19:25:15.828034] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-24T19:25:15.828075] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-24T19:25:15.828558] [DEBUG] [LOCAL ] IGA: Trimmed 13594 records to 9680 (keeping 200 days of data) [2025-09-24T19:25:15.885008] [DEBUG] [LOCAL ] IGA: Primary data saved (9680 records). [2025-09-24T19:25:15.885141] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-24T19:25:15.885263] [INFO ] [MAIN ] Update Progress: 1095/2373 symbols completed. IGA took 22.3s. Estimated remaining: 2h 49m 28s. Rate: 7.5 symbols/min [2025-09-24T19:25:16.029096] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-24T19:25:16.061205] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:16.093086] [DEBUG] [LOCAL ] IGR: Loaded 30548 existing records from primary storage. [2025-09-24T19:25:16.093232] [INFO ] [MAIN ] IGR: Loaded 30548 existing records. [2025-09-24T19:25:16.274901] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:16.275161] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-24T19:25:16.275258] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-24T19:25:16.276313] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-24T19:25:16.276375] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-24T19:25:16.590719] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:25:16.672812] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:16.816104] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-24T19:25:17.264775] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T19:25:17.616094] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-24T19:25:17.756882] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T19:25:17.906325] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-24T19:25:18.416147] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-24T19:25:18.907715] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T19:25:19.216160] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-24T19:25:20.016146] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-24T19:25:20.481915] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T19:25:20.640487] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T19:25:20.816112] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-24T19:25:21.616059] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-24T19:25:21.864754] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T19:25:22.416135] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-24T19:25:23.216058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-24T19:25:23.397813] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T19:25:23.768142] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:25:24.016042] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-24T19:25:24.291709] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T19:25:24.816137] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-24T19:25:25.128333] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T19:25:25.453134] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T19:25:25.616172] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-24T19:25:26.416109] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-24T19:25:27.216069] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-24T19:25:27.394191] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:25:27.417946] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T19:25:27.834187] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T19:25:27.835459] [INFO ] [REMOTE ] IGI: Full fetch complete (5250 records). [2025-09-24T19:25:27.835532] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-24T19:25:28.021665] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-24T19:25:28.224638] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-24T19:25:28.224786] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-24T19:25:28.224995] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-24T19:25:28.225060] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-24T19:25:28.225668] [DEBUG] [LOCAL ] IGI: Trimmed 5250 records to 3677 (keeping 200 days of data) [2025-09-24T19:25:28.248008] [DEBUG] [LOCAL ] IGI: Primary data saved (3677 records). [2025-09-24T19:25:28.248080] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-24T19:25:28.248197] [INFO ] [MAIN ] Update Progress: 1096/2373 symbols completed. IGI took 23.1s. Estimated remaining: 2h 49m 25s. Rate: 7.5 symbols/min [2025-09-24T19:25:28.419436] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:28.424936] [DEBUG] [LOCAL ] IH: Loaded 3505 existing records from primary storage. [2025-09-24T19:25:28.425048] [INFO ] [MAIN ] IH: Loaded 3505 existing records. [2025-09-24T19:25:28.600526] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:28.600816] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-24T19:25:28.600875] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-24T19:25:28.601105] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-24T19:25:28.601164] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-24T19:25:28.821176] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-24T19:25:28.971947] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:29.616083] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-24T19:25:29.770204] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T19:25:29.780113] [INFO ] [REMOTE ] IFF: Full fetch complete (72825 records). [2025-09-24T19:25:29.780274] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-24T19:25:30.093712] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-24T19:25:30.196777] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-24T19:25:30.197018] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-24T19:25:30.198132] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-24T19:25:30.198245] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-24T19:25:30.199805] [DEBUG] [LOCAL ] IFF: Trimmed 72825 records to 50966 (keeping 200 days of data) [2025-09-24T19:25:30.310682] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:25:30.439175] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-24T19:25:30.542571] [DEBUG] [LOCAL ] IFF: Primary data saved (50966 records). [2025-09-24T19:25:30.542742] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-24T19:25:30.542852] [INFO ] [MAIN ] Update Progress: 1097/2373 symbols completed. IFF took 1m 8s. Estimated remaining: 2h 49m 11s. Rate: 7.5 symbols/min [2025-09-24T19:25:30.719470] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:30.728715] [DEBUG] [LOCAL ] IHD: Loaded 7247 existing records from primary storage. [2025-09-24T19:25:30.728839] [INFO ] [MAIN ] IHD: Loaded 7247 existing records. [2025-09-24T19:25:30.919180] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:30.919491] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-24T19:25:30.919561] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-24T19:25:30.920169] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-24T19:25:30.920234] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-24T19:25:31.217689] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-24T19:25:31.298727] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:31.463758] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:25:31.552494] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T19:25:32.016089] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-24T19:25:32.816095] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-24T19:25:32.857015] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:25:33.616095] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-24T19:25:33.820365] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:25:34.416106] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-24T19:25:34.904922] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:25:35.216060] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-24T19:25:35.306535] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T19:25:36.016089] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-24T19:25:36.195111] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T19:25:36.665669] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-24T19:25:36.816088] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-24T19:25:37.547575] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T19:25:37.616068] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-24T19:25:38.195600] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T19:25:38.416081] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-24T19:25:38.770389] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-24T19:25:39.216087] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-24T19:25:39.987604] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T19:25:40.016060] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-24T19:25:40.768296] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T19:25:40.816096] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-24T19:25:41.554327] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T19:25:41.616090] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-24T19:25:42.045495] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T19:25:42.416092] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-24T19:25:43.068892] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T19:25:43.216115] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-24T19:25:44.016075] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-24T19:25:44.199424] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T19:25:44.635900] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T19:25:44.816105] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-24T19:25:45.562212] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:25:45.616054] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-24T19:25:46.331178] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T19:25:46.416068] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-24T19:25:47.216050] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-24T19:25:47.399191] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T19:25:47.402371] [INFO ] [REMOTE ] IGD: Full fetch complete (29399 records). [2025-09-24T19:25:47.402450] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-24T19:25:47.704285] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T19:25:47.791536] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-24T19:25:47.791618] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-24T19:25:47.792305] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-24T19:25:47.792364] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-24T19:25:47.793120] [DEBUG] [LOCAL ] IGD: Trimmed 29399 records to 18929 (keeping 200 days of data) [2025-09-24T19:25:47.903728] [DEBUG] [LOCAL ] IGD: Primary data saved (18929 records). [2025-09-24T19:25:47.903908] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-24T19:25:47.904003] [INFO ] [MAIN ] Update Progress: 1098/2373 symbols completed. IGD took 43.2s. Estimated remaining: 2h 49m 14s. Rate: 7.5 symbols/min [2025-09-24T19:25:48.021291] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-24T19:25:48.082103] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:48.108266] [DEBUG] [LOCAL ] IHG: Loaded 24663 existing records from primary storage. [2025-09-24T19:25:48.108430] [INFO ] [MAIN ] IHG: Loaded 24663 existing records. [2025-09-24T19:25:48.288343] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:48.288625] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-24T19:25:48.288727] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-24T19:25:48.289682] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-24T19:25:48.289745] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-24T19:25:48.655632] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T19:25:48.662605] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:48.816087] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-24T19:25:49.616176] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-24T19:25:49.856798] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T19:25:50.416135] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-24T19:25:50.688339] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T19:25:51.216082] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-24T19:25:51.361563] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T19:25:52.016118] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-24T19:25:52.684684] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:25:52.820878] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-24T19:25:52.828678] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T19:25:53.562475] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T19:25:53.616035] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-24T19:25:54.416059] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-24T19:25:54.564938] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T19:25:54.566993] [INFO ] [REMOTE ] IHD: Full fetch complete (11912 records). [2025-09-24T19:25:54.567064] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-24T19:25:54.929443] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-24T19:25:54.929540] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-24T19:25:54.929869] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-24T19:25:54.929930] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-24T19:25:54.930378] [DEBUG] [LOCAL ] IHD: Trimmed 11912 records to 7151 (keeping 200 days of data) [2025-09-24T19:25:54.970558] [DEBUG] [LOCAL ] IHD: Primary data saved (7151 records). [2025-09-24T19:25:54.970704] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-24T19:25:54.970805] [INFO ] [MAIN ] Update Progress: 1099/2373 symbols completed. IHD took 24.4s. Estimated remaining: 2h 49m 5s. Rate: 7.5 symbols/min [2025-09-24T19:25:55.140158] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:55.177091] [DEBUG] [LOCAL ] IHS: Loaded 39033 existing records from primary storage. [2025-09-24T19:25:55.177233] [INFO ] [MAIN ] IHS: Loaded 39033 existing records. [2025-09-24T19:25:55.221246] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-24T19:25:55.362890] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:55.363231] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-24T19:25:55.363283] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-24T19:25:55.364357] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-24T19:25:55.364420] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-24T19:25:55.745949] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:55.769092] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T19:25:55.930914] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T19:25:55.932267] [INFO ] [REMOTE ] IH: Full fetch complete (4949 records). [2025-09-24T19:25:55.932341] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-24T19:25:56.021360] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-24T19:25:56.291863] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-24T19:25:56.291950] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-24T19:25:56.292181] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-24T19:25:56.292239] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-24T19:25:56.292628] [DEBUG] [LOCAL ] IH: Trimmed 4949 records to 3416 (keeping 200 days of data) [2025-09-24T19:25:56.312379] [DEBUG] [LOCAL ] IH: Primary data saved (3416 records). [2025-09-24T19:25:56.312466] [INFO ] [MAIN ] IH: Full history saved. [2025-09-24T19:25:56.312550] [INFO ] [MAIN ] Update Progress: 1100/2373 symbols completed. IH took 28.1s. Estimated remaining: 2h 48m 49s. Rate: 7.5 symbols/min [2025-09-24T19:25:56.483087] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:25:56.492792] [DEBUG] [LOCAL ] IIF: Loaded 5769 existing records from primary storage. [2025-09-24T19:25:56.492905] [INFO ] [MAIN ] IIF: Loaded 5769 existing records. [2025-09-24T19:25:56.670639] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:25:56.670944] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-24T19:25:56.670992] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-24T19:25:56.671307] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-24T19:25:56.671366] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-24T19:25:56.821159] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-24T19:25:57.034411] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:25:57.220003] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T19:25:57.616083] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-24T19:25:58.270409] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T19:25:58.416211] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-24T19:25:58.794210] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T19:25:59.216135] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-24T19:25:59.587153] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T19:25:59.891259] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-24T19:26:00.016133] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-24T19:26:00.808220] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T19:26:00.816019] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-24T19:26:01.617928] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-24T19:26:01.618958] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T19:26:02.416096] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-24T19:26:02.868951] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T19:26:03.216091] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-24T19:26:03.763496] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T19:26:03.768967] [INFO ] [REMOTE ] IGR: Full fetch complete (45787 records). [2025-09-24T19:26:03.769070] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-24T19:26:04.022618] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-24T19:26:04.187464] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-24T19:26:04.188505] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T19:26:04.188782] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-24T19:26:04.195063] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-24T19:26:04.195542] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-24T19:26:04.196871] [DEBUG] [LOCAL ] IGR: Trimmed 45787 records to 30512 (keeping 200 days of data) [2025-09-24T19:26:04.392678] [DEBUG] [LOCAL ] IGR: Primary data saved (30512 records). [2025-09-24T19:26:04.392852] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-24T19:26:04.392962] [INFO ] [MAIN ] Update Progress: 1101/2373 symbols completed. IGR took 48.5s. Estimated remaining: 2h 48m 41s. Rate: 7.5 symbols/min [2025-09-24T19:26:04.580173] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:04.600845] [DEBUG] [LOCAL ] IIIN: Loaded 16764 existing records from primary storage. [2025-09-24T19:26:04.601066] [INFO ] [MAIN ] IIIN: Loaded 16764 existing records. [2025-09-24T19:26:04.709194] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T19:26:04.799442] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:04.799853] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-24T19:26:04.799909] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-24T19:26:04.800583] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-24T19:26:04.800690] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-24T19:26:04.822760] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-24T19:26:05.196663] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:05.616096] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-24T19:26:06.000385] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T19:26:06.416062] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-24T19:26:06.434612] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T19:26:07.216037] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-24T19:26:07.609710] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T19:26:07.946908] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-24T19:26:08.016050] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-24T19:26:08.600806] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T19:26:08.816116] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-24T19:26:09.619197] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-24T19:26:09.621360] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T19:26:10.402961] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T19:26:10.416028] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-24T19:26:11.216123] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-24T19:26:11.500916] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T19:26:11.816152] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T19:26:12.016184] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-24T19:26:12.725063] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T19:26:12.726532] [INFO ] [REMOTE ] IIF: Full fetch complete (9614 records). [2025-09-24T19:26:12.726669] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-24T19:26:12.821187] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-24T19:26:13.140222] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-24T19:26:13.140302] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-24T19:26:13.140613] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-24T19:26:13.140696] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-24T19:26:13.141136] [DEBUG] [LOCAL ] IIF: Trimmed 9614 records to 5750 (keeping 200 days of data) [2025-09-24T19:26:13.176899] [DEBUG] [LOCAL ] IIF: Primary data saved (5750 records). [2025-09-24T19:26:13.176981] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-24T19:26:13.177085] [INFO ] [MAIN ] Update Progress: 1102/2373 symbols completed. IIF took 16.9s. Estimated remaining: 2h 48m 34s. Rate: 7.5 symbols/min [2025-09-24T19:26:13.350068] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:13.367774] [DEBUG] [LOCAL ] IIM: Loaded 15910 existing records from primary storage. [2025-09-24T19:26:13.367903] [INFO ] [MAIN ] IIM: Loaded 15910 existing records. [2025-09-24T19:26:13.643323] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-24T19:26:13.650860] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:13.652002] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-24T19:26:13.652193] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-24T19:26:13.652925] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-24T19:26:13.653004] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-24T19:26:13.974233] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T19:26:14.038986] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:14.416109] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-24T19:26:15.143862] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T19:26:15.215216] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T19:26:15.219431] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-24T19:26:16.016071] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-24T19:26:16.372367] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T19:26:16.816050] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-24T19:26:17.017750] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T19:26:17.616088] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-24T19:26:18.120726] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T19:26:18.416119] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-24T19:26:18.444133] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T19:26:19.216085] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-24T19:26:19.732856] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T19:26:19.736966] [INFO ] [REMOTE ] IHG: Full fetch complete (33493 records). [2025-09-24T19:26:19.737062] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-24T19:26:20.025112] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-24T19:26:20.139896] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-24T19:26:20.140003] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-24T19:26:20.140831] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-24T19:26:20.140902] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-24T19:26:20.142153] [DEBUG] [LOCAL ] IHG: Trimmed 33493 records to 24600 (keeping 200 days of data) [2025-09-24T19:26:20.303412] [DEBUG] [LOCAL ] IHG: Primary data saved (24600 records). [2025-09-24T19:26:20.303597] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-24T19:26:20.303737] [INFO ] [MAIN ] Update Progress: 1103/2373 symbols completed. IHG took 32.4s. Estimated remaining: 2h 48m 25s. Rate: 7.5 symbols/min [2025-09-24T19:26:20.492229] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:20.529616] [DEBUG] [LOCAL ] IIPR: Loaded 29629 existing records from primary storage. [2025-09-24T19:26:20.529829] [INFO ] [MAIN ] IIPR: Loaded 29629 existing records. [2025-09-24T19:26:20.716968] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:20.717367] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-24T19:26:20.717452] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-24T19:26:20.727390] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-24T19:26:20.740715] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-24T19:26:20.829534] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T19:26:20.829636] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-24T19:26:21.168114] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:21.183874] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T19:26:21.616061] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-24T19:26:21.902536] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T19:26:22.416137] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-24T19:26:23.132075] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T19:26:23.216145] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-24T19:26:23.304549] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T19:26:24.016068] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-24T19:26:24.064816] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T19:26:24.816189] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-24T19:26:25.470336] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T19:26:25.616085] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-24T19:26:26.385072] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:26:26.416038] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-24T19:26:26.520452] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T19:26:27.216107] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-24T19:26:27.690171] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T19:26:27.830925] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T19:26:28.016109] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-24T19:26:28.816074] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-24T19:26:28.910719] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T19:26:29.616056] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-24T19:26:29.667933] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T19:26:30.416054] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-24T19:26:30.503706] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T19:26:30.506481] [INFO ] [REMOTE ] IIIN: Full fetch complete (25177 records). [2025-09-24T19:26:30.506612] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-24T19:26:30.873865] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-24T19:26:30.873945] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-24T19:26:30.874523] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-24T19:26:30.874563] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-24T19:26:30.875239] [DEBUG] [LOCAL ] IIIN: Trimmed 25177 records to 16693 (keeping 200 days of data) [2025-09-24T19:26:30.979852] [DEBUG] [LOCAL ] IIIN: Primary data saved (16693 records). [2025-09-24T19:26:30.980016] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-24T19:26:30.980109] [INFO ] [MAIN ] Update Progress: 1104/2373 symbols completed. IIIN took 26.6s. Estimated remaining: 2h 48m 21s. Rate: 7.5 symbols/min [2025-09-24T19:26:31.147419] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:31.192373] [DEBUG] [LOCAL ] IMAX: Loaded 42766 existing records from primary storage. [2025-09-24T19:26:31.192619] [INFO ] [MAIN ] IMAX: Loaded 42766 existing records. [2025-09-24T19:26:31.225199] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-24T19:26:31.376672] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:31.376925] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-24T19:26:31.376974] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-24T19:26:31.378977] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-24T19:26:31.379041] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-24T19:26:31.735582] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:31.934954] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T19:26:32.016088] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-24T19:26:32.634998] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T19:26:32.816080] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-24T19:26:33.075784] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T19:26:33.616085] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-24T19:26:34.338750] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:26:34.416047] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-24T19:26:35.083406] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:26:35.216048] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-24T19:26:35.668222] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T19:26:36.016126] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-24T19:26:36.521001] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T19:26:36.816094] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-24T19:26:36.909923] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T19:26:37.616074] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-24T19:26:38.348311] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T19:26:38.355189] [INFO ] [REMOTE ] IHS: Full fetch complete (52376 records). [2025-09-24T19:26:38.365723] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T19:26:38.365359] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-24T19:26:38.423558] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-24T19:26:38.756962] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-24T19:26:38.757051] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-24T19:26:38.758417] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-24T19:26:38.758515] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-24T19:26:38.759802] [DEBUG] [LOCAL ] IHS: Trimmed 52376 records to 39058 (keeping 200 days of data) [2025-09-24T19:26:38.982428] [DEBUG] [LOCAL ] IHS: Primary data saved (39058 records). [2025-09-24T19:26:38.982593] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-24T19:26:38.982778] [INFO ] [MAIN ] Update Progress: 1105/2373 symbols completed. IHS took 44.0s. Estimated remaining: 2h 48m 13s. Rate: 7.5 symbols/min [2025-09-24T19:26:39.149630] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:39.200180] [DEBUG] [LOCAL ] INFA: Loaded 50032 existing records from primary storage. [2025-09-24T19:26:39.200356] [INFO ] [MAIN ] INFA: Loaded 50032 existing records. [2025-09-24T19:26:39.221234] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-24T19:26:39.379933] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:39.380157] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-24T19:26:39.380204] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-24T19:26:39.381390] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-24T19:26:39.381461] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-24T19:26:39.748457] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:39.909042] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:26:39.989137] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T19:26:40.016076] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-24T19:26:40.816078] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-24T19:26:41.360416] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T19:26:41.616081] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-24T19:26:42.111003] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T19:26:42.379067] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T19:26:42.416067] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-24T19:26:43.216061] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-24T19:26:43.474222] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T19:26:43.477911] [INFO ] [REMOTE ] IIM: Full fetch complete (25385 records). [2025-09-24T19:26:43.477997] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-24T19:26:43.839290] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-24T19:26:43.839373] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-24T19:26:43.839961] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-24T19:26:43.840023] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-24T19:26:43.840672] [DEBUG] [LOCAL ] IIM: Trimmed 25385 records to 15907 (keeping 200 days of data) [2025-09-24T19:26:43.942957] [DEBUG] [LOCAL ] IIM: Primary data saved (15907 records). [2025-09-24T19:26:43.943104] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-24T19:26:43.943196] [INFO ] [MAIN ] Update Progress: 1106/2373 symbols completed. IIM took 30.8s. Estimated remaining: 2h 48m 1s. Rate: 7.5 symbols/min [2025-09-24T19:26:44.021140] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-24T19:26:44.124965] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:44.193754] [DEBUG] [LOCAL ] INFY: Loaded 53600 existing records from primary storage. [2025-09-24T19:26:44.193927] [INFO ] [MAIN ] INFY: Loaded 53600 existing records. [2025-09-24T19:26:44.371334] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:44.371581] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-24T19:26:44.371629] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-24T19:26:44.373212] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-24T19:26:44.373274] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-24T19:26:44.729254] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:44.817254] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-24T19:26:44.820080] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T19:26:45.344891] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T19:26:45.616090] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-24T19:26:46.416061] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-24T19:26:46.603062] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T19:26:47.132334] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T19:26:47.216033] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-24T19:26:47.670675] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T19:26:48.016100] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-24T19:26:48.794741] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:26:48.816027] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-24T19:26:49.616060] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-24T19:26:49.836509] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T19:26:50.264986] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T19:26:50.416143] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-24T19:26:50.702934] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T19:26:50.708771] [INFO ] [REMOTE ] IIPR: Full fetch complete (44105 records). [2025-09-24T19:26:50.708916] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-24T19:26:51.128212] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-24T19:26:51.128339] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-24T19:26:51.129281] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-24T19:26:51.129355] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-24T19:26:51.132905] [DEBUG] [LOCAL ] IIPR: Trimmed 44105 records to 29633 (keeping 200 days of data) [2025-09-24T19:26:51.225052] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-24T19:26:51.320563] [DEBUG] [LOCAL ] IIPR: Primary data saved (29633 records). [2025-09-24T19:26:51.320743] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-24T19:26:51.320845] [INFO ] [MAIN ] Update Progress: 1107/2373 symbols completed. IIPR took 31.0s. Estimated remaining: 2h 47m 53s. Rate: 7.5 symbols/min [2025-09-24T19:26:51.500394] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:26:51.557417] [DEBUG] [LOCAL ] ING: Loaded 50806 existing records from primary storage. [2025-09-24T19:26:51.557763] [INFO ] [MAIN ] ING: Loaded 50806 existing records. [2025-09-24T19:26:51.748220] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:26:51.748575] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-24T19:26:51.748675] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-24T19:26:51.751307] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-24T19:26:51.751380] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-24T19:26:52.018574] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-24T19:26:52.216882] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T19:26:52.220279] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:26:52.467539] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:26:52.816070] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-24T19:26:53.440022] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T19:26:53.616161] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-24T19:26:54.331955] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T19:26:54.416034] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-24T19:26:55.216088] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-24T19:26:55.352063] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:26:56.016110] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-24T19:26:56.107894] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T19:26:56.642407] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:26:56.816062] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-24T19:26:57.616062] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-24T19:26:57.989260] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T19:26:58.416108] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-24T19:26:58.535881] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T19:26:59.216101] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-24T19:26:59.354250] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:26:59.951318] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T19:27:00.016039] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-24T19:27:00.816113] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-24T19:27:00.976565] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:27:00.986632] [INFO ] [REMOTE ] IMAX: Full fetch complete (59512 records). [2025-09-24T19:27:00.986823] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-24T19:27:01.415015] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-24T19:27:01.415120] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-24T19:27:01.416095] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-24T19:27:01.416184] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-24T19:27:01.420302] [DEBUG] [LOCAL ] IMAX: Trimmed 59512 records to 42759 (keeping 200 days of data) [2025-09-24T19:27:01.635715] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-24T19:27:01.686689] [DEBUG] [LOCAL ] IMAX: Primary data saved (42759 records). [2025-09-24T19:27:01.686874] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-24T19:27:01.687067] [INFO ] [MAIN ] Update Progress: 1108/2373 symbols completed. IMAX took 30.7s. Estimated remaining: 2h 47m 47s. Rate: 7.5 symbols/min [2025-09-24T19:27:01.859395] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:01.897034] [DEBUG] [LOCAL ] INGM: Loaded 28874 existing records from primary storage. [2025-09-24T19:27:01.897175] [INFO ] [MAIN ] INGM: Loaded 28874 existing records. [2025-09-24T19:27:02.098581] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:02.099049] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-24T19:27:02.099145] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-24T19:27:02.100171] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-24T19:27:02.100256] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-24T19:27:02.250903] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-24T19:27:02.421161] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-24T19:27:02.515549] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:03.216156] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-24T19:27:03.323308] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-24T19:27:04.016160] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-24T19:27:05.324117] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-24T19:27:05.367547] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-24T19:27:05.374913] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (3.74 seconds). [2025-09-24T19:27:05.616100] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-24T19:27:05.880950] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (3.46 seconds). [2025-09-24T19:27:05.923803] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T19:27:06.329332] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T19:27:06.416109] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-24T19:27:07.216104] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-24T19:27:07.280748] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T19:27:07.570783] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T19:27:08.016052] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-24T19:27:08.816106] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-24T19:27:09.072309] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T19:27:09.616095] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-24T19:27:09.781134] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T19:27:10.152351] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T19:27:10.416095] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-24T19:27:11.216136] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-24T19:27:11.265533] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T19:27:11.275708] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-24T19:27:11.275942] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-24T19:27:11.681187] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-24T19:27:11.681353] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-24T19:27:11.682389] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-24T19:27:11.682515] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-24T19:27:11.684079] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 53600 (keeping 200 days of data) [2025-09-24T19:27:11.845424] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T19:27:12.016519] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-24T19:27:12.059299] [DEBUG] [LOCAL ] INFY: Primary data saved (53600 records). [2025-09-24T19:27:12.059453] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-24T19:27:12.059545] [INFO ] [MAIN ] Update Progress: 1109/2373 symbols completed. INFY took 28.1s. Estimated remaining: 2h 47m 42s. Rate: 7.5 symbols/min [2025-09-24T19:27:12.233984] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:12.273932] [DEBUG] [LOCAL ] INGR: Loaded 33372 existing records from primary storage. [2025-09-24T19:27:12.274110] [INFO ] [MAIN ] INGR: Loaded 33372 existing records. [2025-09-24T19:27:12.452335] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:12.452813] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-24T19:27:12.452958] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-24T19:27:12.454013] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-24T19:27:12.454075] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-24T19:27:12.754178] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T19:27:12.820025] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-24T19:27:12.841187] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:13.418787] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T19:27:13.616098] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-24T19:27:14.416101] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-24T19:27:15.216149] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-24T19:27:15.751896] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-24T19:27:16.016130] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-24T19:27:16.520374] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-24T19:27:16.816151] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-24T19:27:17.183498] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (3.57 seconds). [2025-09-24T19:27:17.423476] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-24T19:27:17.616067] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-24T19:27:17.650874] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T19:27:18.201365] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T19:27:18.416094] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-24T19:27:19.216094] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-24T19:27:19.624395] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-24T19:27:19.633185] [INFO ] [REMOTE ] INFA: Full fetch complete (71820 records). [2025-09-24T19:27:19.633327] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-24T19:27:20.018125] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-24T19:27:20.040825] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-24T19:27:20.042258] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-24T19:27:20.043479] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-24T19:27:20.043770] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-24T19:27:20.053549] [DEBUG] [LOCAL ] INFA: Trimmed 71820 records to 49983 (keeping 200 days of data) [2025-09-24T19:27:20.068103] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:27:20.379593] [DEBUG] [LOCAL ] INFA: Primary data saved (49983 records). [2025-09-24T19:27:20.379765] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-24T19:27:20.379875] [INFO ] [MAIN ] Update Progress: 1110/2373 symbols completed. INFA took 41.4s. Estimated remaining: 2h 47m 35s. Rate: 7.5 symbols/min [2025-09-24T19:27:20.566985] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:20.570343] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:27:20.613961] [DEBUG] [LOCAL ] INN: Loaded 41945 existing records from primary storage. [2025-09-24T19:27:20.614105] [INFO ] [MAIN ] INN: Loaded 41945 existing records. [2025-09-24T19:27:20.817177] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-24T19:27:20.816993] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:20.817814] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-24T19:27:20.818874] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-24T19:27:20.820026] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-24T19:27:20.820089] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-24T19:27:21.251704] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:21.616090] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-24T19:27:21.826881] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T19:27:22.382419] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T19:27:22.416030] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-24T19:27:23.009519] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T19:27:23.216094] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-24T19:27:23.778775] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T19:27:23.969722] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T19:27:24.016129] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-24T19:27:24.816097] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-24T19:27:25.616062] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-24T19:27:25.807869] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T19:27:25.816888] [INFO ] [REMOTE ] ING: Full fetch complete (73635 records). [2025-09-24T19:27:25.817047] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-24T19:27:26.231597] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-24T19:27:26.231737] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-24T19:27:26.233054] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-24T19:27:26.233133] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-24T19:27:26.234849] [DEBUG] [LOCAL ] ING: Trimmed 73635 records to 50795 (keeping 200 days of data) [2025-09-24T19:27:26.360141] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:27:26.447520] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-24T19:27:26.604248] [DEBUG] [LOCAL ] ING: Primary data saved (50795 records). [2025-09-24T19:27:26.604429] [INFO ] [MAIN ] ING: Full history saved. [2025-09-24T19:27:26.604588] [INFO ] [MAIN ] Update Progress: 1111/2373 symbols completed. ING took 35.3s. Estimated remaining: 2h 47m 25s. Rate: 7.5 symbols/min [2025-09-24T19:27:26.775630] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:26.775852] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-24T19:27:26.775892] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-24T19:27:26.776035] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-24T19:27:26.776078] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-24T19:27:26.776121] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-24T19:27:26.776155] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-24T19:27:27.145534] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T19:27:27.190846] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:27.216039] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-24T19:27:27.417812] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:27:27.418173] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-24T19:27:27.828344] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T19:27:28.016077] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-24T19:27:28.816103] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-24T19:27:29.377570] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:27:29.616045] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-24T19:27:29.641970] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T19:27:30.416150] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-24T19:27:31.005841] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T19:27:31.216092] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-24T19:27:31.704772] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T19:27:32.016086] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-24T19:27:32.583104] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T19:27:32.816095] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-24T19:27:33.463085] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T19:27:33.616091] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-24T19:27:34.369720] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:27:34.376512] [INFO ] [REMOTE ] INGR: Full fetch complete (49805 records). [2025-09-24T19:27:34.376627] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-24T19:27:34.421174] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-24T19:27:34.807576] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T19:27:34.807070] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-24T19:27:34.807745] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-24T19:27:34.812848] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-24T19:27:34.813370] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-24T19:27:34.813577] [INFO ] [REMOTE ] INGM: Full fetch complete (42137 records). [2025-09-24T19:27:34.813881] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-24T19:27:34.861639] [DEBUG] [LOCAL ] INGR: Trimmed 49805 records to 33328 (keeping 200 days of data) [2025-09-24T19:27:35.040231] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T19:27:35.221228] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-24T19:27:35.378257] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-24T19:27:35.378398] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-24T19:27:35.379369] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-24T19:27:35.411960] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-24T19:27:35.440954] [DEBUG] [LOCAL ] INGM: Trimmed 42137 records to 28712 (keeping 200 days of data) [2025-09-24T19:27:35.554733] [DEBUG] [LOCAL ] INGR: Primary data saved (33328 records). [2025-09-24T19:27:35.555628] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-24T19:27:35.556046] [INFO ] [MAIN ] Update Progress: 1112/2373 symbols completed. INGR took 23.5s. Estimated remaining: 2h 47m 18s. Rate: 7.5 symbols/min [2025-09-24T19:27:35.745528] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:35.823824] [DEBUG] [LOCAL ] INGM: Primary data saved (28712 records). [2025-09-24T19:27:35.823976] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-24T19:27:35.824142] [INFO ] [MAIN ] Update Progress: 1113/2373 symbols completed. INGM took 34.1s. Estimated remaining: 2h 47m 1s. Rate: 7.5 symbols/min [2025-09-24T19:27:35.951960] [DEBUG] [LOCAL ] INSP: Loaded 36869 existing records from primary storage. [2025-09-24T19:27:35.957729] [INFO ] [MAIN ] INSP: Loaded 36869 existing records. [2025-09-24T19:27:36.030056] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-24T19:27:36.162639] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:36.253411] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:36.253705] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-24T19:27:36.253763] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-24T19:27:36.254563] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-24T19:27:36.254628] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-24T19:27:36.527259] [DEBUG] [LOCAL ] INSW: Loaded 40407 existing records from primary storage. [2025-09-24T19:27:36.545984] [INFO ] [MAIN ] INSW: Loaded 40407 existing records. [2025-09-24T19:27:36.780056] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:36.842142] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-24T19:27:36.880415] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:36.880221] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T19:27:36.881088] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-24T19:27:36.891062] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-24T19:27:36.892425] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-24T19:27:36.892526] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-24T19:27:37.248771] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:37.616087] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-24T19:27:37.689809] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T19:27:38.223999] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T19:27:38.416090] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-24T19:27:39.105232] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:27:39.216055] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-24T19:27:39.976745] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T19:27:40.016050] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-24T19:27:40.816097] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-24T19:27:41.051304] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T19:27:41.497943] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T19:27:41.616041] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-24T19:27:42.009739] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T19:27:42.416087] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-24T19:27:42.965071] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T19:27:43.216085] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-24T19:27:43.960191] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:27:44.016072] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-24T19:27:44.575094] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T19:27:44.816128] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-24T19:27:45.376292] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:27:45.616130] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-24T19:27:45.820884] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T19:27:46.416086] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-24T19:27:46.907851] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T19:27:46.914522] [INFO ] [REMOTE ] INN: Full fetch complete (57750 records). [2025-09-24T19:27:46.914665] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-24T19:27:47.221225] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-24T19:27:47.308172] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-24T19:27:47.308320] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-24T19:27:47.309401] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-24T19:27:47.309543] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-24T19:27:47.325549] [DEBUG] [LOCAL ] INN: Trimmed 57750 records to 41927 (keeping 200 days of data) [2025-09-24T19:27:47.326495] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T19:27:47.579598] [DEBUG] [LOCAL ] INN: Primary data saved (41927 records). [2025-09-24T19:27:47.579849] [INFO ] [MAIN ] INN: Full history saved. [2025-09-24T19:27:47.579949] [INFO ] [MAIN ] Update Progress: 1114/2373 symbols completed. INN took 27.2s. Estimated remaining: 2h 46m 58s. Rate: 7.5 symbols/min [2025-09-24T19:27:47.757124] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:47.811559] [DEBUG] [LOCAL ] INVH: Loaded 53139 existing records from primary storage. [2025-09-24T19:27:47.811759] [INFO ] [MAIN ] INVH: Loaded 53139 existing records. [2025-09-24T19:27:48.008522] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:48.008824] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-24T19:27:48.008881] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-24T19:27:48.010028] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-24T19:27:48.010091] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-24T19:27:48.021716] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-24T19:27:48.382844] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:48.657791] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T19:27:48.816063] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-24T19:27:49.192314] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T19:27:49.616124] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-24T19:27:49.925033] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T19:27:50.416094] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-24T19:27:50.923148] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T19:27:51.216116] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-24T19:27:51.605599] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T19:27:52.016070] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-24T19:27:52.480967] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T19:27:52.816101] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-24T19:27:53.516452] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T19:27:53.616123] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-24T19:27:53.961689] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T19:27:54.416116] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-24T19:27:54.817146] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T19:27:54.824665] [INFO ] [REMOTE ] INR: Full fetch complete (33123 records). [2025-09-24T19:27:54.824790] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-24T19:27:55.021801] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-24T19:27:55.022271] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:27:55.022344] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:27:55.022421] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-24T19:27:55.022508] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-24T19:27:55.022556] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-24T19:27:55.022614] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-24T19:27:55.022727] [INFO ] [MAIN ] Update Progress: 1115/2373 symbols completed. INR took 28.4s. Estimated remaining: 2h 46m 49s. Rate: 7.5 symbols/min [2025-09-24T19:27:55.197687] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:27:55.216102] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-24T19:27:55.230967] [DEBUG] [LOCAL ] INVX: Loaded 28970 existing records from primary storage. [2025-09-24T19:27:55.231144] [INFO ] [MAIN ] INVX: Loaded 28970 existing records. [2025-09-24T19:27:55.411867] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:27:55.412128] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-24T19:27:55.412182] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-24T19:27:55.412869] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-24T19:27:55.412964] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-24T19:27:55.769977] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:27:56.016061] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-24T19:27:56.183766] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T19:27:56.705576] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:27:56.816133] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-24T19:27:57.464058] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T19:27:57.616193] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-24T19:27:58.380624] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T19:27:58.416064] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-24T19:27:59.207886] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T19:27:59.216620] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-24T19:27:59.632279] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T19:28:00.016123] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-24T19:28:00.619111] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T19:28:00.816109] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-24T19:28:01.616088] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-24T19:28:01.865744] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T19:28:02.416117] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-24T19:28:02.526712] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T19:28:02.948807] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T19:28:03.216108] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-24T19:28:03.974458] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T19:28:04.016055] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-24T19:28:04.695999] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T19:28:04.816091] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-24T19:28:05.621164] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-24T19:28:05.640354] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T19:28:06.084785] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T19:28:06.093930] [INFO ] [REMOTE ] INSP: Full fetch complete (52358 records). [2025-09-24T19:28:06.094180] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-24T19:28:06.421265] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-24T19:28:06.491769] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-24T19:28:06.492055] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-24T19:28:06.493114] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-24T19:28:06.493191] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-24T19:28:06.494778] [DEBUG] [LOCAL ] INSP: Trimmed 52358 records to 36853 (keeping 200 days of data) [2025-09-24T19:28:06.720872] [DEBUG] [LOCAL ] INSP: Primary data saved (36853 records). [2025-09-24T19:28:06.721029] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-24T19:28:06.721119] [INFO ] [MAIN ] Update Progress: 1116/2373 symbols completed. INSP took 31.2s. Estimated remaining: 2h 46m 45s. Rate: 7.5 symbols/min [2025-09-24T19:28:06.897748] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:06.897920] [DEBUG] [LOCAL ] IONQ: No existing data file found in primary storage. [2025-09-24T19:28:06.897958] [WARN ] [MAIN ] IONQ: No existing data found, performing full refresh instead. [2025-09-24T19:28:06.898099] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-24T19:28:06.898142] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-24T19:28:06.898183] [DEBUG] [LOCAL ] IONQ: No primary data file found to delete. [2025-09-24T19:28:06.898216] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-24T19:28:07.230698] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-24T19:28:07.286492] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:07.382999] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T19:28:07.676720] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T19:28:08.016101] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-24T19:28:08.816058] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-24T19:28:08.893223] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T19:28:09.379753] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T19:28:09.616127] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-24T19:28:10.323637] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:28:10.416063] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-24T19:28:11.216150] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-24T19:28:11.798205] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T19:28:12.016055] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-24T19:28:12.321166] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-24T19:28:12.530918] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T19:28:12.816091] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-24T19:28:13.427283] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T19:28:13.616158] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-24T19:28:14.088251] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T19:28:14.416127] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-24T19:28:15.138684] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T19:28:15.145772] [INFO ] [REMOTE ] INSW: Full fetch complete (60825 records). [2025-09-24T19:28:15.145966] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-24T19:28:15.221182] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-24T19:28:15.608960] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-24T19:28:15.609128] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-24T19:28:15.610356] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-24T19:28:15.610922] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-24T19:28:15.611926] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:28:15.621160] [DEBUG] [LOCAL ] INSW: Trimmed 60825 records to 40298 (keeping 200 days of data) [2025-09-24T19:28:15.880936] [DEBUG] [LOCAL ] INSW: Primary data saved (40298 records). [2025-09-24T19:28:15.881080] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-24T19:28:15.881170] [INFO ] [MAIN ] Update Progress: 1117/2373 symbols completed. INSW took 40.1s. Estimated remaining: 2h 46m 39s. Rate: 7.5 symbols/min [2025-09-24T19:28:16.016205] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-24T19:28:16.816164] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-24T19:28:17.047035] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T19:28:17.294723] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T19:28:17.616107] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-24T19:28:18.416100] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-24T19:28:19.011732] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T19:28:19.130348] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-24T19:28:19.216096] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-24T19:28:19.437100] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T19:28:19.441806] [INFO ] [REMOTE ] INVX: Full fetch complete (44379 records). [2025-09-24T19:28:19.441896] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-24T19:28:19.820903] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-24T19:28:19.820983] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-24T19:28:19.821843] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-24T19:28:19.821908] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-24T19:28:19.822918] [DEBUG] [LOCAL ] INVX: Trimmed 44379 records to 28856 (keeping 200 days of data) [2025-09-24T19:28:19.999116] [DEBUG] [LOCAL ] INVX: Primary data saved (28856 records). [2025-09-24T19:28:19.999302] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-24T19:28:19.999406] [INFO ] [MAIN ] Update Progress: 1118/2373 symbols completed. INVX took 25.0s. Estimated remaining: 2h 46m 26s. Rate: 7.5 symbols/min [2025-09-24T19:28:20.016040] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-24T19:28:21.176488] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T19:28:21.185982] [INFO ] [REMOTE ] INVH: Full fetch complete (76688 records). [2025-09-24T19:28:21.186131] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-24T19:28:21.600277] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-24T19:28:21.600379] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-24T19:28:21.601502] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-24T19:28:21.601581] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-24T19:28:21.603499] [DEBUG] [LOCAL ] INVH: Trimmed 76688 records to 53141 (keeping 200 days of data) [2025-09-24T19:28:21.935046] [DEBUG] [LOCAL ] INVH: Primary data saved (53141 records). [2025-09-24T19:28:21.935198] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-24T19:28:21.935287] [INFO ] [MAIN ] Update Progress: 1119/2373 symbols completed. INVH took 34.4s. Estimated remaining: 2h 46m 12s. Rate: 7.5 symbols/min [2025-09-24T19:28:22.493065] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-24T19:28:22.503358] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-24T19:28:25.096233] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-24T19:28:25.108065] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-24T19:28:27.969607] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-24T19:28:27.981045] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-24T19:28:30.568905] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-24T19:28:30.580596] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-24T19:28:33.095225] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-24T19:28:33.106477] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-24T19:28:35.638273] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-24T19:28:35.650331] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-24T19:28:38.017409] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-24T19:28:38.029318] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-24T19:28:40.470946] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-24T19:28:40.480496] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-24T19:28:40.480619] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-24T19:28:40.880877] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-24T19:28:40.881013] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-24T19:28:40.882496] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-24T19:28:40.882582] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-24T19:28:40.884938] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-24T19:28:41.237462] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-24T19:28:41.237704] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-24T19:28:41.237810] [INFO ] [MAIN ] Update Progress: 1120/2373 symbols completed. IONQ took 34.5s. Estimated remaining: 2h 46m 17s. Rate: 7.5 symbols/min [2025-09-24T19:28:41.913041] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:41.998159] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:41.980826] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:42.002131] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:42.055161] [DEBUG] [LOCAL ] IPI: Loaded 21223 existing records from primary storage. [2025-09-24T19:28:42.055522] [INFO ] [MAIN ] IPI: Loaded 21223 existing records. [2025-09-24T19:28:42.328056] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-09-24T19:28:42.345722] [INFO ] [MAIN ] IOT: Loaded 53471 existing records. [2025-09-24T19:28:42.377939] [DEBUG] [LOCAL ] IPG: Loaded 53332 existing records from primary storage. [2025-09-24T19:28:42.345486] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:28:42.377004] [DEBUG] [LOCAL ] IP: Loaded 53323 existing records from primary storage. [2025-09-24T19:28:42.383277] [INFO ] [MAIN ] IPG: Loaded 53332 existing records. [2025-09-24T19:28:42.389129] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-24T19:28:42.389270] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-24T19:28:42.383716] [INFO ] [MAIN ] IP: Loaded 53323 existing records. [2025-09-24T19:28:42.399842] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-24T19:28:42.416578] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-24T19:28:43.034743] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:28:43.050177] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:28:43.112695] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-24T19:28:43.156209] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-24T19:28:43.139680] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-24T19:28:43.179272] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:28:43.190702] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-24T19:28:43.190939] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-24T19:28:43.197063] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-24T19:28:43.197207] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-24T19:28:43.191090] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-24T19:28:43.269810] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-24T19:28:43.303478] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-24T19:28:43.318542] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-24T19:28:43.323879] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-24T19:28:43.641304] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:43.728869] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-24T19:28:44.299520] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:44.345855] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-24T19:28:44.473975] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:44.500742] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-24T19:28:44.506573] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:44.507007] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-24T19:28:44.915017] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T19:28:44.918902] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-24T19:28:45.691740] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T19:28:45.695588] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-24T19:28:45.886509] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:28:45.897242] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-24T19:28:46.348910] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T19:28:46.360396] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-24T19:28:46.607049] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-24T19:28:46.618385] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-24T19:28:46.678424] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T19:28:46.682600] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-24T19:28:47.251858] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:28:47.262628] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-24T19:28:47.531478] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T19:28:47.537199] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-24T19:28:47.954918] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T19:28:48.003944] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-24T19:28:48.007417] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T19:28:48.020390] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-24T19:28:48.253495] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T19:28:48.258995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-24T19:28:48.987422] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T19:28:48.997819] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-24T19:28:49.181834] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T19:28:49.187851] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-24T19:28:49.405463] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T19:28:49.416198] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-24T19:28:49.778784] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T19:28:49.790094] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-24T19:28:50.182206] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T19:28:50.186800] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-24T19:28:50.639999] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:28:50.651857] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-24T19:28:50.895598] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:28:50.907343] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-24T19:28:51.249321] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T19:28:51.254106] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-24T19:28:51.861349] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T19:28:51.873034] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-24T19:28:52.044411] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T19:28:52.056188] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-24T19:28:52.290613] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T19:28:52.295856] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-24T19:28:52.621824] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T19:28:52.633373] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-24T19:28:53.266415] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:28:53.270516] [INFO ] [REMOTE ] IPI: Full fetch complete (29032 records). [2025-09-24T19:28:53.270598] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-24T19:28:53.663460] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-24T19:28:53.663759] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-24T19:28:53.664632] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-24T19:28:53.664837] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-24T19:28:53.680637] [DEBUG] [LOCAL ] IPI: Trimmed 29032 records to 21297 (keeping 200 days of data) [2025-09-24T19:28:53.708583] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T19:28:53.798805] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-24T19:28:53.911231] [DEBUG] [LOCAL ] IPI: Primary data saved (21297 records). [2025-09-24T19:28:53.913574] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T19:28:53.912266] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-24T19:28:53.913888] [INFO ] [MAIN ] Update Progress: 1121/2373 symbols completed. IPI took 12.7s. Estimated remaining: 2h 46m 14s. Rate: 7.5 symbols/min [2025-09-24T19:28:53.967866] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-24T19:28:54.118083] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:28:54.141695] [DEBUG] [LOCAL ] IQI: Loaded 18001 existing records from primary storage. [2025-09-24T19:28:54.141822] [INFO ] [MAIN ] IQI: Loaded 18001 existing records. [2025-09-24T19:28:54.363677] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:28:54.368177] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:28:54.380119] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-24T19:28:54.380184] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-24T19:28:54.380954] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-24T19:28:54.381031] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-24T19:28:54.424109] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-24T19:28:54.735770] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:28:54.736121] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-24T19:28:55.576497] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T19:28:55.589063] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-24T19:28:55.778725] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T19:28:55.790448] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-24T19:28:55.829305] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T19:28:55.834400] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-24T19:28:56.216731] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T19:28:56.228761] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-24T19:28:56.618844] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T19:28:56.623002] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-24T19:28:57.397703] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T19:28:57.424547] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-24T19:28:57.425408] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T19:28:57.432015] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-24T19:28:57.517779] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-24T19:28:57.529108] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-24T19:28:57.735885] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T19:28:57.754132] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-24T19:28:58.378089] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T19:28:58.416139] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-24T19:28:59.334901] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T19:28:59.347612] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-24T19:28:59.493242] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T19:28:59.535755] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:28:59.568141] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T19:29:00.016116] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-24T19:29:00.816100] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-24T19:29:01.259637] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T19:29:01.269313] [INFO ] [REMOTE ] IP: Full fetch complete (77051 records). [2025-09-24T19:29:01.269500] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-24T19:29:01.621420] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-24T19:29:01.710295] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-24T19:29:01.710547] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-24T19:29:01.711852] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-24T19:29:01.712192] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-24T19:29:01.714249] [DEBUG] [LOCAL ] IP: Trimmed 77051 records to 53315 (keeping 200 days of data) [2025-09-24T19:29:01.837748] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:29:02.115488] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T19:29:02.132176] [DEBUG] [LOCAL ] IP: Primary data saved (53315 records). [2025-09-24T19:29:02.132322] [INFO ] [MAIN ] IP: Full history saved. [2025-09-24T19:29:02.132502] [INFO ] [MAIN ] Update Progress: 1122/2373 symbols completed. IP took 20.9s. Estimated remaining: 2h 46m 6s. Rate: 7.5 symbols/min [2025-09-24T19:29:02.305320] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:02.364410] [DEBUG] [LOCAL ] IQV: Loaded 50310 existing records from primary storage. [2025-09-24T19:29:02.364717] [INFO ] [MAIN ] IQV: Loaded 50310 existing records. [2025-09-24T19:29:02.421759] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-24T19:29:02.557722] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:02.558048] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-24T19:29:02.558111] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-24T19:29:02.559685] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-24T19:29:02.559766] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-24T19:29:02.922678] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:03.106319] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-24T19:29:03.216117] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-24T19:29:03.266847] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T19:29:03.290480] [INFO ] [REMOTE ] IPG: Full fetch complete (77249 records). [2025-09-24T19:29:03.290910] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-24T19:29:03.697727] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-24T19:29:03.697820] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-24T19:29:03.698863] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-24T19:29:03.698961] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-24T19:29:03.704321] [DEBUG] [LOCAL ] IPG: Trimmed 77249 records to 53331 (keeping 200 days of data) [2025-09-24T19:29:04.035886] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-24T19:29:04.066610] [DEBUG] [LOCAL ] IPG: Primary data saved (53331 records). [2025-09-24T19:29:04.066966] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-24T19:29:04.067333] [INFO ] [MAIN ] Update Progress: 1123/2373 symbols completed. IPG took 22.8s. Estimated remaining: 2h 45m 51s. Rate: 7.5 symbols/min [2025-09-24T19:29:04.254729] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:04.269142] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T19:29:04.326037] [DEBUG] [LOCAL ] IR: Loaded 52696 existing records from primary storage. [2025-09-24T19:29:04.326213] [INFO ] [MAIN ] IR: Loaded 52696 existing records. [2025-09-24T19:29:04.502663] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:04.502937] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-24T19:29:04.502986] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-24T19:29:04.504512] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-24T19:29:04.504574] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-24T19:29:04.824685] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-24T19:29:04.867914] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:05.616099] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-24T19:29:05.903148] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T19:29:05.973861] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T19:29:05.992229] [INFO ] [REMOTE ] IOT: Full fetch complete (77380 records). [2025-09-24T19:29:05.992503] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-24T19:29:06.421773] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-24T19:29:06.447597] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-24T19:29:06.447765] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-24T19:29:06.449047] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-24T19:29:06.449140] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-24T19:29:06.454017] [DEBUG] [LOCAL ] IOT: Trimmed 77380 records to 53470 (keeping 200 days of data) [2025-09-24T19:29:06.817093] [DEBUG] [LOCAL ] IOT: Primary data saved (53470 records). [2025-09-24T19:29:06.817295] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-24T19:29:06.817440] [INFO ] [MAIN ] Update Progress: 1124/2373 symbols completed. IOT took 25.6s. Estimated remaining: 2h 45m 38s. Rate: 7.5 symbols/min [2025-09-24T19:29:07.000064] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:07.065974] [DEBUG] [LOCAL ] IRM: Loaded 49478 existing records from primary storage. [2025-09-24T19:29:07.066633] [INFO ] [MAIN ] IRM: Loaded 49478 existing records. [2025-09-24T19:29:07.221396] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-24T19:29:07.281759] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:07.297040] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-24T19:29:07.297453] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-24T19:29:07.299996] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:29:07.300087] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-24T19:29:07.300394] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-24T19:29:07.691437] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T19:29:07.723199] [INFO ] [REMOTE ] IQI: Full fetch complete (27199 records). [2025-09-24T19:29:07.734532] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-24T19:29:07.997237] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:08.021295] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-24T19:29:08.484017] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-24T19:29:08.484148] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-24T19:29:08.485207] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-24T19:29:08.485284] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-24T19:29:08.486874] [DEBUG] [LOCAL ] IQI: Trimmed 27199 records to 17974 (keeping 200 days of data) [2025-09-24T19:29:08.676773] [DEBUG] [LOCAL ] IQI: Primary data saved (17974 records). [2025-09-24T19:29:08.677211] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-24T19:29:08.677359] [INFO ] [MAIN ] Update Progress: 1125/2373 symbols completed. IQI took 14.8s. Estimated remaining: 2h 45m 23s. Rate: 7.5 symbols/min [2025-09-24T19:29:08.817488] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-24T19:29:08.945225] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:08.979060] [DEBUG] [LOCAL ] IRS: Loaded 21668 existing records from primary storage. [2025-09-24T19:29:08.979233] [INFO ] [MAIN ] IRS: Loaded 21668 existing records. [2025-09-24T19:29:09.187991] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T19:29:09.303479] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:09.303796] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-24T19:29:09.303848] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-24T19:29:09.304634] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-24T19:29:09.304731] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-24T19:29:09.627264] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-24T19:29:09.670380] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:09.985427] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:29:10.416070] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-24T19:29:10.528105] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T19:29:10.951849] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T19:29:11.171799] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T19:29:11.216033] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-24T19:29:12.016095] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-24T19:29:12.219229] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:29:12.816104] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-24T19:29:13.616059] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-24T19:29:13.775954] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T19:29:14.416068] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-24T19:29:14.529639] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T19:29:14.565025] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:29:15.216093] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-24T19:29:16.016068] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-24T19:29:16.143712] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:29:16.191814] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T19:29:16.816091] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-24T19:29:17.616303] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-24T19:29:17.774561] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T19:29:18.096781] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T19:29:18.416064] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-24T19:29:18.763443] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T19:29:19.216095] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-24T19:29:20.016048] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-24T19:29:20.233410] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T19:29:20.309793] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:29:20.816090] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-24T19:29:21.616106] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-24T19:29:21.763794] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T19:29:21.846240] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T19:29:22.416099] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-24T19:29:23.216061] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-24T19:29:23.324541] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T19:29:23.743844] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T19:29:24.016085] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-24T19:29:24.816055] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-24T19:29:24.947107] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T19:29:25.621289] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-24T19:29:25.646411] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:29:26.416190] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-24T19:29:26.570312] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T19:29:26.761196] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T19:29:27.216153] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-24T19:29:27.939754] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T19:29:28.016115] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-24T19:29:28.285953] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T19:29:28.292720] [INFO ] [REMOTE ] IRS: Full fetch complete (32242 records). [2025-09-24T19:29:28.292878] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-24T19:29:28.674065] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-24T19:29:28.674232] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-24T19:29:28.675332] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-24T19:29:28.675399] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-24T19:29:28.676523] [DEBUG] [LOCAL ] IRS: Trimmed 32242 records to 21830 (keeping 200 days of data) [2025-09-24T19:29:28.816274] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-24T19:29:28.819826] [DEBUG] [LOCAL ] IRS: Primary data saved (21830 records). [2025-09-24T19:29:28.820009] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-24T19:29:28.820131] [INFO ] [MAIN ] Update Progress: 1126/2373 symbols completed. IRS took 20.1s. Estimated remaining: 2h 45m 29s. Rate: 7.5 symbols/min [2025-09-24T19:29:29.048930] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:29.124467] [DEBUG] [LOCAL ] IRT: Loaded 50392 existing records from primary storage. [2025-09-24T19:29:29.124709] [INFO ] [MAIN ] IRT: Loaded 50392 existing records. [2025-09-24T19:29:29.323206] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:29.323718] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-24T19:29:29.323841] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-24T19:29:29.325858] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-24T19:29:29.325925] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-24T19:29:29.621223] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-24T19:29:29.736723] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:29.767968] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T19:29:30.416128] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-24T19:29:30.648214] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T19:29:31.216136] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-24T19:29:31.370870] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T19:29:31.864078] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:29:32.016115] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-24T19:29:32.558300] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T19:29:32.816104] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-24T19:29:33.616071] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-24T19:29:33.818065] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T19:29:34.416079] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-24T19:29:34.458680] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:29:35.216116] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-24T19:29:35.444380] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T19:29:35.453990] [INFO ] [REMOTE ] IRM: Full fetch complete (72261 records). [2025-09-24T19:29:35.454174] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-24T19:29:35.858015] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-24T19:29:35.858154] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-24T19:29:35.859416] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-24T19:29:35.859560] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-24T19:29:35.861624] [DEBUG] [LOCAL ] IRM: Trimmed 72261 records to 49460 (keeping 200 days of data) [2025-09-24T19:29:36.016416] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-24T19:29:36.015128] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T19:29:36.226908] [DEBUG] [LOCAL ] IRM: Primary data saved (49460 records). [2025-09-24T19:29:36.227107] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-24T19:29:36.227216] [INFO ] [MAIN ] Update Progress: 1127/2373 symbols completed. IRM took 29.4s. Estimated remaining: 2h 45m 20s. Rate: 7.5 symbols/min [2025-09-24T19:29:36.404237] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:36.421054] [DEBUG] [LOCAL ] ISD: Loaded 15567 existing records from primary storage. [2025-09-24T19:29:36.421182] [INFO ] [MAIN ] ISD: Loaded 15567 existing records. [2025-09-24T19:29:36.609596] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:36.610218] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-24T19:29:36.610417] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-24T19:29:36.611252] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-24T19:29:36.611448] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-24T19:29:36.831773] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:29:36.827268] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-24T19:29:37.043190] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:37.364594] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:29:37.616100] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-24T19:29:38.416132] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-24T19:29:38.564755] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T19:29:38.599289] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T19:29:39.216150] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-24T19:29:39.926687] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T19:29:40.016042] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-24T19:29:40.816083] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-24T19:29:41.100405] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:29:41.115123] [INFO ] [REMOTE ] IQV: Full fetch complete (72304 records). [2025-09-24T19:29:41.115331] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-24T19:29:41.538212] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-24T19:29:41.538878] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-24T19:29:41.540327] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-24T19:29:41.540469] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-24T19:29:41.544259] [DEBUG] [LOCAL ] IQV: Trimmed 72304 records to 50208 (keeping 200 days of data) [2025-09-24T19:29:41.616473] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-24T19:29:41.708219] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:29:41.709040] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T19:29:41.943693] [DEBUG] [LOCAL ] IQV: Primary data saved (50208 records). [2025-09-24T19:29:41.943885] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-24T19:29:41.943987] [INFO ] [MAIN ] Update Progress: 1128/2373 symbols completed. IQV took 39.8s. Estimated remaining: 2h 45m 10s. Rate: 7.5 symbols/min [2025-09-24T19:29:42.121218] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:42.164608] [DEBUG] [LOCAL ] IT: Loaded 41528 existing records from primary storage. [2025-09-24T19:29:42.164814] [INFO ] [MAIN ] IT: Loaded 41528 existing records. [2025-09-24T19:29:42.343213] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:42.343481] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-24T19:29:42.343529] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-24T19:29:42.344746] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-24T19:29:42.344809] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-24T19:29:42.421225] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-24T19:29:42.704760] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:43.216042] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-24T19:29:43.426606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T19:29:43.453474] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T19:29:44.016077] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-24T19:29:44.221234] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T19:29:44.704978] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T19:29:44.816110] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-24T19:29:45.616108] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-24T19:29:45.869486] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T19:29:46.416098] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-24T19:29:47.216119] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-24T19:29:47.357362] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:29:47.367210] [INFO ] [REMOTE ] IR: Full fetch complete (76132 records). [2025-09-24T19:29:47.367390] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-24T19:29:47.807634] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-24T19:29:47.807881] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-24T19:29:47.809306] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-24T19:29:47.825956] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-24T19:29:47.829281] [DEBUG] [LOCAL ] IR: Trimmed 76132 records to 52697 (keeping 200 days of data) [2025-09-24T19:29:47.828123] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T19:29:47.939741] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T19:29:48.040990] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-24T19:29:48.191806] [DEBUG] [LOCAL ] IR: Primary data saved (52697 records). [2025-09-24T19:29:48.191966] [INFO ] [MAIN ] IR: Full history saved. [2025-09-24T19:29:48.192062] [INFO ] [MAIN ] Update Progress: 1129/2373 symbols completed. IR took 44.1s. Estimated remaining: 2h 44m 60s. Rate: 7.5 symbols/min [2025-09-24T19:29:48.365190] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:48.398352] [DEBUG] [LOCAL ] ITGR: Loaded 31561 existing records from primary storage. [2025-09-24T19:29:48.398521] [INFO ] [MAIN ] ITGR: Loaded 31561 existing records. [2025-09-24T19:29:48.583575] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:29:48.583918] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-24T19:29:48.583974] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-24T19:29:48.584806] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-24T19:29:48.584867] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-24T19:29:48.824189] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-24T19:29:48.966987] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:49.552314] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:29:49.577688] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T19:29:49.616069] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-24T19:29:50.416122] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-24T19:29:51.216072] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-24T19:29:51.259106] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T19:29:51.903844] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:29:52.016053] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-24T19:29:52.264480] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T19:29:52.729984] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T19:29:52.816046] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-24T19:29:53.616068] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-24T19:29:53.655891] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T19:29:54.416070] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-24T19:29:54.640709] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T19:29:55.216087] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-24T19:29:56.016726] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T19:29:56.016916] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-24T19:29:56.816057] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-24T19:29:56.881574] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T19:29:57.144339] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T19:29:57.616094] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-24T19:29:57.714919] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T19:29:57.717923] [INFO ] [REMOTE ] ISD: Full fetch complete (23846 records). [2025-09-24T19:29:57.718019] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-24T19:29:58.101293] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-24T19:29:58.101410] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-24T19:29:58.102011] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-24T19:29:58.102073] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-24T19:29:58.102739] [DEBUG] [LOCAL ] ISD: Trimmed 23846 records to 15572 (keeping 200 days of data) [2025-09-24T19:29:58.202243] [DEBUG] [LOCAL ] ISD: Primary data saved (15572 records). [2025-09-24T19:29:58.202415] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-24T19:29:58.202511] [INFO ] [MAIN ] Update Progress: 1130/2373 symbols completed. ISD took 22.0s. Estimated remaining: 2h 44m 54s. Rate: 7.5 symbols/min [2025-09-24T19:29:58.371447] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:29:58.371632] [DEBUG] [LOCAL ] ITT: No existing data file found in primary storage. [2025-09-24T19:29:58.371707] [WARN ] [MAIN ] ITT: No existing data found, performing full refresh instead. [2025-09-24T19:29:58.371876] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-24T19:29:58.371919] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-24T19:29:58.371966] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-24T19:29:58.372000] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-24T19:29:58.427931] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-24T19:29:58.756509] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:29:59.046314] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T19:29:59.216139] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-24T19:29:59.775431] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T19:30:00.016156] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-24T19:30:00.520083] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T19:30:00.816142] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-24T19:30:01.513181] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T19:30:01.616171] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-24T19:30:02.423727] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-24T19:30:02.432138] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T19:30:03.216119] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-24T19:30:04.016198] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-24T19:30:05.091395] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-24T19:30:05.103849] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-24T19:30:05.658763] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (3.24 seconds). [2025-09-24T19:30:05.667420] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-24T19:30:05.884174] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T19:30:05.893595] [INFO ] [REMOTE ] IRT: Full fetch complete (72377 records). [2025-09-24T19:30:05.893781] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-24T19:30:06.184917] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (2.97 seconds). [2025-09-24T19:30:06.325620] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-24T19:30:06.325747] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-24T19:30:06.326836] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-24T19:30:06.326906] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-24T19:30:06.328495] [DEBUG] [LOCAL ] IRT: Trimmed 72377 records to 50394 (keeping 200 days of data) [2025-09-24T19:30:06.419185] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-24T19:30:06.659226] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T19:30:06.682005] [DEBUG] [LOCAL ] IRT: Primary data saved (50394 records). [2025-09-24T19:30:06.682138] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-24T19:30:06.682233] [INFO ] [MAIN ] Update Progress: 1131/2373 symbols completed. IRT took 37.9s. Estimated remaining: 2h 44m 47s. Rate: 7.5 symbols/min [2025-09-24T19:30:06.858085] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:06.879367] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T19:30:06.933933] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-24T19:30:06.934093] [INFO ] [MAIN ] ITUB: Loaded 53304 existing records. [2025-09-24T19:30:07.133736] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:07.134007] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-24T19:30:07.134057] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-24T19:30:07.135530] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-24T19:30:07.135593] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-24T19:30:07.221218] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-24T19:30:07.505940] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:07.857801] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T19:30:08.016045] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-24T19:30:08.357879] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T19:30:08.816124] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-24T19:30:09.444895] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T19:30:09.616075] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-24T19:30:10.352393] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:30:10.416059] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-24T19:30:10.798800] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T19:30:11.216082] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-24T19:30:12.016053] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-24T19:30:12.212923] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T19:30:12.816102] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-24T19:30:12.859871] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:30:13.359614] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T19:30:13.616098] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-24T19:30:14.263434] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T19:30:14.416100] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-24T19:30:15.216092] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-24T19:30:15.799378] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T19:30:16.016098] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-24T19:30:16.754002] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-24T19:30:16.816047] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-24T19:30:17.153843] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T19:30:17.190036] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-24T19:30:17.616073] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-24T19:30:18.416101] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-24T19:30:18.945930] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T19:30:19.170479] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-24T19:30:19.179185] [INFO ] [REMOTE ] IT: Full fetch complete (55265 records). [2025-09-24T19:30:19.179317] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-24T19:30:19.224439] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-24T19:30:19.577113] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-24T19:30:19.577210] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-24T19:30:19.578207] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-24T19:30:19.578275] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-24T19:30:19.579573] [DEBUG] [LOCAL ] IT: Trimmed 55265 records to 41579 (keeping 200 days of data) [2025-09-24T19:30:19.837988] [DEBUG] [LOCAL ] IT: Primary data saved (41579 records). [2025-09-24T19:30:19.838176] [INFO ] [MAIN ] IT: Full history saved. [2025-09-24T19:30:19.838284] [INFO ] [MAIN ] Update Progress: 1132/2373 symbols completed. IT took 37.9s. Estimated remaining: 2h 44m 44s. Rate: 7.5 symbols/min [2025-09-24T19:30:20.015327] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:20.016289] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-24T19:30:20.059324] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:30:20.114761] [DEBUG] [LOCAL ] ITW: Loaded 46324 existing records from primary storage. [2025-09-24T19:30:20.114965] [INFO ] [MAIN ] ITW: Loaded 46324 existing records. [2025-09-24T19:30:20.304925] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:20.305342] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-24T19:30:20.305514] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-24T19:30:20.306972] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-24T19:30:20.307037] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-24T19:30:20.463400] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:30:20.731509] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:20.816042] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-24T19:30:21.339950] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T19:30:21.346050] [INFO ] [REMOTE ] ITGR: Full fetch complete (41309 records). [2025-09-24T19:30:21.346179] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-24T19:30:21.621195] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-24T19:30:21.725794] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-24T19:30:21.725889] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-24T19:30:21.726894] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-24T19:30:21.726961] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-24T19:30:21.728033] [DEBUG] [LOCAL ] ITGR: Trimmed 41309 records to 31524 (keeping 200 days of data) [2025-09-24T19:30:21.927336] [DEBUG] [LOCAL ] ITGR: Primary data saved (31524 records). [2025-09-24T19:30:21.927494] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-24T19:30:21.927587] [INFO ] [MAIN ] Update Progress: 1133/2373 symbols completed. ITGR took 33.7s. Estimated remaining: 2h 44m 30s. Rate: 7.5 symbols/min [2025-09-24T19:30:22.109439] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:22.155133] [DEBUG] [LOCAL ] IVR: Loaded 47868 existing records from primary storage. [2025-09-24T19:30:22.155291] [INFO ] [MAIN ] IVR: Loaded 47868 existing records. [2025-09-24T19:30:22.337797] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:22.338085] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-24T19:30:22.338150] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-24T19:30:22.339306] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-24T19:30:22.339367] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-24T19:30:22.420240] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-24T19:30:22.750560] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T19:30:22.786797] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:23.216113] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-24T19:30:23.567059] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T19:30:23.774618] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T19:30:23.785838] [INFO ] [REMOTE ] ITT: Full fetch complete (46810 records). [2025-09-24T19:30:23.786205] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-24T19:30:24.024451] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-24T19:30:24.188035] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-24T19:30:24.188158] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-24T19:30:24.189433] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-24T19:30:24.189520] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-24T19:30:24.191310] [DEBUG] [LOCAL ] ITT: Trimmed 46810 records to 33096 (keeping 200 days of data) [2025-09-24T19:30:24.407881] [DEBUG] [LOCAL ] ITT: Primary data saved (33096 records). [2025-09-24T19:30:24.408078] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-24T19:30:24.408198] [INFO ] [MAIN ] Update Progress: 1134/2373 symbols completed. ITT took 26.2s. Estimated remaining: 2h 44m 16s. Rate: 7.5 symbols/min [2025-09-24T19:30:24.595297] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:24.625743] [DEBUG] [LOCAL ] IVT: Loaded 30966 existing records from primary storage. [2025-09-24T19:30:24.625886] [INFO ] [MAIN ] IVT: Loaded 30966 existing records. [2025-09-24T19:30:24.806090] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:24.806557] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-24T19:30:24.806615] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-24T19:30:24.807706] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-24T19:30:24.807767] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-24T19:30:24.821349] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-24T19:30:25.196849] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:25.199005] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-24T19:30:25.616103] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-24T19:30:25.672903] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T19:30:26.416111] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-24T19:30:26.639307] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T19:30:26.929607] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T19:30:27.216082] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-24T19:30:27.981376] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T19:30:28.016047] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-24T19:30:28.816067] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-24T19:30:28.976160] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T19:30:29.050889] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T19:30:29.616086] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-24T19:30:30.371194] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T19:30:30.416056] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-24T19:30:31.216065] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-24T19:30:31.262144] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:30:32.016113] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-24T19:30:32.241790] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T19:30:32.495772] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T19:30:32.816094] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-24T19:30:33.616097] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-24T19:30:33.742931] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T19:30:34.416086] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-24T19:30:34.699062] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:30:34.709078] [INFO ] [REMOTE ] ITUB: Full fetch complete (77162 records). [2025-09-24T19:30:34.709283] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-24T19:30:34.839272] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T19:30:35.144001] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-24T19:30:35.144100] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-24T19:30:35.145352] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-24T19:30:35.145431] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-24T19:30:35.147123] [DEBUG] [LOCAL ] ITUB: Trimmed 77162 records to 53304 (keeping 200 days of data) [2025-09-24T19:30:35.237104] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-24T19:30:35.476965] [DEBUG] [LOCAL ] ITUB: Primary data saved (53304 records). [2025-09-24T19:30:35.477186] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-24T19:30:35.477354] [INFO ] [MAIN ] Update Progress: 1135/2373 symbols completed. ITUB took 28.8s. Estimated remaining: 2h 44m 11s. Rate: 7.5 symbols/min [2025-09-24T19:30:35.647625] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:35.703071] [DEBUG] [LOCAL ] IVZ: Loaded 53139 existing records from primary storage. [2025-09-24T19:30:35.703262] [INFO ] [MAIN ] IVZ: Loaded 53139 existing records. [2025-09-24T19:30:35.893560] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:35.893910] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-24T19:30:35.893964] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-24T19:30:35.895272] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-24T19:30:35.895355] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-24T19:30:36.019621] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-24T19:30:36.342869] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:36.373817] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T19:30:36.506915] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T19:30:36.816101] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-24T19:30:37.620258] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-24T19:30:37.628017] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T19:30:38.416137] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-24T19:30:38.557895] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T19:30:39.216066] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-24T19:30:39.500743] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T19:30:40.016071] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-24T19:30:40.169892] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T19:30:40.494384] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T19:30:40.816089] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-24T19:30:40.942162] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T19:30:41.616090] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-24T19:30:42.298753] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T19:30:42.416076] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-24T19:30:42.441849] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T19:30:43.216147] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-24T19:30:43.764849] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T19:30:44.016134] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-24T19:30:44.816066] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-24T19:30:44.888795] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T19:30:45.616072] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-24T19:30:45.806565] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T19:30:46.416110] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-24T19:30:46.697771] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T19:30:46.755116] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T19:30:47.216114] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-24T19:30:48.016058] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-24T19:30:48.516059] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T19:30:48.587497] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T19:30:48.816109] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-24T19:30:49.627355] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-24T19:30:49.633047] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T19:30:50.391617] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:30:50.416057] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-24T19:30:51.218344] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-24T19:30:51.224085] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T19:30:51.945936] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:30:52.016144] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-24T19:30:52.816138] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-24T19:30:53.110023] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T19:30:53.119765] [INFO ] [REMOTE ] IVR: Full fetch complete (68963 records). [2025-09-24T19:30:53.119953] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-24T19:30:53.461302] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:30:53.621314] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-24T19:30:53.722814] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-24T19:30:53.722959] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-24T19:30:53.724733] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-24T19:30:53.724907] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-24T19:30:53.727082] [DEBUG] [LOCAL ] IVR: Trimmed 68963 records to 47862 (keeping 200 days of data) [2025-09-24T19:30:54.096891] [DEBUG] [LOCAL ] IVR: Primary data saved (47862 records). [2025-09-24T19:30:54.097137] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-24T19:30:54.097361] [INFO ] [MAIN ] Update Progress: 1136/2373 symbols completed. IVR took 32.2s. Estimated remaining: 2h 44m 15s. Rate: 7.5 symbols/min [2025-09-24T19:30:54.397914] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:54.422631] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-24T19:30:54.499771] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T19:30:54.535285] [DEBUG] [LOCAL ] IX: Loaded 22600 existing records from primary storage. [2025-09-24T19:30:54.535539] [INFO ] [MAIN ] IX: Loaded 22600 existing records. [2025-09-24T19:30:54.794244] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:54.794677] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-24T19:30:54.794757] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-24T19:30:54.795529] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-24T19:30:54.795602] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-24T19:30:55.217574] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-24T19:30:55.288521] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:55.292341] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T19:30:55.299884] [INFO ] [REMOTE ] IVT: Full fetch complete (45626 records). [2025-09-24T19:30:55.300170] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-24T19:30:55.702173] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-24T19:30:55.702399] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-24T19:30:55.703431] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-24T19:30:55.703608] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-24T19:30:55.704918] [DEBUG] [LOCAL ] IVT: Trimmed 45626 records to 30919 (keeping 200 days of data) [2025-09-24T19:30:55.947386] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T19:30:55.969504] [DEBUG] [LOCAL ] IVT: Primary data saved (30919 records). [2025-09-24T19:30:55.969717] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-24T19:30:55.969911] [INFO ] [MAIN ] Update Progress: 1137/2373 symbols completed. IVT took 31.6s. Estimated remaining: 2h 44m 0s. Rate: 7.5 symbols/min [2025-09-24T19:30:56.027830] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-24T19:30:56.151578] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:56.219270] [DEBUG] [LOCAL ] J: Loaded 40439 existing records from primary storage. [2025-09-24T19:30:56.219497] [INFO ] [MAIN ] J: Loaded 40439 existing records. [2025-09-24T19:30:56.413417] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:56.413798] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-24T19:30:56.413935] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-24T19:30:56.415235] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-24T19:30:56.415356] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-24T19:30:56.793107] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:56.816038] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-24T19:30:57.122343] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T19:30:57.380532] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T19:30:57.396829] [INFO ] [REMOTE ] ITW: Full fetch complete (66503 records). [2025-09-24T19:30:57.397205] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-24T19:30:57.621244] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-24T19:30:57.821719] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-24T19:30:57.821814] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-24T19:30:57.822864] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-24T19:30:57.822928] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-24T19:30:57.824429] [DEBUG] [LOCAL ] ITW: Trimmed 66503 records to 46224 (keeping 200 days of data) [2025-09-24T19:30:58.225011] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T19:30:58.246171] [DEBUG] [LOCAL ] ITW: Primary data saved (46224 records). [2025-09-24T19:30:58.246487] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-24T19:30:58.246621] [INFO ] [MAIN ] Update Progress: 1138/2373 symbols completed. ITW took 38.4s. Estimated remaining: 2h 43m 46s. Rate: 7.5 symbols/min [2025-09-24T19:30:58.429789] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-24T19:30:58.434539] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:30:58.489949] [DEBUG] [LOCAL ] JBGS: Loaded 42430 existing records from primary storage. [2025-09-24T19:30:58.490194] [INFO ] [MAIN ] JBGS: Loaded 42430 existing records. [2025-09-24T19:30:58.678686] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:30:58.679050] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-24T19:30:58.679101] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-24T19:30:58.681374] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-24T19:30:58.681442] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-24T19:30:59.064016] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:30:59.200041] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T19:30:59.216031] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-24T19:30:59.514158] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T19:30:59.724723] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-24T19:31:00.016134] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-24T19:31:00.766508] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T19:31:00.816040] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-24T19:31:01.616143] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-24T19:31:02.004475] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T19:31:02.416137] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-24T19:31:03.216066] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-24T19:31:03.486483] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T19:31:03.496488] [INFO ] [REMOTE ] IVZ: Full fetch complete (76746 records). [2025-09-24T19:31:03.496690] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-24T19:31:03.938477] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:31:03.970138] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-24T19:31:03.970864] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-24T19:31:03.972573] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-24T19:31:03.972679] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-24T19:31:03.975268] [DEBUG] [LOCAL ] IVZ: Trimmed 76746 records to 53136 (keeping 200 days of data) [2025-09-24T19:31:04.041754] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-24T19:31:04.334549] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T19:31:04.358241] [DEBUG] [LOCAL ] IVZ: Primary data saved (53136 records). [2025-09-24T19:31:04.358419] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-24T19:31:04.358569] [INFO ] [MAIN ] Update Progress: 1139/2373 symbols completed. IVZ took 28.9s. Estimated remaining: 2h 43m 36s. Rate: 7.5 symbols/min [2025-09-24T19:31:04.537564] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:04.588420] [DEBUG] [LOCAL ] JBI: Loaded 44004 existing records from primary storage. [2025-09-24T19:31:04.588598] [INFO ] [MAIN ] JBI: Loaded 44004 existing records. [2025-09-24T19:31:04.773301] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:31:04.773583] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-24T19:31:04.773634] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-24T19:31:04.774726] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-24T19:31:04.774792] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-24T19:31:04.821348] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-24T19:31:05.236153] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:05.253254] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T19:31:05.616096] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-24T19:31:06.263565] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T19:31:06.416112] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-24T19:31:07.126668] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:31:07.216096] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-24T19:31:07.477945] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T19:31:08.016149] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-24T19:31:08.539979] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T19:31:08.816116] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-24T19:31:09.403478] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T19:31:09.616133] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-24T19:31:10.247402] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:31:10.416063] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-24T19:31:10.792610] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T19:31:11.216111] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-24T19:31:11.799797] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T19:31:12.016090] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-24T19:31:12.779266] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T19:31:12.816062] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-24T19:31:13.603760] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T19:31:13.616035] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-24T19:31:13.870156] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T19:31:14.416099] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-24T19:31:15.223010] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-24T19:31:15.228371] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T19:31:15.902561] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:31:16.016136] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-24T19:31:16.471332] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T19:31:16.816134] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-24T19:31:17.109690] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T19:31:17.116144] [INFO ] [REMOTE ] IX: Full fetch complete (26886 records). [2025-09-24T19:31:17.116357] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-24T19:31:17.621333] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-24T19:31:17.737756] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-24T19:31:17.737930] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-24T19:31:17.739144] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-24T19:31:17.739238] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-24T19:31:17.740792] [DEBUG] [LOCAL ] IX: Trimmed 26886 records to 22617 (keeping 200 days of data) [2025-09-24T19:31:17.953510] [DEBUG] [LOCAL ] IX: Primary data saved (22617 records). [2025-09-24T19:31:17.953798] [INFO ] [MAIN ] IX: Full history saved. [2025-09-24T19:31:17.953971] [INFO ] [MAIN ] Update Progress: 1140/2373 symbols completed. IX took 23.9s. Estimated remaining: 2h 43m 35s. Rate: 7.5 symbols/min [2025-09-24T19:31:18.260261] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:18.359609] [DEBUG] [LOCAL ] JBL: Loaded 48368 existing records from primary storage. [2025-09-24T19:31:18.359887] [INFO ] [MAIN ] JBL: Loaded 48368 existing records. [2025-09-24T19:31:18.419513] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-24T19:31:18.614270] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T19:31:18.722711] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:31:18.723128] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-24T19:31:18.723190] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-24T19:31:18.724801] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-24T19:31:18.724871] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-24T19:31:19.143624] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:19.148099] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T19:31:19.216101] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-24T19:31:19.487679] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T19:31:20.016087] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-24T19:31:20.738774] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T19:31:20.816095] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-24T19:31:21.585619] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T19:31:21.616033] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-24T19:31:22.329581] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T19:31:22.416080] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-24T19:31:22.928079] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T19:31:23.216090] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-24T19:31:24.001087] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:31:24.016046] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-24T19:31:24.816059] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-24T19:31:25.024491] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:31:25.589501] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T19:31:25.616136] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-24T19:31:26.294860] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T19:31:26.416084] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-24T19:31:27.216070] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-24T19:31:27.268278] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:31:27.946851] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:31:28.016121] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-24T19:31:28.816112] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-24T19:31:28.954730] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T19:31:29.616115] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-24T19:31:30.085480] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T19:31:30.416110] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-24T19:31:30.535791] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:31:30.543683] [INFO ] [REMOTE ] J: Full fetch complete (59135 records). [2025-09-24T19:31:30.543861] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-24T19:31:30.959070] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-24T19:31:30.959167] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-24T19:31:30.960735] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-24T19:31:30.960801] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-24T19:31:30.962287] [DEBUG] [LOCAL ] J: Trimmed 59135 records to 40350 (keeping 200 days of data) [2025-09-24T19:31:31.216138] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-24T19:31:31.231298] [DEBUG] [LOCAL ] J: Primary data saved (40350 records). [2025-09-24T19:31:31.231450] [INFO ] [MAIN ] J: Full history saved. [2025-09-24T19:31:31.231544] [INFO ] [MAIN ] Update Progress: 1141/2373 symbols completed. J took 35.3s. Estimated remaining: 2h 43m 32s. Rate: 7.5 symbols/min [2025-09-24T19:31:31.411713] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:31.433893] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T19:31:31.442109] [INFO ] [REMOTE ] JBGS: Full fetch complete (59006 records). [2025-09-24T19:31:31.442256] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-24T19:31:31.679738] [DEBUG] [LOCAL ] JBND: Loaded 25406 existing records from primary storage. [2025-09-24T19:31:31.715604] [INFO ] [MAIN ] JBND: Loaded 25406 existing records. [2025-09-24T19:31:32.057738] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:31:32.093013] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-24T19:31:32.093184] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-24T19:31:32.093257] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-24T19:31:32.093434] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-24T19:31:32.094693] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-24T19:31:32.095105] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-24T19:31:32.096063] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-24T19:31:32.096381] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-24T19:31:32.140140] [DEBUG] [LOCAL ] JBGS: Trimmed 59006 records to 42470 (keeping 200 days of data) [2025-09-24T19:31:32.550639] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-24T19:31:32.652790] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-24T19:31:32.665524] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:32.801069] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:31:32.816161] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-24T19:31:32.868290] [DEBUG] [LOCAL ] JBGS: Primary data saved (42470 records). [2025-09-24T19:31:32.868472] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-24T19:31:32.868585] [INFO ] [MAIN ] Update Progress: 1142/2373 symbols completed. JBGS took 34.6s. Estimated remaining: 2h 43m 18s. Rate: 7.5 symbols/min [2025-09-24T19:31:33.046518] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:33.046766] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-24T19:31:33.046814] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-24T19:31:33.046968] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-24T19:31:33.047011] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-24T19:31:33.047053] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-24T19:31:33.047086] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-24T19:31:33.414708] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:33.616108] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-24T19:31:34.261885] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T19:31:34.364110] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T19:31:34.416091] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-24T19:31:34.588050] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T19:31:35.216097] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-24T19:31:35.418777] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:35.419156] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-24T19:31:36.016102] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-24T19:31:36.153557] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T19:31:36.816140] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-24T19:31:37.375580] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:31:37.490817] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T19:31:37.616097] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-24T19:31:38.416106] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-24T19:31:39.165931] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:31:39.189297] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T19:31:39.188860] [INFO ] [REMOTE ] JBI: Full fetch complete (64563 records). [2025-09-24T19:31:39.193247] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-24T19:31:39.225835] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-24T19:31:39.505514] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:39.526419] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-24T19:31:39.596880] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-24T19:31:39.596957] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-24T19:31:39.597980] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-24T19:31:39.598049] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-24T19:31:39.599522] [DEBUG] [LOCAL ] JBI: Trimmed 64563 records to 43886 (keeping 200 days of data) [2025-09-24T19:31:39.853629] [DEBUG] [LOCAL ] JBI: Primary data saved (43886 records). [2025-09-24T19:31:39.853794] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-24T19:31:39.853898] [INFO ] [MAIN ] Update Progress: 1143/2373 symbols completed. JBI took 35.5s. Estimated remaining: 2h 43m 9s. Rate: 7.5 symbols/min [2025-09-24T19:31:40.023423] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-24T19:31:40.026017] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:40.027028] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-24T19:31:40.027084] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-24T19:31:40.027235] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-24T19:31:40.027278] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-24T19:31:40.027319] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-24T19:31:40.027352] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-24T19:31:40.382796] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:40.816124] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-24T19:31:41.220364] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T19:31:41.616081] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-24T19:31:41.811103] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:41.811542] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-24T19:31:42.416140] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-24T19:31:42.637724] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:42.639562] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T19:31:42.639666] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-24T19:31:43.216121] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-24T19:31:43.435717] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:43.436116] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-24T19:31:44.016125] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-24T19:31:44.816112] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-24T19:31:45.134426] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T19:31:45.616108] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-24T19:31:45.900213] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:45.900745] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-24T19:31:46.420747] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-24T19:31:46.428563] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T19:31:46.644114] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:31:46.644926] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-24T19:31:47.216160] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-24T19:31:48.016132] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-24T19:31:48.816077] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-24T19:31:49.055859] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T19:31:49.064333] [INFO ] [REMOTE ] JBL: Full fetch complete (70001 records). [2025-09-24T19:31:49.064465] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-24T19:31:49.480801] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-24T19:31:49.481062] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-24T19:31:49.482363] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-24T19:31:49.482452] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-24T19:31:49.503290] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T19:31:49.511151] [DEBUG] [LOCAL ] JBL: Trimmed 70001 records to 48383 (keeping 200 days of data) [2025-09-24T19:31:49.624694] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-24T19:31:49.828042] [DEBUG] [LOCAL ] JBL: Primary data saved (48383 records). [2025-09-24T19:31:49.828207] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-24T19:31:49.828307] [INFO ] [MAIN ] Update Progress: 1144/2373 symbols completed. JBL took 31.9s. Estimated remaining: 2h 43m 3s. Rate: 7.5 symbols/min [2025-09-24T19:31:50.013501] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:31:50.030260] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T19:31:50.042808] [DEBUG] [LOCAL ] JCE: Loaded 6442 existing records from primary storage. [2025-09-24T19:31:50.042942] [INFO ] [MAIN ] JCE: Loaded 6442 existing records. [2025-09-24T19:31:50.222011] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:31:50.222275] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-24T19:31:50.222327] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-24T19:31:50.222781] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-24T19:31:50.222845] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-24T19:31:50.421287] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-24T19:31:50.594526] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:31:50.881274] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T19:31:51.216120] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-24T19:31:52.015019] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:31:52.020720] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-24T19:31:52.486158] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T19:31:52.708707] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T19:31:52.816159] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-24T19:31:53.616183] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-24T19:31:54.416112] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-24T19:31:54.597367] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T19:31:54.621447] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T19:31:55.216101] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-24T19:31:55.734025] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T19:31:55.983722] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T19:31:56.016057] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-24T19:31:56.816133] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-24T19:31:57.361850] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:31:57.616172] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-24T19:31:58.416128] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-24T19:31:58.557326] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T19:31:58.905313] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T19:31:59.081632] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T19:31:59.216127] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-24T19:32:00.016124] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-24T19:32:00.681945] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:32:00.816127] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-24T19:32:01.160737] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T19:32:01.616116] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-24T19:32:02.416064] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-24T19:32:02.727988] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T19:32:02.738703] [INFO ] [REMOTE ] JBS: Full fetch complete (26751 records). [2025-09-24T19:32:02.738948] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-24T19:32:02.861343] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T19:32:02.963054] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-24T19:32:02.980454] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:32:02.981300] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:32:02.982140] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-24T19:32:02.982031] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T19:32:02.988347] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-24T19:32:02.989032] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-24T19:32:02.989467] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-24T19:32:02.989589] [INFO ] [MAIN ] Update Progress: 1145/2373 symbols completed. JBS took 30.1s. Estimated remaining: 2h 43m 0s. Rate: 7.5 symbols/min [2025-09-24T19:32:03.179759] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:03.216123] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-24T19:32:03.241729] [DEBUG] [LOCAL ] JCI: Loaded 53548 existing records from primary storage. [2025-09-24T19:32:03.241951] [INFO ] [MAIN ] JCI: Loaded 53548 existing records. [2025-09-24T19:32:03.457277] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:03.457769] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-24T19:32:03.457833] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-24T19:32:03.460681] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-24T19:32:03.460786] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-24T19:32:03.897053] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:04.016091] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-24T19:32:04.544375] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T19:32:04.654110] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T19:32:04.816103] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-24T19:32:05.616197] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-24T19:32:06.198622] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:32:06.204690] [INFO ] [REMOTE ] JBTM: Full fetch complete (42030 records). [2025-09-24T19:32:06.204784] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-24T19:32:06.413255] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-24T19:32:06.414007] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:32:06.414270] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:32:06.414344] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-24T19:32:06.414417] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-24T19:32:06.414457] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-24T19:32:06.414497] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-24T19:32:06.414571] [INFO ] [MAIN ] Update Progress: 1146/2373 symbols completed. JBTM took 26.6s. Estimated remaining: 2h 42m 48s. Rate: 7.5 symbols/min [2025-09-24T19:32:06.426472] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-24T19:32:06.595973] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:06.645610] [DEBUG] [LOCAL ] JEF: Loaded 50003 existing records from primary storage. [2025-09-24T19:32:06.645792] [INFO ] [MAIN ] JEF: Loaded 50003 existing records. [2025-09-24T19:32:06.855677] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:06.861015] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T19:32:06.863874] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-24T19:32:06.868842] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-24T19:32:06.869006] [INFO ] [REMOTE ] JBND: Full fetch complete (33361 records). [2025-09-24T19:32:06.869268] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-24T19:32:06.878322] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-24T19:32:06.913752] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-24T19:32:06.897995] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T19:32:07.223541] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-24T19:32:07.680250] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:07.680510] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-24T19:32:07.680612] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-24T19:32:07.681619] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-24T19:32:07.681713] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-24T19:32:07.682497] [DEBUG] [LOCAL ] JBND: Trimmed 33361 records to 25512 (keeping 200 days of data) [2025-09-24T19:32:07.844597] [DEBUG] [LOCAL ] JBND: Primary data saved (25512 records). [2025-09-24T19:32:07.844764] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-24T19:32:07.844864] [INFO ] [MAIN ] Update Progress: 1147/2373 symbols completed. JBND took 36.6s. Estimated remaining: 2h 42m 33s. Rate: 7.5 symbols/min [2025-09-24T19:32:08.021812] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-24T19:32:08.026601] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:08.026856] [DEBUG] [LOCAL ] JELD: No existing data file found in primary storage. [2025-09-24T19:32:08.027786] [WARN ] [MAIN ] JELD: No existing data found, performing full refresh instead. [2025-09-24T19:32:08.028006] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-24T19:32:08.028064] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-24T19:32:08.028110] [DEBUG] [LOCAL ] JELD: No primary data file found to delete. [2025-09-24T19:32:08.028145] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-24T19:32:08.407816] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:08.749526] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T19:32:08.816103] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-24T19:32:09.017629] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T19:32:09.616112] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-24T19:32:10.334243] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:32:10.416138] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-24T19:32:10.601523] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T19:32:11.216147] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-24T19:32:11.806682] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T19:32:12.016113] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-24T19:32:12.650421] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T19:32:12.816074] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-24T19:32:13.004345] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T19:32:13.616081] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-24T19:32:14.416123] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-24T19:32:14.511620] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T19:32:14.514550] [INFO ] [REMOTE ] JCE: Full fetch complete (9068 records). [2025-09-24T19:32:14.514627] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-24T19:32:14.864583] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-24T19:32:14.960538] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-24T19:32:14.960622] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-24T19:32:14.960886] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-24T19:32:14.960938] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-24T19:32:14.961388] [DEBUG] [LOCAL ] JCE: Trimmed 9068 records to 6457 (keeping 200 days of data) [2025-09-24T19:32:15.003121] [DEBUG] [LOCAL ] JCE: Primary data saved (6457 records). [2025-09-24T19:32:15.003274] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-24T19:32:15.003371] [INFO ] [MAIN ] Update Progress: 1148/2373 symbols completed. JCE took 25.2s. Estimated remaining: 2h 42m 24s. Rate: 7.5 symbols/min [2025-09-24T19:32:15.175489] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:15.188077] [DEBUG] [LOCAL ] JEQ: Loaded 9100 existing records from primary storage. [2025-09-24T19:32:15.188242] [INFO ] [MAIN ] JEQ: Loaded 9100 existing records. [2025-09-24T19:32:15.221237] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-24T19:32:15.375080] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:15.375354] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-24T19:32:15.375408] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-24T19:32:15.375857] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-24T19:32:15.375919] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-24T19:32:15.735622] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:15.872996] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T19:32:16.016102] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-24T19:32:16.674487] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T19:32:16.816056] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-24T19:32:16.960774] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T19:32:17.616093] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-24T19:32:18.228703] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T19:32:18.416101] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-24T19:32:19.216073] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-24T19:32:19.263964] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T19:32:19.665199] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T19:32:20.016089] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-24T19:32:20.555929] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T19:32:20.816103] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-24T19:32:20.992733] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T19:32:21.308974] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T19:32:21.616091] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-24T19:32:22.416098] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-24T19:32:23.216133] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-24T19:32:23.454038] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T19:32:24.016934] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T19:32:24.018177] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T19:32:24.017070] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-24T19:32:24.816098] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-24T19:32:25.535550] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:32:25.616086] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-24T19:32:26.400405] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T19:32:26.416054] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-24T19:32:27.106027] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:32:27.216088] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-24T19:32:28.016094] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-24T19:32:28.053718] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T19:32:28.816073] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-24T19:32:28.914708] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T19:32:29.498060] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T19:32:29.616089] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-24T19:32:29.650510] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T19:32:30.416086] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-24T19:32:31.216089] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-24T19:32:31.483566] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:32:31.531557] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T19:32:31.955848] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T19:32:32.016076] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-24T19:32:32.588568] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T19:32:32.816097] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-24T19:32:33.616077] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-24T19:32:34.416098] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-24T19:32:34.644745] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T19:32:35.142305] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:32:35.216195] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-24T19:32:35.273087] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T19:32:36.016133] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-24T19:32:36.816156] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-24T19:32:37.166515] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T19:32:37.176278] [INFO ] [REMOTE ] JCI: Full fetch complete (77408 records). [2025-09-24T19:32:37.176447] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-24T19:32:37.624319] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-24T19:32:37.630611] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-24T19:32:37.631131] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-24T19:32:37.632631] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-24T19:32:37.632838] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-24T19:32:37.635215] [DEBUG] [LOCAL ] JCI: Trimmed 77408 records to 53547 (keeping 200 days of data) [2025-09-24T19:32:37.737877] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T19:32:37.788549] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T19:32:38.083813] [DEBUG] [LOCAL ] JCI: Primary data saved (53547 records). [2025-09-24T19:32:38.084026] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-24T19:32:38.084151] [INFO ] [MAIN ] Update Progress: 1149/2373 symbols completed. JCI took 35.1s. Estimated remaining: 2h 42m 32s. Rate: 7.5 symbols/min [2025-09-24T19:32:38.266505] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:38.300356] [DEBUG] [LOCAL ] JFR: Loaded 30403 existing records from primary storage. [2025-09-24T19:32:38.300556] [INFO ] [MAIN ] JFR: Loaded 30403 existing records. [2025-09-24T19:32:38.417185] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-24T19:32:38.506815] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:38.507213] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-24T19:32:38.507270] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-24T19:32:38.508367] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-24T19:32:38.508445] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-24T19:32:38.925224] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:39.216086] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-24T19:32:39.316947] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T19:32:40.016119] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-24T19:32:40.186838] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T19:32:40.218269] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T19:32:40.221311] [INFO ] [REMOTE ] JEQ: Full fetch complete (11450 records). [2025-09-24T19:32:40.221440] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-24T19:32:40.593750] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-24T19:32:40.593839] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-24T19:32:40.594146] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-24T19:32:40.594196] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-24T19:32:40.594764] [DEBUG] [LOCAL ] JEQ: Trimmed 11450 records to 9156 (keeping 200 days of data) [2025-09-24T19:32:40.652258] [DEBUG] [LOCAL ] JEQ: Primary data saved (9156 records). [2025-09-24T19:32:40.652388] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-24T19:32:40.652544] [INFO ] [MAIN ] Update Progress: 1150/2373 symbols completed. JEQ took 25.6s. Estimated remaining: 2h 42m 18s. Rate: 7.5 symbols/min [2025-09-24T19:32:40.821443] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-24T19:32:40.823685] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:40.842411] [DEBUG] [LOCAL ] JGH: Loaded 10944 existing records from primary storage. [2025-09-24T19:32:40.842538] [INFO ] [MAIN ] JGH: Loaded 10944 existing records. [2025-09-24T19:32:41.035300] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:41.035953] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-24T19:32:41.036066] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-24T19:32:41.036752] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-24T19:32:41.036854] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-24T19:32:41.397144] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:41.616120] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-24T19:32:41.641208] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:32:41.650550] [INFO ] [REMOTE ] JELD: Full fetch complete (63508 records). [2025-09-24T19:32:41.650740] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-24T19:32:42.047060] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-24T19:32:42.047151] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-24T19:32:42.048159] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-24T19:32:42.048292] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-24T19:32:42.049801] [DEBUG] [LOCAL ] JELD: Trimmed 63508 records to 46167 (keeping 200 days of data) [2025-09-24T19:32:42.350584] [DEBUG] [LOCAL ] JELD: Primary data saved (46167 records). [2025-09-24T19:32:42.350899] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-24T19:32:42.351108] [INFO ] [MAIN ] Update Progress: 1151/2373 symbols completed. JELD took 34.5s. Estimated remaining: 2h 42m 4s. Rate: 7.5 symbols/min [2025-09-24T19:32:42.420215] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-24T19:32:42.560201] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:42.578923] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T19:32:42.635970] [DEBUG] [LOCAL ] JHG: Loaded 47972 existing records from primary storage. [2025-09-24T19:32:42.636679] [INFO ] [MAIN ] JHG: Loaded 47972 existing records. [2025-09-24T19:32:42.848177] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:32:42.852786] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:42.860970] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-24T19:32:42.861030] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-24T19:32:42.862325] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-24T19:32:42.862397] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-24T19:32:43.221806] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-24T19:32:43.226550] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:43.251594] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T19:32:44.016130] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-24T19:32:44.727730] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T19:32:44.729938] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:32:44.816130] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-24T19:32:45.616110] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-24T19:32:46.416177] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-24T19:32:46.460840] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T19:32:46.470688] [INFO ] [REMOTE ] JEF: Full fetch complete (72833 records). [2025-09-24T19:32:46.470926] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-24T19:32:46.913345] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-24T19:32:46.913477] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-24T19:32:46.914830] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-24T19:32:46.914944] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-24T19:32:46.916841] [DEBUG] [LOCAL ] JEF: Trimmed 72833 records to 49996 (keeping 200 days of data) [2025-09-24T19:32:47.056635] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T19:32:47.202103] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T19:32:47.216175] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-24T19:32:47.306798] [DEBUG] [LOCAL ] JEF: Primary data saved (49996 records). [2025-09-24T19:32:47.306972] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-24T19:32:47.307127] [INFO ] [MAIN ] Update Progress: 1152/2373 symbols completed. JEF took 40.9s. Estimated remaining: 2h 41m 52s. Rate: 7.5 symbols/min [2025-09-24T19:32:47.474728] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:32:47.481238] [DEBUG] [LOCAL ] JHI: Loaded 3572 existing records from primary storage. [2025-09-24T19:32:47.481342] [INFO ] [MAIN ] JHI: Loaded 3572 existing records. [2025-09-24T19:32:47.656080] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:32:47.656358] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-24T19:32:47.656415] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-24T19:32:47.656727] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-24T19:32:47.656788] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-24T19:32:48.016637] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:32:48.016846] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-24T19:32:48.605801] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:32:48.776138] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T19:32:48.816043] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-24T19:32:49.616099] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-24T19:32:50.010916] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-24T19:32:50.361871] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:32:50.416144] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-24T19:32:51.216103] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-24T19:32:51.751378] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T19:32:51.934614] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:32:52.016049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-24T19:32:52.524310] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T19:32:52.816094] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-24T19:32:53.518950] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T19:32:53.616077] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-24T19:32:54.373336] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T19:32:54.416113] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-24T19:32:55.160699] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T19:32:55.216091] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-24T19:32:56.016146] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-24T19:32:56.069662] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T19:32:56.597592] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T19:32:56.816126] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-24T19:32:57.616121] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-24T19:32:58.236138] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T19:32:58.377971] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T19:32:58.416107] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-24T19:32:59.216152] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-24T19:32:59.727033] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:33:00.016107] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-24T19:33:00.677340] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T19:33:00.816052] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-24T19:33:01.217094] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T19:33:01.616134] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-24T19:33:02.416160] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-24T19:33:03.216120] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-24T19:33:03.374593] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-24T19:33:04.016138] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-24T19:33:04.357042] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T19:33:04.360618] [INFO ] [REMOTE ] JGH: Full fetch complete (14823 records). [2025-09-24T19:33:04.360729] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-24T19:33:04.641484] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-24T19:33:04.702825] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-24T19:33:04.792338] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-24T19:33:04.792423] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-24T19:33:04.792802] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-24T19:33:04.792862] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-24T19:33:04.793350] [DEBUG] [LOCAL ] JGH: Trimmed 14823 records to 10954 (keeping 200 days of data) [2025-09-24T19:33:04.827457] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-24T19:33:04.868822] [DEBUG] [LOCAL ] JGH: Primary data saved (10954 records). [2025-09-24T19:33:04.868946] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-24T19:33:04.869074] [INFO ] [MAIN ] Update Progress: 1153/2373 symbols completed. JGH took 24.2s. Estimated remaining: 2h 41m 55s. Rate: 7.5 symbols/min [2025-09-24T19:33:05.047050] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:05.053977] [DEBUG] [LOCAL ] JHS: Loaded 2865 existing records from primary storage. [2025-09-24T19:33:05.054061] [INFO ] [MAIN ] JHS: Loaded 2865 existing records. [2025-09-24T19:33:05.309086] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:05.309339] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-24T19:33:05.309396] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-24T19:33:05.309765] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-24T19:33:05.309824] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-24T19:33:05.628168] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-24T19:33:05.669580] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:05.940713] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T19:33:06.152362] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T19:33:06.200715] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T19:33:06.416116] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-24T19:33:06.911819] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T19:33:07.216091] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-24T19:33:08.016095] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-24T19:33:08.540900] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T19:33:08.556460] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T19:33:08.816070] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-24T19:33:09.616107] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-24T19:33:10.113661] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T19:33:10.416138] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-24T19:33:10.887011] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-24T19:33:11.013595] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T19:33:11.020262] [INFO ] [REMOTE ] JFR: Full fetch complete (47915 records). [2025-09-24T19:33:11.020390] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-24T19:33:11.221247] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-24T19:33:11.415542] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-24T19:33:11.415634] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-24T19:33:11.416559] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-24T19:33:11.416626] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-24T19:33:11.417924] [DEBUG] [LOCAL ] JFR: Trimmed 47915 records to 30352 (keeping 200 days of data) [2025-09-24T19:33:11.608441] [DEBUG] [LOCAL ] JFR: Primary data saved (30352 records). [2025-09-24T19:33:11.608596] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-24T19:33:11.608753] [INFO ] [MAIN ] Update Progress: 1154/2373 symbols completed. JFR took 33.5s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-24T19:33:11.791985] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:11.831380] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T19:33:11.853051] [DEBUG] [LOCAL ] JHX: Loaded 50123 existing records from primary storage. [2025-09-24T19:33:11.853213] [INFO ] [MAIN ] JHX: Loaded 50123 existing records. [2025-09-24T19:33:12.030745] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-24T19:33:12.038461] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:12.038724] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-24T19:33:12.038782] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-24T19:33:12.040063] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-24T19:33:12.040128] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-24T19:33:12.429844] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:12.816097] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-24T19:33:13.616036] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-24T19:33:13.702245] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T19:33:13.804209] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T19:33:14.416152] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-24T19:33:15.216111] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-24T19:33:15.369077] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T19:33:15.370740] [INFO ] [REMOTE ] JHI: Full fetch complete (5295 records). [2025-09-24T19:33:15.370817] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-24T19:33:15.731154] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-24T19:33:15.731240] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-24T19:33:15.731426] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-24T19:33:15.731466] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-24T19:33:15.731897] [DEBUG] [LOCAL ] JHI: Trimmed 5295 records to 3595 (keeping 200 days of data) [2025-09-24T19:33:15.754905] [DEBUG] [LOCAL ] JHI: Primary data saved (3595 records). [2025-09-24T19:33:15.754988] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-24T19:33:15.755068] [INFO ] [MAIN ] Update Progress: 1155/2373 symbols completed. JHI took 28.4s. Estimated remaining: 2h 41m 33s. Rate: 7.5 symbols/min [2025-09-24T19:33:15.934855] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:15.953244] [DEBUG] [LOCAL ] JILL: Loaded 16755 existing records from primary storage. [2025-09-24T19:33:15.953366] [INFO ] [MAIN ] JILL: Loaded 16755 existing records. [2025-09-24T19:33:16.022707] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-24T19:33:16.138097] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:16.138394] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-24T19:33:16.138444] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-24T19:33:16.139023] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-24T19:33:16.139085] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-24T19:33:16.349574] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T19:33:16.468411] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T19:33:16.559264] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:16.618617] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T19:33:16.816105] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-24T19:33:17.383082] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T19:33:17.616118] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-24T19:33:18.416092] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-24T19:33:18.608934] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T19:33:19.216124] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-24T19:33:19.281329] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T19:33:19.601043] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-24T19:33:20.016143] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-24T19:33:20.816087] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-24T19:33:21.623695] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-24T19:33:21.629569] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T19:33:21.653430] [INFO ] [REMOTE ] JHG: Full fetch complete (68448 records). [2025-09-24T19:33:21.656742] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-24T19:33:21.660042] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T19:33:22.081396] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-24T19:33:22.081485] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-24T19:33:22.082487] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-24T19:33:22.082555] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-24T19:33:22.084188] [DEBUG] [LOCAL ] JHG: Trimmed 68448 records to 47903 (keeping 200 days of data) [2025-09-24T19:33:22.160436] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T19:33:22.398621] [DEBUG] [LOCAL ] JHG: Primary data saved (47903 records). [2025-09-24T19:33:22.398811] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-24T19:33:22.398912] [INFO ] [MAIN ] Update Progress: 1156/2373 symbols completed. JHG took 40.0s. Estimated remaining: 2h 41m 24s. Rate: 7.5 symbols/min [2025-09-24T19:33:22.421268] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-24T19:33:22.570805] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:22.610672] [DEBUG] [LOCAL ] JKS: Loaded 40129 existing records from primary storage. [2025-09-24T19:33:22.610837] [INFO ] [MAIN ] JKS: Loaded 40129 existing records. [2025-09-24T19:33:22.808226] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:22.808488] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-24T19:33:22.808537] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-24T19:33:22.809466] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-24T19:33:22.809528] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-24T19:33:22.977360] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T19:33:23.209858] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:23.216039] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-24T19:33:24.016099] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-24T19:33:24.587429] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T19:33:24.816106] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-24T19:33:25.274152] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T19:33:25.438252] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T19:33:25.616071] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-24T19:33:26.242499] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T19:33:26.416093] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-24T19:33:27.216051] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-24T19:33:27.227435] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T19:33:27.681740] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T19:33:28.016099] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-24T19:33:28.711897] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T19:33:28.714422] [INFO ] [REMOTE ] JHS: Full fetch complete (4440 records). [2025-09-24T19:33:28.714723] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-24T19:33:28.818929] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-24T19:33:29.080375] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-24T19:33:29.080466] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-24T19:33:29.080661] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-24T19:33:29.080758] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-24T19:33:29.081127] [DEBUG] [LOCAL ] JHS: Trimmed 4440 records to 2851 (keeping 200 days of data) [2025-09-24T19:33:29.099306] [DEBUG] [LOCAL ] JHS: Primary data saved (2851 records). [2025-09-24T19:33:29.099387] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-24T19:33:29.099478] [INFO ] [MAIN ] Update Progress: 1157/2373 symbols completed. JHS took 24.2s. Estimated remaining: 2h 41m 15s. Rate: 7.5 symbols/min [2025-09-24T19:33:29.616093] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-24T19:33:30.398240] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:33:30.416043] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-24T19:33:30.473759] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T19:33:31.216103] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-24T19:33:31.952821] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T19:33:32.016098] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-24T19:33:32.816243] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-24T19:33:32.989999] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T19:33:33.624481] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-24T19:33:33.630104] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:33:33.727300] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T19:33:34.416148] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-24T19:33:34.974534] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T19:33:35.216086] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-24T19:33:36.016227] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-24T19:33:36.446714] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T19:33:36.816062] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-24T19:33:37.066418] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T19:33:37.110822] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T19:33:37.616076] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-24T19:33:37.910129] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:33:38.416130] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-24T19:33:39.216094] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-24T19:33:39.444987] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T19:33:39.795170] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:33:40.016142] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-24T19:33:40.368378] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T19:33:40.816147] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-24T19:33:41.482518] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:33:41.616075] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-24T19:33:41.922930] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T19:33:42.416104] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-24T19:33:43.216042] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-24T19:33:43.354558] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T19:33:43.717148] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T19:33:43.727574] [INFO ] [REMOTE ] JHX: Full fetch complete (57006 records). [2025-09-24T19:33:43.727723] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-24T19:33:44.024395] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-24T19:33:44.150420] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-24T19:33:44.150530] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-24T19:33:44.151555] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-24T19:33:44.151622] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-24T19:33:44.154974] [DEBUG] [LOCAL ] JHX: Trimmed 57006 records to 50437 (keeping 200 days of data) [2025-09-24T19:33:44.472636] [DEBUG] [LOCAL ] JHX: Primary data saved (50437 records). [2025-09-24T19:33:44.472819] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-24T19:33:44.472913] [INFO ] [MAIN ] Update Progress: 1158/2373 symbols completed. JHX took 32.9s. Estimated remaining: 2h 41m 15s. Rate: 7.5 symbols/min [2025-09-24T19:33:44.757535] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T19:33:44.816044] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-24T19:33:45.453580] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T19:33:45.616124] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-24T19:33:46.658149] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T19:33:46.661913] [INFO ] [REMOTE ] JILL: Full fetch complete (23073 records). [2025-09-24T19:33:46.662063] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-24T19:33:46.954961] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-24T19:33:46.996454] [INFO ] [REMOTE ] JKS: Full fetch complete (59415 records). [2025-09-24T19:33:47.007206] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-24T19:33:47.213727] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-24T19:33:47.213927] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-24T19:33:47.214950] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-24T19:33:47.225678] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-24T19:33:47.285031] [DEBUG] [LOCAL ] JILL: Trimmed 23073 records to 16769 (keeping 200 days of data) [2025-09-24T19:33:47.605022] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-24T19:33:47.607977] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-24T19:33:47.609212] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-24T19:33:47.609527] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-24T19:33:47.623151] [DEBUG] [LOCAL ] JKS: Trimmed 59415 records to 40108 (keeping 200 days of data) [2025-09-24T19:33:47.634951] [DEBUG] [LOCAL ] JILL: Primary data saved (16769 records). [2025-09-24T19:33:47.635079] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-24T19:33:47.635197] [INFO ] [MAIN ] Update Progress: 1159/2373 symbols completed. JILL took 31.9s. Estimated remaining: 2h 41m 2s. Rate: 7.5 symbols/min [2025-09-24T19:33:47.879236] [DEBUG] [LOCAL ] JKS: Primary data saved (40108 records). [2025-09-24T19:33:47.879370] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-24T19:33:47.879500] [INFO ] [MAIN ] Update Progress: 1160/2373 symbols completed. JKS took 25.5s. Estimated remaining: 2h 40m 46s. Rate: 7.5 symbols/min [2025-09-24T19:33:48.575683] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:48.627946] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:48.621765] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:48.652261] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-24T19:33:48.661794] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-24T19:33:48.686921] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:33:48.687114] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-24T19:33:48.687467] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-24T19:33:48.688074] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-24T19:33:48.688171] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-24T19:33:48.788429] [DEBUG] [LOCAL ] JLS: Loaded 4092 existing records from primary storage. [2025-09-24T19:33:48.813269] [INFO ] [MAIN ] JLS: Loaded 4092 existing records. [2025-09-24T19:33:48.926955] [DEBUG] [LOCAL ] JLL: Loaded 32090 existing records from primary storage. [2025-09-24T19:33:48.987536] [INFO ] [MAIN ] JLL: Loaded 32090 existing records. [2025-09-24T19:33:49.200608] [DEBUG] [LOCAL ] JMIA: Loaded 50490 existing records from primary storage. [2025-09-24T19:33:49.231471] [INFO ] [MAIN ] JMIA: Loaded 50490 existing records. [2025-09-24T19:33:49.459959] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:49.538679] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-24T19:33:49.541739] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:49.627047] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-24T19:33:49.644562] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:49.649878] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-24T19:33:49.685037] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-24T19:33:49.709884] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-24T19:33:49.715738] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:33:49.712376] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-24T19:33:49.715954] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-24T19:33:49.727977] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-24T19:33:49.749546] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-24T19:33:49.754760] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-24T19:33:49.754880] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-24T19:33:49.814674] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-24T19:33:49.849363] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-24T19:33:50.497720] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T19:33:50.561949] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-24T19:33:50.907083] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:50.920525] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:50.942155] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-24T19:33:50.958978] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-24T19:33:51.064600] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:33:51.065349] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-24T19:33:51.108369] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T19:33:51.109673] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-24T19:33:51.563336] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T19:33:51.565347] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-24T19:33:51.848235] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T19:33:51.902858] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-24T19:33:52.016140] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-24T19:33:52.469131] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T19:33:52.480940] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T19:33:52.816063] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-24T19:33:53.141305] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-24T19:33:53.214171] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-24T19:33:53.616089] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-24T19:33:54.071616] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-24T19:33:54.416135] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-24T19:33:54.960938] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T19:33:55.216094] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-24T19:33:55.820428] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T19:33:56.016112] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-24T19:33:56.816106] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-24T19:33:57.355722] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T19:33:57.616072] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-24T19:33:57.744265] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T19:33:58.206869] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-24T19:33:58.416145] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-24T19:33:59.216130] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-24T19:33:59.789237] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T19:33:59.884492] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T19:34:00.016139] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-24T19:34:00.816132] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-24T19:34:01.616084] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-24T19:34:01.800249] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T19:34:02.089413] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T19:34:02.401830] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:34:02.416024] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-24T19:34:03.216093] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-24T19:34:03.488294] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T19:34:04.016150] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-24T19:34:04.816047] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-24T19:34:04.986886] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T19:34:05.166997] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T19:34:05.483994] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T19:34:05.616068] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-24T19:34:06.416085] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-24T19:34:06.656141] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T19:34:06.924316] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-24T19:34:07.216106] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-24T19:34:07.652882] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T19:34:08.016089] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-24T19:34:08.494475] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-24T19:34:08.495348] [INFO ] [REMOTE ] JMM: Full fetch complete (2290 records). [2025-09-24T19:34:08.495437] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-24T19:34:08.699771] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-24T19:34:08.699963] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:34:08.700036] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:34:08.700107] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-24T19:34:08.700177] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-24T19:34:08.700218] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-24T19:34:08.700285] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-24T19:34:08.700366] [INFO ] [MAIN ] Update Progress: 1161/2373 symbols completed. JMM took 20.8s. Estimated remaining: 2h 40m 51s. Rate: 7.5 symbols/min [2025-09-24T19:34:08.821178] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-24T19:34:08.877515] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:08.937197] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-24T19:34:08.937349] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-24T19:34:09.117036] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:09.117288] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-24T19:34:09.117337] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-24T19:34:09.119023] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-24T19:34:09.119088] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-24T19:34:09.481561] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T19:34:09.481389] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:09.616067] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-24T19:34:10.207678] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T19:34:10.209086] [INFO ] [REMOTE ] JLS: Full fetch complete (5793 records). [2025-09-24T19:34:10.209159] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-24T19:34:10.424167] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-24T19:34:10.587520] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-24T19:34:10.587609] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-24T19:34:10.587884] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-24T19:34:10.587943] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-24T19:34:10.588358] [DEBUG] [LOCAL ] JLS: Trimmed 5793 records to 4088 (keeping 200 days of data) [2025-09-24T19:34:10.614673] [DEBUG] [LOCAL ] JLS: Primary data saved (4088 records). [2025-09-24T19:34:10.614795] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-24T19:34:10.614887] [INFO ] [MAIN ] Update Progress: 1162/2373 symbols completed. JLS took 22.7s. Estimated remaining: 2h 40m 37s. Rate: 7.5 symbols/min [2025-09-24T19:34:10.783850] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:10.837399] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-24T19:34:10.837548] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-24T19:34:11.013465] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:11.013735] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-24T19:34:11.013839] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-24T19:34:11.015248] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-24T19:34:11.015310] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-24T19:34:11.221276] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-24T19:34:11.370748] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:12.016123] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-24T19:34:12.816099] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-24T19:34:13.015019] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T19:34:13.131886] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-24T19:34:13.616120] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-24T19:34:14.242087] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:34:14.335818] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-24T19:34:14.416079] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-24T19:34:15.216063] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-24T19:34:15.431025] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T19:34:16.016128] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-24T19:34:16.632031] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-24T19:34:16.816082] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-24T19:34:17.446948] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-24T19:34:17.498366] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T19:34:17.616095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-24T19:34:18.416102] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-24T19:34:18.964002] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T19:34:19.069977] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-24T19:34:19.216089] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-24T19:34:19.729535] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T19:34:20.016092] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-24T19:34:20.816106] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-24T19:34:21.616097] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-24T19:34:21.846142] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T19:34:21.991686] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-24T19:34:22.416054] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-24T19:34:22.441403] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:34:22.447166] [INFO ] [REMOTE ] JLL: Full fetch complete (44855 records). [2025-09-24T19:34:22.447274] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-24T19:34:22.830308] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-24T19:34:22.830390] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-24T19:34:22.831175] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-24T19:34:22.831239] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-24T19:34:22.832305] [DEBUG] [LOCAL ] JLL: Trimmed 44855 records to 32095 (keeping 200 days of data) [2025-09-24T19:34:23.035778] [DEBUG] [LOCAL ] JLL: Primary data saved (32095 records). [2025-09-24T19:34:23.035971] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-24T19:34:23.036081] [INFO ] [MAIN ] Update Progress: 1163/2373 symbols completed. JLL took 35.2s. Estimated remaining: 2h 40m 34s. Rate: 7.5 symbols/min [2025-09-24T19:34:23.212772] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:23.216051] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-24T19:34:23.239570] [DEBUG] [LOCAL ] JOE: Loaded 24662 existing records from primary storage. [2025-09-24T19:34:23.239751] [INFO ] [MAIN ] JOE: Loaded 24662 existing records. [2025-09-24T19:34:23.428215] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:23.428537] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-24T19:34:23.428595] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-24T19:34:23.429437] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-24T19:34:23.429500] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-24T19:34:23.800003] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:23.833941] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-24T19:34:24.016081] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-24T19:34:24.816055] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-24T19:34:24.935633] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-24T19:34:25.134549] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T19:34:25.185039] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T19:34:25.616086] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-24T19:34:26.416103] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-24T19:34:26.886010] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T19:34:27.216133] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-24T19:34:27.724512] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T19:34:27.931372] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-24T19:34:28.016123] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-24T19:34:28.816086] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-24T19:34:29.175094] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T19:34:29.616124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-24T19:34:30.416191] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-24T19:34:30.546276] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-24T19:34:30.939847] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-24T19:34:30.949334] [INFO ] [REMOTE ] JMIA: Full fetch complete (73266 records). [2025-09-24T19:34:30.949502] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-24T19:34:31.222834] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-24T19:34:31.351318] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-24T19:34:31.352024] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-24T19:34:31.353058] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-24T19:34:31.353122] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-24T19:34:31.355324] [DEBUG] [LOCAL ] JMIA: Trimmed 73266 records to 50508 (keeping 200 days of data) [2025-09-24T19:34:31.461474] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T19:34:31.674735] [DEBUG] [LOCAL ] JMIA: Primary data saved (50508 records). [2025-09-24T19:34:31.674893] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-24T19:34:31.674988] [INFO ] [MAIN ] Update Progress: 1164/2373 symbols completed. JMIA took 43.8s. Estimated remaining: 2h 40m 26s. Rate: 7.5 symbols/min [2025-09-24T19:34:31.851129] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:31.861189] [DEBUG] [LOCAL ] JOF: Loaded 7131 existing records from primary storage. [2025-09-24T19:34:31.861306] [INFO ] [MAIN ] JOF: Loaded 7131 existing records. [2025-09-24T19:34:32.006590] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-24T19:34:32.017044] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-24T19:34:32.095347] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:32.095631] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-24T19:34:32.095725] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-24T19:34:32.096195] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-24T19:34:32.096283] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-24T19:34:32.460284] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:32.816135] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-24T19:34:33.327317] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:34:33.616090] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-24T19:34:33.686423] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-24T19:34:34.416135] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-24T19:34:34.632399] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T19:34:34.783015] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T19:34:35.216045] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-24T19:34:35.482932] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T19:34:36.016126] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-24T19:34:36.119905] [DEBUG] [REMOTE ] JOF: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-24T19:34:36.120261] [WARN ] [REMOTE ] JOF: No data returned for month 2025-01 [2025-09-24T19:34:36.816084] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-24T19:34:37.510730] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-24T19:34:37.616079] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-24T19:34:37.818880] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T19:34:38.159329] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T19:34:38.416102] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-24T19:34:39.216106] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-24T19:34:40.016124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-24T19:34:40.256064] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T19:34:40.816174] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-24T19:34:41.114631] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-24T19:34:41.386995] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T19:34:41.616110] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-24T19:34:42.165626] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-24T19:34:42.364666] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-24T19:34:42.416141] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-24T19:34:43.216091] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-24T19:34:43.810015] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-24T19:34:44.016139] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-24T19:34:44.816156] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-24T19:34:45.540418] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-24T19:34:45.550116] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-24T19:34:45.550274] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-24T19:34:45.619952] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-24T19:34:45.968917] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-24T19:34:45.969110] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-24T19:34:45.970715] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-24T19:34:45.970920] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-24T19:34:45.973313] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-24T19:34:46.086919] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T19:34:46.357340] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T19:34:46.403118] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-24T19:34:46.414727] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-24T19:34:46.415733] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-24T19:34:46.416409] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-24T19:34:46.551666] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-24T19:34:46.557080] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-24T19:34:46.557379] [INFO ] [MAIN ] Update Progress: 1165/2373 symbols completed. JOBY took 35.9s. Estimated remaining: 2h 40m 26s. Rate: 7.5 symbols/min [2025-09-24T19:34:46.957504] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:47.008019] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-24T19:34:47.008222] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-24T19:34:47.009538] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-24T19:34:47.009621] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-24T19:34:47.011823] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-24T19:34:47.132163] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:34:47.150366] [DEBUG] [LOCAL ] JPC: Loaded 37051 existing records from primary storage. [2025-09-24T19:34:47.151251] [INFO ] [MAIN ] JPC: Loaded 37051 existing records. [2025-09-24T19:34:47.218150] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-24T19:34:47.342224] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:47.343227] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-24T19:34:47.344049] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-24T19:34:47.345586] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-24T19:34:47.346165] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-24T19:34:47.722612] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:47.949906] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-24T19:34:47.950053] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-24T19:34:47.950141] [INFO ] [MAIN ] Update Progress: 1166/2373 symbols completed. JNJ took 39.2s. Estimated remaining: 2h 40m 11s. Rate: 7.5 symbols/min [2025-09-24T19:34:48.021301] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-24T19:34:48.060905] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T19:34:48.133710] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:48.186313] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-24T19:34:48.186466] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-24T19:34:48.370530] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:48.370877] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-24T19:34:48.370948] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-24T19:34:48.372625] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-24T19:34:48.372726] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-24T19:34:48.718087] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:48.816044] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-24T19:34:49.229314] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T19:34:49.616110] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-24T19:34:50.416184] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-24T19:34:50.739174] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T19:34:50.741177] [INFO ] [REMOTE ] JOF: Full fetch complete (8824 records). [2025-09-24T19:34:50.741304] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-24T19:34:50.930213] [WARN ] [VALIDATOR ] JOF: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T19:34:50.930447] [FATAL] [MAIN ] JOF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:34:50.930526] [WARN ] [MAIN ] JOF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:34:50.930575] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-24T19:34:50.930633] [DEBUG] [LOCAL ] JOF: No primary data file found to delete. [2025-09-24T19:34:50.930718] [INFO ] [LOCAL ] JOF: Starting deletion of derivative data. [2025-09-24T19:34:50.931201] [DEBUG] [LOCAL ] JOF: Deleted derivative data file. [2025-09-24T19:34:50.931312] [INFO ] [MAIN ] Update Progress: 1167/2373 symbols completed. JOF took 19.3s. Estimated remaining: 2h 39m 58s. Rate: 7.5 symbols/min [2025-09-24T19:34:51.114721] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:51.155880] [DEBUG] [LOCAL ] JQC: Loaded 33665 existing records from primary storage. [2025-09-24T19:34:51.156022] [INFO ] [MAIN ] JQC: Loaded 33665 existing records. [2025-09-24T19:34:51.222020] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-24T19:34:51.349852] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:51.350154] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-24T19:34:51.350276] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-24T19:34:51.351343] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-24T19:34:51.351409] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-24T19:34:51.583844] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-24T19:34:51.790070] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:51.847716] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:34:52.016088] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-24T19:34:52.195066] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:34:52.199929] [INFO ] [REMOTE ] JOE: Full fetch complete (36353 records). [2025-09-24T19:34:52.200047] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-24T19:34:52.583048] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-24T19:34:52.583139] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-24T19:34:52.583869] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-24T19:34:52.583950] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-24T19:34:52.585049] [DEBUG] [LOCAL ] JOE: Trimmed 36353 records to 24559 (keeping 200 days of data) [2025-09-24T19:34:52.751727] [DEBUG] [LOCAL ] JOE: Primary data saved (24559 records). [2025-09-24T19:34:52.751891] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-24T19:34:52.752041] [INFO ] [MAIN ] Update Progress: 1168/2373 symbols completed. JOE took 29.7s. Estimated remaining: 2h 39m 43s. Rate: 7.5 symbols/min [2025-09-24T19:34:52.821296] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-24T19:34:52.936334] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:34:52.957198] [DEBUG] [LOCAL ] JRI: Loaded 14888 existing records from primary storage. [2025-09-24T19:34:52.957329] [INFO ] [MAIN ] JRI: Loaded 14888 existing records. [2025-09-24T19:34:53.152511] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:34:53.153516] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-24T19:34:53.153673] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-24T19:34:53.154567] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-24T19:34:53.154633] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-24T19:34:53.349766] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T19:34:53.591030] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:34:53.616119] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-24T19:34:54.416103] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-24T19:34:55.037782] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:34:55.148923] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-24T19:34:55.216084] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-24T19:34:55.608821] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T19:34:56.016135] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-24T19:34:56.595817] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T19:34:56.816081] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-24T19:34:57.616161] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-24T19:34:57.975076] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T19:34:58.416160] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-24T19:34:58.449276] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T19:34:58.899199] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T19:34:59.028534] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T19:34:59.216090] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-24T19:35:00.016131] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-24T19:35:00.816148] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-24T19:35:01.545166] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T19:35:01.616149] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-24T19:35:01.823302] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-24T19:35:02.292622] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:35:02.416188] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-24T19:35:02.605221] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T19:35:03.216170] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-24T19:35:03.840304] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T19:35:04.016142] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-24T19:35:04.816205] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-24T19:35:05.419476] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T19:35:05.616121] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-24T19:35:05.725614] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T19:35:06.156176] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T19:35:06.416123] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-24T19:35:07.216135] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-24T19:35:07.802544] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T19:35:07.881175] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T19:35:07.934548] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-24T19:35:08.016124] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-24T19:35:08.816112] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-24T19:35:09.249530] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T19:35:09.616075] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-24T19:35:09.738077] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T19:35:10.416131] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-24T19:35:11.216115] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-24T19:35:11.780679] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T19:35:11.960785] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-24T19:35:12.016138] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-24T19:35:12.206507] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T19:35:12.816086] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-24T19:35:13.348297] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T19:35:13.418576] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T19:35:13.616083] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-24T19:35:14.416083] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-24T19:35:14.986794] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T19:35:14.994088] [INFO ] [REMOTE ] JQC: Full fetch complete (48498 records). [2025-09-24T19:35:14.994195] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-24T19:35:15.221269] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-24T19:35:15.400133] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-24T19:35:15.400227] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-24T19:35:15.401121] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-24T19:35:15.401188] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-24T19:35:15.402557] [DEBUG] [LOCAL ] JQC: Trimmed 48498 records to 33645 (keeping 200 days of data) [2025-09-24T19:35:15.634230] [DEBUG] [LOCAL ] JQC: Primary data saved (33645 records). [2025-09-24T19:35:15.634457] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-24T19:35:15.634667] [INFO ] [MAIN ] Update Progress: 1169/2373 symbols completed. JQC took 24.7s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-24T19:35:15.843602] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:15.844921] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:35:15.864675] [DEBUG] [LOCAL ] JRS: Loaded 11097 existing records from primary storage. [2025-09-24T19:35:15.864794] [INFO ] [MAIN ] JRS: Loaded 11097 existing records. [2025-09-24T19:35:16.019143] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-24T19:35:16.048665] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:16.048912] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-24T19:35:16.048978] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-24T19:35:16.049451] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-24T19:35:16.049535] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-24T19:35:16.415831] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:16.816087] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-24T19:35:17.454891] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T19:35:17.616066] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-24T19:35:17.851215] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T19:35:17.909377] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-24T19:35:18.416067] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-24T19:35:18.641880] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T19:35:19.216096] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-24T19:35:19.993710] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T19:35:20.016039] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-24T19:35:20.547008] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-24T19:35:20.570379] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T19:35:20.816092] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-24T19:35:21.616122] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-24T19:35:22.309861] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T19:35:22.401572] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T19:35:22.416034] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-24T19:35:23.216236] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-24T19:35:23.529815] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T19:35:23.533907] [INFO ] [REMOTE ] JRI: Full fetch complete (23173 records). [2025-09-24T19:35:23.534021] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-24T19:35:23.961928] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-24T19:35:23.962123] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-24T19:35:23.962829] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-24T19:35:23.962897] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-24T19:35:23.963747] [DEBUG] [LOCAL ] JRI: Trimmed 23173 records to 14901 (keeping 200 days of data) [2025-09-24T19:35:24.018120] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-24T19:35:24.072807] [DEBUG] [LOCAL ] JRI: Primary data saved (14901 records). [2025-09-24T19:35:24.072994] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-24T19:35:24.073193] [INFO ] [MAIN ] Update Progress: 1170/2373 symbols completed. JRI took 31.3s. Estimated remaining: 2h 39m 43s. Rate: 7.5 symbols/min [2025-09-24T19:35:24.265375] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:24.319476] [DEBUG] [LOCAL ] JXN: Loaded 46012 existing records from primary storage. [2025-09-24T19:35:24.319698] [INFO ] [MAIN ] JXN: Loaded 46012 existing records. [2025-09-24T19:35:24.518739] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:24.519054] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-24T19:35:24.519105] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-24T19:35:24.521055] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-24T19:35:24.521120] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-24T19:35:24.818095] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-24T19:35:24.921380] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:24.925047] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T19:35:24.932836] [INFO ] [REMOTE ] JPC: Full fetch complete (55725 records). [2025-09-24T19:35:24.932987] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-24T19:35:25.349120] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-24T19:35:25.349208] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-24T19:35:25.350118] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-24T19:35:25.350182] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-24T19:35:25.352533] [DEBUG] [LOCAL ] JPC: Trimmed 55725 records to 37066 (keeping 200 days of data) [2025-09-24T19:35:25.571907] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T19:35:25.604983] [DEBUG] [LOCAL ] JPC: Primary data saved (37066 records). [2025-09-24T19:35:25.605170] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-24T19:35:25.605274] [INFO ] [MAIN ] Update Progress: 1171/2373 symbols completed. JPC took 39.0s. Estimated remaining: 2h 39m 29s. Rate: 7.5 symbols/min [2025-09-24T19:35:25.626398] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-24T19:35:25.790079] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:25.848246] [DEBUG] [LOCAL ] K: Loaded 49850 existing records from primary storage. [2025-09-24T19:35:25.848403] [INFO ] [MAIN ] K: Loaded 49850 existing records. [2025-09-24T19:35:26.040689] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:26.041237] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-24T19:35:26.041297] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-24T19:35:26.043160] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-24T19:35:26.043223] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-24T19:35:26.422767] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-24T19:35:26.428904] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:26.485484] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-24T19:35:26.496032] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-24T19:35:26.496181] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-24T19:35:26.650898] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T19:35:26.952970] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-24T19:35:26.953107] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-24T19:35:26.954596] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-24T19:35:26.954696] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-24T19:35:26.956811] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-24T19:35:27.216787] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-24T19:35:27.338884] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-24T19:35:27.339061] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-24T19:35:27.339205] [INFO ] [MAIN ] Update Progress: 1172/2373 symbols completed. JPM took 39.4s. Estimated remaining: 2h 39m 14s. Rate: 7.5 symbols/min [2025-09-24T19:35:27.527699] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:27.544165] [DEBUG] [LOCAL ] KAI: Loaded 13631 existing records from primary storage. [2025-09-24T19:35:27.544290] [INFO ] [MAIN ] KAI: Loaded 13631 existing records. [2025-09-24T19:35:27.747128] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:27.747697] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-24T19:35:27.747779] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-24T19:35:27.748433] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-24T19:35:27.748502] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-24T19:35:27.889354] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:35:28.021290] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-24T19:35:28.179880] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:28.536510] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T19:35:28.816091] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-24T19:35:29.424618] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T19:35:29.616083] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-24T19:35:30.173019] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T19:35:30.416051] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-24T19:35:30.465171] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:35:31.216159] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-24T19:35:31.947970] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T19:35:31.984016] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T19:35:32.016034] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-24T19:35:32.816097] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-24T19:35:33.616057] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-24T19:35:33.745309] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T19:35:34.286201] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T19:35:34.416107] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-24T19:35:34.614189] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T19:35:35.216123] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-24T19:35:35.476223] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T19:35:36.016116] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-24T19:35:36.573815] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T19:35:36.611927] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T19:35:36.816131] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-24T19:35:37.618344] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-24T19:35:37.627598] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T19:35:38.416113] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-24T19:35:39.216300] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-24T19:35:39.280780] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T19:35:39.281719] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T19:35:40.016109] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-24T19:35:40.269175] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T19:35:40.811940] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T19:35:40.816024] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-24T19:35:41.616166] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-24T19:35:41.734484] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T19:35:41.737498] [INFO ] [REMOTE ] JRS: Full fetch complete (16099 records). [2025-09-24T19:35:41.737589] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-24T19:35:42.112910] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-24T19:35:42.113020] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-24T19:35:42.113429] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-24T19:35:42.113472] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-24T19:35:42.114133] [DEBUG] [LOCAL ] JRS: Trimmed 16099 records to 11089 (keeping 200 days of data) [2025-09-24T19:35:42.179612] [DEBUG] [LOCAL ] JRS: Primary data saved (11089 records). [2025-09-24T19:35:42.179788] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-24T19:35:42.179888] [INFO ] [MAIN ] Update Progress: 1173/2373 symbols completed. JRS took 26.5s. Estimated remaining: 2h 39m 13s. Rate: 7.5 symbols/min [2025-09-24T19:35:42.348459] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:42.396450] [DEBUG] [LOCAL ] KAR: Loaded 39918 existing records from primary storage. [2025-09-24T19:35:42.396625] [INFO ] [MAIN ] KAR: Loaded 39918 existing records. [2025-09-24T19:35:42.427200] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-24T19:35:42.579078] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:42.579354] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-24T19:35:42.579489] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-24T19:35:42.580552] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-24T19:35:42.580614] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-24T19:35:42.934805] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:43.224330] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-24T19:35:43.230589] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:35:43.714367] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T19:35:44.016158] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-24T19:35:44.257624] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T19:35:44.816162] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-24T19:35:45.616110] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-24T19:35:45.713725] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T19:35:45.749040] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T19:35:46.416088] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-24T19:35:47.085021] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:35:47.216046] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-24T19:35:47.319484] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T19:35:48.016135] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-24T19:35:48.644051] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T19:35:48.816142] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-24T19:35:49.616136] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-24T19:35:49.901720] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T19:35:50.234452] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T19:35:50.416036] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-24T19:35:51.192861] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T19:35:51.216081] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-24T19:35:51.476777] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T19:35:52.016104] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-24T19:35:52.762234] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T19:35:52.781088] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T19:35:52.816061] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-24T19:35:53.616150] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-24T19:35:53.819561] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T19:35:53.822625] [INFO ] [REMOTE ] KAI: Full fetch complete (18818 records). [2025-09-24T19:35:53.822763] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-24T19:35:54.209500] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-24T19:35:54.209598] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-24T19:35:54.210185] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-24T19:35:54.210249] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-24T19:35:54.210913] [DEBUG] [LOCAL ] KAI: Trimmed 18818 records to 13573 (keeping 200 days of data) [2025-09-24T19:35:54.303474] [DEBUG] [LOCAL ] KAI: Primary data saved (13573 records). [2025-09-24T19:35:54.303684] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-24T19:35:54.303810] [INFO ] [MAIN ] Update Progress: 1174/2373 symbols completed. KAI took 27.0s. Estimated remaining: 2h 39m 10s. Rate: 7.5 symbols/min [2025-09-24T19:35:54.416712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-24T19:35:54.497044] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:54.521543] [DEBUG] [LOCAL ] KB: Loaded 24164 existing records from primary storage. [2025-09-24T19:35:54.521720] [INFO ] [MAIN ] KB: Loaded 24164 existing records. [2025-09-24T19:35:54.708767] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:54.709052] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-24T19:35:54.709103] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-24T19:35:54.709878] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-24T19:35:54.709943] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-24T19:35:55.078947] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:55.104949] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T19:35:55.113824] [INFO ] [REMOTE ] JXN: Full fetch complete (65373 records). [2025-09-24T19:35:55.114087] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-24T19:35:55.217928] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-24T19:35:55.524627] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-24T19:35:55.524765] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-24T19:35:55.525963] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-24T19:35:55.526033] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-24T19:35:55.527867] [DEBUG] [LOCAL ] JXN: Trimmed 65373 records to 45954 (keeping 200 days of data) [2025-09-24T19:35:55.851467] [DEBUG] [LOCAL ] JXN: Primary data saved (45954 records). [2025-09-24T19:35:55.851695] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-24T19:35:55.851828] [INFO ] [MAIN ] Update Progress: 1175/2373 symbols completed. JXN took 31.8s. Estimated remaining: 2h 38m 55s. Rate: 7.5 symbols/min [2025-09-24T19:35:56.029901] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-24T19:35:56.034360] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:35:56.061441] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T19:35:56.092088] [DEBUG] [LOCAL ] KBDC: Loaded 20649 existing records from primary storage. [2025-09-24T19:35:56.092274] [INFO ] [MAIN ] KBDC: Loaded 20649 existing records. [2025-09-24T19:35:56.272349] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:35:56.272708] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-24T19:35:56.272768] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-24T19:35:56.273525] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-24T19:35:56.273588] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-24T19:35:56.655280] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:35:56.816137] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-24T19:35:56.953444] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T19:35:57.616119] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-24T19:35:57.681301] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:35:58.254282] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T19:35:58.416126] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-24T19:35:59.216133] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-24T19:35:59.275501] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T19:35:59.394344] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:35:59.816038] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-24T19:36:00.016185] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-24T19:36:00.816114] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-24T19:36:01.311012] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T19:36:01.616174] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-24T19:36:02.416147] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-24T19:36:02.484534] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T19:36:03.216133] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-24T19:36:04.016198] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-24T19:36:04.963755] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-09-24T19:36:04.970883] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-24T19:36:05.646567] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T19:36:05.651168] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-24T19:36:05.918370] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-24T19:36:05.952344] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (3.54 seconds). [2025-09-24T19:36:06.016003] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T19:36:06.252001] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T19:36:06.416113] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-24T19:36:07.216058] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-24T19:36:07.600989] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T19:36:08.016149] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-24T19:36:08.323608] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:36:08.816115] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-24T19:36:09.146375] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T19:36:09.616104] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-24T19:36:10.339341] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T19:36:10.347589] [INFO ] [REMOTE ] KAR: Full fetch complete (56639 records). [2025-09-24T19:36:10.347858] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-24T19:36:10.421293] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-24T19:36:10.838701] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-24T19:36:10.838945] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-24T19:36:10.840029] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-24T19:36:10.840178] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-24T19:36:10.842075] [DEBUG] [LOCAL ] KAR: Trimmed 56639 records to 39814 (keeping 200 days of data) [2025-09-24T19:36:10.989586] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T19:36:11.131240] [DEBUG] [LOCAL ] KAR: Primary data saved (39814 records). [2025-09-24T19:36:11.131448] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-24T19:36:11.131565] [INFO ] [MAIN ] Update Progress: 1176/2373 symbols completed. KAR took 29.0s. Estimated remaining: 2h 38m 55s. Rate: 7.5 symbols/min [2025-09-24T19:36:11.222855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-24T19:36:11.306241] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:11.353512] [DEBUG] [LOCAL ] KBH: Loaded 48899 existing records from primary storage. [2025-09-24T19:36:11.353706] [INFO ] [MAIN ] KBH: Loaded 48899 existing records. [2025-09-24T19:36:11.534931] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:11.535448] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-24T19:36:11.535576] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-24T19:36:11.536831] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-24T19:36:11.536894] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-24T19:36:11.872816] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T19:36:11.943449] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:12.016119] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-24T19:36:12.816154] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-24T19:36:13.022003] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T19:36:13.049531] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T19:36:13.055165] [INFO ] [REMOTE ] K: Full fetch complete (71868 records). [2025-09-24T19:36:13.056093] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-24T19:36:13.492570] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-24T19:36:13.492700] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-24T19:36:13.493876] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-24T19:36:13.493943] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-24T19:36:13.496089] [DEBUG] [LOCAL ] K: Trimmed 71868 records to 49862 (keeping 200 days of data) [2025-09-24T19:36:13.616106] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-24T19:36:13.831444] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T19:36:13.849662] [DEBUG] [LOCAL ] K: Primary data saved (49862 records). [2025-09-24T19:36:13.849804] [INFO ] [MAIN ] K: Full history saved. [2025-09-24T19:36:13.849909] [INFO ] [MAIN ] Update Progress: 1177/2373 symbols completed. K took 48.2s. Estimated remaining: 2h 38m 41s. Rate: 7.5 symbols/min [2025-09-24T19:36:14.020294] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:14.066303] [DEBUG] [LOCAL ] KBR: Loaded 48140 existing records from primary storage. [2025-09-24T19:36:14.066454] [INFO ] [MAIN ] KBR: Loaded 48140 existing records. [2025-09-24T19:36:14.258636] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:14.258909] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-24T19:36:14.258962] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-24T19:36:14.260252] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-24T19:36:14.260332] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-24T19:36:14.417390] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-24T19:36:14.645968] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:14.661161] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T19:36:15.216087] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-24T19:36:16.016087] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-24T19:36:16.634597] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T19:36:16.816365] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-24T19:36:16.818661] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T19:36:17.616158] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-24T19:36:17.954804] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T19:36:18.416067] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-24T19:36:18.532730] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:36:18.733914] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T19:36:18.737683] [INFO ] [REMOTE ] KB: Full fetch complete (34591 records). [2025-09-24T19:36:18.737765] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-24T19:36:19.123988] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-24T19:36:19.124151] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-24T19:36:19.125823] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T19:36:19.125403] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-24T19:36:19.130046] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-24T19:36:19.131144] [DEBUG] [LOCAL ] KB: Trimmed 34591 records to 24099 (keeping 200 days of data) [2025-09-24T19:36:19.226070] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-24T19:36:19.302413] [DEBUG] [LOCAL ] KB: Primary data saved (24099 records). [2025-09-24T19:36:19.302560] [INFO ] [MAIN ] KB: Full history saved. [2025-09-24T19:36:19.302673] [INFO ] [MAIN ] Update Progress: 1178/2373 symbols completed. KB took 25.0s. Estimated remaining: 2h 38m 31s. Rate: 7.5 symbols/min [2025-09-24T19:36:19.474905] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:19.534714] [DEBUG] [LOCAL ] KD: Loaded 52293 existing records from primary storage. [2025-09-24T19:36:19.534948] [INFO ] [MAIN ] KD: Loaded 52293 existing records. [2025-09-24T19:36:19.748299] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:19.748556] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-24T19:36:19.748608] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-24T19:36:19.749789] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-24T19:36:19.749851] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-24T19:36:20.021352] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-24T19:36:20.123732] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:20.816062] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-24T19:36:20.859056] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T19:36:21.439133] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:36:21.616088] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-24T19:36:22.197711] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:36:22.203938] [INFO ] [REMOTE ] KBDC: Full fetch complete (28062 records). [2025-09-24T19:36:22.204046] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-24T19:36:22.425210] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-24T19:36:22.589327] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-24T19:36:22.589408] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-24T19:36:22.590060] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-24T19:36:22.590122] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-24T19:36:22.590881] [DEBUG] [LOCAL ] KBDC: Trimmed 28062 records to 20843 (keeping 200 days of data) [2025-09-24T19:36:22.718935] [DEBUG] [LOCAL ] KBDC: Primary data saved (20843 records). [2025-09-24T19:36:22.719073] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-24T19:36:22.719158] [INFO ] [MAIN ] Update Progress: 1179/2373 symbols completed. KBDC took 26.9s. Estimated remaining: 2h 38m 18s. Rate: 7.5 symbols/min [2025-09-24T19:36:22.921917] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:22.930364] [DEBUG] [LOCAL ] KEN: Loaded 4759 existing records from primary storage. [2025-09-24T19:36:22.930471] [INFO ] [MAIN ] KEN: Loaded 4759 existing records. [2025-09-24T19:36:23.114497] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:23.114894] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-24T19:36:23.115039] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-24T19:36:23.115433] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-24T19:36:23.115496] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-24T19:36:23.221165] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-24T19:36:23.498391] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:23.517037] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T19:36:23.757571] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T19:36:24.016116] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-24T19:36:24.816074] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-24T19:36:24.898321] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T19:36:25.418159] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T19:36:25.448674] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T19:36:25.616085] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-24T19:36:26.416089] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-24T19:36:27.044016] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T19:36:27.216110] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-24T19:36:27.577416] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T19:36:28.016147] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-24T19:36:28.816145] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-24T19:36:28.986127] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T19:36:29.116921] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-24T19:36:29.277277] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T19:36:29.616088] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-24T19:36:30.210972] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:36:30.416102] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-24T19:36:31.216101] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-24T19:36:31.968811] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T19:36:32.016044] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-24T19:36:32.816131] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-24T19:36:32.862556] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T19:36:33.557044] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:36:33.557409] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T19:36:33.616102] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-24T19:36:34.416097] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-24T19:36:35.016408] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T19:36:35.222926] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-24T19:36:35.244791] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:36:35.713723] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T19:36:36.016085] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-24T19:36:36.569434] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-24T19:36:36.816095] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-24T19:36:37.616091] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-24T19:36:38.010561] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-24T19:36:38.416071] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-24T19:36:38.485841] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T19:36:39.216087] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-24T19:36:40.016054] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-24T19:36:40.125773] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T19:36:40.572040] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T19:36:40.816084] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-24T19:36:41.616059] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-24T19:36:41.689889] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T19:36:42.153938] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T19:36:42.155714] [INFO ] [REMOTE ] KEN: Full fetch complete (5976 records). [2025-09-24T19:36:42.155806] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-24T19:36:42.423432] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-24T19:36:42.563353] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-24T19:36:42.563497] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-24T19:36:42.563735] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-24T19:36:42.563972] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-24T19:36:42.564615] [DEBUG] [LOCAL ] KEN: Trimmed 5976 records to 4766 (keeping 200 days of data) [2025-09-24T19:36:42.631070] [DEBUG] [LOCAL ] KEN: Primary data saved (4766 records). [2025-09-24T19:36:42.634134] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-24T19:36:42.634267] [INFO ] [MAIN ] Update Progress: 1180/2373 symbols completed. KEN took 19.9s. Estimated remaining: 2h 38m 23s. Rate: 7.5 symbols/min [2025-09-24T19:36:42.709264] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T19:36:42.828091] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:42.865011] [DEBUG] [LOCAL ] KEP: Loaded 30525 existing records from primary storage. [2025-09-24T19:36:42.865205] [INFO ] [MAIN ] KEP: Loaded 30525 existing records. [2025-09-24T19:36:43.058137] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:43.058452] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-24T19:36:43.058525] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-24T19:36:43.059395] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-24T19:36:43.059459] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-24T19:36:43.222682] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-24T19:36:43.445156] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:44.016082] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-24T19:36:44.058920] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:36:44.695567] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T19:36:44.816115] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-24T19:36:45.616095] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-24T19:36:45.708555] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T19:36:46.416110] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-24T19:36:46.510794] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T19:36:47.216144] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-24T19:36:47.702086] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T19:36:47.941285] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T19:36:48.016171] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-24T19:36:48.805494] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T19:36:48.818204] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-24T19:36:49.286211] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T19:36:49.616087] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-24T19:36:50.416066] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-24T19:36:50.473211] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T19:36:50.482258] [INFO ] [REMOTE ] KBR: Full fetch complete (69910 records). [2025-09-24T19:36:50.482433] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-24T19:36:50.890185] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-24T19:36:50.890279] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-24T19:36:50.891289] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-24T19:36:50.891353] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-24T19:36:50.892814] [DEBUG] [LOCAL ] KBR: Trimmed 69910 records to 48149 (keeping 200 days of data) [2025-09-24T19:36:51.209278] [DEBUG] [LOCAL ] KBR: Primary data saved (48149 records). [2025-09-24T19:36:51.209482] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-24T19:36:51.209680] [INFO ] [MAIN ] Update Progress: 1181/2373 symbols completed. KBR took 37.4s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-24T19:36:51.222005] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-24T19:36:51.387617] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:51.426309] [DEBUG] [LOCAL ] KEX: Loaded 37961 existing records from primary storage. [2025-09-24T19:36:51.426450] [INFO ] [MAIN ] KEX: Loaded 37961 existing records. [2025-09-24T19:36:51.550470] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T19:36:51.625261] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:51.625865] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-24T19:36:51.625921] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-24T19:36:51.627840] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-24T19:36:51.627912] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-24T19:36:51.935599] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-24T19:36:51.971387] [INFO ] [REMOTE ] KD: Full fetch complete (75576 records). [2025-09-24T19:36:51.994747] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-24T19:36:52.051414] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-24T19:36:52.056834] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:52.458322] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-24T19:36:52.458415] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-24T19:36:52.459544] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-24T19:36:52.459615] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-24T19:36:52.461381] [DEBUG] [LOCAL ] KD: Trimmed 75576 records to 52290 (keeping 200 days of data) [2025-09-24T19:36:52.816501] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-24T19:36:52.826235] [DEBUG] [LOCAL ] KD: Primary data saved (52290 records). [2025-09-24T19:36:52.826926] [INFO ] [MAIN ] KD: Full history saved. [2025-09-24T19:36:52.827303] [INFO ] [MAIN ] Update Progress: 1182/2373 symbols completed. KD took 33.5s. Estimated remaining: 2h 38m 1s. Rate: 7.5 symbols/min [2025-09-24T19:36:53.021316] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:53.021860] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-24T19:36:53.021938] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-24T19:36:53.022191] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-24T19:36:53.022344] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-24T19:36:53.022500] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-24T19:36:53.022607] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-24T19:36:53.285286] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T19:36:53.365534] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T19:36:53.502369] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:53.616133] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-24T19:36:54.071815] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T19:36:54.416126] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-24T19:36:55.216104] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-24T19:36:55.721001] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T19:36:55.746422] [INFO ] [REMOTE ] KBH: Full fetch complete (70627 records). [2025-09-24T19:36:55.747594] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T19:36:55.753525] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-24T19:36:56.023164] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-24T19:36:56.232258] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-24T19:36:56.232364] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-24T19:36:56.233750] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-24T19:36:56.233853] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-24T19:36:56.238587] [DEBUG] [LOCAL ] KBH: Trimmed 70627 records to 48915 (keeping 200 days of data) [2025-09-24T19:36:56.580452] [DEBUG] [LOCAL ] KBH: Primary data saved (48915 records). [2025-09-24T19:36:56.580836] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-24T19:36:56.580966] [INFO ] [MAIN ] Update Progress: 1183/2373 symbols completed. KBH took 45.4s. Estimated remaining: 2h 37m 49s. Rate: 7.5 symbols/min [2025-09-24T19:36:56.791638] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:36:56.823502] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-24T19:36:56.879499] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T19:36:56.894551] [DEBUG] [LOCAL ] KEYS: Loaded 43332 existing records from primary storage. [2025-09-24T19:36:56.894814] [INFO ] [MAIN ] KEYS: Loaded 43332 existing records. [2025-09-24T19:36:57.093922] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:36:57.094361] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-24T19:36:57.094423] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-24T19:36:57.095792] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-24T19:36:57.095859] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-24T19:36:57.451666] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T19:36:57.547765] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:36:57.616111] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-24T19:36:58.317728] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T19:36:58.416078] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-24T19:36:58.984919] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T19:36:59.216080] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-24T19:36:59.864234] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T19:37:00.016096] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-24T19:37:00.670516] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T19:37:00.816079] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-24T19:37:01.147994] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T19:37:01.616094] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-24T19:37:02.286210] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:37:02.416114] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-24T19:37:02.809475] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T19:37:03.216098] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-24T19:37:04.016070] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-24T19:37:04.163476] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T19:37:04.530073] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T19:37:04.816103] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-24T19:37:05.147790] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:37:05.616147] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-24T19:37:06.368880] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:37:06.416036] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-24T19:37:06.957724] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T19:37:06.963260] [INFO ] [REMOTE ] KEP: Full fetch complete (41546 records). [2025-09-24T19:37:06.963384] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-24T19:37:07.221269] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-24T19:37:07.353185] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-24T19:37:07.353270] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-24T19:37:07.354126] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-24T19:37:07.354210] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-24T19:37:07.355297] [DEBUG] [LOCAL ] KEP: Trimmed 41546 records to 30642 (keeping 200 days of data) [2025-09-24T19:37:07.560059] [DEBUG] [LOCAL ] KEP: Primary data saved (30642 records). [2025-09-24T19:37:07.560218] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-24T19:37:07.560394] [INFO ] [MAIN ] Update Progress: 1184/2373 symbols completed. KEP took 24.9s. Estimated remaining: 2h 37m 44s. Rate: 7.5 symbols/min [2025-09-24T19:37:07.751788] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:07.757219] [DEBUG] [LOCAL ] KF: Loaded 2471 existing records from primary storage. [2025-09-24T19:37:07.757417] [INFO ] [MAIN ] KF: Loaded 2471 existing records. [2025-09-24T19:37:07.975401] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:07.977751] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T19:37:07.977941] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-24T19:37:07.987667] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-24T19:37:07.988342] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-24T19:37:07.988429] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-24T19:37:08.021154] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-24T19:37:08.365448] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:08.614800] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T19:37:08.816107] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-24T19:37:09.512996] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:37:09.616113] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-24T19:37:10.243984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T19:37:10.416094] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-24T19:37:11.109318] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T19:37:11.216066] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-24T19:37:12.016090] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-24T19:37:12.359025] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T19:37:12.445682] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T19:37:12.816060] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-24T19:37:12.866323] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T19:37:13.616088] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-24T19:37:14.416072] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-24T19:37:14.673032] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T19:37:14.758964] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-24T19:37:14.984395] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T19:37:15.216099] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-24T19:37:16.016087] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-24T19:37:16.816075] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-24T19:37:16.971965] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T19:37:17.616069] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-24T19:37:17.714405] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T19:37:17.723358] [INFO ] [REMOTE ] KEX: Full fetch complete (55413 records). [2025-09-24T19:37:17.723551] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-24T19:37:18.102172] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T19:37:18.157249] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-24T19:37:18.157551] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-24T19:37:18.158775] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-24T19:37:18.158920] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-24T19:37:18.160912] [DEBUG] [LOCAL ] KEX: Trimmed 55413 records to 38021 (keeping 200 days of data) [2025-09-24T19:37:18.405405] [DEBUG] [LOCAL ] KEX: Primary data saved (38021 records). [2025-09-24T19:37:18.405573] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-24T19:37:18.405737] [INFO ] [MAIN ] Update Progress: 1185/2373 symbols completed. KEX took 27.2s. Estimated remaining: 2h 37m 39s. Rate: 7.5 symbols/min [2025-09-24T19:37:18.421173] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-24T19:37:18.620417] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:18.623385] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T19:37:18.657814] [DEBUG] [LOCAL ] KFRC: Loaded 19348 existing records from primary storage. [2025-09-24T19:37:18.657966] [INFO ] [MAIN ] KFRC: Loaded 19348 existing records. [2025-09-24T19:37:18.847175] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:18.847503] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-24T19:37:18.847557] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-24T19:37:18.848388] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-24T19:37:18.848607] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-24T19:37:19.008253] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:37:19.218529] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-24T19:37:19.218443] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:20.016112] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-24T19:37:20.770844] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T19:37:20.816040] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-24T19:37:21.252907] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T19:37:21.616135] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-24T19:37:22.416095] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-24T19:37:22.501276] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T19:37:22.755581] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T19:37:22.901598] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T19:37:23.216084] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-24T19:37:23.890519] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T19:37:24.016083] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-24T19:37:24.745853] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T19:37:24.816108] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-24T19:37:25.616110] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-24T19:37:25.899765] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T19:37:26.416106] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-24T19:37:27.216160] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-24T19:37:27.435196] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T19:37:27.979022] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T19:37:28.016051] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-24T19:37:28.031425] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T19:37:28.816119] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-24T19:37:29.373905] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T19:37:29.621820] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-24T19:37:29.632934] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:37:30.416082] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-24T19:37:30.616998] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:37:30.893121] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-24T19:37:31.216140] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-24T19:37:32.016089] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-24T19:37:32.772976] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:37:32.782281] [INFO ] [REMOTE ] KEY: Full fetch complete (77255 records). [2025-09-24T19:37:32.782412] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-24T19:37:32.825814] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-24T19:37:32.984492] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T19:37:32.985352] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:37:32.985448] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:37:32.985544] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-24T19:37:32.985628] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-24T19:37:32.985704] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-24T19:37:32.985774] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-24T19:37:32.985864] [INFO ] [MAIN ] Update Progress: 1186/2373 symbols completed. KEY took 40.2s. Estimated remaining: 2h 37m 37s. Rate: 7.5 symbols/min [2025-09-24T19:37:33.156126] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:33.166401] [DEBUG] [LOCAL ] KFS: Loaded 8312 existing records from primary storage. [2025-09-24T19:37:33.166507] [INFO ] [MAIN ] KFS: Loaded 8312 existing records. [2025-09-24T19:37:33.351539] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:33.352594] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-24T19:37:33.352810] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-24T19:37:33.353435] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-24T19:37:33.353498] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-24T19:37:33.401372] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T19:37:33.618149] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-24T19:37:33.740568] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:33.778872] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T19:37:34.124866] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T19:37:34.416180] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-24T19:37:35.216049] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-24T19:37:35.536803] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T19:37:36.016085] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-24T19:37:36.816169] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-24T19:37:36.893013] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T19:37:36.901558] [INFO ] [REMOTE ] KEYS: Full fetch complete (62968 records). [2025-09-24T19:37:36.901718] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-24T19:37:37.306219] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-24T19:37:37.306924] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-24T19:37:37.307487] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T19:37:37.308501] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-24T19:37:37.308598] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-24T19:37:37.315690] [DEBUG] [LOCAL ] KEYS: Trimmed 62968 records to 43320 (keeping 200 days of data) [2025-09-24T19:37:37.584206] [DEBUG] [LOCAL ] KEYS: Primary data saved (43320 records). [2025-09-24T19:37:37.584368] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-24T19:37:37.584458] [INFO ] [MAIN ] Update Progress: 1187/2373 symbols completed. KEYS took 41.0s. Estimated remaining: 2h 37m 26s. Rate: 7.5 symbols/min [2025-09-24T19:37:37.617012] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-24T19:37:37.707388] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T19:37:37.781532] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:37.814098] [DEBUG] [LOCAL ] KFY: Loaded 30672 existing records from primary storage. [2025-09-24T19:37:37.814245] [INFO ] [MAIN ] KFY: Loaded 30672 existing records. [2025-09-24T19:37:37.993091] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:37.993341] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-24T19:37:37.993391] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-24T19:37:37.994383] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-24T19:37:37.994444] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-24T19:37:38.257770] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T19:37:38.279686] [INFO ] [REMOTE ] KF: Full fetch complete (3765 records). [2025-09-24T19:37:38.280020] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-24T19:37:38.426036] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-24T19:37:38.476880] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:38.744484] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-24T19:37:38.744566] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-24T19:37:38.744725] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-24T19:37:38.744785] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-24T19:37:38.745142] [DEBUG] [LOCAL ] KF: Trimmed 3765 records to 2470 (keeping 200 days of data) [2025-09-24T19:37:38.760041] [DEBUG] [LOCAL ] KF: Primary data saved (2470 records). [2025-09-24T19:37:38.760107] [INFO ] [MAIN ] KF: Full history saved. [2025-09-24T19:37:38.760194] [INFO ] [MAIN ] Update Progress: 1188/2373 symbols completed. KF took 31.2s. Estimated remaining: 2h 37m 11s. Rate: 7.5 symbols/min [2025-09-24T19:37:38.930204] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:38.990977] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-24T19:37:38.991128] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-24T19:37:39.169670] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:39.169952] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-24T19:37:39.170007] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-24T19:37:39.171663] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-24T19:37:39.171727] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-24T19:37:39.226941] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-24T19:37:39.537430] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:39.825336] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T19:37:39.830501] [INFO ] [REMOTE ] KFRC: Full fetch complete (25328 records). [2025-09-24T19:37:39.830687] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-24T19:37:39.939569] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T19:37:40.026297] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-24T19:37:40.227590] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-24T19:37:40.227715] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-24T19:37:40.228354] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-24T19:37:40.228397] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-24T19:37:40.229397] [DEBUG] [LOCAL ] KFRC: Trimmed 25328 records to 19440 (keeping 200 days of data) [2025-09-24T19:37:40.356918] [DEBUG] [LOCAL ] KFRC: Primary data saved (19440 records). [2025-09-24T19:37:40.357090] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-24T19:37:40.357184] [INFO ] [MAIN ] Update Progress: 1189/2373 symbols completed. KFRC took 22.0s. Estimated remaining: 2h 36m 57s. Rate: 7.5 symbols/min [2025-09-24T19:37:40.545847] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:40.611989] [DEBUG] [LOCAL ] KGS: Loaded 45785 existing records from primary storage. [2025-09-24T19:37:40.612178] [INFO ] [MAIN ] KGS: Loaded 45785 existing records. [2025-09-24T19:37:40.729395] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T19:37:40.821457] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-24T19:37:40.894200] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:40.894546] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-24T19:37:40.894611] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-24T19:37:40.895842] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-24T19:37:40.895907] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-24T19:37:41.393475] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:41.543038] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T19:37:41.616164] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-24T19:37:42.416094] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-24T19:37:43.143583] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T19:37:43.216043] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-24T19:37:43.742248] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T19:37:44.016118] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-24T19:37:44.766802] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:37:44.804587] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T19:37:44.816044] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-24T19:37:45.459064] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T19:37:45.616101] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-24T19:37:46.416104] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-24T19:37:47.216050] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-24T19:37:47.394133] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T19:37:47.516983] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T19:37:47.931621] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T19:37:48.016083] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-24T19:37:48.535517] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T19:37:48.816314] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-24T19:37:49.616098] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-24T19:37:50.416076] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-24T19:37:50.625480] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:37:50.931573] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T19:37:51.118256] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:37:51.216112] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-24T19:37:52.016136] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-24T19:37:52.816075] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-24T19:37:52.900292] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T19:37:53.515877] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:37:53.616106] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-24T19:37:53.706935] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T19:37:53.709506] [INFO ] [REMOTE ] KFS: Full fetch complete (10464 records). [2025-09-24T19:37:53.709589] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-24T19:37:54.143670] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-24T19:37:54.143789] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-24T19:37:54.144297] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-24T19:37:54.144361] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-24T19:37:54.145012] [DEBUG] [LOCAL ] KFS: Trimmed 10464 records to 8319 (keeping 200 days of data) [2025-09-24T19:37:54.199272] [DEBUG] [LOCAL ] KFS: Primary data saved (8319 records). [2025-09-24T19:37:54.199478] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-24T19:37:54.199593] [INFO ] [MAIN ] Update Progress: 1190/2373 symbols completed. KFS took 21.2s. Estimated remaining: 2h 36m 55s. Rate: 7.5 symbols/min [2025-09-24T19:37:54.392532] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:37:54.416180] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-24T19:37:54.463907] [DEBUG] [LOCAL ] KIM: Loaded 53067 existing records from primary storage. [2025-09-24T19:37:54.464144] [INFO ] [MAIN ] KIM: Loaded 53067 existing records. [2025-09-24T19:37:54.660579] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:37:54.661067] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-24T19:37:54.661126] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-24T19:37:54.662608] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-24T19:37:54.662701] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-24T19:37:55.022398] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:37:55.216070] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-24T19:37:55.633113] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T19:37:55.815887] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T19:37:56.016091] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-24T19:37:56.673116] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T19:37:56.816104] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-24T19:37:57.616094] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-24T19:37:58.144717] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-24T19:37:58.198738] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T19:37:58.416148] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-24T19:37:59.042521] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:37:59.216094] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-24T19:37:59.806625] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T19:38:00.016088] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-24T19:38:00.816113] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-24T19:38:01.079635] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T19:38:01.599817] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:38:01.616044] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-24T19:38:02.416057] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-24T19:38:02.663351] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T19:38:03.101158] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T19:38:03.216066] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-24T19:38:03.826505] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T19:38:04.016109] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-24T19:38:04.762134] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T19:38:04.816095] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-24T19:38:05.336591] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T19:38:05.616062] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-24T19:38:06.017560] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T19:38:06.416091] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-24T19:38:07.216064] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-24T19:38:07.355105] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:38:07.364270] [INFO ] [REMOTE ] KGS: Full fetch complete (65921 records). [2025-09-24T19:38:07.364421] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-24T19:38:07.762573] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-24T19:38:07.762696] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-24T19:38:07.763682] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-24T19:38:07.763748] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-24T19:38:07.765340] [DEBUG] [LOCAL ] KGS: Trimmed 65921 records to 45757 (keeping 200 days of data) [2025-09-24T19:38:08.016297] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-24T19:38:08.059753] [DEBUG] [LOCAL ] KGS: Primary data saved (45757 records). [2025-09-24T19:38:08.059891] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-24T19:38:08.059995] [INFO ] [MAIN ] Update Progress: 1191/2373 symbols completed. KGS took 27.7s. Estimated remaining: 2h 36m 53s. Rate: 7.5 symbols/min [2025-09-24T19:38:08.237207] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:08.259496] [DEBUG] [LOCAL ] KIO: Loaded 21283 existing records from primary storage. [2025-09-24T19:38:08.259631] [INFO ] [MAIN ] KIO: Loaded 21283 existing records. [2025-09-24T19:38:08.459133] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:38:08.459727] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-24T19:38:08.460000] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-24T19:38:08.470803] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-24T19:38:08.486636] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-24T19:38:08.601549] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-24T19:38:08.718133] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T19:38:08.816921] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-24T19:38:08.934819] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:09.609554] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T19:38:09.620380] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-24T19:38:10.416080] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-24T19:38:10.593049] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T19:38:10.671033] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T19:38:11.216084] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-24T19:38:11.439223] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T19:38:12.016114] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-24T19:38:12.816067] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-24T19:38:12.997458] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T19:38:13.134849] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T19:38:13.616086] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-24T19:38:14.416071] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-24T19:38:14.461262] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T19:38:14.578270] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T19:38:15.216094] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-24T19:38:16.016050] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-24T19:38:16.244684] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T19:38:16.349050] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T19:38:16.816162] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-24T19:38:17.616161] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-24T19:38:18.159734] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-24T19:38:18.169559] [INFO ] [REMOTE ] KGC: Full fetch complete (77693 records). [2025-09-24T19:38:18.169733] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-24T19:38:18.421106] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-24T19:38:18.589989] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-24T19:38:18.590263] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-24T19:38:18.591993] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-24T19:38:18.592144] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-24T19:38:18.623031] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T19:38:18.621282] [DEBUG] [LOCAL ] KGC: Trimmed 77693 records to 53699 (keeping 200 days of data) [2025-09-24T19:38:18.746531] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T19:38:19.000564] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-24T19:38:19.000761] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-24T19:38:19.000863] [INFO ] [MAIN ] Update Progress: 1192/2373 symbols completed. KGC took 40.2s. Estimated remaining: 2h 36m 48s. Rate: 7.5 symbols/min [2025-09-24T19:38:19.171421] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:19.228444] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-24T19:38:19.231520] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-09-24T19:38:19.231758] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-09-24T19:38:19.410163] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:38:19.410409] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-24T19:38:19.410467] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-24T19:38:19.411769] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-24T19:38:19.411830] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-24T19:38:19.772779] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:19.796019] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T19:38:19.805183] [INFO ] [REMOTE ] KFY: Full fetch complete (43765 records). [2025-09-24T19:38:19.805292] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-24T19:38:20.021950] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-24T19:38:20.203156] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-24T19:38:20.203252] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-24T19:38:20.204272] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-24T19:38:20.204341] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-24T19:38:20.205523] [DEBUG] [LOCAL ] KFY: Trimmed 43765 records to 30608 (keeping 200 days of data) [2025-09-24T19:38:20.410771] [DEBUG] [LOCAL ] KFY: Primary data saved (30608 records). [2025-09-24T19:38:20.416761] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-24T19:38:20.417099] [INFO ] [MAIN ] Update Progress: 1193/2373 symbols completed. KFY took 42.8s. Estimated remaining: 2h 36m 33s. Rate: 7.5 symbols/min [2025-09-24T19:38:20.431902] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T19:38:20.620815] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:20.629144] [DEBUG] [LOCAL ] KKRS: Loaded 5751 existing records from primary storage. [2025-09-24T19:38:20.629260] [INFO ] [MAIN ] KKRS: Loaded 5751 existing records. [2025-09-24T19:38:20.819322] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-24T19:38:20.823069] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:38:20.824361] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-24T19:38:20.824414] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-24T19:38:20.824769] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-24T19:38:20.824831] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-24T19:38:21.178582] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:21.616092] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-24T19:38:21.722792] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T19:38:22.416113] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-24T19:38:22.453809] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:38:22.704634] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T19:38:23.216099] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-24T19:38:24.016118] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-24T19:38:24.293114] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T19:38:24.604886] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-24T19:38:24.816139] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-24T19:38:25.141728] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T19:38:25.616114] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-24T19:38:26.236113] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T19:38:26.416147] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-24T19:38:26.509293] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T19:38:26.519571] [INFO ] [REMOTE ] KIM: Full fetch complete (76829 records). [2025-09-24T19:38:26.519833] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-24T19:38:26.943695] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-24T19:38:26.943830] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-24T19:38:26.945342] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-24T19:38:26.945416] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-24T19:38:26.947567] [DEBUG] [LOCAL ] KIM: Trimmed 76829 records to 53063 (keeping 200 days of data) [2025-09-24T19:38:27.216720] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-24T19:38:27.313967] [DEBUG] [LOCAL ] KIM: Primary data saved (53063 records). [2025-09-24T19:38:27.314179] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-24T19:38:27.314285] [INFO ] [MAIN ] Update Progress: 1194/2373 symbols completed. KIM took 33.1s. Estimated remaining: 2h 36m 24s. Rate: 7.5 symbols/min [2025-09-24T19:38:27.499157] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:27.499448] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-24T19:38:27.499504] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-24T19:38:27.499711] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-24T19:38:27.499765] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-24T19:38:27.499808] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-24T19:38:27.499849] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-24T19:38:27.895377] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:28.016073] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-24T19:38:28.052886] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T19:38:28.092125] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T19:38:28.583734] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T19:38:28.816118] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-24T19:38:29.616114] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-24T19:38:29.827810] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:29.828285] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-24T19:38:29.852994] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T19:38:30.416190] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-24T19:38:31.018832] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T19:38:31.216153] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-24T19:38:31.907992] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T19:38:32.016160] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-24T19:38:32.816214] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-24T19:38:33.044835] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:33.045426] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-24T19:38:33.231865] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T19:38:33.616204] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-24T19:38:33.827304] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:33.827858] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-24T19:38:34.416119] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-24T19:38:35.200265] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T19:38:35.216082] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-24T19:38:35.701581] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T19:38:36.016158] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-24T19:38:36.816069] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-24T19:38:37.125263] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:37.126066] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-24T19:38:37.129262] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:38:37.616088] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-24T19:38:38.184709] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T19:38:38.416122] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-24T19:38:39.218792] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-24T19:38:39.222000] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T19:38:39.227299] [INFO ] [REMOTE ] KIO: Full fetch complete (30811 records). [2025-09-24T19:38:39.227405] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-24T19:38:39.628826] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-24T19:38:39.629012] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-24T19:38:39.630016] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-24T19:38:39.630086] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-24T19:38:39.631335] [DEBUG] [LOCAL ] KIO: Trimmed 30811 records to 21295 (keeping 200 days of data) [2025-09-24T19:38:39.779004] [DEBUG] [LOCAL ] KIO: Primary data saved (21295 records). [2025-09-24T19:38:39.779197] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-24T19:38:39.779305] [INFO ] [MAIN ] Update Progress: 1195/2373 symbols completed. KIO took 31.7s. Estimated remaining: 2h 36m 21s. Rate: 7.5 symbols/min [2025-09-24T19:38:39.932804] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T19:38:39.969001] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:39.967962] [INFO ] [REMOTE ] KKRS: Full fetch complete (8007 records). [2025-09-24T19:38:39.969273] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-24T19:38:39.969238] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-24T19:38:39.969392] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-24T19:38:39.975222] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-24T19:38:40.018925] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-24T19:38:40.018777] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-24T19:38:40.048833] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-24T19:38:40.075965] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-24T19:38:40.710234] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-24T19:38:40.720720] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-24T19:38:40.730416] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-24T19:38:40.730836] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-24T19:38:40.751749] [DEBUG] [LOCAL ] KKRS: Trimmed 8007 records to 5740 (keeping 200 days of data) [2025-09-24T19:38:40.751632] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:40.788214] [DEBUG] [LOCAL ] KKRS: Primary data saved (5740 records). [2025-09-24T19:38:40.788565] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-24T19:38:40.788708] [INFO ] [MAIN ] Update Progress: 1196/2373 symbols completed. KKRS took 20.4s. Estimated remaining: 2h 36m 6s. Rate: 7.5 symbols/min [2025-09-24T19:38:40.820772] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-24T19:38:40.960485] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:38:40.997243] [DEBUG] [LOCAL ] KLC: Loaded 36503 existing records from primary storage. [2025-09-24T19:38:40.997391] [INFO ] [MAIN ] KLC: Loaded 36503 existing records. [2025-09-24T19:38:41.097791] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:41.098424] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-24T19:38:41.175767] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:38:41.176073] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-24T19:38:41.176126] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-24T19:38:41.177095] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-24T19:38:41.177158] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-24T19:38:41.533569] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:38:41.616054] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-24T19:38:41.842003] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:41.842341] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-24T19:38:42.094172] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-24T19:38:42.416083] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-24T19:38:42.628069] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:42.628404] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-24T19:38:43.216088] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-24T19:38:44.016087] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-24T19:38:44.536065] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T19:38:44.696207] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:38:44.816084] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-24T19:38:45.616096] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-24T19:38:46.117584] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T19:38:46.416061] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-24T19:38:46.724828] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T19:38:47.216090] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-24T19:38:47.996450] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T19:38:48.016031] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-24T19:38:48.652241] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T19:38:48.816074] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-24T19:38:48.855520] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T19:38:49.616092] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-24T19:38:50.416049] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-24T19:38:50.466860] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T19:38:50.469297] [INFO ] [REMOTE ] KKRT: Full fetch complete (8548 records). [2025-09-24T19:38:50.469371] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-24T19:38:50.661521] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 81 unique days, need 200 days [2025-09-24T19:38:50.661960] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:38:50.662145] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:38:50.662320] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-24T19:38:50.662574] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-24T19:38:50.662787] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-24T19:38:50.662987] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-24T19:38:50.663095] [INFO ] [MAIN ] Update Progress: 1197/2373 symbols completed. KKRT took 23.3s. Estimated remaining: 2h 35m 60s. Rate: 7.5 symbols/min [2025-09-24T19:38:50.793325] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-24T19:38:51.216073] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-24T19:38:51.546483] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T19:38:52.016083] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-24T19:38:52.227254] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:52.227595] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-24T19:38:52.816078] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-24T19:38:53.042348] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T19:38:53.616091] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-24T19:38:54.169487] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T19:38:54.416118] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-24T19:38:55.216099] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-24T19:38:55.402726] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T19:38:55.455946] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:55.458094] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T19:38:55.456987] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-24T19:38:56.016096] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-24T19:38:56.816101] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-24T19:38:57.018897] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:57.019220] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-24T19:38:57.616109] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-24T19:38:57.818223] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:57.818535] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-24T19:38:57.882304] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T19:38:58.416089] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-24T19:38:58.605171] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:58.605483] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-24T19:38:59.216095] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-24T19:38:59.406286] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:38:59.406569] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-24T19:39:00.016105] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-24T19:39:00.223161] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:39:00.223478] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-24T19:39:00.816098] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-24T19:39:01.616098] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-24T19:39:02.416188] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-24T19:39:03.190525] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-24T19:39:03.201830] [INFO ] [REMOTE ] KKR: Full fetch complete (77439 records). [2025-09-24T19:39:03.202004] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-24T19:39:03.639372] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-24T19:39:03.639527] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-24T19:39:03.640917] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-24T19:39:03.640989] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-24T19:39:03.643046] [DEBUG] [LOCAL ] KKR: Trimmed 77439 records to 53501 (keeping 200 days of data) [2025-09-24T19:39:03.997005] [DEBUG] [LOCAL ] KKR: Primary data saved (53501 records). [2025-09-24T19:39:03.997164] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-24T19:39:03.997258] [INFO ] [MAIN ] Update Progress: 1198/2373 symbols completed. KKR took 45.0s. Estimated remaining: 2h 35m 57s. Rate: 7.5 symbols/min [2025-09-24T19:39:04.992864] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (3.38 seconds). [2025-09-24T19:39:04.999018] [INFO ] [REMOTE ] KLAR: Full fetch complete (4022 records). [2025-09-24T19:39:04.999093] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-24T19:39:05.181100] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-24T19:39:05.181329] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:39:05.181377] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:39:05.181416] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-24T19:39:05.181476] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-24T19:39:05.181520] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-24T19:39:05.181585] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-24T19:39:05.181690] [INFO ] [MAIN ] Update Progress: 1199/2373 symbols completed. KLAR took 25.4s. Estimated remaining: 2h 35m 43s. Rate: 7.5 symbols/min [2025-09-24T19:39:05.776729] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (3.36 seconds). [2025-09-24T19:39:05.786066] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-24T19:39:07.115786] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T19:39:07.123327] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-24T19:39:08.444975] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T19:39:08.453359] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-24T19:39:09.816172] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:39:09.835832] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-24T19:39:11.391855] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:39:11.398832] [INFO ] [REMOTE ] KLC: Full fetch complete (50732 records). [2025-09-24T19:39:11.399005] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-24T19:39:11.796695] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-24T19:39:11.796804] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-24T19:39:11.797737] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-24T19:39:11.797821] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-24T19:39:11.800106] [DEBUG] [LOCAL ] KLC: Trimmed 50732 records to 36523 (keeping 200 days of data) [2025-09-24T19:39:12.017071] [DEBUG] [LOCAL ] KLC: Primary data saved (36523 records). [2025-09-24T19:39:12.017241] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-24T19:39:12.017372] [INFO ] [MAIN ] Update Progress: 1200/2373 symbols completed. KLC took 31.2s. Estimated remaining: 2h 35m 33s. Rate: 7.5 symbols/min [2025-09-24T19:39:12.702371] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:12.738003] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:12.785697] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:12.805968] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:12.784680] [DEBUG] [LOCAL ] KMI: No existing data file found in primary storage. [2025-09-24T19:39:12.806892] [WARN ] [MAIN ] KMI: No existing data found, performing full refresh instead. [2025-09-24T19:39:12.808493] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-24T19:39:12.808563] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-24T19:39:12.808614] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-09-24T19:39:12.808679] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-24T19:39:12.861513] [DEBUG] [LOCAL ] KMPB: Loaded 3582 existing records from primary storage. [2025-09-24T19:39:12.885034] [INFO ] [MAIN ] KMPB: Loaded 3582 existing records. [2025-09-24T19:39:13.326169] [DEBUG] [LOCAL ] KLG: Loaded 41973 existing records from primary storage. [2025-09-24T19:39:13.345761] [INFO ] [MAIN ] KLG: Loaded 41973 existing records. [2025-09-24T19:39:13.342066] [DEBUG] [LOCAL ] KMPR: Loaded 38267 existing records from primary storage. [2025-09-24T19:39:13.368070] [INFO ] [MAIN ] KMPR: Loaded 38267 existing records. [2025-09-24T19:39:13.421356] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:13.469574] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-24T19:39:13.492564] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-24T19:39:13.554871] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-24T19:39:13.592855] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-24T19:39:13.635733] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:13.677584] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-24T19:39:13.913276] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:13.960866] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:13.981911] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-24T19:39:14.001552] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-24T19:39:14.001425] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-24T19:39:14.035578] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-24T19:39:14.053724] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-24T19:39:14.053854] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-24T19:39:14.073276] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-24T19:39:14.083708] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-24T19:39:14.468929] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:14.504198] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-24T19:39:14.968543] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:14.981536] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-24T19:39:14.981291] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:14.981873] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-24T19:39:15.232381] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T19:39:15.234032] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-24T19:39:15.909871] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T19:39:15.911186] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-24T19:39:15.959842] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T19:39:15.971461] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-24T19:39:16.866339] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T19:39:16.872281] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-24T19:39:17.363006] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T19:39:17.364372] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-24T19:39:17.909841] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-24T19:39:17.919445] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-24T19:39:18.030672] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T19:39:18.032361] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-24T19:39:18.493713] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-24T19:39:18.495231] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-24T19:39:18.535213] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T19:39:18.541532] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-24T19:39:18.809440] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-24T19:39:18.810893] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-24T19:39:19.205051] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (3.23 seconds). [2025-09-24T19:39:19.216574] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-24T19:39:19.230352] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T19:39:19.232115] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-24T19:39:19.462619] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T19:39:19.494412] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-24T19:39:19.497426] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:39:19.721265] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T19:39:20.016174] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-24T19:39:20.590481] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T19:39:20.680264] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T19:39:20.816102] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-24T19:39:21.121393] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T19:39:21.616145] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-24T19:39:22.320036] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:39:22.416111] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-24T19:39:23.059759] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T19:39:23.216080] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-24T19:39:24.001107] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T19:39:24.016048] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-24T19:39:24.539122] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T19:39:24.816082] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-24T19:39:25.342881] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T19:39:25.616084] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-24T19:39:25.931627] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T19:39:26.206130] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T19:39:26.208071] [INFO ] [REMOTE ] KMPB: Full fetch complete (4892 records). [2025-09-24T19:39:26.208180] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-24T19:39:26.421284] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-24T19:39:26.761312] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-24T19:39:26.761481] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-24T19:39:26.761815] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-24T19:39:26.761908] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-24T19:39:26.762762] [DEBUG] [LOCAL ] KMPB: Trimmed 4892 records to 3581 (keeping 200 days of data) [2025-09-24T19:39:26.796375] [DEBUG] [LOCAL ] KMPB: Primary data saved (3581 records). [2025-09-24T19:39:26.796560] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-24T19:39:26.796852] [INFO ] [MAIN ] Update Progress: 1201/2373 symbols completed. KMPB took 14.8s. Estimated remaining: 2h 35m 32s. Rate: 7.5 symbols/min [2025-09-24T19:39:27.078135] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:27.165318] [DEBUG] [LOCAL ] KMT: Loaded 43103 existing records from primary storage. [2025-09-24T19:39:27.165530] [INFO ] [MAIN ] KMT: Loaded 43103 existing records. [2025-09-24T19:39:27.221333] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-24T19:39:27.383542] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:27.383903] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-24T19:39:27.383973] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-24T19:39:27.385327] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-24T19:39:27.385399] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-24T19:39:27.753264] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:28.016110] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-24T19:39:28.476605] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T19:39:28.588569] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T19:39:28.816125] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-24T19:39:29.589142] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T19:39:29.616042] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-24T19:39:30.416115] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-24T19:39:30.631158] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T19:39:31.190134] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T19:39:31.216050] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-24T19:39:31.865584] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:39:32.016141] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-24T19:39:32.657167] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T19:39:32.816101] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-24T19:39:33.511696] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T19:39:33.616137] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-24T19:39:34.416064] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-24T19:39:34.951168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-24T19:39:35.216070] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-24T19:39:35.521305] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-24T19:39:35.731417] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T19:39:35.740935] [INFO ] [REMOTE ] KMPR: Full fetch complete (50643 records). [2025-09-24T19:39:35.741061] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-24T19:39:36.021208] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-24T19:39:36.132530] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-24T19:39:36.132614] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-24T19:39:36.133448] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-24T19:39:36.133508] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-24T19:39:36.134691] [DEBUG] [LOCAL ] KMPR: Trimmed 50643 records to 38424 (keeping 200 days of data) [2025-09-24T19:39:36.385342] [DEBUG] [LOCAL ] KMPR: Primary data saved (38424 records). [2025-09-24T19:39:36.385504] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-24T19:39:36.385636] [INFO ] [MAIN ] Update Progress: 1202/2373 symbols completed. KMPR took 24.4s. Estimated remaining: 2h 35m 26s. Rate: 7.5 symbols/min [2025-09-24T19:39:36.568239] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:36.623172] [DEBUG] [LOCAL ] KMX: Loaded 53112 existing records from primary storage. [2025-09-24T19:39:36.623356] [INFO ] [MAIN ] KMX: Loaded 53112 existing records. [2025-09-24T19:39:36.808260] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:36.808624] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-24T19:39:36.808719] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-24T19:39:36.810210] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-24T19:39:36.810274] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-24T19:39:36.832584] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-24T19:39:37.188338] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:37.227890] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T19:39:37.552210] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T19:39:37.616070] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-24T19:39:38.417570] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-24T19:39:38.420419] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T19:39:39.168090] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:39:39.175353] [INFO ] [REMOTE ] KLG: Full fetch complete (61714 records). [2025-09-24T19:39:39.175463] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-24T19:39:39.225009] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-24T19:39:39.575412] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-24T19:39:39.575520] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-24T19:39:39.576472] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-24T19:39:39.576538] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-24T19:39:39.577994] [DEBUG] [LOCAL ] KLG: Trimmed 61714 records to 41876 (keeping 200 days of data) [2025-09-24T19:39:39.854499] [DEBUG] [LOCAL ] KLG: Primary data saved (41876 records). [2025-09-24T19:39:39.854665] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-24T19:39:39.854797] [INFO ] [MAIN ] Update Progress: 1203/2373 symbols completed. KLG took 27.8s. Estimated remaining: 2h 35m 13s. Rate: 7.5 symbols/min [2025-09-24T19:39:40.016028] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-24T19:39:40.061392] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:40.065245] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:39:40.114551] [DEBUG] [LOCAL ] KN: Loaded 38940 existing records from primary storage. [2025-09-24T19:39:40.114729] [INFO ] [MAIN ] KN: Loaded 38940 existing records. [2025-09-24T19:39:40.289565] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:40.289874] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-24T19:39:40.289923] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-24T19:39:40.291768] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-24T19:39:40.291831] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-24T19:39:40.646144] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:40.816054] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-24T19:39:40.906406] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T19:39:41.616060] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-24T19:39:42.069031] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T19:39:42.256819] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T19:39:42.416097] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-24T19:39:43.092017] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T19:39:43.216076] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-24T19:39:44.016121] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-24T19:39:44.524346] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T19:39:44.816096] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-24T19:39:44.847475] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T19:39:45.616150] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-24T19:39:45.618071] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T19:39:46.416075] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-24T19:39:46.472718] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:39:47.062969] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:39:47.216098] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-24T19:39:47.667330] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T19:39:48.016145] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-24T19:39:48.816137] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-24T19:39:49.049451] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T19:39:49.059137] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-24T19:39:49.059275] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-24T19:39:49.466334] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-24T19:39:49.466539] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-24T19:39:49.467684] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-24T19:39:49.467764] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-24T19:39:49.469460] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-09-24T19:39:49.622566] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-24T19:39:49.646237] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T19:39:49.869008] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-24T19:39:49.869161] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-24T19:39:49.869241] [INFO ] [MAIN ] Update Progress: 1204/2373 symbols completed. KMI took 37.9s. Estimated remaining: 2h 35m 8s. Rate: 7.5 symbols/min [2025-09-24T19:39:50.045335] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:50.083574] [DEBUG] [LOCAL ] KNF: Loaded 35846 existing records from primary storage. [2025-09-24T19:39:50.083744] [INFO ] [MAIN ] KNF: Loaded 35846 existing records. [2025-09-24T19:39:50.278077] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:50.278698] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-24T19:39:50.278874] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-24T19:39:50.280201] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-24T19:39:50.280268] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-24T19:39:50.433881] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-24T19:39:50.652836] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T19:39:50.700325] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:50.917807] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T19:39:51.216313] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-24T19:39:52.016201] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-24T19:39:52.300808] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T19:39:52.309203] [INFO ] [REMOTE ] KMT: Full fetch complete (62022 records). [2025-09-24T19:39:52.309323] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-24T19:39:52.705908] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T19:39:52.773555] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-24T19:39:52.773667] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-24T19:39:52.774718] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-24T19:39:52.774784] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-24T19:39:52.779969] [DEBUG] [LOCAL ] KMT: Trimmed 62022 records to 43072 (keeping 200 days of data) [2025-09-24T19:39:52.842522] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-24T19:39:53.080577] [DEBUG] [LOCAL ] KMT: Primary data saved (43072 records). [2025-09-24T19:39:53.080786] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-24T19:39:53.080913] [INFO ] [MAIN ] Update Progress: 1205/2373 symbols completed. KMT took 26.3s. Estimated remaining: 2h 34m 55s. Rate: 7.5 symbols/min [2025-09-24T19:39:53.270468] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:39:53.305031] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T19:39:53.319307] [DEBUG] [LOCAL ] KNOP: Loaded 9921 existing records from primary storage. [2025-09-24T19:39:53.319717] [INFO ] [MAIN ] KNOP: Loaded 9921 existing records. [2025-09-24T19:39:53.508534] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:39:53.508854] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-24T19:39:53.508905] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-24T19:39:53.509358] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-24T19:39:53.509418] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-24T19:39:53.621331] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-24T19:39:53.904258] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:39:53.923238] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T19:39:54.416082] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-24T19:39:55.135861] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T19:39:55.169513] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T19:39:55.216039] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-24T19:39:56.016087] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-24T19:39:56.816072] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-24T19:39:57.044542] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T19:39:57.167585] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T19:39:57.591913] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T19:39:57.616061] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-24T19:39:58.359250] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T19:39:58.416087] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-24T19:39:59.216078] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-24T19:39:59.273623] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T19:40:00.016077] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-24T19:40:00.749541] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T19:40:00.816098] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-24T19:40:01.616087] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-24T19:40:02.355799] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-24T19:40:02.416053] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-24T19:40:02.577689] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T19:40:02.795134] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T19:40:03.216086] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-24T19:40:04.016115] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-24T19:40:04.251975] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T19:40:04.536431] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T19:40:04.816085] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-24T19:40:04.839977] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T19:40:05.616109] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-24T19:40:06.206485] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T19:40:06.370102] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T19:40:06.416071] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-24T19:40:07.169601] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T19:40:07.216125] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-24T19:40:08.016142] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-24T19:40:08.589105] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T19:40:08.816152] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-24T19:40:09.235564] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T19:40:09.616181] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-24T19:40:10.018035] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T19:40:10.416188] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-24T19:40:10.471948] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T19:40:10.474765] [INFO ] [REMOTE ] KNOP: Full fetch complete (14642 records). [2025-09-24T19:40:10.474874] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-24T19:40:10.902618] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-24T19:40:10.902742] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-24T19:40:10.903141] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-24T19:40:10.903263] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-24T19:40:10.904076] [DEBUG] [LOCAL ] KNOP: Trimmed 14642 records to 9990 (keeping 200 days of data) [2025-09-24T19:40:10.962970] [DEBUG] [LOCAL ] KNOP: Primary data saved (9990 records). [2025-09-24T19:40:10.963098] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-24T19:40:10.963201] [INFO ] [MAIN ] Update Progress: 1206/2373 symbols completed. KNOP took 17.9s. Estimated remaining: 2h 34m 57s. Rate: 7.5 symbols/min [2025-09-24T19:40:11.132181] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:11.153405] [DEBUG] [LOCAL ] KNSL: Loaded 18092 existing records from primary storage. [2025-09-24T19:40:11.153561] [INFO ] [MAIN ] KNSL: Loaded 18092 existing records. [2025-09-24T19:40:11.226236] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-24T19:40:11.333576] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:11.333841] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-24T19:40:11.333893] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-24T19:40:11.334623] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-24T19:40:11.334736] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-24T19:40:11.728666] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:12.016069] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-24T19:40:12.270635] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T19:40:12.704235] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T19:40:12.816061] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-24T19:40:12.975997] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T19:40:13.616151] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-24T19:40:13.972003] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T19:40:14.416127] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-24T19:40:14.975943] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:40:15.216167] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-24T19:40:15.522551] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T19:40:16.016148] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-24T19:40:16.442981] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T19:40:16.816085] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-24T19:40:17.051965] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T19:40:17.616140] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-24T19:40:18.248430] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:40:18.416045] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-24T19:40:18.798727] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T19:40:19.216128] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-24T19:40:19.620463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:40:19.906985] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T19:40:20.016135] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-24T19:40:20.816088] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-24T19:40:21.461009] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T19:40:21.616079] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-24T19:40:22.369680] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:40:22.376877] [INFO ] [REMOTE ] KNF: Full fetch complete (50446 records). [2025-09-24T19:40:22.376985] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-24T19:40:22.421247] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-24T19:40:22.763295] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-24T19:40:22.763507] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-24T19:40:22.764556] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-24T19:40:22.764627] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-24T19:40:22.765867] [DEBUG] [LOCAL ] KNF: Trimmed 50446 records to 35874 (keeping 200 days of data) [2025-09-24T19:40:22.981913] [DEBUG] [LOCAL ] KNF: Primary data saved (35874 records). [2025-09-24T19:40:22.982124] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-24T19:40:22.982248] [INFO ] [MAIN ] Update Progress: 1207/2373 symbols completed. KNF took 33.1s. Estimated remaining: 2h 34m 53s. Rate: 7.5 symbols/min [2025-09-24T19:40:23.160791] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:23.180315] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:40:23.187890] [INFO ] [REMOTE ] KN: Full fetch complete (56397 records). [2025-09-24T19:40:23.188030] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-24T19:40:23.220718] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-24T19:40:23.539380] [DEBUG] [LOCAL ] KNTK: Loaded 46111 existing records from primary storage. [2025-09-24T19:40:23.549814] [INFO ] [MAIN ] KNTK: Loaded 46111 existing records. [2025-09-24T19:40:23.731984] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-24T19:40:23.737182] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-24T19:40:23.748540] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-24T19:40:23.762012] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-24T19:40:23.803484] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:23.803991] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-24T19:40:23.804075] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-24T19:40:23.803938] [DEBUG] [LOCAL ] KN: Trimmed 56397 records to 38876 (keeping 200 days of data) [2025-09-24T19:40:23.805398] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-24T19:40:23.805465] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-24T19:40:24.318974] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:24.321070] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-24T19:40:24.341040] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T19:40:24.483945] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-24T19:40:24.497158] [INFO ] [REMOTE ] KMX: Full fetch complete (75938 records). [2025-09-24T19:40:24.498574] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-24T19:40:24.737137] [DEBUG] [LOCAL ] KN: Primary data saved (38876 records). [2025-09-24T19:40:24.777310] [INFO ] [MAIN ] KN: Full history saved. [2025-09-24T19:40:24.821268] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-24T19:40:24.830048] [INFO ] [MAIN ] Update Progress: 1208/2373 symbols completed. KN took 45.0s. Estimated remaining: 2h 34m 39s. Rate: 7.5 symbols/min [2025-09-24T19:40:25.105488] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-24T19:40:25.110749] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-24T19:40:25.111996] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-24T19:40:25.117224] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-24T19:40:25.174014] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:25.175136] [DEBUG] [LOCAL ] KMX: Trimmed 75938 records to 53117 (keeping 200 days of data) [2025-09-24T19:40:25.346084] [DEBUG] [LOCAL ] KNX: Loaded 52600 existing records from primary storage. [2025-09-24T19:40:25.351083] [INFO ] [MAIN ] KNX: Loaded 52600 existing records. [2025-09-24T19:40:25.635717] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:25.651028] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-24T19:40:25.660124] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-24T19:40:25.662762] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-24T19:40:25.668335] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-24T19:40:25.873512] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T19:40:25.890775] [DEBUG] [LOCAL ] KMX: Primary data saved (53117 records). [2025-09-24T19:40:25.910675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-24T19:40:25.921538] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-24T19:40:25.921784] [INFO ] [MAIN ] Update Progress: 1209/2373 symbols completed. KMX took 49.5s. Estimated remaining: 2h 34m 24s. Rate: 7.5 symbols/min [2025-09-24T19:40:25.948078] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T19:40:26.345948] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:26.362355] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-24T19:40:26.362456] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-24T19:40:26.364127] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-24T19:40:26.368352] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-24T19:40:26.368271] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:26.368538] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-24T19:40:26.368901] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-24T19:40:26.423004] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-24T19:40:26.733736] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:26.993380] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T19:40:27.216088] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-24T19:40:27.488748] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T19:40:28.016141] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-24T19:40:28.816088] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-24T19:40:29.616131] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-24T19:40:29.784114] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:40:29.803512] [INFO ] [REMOTE ] KNSL: Full fetch complete (26717 records). [2025-09-24T19:40:29.816909] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-24T19:40:29.852789] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T19:40:30.266062] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-09-24T19:40:30.268068] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-24T19:40:30.268222] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-24T19:40:30.280674] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-24T19:40:30.280750] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-24T19:40:30.281573] [DEBUG] [LOCAL ] KNSL: Trimmed 26717 records to 18098 (keeping 200 days of data) [2025-09-24T19:40:30.397322] [DEBUG] [LOCAL ] KNSL: Primary data saved (18098 records). [2025-09-24T19:40:30.397510] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-24T19:40:30.397618] [INFO ] [MAIN ] Update Progress: 1210/2373 symbols completed. KNSL took 19.4s. Estimated remaining: 2h 34m 13s. Rate: 7.5 symbols/min [2025-09-24T19:40:30.421249] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-24T19:40:30.579862] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:30.625367] [DEBUG] [LOCAL ] KODK: Loaded 43429 existing records from primary storage. [2025-09-24T19:40:30.625516] [INFO ] [MAIN ] KODK: Loaded 43429 existing records. [2025-09-24T19:40:30.814457] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:30.814946] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-24T19:40:30.815076] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-24T19:40:30.823193] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-24T19:40:30.836346] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-24T19:40:30.863697] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T19:40:31.206818] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:31.216035] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-24T19:40:32.016083] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-24T19:40:32.254298] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T19:40:32.816124] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-24T19:40:32.995866] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T19:40:33.616089] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-24T19:40:34.319992] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-24T19:40:34.416100] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-24T19:40:34.568541] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T19:40:35.141499] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T19:40:35.216071] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-24T19:40:36.016173] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-24T19:40:36.821240] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-24T19:40:36.842475] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T19:40:36.941535] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-24T19:40:37.616197] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-24T19:40:37.848851] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T19:40:38.416148] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-24T19:40:38.522479] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T19:40:39.216178] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-24T19:40:40.016171] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-24T19:40:40.233217] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T19:40:40.279576] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-24T19:40:40.796049] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T19:40:40.816038] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-24T19:40:41.252794] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:40:41.616114] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-24T19:40:42.389526] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T19:40:42.416113] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-24T19:40:43.216127] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-24T19:40:43.979542] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T19:40:44.016106] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-24T19:40:44.429791] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-24T19:40:44.817545] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-24T19:40:44.824284] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:40:45.616181] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-24T19:40:45.690780] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T19:40:46.416180] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-24T19:40:47.124275] [DEBUG] [REMOTE ] KO: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-24T19:40:47.124506] [WARN ] [REMOTE ] KO: No data returned for month 2025-05 [2025-09-24T19:40:47.216230] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-24T19:40:47.256755] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T19:40:47.913450] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T19:40:48.016069] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-24T19:40:48.816101] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-24T19:40:49.616131] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-24T19:40:49.748514] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:40:49.793307] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-24T19:40:50.122042] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T19:40:50.416097] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-24T19:40:51.057590] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T19:40:51.216114] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-24T19:40:52.016093] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-24T19:40:52.745566] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T19:40:52.816112] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-24T19:40:53.239813] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-24T19:40:53.500491] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T19:40:53.616076] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-24T19:40:54.420931] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-24T19:40:54.427161] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T19:40:54.437497] [INFO ] [REMOTE ] KNX: Full fetch complete (75701 records). [2025-09-24T19:40:54.437711] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-24T19:40:54.868793] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-24T19:40:54.868894] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-24T19:40:54.869936] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-24T19:40:54.870001] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-24T19:40:54.871662] [DEBUG] [LOCAL ] KNX: Trimmed 75701 records to 52595 (keeping 200 days of data) [2025-09-24T19:40:55.213622] [DEBUG] [LOCAL ] KNX: Primary data saved (52595 records). [2025-09-24T19:40:55.213823] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-24T19:40:55.213924] [INFO ] [MAIN ] Update Progress: 1211/2373 symbols completed. KNX took 30.4s. Estimated remaining: 2h 34m 21s. Rate: 7.5 symbols/min [2025-09-24T19:40:55.246752] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-24T19:40:55.405219] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:55.434404] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T19:40:55.470978] [DEBUG] [LOCAL ] KOF: Loaded 25835 existing records from primary storage. [2025-09-24T19:40:55.471254] [INFO ] [MAIN ] KOF: Loaded 25835 existing records. [2025-09-24T19:40:55.655100] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:55.655345] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-24T19:40:55.655395] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-24T19:40:55.656430] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-24T19:40:55.656493] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-24T19:40:56.011024] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:56.016046] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-24T19:40:56.816102] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-24T19:40:57.179326] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-24T19:40:57.216971] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T19:40:57.236627] [INFO ] [REMOTE ] KNTK: Full fetch complete (64025 records). [2025-09-24T19:40:57.237689] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-24T19:40:57.237605] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T19:40:57.621025] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-24T19:40:57.643237] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-24T19:40:57.643353] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-24T19:40:57.644709] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-24T19:40:57.644873] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-24T19:40:57.649201] [DEBUG] [LOCAL ] KNTK: Trimmed 64025 records to 46087 (keeping 200 days of data) [2025-09-24T19:40:57.958910] [DEBUG] [LOCAL ] KNTK: Primary data saved (46087 records). [2025-09-24T19:40:57.959069] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-24T19:40:57.959177] [INFO ] [MAIN ] Update Progress: 1212/2373 symbols completed. KNTK took 35.0s. Estimated remaining: 2h 34m 8s. Rate: 7.5 symbols/min [2025-09-24T19:40:58.137209] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:40:58.159547] [DEBUG] [LOCAL ] KOP: Loaded 17936 existing records from primary storage. [2025-09-24T19:40:58.159771] [INFO ] [MAIN ] KOP: Loaded 17936 existing records. [2025-09-24T19:40:58.345299] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:40:58.345561] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-24T19:40:58.345610] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-24T19:40:58.346371] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-24T19:40:58.346434] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-24T19:40:58.417139] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-24T19:40:58.745859] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:40:58.773606] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T19:40:58.987299] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:40:59.216097] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-24T19:41:00.016125] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-24T19:41:00.816122] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-24T19:41:00.954433] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:41:00.966160] [INFO ] [REMOTE ] KODK: Full fetch complete (63516 records). [2025-09-24T19:41:00.966402] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-24T19:41:01.285170] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T19:41:01.413304] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-24T19:41:01.413517] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-24T19:41:01.414547] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-24T19:41:01.414633] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-24T19:41:01.439278] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-09-24T19:41:01.448940] [DEBUG] [LOCAL ] KODK: Trimmed 63516 records to 43383 (keeping 200 days of data) [2025-09-24T19:41:01.449856] [INFO ] [REMOTE ] KO: Full fetch complete (69414 records). [2025-09-24T19:41:01.450342] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-24T19:41:01.645469] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-24T19:41:01.774848] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-24T19:41:01.776888] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:41:01.778477] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:41:01.784504] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-24T19:41:01.807829] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-24T19:41:01.809087] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-24T19:41:01.810271] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-24T19:41:01.810094] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T19:41:01.854823] [INFO ] [MAIN ] Update Progress: 1213/2373 symbols completed. KO took 35.9s. Estimated remaining: 2h 33m 56s. Rate: 7.5 symbols/min [2025-09-24T19:41:02.077132] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:02.084809] [DEBUG] [LOCAL ] KORE: Loaded 1946 existing records from primary storage. [2025-09-24T19:41:02.085472] [INFO ] [MAIN ] KORE: Loaded 1946 existing records. [2025-09-24T19:41:02.275798] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:02.278285] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-24T19:41:02.279694] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-24T19:41:02.280402] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-24T19:41:02.280834] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-24T19:41:02.419986] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-24T19:41:02.665081] [DEBUG] [LOCAL ] KODK: Primary data saved (43383 records). [2025-09-24T19:41:02.675892] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-24T19:41:02.676162] [INFO ] [MAIN ] Update Progress: 1214/2373 symbols completed. KODK took 32.3s. Estimated remaining: 2h 33m 41s. Rate: 7.5 symbols/min [2025-09-24T19:41:02.760830] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:02.847894] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T19:41:02.949734] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:03.011230] [DEBUG] [LOCAL ] KOS: Loaded 53066 existing records from primary storage. [2025-09-24T19:41:03.011440] [INFO ] [MAIN ] KOS: Loaded 53066 existing records. [2025-09-24T19:41:03.195769] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:03.196046] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-24T19:41:03.196099] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-24T19:41:03.197553] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-24T19:41:03.197616] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-24T19:41:03.221276] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-24T19:41:03.569572] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:03.586246] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T19:41:04.016058] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-24T19:41:04.404689] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T19:41:04.816068] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-24T19:41:04.939536] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T19:41:05.616088] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-24T19:41:05.968211] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T19:41:06.416090] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-24T19:41:06.486617] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-24T19:41:07.216128] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-24T19:41:07.359928] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-24T19:41:07.649268] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T19:41:08.016179] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-24T19:41:08.816127] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-24T19:41:09.616120] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-24T19:41:09.667559] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:41:09.887929] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T19:41:10.416157] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-24T19:41:10.901281] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:41:11.216066] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-24T19:41:11.329953] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T19:41:12.016094] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-24T19:41:12.745105] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:41:12.816047] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-24T19:41:13.061001] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T19:41:13.616105] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-24T19:41:13.837588] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T19:41:13.991340] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-24T19:41:14.416110] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-24T19:41:14.803336] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-24T19:41:15.216082] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-24T19:41:16.016214] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-24T19:41:16.816140] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-24T19:41:16.908911] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T19:41:17.485829] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T19:41:17.616084] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-24T19:41:18.020158] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T19:41:18.024259] [INFO ] [REMOTE ] KOP: Full fetch complete (25417 records). [2025-09-24T19:41:18.024339] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-24T19:41:18.397454] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-24T19:41:18.397538] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-24T19:41:18.398113] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-24T19:41:18.398176] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-24T19:41:18.398869] [DEBUG] [LOCAL ] KOP: Trimmed 25417 records to 17845 (keeping 200 days of data) [2025-09-24T19:41:18.445156] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-24T19:41:18.524790] [DEBUG] [LOCAL ] KOP: Primary data saved (17845 records). [2025-09-24T19:41:18.525060] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-24T19:41:18.525444] [INFO ] [MAIN ] Update Progress: 1215/2373 symbols completed. KOP took 20.6s. Estimated remaining: 2h 33m 41s. Rate: 7.5 symbols/min [2025-09-24T19:41:18.707506] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:18.766375] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-24T19:41:18.766573] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-24T19:41:18.953999] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:18.954279] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-24T19:41:18.954326] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-24T19:41:18.955882] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-24T19:41:18.955943] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-24T19:41:19.216361] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-24T19:41:19.341976] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:19.379471] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T19:41:19.727469] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T19:41:19.823597] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:41:20.016107] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-24T19:41:20.816133] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-24T19:41:21.616086] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-24T19:41:21.876068] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T19:41:22.068054] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T19:41:22.416108] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-24T19:41:23.121470] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:41:23.216061] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-24T19:41:23.328924] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T19:41:23.726168] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T19:41:24.016122] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-24T19:41:24.816110] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-24T19:41:25.238044] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T19:41:25.243351] [INFO ] [REMOTE ] KOF: Full fetch complete (36953 records). [2025-09-24T19:41:25.243513] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-24T19:41:25.621259] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-24T19:41:25.637125] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-24T19:41:25.637247] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-24T19:41:25.638080] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-24T19:41:25.638177] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-24T19:41:25.639382] [DEBUG] [LOCAL ] KOF: Trimmed 36953 records to 25908 (keeping 200 days of data) [2025-09-24T19:41:25.809504] [DEBUG] [LOCAL ] KOF: Primary data saved (25908 records). [2025-09-24T19:41:25.809688] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-24T19:41:25.809825] [INFO ] [MAIN ] Update Progress: 1216/2373 symbols completed. KOF took 30.6s. Estimated remaining: 2h 33m 32s. Rate: 7.5 symbols/min [2025-09-24T19:41:25.992296] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:26.042347] [DEBUG] [LOCAL ] KRC: Loaded 48420 existing records from primary storage. [2025-09-24T19:41:26.042572] [INFO ] [MAIN ] KRC: Loaded 48420 existing records. [2025-09-24T19:41:26.223112] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:26.223487] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-24T19:41:26.223562] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-24T19:41:26.225002] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-24T19:41:26.225083] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-24T19:41:26.251322] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T19:41:26.419761] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-24T19:41:26.653084] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:26.654677] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T19:41:26.993046] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T19:41:27.216089] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-24T19:41:28.016095] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-24T19:41:28.541666] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T19:41:28.542700] [INFO ] [REMOTE ] KORE: Full fetch complete (6100 records). [2025-09-24T19:41:28.542772] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-24T19:41:28.821219] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-24T19:41:28.935967] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-24T19:41:28.936483] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-24T19:41:28.936864] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-24T19:41:28.936999] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-24T19:41:28.937988] [DEBUG] [LOCAL ] KORE: Trimmed 6100 records to 1970 (keeping 200 days of data) [2025-09-24T19:41:28.984458] [DEBUG] [LOCAL ] KORE: Primary data saved (1970 records). [2025-09-24T19:41:28.984358] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T19:41:28.995004] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-24T19:41:28.995615] [INFO ] [MAIN ] Update Progress: 1217/2373 symbols completed. KORE took 27.1s. Estimated remaining: 2h 33m 20s. Rate: 7.5 symbols/min [2025-09-24T19:41:29.173576] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:29.230421] [DEBUG] [LOCAL ] KREF: Loaded 37022 existing records from primary storage. [2025-09-24T19:41:29.230565] [INFO ] [MAIN ] KREF: Loaded 37022 existing records. [2025-09-24T19:41:29.411549] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:29.411811] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-24T19:41:29.411875] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-24T19:41:29.413023] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-24T19:41:29.413092] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-24T19:41:29.621250] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-24T19:41:29.782357] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:30.421610] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-24T19:41:30.452854] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T19:41:31.216078] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-24T19:41:31.362477] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T19:41:32.016044] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-24T19:41:32.204224] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T19:41:32.572921] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T19:41:32.816078] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-24T19:41:33.621222] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-24T19:41:33.639922] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T19:41:34.178078] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T19:41:34.416120] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-24T19:41:35.216075] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-24T19:41:35.438485] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T19:41:35.652697] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:41:36.016089] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-24T19:41:36.464871] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T19:41:36.816148] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-24T19:41:37.087863] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T19:41:37.616094] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-24T19:41:38.416101] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-24T19:41:38.753215] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T19:41:38.763946] [INFO ] [REMOTE ] KOS: Full fetch complete (76851 records). [2025-09-24T19:41:38.764196] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-24T19:41:39.195709] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-24T19:41:39.195883] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-24T19:41:39.196990] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-24T19:41:39.197055] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-24T19:41:39.198736] [DEBUG] [LOCAL ] KOS: Trimmed 76851 records to 53064 (keeping 200 days of data) [2025-09-24T19:41:39.256327] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-24T19:41:39.538361] [DEBUG] [LOCAL ] KOS: Primary data saved (53064 records). [2025-09-24T19:41:39.538554] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-24T19:41:39.538794] [INFO ] [MAIN ] Update Progress: 1218/2373 symbols completed. KOS took 36.8s. Estimated remaining: 2h 33m 14s. Rate: 7.5 symbols/min [2025-09-24T19:41:39.702268] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T19:41:39.773491] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:39.827030] [DEBUG] [LOCAL ] KRG: Loaded 49153 existing records from primary storage. [2025-09-24T19:41:39.827187] [INFO ] [MAIN ] KRG: Loaded 49153 existing records. [2025-09-24T19:41:40.031141] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-24T19:41:40.031568] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:41:40.033523] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-24T19:41:40.033661] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-24T19:41:40.044184] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-24T19:41:40.044480] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-24T19:41:40.172411] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T19:41:40.493258] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:40.519130] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T19:41:40.816093] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-24T19:41:41.616105] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-24T19:41:42.165263] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-24T19:41:42.370779] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T19:41:42.416051] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-24T19:41:42.736731] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T19:41:43.216084] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-24T19:41:43.745879] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T19:41:44.016111] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-24T19:41:44.816075] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-24T19:41:44.943808] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T19:41:45.616090] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-24T19:41:45.992758] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T19:41:46.042747] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T19:41:46.416096] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-24T19:41:47.216121] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-24T19:41:47.421673] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T19:41:48.016056] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-24T19:41:48.239810] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T19:41:48.279441] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T19:41:48.816073] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-24T19:41:49.581883] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T19:41:49.616031] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-24T19:41:50.167944] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T19:41:50.416094] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-24T19:41:51.003894] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T19:41:51.216091] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-24T19:41:51.800480] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T19:41:52.016165] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-24T19:41:52.816110] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-24T19:41:52.962971] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T19:41:53.444366] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:41:53.616083] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-24T19:41:54.381960] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T19:41:54.389166] [INFO ] [REMOTE ] KREF: Full fetch complete (51860 records). [2025-09-24T19:41:54.389256] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-24T19:41:54.421261] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-24T19:41:54.805312] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-24T19:41:54.805762] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-24T19:41:54.806992] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-24T19:41:54.807082] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-24T19:41:54.809449] [DEBUG] [LOCAL ] KREF: Trimmed 51860 records to 37132 (keeping 200 days of data) [2025-09-24T19:41:55.046170] [DEBUG] [LOCAL ] KREF: Primary data saved (37132 records). [2025-09-24T19:41:55.046362] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-24T19:41:55.046463] [INFO ] [MAIN ] Update Progress: 1219/2373 symbols completed. KREF took 26.1s. Estimated remaining: 2h 33m 14s. Rate: 7.5 symbols/min [2025-09-24T19:41:55.219288] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-24T19:41:55.219065] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:41:55.219788] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-24T19:41:55.220848] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-24T19:41:55.221057] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-24T19:41:55.221102] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-24T19:41:55.221146] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-24T19:41:55.221181] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-24T19:41:55.594346] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:41:55.633488] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T19:41:56.016052] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-24T19:41:56.263903] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T19:41:56.529720] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T19:41:56.816092] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-24T19:41:57.616078] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-24T19:41:57.812636] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:41:57.816475] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-24T19:41:57.819069] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T19:41:58.416131] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-24T19:41:58.552520] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T19:41:58.790586] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:41:58.790971] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-24T19:41:59.216075] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-24T19:42:00.016083] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-24T19:42:00.462294] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T19:42:00.816121] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-24T19:42:01.616105] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-24T19:42:01.890839] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T19:42:02.189597] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T19:42:02.203008] [INFO ] [REMOTE ] KRC: Full fetch complete (69548 records). [2025-09-24T19:42:02.203210] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-24T19:42:02.421279] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-24T19:42:02.620048] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-24T19:42:02.620140] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-24T19:42:02.621263] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-24T19:42:02.621335] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-24T19:42:02.622885] [DEBUG] [LOCAL ] KRC: Trimmed 69548 records to 48389 (keeping 200 days of data) [2025-09-24T19:42:02.940371] [DEBUG] [LOCAL ] KRC: Primary data saved (48389 records). [2025-09-24T19:42:02.940518] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-24T19:42:02.940606] [INFO ] [MAIN ] Update Progress: 1220/2373 symbols completed. KRC took 37.1s. Estimated remaining: 2h 33m 5s. Rate: 7.5 symbols/min [2025-09-24T19:42:03.120855] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:03.121055] [DEBUG] [LOCAL ] KRO: No existing data file found in primary storage. [2025-09-24T19:42:03.121093] [WARN ] [MAIN ] KRO: No existing data found, performing full refresh instead. [2025-09-24T19:42:03.121239] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-24T19:42:03.121282] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-24T19:42:03.121325] [DEBUG] [LOCAL ] KRO: No primary data file found to delete. [2025-09-24T19:42:03.121360] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-24T19:42:03.221366] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-24T19:42:03.494859] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:04.016104] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-24T19:42:04.541678] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T19:42:04.657118] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T19:42:04.816110] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-24T19:42:04.888745] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T19:42:05.115834] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (3.50 seconds). [2025-09-24T19:42:05.125842] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-09-24T19:42:05.126029] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-24T19:42:05.542493] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-24T19:42:05.542589] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-24T19:42:05.543852] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-24T19:42:05.543921] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-24T19:42:05.545842] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53682 (keeping 200 days of data) [2025-09-24T19:42:05.622806] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-24T19:42:05.897336] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-24T19:42:05.897482] [INFO ] [MAIN ] KR: Full history saved. [2025-09-24T19:42:05.897599] [INFO ] [MAIN ] Update Progress: 1221/2373 symbols completed. KR took 47.4s. Estimated remaining: 2h 32m 53s. Rate: 7.5 symbols/min [2025-09-24T19:42:06.072209] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:06.113794] [DEBUG] [LOCAL ] KRP: Loaded 37613 existing records from primary storage. [2025-09-24T19:42:06.113953] [INFO ] [MAIN ] KRP: Loaded 37613 existing records. [2025-09-24T19:42:06.309135] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:06.309390] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-24T19:42:06.309442] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-24T19:42:06.310835] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-24T19:42:06.310905] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-24T19:42:06.417131] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-24T19:42:06.474322] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:42:06.744506] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:06.781685] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T19:42:07.216105] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-24T19:42:07.923528] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:42:08.016075] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-24T19:42:08.176827] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T19:42:08.816075] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-24T19:42:09.366292] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:42:09.616111] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-24T19:42:09.893611] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T19:42:10.416180] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-24T19:42:11.216103] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-24T19:42:11.254789] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T19:42:11.267322] [INFO ] [REMOTE ] KRG: Full fetch complete (71026 records). [2025-09-24T19:42:11.267487] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-24T19:42:11.743943] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-24T19:42:11.744033] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-24T19:42:11.745013] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-24T19:42:11.745076] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-24T19:42:11.746531] [DEBUG] [LOCAL ] KRG: Trimmed 71026 records to 49177 (keeping 200 days of data) [2025-09-24T19:42:12.022621] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-24T19:42:12.064331] [DEBUG] [LOCAL ] KRG: Primary data saved (49177 records). [2025-09-24T19:42:12.064675] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-24T19:42:12.064809] [INFO ] [MAIN ] Update Progress: 1222/2373 symbols completed. KRG took 32.5s. Estimated remaining: 2h 32m 43s. Rate: 7.5 symbols/min [2025-09-24T19:42:12.127931] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T19:42:12.284144] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:12.304329] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T19:42:12.373829] [DEBUG] [LOCAL ] KSS: Loaded 53608 existing records from primary storage. [2025-09-24T19:42:12.373993] [INFO ] [MAIN ] KSS: Loaded 53608 existing records. [2025-09-24T19:42:12.551217] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:12.551515] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-24T19:42:12.551569] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-24T19:42:12.552828] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-24T19:42:12.552890] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-24T19:42:12.821824] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-24T19:42:12.919180] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:13.449299] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T19:42:13.616111] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-24T19:42:14.416088] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-24T19:42:14.683027] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T19:42:15.139272] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T19:42:15.216136] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-24T19:42:16.016072] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-24T19:42:16.335357] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T19:42:16.463250] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T19:42:16.816108] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-24T19:42:17.616110] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-24T19:42:17.751535] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T19:42:18.416120] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-24T19:42:19.218844] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-24T19:42:19.221054] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-24T19:42:19.967857] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-24T19:42:20.016031] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-24T19:42:20.549204] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-24T19:42:20.558420] [INFO ] [REMOTE ] KRMN: Full fetch complete (49939 records). [2025-09-24T19:42:20.558557] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-24T19:42:20.757410] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-24T19:42:20.758103] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:42:20.758294] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:42:20.758493] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-24T19:42:20.758825] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-24T19:42:20.758975] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-24T19:42:20.759083] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-24T19:42:20.759227] [INFO ] [MAIN ] Update Progress: 1223/2373 symbols completed. KRMN took 25.7s. Estimated remaining: 2h 32m 36s. Rate: 7.5 symbols/min [2025-09-24T19:42:20.824576] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-24T19:42:20.941076] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:20.959449] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T19:42:20.997175] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T19:42:21.048137] [DEBUG] [LOCAL ] KT: Loaded 45670 existing records from primary storage. [2025-09-24T19:42:21.048320] [INFO ] [MAIN ] KT: Loaded 45670 existing records. [2025-09-24T19:42:21.232344] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:21.232626] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-24T19:42:21.232712] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-24T19:42:21.233980] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-24T19:42:21.234044] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-24T19:42:21.596881] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:21.616029] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-24T19:42:22.416056] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-24T19:42:22.573576] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T19:42:23.216147] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-24T19:42:23.362844] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T19:42:23.775605] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:42:24.016133] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-24T19:42:24.816066] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-24T19:42:24.857433] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T19:42:25.539333] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:42:25.616078] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-24T19:42:26.416109] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-24T19:42:26.457135] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T19:42:26.606540] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T19:42:27.216103] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-24T19:42:27.735636] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T19:42:27.740980] [INFO ] [REMOTE ] KRO: Full fetch complete (34861 records). [2025-09-24T19:42:27.741123] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-24T19:42:28.021294] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-24T19:42:28.132540] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-24T19:42:28.132624] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-24T19:42:28.133451] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-24T19:42:28.133504] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-24T19:42:28.134412] [DEBUG] [LOCAL ] KRO: Trimmed 34861 records to 26034 (keeping 200 days of data) [2025-09-24T19:42:28.290583] [DEBUG] [LOCAL ] KRO: Primary data saved (26034 records). [2025-09-24T19:42:28.290770] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-24T19:42:28.290879] [INFO ] [MAIN ] Update Progress: 1224/2373 symbols completed. KRO took 25.4s. Estimated remaining: 2h 32m 28s. Rate: 7.5 symbols/min [2025-09-24T19:42:28.470782] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:28.512040] [DEBUG] [LOCAL ] KTB: Loaded 41133 existing records from primary storage. [2025-09-24T19:42:28.512191] [INFO ] [MAIN ] KTB: Loaded 41133 existing records. [2025-09-24T19:42:28.702058] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:28.702319] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-24T19:42:28.702367] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-24T19:42:28.703580] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-24T19:42:28.703685] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-24T19:42:28.816271] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-24T19:42:29.090354] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:29.120361] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T19:42:29.616101] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-24T19:42:29.814454] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T19:42:30.246221] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:42:30.416135] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-24T19:42:30.534411] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T19:42:31.216090] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-24T19:42:32.016098] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-24T19:42:32.289406] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T19:42:32.816113] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-24T19:42:32.888289] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T19:42:33.085394] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T19:42:33.616091] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-24T19:42:33.896876] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T19:42:34.416144] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-24T19:42:35.216128] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-24T19:42:35.597219] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T19:42:35.786346] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-24T19:42:36.016125] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-24T19:42:36.598326] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T19:42:36.816100] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-24T19:42:37.576801] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T19:42:37.616082] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-24T19:42:37.863166] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T19:42:37.869620] [INFO ] [REMOTE ] KRP: Full fetch complete (54855 records). [2025-09-24T19:42:37.869795] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-24T19:42:38.267287] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-24T19:42:38.267385] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-24T19:42:38.268252] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-24T19:42:38.268318] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-24T19:42:38.269599] [DEBUG] [LOCAL ] KRP: Trimmed 54855 records to 37523 (keeping 200 days of data) [2025-09-24T19:42:38.439967] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-24T19:42:38.506668] [DEBUG] [LOCAL ] KRP: Primary data saved (37523 records). [2025-09-24T19:42:38.506836] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-24T19:42:38.506930] [INFO ] [MAIN ] Update Progress: 1225/2373 symbols completed. KRP took 32.6s. Estimated remaining: 2h 32m 22s. Rate: 7.5 symbols/min [2025-09-24T19:42:38.677992] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:38.692980] [DEBUG] [LOCAL ] KTF: Loaded 13055 existing records from primary storage. [2025-09-24T19:42:38.693112] [INFO ] [MAIN ] KTF: Loaded 13055 existing records. [2025-09-24T19:42:38.876357] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:38.876680] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-24T19:42:38.876748] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-24T19:42:38.877246] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-24T19:42:38.877309] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-24T19:42:39.220511] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-24T19:42:39.263345] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:39.290547] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T19:42:39.992965] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:42:40.016044] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-24T19:42:40.816110] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-24T19:42:41.281942] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T19:42:41.427971] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T19:42:41.616121] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-24T19:42:42.095555] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T19:42:42.416124] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-24T19:42:43.220078] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-24T19:42:43.232901] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T19:42:44.016151] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-24T19:42:44.757011] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-24T19:42:44.806032] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:42:44.816330] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-24T19:42:45.563864] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T19:42:45.616129] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-24T19:42:46.416107] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-24T19:42:46.779075] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T19:42:46.794994] [INFO ] [REMOTE ] KSS: Full fetch complete (77639 records). [2025-09-24T19:42:46.795338] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-24T19:42:47.011996] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T19:42:47.222394] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-24T19:42:47.286451] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-24T19:42:47.286561] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-24T19:42:47.287792] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-24T19:42:47.287865] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-24T19:42:47.289608] [DEBUG] [LOCAL ] KSS: Trimmed 77639 records to 53607 (keeping 200 days of data) [2025-09-24T19:42:47.632831] [DEBUG] [LOCAL ] KSS: Primary data saved (53607 records). [2025-09-24T19:42:47.633020] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-24T19:42:47.633127] [INFO ] [MAIN ] Update Progress: 1226/2373 symbols completed. KSS took 35.5s. Estimated remaining: 2h 32m 15s. Rate: 7.5 symbols/min [2025-09-24T19:42:47.856359] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:47.857708] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T19:42:47.881299] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-24T19:42:47.884799] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-24T19:42:47.884989] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-24T19:42:47.885223] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-24T19:42:47.885722] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-24T19:42:47.887052] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-24T19:42:47.886917] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:42:48.021176] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-24T19:42:48.281635] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:48.816090] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-24T19:42:49.577721] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T19:42:49.616077] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-24T19:42:50.093036] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T19:42:50.416090] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-24T19:42:51.216103] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-24T19:42:51.376332] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:42:51.388801] [INFO ] [REMOTE ] KT: Full fetch complete (66807 records). [2025-09-24T19:42:51.389032] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-24T19:42:51.766571] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-24T19:42:51.853743] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-24T19:42:51.854006] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-24T19:42:51.855404] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-24T19:42:51.855485] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-24T19:42:51.857458] [DEBUG] [LOCAL ] KT: Trimmed 66807 records to 45678 (keeping 200 days of data) [2025-09-24T19:42:52.047985] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-24T19:42:52.142347] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:42:52.206313] [DEBUG] [LOCAL ] KT: Primary data saved (45678 records). [2025-09-24T19:42:52.206472] [INFO ] [MAIN ] KT: Full history saved. [2025-09-24T19:42:52.206563] [INFO ] [MAIN ] Update Progress: 1227/2373 symbols completed. KT took 31.4s. Estimated remaining: 2h 32m 4s. Rate: 7.5 symbols/min [2025-09-24T19:42:52.377450] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:52.377697] [DEBUG] [LOCAL ] KVUE: No existing data file found in primary storage. [2025-09-24T19:42:52.377757] [WARN ] [MAIN ] KVUE: No existing data found, performing full refresh instead. [2025-09-24T19:42:52.377900] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-24T19:42:52.377943] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-24T19:42:52.377985] [DEBUG] [LOCAL ] KVUE: No primary data file found to delete. [2025-09-24T19:42:52.378017] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-24T19:42:52.736918] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:52.816049] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-24T19:42:52.890942] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T19:42:53.616161] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-24T19:42:54.237239] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T19:42:54.252266] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T19:42:54.257819] [INFO ] [REMOTE ] KTB: Full fetch complete (57463 records). [2025-09-24T19:42:54.258150] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-24T19:42:54.421256] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-24T19:42:54.675838] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-24T19:42:54.675941] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-24T19:42:54.676954] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-24T19:42:54.677021] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-24T19:42:54.678448] [DEBUG] [LOCAL ] KTB: Trimmed 57463 records to 41077 (keeping 200 days of data) [2025-09-24T19:42:54.941138] [DEBUG] [LOCAL ] KTB: Primary data saved (41077 records). [2025-09-24T19:42:54.941301] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-24T19:42:54.941395] [INFO ] [MAIN ] Update Progress: 1228/2373 symbols completed. KTB took 26.7s. Estimated remaining: 2h 31m 51s. Rate: 7.5 symbols/min [2025-09-24T19:42:55.112841] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:42:55.159801] [DEBUG] [LOCAL ] KVYO: Loaded 49905 existing records from primary storage. [2025-09-24T19:42:55.159984] [INFO ] [MAIN ] KVYO: Loaded 49905 existing records. [2025-09-24T19:42:55.221825] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-24T19:42:55.298793] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T19:42:55.357711] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:42:55.357975] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-24T19:42:55.358028] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-24T19:42:55.359139] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-24T19:42:55.359201] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-24T19:42:55.716681] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:42:56.016101] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-24T19:42:56.816072] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-24T19:42:57.139397] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T19:42:57.616081] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-24T19:42:57.692369] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T19:42:57.781202] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T19:42:58.416087] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-24T19:42:58.640374] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T19:42:59.216158] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-24T19:42:59.832211] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:43:00.016056] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-24T19:43:00.677480] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T19:43:00.816082] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-24T19:43:01.621161] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-24T19:43:01.639966] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T19:43:02.163702] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T19:43:02.416057] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-24T19:43:02.481693] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T19:43:03.216121] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-24T19:43:03.662312] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T19:43:04.016071] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-24T19:43:04.123580] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T19:43:04.816090] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-24T19:43:05.616103] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-24T19:43:05.937063] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T19:43:06.083382] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T19:43:06.146546] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T19:43:06.416089] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-24T19:43:07.216096] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-24T19:43:07.823481] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:43:08.016095] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-24T19:43:08.180751] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T19:43:08.816118] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-24T19:43:08.977250] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T19:43:09.616090] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-24T19:43:10.066806] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T19:43:10.416115] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-24T19:43:10.455908] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:43:10.860603] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T19:43:11.216114] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-24T19:43:12.016092] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-24T19:43:12.816200] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-24T19:43:13.037582] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T19:43:13.526893] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T19:43:13.562595] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T19:43:13.616101] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-24T19:43:14.416138] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-24T19:43:15.216077] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-24T19:43:15.459560] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T19:43:15.468298] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T19:43:15.825909] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T19:43:16.016153] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-24T19:43:16.816105] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-24T19:43:16.881117] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T19:43:16.884057] [INFO ] [REMOTE ] KTF: Full fetch complete (18316 records). [2025-09-24T19:43:16.884202] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-24T19:43:17.298462] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-24T19:43:17.298587] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-24T19:43:17.299311] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-24T19:43:17.299385] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-24T19:43:17.300287] [DEBUG] [LOCAL ] KTF: Trimmed 18316 records to 12966 (keeping 200 days of data) [2025-09-24T19:43:17.399265] [DEBUG] [LOCAL ] KTF: Primary data saved (12966 records). [2025-09-24T19:43:17.399506] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-24T19:43:17.399635] [INFO ] [MAIN ] Update Progress: 1229/2373 symbols completed. KTF took 38.9s. Estimated remaining: 2h 31m 56s. Rate: 7.5 symbols/min [2025-09-24T19:43:17.606975] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T19:43:17.611753] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:17.615128] [INFO ] [REMOTE ] KUKE: Full fetch complete (7900 records). [2025-09-24T19:43:17.615267] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-24T19:43:17.627229] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-24T19:43:17.819687] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T19:43:17.820085] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:43:17.820157] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:43:17.820208] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-24T19:43:17.820269] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-24T19:43:17.820315] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-24T19:43:17.820372] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-24T19:43:17.820461] [INFO ] [MAIN ] Update Progress: 1230/2373 symbols completed. KUKE took 30.2s. Estimated remaining: 2h 31m 41s. Rate: 7.5 symbols/min [2025-09-24T19:43:17.950167] [DEBUG] [LOCAL ] KW: Loaded 40660 existing records from primary storage. [2025-09-24T19:43:17.960783] [INFO ] [MAIN ] KW: Loaded 40660 existing records. [2025-09-24T19:43:18.118298] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:18.225780] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:18.226163] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-24T19:43:18.226342] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-24T19:43:18.232779] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-24T19:43:18.234137] [DEBUG] [LOCAL ] KWR: Loaded 16787 existing records from primary storage. [2025-09-24T19:43:18.234233] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-24T19:43:18.234336] [INFO ] [MAIN ] KWR: Loaded 16787 existing records. [2025-09-24T19:43:18.417093] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-24T19:43:18.606677] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:18.695964] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-24T19:43:18.707052] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-24T19:43:18.713026] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-24T19:43:18.733635] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-24T19:43:18.899760] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:19.177611] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:19.216120] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-24T19:43:19.394522] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T19:43:20.016054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-24T19:43:20.293865] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T19:43:20.327208] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T19:43:20.737000] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T19:43:20.816044] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-24T19:43:21.616093] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-24T19:43:21.861774] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T19:43:22.416101] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-24T19:43:23.216086] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-24T19:43:23.572540] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T19:43:23.595724] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T19:43:24.016115] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-24T19:43:24.816115] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-24T19:43:25.099246] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:43:25.109808] [INFO ] [REMOTE ] KVYO: Full fetch complete (71425 records). [2025-09-24T19:43:25.109979] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-24T19:43:25.329907] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T19:43:25.576046] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-24T19:43:25.576157] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-24T19:43:25.577360] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-24T19:43:25.577443] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-24T19:43:25.579131] [DEBUG] [LOCAL ] KVYO: Trimmed 71425 records to 49916 (keeping 200 days of data) [2025-09-24T19:43:25.637995] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-24T19:43:25.924671] [DEBUG] [LOCAL ] KVYO: Primary data saved (49916 records). [2025-09-24T19:43:25.924949] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-24T19:43:25.925234] [INFO ] [MAIN ] Update Progress: 1231/2373 symbols completed. KVYO took 31.0s. Estimated remaining: 2h 31m 34s. Rate: 7.5 symbols/min [2025-09-24T19:43:26.106810] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:26.143303] [DEBUG] [LOCAL ] KYN: Loaded 30159 existing records from primary storage. [2025-09-24T19:43:26.143450] [INFO ] [MAIN ] KYN: Loaded 30159 existing records. [2025-09-24T19:43:26.334289] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:26.334994] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-24T19:43:26.335129] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-24T19:43:26.336406] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-24T19:43:26.336628] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-24T19:43:26.422186] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-24T19:43:26.734118] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:26.780420] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T19:43:26.792621] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T19:43:27.216104] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-24T19:43:27.574597] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T19:43:28.016122] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-24T19:43:28.474182] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T19:43:28.816146] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-24T19:43:29.505565] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T19:43:29.616067] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-24T19:43:29.735173] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T19:43:30.416088] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-24T19:43:31.122448] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:43:31.216097] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-24T19:43:31.507782] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:43:32.016130] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-24T19:43:32.553908] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T19:43:32.816101] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-24T19:43:33.616083] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-24T19:43:33.928952] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T19:43:34.093520] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-24T19:43:34.107822] [INFO ] [REMOTE ] KVUE: Full fetch complete (77671 records). [2025-09-24T19:43:34.108029] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-24T19:43:34.421167] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-24T19:43:34.531182] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-24T19:43:34.531277] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-24T19:43:34.532511] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-24T19:43:34.532766] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-24T19:43:34.536035] [DEBUG] [LOCAL ] KVUE: Trimmed 77671 records to 53667 (keeping 200 days of data) [2025-09-24T19:43:34.898519] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-24T19:43:34.898701] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-24T19:43:34.898894] [INFO ] [MAIN ] Update Progress: 1232/2373 symbols completed. KVUE took 42.7s. Estimated remaining: 2h 31m 27s. Rate: 7.5 symbols/min [2025-09-24T19:43:35.080621] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:35.109304] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T19:43:35.153958] [DEBUG] [LOCAL ] L: Loaded 40938 existing records from primary storage. [2025-09-24T19:43:35.154113] [INFO ] [MAIN ] L: Loaded 40938 existing records. [2025-09-24T19:43:35.219137] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-24T19:43:35.350122] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:35.350818] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-24T19:43:35.351034] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-24T19:43:35.363065] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-24T19:43:35.363355] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-24T19:43:35.369839] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T19:43:35.737600] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:36.016087] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-24T19:43:36.733151] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T19:43:36.783815] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T19:43:36.816032] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-24T19:43:37.616122] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-24T19:43:37.769537] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T19:43:37.772417] [INFO ] [REMOTE ] KWR: Full fetch complete (23996 records). [2025-09-24T19:43:37.772503] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-24T19:43:38.205063] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-24T19:43:38.205146] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-24T19:43:38.205674] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-24T19:43:38.205737] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-24T19:43:38.207603] [DEBUG] [LOCAL ] KWR: Trimmed 23996 records to 16760 (keeping 200 days of data) [2025-09-24T19:43:38.325567] [DEBUG] [LOCAL ] KWR: Primary data saved (16760 records). [2025-09-24T19:43:38.325756] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-24T19:43:38.325873] [INFO ] [MAIN ] Update Progress: 1233/2373 symbols completed. KWR took 20.5s. Estimated remaining: 2h 31m 14s. Rate: 7.5 symbols/min [2025-09-24T19:43:38.424472] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-24T19:43:38.524257] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:38.594320] [DEBUG] [LOCAL ] LAC: Loaded 52304 existing records from primary storage. [2025-09-24T19:43:38.594482] [INFO ] [MAIN ] LAC: Loaded 52304 existing records. [2025-09-24T19:43:38.795317] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:38.795869] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-24T19:43:38.795929] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-24T19:43:38.797219] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-24T19:43:38.797283] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-24T19:43:39.132269] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T19:43:39.232105] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-24T19:43:39.253020] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:39.910704] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T19:43:40.016084] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-24T19:43:40.776516] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T19:43:40.783875] [INFO ] [REMOTE ] KW: Full fetch complete (56911 records). [2025-09-24T19:43:40.784022] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-24T19:43:40.821347] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-24T19:43:41.184522] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-24T19:43:41.184987] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-24T19:43:41.185889] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-24T19:43:41.185953] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-24T19:43:41.187577] [DEBUG] [LOCAL ] KW: Trimmed 56911 records to 40700 (keeping 200 days of data) [2025-09-24T19:43:41.323493] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T19:43:41.477945] [DEBUG] [LOCAL ] KW: Primary data saved (40700 records). [2025-09-24T19:43:41.478083] [INFO ] [MAIN ] KW: Full history saved. [2025-09-24T19:43:41.478170] [INFO ] [MAIN ] Update Progress: 1234/2373 symbols completed. KW took 24.1s. Estimated remaining: 2h 31m 2s. Rate: 7.5 symbols/min [2025-09-24T19:43:41.620030] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-24T19:43:41.651987] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:43:41.678112] [DEBUG] [LOCAL ] LAD: Loaded 23712 existing records from primary storage. [2025-09-24T19:43:41.678254] [INFO ] [MAIN ] LAD: Loaded 23712 existing records. [2025-09-24T19:43:41.855050] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:43:41.855351] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-24T19:43:41.855400] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-24T19:43:41.856329] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-24T19:43:41.856405] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-24T19:43:42.210354] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:43:42.416079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-24T19:43:42.859239] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:43:42.945161] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-24T19:43:43.216144] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-24T19:43:43.946490] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T19:43:44.016080] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-24T19:43:44.816060] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-24T19:43:45.071667] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T19:43:45.330486] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T19:43:45.616084] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-24T19:43:46.131532] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T19:43:46.416083] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-24T19:43:47.130048] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T19:43:47.216097] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-24T19:43:48.011911] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T19:43:48.020374] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-24T19:43:48.646096] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T19:43:48.816081] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-24T19:43:49.101805] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T19:43:49.616085] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-24T19:43:50.115178] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T19:43:50.416090] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-24T19:43:50.578085] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T19:43:51.216094] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-24T19:43:51.970422] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T19:43:52.016084] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-24T19:43:52.563093] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T19:43:52.816121] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-24T19:43:53.304006] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T19:43:53.616098] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-24T19:43:53.997226] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T19:43:54.416116] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-24T19:43:55.063209] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T19:43:55.216072] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-24T19:43:55.767560] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T19:43:56.016147] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-24T19:43:56.816180] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-24T19:43:56.868769] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T19:43:57.012068] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T19:43:57.616175] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-24T19:43:58.092020] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T19:43:58.416166] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-24T19:43:59.216139] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-24T19:43:59.271198] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:43:59.713002] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T19:44:00.016159] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-24T19:44:00.816163] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-24T19:44:01.299634] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T19:44:01.420791] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T19:44:01.427195] [INFO ] [REMOTE ] KYN: Full fetch complete (44831 records). [2025-09-24T19:44:01.427384] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-24T19:44:01.623829] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-24T19:44:01.866530] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-24T19:44:01.866776] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-24T19:44:01.867822] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-24T19:44:01.867916] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-24T19:44:01.869594] [DEBUG] [LOCAL ] KYN: Trimmed 44831 records to 30081 (keeping 200 days of data) [2025-09-24T19:44:01.980442] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T19:44:02.094070] [DEBUG] [LOCAL ] KYN: Primary data saved (30081 records). [2025-09-24T19:44:02.094239] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-24T19:44:02.094362] [INFO ] [MAIN ] Update Progress: 1235/2373 symbols completed. KYN took 36.2s. Estimated remaining: 2h 31m 6s. Rate: 7.5 symbols/min [2025-09-24T19:44:02.274329] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:02.327517] [DEBUG] [LOCAL ] LADR: Loaded 38692 existing records from primary storage. [2025-09-24T19:44:02.327729] [INFO ] [MAIN ] LADR: Loaded 38692 existing records. [2025-09-24T19:44:02.421207] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-24T19:44:02.549386] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:02.549697] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-24T19:44:02.549758] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-24T19:44:02.550715] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-24T19:44:02.550776] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-24T19:44:02.915309] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:03.216142] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-24T19:44:03.360884] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:44:03.369594] [INFO ] [REMOTE ] L: Full fetch complete (59530 records). [2025-09-24T19:44:03.369877] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-24T19:44:03.803830] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-24T19:44:03.803986] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-24T19:44:03.805421] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-24T19:44:03.805490] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-24T19:44:03.807518] [DEBUG] [LOCAL ] L: Trimmed 59530 records to 40956 (keeping 200 days of data) [2025-09-24T19:44:04.019735] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-24T19:44:04.097420] [DEBUG] [LOCAL ] L: Primary data saved (40956 records). [2025-09-24T19:44:04.097613] [INFO ] [MAIN ] L: Full history saved. [2025-09-24T19:44:04.097752] [INFO ] [MAIN ] Update Progress: 1236/2373 symbols completed. L took 29.2s. Estimated remaining: 2h 30m 52s. Rate: 7.5 symbols/min [2025-09-24T19:44:04.281009] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:04.286463] [DEBUG] [LOCAL ] LANV: Loaded 2730 existing records from primary storage. [2025-09-24T19:44:04.286671] [INFO ] [MAIN ] LANV: Loaded 2730 existing records. [2025-09-24T19:44:04.483507] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:04.484269] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-24T19:44:04.484572] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-24T19:44:04.485053] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-24T19:44:04.485339] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-24T19:44:04.635611] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-24T19:44:04.839748] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-24T19:44:04.861430] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:44:04.979863] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:05.111746] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T19:44:05.616174] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-24T19:44:06.416143] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-24T19:44:06.699236] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T19:44:06.984527] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:44:07.088511] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T19:44:07.216134] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-24T19:44:08.016086] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-24T19:44:08.816154] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-24T19:44:09.334010] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T19:44:09.409158] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T19:44:09.616116] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-24T19:44:09.998153] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T19:44:10.074557] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-24T19:44:10.416153] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-24T19:44:11.216103] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-24T19:44:12.016091] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-24T19:44:12.419084] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T19:44:12.454478] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T19:44:12.457925] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T19:44:12.816142] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-24T19:44:13.295196] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T19:44:13.616120] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-24T19:44:14.084135] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-24T19:44:14.416088] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-24T19:44:14.861966] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T19:44:15.216098] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-24T19:44:15.724910] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T19:44:16.016111] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-24T19:44:16.816094] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-24T19:44:17.220524] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T19:44:17.616068] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-24T19:44:17.666287] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T19:44:18.080370] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-24T19:44:18.416107] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-24T19:44:18.794312] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-24T19:44:19.216185] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-24T19:44:20.016133] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-24T19:44:20.682579] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T19:44:20.816152] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-24T19:44:21.616193] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-24T19:44:21.947880] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:44:22.359788] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T19:44:22.370085] [INFO ] [REMOTE ] LAC: Full fetch complete (75968 records). [2025-09-24T19:44:22.370247] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-24T19:44:22.421387] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-24T19:44:22.848990] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T19:44:22.853698] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-24T19:44:22.862252] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-24T19:44:22.863941] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-24T19:44:22.864059] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-24T19:44:22.866551] [DEBUG] [LOCAL ] LAC: Trimmed 75968 records to 52311 (keeping 200 days of data) [2025-09-24T19:44:23.191202] [DEBUG] [LOCAL ] LAC: Primary data saved (52311 records). [2025-09-24T19:44:23.191387] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-24T19:44:23.191486] [INFO ] [MAIN ] Update Progress: 1237/2373 symbols completed. LAC took 44.9s. Estimated remaining: 2h 30m 54s. Rate: 7.5 symbols/min [2025-09-24T19:44:23.216105] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-24T19:44:23.403772] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T19:44:23.407871] [INFO ] [REMOTE ] LAD: Full fetch complete (35201 records). [2025-09-24T19:44:23.407955] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-24T19:44:23.857132] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T19:44:23.871973] [INFO ] [REMOTE ] LANV: Full fetch complete (4431 records). [2025-09-24T19:44:23.873995] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-24T19:44:23.906207] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-24T19:44:23.939593] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-24T19:44:23.940571] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-24T19:44:23.946320] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-24T19:44:23.985087] [DEBUG] [LOCAL ] LAD: Trimmed 35201 records to 23631 (keeping 200 days of data) [2025-09-24T19:44:24.020214] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-24T19:44:24.358688] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-24T19:44:24.359291] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-24T19:44:24.359884] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-24T19:44:24.359971] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-24T19:44:24.361381] [DEBUG] [LOCAL ] LANV: Trimmed 4431 records to 2781 (keeping 200 days of data) [2025-09-24T19:44:24.386526] [DEBUG] [LOCAL ] LANV: Primary data saved (2781 records). [2025-09-24T19:44:24.386950] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-24T19:44:24.388204] [INFO ] [MAIN ] Update Progress: 1238/2373 symbols completed. LANV took 20.3s. Estimated remaining: 2h 30m 40s. Rate: 7.5 symbols/min [2025-09-24T19:44:24.431837] [DEBUG] [LOCAL ] LAD: Primary data saved (23631 records). [2025-09-24T19:44:24.432039] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-24T19:44:24.432154] [INFO ] [MAIN ] Update Progress: 1239/2373 symbols completed. LAD took 43.0s. Estimated remaining: 2h 30m 25s. Rate: 7.5 symbols/min [2025-09-24T19:44:25.548152] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:44:25.558028] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-24T19:44:27.012163] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:44:27.021060] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-24T19:44:28.579904] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T19:44:28.591803] [INFO ] [REMOTE ] LADR: Full fetch complete (55036 records). [2025-09-24T19:44:28.592132] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-24T19:44:29.115904] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-24T19:44:29.116107] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-24T19:44:29.117769] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-24T19:44:29.117852] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-24T19:44:29.120271] [DEBUG] [LOCAL ] LADR: Trimmed 55036 records to 38668 (keeping 200 days of data) [2025-09-24T19:44:29.388374] [DEBUG] [LOCAL ] LADR: Primary data saved (38668 records). [2025-09-24T19:44:29.388637] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-24T19:44:29.388816] [INFO ] [MAIN ] Update Progress: 1240/2373 symbols completed. LADR took 27.3s. Estimated remaining: 2h 30m 14s. Rate: 7.5 symbols/min [2025-09-24T19:44:30.006006] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:30.170618] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:30.200026] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:30.174635] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-24T19:44:30.223026] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:30.223386] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-24T19:44:30.225571] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-24T19:44:30.225777] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-24T19:44:30.226149] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-24T19:44:30.226210] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-24T19:44:30.367160] [DEBUG] [LOCAL ] LAW: Loaded 13871 existing records from primary storage. [2025-09-24T19:44:30.378099] [INFO ] [MAIN ] LAW: Loaded 13871 existing records. [2025-09-24T19:44:30.701408] [DEBUG] [LOCAL ] LAZ: Loaded 45286 existing records from primary storage. [2025-09-24T19:44:30.708134] [DEBUG] [LOCAL ] LB: Loaded 37675 existing records from primary storage. [2025-09-24T19:44:30.735211] [INFO ] [MAIN ] LAZ: Loaded 45286 existing records. [2025-09-24T19:44:30.784604] [INFO ] [MAIN ] LB: Loaded 37675 existing records. [2025-09-24T19:44:30.981865] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:31.142725] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:31.171297] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-24T19:44:31.175460] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-24T19:44:31.191692] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-24T19:44:31.208316] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-24T19:44:31.274028] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-24T19:44:31.306726] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:31.395850] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-24T19:44:31.390097] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:31.412448] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-24T19:44:31.439117] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-24T19:44:31.433818] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-24T19:44:31.459768] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-24T19:44:31.459849] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-24T19:44:31.536853] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-24T19:44:31.599688] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-24T19:44:31.589446] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:44:31.643902] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-24T19:44:31.765936] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-24T19:44:32.330584] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:32.359826] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-24T19:44:32.490545] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:32.502101] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-24T19:44:32.573440] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:32.573787] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-24T19:44:32.795035] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T19:44:32.798317] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-24T19:44:33.221507] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T19:44:33.225773] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-24T19:44:33.994954] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T19:44:34.004842] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-24T19:44:34.079174] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T19:44:34.088867] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-24T19:44:34.117309] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T19:44:34.126292] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-24T19:44:34.138322] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T19:44:34.416188] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-24T19:44:35.116889] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T19:44:35.216146] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-24T19:44:35.640000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T19:44:35.743916] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T19:44:35.788374] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T19:44:35.807977] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:44:36.016098] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-24T19:44:36.816116] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-24T19:44:37.510583] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:44:37.616077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-24T19:44:38.421208] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-24T19:44:38.435173] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T19:44:39.216118] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-24T19:44:39.250697] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T19:44:39.323935] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T19:44:40.016092] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-24T19:44:40.816058] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-24T19:44:40.897815] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T19:44:41.616114] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-24T19:44:41.660450] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T19:44:42.284468] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T19:44:42.416077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-24T19:44:43.148039] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:44:43.216043] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-24T19:44:43.835443] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T19:44:44.016083] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-24T19:44:44.667078] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T19:44:44.816115] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-24T19:44:45.616058] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-24T19:44:45.706789] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T19:44:45.707330] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T19:44:46.416138] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-24T19:44:47.180884] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T19:44:47.220677] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-24T19:44:47.228865] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T19:44:48.016119] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-24T19:44:48.728795] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T19:44:48.762412] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T19:44:48.816035] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-24T19:44:49.616096] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-24T19:44:49.735208] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T19:44:50.416148] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-24T19:44:51.046898] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:44:51.216140] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-24T19:44:52.002485] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T19:44:52.016029] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-24T19:44:52.416996] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:44:52.816101] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-24T19:44:53.431135] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T19:44:53.616109] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-24T19:44:54.255437] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T19:44:54.416128] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-24T19:44:55.015853] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T19:44:55.216142] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-24T19:44:55.871785] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T19:44:55.878615] [INFO ] [REMOTE ] LB: Full fetch complete (56116 records). [2025-09-24T19:44:55.878819] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-24T19:44:56.021319] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-24T19:44:56.335689] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T19:44:56.339861] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-24T19:44:56.340184] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-24T19:44:56.341579] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-24T19:44:56.340315] [INFO ] [REMOTE ] LAW: Full fetch complete (20769 records). [2025-09-24T19:44:56.341818] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-24T19:44:56.341943] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-24T19:44:56.447621] [DEBUG] [LOCAL ] LB: Trimmed 56116 records to 37678 (keeping 200 days of data) [2025-09-24T19:44:56.818077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-24T19:44:56.850610] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-24T19:44:56.858435] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-24T19:44:56.859850] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-24T19:44:56.860177] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-24T19:44:56.866985] [DEBUG] [LOCAL ] LAW: Trimmed 20769 records to 13939 (keeping 200 days of data) [2025-09-24T19:44:57.042080] [DEBUG] [LOCAL ] LAW: Primary data saved (13939 records). [2025-09-24T19:44:57.042817] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-24T19:44:57.042955] [INFO ] [MAIN ] Update Progress: 1241/2373 symbols completed. LAW took 27.7s. Estimated remaining: 2h 30m 24s. Rate: 7.5 symbols/min [2025-09-24T19:44:57.217779] [DEBUG] [LOCAL ] LB: Primary data saved (37678 records). [2025-09-24T19:44:57.240401] [INFO ] [MAIN ] LB: Full history saved. [2025-09-24T19:44:57.240294] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:57.240680] [INFO ] [MAIN ] Update Progress: 1242/2373 symbols completed. LB took 27.8s. Estimated remaining: 2h 30m 9s. Rate: 7.5 symbols/min [2025-09-24T19:44:57.429395] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:57.477770] [DEBUG] [LOCAL ] LBRT: Loaded 52920 existing records from primary storage. [2025-09-24T19:44:57.478042] [INFO ] [MAIN ] LBRT: Loaded 52920 existing records. [2025-09-24T19:44:57.667666] [DEBUG] [LOCAL ] LC: Loaded 47948 existing records from primary storage. [2025-09-24T19:44:57.667936] [INFO ] [MAIN ] LC: Loaded 47948 existing records. [2025-09-24T19:44:57.774044] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:57.828307] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-24T19:44:57.834416] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-24T19:44:57.887385] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-24T19:44:57.917520] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-24T19:44:57.917729] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:57.930613] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-24T19:44:57.940698] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-24T19:44:57.960677] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-24T19:44:57.965939] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-24T19:44:58.122359] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T19:44:58.180078] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-24T19:44:58.675855] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:58.695122] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-24T19:44:58.738913] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:44:58.762096] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T19:44:58.769986] [INFO ] [REMOTE ] LAZ: Full fetch complete (65864 records). [2025-09-24T19:44:58.770111] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-24T19:44:59.157453] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-24T19:44:59.157542] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-24T19:44:59.158500] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-24T19:44:59.158565] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-24T19:44:59.159956] [DEBUG] [LOCAL ] LAZ: Trimmed 65864 records to 45202 (keeping 200 days of data) [2025-09-24T19:44:59.222092] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-24T19:44:59.444478] [DEBUG] [LOCAL ] LAZ: Primary data saved (45202 records). [2025-09-24T19:44:59.444632] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-24T19:44:59.444784] [INFO ] [MAIN ] Update Progress: 1243/2373 symbols completed. LAZ took 30.1s. Estimated remaining: 2h 29m 56s. Rate: 7.5 symbols/min [2025-09-24T19:44:59.616517] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:44:59.650473] [DEBUG] [LOCAL ] LCII: Loaded 28651 existing records from primary storage. [2025-09-24T19:44:59.650634] [INFO ] [MAIN ] LCII: Loaded 28651 existing records. [2025-09-24T19:44:59.830244] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:44:59.830490] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-24T19:44:59.830538] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-24T19:44:59.831408] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-24T19:44:59.831469] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-24T19:45:00.220874] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:00.221610] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-24T19:45:00.224346] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T19:45:00.233667] [INFO ] [REMOTE ] LAR: Full fetch complete (54770 records). [2025-09-24T19:45:00.233798] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-24T19:45:00.439179] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-24T19:45:00.439919] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:45:00.440121] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:45:00.440207] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-24T19:45:00.440384] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-24T19:45:00.440457] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-24T19:45:00.440527] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-24T19:45:00.440619] [INFO ] [MAIN ] Update Progress: 1244/2373 symbols completed. LAR took 31.1s. Estimated remaining: 2h 29m 42s. Rate: 7.5 symbols/min [2025-09-24T19:45:00.651897] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:45:00.649765] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:00.707449] [DEBUG] [LOCAL ] LDI: Loaded 43871 existing records from primary storage. [2025-09-24T19:45:00.707598] [INFO ] [MAIN ] LDI: Loaded 43871 existing records. [2025-09-24T19:45:00.820180] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-24T19:45:00.900766] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:00.901236] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-24T19:45:00.901346] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-24T19:45:00.911192] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-24T19:45:00.927237] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-24T19:45:01.002354] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T19:45:01.352137] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:01.366865] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T19:45:01.616096] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-24T19:45:02.416101] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-24T19:45:03.216103] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-24T19:45:03.943219] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (3.12 seconds). [2025-09-24T19:45:04.016083] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-24T19:45:05.249083] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T19:45:05.254485] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-24T19:45:05.367868] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-24T19:45:05.583378] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (3.97 seconds). [2025-09-24T19:45:05.616028] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-24T19:45:06.286301] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-24T19:45:06.353396] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T19:45:06.416077] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-24T19:45:06.957675] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T19:45:07.216095] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-24T19:45:07.557926] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T19:45:08.016106] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-24T19:45:08.687708] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T19:45:08.816159] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-24T19:45:09.334189] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T19:45:09.616128] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-24T19:45:10.416157] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-24T19:45:10.685922] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T19:45:11.136377] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T19:45:11.216036] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-24T19:45:12.016103] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-24T19:45:12.100608] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T19:45:12.735129] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:45:12.816159] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-24T19:45:13.523414] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:45:13.616074] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-24T19:45:14.416126] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-24T19:45:14.545076] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:45:15.216139] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-24T19:45:15.787452] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-24T19:45:16.016124] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-24T19:45:16.816113] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-24T19:45:17.171614] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-24T19:45:17.244298] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-24T19:45:17.503369] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:45:17.616104] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-24T19:45:18.297921] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T19:45:18.416103] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-24T19:45:19.201626] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:45:19.216034] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-24T19:45:20.023638] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-24T19:45:20.044893] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:45:20.721770] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T19:45:20.816224] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-24T19:45:21.616152] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-24T19:45:21.893453] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:45:22.079545] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T19:45:22.416139] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-24T19:45:22.933135] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T19:45:23.216142] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-24T19:45:24.016124] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-24T19:45:24.571019] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-24T19:45:24.581713] [INFO ] [REMOTE ] LDI: Full fetch complete (60132 records). [2025-09-24T19:45:24.581929] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-24T19:45:24.818573] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-24T19:45:24.997523] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-24T19:45:24.997747] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-24T19:45:24.998976] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-24T19:45:24.999166] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-24T19:45:25.001961] [DEBUG] [LOCAL ] LDI: Trimmed 60132 records to 44007 (keeping 200 days of data) [2025-09-24T19:45:25.136940] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T19:45:25.337545] [DEBUG] [LOCAL ] LDI: Primary data saved (44007 records). [2025-09-24T19:45:25.337730] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-24T19:45:25.337851] [INFO ] [MAIN ] Update Progress: 1245/2373 symbols completed. LDI took 24.9s. Estimated remaining: 2h 29m 49s. Rate: 7.5 symbols/min [2025-09-24T19:45:25.506778] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:25.553400] [DEBUG] [LOCAL ] LDOS: Loaded 45814 existing records from primary storage. [2025-09-24T19:45:25.553579] [INFO ] [MAIN ] LDOS: Loaded 45814 existing records. [2025-09-24T19:45:25.637693] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-24T19:45:25.753437] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:25.753896] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-24T19:45:25.753952] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-24T19:45:25.757378] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-24T19:45:25.757452] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-24T19:45:26.089073] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-24T19:45:26.185029] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T19:45:26.236826] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:26.416073] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-24T19:45:27.216106] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-24T19:45:27.431048] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T19:45:27.497497] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T19:45:28.016085] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-24T19:45:28.816137] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-24T19:45:28.964545] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T19:45:28.977708] [INFO ] [REMOTE ] LBRT: Full fetch complete (76511 records). [2025-09-24T19:45:28.977936] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-24T19:45:29.441817] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T19:45:29.475241] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-24T19:45:29.475464] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-24T19:45:29.476626] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-24T19:45:29.477110] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-24T19:45:29.478620] [DEBUG] [LOCAL ] LBRT: Trimmed 76511 records to 52919 (keeping 200 days of data) [2025-09-24T19:45:29.616213] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-24T19:45:29.834008] [DEBUG] [LOCAL ] LBRT: Primary data saved (52919 records). [2025-09-24T19:45:29.834230] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-24T19:45:29.834327] [INFO ] [MAIN ] Update Progress: 1246/2373 symbols completed. LBRT took 32.8s. Estimated remaining: 2h 29m 38s. Rate: 7.5 symbols/min [2025-09-24T19:45:30.019541] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:30.035805] [DEBUG] [LOCAL ] LDP: Loaded 12995 existing records from primary storage. [2025-09-24T19:45:30.035923] [INFO ] [MAIN ] LDP: Loaded 12995 existing records. [2025-09-24T19:45:30.219894] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:30.220548] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-24T19:45:30.220670] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-24T19:45:30.221362] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-24T19:45:30.221581] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-24T19:45:30.347572] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T19:45:30.400545] [INFO ] [REMOTE ] LC: Full fetch complete (70338 records). [2025-09-24T19:45:30.413282] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-24T19:45:30.417017] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-24T19:45:30.769582] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:30.957172] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T19:45:31.005104] [INFO ] [REMOTE ] LCII: Full fetch complete (39025 records). [2025-09-24T19:45:31.022131] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-24T19:45:31.043699] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-24T19:45:31.043800] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-24T19:45:31.044950] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-24T19:45:31.045016] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-24T19:45:31.156226] [DEBUG] [LOCAL ] LC: Trimmed 70338 records to 47900 (keeping 200 days of data) [2025-09-24T19:45:31.261914] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-24T19:45:31.559871] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-24T19:45:31.560287] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-24T19:45:31.561461] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-24T19:45:31.561816] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-24T19:45:31.565367] [DEBUG] [LOCAL ] LCII: Trimmed 39025 records to 28619 (keeping 200 days of data) [2025-09-24T19:45:31.957067] [DEBUG] [LOCAL ] LC: Primary data saved (47900 records). [2025-09-24T19:45:31.957394] [INFO ] [MAIN ] LC: Full history saved. [2025-09-24T19:45:31.957996] [INFO ] [MAIN ] Update Progress: 1247/2373 symbols completed. LC took 34.7s. Estimated remaining: 2h 29m 25s. Rate: 7.5 symbols/min [2025-09-24T19:45:32.039600] [DEBUG] [LOCAL ] LCII: Primary data saved (28619 records). [2025-09-24T19:45:32.051628] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-24T19:45:32.068671] [INFO ] [MAIN ] Update Progress: 1248/2373 symbols completed. LCII took 32.6s. Estimated remaining: 2h 29m 10s. Rate: 7.5 symbols/min [2025-09-24T19:45:32.267551] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:32.371292] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:32.375182] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:45:32.392320] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-24T19:45:32.433367] [DEBUG] [LOCAL ] LEA: Loaded 41822 existing records from primary storage. [2025-09-24T19:45:32.433612] [INFO ] [MAIN ] LEA: Loaded 41822 existing records. [2025-09-24T19:45:32.671686] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:32.677956] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T19:45:32.680277] [DEBUG] [LOCAL ] LEG: Loaded 50396 existing records from primary storage. [2025-09-24T19:45:32.680545] [INFO ] [MAIN ] LEG: Loaded 50396 existing records. [2025-09-24T19:45:32.678065] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-24T19:45:32.685906] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-24T19:45:32.730106] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-24T19:45:32.737103] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-24T19:45:32.829772] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-24T19:45:33.042198] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:33.061320] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-24T19:45:33.079117] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-24T19:45:33.150342] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-24T19:45:33.172925] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-24T19:45:33.406166] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:33.618831] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-24T19:45:33.642505] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:33.824793] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:45:34.089560] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T19:45:34.416088] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-24T19:45:35.189392] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T19:45:35.216043] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-24T19:45:36.016126] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-24T19:45:36.344003] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T19:45:36.789790] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:45:36.816033] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-24T19:45:37.375420] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T19:45:37.616104] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-24T19:45:38.332885] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:45:38.416037] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-24T19:45:39.216069] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-24T19:45:39.327503] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T19:45:40.016080] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-24T19:45:40.060527] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:45:40.816138] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-24T19:45:40.898956] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T19:45:41.616063] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-24T19:45:41.733437] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T19:45:42.243851] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T19:45:42.416077] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-24T19:45:43.216108] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-24T19:45:43.251999] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T19:45:44.016139] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-24T19:45:44.121837] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T19:45:44.746536] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:45:44.816041] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-24T19:45:45.461712] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T19:45:45.616072] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-24T19:45:46.359277] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T19:45:46.416093] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-24T19:45:47.173408] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T19:45:47.216131] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-24T19:45:47.438427] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T19:45:47.773063] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T19:45:48.016132] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-24T19:45:48.816073] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-24T19:45:48.838805] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T19:45:49.616171] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-24T19:45:50.353092] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T19:45:50.416112] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-24T19:45:51.216065] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-24T19:45:51.297477] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T19:45:51.893464] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T19:45:52.016076] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-24T19:45:52.562403] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T19:45:52.816074] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-24T19:45:53.621337] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-24T19:45:53.643596] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T19:45:54.261101] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:45:54.416177] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-24T19:45:55.056916] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T19:45:55.216143] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-24T19:45:56.016109] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-24T19:45:56.093073] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T19:45:56.101831] [INFO ] [REMOTE ] LEA: Full fetch complete (60995 records). [2025-09-24T19:45:56.102021] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-24T19:45:56.511539] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-24T19:45:56.511683] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-24T19:45:56.512921] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-24T19:45:56.513011] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-24T19:45:56.515433] [DEBUG] [LOCAL ] LEA: Trimmed 60995 records to 41801 (keeping 200 days of data) [2025-09-24T19:45:56.788834] [DEBUG] [LOCAL ] LEA: Primary data saved (41801 records). [2025-09-24T19:45:56.788989] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-24T19:45:56.789091] [INFO ] [MAIN ] Update Progress: 1249/2373 symbols completed. LEA took 24.8s. Estimated remaining: 2h 29m 17s. Rate: 7.5 symbols/min [2025-09-24T19:45:56.826821] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-24T19:45:57.022687] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:57.036527] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T19:45:57.048382] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T19:45:57.112425] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-24T19:45:57.112589] [INFO ] [MAIN ] LEN: Loaded 53191 existing records. [2025-09-24T19:45:57.288797] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:57.289140] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-24T19:45:57.289216] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-24T19:45:57.291184] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-24T19:45:57.291258] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-24T19:45:57.623949] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-24T19:45:57.657193] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:45:58.381893] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T19:45:58.416082] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-24T19:45:58.554190] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T19:45:58.567205] [INFO ] [REMOTE ] LDOS: Full fetch complete (67732 records). [2025-09-24T19:45:58.567366] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-24T19:45:58.963188] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-24T19:45:58.963366] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-24T19:45:58.964470] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-24T19:45:58.964695] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-24T19:45:58.976603] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T19:45:58.980837] [DEBUG] [LOCAL ] LDOS: Trimmed 67732 records to 45746 (keeping 200 days of data) [2025-09-24T19:45:59.216321] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-24T19:45:59.296494] [DEBUG] [LOCAL ] LDOS: Primary data saved (45746 records). [2025-09-24T19:45:59.296703] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-24T19:45:59.296832] [INFO ] [MAIN ] Update Progress: 1250/2373 symbols completed. LDOS took 34.0s. Estimated remaining: 2h 29m 4s. Rate: 7.5 symbols/min [2025-09-24T19:45:59.467904] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:45:59.487198] [DEBUG] [LOCAL ] LEO: Loaded 17672 existing records from primary storage. [2025-09-24T19:45:59.487335] [INFO ] [MAIN ] LEO: Loaded 17672 existing records. [2025-09-24T19:45:59.663131] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:45:59.663383] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-24T19:45:59.663431] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-24T19:45:59.664296] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-24T19:45:59.664390] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-24T19:46:00.020159] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-24T19:46:00.024122] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:00.816054] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-24T19:46:00.934077] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:46:01.616141] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-24T19:46:01.795419] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:46:01.832566] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T19:46:02.416087] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-24T19:46:03.127302] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:46:03.216052] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-24T19:46:04.024292] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-24T19:46:04.048705] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:46:04.063826] [INFO ] [REMOTE ] LEG: Full fetch complete (73212 records). [2025-09-24T19:46:04.064087] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-24T19:46:04.474790] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-24T19:46:04.474878] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-24T19:46:04.475873] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-24T19:46:04.475937] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-24T19:46:04.477534] [DEBUG] [LOCAL ] LEG: Trimmed 73212 records to 50384 (keeping 200 days of data) [2025-09-24T19:46:04.816430] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-24T19:46:04.847170] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T19:46:04.871591] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T19:46:04.886889] [DEBUG] [LOCAL ] LEG: Primary data saved (50384 records). [2025-09-24T19:46:04.887083] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-24T19:46:04.887227] [INFO ] [MAIN ] Update Progress: 1251/2373 symbols completed. LEG took 32.8s. Estimated remaining: 2h 28m 54s. Rate: 7.5 symbols/min [2025-09-24T19:46:05.079392] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:05.137912] [DEBUG] [LOCAL ] LEVI: Loaded 51546 existing records from primary storage. [2025-09-24T19:46:05.138161] [INFO ] [MAIN ] LEVI: Loaded 51546 existing records. [2025-09-24T19:46:05.326994] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:05.327275] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-24T19:46:05.327325] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-24T19:46:05.328738] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-24T19:46:05.328799] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-24T19:46:05.621212] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-24T19:46:05.694803] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:05.816222] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T19:46:06.416106] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-24T19:46:06.662188] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T19:46:06.664880] [INFO ] [REMOTE ] LDP: Full fetch complete (19438 records). [2025-09-24T19:46:06.664956] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-24T19:46:07.026140] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-24T19:46:07.026222] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-24T19:46:07.026675] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-24T19:46:07.026737] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-24T19:46:07.027285] [DEBUG] [LOCAL ] LDP: Trimmed 19438 records to 12957 (keeping 200 days of data) [2025-09-24T19:46:07.117730] [DEBUG] [LOCAL ] LDP: Primary data saved (12957 records). [2025-09-24T19:46:07.117970] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-24T19:46:07.118113] [INFO ] [MAIN ] Update Progress: 1252/2373 symbols completed. LDP took 37.3s. Estimated remaining: 2h 28m 41s. Rate: 7.5 symbols/min [2025-09-24T19:46:07.221339] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-24T19:46:07.299721] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:07.325083] [DEBUG] [LOCAL ] LFT: Loaded 18057 existing records from primary storage. [2025-09-24T19:46:07.325345] [INFO ] [MAIN ] LFT: Loaded 18057 existing records. [2025-09-24T19:46:07.513694] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:07.514021] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-24T19:46:07.514074] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-24T19:46:07.514851] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-24T19:46:07.514917] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-24T19:46:07.646379] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T19:46:07.929456] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:08.016110] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-24T19:46:08.816122] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-24T19:46:08.913717] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T19:46:09.074247] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T19:46:09.616147] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-24T19:46:10.416185] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-24T19:46:10.876530] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T19:46:10.906825] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:46:11.216137] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-24T19:46:11.295949] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T19:46:12.016168] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-24T19:46:12.727991] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T19:46:12.816138] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-24T19:46:13.327443] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T19:46:13.616188] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-24T19:46:13.844185] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T19:46:14.416143] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-24T19:46:15.216145] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-24T19:46:15.426140] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T19:46:15.547540] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T19:46:16.016119] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-24T19:46:16.195378] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T19:46:16.816113] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-24T19:46:17.606581] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:46:17.617774] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-24T19:46:18.421309] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-24T19:46:18.435502] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T19:46:18.553787] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T19:46:19.216116] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-24T19:46:19.308935] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T19:46:20.016180] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-24T19:46:20.816081] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-24T19:46:20.870837] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T19:46:21.157428] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T19:46:21.616178] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-24T19:46:22.243101] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T19:46:22.416120] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-24T19:46:22.627814] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T19:46:23.216158] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-24T19:46:24.016055] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-24T19:46:24.194561] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T19:46:24.816073] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-24T19:46:24.926353] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T19:46:25.047550] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T19:46:25.616097] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-24T19:46:26.310418] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T19:46:26.336518] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T19:46:26.340073] [INFO ] [REMOTE ] LEO: Full fetch complete (27108 records). [2025-09-24T19:46:26.340198] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-24T19:46:26.421225] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-24T19:46:26.747322] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-24T19:46:26.747418] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-24T19:46:26.748061] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-24T19:46:26.748128] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-24T19:46:26.748924] [DEBUG] [LOCAL ] LEO: Trimmed 27108 records to 17545 (keeping 200 days of data) [2025-09-24T19:46:26.854011] [DEBUG] [LOCAL ] LEO: Primary data saved (17545 records). [2025-09-24T19:46:26.854164] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-24T19:46:26.854292] [INFO ] [MAIN ] Update Progress: 1253/2373 symbols completed. LEO took 27.6s. Estimated remaining: 2h 28m 44s. Rate: 7.5 symbols/min [2025-09-24T19:46:27.028027] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:27.044390] [DEBUG] [LOCAL ] LGI: Loaded 10013 existing records from primary storage. [2025-09-24T19:46:27.044593] [INFO ] [MAIN ] LGI: Loaded 10013 existing records. [2025-09-24T19:46:27.231462] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-24T19:46:27.238976] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:27.240540] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-24T19:46:27.240602] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-24T19:46:27.241246] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-24T19:46:27.241467] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-24T19:46:27.607537] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:28.016142] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-24T19:46:28.434141] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T19:46:28.816087] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-24T19:46:28.870977] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-24T19:46:28.880636] [INFO ] [REMOTE ] LEN: Full fetch complete (77010 records). [2025-09-24T19:46:28.880801] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-24T19:46:29.277737] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-24T19:46:29.277828] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-24T19:46:29.278851] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-24T19:46:29.278918] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-24T19:46:29.280529] [DEBUG] [LOCAL ] LEN: Trimmed 77010 records to 53191 (keeping 200 days of data) [2025-09-24T19:46:29.551983] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T19:46:29.619741] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-24T19:46:29.669552] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T19:46:29.691165] [DEBUG] [LOCAL ] LEN: Primary data saved (53191 records). [2025-09-24T19:46:29.691314] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-24T19:46:29.691405] [INFO ] [MAIN ] Update Progress: 1254/2373 symbols completed. LEN took 32.9s. Estimated remaining: 2h 28m 31s. Rate: 7.5 symbols/min [2025-09-24T19:46:29.871341] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:29.909491] [DEBUG] [LOCAL ] LH: Loaded 38380 existing records from primary storage. [2025-09-24T19:46:29.909657] [INFO ] [MAIN ] LH: Loaded 38380 existing records. [2025-09-24T19:46:30.089840] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:30.090111] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-24T19:46:30.090198] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-24T19:46:30.091235] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-24T19:46:30.091298] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-24T19:46:30.421209] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-24T19:46:30.451185] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:31.187119] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T19:46:31.216070] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-24T19:46:31.255306] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:46:32.016111] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-24T19:46:32.604091] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T19:46:32.816082] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-24T19:46:33.616067] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-24T19:46:33.953496] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T19:46:34.239489] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T19:46:34.348929] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T19:46:34.416129] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-24T19:46:35.216138] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-24T19:46:35.961750] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T19:46:36.016074] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-24T19:46:36.222747] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T19:46:36.816064] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-24T19:46:36.966843] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T19:46:37.616098] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-24T19:46:38.416070] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-24T19:46:38.734261] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T19:46:38.748468] [INFO ] [REMOTE ] LEVI: Full fetch complete (74462 records). [2025-09-24T19:46:38.748801] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-24T19:46:39.176483] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-24T19:46:39.176685] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-24T19:46:39.178109] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-24T19:46:39.178295] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-24T19:46:39.202360] [DEBUG] [LOCAL ] LEVI: Trimmed 74462 records to 51549 (keeping 200 days of data) [2025-09-24T19:46:39.203171] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:46:39.269784] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-24T19:46:39.525017] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:46:39.566478] [DEBUG] [LOCAL ] LEVI: Primary data saved (51549 records). [2025-09-24T19:46:39.566695] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-24T19:46:39.566822] [INFO ] [MAIN ] Update Progress: 1255/2373 symbols completed. LEVI took 34.7s. Estimated remaining: 2h 28m 25s. Rate: 7.5 symbols/min [2025-09-24T19:46:39.746559] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:39.804004] [DEBUG] [LOCAL ] LHX: Loaded 48750 existing records from primary storage. [2025-09-24T19:46:39.804206] [INFO ] [MAIN ] LHX: Loaded 48750 existing records. [2025-09-24T19:46:39.988283] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:39.988598] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-24T19:46:39.988673] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-24T19:46:39.990167] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-24T19:46:39.990232] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-24T19:46:40.021379] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-24T19:46:40.353525] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:40.607162] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T19:46:40.816129] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-24T19:46:41.120573] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T19:46:41.124127] [INFO ] [REMOTE ] LFT: Full fetch complete (23978 records). [2025-09-24T19:46:41.124215] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-24T19:46:41.519876] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-24T19:46:41.520014] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-24T19:46:41.520800] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-24T19:46:41.520867] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-24T19:46:41.521781] [DEBUG] [LOCAL ] LFT: Trimmed 23978 records to 18087 (keeping 200 days of data) [2025-09-24T19:46:41.620231] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-24T19:46:41.658241] [DEBUG] [LOCAL ] LFT: Primary data saved (18087 records). [2025-09-24T19:46:41.658472] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-24T19:46:41.658591] [INFO ] [MAIN ] Update Progress: 1256/2373 symbols completed. LFT took 34.5s. Estimated remaining: 2h 28m 12s. Rate: 7.5 symbols/min [2025-09-24T19:46:41.841998] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:41.876559] [DEBUG] [LOCAL ] LII: Loaded 28428 existing records from primary storage. [2025-09-24T19:46:41.876831] [INFO ] [MAIN ] LII: Loaded 28428 existing records. [2025-09-24T19:46:42.074385] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:42.074754] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-24T19:46:42.074818] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-24T19:46:42.076009] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-24T19:46:42.076077] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-24T19:46:42.430421] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-24T19:46:42.475775] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:42.484885] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T19:46:42.516287] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T19:46:43.216068] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-24T19:46:43.963724] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T19:46:44.010700] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T19:46:44.016033] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-24T19:46:44.684613] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T19:46:44.816063] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-24T19:46:45.546405] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:46:45.616096] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-24T19:46:46.416150] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-24T19:46:47.216092] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-24T19:46:47.323374] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T19:46:47.431379] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T19:46:48.016088] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-24T19:46:48.816073] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-24T19:46:48.980325] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T19:46:49.029519] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T19:46:49.616080] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-24T19:46:50.075787] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T19:46:50.416088] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-24T19:46:50.950074] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T19:46:51.216108] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-24T19:46:52.016132] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-24T19:46:52.070879] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T19:46:52.789700] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T19:46:52.792777] [INFO ] [REMOTE ] LGI: Full fetch complete (14296 records). [2025-09-24T19:46:52.792886] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-24T19:46:52.824322] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-24T19:46:53.179391] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-24T19:46:53.179529] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-24T19:46:53.180160] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-24T19:46:53.180313] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-24T19:46:53.206757] [DEBUG] [LOCAL ] LGI: Trimmed 14296 records to 10017 (keeping 200 days of data) [2025-09-24T19:46:53.208379] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T19:46:53.281411] [DEBUG] [LOCAL ] LGI: Primary data saved (10017 records). [2025-09-24T19:46:53.281580] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-24T19:46:53.281699] [INFO ] [MAIN ] Update Progress: 1257/2373 symbols completed. LGI took 26.4s. Estimated remaining: 2h 28m 7s. Rate: 7.5 symbols/min [2025-09-24T19:46:53.450381] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:53.493854] [DEBUG] [LOCAL ] LION: Loaded 43086 existing records from primary storage. [2025-09-24T19:46:53.494011] [INFO ] [MAIN ] LION: Loaded 43086 existing records. [2025-09-24T19:46:53.621177] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-24T19:46:53.680264] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:53.680501] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-24T19:46:53.680557] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-24T19:46:53.681463] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-24T19:46:53.681525] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-24T19:46:54.042130] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:54.153005] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T19:46:54.416170] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-24T19:46:55.216057] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-24T19:46:55.479352] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T19:46:55.479979] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T19:46:56.016098] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-24T19:46:56.278148] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T19:46:56.283890] [INFO ] [REMOTE ] LH: Full fetch complete (54807 records). [2025-09-24T19:46:56.283998] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-24T19:46:56.679618] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-24T19:46:56.679900] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-24T19:46:56.681227] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-24T19:46:56.681308] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-24T19:46:56.683161] [DEBUG] [LOCAL ] LH: Trimmed 54807 records to 38227 (keeping 200 days of data) [2025-09-24T19:46:56.816141] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-24T19:46:56.957741] [DEBUG] [LOCAL ] LH: Primary data saved (38227 records). [2025-09-24T19:46:56.957969] [INFO ] [MAIN ] LH: Full history saved. [2025-09-24T19:46:56.958101] [INFO ] [MAIN ] Update Progress: 1258/2373 symbols completed. LH took 27.3s. Estimated remaining: 2h 27m 55s. Rate: 7.5 symbols/min [2025-09-24T19:46:57.154944] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:46:57.162625] [DEBUG] [LOCAL ] LITB: Loaded 4327 existing records from primary storage. [2025-09-24T19:46:57.162842] [INFO ] [MAIN ] LITB: Loaded 4327 existing records. [2025-09-24T19:46:57.378024] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:46:57.388240] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-24T19:46:57.393797] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-24T19:46:57.403522] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-24T19:46:57.403828] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-24T19:46:57.458526] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T19:46:57.623436] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-24T19:46:57.815536] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:46:57.987034] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T19:46:58.416084] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-24T19:46:59.216205] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-24T19:46:59.573530] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T19:46:59.603270] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T19:46:59.701235] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T19:47:00.016111] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-24T19:47:00.816090] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-24T19:47:01.464741] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T19:47:01.616119] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-24T19:47:02.106998] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T19:47:02.416064] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-24T19:47:02.538783] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T19:47:02.810782] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-24T19:47:03.216161] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-24T19:47:04.016146] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-24T19:47:04.549276] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T19:47:04.669499] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T19:47:04.816077] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-24T19:47:05.443037] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T19:47:05.616116] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-24T19:47:06.027326] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T19:47:06.416144] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-24T19:47:06.893339] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-24T19:47:07.216147] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-24T19:47:07.673949] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-24T19:47:08.016102] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-24T19:47:08.816045] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-24T19:47:08.908818] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T19:47:09.616055] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-24T19:47:10.046047] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T19:47:10.139316] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T19:47:10.416162] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-24T19:47:11.216089] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-24T19:47:12.016072] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-24T19:47:12.025334] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T19:47:12.027047] [INFO ] [REMOTE ] LITB: Full fetch complete (5613 records). [2025-09-24T19:47:12.027120] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-24T19:47:12.414257] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-24T19:47:12.414364] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-24T19:47:12.414625] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-24T19:47:12.414789] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-24T19:47:12.415447] [DEBUG] [LOCAL ] LITB: Trimmed 5613 records to 4382 (keeping 200 days of data) [2025-09-24T19:47:12.462119] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T19:47:12.480071] [DEBUG] [LOCAL ] LITB: Primary data saved (4382 records). [2025-09-24T19:47:12.480216] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-24T19:47:12.480314] [INFO ] [MAIN ] Update Progress: 1259/2373 symbols completed. LITB took 15.5s. Estimated remaining: 2h 27m 54s. Rate: 7.5 symbols/min [2025-09-24T19:47:12.663454] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:12.716839] [DEBUG] [LOCAL ] LLY: Loaded 53293 existing records from primary storage. [2025-09-24T19:47:12.716990] [INFO ] [MAIN ] LLY: Loaded 53293 existing records. [2025-09-24T19:47:12.818354] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-24T19:47:12.903022] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:12.903289] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-24T19:47:12.903340] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-24T19:47:12.904554] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-24T19:47:12.904617] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-24T19:47:13.255240] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T19:47:13.331493] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:13.616106] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-24T19:47:14.290616] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:47:14.416115] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-24T19:47:14.905181] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T19:47:15.216133] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-24T19:47:16.016104] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-24T19:47:16.140216] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T19:47:16.816064] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-24T19:47:16.894425] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T19:47:17.616086] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-24T19:47:18.421178] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-24T19:47:18.440208] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-24T19:47:18.581580] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T19:47:18.838728] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T19:47:19.216083] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-24T19:47:19.799319] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T19:47:20.016086] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-24T19:47:20.816096] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-24T19:47:21.106168] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T19:47:21.115175] [INFO ] [REMOTE ] LHX: Full fetch complete (70794 records). [2025-09-24T19:47:21.115316] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-24T19:47:21.538910] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T19:47:21.569006] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-24T19:47:21.569177] [INFO ] [REMOTE ] LII: Full fetch complete (41271 records). [2025-09-24T19:47:21.569238] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-24T19:47:21.569392] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-24T19:47:21.570511] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-24T19:47:21.570811] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-24T19:47:21.632260] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-24T19:47:21.665833] [DEBUG] [LOCAL ] LHX: Trimmed 70794 records to 48707 (keeping 200 days of data) [2025-09-24T19:47:22.117538] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-24T19:47:22.117766] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-24T19:47:22.119345] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-24T19:47:22.119801] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-24T19:47:22.126125] [DEBUG] [LOCAL ] LII: Trimmed 41271 records to 28324 (keeping 200 days of data) [2025-09-24T19:47:22.388027] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T19:47:22.419771] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-24T19:47:22.561934] [DEBUG] [LOCAL ] LII: Primary data saved (28324 records). [2025-09-24T19:47:22.562671] [INFO ] [MAIN ] LII: Full history saved. [2025-09-24T19:47:22.563055] [INFO ] [MAIN ] Update Progress: 1260/2373 symbols completed. LII took 40.9s. Estimated remaining: 2h 27m 48s. Rate: 7.5 symbols/min [2025-09-24T19:47:22.637501] [DEBUG] [LOCAL ] LHX: Primary data saved (48707 records). [2025-09-24T19:47:22.648682] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-24T19:47:22.667348] [INFO ] [MAIN ] Update Progress: 1261/2373 symbols completed. LHX took 43.1s. Estimated remaining: 2h 27m 33s. Rate: 7.5 symbols/min [2025-09-24T19:47:22.871483] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:22.921182] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:22.992991] [DEBUG] [LOCAL ] LMND: Loaded 51875 existing records from primary storage. [2025-09-24T19:47:22.993667] [INFO ] [MAIN ] LMND: Loaded 51875 existing records. [2025-09-24T19:47:23.088344] [DEBUG] [LOCAL ] LMT: Loaded 49926 existing records from primary storage. [2025-09-24T19:47:23.100800] [INFO ] [MAIN ] LMT: Loaded 49926 existing records. [2025-09-24T19:47:23.366413] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:23.399103] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-24T19:47:23.399339] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-24T19:47:23.399209] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:23.399561] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-24T19:47:23.399612] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-24T19:47:23.400420] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-24T19:47:23.400504] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-24T19:47:23.407101] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-24T19:47:23.466000] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-24T19:47:24.066873] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:24.141174] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:24.138256] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-24T19:47:24.141535] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-24T19:47:24.176589] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T19:47:24.221775] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-24T19:47:24.816083] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-24T19:47:25.616082] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-24T19:47:25.895375] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T19:47:26.228914] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-24T19:47:26.282472] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T19:47:26.292605] [INFO ] [REMOTE ] LION: Full fetch complete (54033 records). [2025-09-24T19:47:26.292808] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-24T19:47:26.421155] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-24T19:47:26.704404] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-24T19:47:26.704600] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-24T19:47:26.705823] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-24T19:47:26.705900] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-24T19:47:26.708276] [DEBUG] [LOCAL ] LION: Trimmed 54033 records to 43248 (keeping 200 days of data) [2025-09-24T19:47:26.952716] [DEBUG] [LOCAL ] LION: Primary data saved (43248 records). [2025-09-24T19:47:26.952869] [INFO ] [MAIN ] LION: Full history saved. [2025-09-24T19:47:26.953121] [INFO ] [MAIN ] Update Progress: 1262/2373 symbols completed. LION took 33.7s. Estimated remaining: 2h 27m 22s. Rate: 7.5 symbols/min [2025-09-24T19:47:27.124754] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:27.180117] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-09-24T19:47:27.180266] [INFO ] [MAIN ] LNC: Loaded 51637 existing records. [2025-09-24T19:47:27.222956] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-24T19:47:27.362273] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:27.362581] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-24T19:47:27.362632] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-24T19:47:27.363901] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-24T19:47:27.363963] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-24T19:47:27.743441] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:27.844509] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-24T19:47:28.016049] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-24T19:47:28.334522] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T19:47:28.774703] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T19:47:28.816026] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-24T19:47:29.616095] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-24T19:47:30.416101] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-24T19:47:30.520792] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-24T19:47:30.787919] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T19:47:31.216101] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-24T19:47:31.639440] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T19:47:31.709739] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T19:47:32.016075] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-24T19:47:32.816058] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-24T19:47:33.106431] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T19:47:33.466944] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:47:33.616059] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-24T19:47:34.416087] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-24T19:47:35.222607] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-24T19:47:35.228369] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T19:47:35.293501] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T19:47:36.016129] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-24T19:47:36.066168] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:47:36.816136] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-24T19:47:37.428505] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T19:47:37.616083] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-24T19:47:38.370554] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-24T19:47:38.418023] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-24T19:47:38.421472] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T19:47:39.216137] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-24T19:47:39.417440] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T19:47:40.016156] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-24T19:47:40.820192] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-24T19:47:40.841581] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-24T19:47:41.027556] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T19:47:41.616068] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-24T19:47:41.728623] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T19:47:42.416071] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-24T19:47:42.904907] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T19:47:43.216114] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-24T19:47:43.518805] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T19:47:44.016046] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-24T19:47:44.249013] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T19:47:44.816137] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-24T19:47:45.616374] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-24T19:47:45.617493] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-24T19:47:45.694847] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T19:47:46.416068] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-24T19:47:46.614274] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T19:47:47.216147] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-24T19:47:48.016113] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-24T19:47:48.223853] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T19:47:48.410553] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-24T19:47:48.816154] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-24T19:47:49.170742] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T19:47:49.616193] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-24T19:47:50.347214] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T19:47:50.412580] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:47:50.422894] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-24T19:47:51.216193] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-24T19:47:51.419415] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T19:47:51.429200] [INFO ] [REMOTE ] LMND: Full fetch complete (75285 records). [2025-09-24T19:47:51.429331] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-24T19:47:51.864805] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-24T19:47:51.864917] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-24T19:47:51.865952] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-24T19:47:51.866060] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-24T19:47:51.867947] [DEBUG] [LOCAL ] LMND: Trimmed 75285 records to 51874 (keeping 200 days of data) [2025-09-24T19:47:52.057497] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-24T19:47:52.208268] [DEBUG] [LOCAL ] LMND: Primary data saved (51874 records). [2025-09-24T19:47:52.208447] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-24T19:47:52.208619] [INFO ] [MAIN ] Update Progress: 1263/2373 symbols completed. LMND took 29.6s. Estimated remaining: 2h 27m 29s. Rate: 7.5 symbols/min [2025-09-24T19:47:52.383021] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:52.390661] [DEBUG] [LOCAL ] LND: Loaded 4996 existing records from primary storage. [2025-09-24T19:47:52.390807] [INFO ] [MAIN ] LND: Loaded 4996 existing records. [2025-09-24T19:47:52.577585] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:52.578047] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-24T19:47:52.578277] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-24T19:47:52.578774] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-24T19:47:52.578859] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-24T19:47:52.874799] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-24T19:47:52.927675] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-24T19:47:53.007681] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:53.522162] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-24T19:47:53.616092] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-24T19:47:54.012687] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T19:47:54.022300] [INFO ] [REMOTE ] LNC: Full fetch complete (74046 records). [2025-09-24T19:47:54.022474] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-24T19:47:54.416061] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-24T19:47:54.435824] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-24T19:47:54.435901] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-24T19:47:54.436963] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-24T19:47:54.437303] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-24T19:47:54.439135] [DEBUG] [LOCAL ] LNC: Trimmed 74046 records to 51623 (keeping 200 days of data) [2025-09-24T19:47:54.448003] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T19:47:54.775116] [DEBUG] [LOCAL ] LNC: Primary data saved (51623 records). [2025-09-24T19:47:54.775278] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-24T19:47:54.775502] [INFO ] [MAIN ] Update Progress: 1264/2373 symbols completed. LNC took 27.8s. Estimated remaining: 2h 27m 16s. Rate: 7.5 symbols/min [2025-09-24T19:47:54.955073] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:55.009129] [DEBUG] [LOCAL ] LNG: Loaded 51508 existing records from primary storage. [2025-09-24T19:47:55.009462] [INFO ] [MAIN ] LNG: Loaded 51508 existing records. [2025-09-24T19:47:55.227208] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-24T19:47:55.233496] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:55.234820] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-24T19:47:55.235324] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-24T19:47:55.239044] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T19:47:55.239160] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-24T19:47:55.239448] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-24T19:47:55.321815] [INFO ] [REMOTE ] LMT: Full fetch complete (72547 records). [2025-09-24T19:47:55.344140] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-24T19:47:55.969854] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:56.032087] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-24T19:47:56.082828] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T19:47:56.104282] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-24T19:47:56.104344] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-24T19:47:56.105373] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-24T19:47:56.105439] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-24T19:47:56.106841] [DEBUG] [LOCAL ] LMT: Trimmed 72547 records to 49894 (keeping 200 days of data) [2025-09-24T19:47:56.449311] [DEBUG] [LOCAL ] LMT: Primary data saved (49894 records). [2025-09-24T19:47:56.449742] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-24T19:47:56.449846] [INFO ] [MAIN ] Update Progress: 1265/2373 symbols completed. LMT took 33.8s. Estimated remaining: 2h 27m 3s. Rate: 7.5 symbols/min [2025-09-24T19:47:56.654564] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:56.668453] [DEBUG] [LOCAL ] LNN: Loaded 11243 existing records from primary storage. [2025-09-24T19:47:56.668601] [INFO ] [MAIN ] LNN: Loaded 11243 existing records. [2025-09-24T19:47:56.824176] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-24T19:47:56.856996] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:56.858860] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-24T19:47:56.858948] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-24T19:47:56.859731] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-24T19:47:56.859887] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-24T19:47:57.251057] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:57.276684] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-24T19:47:57.286187] [INFO ] [REMOTE ] LLY: Full fetch complete (77251 records). [2025-09-24T19:47:57.286381] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-24T19:47:57.617301] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-24T19:47:57.707154] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-24T19:47:57.707523] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T19:47:57.707808] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-24T19:47:57.712772] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-24T19:47:57.712875] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-24T19:47:57.714850] [DEBUG] [LOCAL ] LLY: Trimmed 77251 records to 53288 (keeping 200 days of data) [2025-09-24T19:47:57.889918] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T19:47:58.138738] [DEBUG] [LOCAL ] LLY: Primary data saved (53288 records). [2025-09-24T19:47:58.138940] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-24T19:47:58.139078] [INFO ] [MAIN ] Update Progress: 1266/2373 symbols completed. LLY took 45.7s. Estimated remaining: 2h 26m 49s. Rate: 7.5 symbols/min [2025-09-24T19:47:58.328140] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:47:58.369365] [DEBUG] [LOCAL ] LOAR: Loaded 41777 existing records from primary storage. [2025-09-24T19:47:58.369521] [INFO ] [MAIN ] LOAR: Loaded 41777 existing records. [2025-09-24T19:47:58.422729] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-24T19:47:58.495218] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T19:47:58.569977] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:47:58.570282] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-24T19:47:58.570336] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-24T19:47:58.571355] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-24T19:47:58.571419] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-24T19:47:58.927196] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:47:59.216161] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-24T19:47:59.892003] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T19:48:00.016070] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-24T19:48:00.155495] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T19:48:00.673880] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T19:48:00.816059] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-24T19:48:01.472066] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T19:48:01.616099] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-24T19:48:02.416103] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-24T19:48:02.792755] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T19:48:03.216076] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-24T19:48:03.786606] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T19:48:03.934836] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T19:48:04.016090] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-24T19:48:04.816076] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-24T19:48:04.849594] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T19:48:05.616105] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-24T19:48:06.019474] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T19:48:06.416141] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-24T19:48:06.965098] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T19:48:07.216056] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-24T19:48:07.489780] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T19:48:07.976597] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T19:48:07.978109] [INFO ] [REMOTE ] LND: Full fetch complete (8707 records). [2025-09-24T19:48:07.978182] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-24T19:48:08.021297] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-24T19:48:08.336974] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-24T19:48:08.337062] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-24T19:48:08.337310] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-24T19:48:08.337348] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-24T19:48:08.337811] [DEBUG] [LOCAL ] LND: Trimmed 8707 records to 4968 (keeping 200 days of data) [2025-09-24T19:48:08.365812] [DEBUG] [LOCAL ] LND: Primary data saved (4968 records). [2025-09-24T19:48:08.365903] [INFO ] [MAIN ] LND: Full history saved. [2025-09-24T19:48:08.365987] [INFO ] [MAIN ] Update Progress: 1267/2373 symbols completed. LND took 16.2s. Estimated remaining: 2h 26m 43s. Rate: 7.5 symbols/min [2025-09-24T19:48:08.624955] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:08.664731] [DEBUG] [LOCAL ] LOB: Loaded 27535 existing records from primary storage. [2025-09-24T19:48:08.664937] [INFO ] [MAIN ] LOB: Loaded 27535 existing records. [2025-09-24T19:48:08.821154] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-24T19:48:08.898489] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:08.898754] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-24T19:48:08.898810] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-24T19:48:08.899606] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-24T19:48:08.899697] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-24T19:48:09.264979] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:09.287026] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T19:48:09.616105] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-24T19:48:09.726739] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T19:48:10.416110] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-24T19:48:10.517188] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T19:48:11.216100] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-24T19:48:11.469207] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T19:48:12.016179] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-24T19:48:12.125752] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T19:48:12.816086] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-24T19:48:13.340879] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T19:48:13.561747] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:48:13.616123] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-24T19:48:14.416157] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-24T19:48:15.001313] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T19:48:15.208493] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T19:48:15.216026] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-24T19:48:16.016088] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-24T19:48:16.816139] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-24T19:48:17.280529] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T19:48:17.616143] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-24T19:48:18.416108] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-24T19:48:18.667102] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T19:48:19.216274] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-24T19:48:19.426998] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-09-24T19:48:19.626426] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T19:48:19.877517] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-24T19:48:19.898166] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T19:48:20.016098] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-24T19:48:20.816088] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-24T19:48:21.051342] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T19:48:21.616085] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-24T19:48:22.416131] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-24T19:48:22.562592] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T19:48:23.216111] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-24T19:48:23.286715] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T19:48:23.411869] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T19:48:24.016107] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-24T19:48:24.816101] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-24T19:48:24.874765] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T19:48:25.075989] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T19:48:25.616102] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-24T19:48:26.359555] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T19:48:26.416308] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-24T19:48:26.832898] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T19:48:27.216127] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-24T19:48:28.016194] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-24T19:48:28.016112] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:48:28.771633] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T19:48:28.816030] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-24T19:48:28.909935] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T19:48:28.912307] [INFO ] [REMOTE ] LNN: Full fetch complete (15550 records). [2025-09-24T19:48:28.912379] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-24T19:48:29.280270] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-24T19:48:29.280367] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-24T19:48:29.280806] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-24T19:48:29.280868] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-24T19:48:29.281636] [DEBUG] [LOCAL ] LNN: Trimmed 15550 records to 11268 (keeping 200 days of data) [2025-09-24T19:48:29.355444] [DEBUG] [LOCAL ] LNN: Primary data saved (11268 records). [2025-09-24T19:48:29.355593] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-24T19:48:29.355706] [INFO ] [MAIN ] Update Progress: 1268/2373 symbols completed. LNN took 32.9s. Estimated remaining: 2h 26m 47s. Rate: 7.5 symbols/min [2025-09-24T19:48:29.528874] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:29.534298] [DEBUG] [LOCAL ] LOCL: Loaded 3584 existing records from primary storage. [2025-09-24T19:48:29.534408] [INFO ] [MAIN ] LOCL: Loaded 3584 existing records. [2025-09-24T19:48:29.625947] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-24T19:48:29.718434] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:29.718718] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-24T19:48:29.718776] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-24T19:48:29.719030] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-24T19:48:29.719089] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-24T19:48:30.087281] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:30.241351] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T19:48:30.416098] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-24T19:48:30.623855] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T19:48:31.216102] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-24T19:48:31.728010] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-24T19:48:32.016136] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-24T19:48:32.140150] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T19:48:32.151111] [INFO ] [REMOTE ] LOAR: Full fetch complete (56366 records). [2025-09-24T19:48:32.151360] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-24T19:48:32.482354] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-24T19:48:32.579265] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-24T19:48:32.579388] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-24T19:48:32.580292] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-24T19:48:32.580356] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-24T19:48:32.581663] [DEBUG] [LOCAL ] LOAR: Trimmed 56366 records to 41692 (keeping 200 days of data) [2025-09-24T19:48:32.816279] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-24T19:48:32.834397] [DEBUG] [LOCAL ] LOAR: Primary data saved (41692 records). [2025-09-24T19:48:32.834550] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-24T19:48:32.834672] [INFO ] [MAIN ] Update Progress: 1269/2373 symbols completed. LOAR took 34.7s. Estimated remaining: 2h 26m 35s. Rate: 7.5 symbols/min [2025-09-24T19:48:33.006996] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:33.039907] [DEBUG] [LOCAL ] LOMA: Loaded 31837 existing records from primary storage. [2025-09-24T19:48:33.040069] [INFO ] [MAIN ] LOMA: Loaded 31837 existing records. [2025-09-24T19:48:33.224483] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:33.224788] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-24T19:48:33.224845] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-24T19:48:33.225701] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-24T19:48:33.225764] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-24T19:48:33.590975] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:33.616051] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-24T19:48:34.416053] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-24T19:48:34.750481] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T19:48:34.874374] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T19:48:35.216091] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-24T19:48:35.499201] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T19:48:35.504424] [INFO ] [REMOTE ] LOB: Full fetch complete (37647 records). [2025-09-24T19:48:35.504515] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-24T19:48:35.914251] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-24T19:48:35.914357] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-24T19:48:35.915177] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-24T19:48:35.915246] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-24T19:48:35.916285] [DEBUG] [LOCAL ] LOB: Trimmed 37647 records to 27485 (keeping 200 days of data) [2025-09-24T19:48:36.016430] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-24T19:48:36.096809] [DEBUG] [LOCAL ] LOB: Primary data saved (27485 records). [2025-09-24T19:48:36.096973] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-24T19:48:36.097107] [INFO ] [MAIN ] Update Progress: 1270/2373 symbols completed. LOB took 27.7s. Estimated remaining: 2h 26m 23s. Rate: 7.5 symbols/min [2025-09-24T19:48:36.283102] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:36.341671] [DEBUG] [LOCAL ] LOW: Loaded 52961 existing records from primary storage. [2025-09-24T19:48:36.341825] [INFO ] [MAIN ] LOW: Loaded 52961 existing records. [2025-09-24T19:48:36.545278] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:36.545772] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-24T19:48:36.546013] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-24T19:48:36.547445] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-24T19:48:36.547511] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-24T19:48:36.722676] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:48:36.821343] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-24T19:48:36.973455] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:37.333299] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T19:48:37.466029] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T19:48:37.616079] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-24T19:48:38.416088] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-24T19:48:39.216058] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-24T19:48:39.531800] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T19:48:40.016059] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-24T19:48:40.280769] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T19:48:40.290463] [INFO ] [REMOTE ] LNG: Full fetch complete (74707 records). [2025-09-24T19:48:40.290607] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-24T19:48:40.528881] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T19:48:40.716039] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-24T19:48:40.716121] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-24T19:48:40.717256] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-24T19:48:40.717328] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-24T19:48:40.718868] [DEBUG] [LOCAL ] LNG: Trimmed 74707 records to 51493 (keeping 200 days of data) [2025-09-24T19:48:40.819066] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-24T19:48:41.045183] [DEBUG] [LOCAL ] LNG: Primary data saved (51493 records). [2025-09-24T19:48:41.045327] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-24T19:48:41.045418] [INFO ] [MAIN ] Update Progress: 1271/2373 symbols completed. LNG took 46.3s. Estimated remaining: 2h 26m 12s. Rate: 7.5 symbols/min [2025-09-24T19:48:41.214016] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:41.260302] [DEBUG] [LOCAL ] LPG: Loaded 40171 existing records from primary storage. [2025-09-24T19:48:41.260452] [INFO ] [MAIN ] LPG: Loaded 40171 existing records. [2025-09-24T19:48:41.436233] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:41.436510] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-24T19:48:41.436562] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-24T19:48:41.437559] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-24T19:48:41.437621] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-24T19:48:41.626852] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-24T19:48:41.803751] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:41.905001] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T19:48:41.978170] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T19:48:42.025459] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-24T19:48:42.416086] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-24T19:48:43.216098] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-24T19:48:43.783248] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T19:48:44.016081] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-24T19:48:44.696389] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:48:44.816057] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-24T19:48:45.410413] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T19:48:45.616074] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-24T19:48:46.414739] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T19:48:46.418771] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-24T19:48:46.480149] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T19:48:47.216087] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-24T19:48:47.937320] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:48:48.016038] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-24T19:48:48.327954] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T19:48:48.816073] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-24T19:48:49.616050] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-24T19:48:49.990410] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T19:48:50.028619] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T19:48:50.416141] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-24T19:48:50.470102] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T19:48:51.216088] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-24T19:48:51.827379] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:48:51.858813] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T19:48:52.016091] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-24T19:48:52.816077] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-24T19:48:53.625706] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-24T19:48:53.655820] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T19:48:54.104053] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-24T19:48:54.111557] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T19:48:54.416172] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-24T19:48:55.216211] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-24T19:48:56.016119] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-24T19:48:56.381831] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-24T19:48:56.402316] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T19:48:56.410302] [INFO ] [REMOTE ] LOMA: Full fetch complete (48091 records). [2025-09-24T19:48:56.410415] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-24T19:48:56.801418] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-24T19:48:56.801533] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-24T19:48:56.802488] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-24T19:48:56.802609] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-24T19:48:56.829727] [DEBUG] [LOCAL ] LOMA: Trimmed 48091 records to 31918 (keeping 200 days of data) [2025-09-24T19:48:56.819348] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-24T19:48:56.832206] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T19:48:57.047603] [DEBUG] [LOCAL ] LOMA: Primary data saved (31918 records). [2025-09-24T19:48:57.047850] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-24T19:48:57.047973] [INFO ] [MAIN ] Update Progress: 1272/2373 symbols completed. LOMA took 24.2s. Estimated remaining: 2h 26m 11s. Rate: 7.5 symbols/min [2025-09-24T19:48:57.232344] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:57.260867] [DEBUG] [LOCAL ] LPL: Loaded 25591 existing records from primary storage. [2025-09-24T19:48:57.261068] [INFO ] [MAIN ] LPL: Loaded 25591 existing records. [2025-09-24T19:48:57.371420] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T19:48:57.458624] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:57.459012] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-24T19:48:57.459064] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-24T19:48:57.459879] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-24T19:48:57.459942] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-24T19:48:57.621279] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-24T19:48:57.850207] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:58.391762] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T19:48:58.393353] [INFO ] [REMOTE ] LOCL: Full fetch complete (4823 records). [2025-09-24T19:48:58.393424] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-24T19:48:58.425927] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-24T19:48:58.775935] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-24T19:48:58.776018] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-24T19:48:58.776169] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-24T19:48:58.776206] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-24T19:48:58.776594] [DEBUG] [LOCAL ] LOCL: Trimmed 4823 records to 3595 (keeping 200 days of data) [2025-09-24T19:48:58.798196] [DEBUG] [LOCAL ] LOCL: Primary data saved (3595 records). [2025-09-24T19:48:58.798288] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-24T19:48:58.798368] [INFO ] [MAIN ] Update Progress: 1273/2373 symbols completed. LOCL took 29.4s. Estimated remaining: 2h 25m 58s. Rate: 7.5 symbols/min [2025-09-24T19:48:58.967865] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:48:59.009327] [DEBUG] [LOCAL ] LPX: Loaded 39673 existing records from primary storage. [2025-09-24T19:48:59.009470] [INFO ] [MAIN ] LPX: Loaded 39673 existing records. [2025-09-24T19:48:59.185630] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:48:59.185879] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-24T19:48:59.185927] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-24T19:48:59.190245] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-24T19:48:59.190316] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-24T19:48:59.221143] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-24T19:48:59.569368] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:48:59.582069] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T19:49:00.016109] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-24T19:49:00.816104] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-24T19:49:01.182016] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T19:49:01.621160] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-24T19:49:01.634798] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T19:49:02.299099] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:49:02.416044] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-24T19:49:02.768230] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T19:49:03.216091] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-24T19:49:03.945305] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T19:49:04.016052] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-24T19:49:04.816105] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-24T19:49:05.116477] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T19:49:05.556381] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T19:49:05.616103] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-24T19:49:05.808121] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T19:49:06.416111] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-24T19:49:06.851152] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:49:07.216098] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-24T19:49:08.016096] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-24T19:49:08.287327] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T19:49:08.336672] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T19:49:08.816078] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-24T19:49:09.532309] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:49:09.616098] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-24T19:49:09.917120] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T19:49:10.416334] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-24T19:49:11.200265] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T19:49:11.207286] [INFO ] [REMOTE ] LPG: Full fetch complete (59878 records). [2025-09-24T19:49:11.207460] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-24T19:49:11.221191] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-24T19:49:11.632847] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-24T19:49:11.633080] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-24T19:49:11.634033] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-24T19:49:11.634146] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-24T19:49:11.635488] [DEBUG] [LOCAL ] LPG: Trimmed 59878 records to 40053 (keeping 200 days of data) [2025-09-24T19:49:11.895357] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T19:49:11.939097] [DEBUG] [LOCAL ] LPG: Primary data saved (40053 records). [2025-09-24T19:49:11.939230] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-24T19:49:11.939311] [INFO ] [MAIN ] Update Progress: 1274/2373 symbols completed. LPG took 30.9s. Estimated remaining: 2h 25m 54s. Rate: 7.5 symbols/min [2025-09-24T19:49:12.021266] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-24T19:49:12.116438] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:12.157540] [DEBUG] [LOCAL ] LRN: Loaded 40031 existing records from primary storage. [2025-09-24T19:49:12.157759] [INFO ] [MAIN ] LRN: Loaded 40031 existing records. [2025-09-24T19:49:12.342100] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:12.342481] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-24T19:49:12.342539] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-24T19:49:12.343940] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-24T19:49:12.344003] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-24T19:49:12.469820] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T19:49:12.742200] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:12.816074] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-24T19:49:13.616096] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-24T19:49:13.930139] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T19:49:14.046744] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T19:49:14.416087] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-24T19:49:14.792568] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T19:49:15.216082] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-24T19:49:16.016123] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-24T19:49:16.446470] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T19:49:16.488887] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T19:49:16.816103] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-24T19:49:17.213967] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:49:17.616122] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-24T19:49:18.416092] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-24T19:49:18.792810] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T19:49:18.802522] [INFO ] [REMOTE ] LOW: Full fetch complete (76489 records). [2025-09-24T19:49:18.802709] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-24T19:49:19.220976] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-24T19:49:19.261957] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-24T19:49:19.263960] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:49:19.271729] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-24T19:49:19.273857] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-24T19:49:19.273929] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-24T19:49:19.277423] [DEBUG] [LOCAL ] LOW: Trimmed 76489 records to 52958 (keeping 200 days of data) [2025-09-24T19:49:19.621374] [DEBUG] [LOCAL ] LOW: Primary data saved (52958 records). [2025-09-24T19:49:19.621517] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-24T19:49:19.621617] [INFO ] [MAIN ] Update Progress: 1275/2373 symbols completed. LOW took 43.5s. Estimated remaining: 2h 25m 46s. Rate: 7.5 symbols/min [2025-09-24T19:49:19.795228] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:19.838218] [DEBUG] [LOCAL ] LSPD: Loaded 43334 existing records from primary storage. [2025-09-24T19:49:19.838366] [INFO ] [MAIN ] LSPD: Loaded 43334 existing records. [2025-09-24T19:49:20.018884] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:49:20.018997] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-24T19:49:20.063981] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:20.065979] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-24T19:49:20.066074] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-24T19:49:20.067323] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-24T19:49:20.067395] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-24T19:49:20.442031] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:20.483325] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T19:49:20.816079] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-24T19:49:21.293585] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T19:49:21.616123] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-24T19:49:22.290336] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T19:49:22.416143] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-24T19:49:23.051167] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T19:49:23.216084] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-24T19:49:23.949753] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T19:49:24.016078] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-24T19:49:24.436903] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T19:49:24.816085] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-24T19:49:25.337148] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T19:49:25.616091] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-24T19:49:25.974936] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T19:49:26.416106] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-24T19:49:26.788781] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T19:49:26.795996] [INFO ] [REMOTE ] LPL: Full fetch complete (34618 records). [2025-09-24T19:49:26.796123] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-24T19:49:27.195436] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-24T19:49:27.195578] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-24T19:49:27.196321] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-24T19:49:27.196454] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-24T19:49:27.197358] [DEBUG] [LOCAL ] LPL: Trimmed 34618 records to 25786 (keeping 200 days of data) [2025-09-24T19:49:27.249525] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-24T19:49:27.355141] [DEBUG] [LOCAL ] LPL: Primary data saved (25786 records). [2025-09-24T19:49:27.355299] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-24T19:49:27.355435] [INFO ] [MAIN ] Update Progress: 1276/2373 symbols completed. LPL took 30.3s. Estimated remaining: 2h 25m 38s. Rate: 7.5 symbols/min [2025-09-24T19:49:27.536078] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:27.574238] [DEBUG] [LOCAL ] LTC: Loaded 29903 existing records from primary storage. [2025-09-24T19:49:27.574461] [INFO ] [MAIN ] LTC: Loaded 29903 existing records. [2025-09-24T19:49:27.795334] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:27.795976] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-24T19:49:27.796109] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-24T19:49:27.797800] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-24T19:49:27.797870] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-24T19:49:27.963820] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:49:28.017198] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-24T19:49:28.009302] [INFO ] [REMOTE ] LPX: Full fetch complete (58506 records). [2025-09-24T19:49:28.050036] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-24T19:49:28.373532] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:28.616216] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-24T19:49:28.616367] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-24T19:49:28.617558] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-24T19:49:28.617659] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-24T19:49:28.619208] [DEBUG] [LOCAL ] LPX: Trimmed 58506 records to 39704 (keeping 200 days of data) [2025-09-24T19:49:28.826157] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-24T19:49:28.893949] [DEBUG] [LOCAL ] LPX: Primary data saved (39704 records). [2025-09-24T19:49:28.894118] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-24T19:49:28.894268] [INFO ] [MAIN ] Update Progress: 1277/2373 symbols completed. LPX took 30.1s. Estimated remaining: 2h 25m 24s. Rate: 7.5 symbols/min [2025-09-24T19:49:28.982596] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T19:49:29.614424] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T19:49:29.623427] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-24T19:49:29.780913] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T19:49:30.416097] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-24T19:49:31.104021] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T19:49:31.216139] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-24T19:49:31.797340] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T19:49:32.016094] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-24T19:49:32.100906] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T19:49:32.816132] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-24T19:49:33.594838] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T19:49:33.616033] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-24T19:49:33.930689] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T19:49:34.416082] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-24T19:49:35.148391] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:49:35.216050] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-24T19:49:35.780153] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T19:49:36.016107] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-24T19:49:36.817382] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-24T19:49:36.820623] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:49:37.595327] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:49:37.616033] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-24T19:49:37.766048] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T19:49:38.416075] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-24T19:49:38.832816] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T19:49:39.216121] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-24T19:49:39.528946] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T19:49:40.016100] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-24T19:49:40.706412] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T19:49:40.816081] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-24T19:49:41.566385] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T19:49:41.616036] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-24T19:49:42.416131] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-24T19:49:42.479281] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T19:49:42.488218] [INFO ] [REMOTE ] LRN: Full fetch complete (58430 records). [2025-09-24T19:49:42.488357] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-24T19:49:42.893265] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-24T19:49:42.893395] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-24T19:49:42.894430] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-24T19:49:42.894512] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-24T19:49:42.897577] [DEBUG] [LOCAL ] LRN: Trimmed 58430 records to 39954 (keeping 200 days of data) [2025-09-24T19:49:43.147740] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T19:49:43.189287] [DEBUG] [LOCAL ] LRN: Primary data saved (39954 records). [2025-09-24T19:49:43.189451] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-24T19:49:43.189601] [INFO ] [MAIN ] Update Progress: 1278/2373 symbols completed. LRN took 31.3s. Estimated remaining: 2h 25m 22s. Rate: 7.5 symbols/min [2025-09-24T19:49:43.216034] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-24T19:49:43.447620] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T19:49:44.016137] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-24T19:49:44.695690] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T19:49:44.703152] [INFO ] [REMOTE ] LSPD: Full fetch complete (61487 records). [2025-09-24T19:49:44.703265] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-24T19:49:45.172390] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-24T19:49:45.172523] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-24T19:49:45.173564] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-24T19:49:45.173711] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-24T19:49:45.183996] [DEBUG] [LOCAL ] LSPD: Trimmed 61487 records to 43263 (keeping 200 days of data) [2025-09-24T19:49:45.197540] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T19:49:45.205739] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-24T19:49:45.487330] [DEBUG] [LOCAL ] LSPD: Primary data saved (43263 records). [2025-09-24T19:49:45.487523] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-24T19:49:45.487742] [INFO ] [MAIN ] Update Progress: 1279/2373 symbols completed. LSPD took 25.9s. Estimated remaining: 2h 25m 9s. Rate: 7.5 symbols/min [2025-09-24T19:49:46.389637] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T19:49:46.397501] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-24T19:49:47.809767] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T19:49:47.816022] [INFO ] [REMOTE ] LTC: Full fetch complete (43004 records). [2025-09-24T19:49:47.816125] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-24T19:49:48.199428] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-24T19:49:48.199578] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-24T19:49:48.200355] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-24T19:49:48.200416] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-24T19:49:48.201356] [DEBUG] [LOCAL ] LTC: Trimmed 43004 records to 29980 (keeping 200 days of data) [2025-09-24T19:49:48.390010] [DEBUG] [LOCAL ] LTC: Primary data saved (29980 records). [2025-09-24T19:49:48.390153] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-24T19:49:48.390251] [INFO ] [MAIN ] Update Progress: 1280/2373 symbols completed. LTC took 21.0s. Estimated remaining: 2h 24m 57s. Rate: 7.5 symbols/min [2025-09-24T19:49:48.914871] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:49.063299] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:49.072479] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:49.098320] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:49:49.099061] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-24T19:49:49.099253] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-24T19:49:49.103213] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-24T19:49:49.103310] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-24T19:49:49.103384] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-24T19:49:49.103430] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-24T19:49:49.326103] [DEBUG] [LOCAL ] LTM: Loaded 36133 existing records from primary storage. [2025-09-24T19:49:49.361419] [INFO ] [MAIN ] LTM: Loaded 36133 existing records. [2025-09-24T19:49:49.605734] [DEBUG] [LOCAL ] LU: Loaded 48961 existing records from primary storage. [2025-09-24T19:49:49.674329] [DEBUG] [LOCAL ] LTH: Loaded 51874 existing records from primary storage. [2025-09-24T19:49:49.671638] [INFO ] [MAIN ] LU: Loaded 48961 existing records. [2025-09-24T19:49:49.675566] [INFO ] [MAIN ] LTH: Loaded 51874 existing records. [2025-09-24T19:49:49.730118] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:49.875886] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-24T19:49:49.875475] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:49.934814] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-24T19:49:49.957608] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-24T19:49:49.994827] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-24T19:49:49.995560] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-24T19:49:50.171636] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:50.207247] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-24T19:49:50.221389] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:49:50.237806] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-24T19:49:50.237959] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-24T19:49:50.238037] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-24T19:49:50.249966] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-24T19:49:50.255155] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-24T19:49:50.255244] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-24T19:49:50.296073] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-24T19:49:50.926876] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:50.957110] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-24T19:49:51.252806] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:51.268987] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-24T19:49:51.267042] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:49:51.271128] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T19:49:51.270596] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-24T19:49:51.276524] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-24T19:49:51.877806] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T19:49:51.882621] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-24T19:49:52.729478] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T19:49:52.738406] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-24T19:49:52.822137] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T19:49:52.831639] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-24T19:49:52.890480] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T19:49:52.900432] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-24T19:49:53.128827] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T19:49:53.616143] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-24T19:49:53.888716] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T19:49:54.416142] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-24T19:49:54.536624] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T19:49:54.707015] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T19:49:54.995581] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T19:49:55.216094] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-24T19:49:55.786766] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T19:49:56.016130] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-24T19:49:56.816120] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-24T19:49:56.947837] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:49:57.610182] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T19:49:57.619833] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-24T19:49:57.672493] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T19:49:58.416137] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-24T19:49:58.653200] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T19:49:59.216149] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-24T19:49:59.827922] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T19:50:00.016091] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-24T19:50:00.532877] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T19:50:00.816636] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-24T19:50:01.015855] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T19:50:01.616137] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-24T19:50:02.416066] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-24T19:50:02.657717] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T19:50:03.025432] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T19:50:03.216109] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-24T19:50:03.623958] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T19:50:04.016083] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-24T19:50:04.816048] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-24T19:50:04.948605] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:50:04.976462] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T19:50:05.616077] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-24T19:50:06.416067] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-24T19:50:06.483469] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T19:50:06.588575] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T19:50:07.216133] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-24T19:50:07.556822] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T19:50:08.016100] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-24T19:50:08.816083] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-24T19:50:09.221439] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T19:50:09.616095] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-24T19:50:09.656178] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:50:09.867883] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T19:50:09.872548] [INFO ] [REMOTE ] LUCK: Full fetch complete (40277 records). [2025-09-24T19:50:09.872705] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-24T19:50:10.062614] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-24T19:50:10.063151] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:50:10.063222] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:50:10.063270] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-24T19:50:10.063330] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-24T19:50:10.063367] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-24T19:50:10.063421] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-24T19:50:10.063510] [INFO ] [MAIN ] Update Progress: 1281/2373 symbols completed. LUCK took 21.7s. Estimated remaining: 2h 25m 1s. Rate: 7.5 symbols/min [2025-09-24T19:50:10.232599] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:10.287728] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-24T19:50:10.287889] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-24T19:50:10.431701] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-24T19:50:10.475230] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:10.475473] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-24T19:50:10.475523] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-24T19:50:10.477117] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-24T19:50:10.477180] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-24T19:50:10.841503] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:11.216090] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-24T19:50:11.484983] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T19:50:11.924486] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T19:50:12.016079] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-24T19:50:12.792960] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T19:50:12.816043] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-24T19:50:13.616126] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-24T19:50:13.679210] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:50:14.416126] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-24T19:50:14.631307] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T19:50:15.216087] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-24T19:50:15.325570] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T19:50:16.016134] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-24T19:50:16.154505] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T19:50:16.164375] [INFO ] [REMOTE ] LTM: Full fetch complete (47004 records). [2025-09-24T19:50:16.164593] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-24T19:50:16.578128] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-24T19:50:16.578343] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-24T19:50:16.579234] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-24T19:50:16.579305] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-24T19:50:16.580671] [DEBUG] [LOCAL ] LTM: Trimmed 47004 records to 36299 (keeping 200 days of data) [2025-09-24T19:50:16.799484] [DEBUG] [LOCAL ] LTM: Primary data saved (36299 records). [2025-09-24T19:50:16.799634] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-24T19:50:16.799762] [INFO ] [MAIN ] Update Progress: 1282/2373 symbols completed. LTM took 28.4s. Estimated remaining: 2h 24m 52s. Rate: 7.5 symbols/min [2025-09-24T19:50:16.844567] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-24T19:50:16.981140] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:17.036084] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-24T19:50:17.036262] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-24T19:50:17.240045] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-24T19:50:17.245927] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:17.254832] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-24T19:50:17.254900] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-24T19:50:17.255102] [INFO ] [REMOTE ] LTH: Full fetch complete (73946 records). [2025-09-24T19:50:17.255183] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-24T19:50:17.289741] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-24T19:50:17.315889] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-24T19:50:18.086176] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:18.086457] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-24T19:50:18.086745] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-24T19:50:18.087629] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-24T19:50:18.089159] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-24T19:50:18.089889] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-24T19:50:18.121494] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T19:50:18.119886] [DEBUG] [LOCAL ] LTH: Trimmed 73946 records to 51869 (keeping 200 days of data) [2025-09-24T19:50:18.422303] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-24T19:50:18.468258] [DEBUG] [LOCAL ] LTH: Primary data saved (51869 records). [2025-09-24T19:50:18.468407] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-24T19:50:18.468502] [INFO ] [MAIN ] Update Progress: 1283/2373 symbols completed. LTH took 30.1s. Estimated remaining: 2h 24m 38s. Rate: 7.5 symbols/min [2025-09-24T19:50:18.654882] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:18.655447] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-24T19:50:18.655570] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-24T19:50:18.655804] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-24T19:50:18.655869] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-24T19:50:18.655963] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-24T19:50:18.656158] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-24T19:50:19.014983] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-24T19:50:19.080322] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:19.216048] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-24T19:50:19.422971] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:50:19.423311] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-24T19:50:20.016058] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-24T19:50:20.213885] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:50:20.214155] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-24T19:50:20.354412] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-24T19:50:20.821177] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-24T19:50:20.834062] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-24T19:50:21.060036] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:50:21.060380] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-24T19:50:21.616135] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-24T19:50:22.416100] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-24T19:50:23.216073] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-24T19:50:23.549560] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T19:50:24.016068] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-24T19:50:24.229229] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:50:24.229601] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-24T19:50:24.299690] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T19:50:24.310380] [INFO ] [REMOTE ] LU: Full fetch complete (70407 records). [2025-09-24T19:50:24.310573] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-24T19:50:24.713678] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-24T19:50:24.713780] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-24T19:50:24.714798] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-24T19:50:24.714862] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-24T19:50:24.716379] [DEBUG] [LOCAL ] LU: Trimmed 70407 records to 48960 (keeping 200 days of data) [2025-09-24T19:50:24.816868] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-24T19:50:25.004513] [DEBUG] [LOCAL ] LU: Primary data saved (48960 records). [2025-09-24T19:50:25.004703] [INFO ] [MAIN ] LU: Full history saved. [2025-09-24T19:50:25.004838] [INFO ] [MAIN ] Update Progress: 1284/2373 symbols completed. LU took 36.6s. Estimated remaining: 2h 24m 29s. Rate: 7.5 symbols/min [2025-09-24T19:50:25.101277] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:50:25.112734] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-24T19:50:25.186480] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:25.225153] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T19:50:25.286952] [DEBUG] [LOCAL ] LVS: Loaded 53568 existing records from primary storage. [2025-09-24T19:50:25.287163] [INFO ] [MAIN ] LVS: Loaded 53568 existing records. [2025-09-24T19:50:25.490345] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:25.490626] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-24T19:50:25.490809] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-24T19:50:25.492550] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-24T19:50:25.492614] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-24T19:50:25.621238] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-24T19:50:25.868356] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:26.416153] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-24T19:50:27.216141] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-24T19:50:27.705170] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T19:50:28.016159] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-24T19:50:28.239010] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T19:50:28.384346] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T19:50:28.816083] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-24T19:50:29.616064] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-24T19:50:29.855309] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T19:50:30.416135] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-24T19:50:30.536452] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T19:50:30.713779] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-24T19:50:31.216092] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-24T19:50:32.016084] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-24T19:50:32.206507] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T19:50:32.271802] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-24T19:50:32.816095] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-24T19:50:33.616057] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-24T19:50:33.751758] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T19:50:33.854036] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T19:50:34.416078] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-24T19:50:35.216063] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-24T19:50:35.491596] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T19:50:36.016070] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-24T19:50:36.427261] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T19:50:36.428719] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T19:50:36.445350] [INFO ] [REMOTE ] LUXE: Full fetch complete (13419 records). [2025-09-24T19:50:36.445858] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-24T19:50:36.627305] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 101 unique days, need 200 days [2025-09-24T19:50:36.627681] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:50:36.627765] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:50:36.627834] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-24T19:50:36.627921] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-24T19:50:36.627977] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-24T19:50:36.628044] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-24T19:50:36.628196] [INFO ] [MAIN ] Update Progress: 1285/2373 symbols completed. LUXE took 18.2s. Estimated remaining: 2h 24m 24s. Rate: 7.5 symbols/min [2025-09-24T19:50:36.795546] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:36.813693] [DEBUG] [LOCAL ] LVWR: Loaded 17514 existing records from primary storage. [2025-09-24T19:50:36.813843] [INFO ] [MAIN ] LVWR: Loaded 17514 existing records. [2025-09-24T19:50:36.825190] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-24T19:50:36.997579] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:36.997908] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-24T19:50:36.997977] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-24T19:50:36.998689] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-24T19:50:36.998756] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-24T19:50:37.358678] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:37.557035] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T19:50:37.616034] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-24T19:50:38.227250] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T19:50:38.416041] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-24T19:50:38.683889] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T19:50:38.827155] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-24T19:50:39.216092] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-24T19:50:40.016090] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-24T19:50:40.498444] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T19:50:40.816060] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-24T19:50:41.253420] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-24T19:50:41.340858] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T19:50:41.616176] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-24T19:50:42.416168] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-24T19:50:43.216064] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-24T19:50:43.526604] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T19:50:43.807852] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-24T19:50:44.021191] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-24T19:50:44.037728] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T19:50:44.816118] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-24T19:50:45.616203] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-24T19:50:45.937366] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T19:50:46.104361] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T19:50:46.416089] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-24T19:50:47.216126] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-24T19:50:47.460729] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T19:50:48.016075] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-24T19:50:48.159880] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T19:50:48.816133] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-24T19:50:49.088158] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:50:49.626412] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-24T19:50:49.633784] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T19:50:50.416071] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-24T19:50:50.729044] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T19:50:51.216156] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-24T19:50:51.568706] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T19:50:52.016171] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-24T19:50:52.361760] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T19:50:52.441991] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T19:50:52.816078] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-24T19:50:53.616119] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-24T19:50:53.993933] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T19:50:54.416068] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-24T19:50:54.858979] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T19:50:55.066908] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-24T19:50:55.216162] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-24T19:50:55.647332] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T19:50:55.658888] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-24T19:50:55.659200] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-24T19:50:56.021551] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-24T19:50:56.259590] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-24T19:50:56.259760] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-24T19:50:56.261461] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-24T19:50:56.261583] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-24T19:50:56.263820] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-24T19:50:56.625842] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-24T19:50:56.626005] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-24T19:50:56.626100] [INFO ] [MAIN ] Update Progress: 1286/2373 symbols completed. LUV took 39.8s. Estimated remaining: 2h 24m 26s. Rate: 7.5 symbols/min [2025-09-24T19:50:56.800050] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:56.829433] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-24T19:50:56.852701] [DEBUG] [LOCAL ] LW: Loaded 51202 existing records from primary storage. [2025-09-24T19:50:56.852863] [INFO ] [MAIN ] LW: Loaded 51202 existing records. [2025-09-24T19:50:57.031272] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:57.031609] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-24T19:50:57.031693] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-24T19:50:57.033212] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-24T19:50:57.033274] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-24T19:50:57.401784] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:50:57.509423] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T19:50:57.519292] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-24T19:50:57.519583] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-24T19:50:57.616730] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-24T19:50:57.743385] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T19:50:57.811254] [INFO ] [REMOTE ] LVWR: Full fetch complete (19851 records). [2025-09-24T19:50:57.805979] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T19:50:57.835117] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-24T19:50:58.188192] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-24T19:50:58.190588] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-24T19:50:58.217205] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-24T19:50:58.281613] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-24T19:50:58.338491] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 53634 (keeping 200 days of data) [2025-09-24T19:50:58.447312] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-24T19:50:58.456362] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-24T19:50:58.465292] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-24T19:50:58.493790] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-24T19:50:58.494489] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-24T19:50:58.498253] [DEBUG] [LOCAL ] LVWR: Trimmed 19851 records to 17553 (keeping 200 days of data) [2025-09-24T19:50:58.675963] [DEBUG] [LOCAL ] LVWR: Primary data saved (17553 records). [2025-09-24T19:50:58.685060] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-24T19:50:58.685579] [INFO ] [MAIN ] Update Progress: 1287/2373 symbols completed. LVWR took 22.1s. Estimated remaining: 2h 24m 13s. Rate: 7.5 symbols/min [2025-09-24T19:50:59.000350] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:59.011407] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-24T19:50:59.011502] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-24T19:50:59.011583] [INFO ] [MAIN ] Update Progress: 1288/2373 symbols completed. LUMN took 48.9s. Estimated remaining: 2h 23m 59s. Rate: 7.5 symbols/min [2025-09-24T19:50:59.157709] [DEBUG] [LOCAL ] LXFR: Loaded 17121 existing records from primary storage. [2025-09-24T19:50:59.157922] [INFO ] [MAIN ] LXFR: Loaded 17121 existing records. [2025-09-24T19:50:59.335612] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:50:59.421440] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:50:59.422019] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-24T19:50:59.422252] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-24T19:50:59.423126] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-24T19:50:59.423251] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-24T19:50:59.752497] [DEBUG] [LOCAL ] LXP: Loaded 50647 existing records from primary storage. [2025-09-24T19:50:59.754137] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-24T19:50:59.778492] [INFO ] [MAIN ] LXP: Loaded 50647 existing records. [2025-09-24T19:50:59.844304] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-24T19:50:59.990953] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:00.017234] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-24T19:51:00.075766] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:00.076176] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-24T19:51:00.076365] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-24T19:51:00.077760] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-24T19:51:00.077972] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-24T19:51:00.177003] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T19:51:00.228992] [INFO ] [REMOTE ] LVS: Full fetch complete (77513 records). [2025-09-24T19:51:00.239451] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-24T19:51:00.757947] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:00.829018] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-24T19:51:00.889683] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-24T19:51:00.889777] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-24T19:51:00.890955] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-24T19:51:00.891140] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-24T19:51:00.892915] [DEBUG] [LOCAL ] LVS: Trimmed 77513 records to 53564 (keeping 200 days of data) [2025-09-24T19:51:01.137141] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T19:51:01.253839] [DEBUG] [LOCAL ] LVS: Primary data saved (53564 records). [2025-09-24T19:51:01.254006] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-24T19:51:01.254098] [INFO ] [MAIN ] Update Progress: 1289/2373 symbols completed. LVS took 36.2s. Estimated remaining: 2h 23m 46s. Rate: 7.5 symbols/min [2025-09-24T19:51:01.422453] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:01.453870] [DEBUG] [LOCAL ] LXU: Loaded 32069 existing records from primary storage. [2025-09-24T19:51:01.454017] [INFO ] [MAIN ] LXU: Loaded 32069 existing records. [2025-09-24T19:51:01.626041] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-24T19:51:01.649926] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:01.650145] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-24T19:51:01.650202] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-24T19:51:01.651110] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-24T19:51:01.651188] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-24T19:51:02.047475] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:02.264380] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-24T19:51:02.416088] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-24T19:51:03.216047] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-24T19:51:03.475297] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-24T19:51:04.016084] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-24T19:51:04.384320] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-24T19:51:04.548345] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T19:51:04.816119] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-24T19:51:05.496116] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-24T19:51:05.616069] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-24T19:51:05.669453] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T19:51:05.836177] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T19:51:06.416099] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-24T19:51:07.216068] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-24T19:51:07.494044] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T19:51:07.615008] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T19:51:08.016110] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-24T19:51:08.744879] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T19:51:08.816061] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-24T19:51:09.082984] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T19:51:09.616134] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-24T19:51:10.416062] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-24T19:51:10.476723] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T19:51:11.216054] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-24T19:51:11.400288] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T19:51:11.451417] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T19:51:12.016088] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-24T19:51:12.760428] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:51:12.816034] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-24T19:51:13.616085] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-24T19:51:13.818623] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T19:51:14.416136] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-24T19:51:15.079153] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T19:51:15.216073] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-24T19:51:15.739882] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-24T19:51:15.834627] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T19:51:16.016106] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-24T19:51:16.434703] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T19:51:16.816074] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-24T19:51:17.592273] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:51:17.616035] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-24T19:51:18.420409] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-24T19:51:18.426395] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T19:51:18.615082] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:51:19.216083] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-24T19:51:19.931084] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T19:51:20.016052] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-24T19:51:20.816139] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-24T19:51:21.015437] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T19:51:21.557801] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T19:51:21.616086] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-24T19:51:21.677998] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T19:51:22.416103] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-24T19:51:23.132191] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:51:23.216054] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-24T19:51:24.016107] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-24T19:51:24.206560] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T19:51:24.215762] [INFO ] [REMOTE ] LXP: Full fetch complete (72458 records). [2025-09-24T19:51:24.215925] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-24T19:51:24.618372] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-24T19:51:24.618673] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-24T19:51:24.619702] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-24T19:51:24.619786] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-24T19:51:24.639599] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T19:51:24.646968] [DEBUG] [LOCAL ] LXP: Trimmed 72458 records to 50657 (keeping 200 days of data) [2025-09-24T19:51:24.823710] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-24T19:51:24.948071] [DEBUG] [LOCAL ] LXP: Primary data saved (50657 records). [2025-09-24T19:51:24.948217] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-24T19:51:24.948301] [INFO ] [MAIN ] Update Progress: 1290/2373 symbols completed. LXP took 25.9s. Estimated remaining: 2h 23m 51s. Rate: 7.5 symbols/min [2025-09-24T19:51:25.117551] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:25.169769] [DEBUG] [LOCAL ] LYB: Loaded 53599 existing records from primary storage. [2025-09-24T19:51:25.169973] [INFO ] [MAIN ] LYB: Loaded 53599 existing records. [2025-09-24T19:51:25.350978] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:25.351288] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-24T19:51:25.351345] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-24T19:51:25.352736] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-24T19:51:25.352798] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-24T19:51:25.631951] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-24T19:51:25.718370] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:25.745588] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T19:51:26.232767] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T19:51:26.416070] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-24T19:51:26.746617] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T19:51:27.216116] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-24T19:51:28.016127] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-24T19:51:28.062206] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T19:51:28.081694] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T19:51:28.084679] [INFO ] [REMOTE ] LXFR: Full fetch complete (25136 records). [2025-09-24T19:51:28.084754] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-24T19:51:28.464889] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-24T19:51:28.464966] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-24T19:51:28.465513] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-24T19:51:28.465570] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-24T19:51:28.466977] [DEBUG] [LOCAL ] LXFR: Trimmed 25136 records to 17085 (keeping 200 days of data) [2025-09-24T19:51:28.572458] [DEBUG] [LOCAL ] LXFR: Primary data saved (17085 records). [2025-09-24T19:51:28.572603] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-24T19:51:28.572713] [INFO ] [MAIN ] Update Progress: 1291/2373 symbols completed. LXFR took 29.9s. Estimated remaining: 2h 23m 40s. Rate: 7.5 symbols/min [2025-09-24T19:51:28.744330] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:28.799495] [DEBUG] [LOCAL ] LYG: Loaded 52873 existing records from primary storage. [2025-09-24T19:51:28.799674] [INFO ] [MAIN ] LYG: Loaded 52873 existing records. [2025-09-24T19:51:28.821207] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-24T19:51:28.978869] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:28.979134] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-24T19:51:28.979184] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-24T19:51:28.980530] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-24T19:51:28.980592] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-24T19:51:29.336118] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:29.541984] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T19:51:29.616040] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-24T19:51:30.416058] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-24T19:51:30.613952] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T19:51:30.623401] [INFO ] [REMOTE ] LW: Full fetch complete (74597 records). [2025-09-24T19:51:30.623554] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-24T19:51:30.842391] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T19:51:31.098397] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-24T19:51:31.098521] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-24T19:51:31.099868] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-24T19:51:31.099951] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-24T19:51:31.101726] [DEBUG] [LOCAL ] LW: Trimmed 74597 records to 51165 (keeping 200 days of data) [2025-09-24T19:51:31.217870] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-24T19:51:31.442253] [DEBUG] [LOCAL ] LW: Primary data saved (51165 records). [2025-09-24T19:51:31.442419] [INFO ] [MAIN ] LW: Full history saved. [2025-09-24T19:51:31.442555] [INFO ] [MAIN ] Update Progress: 1292/2373 symbols completed. LW took 34.8s. Estimated remaining: 2h 23m 28s. Rate: 7.5 symbols/min [2025-09-24T19:51:31.636949] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:31.694966] [DEBUG] [LOCAL ] LYV: Loaded 51188 existing records from primary storage. [2025-09-24T19:51:31.695139] [INFO ] [MAIN ] LYV: Loaded 51188 existing records. [2025-09-24T19:51:31.900138] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:31.900619] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-24T19:51:31.900750] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-24T19:51:31.902299] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-24T19:51:31.902395] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-24T19:51:32.017752] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-24T19:51:32.316542] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:32.375630] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T19:51:32.816070] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-24T19:51:32.982448] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T19:51:33.299709] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T19:51:33.305254] [INFO ] [REMOTE ] LXU: Full fetch complete (44926 records). [2025-09-24T19:51:33.305355] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-24T19:51:33.621216] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-24T19:51:33.726098] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-24T19:51:33.726179] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-24T19:51:33.726996] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-24T19:51:33.727060] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-24T19:51:33.728010] [DEBUG] [LOCAL ] LXU: Trimmed 44926 records to 32004 (keeping 200 days of data) [2025-09-24T19:51:33.907202] [DEBUG] [LOCAL ] LXU: Primary data saved (32004 records). [2025-09-24T19:51:33.907345] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-24T19:51:33.907444] [INFO ] [MAIN ] Update Progress: 1293/2373 symbols completed. LXU took 32.7s. Estimated remaining: 2h 23m 15s. Rate: 7.5 symbols/min [2025-09-24T19:51:34.075985] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:34.111539] [DEBUG] [LOCAL ] LZB: Loaded 35589 existing records from primary storage. [2025-09-24T19:51:34.111705] [INFO ] [MAIN ] LZB: Loaded 35589 existing records. [2025-09-24T19:51:34.295810] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:34.296115] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-24T19:51:34.296370] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-24T19:51:34.297427] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-24T19:51:34.297493] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-24T19:51:34.420915] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-24T19:51:34.634329] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T19:51:34.702128] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:35.216078] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-24T19:51:35.472335] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T19:51:36.016063] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-24T19:51:36.165627] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T19:51:36.519426] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T19:51:36.816090] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-24T19:51:37.428502] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T19:51:37.616102] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-24T19:51:37.658471] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T19:51:38.416100] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-24T19:51:39.216068] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-24T19:51:39.399483] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T19:51:40.016204] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-24T19:51:40.409864] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T19:51:40.574721] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T19:51:40.816175] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-24T19:51:41.437321] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T19:51:41.616051] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-24T19:51:42.416114] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-24T19:51:42.738984] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T19:51:42.773329] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T19:51:43.216141] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-24T19:51:44.016076] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-24T19:51:44.144361] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:51:44.451558] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:51:44.816150] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-24T19:51:45.616186] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-24T19:51:45.918230] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T19:51:46.130715] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:51:46.416123] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-24T19:51:46.517531] [DEBUG] [REMOTE ] LYB: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-24T19:51:46.517938] [WARN ] [REMOTE ] LYB: No data returned for month 2025-06 [2025-09-24T19:51:46.990767] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T19:51:47.216082] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-24T19:51:48.016125] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-24T19:51:48.816080] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-24T19:51:48.907377] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T19:51:49.530990] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T19:51:49.616098] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-24T19:51:50.416326] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-24T19:51:50.751468] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T19:51:50.817558] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T19:51:51.216103] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-24T19:51:52.016100] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-24T19:51:52.501509] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T19:51:52.642421] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T19:51:52.816140] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-24T19:51:53.616062] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-24T19:51:53.898866] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T19:51:54.062477] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T19:51:54.070228] [INFO ] [REMOTE ] LZB: Full fetch complete (50178 records). [2025-09-24T19:51:54.070382] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-24T19:51:54.421283] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-24T19:51:54.496443] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-24T19:51:54.496872] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-24T19:51:54.497805] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-24T19:51:54.497884] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-24T19:51:54.499615] [DEBUG] [LOCAL ] LZB: Trimmed 50178 records to 35569 (keeping 200 days of data) [2025-09-24T19:51:54.726891] [DEBUG] [LOCAL ] LZB: Primary data saved (35569 records). [2025-09-24T19:51:54.727039] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-24T19:51:54.727139] [INFO ] [MAIN ] Update Progress: 1294/2373 symbols completed. LZB took 20.8s. Estimated remaining: 2h 23m 18s. Rate: 7.5 symbols/min [2025-09-24T19:51:54.911443] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:54.932483] [DEBUG] [LOCAL ] LZM: Loaded 13552 existing records from primary storage. [2025-09-24T19:51:54.932692] [INFO ] [MAIN ] LZM: Loaded 13552 existing records. [2025-09-24T19:51:55.131596] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:55.132333] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-24T19:51:55.132536] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-24T19:51:55.133070] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-24T19:51:55.133273] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-24T19:51:55.217122] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-24T19:51:55.453310] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T19:51:55.555735] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:56.016071] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-24T19:51:56.227364] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T19:51:56.816157] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-24T19:51:57.076987] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T19:51:57.086560] [INFO ] [REMOTE ] LYB: Full fetch complete (69661 records). [2025-09-24T19:51:57.086725] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-24T19:51:57.284049] [WARN ] [VALIDATOR ] LYB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T19:51:57.284743] [FATAL] [MAIN ] LYB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:51:57.284816] [WARN ] [MAIN ] LYB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:51:57.284888] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-24T19:51:57.284968] [DEBUG] [LOCAL ] LYB: No primary data file found to delete. [2025-09-24T19:51:57.285024] [INFO ] [LOCAL ] LYB: Starting deletion of derivative data. [2025-09-24T19:51:57.285422] [DEBUG] [LOCAL ] LYB: Deleted derivative data file. [2025-09-24T19:51:57.285548] [INFO ] [MAIN ] Update Progress: 1295/2373 symbols completed. LYB took 32.3s. Estimated remaining: 2h 23m 5s. Rate: 7.5 symbols/min [2025-09-24T19:51:57.455761] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:51:57.514098] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-24T19:51:57.514275] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-24T19:51:57.623726] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-24T19:51:57.714878] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:51:57.715355] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-24T19:51:57.715605] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-24T19:51:57.717610] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-24T19:51:57.717718] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-24T19:51:58.035906] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T19:51:58.127853] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:51:58.390909] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T19:51:58.416061] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-24T19:51:58.459420] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T19:51:59.216121] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-24T19:52:00.016118] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-24T19:52:00.371834] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:52:00.793346] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:52:00.794554] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T19:52:00.816066] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-24T19:52:01.616089] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-24T19:52:02.408249] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T19:52:02.416017] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-24T19:52:02.607977] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T19:52:03.136233] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T19:52:03.216129] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-24T19:52:04.016106] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-24T19:52:04.238297] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T19:52:04.816102] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-24T19:52:05.585794] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T19:52:05.616032] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-24T19:52:06.339105] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T19:52:06.416151] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-24T19:52:07.216081] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-24T19:52:07.301274] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T19:52:07.505826] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T19:52:07.515353] [INFO ] [REMOTE ] LYG: Full fetch complete (76047 records). [2025-09-24T19:52:07.515569] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-24T19:52:07.927390] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-24T19:52:07.927494] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-24T19:52:07.928560] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-24T19:52:07.928674] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-24T19:52:07.930411] [DEBUG] [LOCAL ] LYG: Trimmed 76047 records to 52864 (keeping 200 days of data) [2025-09-24T19:52:08.029226] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-24T19:52:08.258552] [DEBUG] [LOCAL ] LYG: Primary data saved (52864 records). [2025-09-24T19:52:08.258798] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-24T19:52:08.258976] [INFO ] [MAIN ] Update Progress: 1296/2373 symbols completed. LYG took 39.7s. Estimated remaining: 2h 22m 60s. Rate: 7.5 symbols/min [2025-09-24T19:52:08.431718] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:08.488546] [DEBUG] [LOCAL ] MA: Loaded 52574 existing records from primary storage. [2025-09-24T19:52:08.488733] [INFO ] [MAIN ] MA: Loaded 52574 existing records. [2025-09-24T19:52:08.665929] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:08.666185] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-24T19:52:08.666234] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-24T19:52:08.667844] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-24T19:52:08.667907] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-24T19:52:08.827983] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-24T19:52:09.049934] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:09.190416] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T19:52:09.204461] [INFO ] [REMOTE ] LYV: Full fetch complete (73631 records). [2025-09-24T19:52:09.204608] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-24T19:52:09.622140] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-24T19:52:09.626892] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-24T19:52:09.628772] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-24T19:52:09.630529] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-24T19:52:09.630751] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-24T19:52:09.636321] [DEBUG] [LOCAL ] LYV: Trimmed 73631 records to 51163 (keeping 200 days of data) [2025-09-24T19:52:09.721834] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T19:52:10.035297] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T19:52:10.065175] [DEBUG] [LOCAL ] LYV: Primary data saved (51163 records). [2025-09-24T19:52:10.066181] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-24T19:52:10.066469] [INFO ] [MAIN ] Update Progress: 1297/2373 symbols completed. LYV took 38.6s. Estimated remaining: 2h 22m 47s. Rate: 7.5 symbols/min [2025-09-24T19:52:10.253351] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:10.308015] [DEBUG] [LOCAL ] MAA: Loaded 42875 existing records from primary storage. [2025-09-24T19:52:10.308272] [INFO ] [MAIN ] MAA: Loaded 42875 existing records. [2025-09-24T19:52:10.421272] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-24T19:52:10.495519] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:10.495901] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-24T19:52:10.495970] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-24T19:52:10.497453] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-24T19:52:10.497530] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-24T19:52:10.885810] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:11.146686] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:52:11.216060] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-24T19:52:11.621932] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T19:52:12.016117] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-24T19:52:12.082845] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T19:52:12.816108] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-24T19:52:13.563558] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:52:13.616056] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-24T19:52:14.416057] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-24T19:52:14.772022] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T19:52:15.067184] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T19:52:15.070770] [INFO ] [REMOTE ] LZM: Full fetch complete (17906 records). [2025-09-24T19:52:15.070846] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-24T19:52:15.216593] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-24T19:52:15.462739] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-24T19:52:15.463117] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-24T19:52:15.463543] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-24T19:52:15.463623] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-24T19:52:15.494466] [DEBUG] [LOCAL ] LZM: Trimmed 17906 records to 13587 (keeping 200 days of data) [2025-09-24T19:52:15.496909] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T19:52:15.595235] [DEBUG] [LOCAL ] LZM: Primary data saved (13587 records). [2025-09-24T19:52:15.595392] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-24T19:52:15.595511] [INFO ] [MAIN ] Update Progress: 1298/2373 symbols completed. LZM took 20.9s. Estimated remaining: 2h 22m 37s. Rate: 7.5 symbols/min [2025-09-24T19:52:15.788544] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:15.848846] [DEBUG] [LOCAL ] MAC: Loaded 49711 existing records from primary storage. [2025-09-24T19:52:15.849028] [INFO ] [MAIN ] MAC: Loaded 49711 existing records. [2025-09-24T19:52:16.022946] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-24T19:52:16.028015] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:16.029219] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-24T19:52:16.029271] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-24T19:52:16.031436] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-24T19:52:16.031502] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-24T19:52:16.385484] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:16.797413] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T19:52:16.816038] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-24T19:52:17.512233] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:52:17.616060] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-24T19:52:18.416133] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-24T19:52:18.475112] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T19:52:19.216062] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-24T19:52:19.768613] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-24T19:52:20.016154] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-24T19:52:20.521937] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T19:52:20.561401] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T19:52:20.816081] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-24T19:52:21.616096] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-24T19:52:21.953552] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T19:52:22.346108] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T19:52:22.416119] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-24T19:52:22.783205] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T19:52:23.216117] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-24T19:52:23.846202] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T19:52:24.016112] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-24T19:52:24.816144] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-24T19:52:25.190530] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T19:52:25.446740] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T19:52:25.616082] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-24T19:52:26.361332] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T19:52:26.416053] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-24T19:52:27.216075] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-24T19:52:27.295753] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T19:52:28.021966] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-24T19:52:28.052938] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T19:52:28.816105] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-24T19:52:29.233204] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T19:52:29.447288] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:52:29.616091] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-24T19:52:30.416107] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-24T19:52:30.928586] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T19:52:31.216140] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-24T19:52:31.286617] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T19:52:32.016080] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-24T19:52:32.494908] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-24T19:52:32.816046] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-24T19:52:32.860439] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T19:52:33.548593] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T19:52:33.616044] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-24T19:52:34.416114] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-24T19:52:34.846630] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T19:52:35.214285] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:52:35.223440] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-24T19:52:36.021393] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-24T19:52:36.036732] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:52:36.816076] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-24T19:52:37.233518] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T19:52:37.616898] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-24T19:52:37.616817] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:52:38.383527] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T19:52:38.416035] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-24T19:52:39.216162] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-24T19:52:39.831125] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-24T19:52:39.840827] [INFO ] [REMOTE ] MA: Full fetch complete (76270 records). [2025-09-24T19:52:39.841001] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-24T19:52:40.033956] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-24T19:52:40.278452] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-24T19:52:40.278695] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-24T19:52:40.279896] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-24T19:52:40.279983] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-24T19:52:40.282084] [DEBUG] [LOCAL ] MA: Trimmed 76270 records to 52569 (keeping 200 days of data) [2025-09-24T19:52:40.413043] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T19:52:40.432617] [INFO ] [REMOTE ] M: Full fetch complete (77499 records). [2025-09-24T19:52:40.437714] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-24T19:52:40.985251] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-24T19:52:40.986501] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-24T19:52:40.994058] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-24T19:52:40.994848] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-24T19:52:41.083264] [DEBUG] [LOCAL ] M: Trimmed 77499 records to 53536 (keeping 200 days of data) [2025-09-24T19:52:41.085442] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:52:41.099698] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-24T19:52:41.214983] [DEBUG] [LOCAL ] MA: Primary data saved (52569 records). [2025-09-24T19:52:41.217067] [INFO ] [MAIN ] MA: Full history saved. [2025-09-24T19:52:41.217484] [INFO ] [MAIN ] Update Progress: 1299/2373 symbols completed. MA took 33.0s. Estimated remaining: 2h 22m 44s. Rate: 7.5 symbols/min [2025-09-24T19:52:41.421315] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:41.627925] [DEBUG] [LOCAL ] MAGN: Loaded 34981 existing records from primary storage. [2025-09-24T19:52:41.630237] [INFO ] [MAIN ] MAGN: Loaded 34981 existing records. [2025-09-24T19:52:41.860043] [DEBUG] [LOCAL ] M: Primary data saved (53536 records). [2025-09-24T19:52:41.865458] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:41.866304] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-24T19:52:41.866055] [INFO ] [MAIN ] M: Full history saved. [2025-09-24T19:52:41.866609] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-24T19:52:41.866550] [INFO ] [MAIN ] Update Progress: 1300/2373 symbols completed. M took 44.6s. Estimated remaining: 2h 22m 29s. Rate: 7.5 symbols/min [2025-09-24T19:52:41.888198] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-24T19:52:41.903394] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-24T19:52:42.173152] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-24T19:52:42.215399] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:42.287393] [INFO ] [REMOTE ] MAA: Full fetch complete (61000 records). [2025-09-24T19:52:42.320369] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-24T19:52:42.557106] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:42.558505] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-24T19:52:42.633200] [DEBUG] [LOCAL ] MAIN: Loaded 41357 existing records from primary storage. [2025-09-24T19:52:42.652455] [INFO ] [MAIN ] MAIN: Loaded 41357 existing records. [2025-09-24T19:52:42.991941] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-24T19:52:43.002397] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-24T19:52:43.038922] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-24T19:52:43.060026] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-24T19:52:43.060166] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:43.060723] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-24T19:52:43.061078] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-24T19:52:43.076435] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-24T19:52:43.085257] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-24T19:52:43.088337] [DEBUG] [LOCAL ] MAA: Trimmed 61000 records to 42807 (keeping 200 days of data) [2025-09-24T19:52:43.115404] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T19:52:43.301234] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-24T19:52:43.672897] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:43.682973] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-24T19:52:43.763558] [DEBUG] [LOCAL ] MAA: Primary data saved (42807 records). [2025-09-24T19:52:43.763761] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-24T19:52:43.763849] [INFO ] [MAIN ] Update Progress: 1301/2373 symbols completed. MAA took 33.7s. Estimated remaining: 2h 22m 17s. Rate: 7.5 symbols/min [2025-09-24T19:52:43.937903] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:43.981633] [DEBUG] [LOCAL ] MAN: Loaded 43562 existing records from primary storage. [2025-09-24T19:52:43.981809] [INFO ] [MAIN ] MAN: Loaded 43562 existing records. [2025-09-24T19:52:44.185156] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T19:52:44.190740] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:44.199814] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-24T19:52:44.199464] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-24T19:52:44.200850] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-24T19:52:44.202097] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-24T19:52:44.202164] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-24T19:52:44.589000] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:44.816054] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-24T19:52:44.934187] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T19:52:44.944010] [INFO ] [REMOTE ] MAC: Full fetch complete (71469 records). [2025-09-24T19:52:44.944277] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-24T19:52:45.368805] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-24T19:52:45.369177] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-24T19:52:45.370774] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-24T19:52:45.370871] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-24T19:52:45.395056] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T19:52:45.404868] [DEBUG] [LOCAL ] MAC: Trimmed 71469 records to 49705 (keeping 200 days of data) [2025-09-24T19:52:45.624841] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-24T19:52:45.667692] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T19:52:45.784513] [DEBUG] [LOCAL ] MAC: Primary data saved (49705 records). [2025-09-24T19:52:45.784769] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-24T19:52:45.784922] [INFO ] [MAIN ] Update Progress: 1302/2373 symbols completed. MAC took 30.2s. Estimated remaining: 2h 22m 4s. Rate: 7.5 symbols/min [2025-09-24T19:52:45.965736] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:52:45.990813] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T19:52:46.027116] [DEBUG] [LOCAL ] MANU: Loaded 27166 existing records from primary storage. [2025-09-24T19:52:46.027343] [INFO ] [MAIN ] MANU: Loaded 27166 existing records. [2025-09-24T19:52:46.211217] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:52:46.211585] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-24T19:52:46.211670] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-24T19:52:46.212426] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-24T19:52:46.212492] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-24T19:52:46.425217] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-24T19:52:46.594311] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:52:47.216074] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-24T19:52:47.407094] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T19:52:47.947208] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:52:48.016113] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-24T19:52:48.446968] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T19:52:48.816138] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-24T19:52:49.045932] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T19:52:49.616094] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-24T19:52:50.162136] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T19:52:50.416115] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-24T19:52:50.994151] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T19:52:51.216112] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-24T19:52:51.923049] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:52:52.016111] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-24T19:52:52.816187] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-24T19:52:52.949478] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T19:52:53.034550] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:52:53.616099] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-24T19:52:53.900503] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T19:52:54.416099] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-24T19:52:55.134235] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T19:52:55.216049] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-24T19:52:55.969955] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T19:52:56.016131] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-24T19:52:56.816070] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-24T19:52:57.031942] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T19:52:57.586574] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T19:52:57.616030] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-24T19:52:57.914971] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T19:52:58.416135] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-24T19:52:58.979129] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T19:52:59.216160] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-24T19:52:59.952886] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T19:53:00.016066] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-24T19:53:00.610831] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T19:53:00.816100] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-24T19:53:01.618160] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-24T19:53:01.621527] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T19:53:02.075145] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T19:53:02.416108] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-24T19:53:03.136291] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T19:53:03.216125] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-24T19:53:03.727609] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T19:53:04.016090] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-24T19:53:04.816307] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-24T19:53:04.843521] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T19:53:05.265535] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T19:53:05.616102] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-24T19:53:06.416084] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-24T19:53:06.477742] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T19:53:06.743911] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T19:53:07.216082] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-24T19:53:07.777162] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:53:08.016089] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-24T19:53:08.645826] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:53:08.816114] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-24T19:53:09.616112] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-24T19:53:09.697065] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T19:53:10.001955] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T19:53:10.010001] [INFO ] [REMOTE ] MAN: Full fetch complete (61947 records). [2025-09-24T19:53:10.010118] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-24T19:53:10.396158] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-24T19:53:10.396268] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-24T19:53:10.397204] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-24T19:53:10.397266] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-24T19:53:10.398567] [DEBUG] [LOCAL ] MAN: Trimmed 61947 records to 43547 (keeping 200 days of data) [2025-09-24T19:53:10.454595] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-24T19:53:10.673411] [DEBUG] [LOCAL ] MAN: Primary data saved (43547 records). [2025-09-24T19:53:10.673584] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-24T19:53:10.673703] [INFO ] [MAIN ] Update Progress: 1303/2373 symbols completed. MAN took 26.9s. Estimated remaining: 2h 22m 10s. Rate: 7.5 symbols/min [2025-09-24T19:53:10.846323] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:10.899053] [DEBUG] [LOCAL ] MAS: Loaded 52341 existing records from primary storage. [2025-09-24T19:53:10.899212] [INFO ] [MAIN ] MAS: Loaded 52341 existing records. [2025-09-24T19:53:11.030896] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T19:53:11.186173] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:11.189710] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-24T19:53:11.189770] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-24T19:53:11.191005] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-24T19:53:11.191066] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-24T19:53:11.221299] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-24T19:53:11.544846] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:12.016077] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-24T19:53:12.078730] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T19:53:12.087234] [INFO ] [REMOTE ] MAIN: Full fetch complete (59703 records). [2025-09-24T19:53:12.087398] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-24T19:53:12.499762] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-24T19:53:12.499981] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-24T19:53:12.501782] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-24T19:53:12.501908] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-24T19:53:12.504300] [DEBUG] [LOCAL ] MAIN: Trimmed 59703 records to 41379 (keeping 200 days of data) [2025-09-24T19:53:12.644599] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T19:53:12.817730] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-24T19:53:12.821847] [DEBUG] [LOCAL ] MAIN: Primary data saved (41379 records). [2025-09-24T19:53:12.822050] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-24T19:53:12.822164] [INFO ] [MAIN ] Update Progress: 1304/2373 symbols completed. MAIN took 31.0s. Estimated remaining: 2h 21m 57s. Rate: 7.5 symbols/min [2025-09-24T19:53:13.019979] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:13.060876] [DEBUG] [LOCAL ] MATV: Loaded 37655 existing records from primary storage. [2025-09-24T19:53:13.061092] [INFO ] [MAIN ] MATV: Loaded 37655 existing records. [2025-09-24T19:53:13.262039] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:13.262566] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-24T19:53:13.262627] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-24T19:53:13.263737] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-24T19:53:13.263805] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-24T19:53:13.619766] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-24T19:53:13.703522] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:13.753492] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T19:53:13.752932] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T19:53:14.416111] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-24T19:53:15.160684] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T19:53:15.167876] [INFO ] [REMOTE ] MAGN: Full fetch complete (51043 records). [2025-09-24T19:53:15.168072] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-24T19:53:15.221374] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-24T19:53:15.582378] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-24T19:53:15.582499] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-24T19:53:15.583944] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-24T19:53:15.584013] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-24T19:53:15.585675] [DEBUG] [LOCAL ] MAGN: Trimmed 51043 records to 34933 (keeping 200 days of data) [2025-09-24T19:53:15.821191] [DEBUG] [LOCAL ] MAGN: Primary data saved (34933 records). [2025-09-24T19:53:15.821525] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-24T19:53:15.821860] [INFO ] [MAIN ] Update Progress: 1305/2373 symbols completed. MAGN took 34.6s. Estimated remaining: 2h 21m 45s. Rate: 7.5 symbols/min [2025-09-24T19:53:15.984539] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T19:53:16.016619] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-24T19:53:16.079325] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:16.122683] [DEBUG] [LOCAL ] MATX: Loaded 31629 existing records from primary storage. [2025-09-24T19:53:16.122910] [INFO ] [MAIN ] MATX: Loaded 31629 existing records. [2025-09-24T19:53:16.308989] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:16.309350] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-24T19:53:16.309405] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-24T19:53:16.310401] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-24T19:53:16.310478] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-24T19:53:16.694251] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:16.735097] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T19:53:16.742124] [INFO ] [REMOTE ] MANU: Full fetch complete (38245 records). [2025-09-24T19:53:16.742353] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-24T19:53:16.821991] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-24T19:53:17.211546] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-24T19:53:17.211759] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-24T19:53:17.213053] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-24T19:53:17.213357] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-24T19:53:17.243816] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:53:17.244127] [DEBUG] [LOCAL ] MANU: Trimmed 38245 records to 27119 (keeping 200 days of data) [2025-09-24T19:53:17.479630] [DEBUG] [LOCAL ] MANU: Primary data saved (27119 records). [2025-09-24T19:53:17.479905] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-24T19:53:17.480037] [INFO ] [MAIN ] Update Progress: 1306/2373 symbols completed. MANU took 31.7s. Estimated remaining: 2h 21m 32s. Rate: 7.5 symbols/min [2025-09-24T19:53:17.621278] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-24T19:53:17.724073] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:17.760731] [DEBUG] [LOCAL ] MAX: Loaded 30963 existing records from primary storage. [2025-09-24T19:53:17.760937] [INFO ] [MAIN ] MAX: Loaded 30963 existing records. [2025-09-24T19:53:17.947134] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:17.947483] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-24T19:53:17.947535] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-24T19:53:17.948517] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-24T19:53:17.948581] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-24T19:53:18.186342] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T19:53:18.361755] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:18.416132] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-24T19:53:19.031624] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T19:53:19.216123] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-24T19:53:19.657096] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T19:53:20.016153] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-24T19:53:20.064851] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T19:53:20.816126] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-24T19:53:21.393680] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T19:53:21.616132] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-24T19:53:22.416095] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-24T19:53:22.489409] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T19:53:22.628714] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T19:53:23.216104] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-24T19:53:23.739050] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T19:53:24.016060] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-24T19:53:24.206997] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T19:53:24.816163] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-24T19:53:25.616080] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-24T19:53:25.800268] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T19:53:25.836278] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T19:53:26.416128] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-24T19:53:27.088291] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T19:53:27.216109] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-24T19:53:27.907467] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:53:28.016118] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-24T19:53:28.721517] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T19:53:28.816127] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-24T19:53:29.334355] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T19:53:29.616139] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-24T19:53:29.933088] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T19:53:30.416110] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-24T19:53:30.564735] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T19:53:31.216118] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-24T19:53:32.016131] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-24T19:53:32.051179] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T19:53:32.311527] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T19:53:32.816109] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-24T19:53:33.625172] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-24T19:53:33.650113] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T19:53:34.416137] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-24T19:53:34.623619] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T19:53:34.685168] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T19:53:35.216178] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-24T19:53:35.954618] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T19:53:36.016122] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-24T19:53:36.091158] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T19:53:36.816198] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-24T19:53:37.432576] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T19:53:37.616123] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-24T19:53:38.126836] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T19:53:38.132582] [INFO ] [REMOTE ] MATX: Full fetch complete (42496 records). [2025-09-24T19:53:38.132744] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-24T19:53:38.423739] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-24T19:53:38.552697] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-24T19:53:38.552868] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-24T19:53:38.554040] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-24T19:53:38.554120] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-24T19:53:38.556469] [DEBUG] [LOCAL ] MATX: Trimmed 42496 records to 31538 (keeping 200 days of data) [2025-09-24T19:53:38.809056] [DEBUG] [LOCAL ] MATX: Primary data saved (31538 records). [2025-09-24T19:53:38.809271] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-24T19:53:38.809387] [INFO ] [MAIN ] Update Progress: 1307/2373 symbols completed. MATX took 23.0s. Estimated remaining: 2h 21m 35s. Rate: 7.5 symbols/min [2025-09-24T19:53:39.021457] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:39.048632] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:53:39.101014] [DEBUG] [LOCAL ] MBC: Loaded 43093 existing records from primary storage. [2025-09-24T19:53:39.101219] [INFO ] [MAIN ] MBC: Loaded 43093 existing records. [2025-09-24T19:53:39.221360] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-24T19:53:39.297577] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:39.297928] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-24T19:53:39.297983] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-24T19:53:39.299219] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-24T19:53:39.299286] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-24T19:53:39.682681] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:39.764970] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T19:53:40.016143] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-24T19:53:40.816106] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-24T19:53:41.087835] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T19:53:41.246813] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:53:41.616061] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-24T19:53:41.641353] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T19:53:42.416128] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-24T19:53:43.012390] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T19:53:43.216135] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-24T19:53:43.913468] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T19:53:44.016089] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-24T19:53:44.810094] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T19:53:44.819768] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-24T19:53:44.822508] [INFO ] [REMOTE ] MAS: Full fetch complete (74788 records). [2025-09-24T19:53:44.822766] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-24T19:53:45.265135] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-24T19:53:45.265421] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-24T19:53:45.267011] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-24T19:53:45.267148] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-24T19:53:45.285523] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T19:53:45.293178] [DEBUG] [LOCAL ] MAS: Trimmed 74788 records to 52338 (keeping 200 days of data) [2025-09-24T19:53:45.623164] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-24T19:53:45.648987] [DEBUG] [LOCAL ] MAS: Primary data saved (52338 records). [2025-09-24T19:53:45.649156] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-24T19:53:45.649251] [INFO ] [MAIN ] Update Progress: 1308/2373 symbols completed. MAS took 35.0s. Estimated remaining: 2h 21m 26s. Rate: 7.5 symbols/min [2025-09-24T19:53:45.825933] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:45.850287] [DEBUG] [LOCAL ] MBI: Loaded 24755 existing records from primary storage. [2025-09-24T19:53:45.850448] [INFO ] [MAIN ] MBI: Loaded 24755 existing records. [2025-09-24T19:53:46.028736] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:46.029083] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-24T19:53:46.029297] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-24T19:53:46.030171] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-24T19:53:46.030233] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-24T19:53:46.407795] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T19:53:46.421052] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-24T19:53:46.420981] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:46.845534] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T19:53:47.216127] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-24T19:53:47.661510] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T19:53:48.016122] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-24T19:53:48.555252] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T19:53:48.561267] [INFO ] [REMOTE ] MATV: Full fetch complete (52401 records). [2025-09-24T19:53:48.561367] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-24T19:53:48.821369] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-24T19:53:48.984129] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-24T19:53:48.984237] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-24T19:53:48.985284] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-24T19:53:48.985352] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-24T19:53:48.986998] [DEBUG] [LOCAL ] MATV: Trimmed 52401 records to 37531 (keeping 200 days of data) [2025-09-24T19:53:49.239917] [DEBUG] [LOCAL ] MATV: Primary data saved (37531 records). [2025-09-24T19:53:49.240205] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-24T19:53:49.240334] [INFO ] [MAIN ] Update Progress: 1309/2373 symbols completed. MATV took 36.4s. Estimated remaining: 2h 21m 14s. Rate: 7.5 symbols/min [2025-09-24T19:53:49.428473] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:49.476118] [DEBUG] [LOCAL ] MC: Loaded 44325 existing records from primary storage. [2025-09-24T19:53:49.476508] [INFO ] [MAIN ] MC: Loaded 44325 existing records. [2025-09-24T19:53:49.614844] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T19:53:49.618352] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-24T19:53:49.644572] [INFO ] [REMOTE ] MAX: Full fetch complete (45486 records). [2025-09-24T19:53:49.649973] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-24T19:53:49.761152] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:49.762085] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-24T19:53:49.783826] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-24T19:53:49.812205] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-24T19:53:49.823321] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-24T19:53:50.441808] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-24T19:53:50.447235] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-24T19:53:50.453408] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-24T19:53:50.469038] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-24T19:53:50.528028] [DEBUG] [LOCAL ] MAX: Trimmed 45486 records to 30824 (keeping 200 days of data) [2025-09-24T19:53:50.527869] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:50.529578] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-24T19:53:50.642279] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T19:53:50.756044] [DEBUG] [LOCAL ] MAX: Primary data saved (30824 records). [2025-09-24T19:53:50.756201] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-24T19:53:50.756326] [INFO ] [MAIN ] Update Progress: 1310/2373 symbols completed. MAX took 33.3s. Estimated remaining: 2h 21m 1s. Rate: 7.5 symbols/min [2025-09-24T19:53:50.943545] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:53:50.961354] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T19:53:50.975949] [DEBUG] [LOCAL ] MCB: Loaded 11735 existing records from primary storage. [2025-09-24T19:53:50.976053] [INFO ] [MAIN ] MCB: Loaded 11735 existing records. [2025-09-24T19:53:51.174411] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:53:51.174723] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-24T19:53:51.174780] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-24T19:53:51.175101] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-24T19:53:51.175160] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-24T19:53:51.221260] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-24T19:53:51.540121] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:53:51.876206] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T19:53:52.016187] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-24T19:53:52.657351] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T19:53:52.798614] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T19:53:52.816052] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-24T19:53:53.616133] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-24T19:53:54.114256] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T19:53:54.416084] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-24T19:53:54.501381] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T19:53:55.216111] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-24T19:53:55.659118] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T19:53:55.999080] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T19:53:56.016036] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-24T19:53:56.816163] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-24T19:53:57.019345] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T19:53:57.616142] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-24T19:53:57.925908] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T19:53:58.416132] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-24T19:53:58.638308] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T19:53:59.216128] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-24T19:53:59.882835] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T19:54:00.016157] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-24T19:54:00.703609] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:54:00.816050] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-24T19:54:00.828337] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T19:54:01.616206] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-24T19:54:02.416087] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-24T19:54:02.939478] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T19:54:03.216136] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-24T19:54:04.016264] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-24T19:54:04.357214] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T19:54:04.816081] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-24T19:54:04.888828] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-24T19:54:05.248314] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T19:54:05.383942] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-24T19:54:05.616053] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-24T19:54:05.763860] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T19:54:06.416148] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-24T19:54:06.880745] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T19:54:07.216159] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-24T19:54:07.269336] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T19:54:08.016154] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-24T19:54:08.486692] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T19:54:08.734932] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T19:54:08.816094] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-24T19:54:09.449391] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T19:54:09.451989] [INFO ] [REMOTE ] MCB: Full fetch complete (16288 records). [2025-09-24T19:54:09.452065] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-24T19:54:09.629803] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-24T19:54:09.827552] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-24T19:54:09.827674] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-24T19:54:09.828090] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-24T19:54:09.828154] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-24T19:54:09.828959] [DEBUG] [LOCAL ] MCB: Trimmed 16288 records to 11686 (keeping 200 days of data) [2025-09-24T19:54:09.920244] [DEBUG] [LOCAL ] MCB: Primary data saved (11686 records). [2025-09-24T19:54:09.920714] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-24T19:54:09.921011] [INFO ] [MAIN ] Update Progress: 1311/2373 symbols completed. MCB took 19.2s. Estimated remaining: 2h 21m 2s. Rate: 7.5 symbols/min [2025-09-24T19:54:10.101257] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:10.101488] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-24T19:54:10.101543] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-24T19:54:10.101730] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-24T19:54:10.101791] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-24T19:54:10.101859] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-24T19:54:10.101904] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-24T19:54:10.421407] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-24T19:54:10.500162] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:10.643237] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T19:54:11.216133] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-24T19:54:12.017457] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-24T19:54:12.023057] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T19:54:12.816132] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-24T19:54:12.863559] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T19:54:12.872177] [INFO ] [REMOTE ] MBC: Full fetch complete (62580 records). [2025-09-24T19:54:12.872316] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-24T19:54:13.262562] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-24T19:54:13.262688] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-24T19:54:13.263668] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-24T19:54:13.263771] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-24T19:54:13.265163] [DEBUG] [LOCAL ] MBC: Trimmed 62580 records to 43095 (keeping 200 days of data) [2025-09-24T19:54:13.555379] [DEBUG] [LOCAL ] MBC: Primary data saved (43095 records). [2025-09-24T19:54:13.555774] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-24T19:54:13.556085] [INFO ] [MAIN ] Update Progress: 1312/2373 symbols completed. MBC took 34.7s. Estimated remaining: 2h 20m 51s. Rate: 7.5 symbols/min [2025-09-24T19:54:13.627812] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-24T19:54:13.751891] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:13.764130] [DEBUG] [LOCAL ] MCI: Loaded 6399 existing records from primary storage. [2025-09-24T19:54:13.764381] [INFO ] [MAIN ] MCI: Loaded 6399 existing records. [2025-09-24T19:54:13.966493] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:54:13.967747] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-24T19:54:13.967901] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-24T19:54:13.968996] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-24T19:54:13.969228] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-24T19:54:14.182747] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T19:54:14.419742] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-24T19:54:14.484102] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:14.488869] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-24T19:54:15.216136] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-24T19:54:15.274883] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T19:54:15.519915] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T19:54:15.696869] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-24T19:54:16.016118] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-24T19:54:16.816118] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-24T19:54:17.616116] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-24T19:54:17.884340] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T19:54:18.345590] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T19:54:18.416121] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-24T19:54:19.216127] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-24T19:54:19.272807] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-24T19:54:19.274069] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T19:54:20.016213] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-24T19:54:20.815850] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T19:54:20.821832] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-24T19:54:21.542461] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T19:54:21.616107] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-24T19:54:21.804160] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T19:54:22.416080] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-24T19:54:22.680895] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T19:54:23.216070] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-24T19:54:23.791947] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T19:54:24.016050] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-24T19:54:24.513936] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-24T19:54:24.537552] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T19:54:24.816084] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-24T19:54:25.594730] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T19:54:25.616068] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-24T19:54:26.416079] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-24T19:54:27.222887] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-24T19:54:27.235578] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T19:54:27.246940] [INFO ] [REMOTE ] MC: Full fetch complete (62312 records). [2025-09-24T19:54:27.247073] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-24T19:54:27.629192] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T19:54:27.664809] [INFO ] [REMOTE ] MBI: Full fetch complete (36704 records). [2025-09-24T19:54:27.682286] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-24T19:54:27.682538] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-24T19:54:27.682935] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-24T19:54:27.684782] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-24T19:54:27.690589] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-24T19:54:27.801616] [DEBUG] [LOCAL ] MC: Trimmed 62312 records to 44280 (keeping 200 days of data) [2025-09-24T19:54:27.987896] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T19:54:28.019258] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-24T19:54:28.277362] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-24T19:54:28.277764] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-24T19:54:28.279177] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-24T19:54:28.279498] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-24T19:54:28.282517] [DEBUG] [LOCAL ] MBI: Trimmed 36704 records to 24678 (keeping 200 days of data) [2025-09-24T19:54:28.620998] [DEBUG] [LOCAL ] MBI: Primary data saved (24678 records). [2025-09-24T19:54:28.622521] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-24T19:54:28.623769] [INFO ] [MAIN ] Update Progress: 1313/2373 symbols completed. MBI took 43.0s. Estimated remaining: 2h 20m 48s. Rate: 7.5 symbols/min [2025-09-24T19:54:28.705446] [DEBUG] [LOCAL ] MC: Primary data saved (44280 records). [2025-09-24T19:54:28.730258] [INFO ] [MAIN ] MC: Full history saved. [2025-09-24T19:54:28.733454] [INFO ] [MAIN ] Update Progress: 1314/2373 symbols completed. MC took 39.5s. Estimated remaining: 2h 20m 34s. Rate: 7.5 symbols/min [2025-09-24T19:54:28.818968] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-24T19:54:28.894603] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:28.995846] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:29.011860] [DEBUG] [LOCAL ] MCN: Loaded 8126 existing records from primary storage. [2025-09-24T19:54:29.012059] [INFO ] [MAIN ] MCN: Loaded 8126 existing records. [2025-09-24T19:54:29.181035] [DEBUG] [LOCAL ] MCK: Loaded 39356 existing records from primary storage. [2025-09-24T19:54:29.192166] [INFO ] [MAIN ] MCK: Loaded 39356 existing records. [2025-09-24T19:54:29.303041] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:54:29.336255] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-24T19:54:29.347338] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-24T19:54:29.376446] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-24T19:54:29.393607] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-24T19:54:29.492769] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:54:29.527316] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-24T19:54:29.531950] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-24T19:54:29.553565] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T19:54:29.553351] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-24T19:54:29.578271] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-24T19:54:29.623233] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-24T19:54:30.168828] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:30.252936] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:30.312283] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-24T19:54:30.416111] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-24T19:54:30.588938] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T19:54:30.591119] [INFO ] [REMOTE ] MCI: Full fetch complete (9900 records). [2025-09-24T19:54:30.591208] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-24T19:54:30.993928] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-24T19:54:30.994027] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-24T19:54:30.994345] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-24T19:54:30.994387] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-24T19:54:30.994890] [DEBUG] [LOCAL ] MCI: Trimmed 9900 records to 6397 (keeping 200 days of data) [2025-09-24T19:54:31.035441] [DEBUG] [LOCAL ] MCI: Primary data saved (6397 records). [2025-09-24T19:54:31.035591] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-24T19:54:31.035738] [INFO ] [MAIN ] Update Progress: 1315/2373 symbols completed. MCI took 17.5s. Estimated remaining: 2h 20m 22s. Rate: 7.5 symbols/min [2025-09-24T19:54:31.219354] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-24T19:54:31.219221] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:31.277434] [DEBUG] [LOCAL ] MCO: Loaded 39575 existing records from primary storage. [2025-09-24T19:54:31.277606] [INFO ] [MAIN ] MCO: Loaded 39575 existing records. [2025-09-24T19:54:31.476939] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:54:31.477217] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-24T19:54:31.477267] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-24T19:54:31.478427] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-24T19:54:31.478490] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-24T19:54:31.888827] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:31.941737] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T19:54:32.016037] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-24T19:54:32.135906] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:54:32.733380] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T19:54:32.816065] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-24T19:54:33.550674] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T19:54:33.616180] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-24T19:54:34.345190] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T19:54:34.416128] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-24T19:54:35.216133] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-24T19:54:36.016202] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-24T19:54:36.313533] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T19:54:36.687392] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T19:54:36.816124] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-24T19:54:37.150906] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T19:54:37.616146] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-24T19:54:38.416091] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-24T19:54:39.223183] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-24T19:54:39.226844] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-24T19:54:39.440509] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T19:54:39.853689] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T19:54:40.010561] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T19:54:40.016028] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-24T19:54:40.648426] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T19:54:40.816064] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-24T19:54:41.616130] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-24T19:54:42.336565] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T19:54:42.416072] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-24T19:54:43.178026] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T19:54:43.216031] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-24T19:54:43.975196] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-24T19:54:43.992173] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T19:54:44.016028] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-24T19:54:44.797109] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T19:54:44.816097] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-24T19:54:45.561106] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T19:54:45.562934] [INFO ] [REMOTE ] MCN: Full fetch complete (11536 records). [2025-09-24T19:54:45.563054] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-24T19:54:45.625077] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-24T19:54:45.934336] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-24T19:54:45.934424] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-24T19:54:45.934759] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-24T19:54:45.934822] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-24T19:54:45.935345] [DEBUG] [LOCAL ] MCN: Trimmed 11536 records to 8126 (keeping 200 days of data) [2025-09-24T19:54:45.985847] [DEBUG] [LOCAL ] MCN: Primary data saved (8126 records). [2025-09-24T19:54:45.986032] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-24T19:54:45.986162] [INFO ] [MAIN ] Update Progress: 1316/2373 symbols completed. MCN took 17.3s. Estimated remaining: 2h 20m 19s. Rate: 7.5 symbols/min [2025-09-24T19:54:46.162941] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:54:46.172964] [DEBUG] [LOCAL ] MCR: Loaded 8801 existing records from primary storage. [2025-09-24T19:54:46.173076] [INFO ] [MAIN ] MCR: Loaded 8801 existing records. [2025-09-24T19:54:46.351270] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:54:46.351538] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-24T19:54:46.351587] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-24T19:54:46.352061] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-24T19:54:46.352123] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-24T19:54:46.421379] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-24T19:54:46.713267] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:54:47.216153] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-24T19:54:47.618114] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T19:54:47.782183] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T19:54:48.016143] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-24T19:54:48.027088] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T19:54:48.816093] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-24T19:54:49.616091] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-24T19:54:49.794550] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T19:54:50.416151] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-24T19:54:50.525872] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T19:54:50.564240] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T19:54:51.216182] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-24T19:54:51.905459] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T19:54:51.947158] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T19:54:52.016052] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-24T19:54:52.672815] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T19:54:52.816114] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-24T19:54:53.616087] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-24T19:54:54.324371] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T19:54:54.416099] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-24T19:54:55.216140] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-24T19:54:55.854230] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T19:54:55.940456] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-24T19:54:55.953740] [INFO ] [REMOTE ] MCD: Full fetch complete (77028 records). [2025-09-24T19:54:55.953899] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-24T19:54:56.020274] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-24T19:54:56.158961] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T19:54:56.159853] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:54:56.180058] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:54:56.180169] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-24T19:54:56.180247] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-24T19:54:56.180878] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-24T19:54:56.181617] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T19:54:56.189153] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-24T19:54:56.189608] [INFO ] [MAIN ] Update Progress: 1317/2373 symbols completed. MCD took 46.3s. Estimated remaining: 2h 20m 13s. Rate: 7.5 symbols/min [2025-09-24T19:54:56.816102] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-24T19:54:57.601851] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T19:54:57.616021] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-24T19:54:58.258741] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T19:54:58.416121] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-24T19:54:59.025270] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T19:54:59.216092] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-24T19:54:59.809359] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T19:55:00.016120] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-24T19:55:00.769161] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T19:55:00.829250] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-24T19:55:00.834191] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T19:55:01.597230] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T19:55:01.616041] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-24T19:55:02.333469] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T19:55:02.416120] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-24T19:55:03.216134] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-24T19:55:03.897601] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T19:55:04.016100] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-24T19:55:04.816068] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-24T19:55:04.858408] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T19:55:04.865177] [INFO ] [REMOTE ] MCK: Full fetch complete (57477 records). [2025-09-24T19:55:04.865292] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-24T19:55:05.266114] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-24T19:55:05.266208] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-24T19:55:05.267280] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-24T19:55:05.267350] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-24T19:55:05.268629] [DEBUG] [LOCAL ] MCK: Trimmed 57477 records to 39330 (keeping 200 days of data) [2025-09-24T19:55:05.521405] [DEBUG] [LOCAL ] MCK: Primary data saved (39330 records). [2025-09-24T19:55:05.521698] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-24T19:55:05.521902] [INFO ] [MAIN ] Update Progress: 1318/2373 symbols completed. MCK took 36.9s. Estimated remaining: 2h 20m 6s. Rate: 7.5 symbols/min [2025-09-24T19:55:05.562928] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T19:55:05.616030] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-24T19:55:05.797830] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T19:55:05.805347] [INFO ] [REMOTE ] MCO: Full fetch complete (56594 records). [2025-09-24T19:55:05.805508] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-24T19:55:06.216019] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-24T19:55:06.216157] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-24T19:55:06.217405] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-24T19:55:06.217497] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-24T19:55:06.219240] [DEBUG] [LOCAL ] MCO: Trimmed 56594 records to 39518 (keeping 200 days of data) [2025-09-24T19:55:06.453195] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T19:55:06.455884] [INFO ] [REMOTE ] MCR: Full fetch complete (14192 records). [2025-09-24T19:55:06.456201] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-24T19:55:06.925369] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-24T19:55:06.925720] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-24T19:55:06.926127] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-24T19:55:06.926505] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-24T19:55:06.928882] [DEBUG] [LOCAL ] MCR: Trimmed 14192 records to 8764 (keeping 200 days of data) [2025-09-24T19:55:06.985519] [DEBUG] [LOCAL ] MCR: Primary data saved (8764 records). [2025-09-24T19:55:06.986250] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-24T19:55:06.986617] [INFO ] [MAIN ] Update Progress: 1319/2373 symbols completed. MCR took 21.0s. Estimated remaining: 2h 19m 53s. Rate: 7.5 symbols/min [2025-09-24T19:55:07.000930] [DEBUG] [LOCAL ] MCO: Primary data saved (39518 records). [2025-09-24T19:55:07.001102] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-24T19:55:07.001222] [INFO ] [MAIN ] Update Progress: 1320/2373 symbols completed. MCO took 36.0s. Estimated remaining: 2h 19m 39s. Rate: 7.5 symbols/min [2025-09-24T19:55:07.613973] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:07.690804] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:07.734780] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:07.730708] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:07.741867] [DEBUG] [LOCAL ] MDST: Loaded 5492 existing records from primary storage. [2025-09-24T19:55:07.742257] [INFO ] [MAIN ] MDST: Loaded 5492 existing records. [2025-09-24T19:55:07.877326] [DEBUG] [LOCAL ] MCS: Loaded 21238 existing records from primary storage. [2025-09-24T19:55:07.897984] [INFO ] [MAIN ] MCS: Loaded 21238 existing records. [2025-09-24T19:55:07.975266] [DEBUG] [LOCAL ] MCY: Loaded 25182 existing records from primary storage. [2025-09-24T19:55:08.043689] [INFO ] [MAIN ] MCY: Loaded 25182 existing records. [2025-09-24T19:55:08.112492] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:08.119825] [DEBUG] [LOCAL ] MD: Loaded 38662 existing records from primary storage. [2025-09-24T19:55:08.163479] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-24T19:55:08.154636] [INFO ] [MAIN ] MD: Loaded 38662 existing records. [2025-09-24T19:55:08.172575] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-24T19:55:08.238682] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-24T19:55:08.432511] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-24T19:55:08.479168] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:08.571638] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:08.610435] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-24T19:55:08.592910] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-24T19:55:08.620899] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-24T19:55:08.677155] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-24T19:55:08.685226] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-24T19:55:08.709442] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-24T19:55:08.709572] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:08.704229] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-24T19:55:08.741686] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-24T19:55:08.709883] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-24T19:55:08.791102] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-24T19:55:08.908251] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-24T19:55:08.937008] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-24T19:55:09.792602] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:09.877774] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-24T19:55:10.009514] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:10.032985] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-24T19:55:10.039289] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:10.052155] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-24T19:55:10.141482] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:10.141836] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-24T19:55:10.732494] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T19:55:10.734611] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-24T19:55:11.240774] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T19:55:11.245909] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-24T19:55:11.302449] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T19:55:11.309361] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-24T19:55:11.371014] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T19:55:11.371908] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T19:55:12.016062] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-24T19:55:12.053933] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T19:55:12.634693] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T19:55:12.816073] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-24T19:55:13.006803] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T19:55:13.616053] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-24T19:55:13.646594] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T19:55:14.306346] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T19:55:14.416096] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-24T19:55:14.976682] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T19:55:15.216085] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-24T19:55:16.016078] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-24T19:55:16.485786] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T19:55:16.582799] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T19:55:16.816087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-24T19:55:17.399773] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T19:55:17.616094] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-24T19:55:18.416095] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-24T19:55:18.692392] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T19:55:19.216055] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-24T19:55:19.532762] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T19:55:20.016076] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-24T19:55:20.681374] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T19:55:20.816058] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-24T19:55:21.083077] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T19:55:21.592124] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T19:55:21.616086] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-24T19:55:22.416077] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-24T19:55:23.035348] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T19:55:23.216058] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-24T19:55:23.470004] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T19:55:24.016077] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-24T19:55:24.475689] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T19:55:24.816088] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-24T19:55:25.442915] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T19:55:25.463284] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T19:55:25.616074] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-24T19:55:26.416089] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-24T19:55:26.733774] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T19:55:27.216113] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-24T19:55:27.463283] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T19:55:28.015440] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T19:55:28.017374] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-24T19:55:28.018724] [INFO ] [REMOTE ] MDST: Full fetch complete (8451 records). [2025-09-24T19:55:28.018801] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-24T19:55:28.394927] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-24T19:55:28.395008] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-24T19:55:28.395241] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-24T19:55:28.395282] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-24T19:55:28.395728] [DEBUG] [LOCAL ] MDST: Trimmed 8451 records to 5536 (keeping 200 days of data) [2025-09-24T19:55:28.429051] [DEBUG] [LOCAL ] MDST: Primary data saved (5536 records). [2025-09-24T19:55:28.429153] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-24T19:55:28.429235] [INFO ] [MAIN ] Update Progress: 1321/2373 symbols completed. MDST took 21.4s. Estimated remaining: 2h 19m 42s. Rate: 7.5 symbols/min [2025-09-24T19:55:28.604350] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:28.660757] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-24T19:55:28.660935] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-24T19:55:28.819711] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-24T19:55:28.849337] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:28.849536] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-24T19:55:28.849584] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-24T19:55:28.851099] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-24T19:55:28.851168] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-24T19:55:29.224694] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:29.608233] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T19:55:29.616974] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-24T19:55:30.122964] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T19:55:30.416055] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-24T19:55:30.509847] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T19:55:31.216094] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-24T19:55:32.016071] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-24T19:55:32.139038] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T19:55:32.181539] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T19:55:32.816089] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-24T19:55:33.150890] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T19:55:33.616105] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-24T19:55:34.416050] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-24T19:55:34.823586] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T19:55:34.850241] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T19:55:35.216081] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-24T19:55:36.016070] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-24T19:55:36.039462] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:55:36.816130] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-24T19:55:37.062309] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T19:55:37.148751] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:55:37.616139] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-24T19:55:38.138682] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T19:55:38.416161] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-24T19:55:38.540428] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T19:55:39.216113] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-24T19:55:39.568669] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T19:55:39.573131] [INFO ] [REMOTE ] MCS: Full fetch complete (30319 records). [2025-09-24T19:55:39.573216] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-24T19:55:39.958314] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-24T19:55:39.958403] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-24T19:55:39.959168] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-24T19:55:39.959232] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-24T19:55:39.960059] [DEBUG] [LOCAL ] MCS: Trimmed 30319 records to 21218 (keeping 200 days of data) [2025-09-24T19:55:40.025074] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-24T19:55:40.106132] [DEBUG] [LOCAL ] MCS: Primary data saved (21218 records). [2025-09-24T19:55:40.106328] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-24T19:55:40.106434] [INFO ] [MAIN ] Update Progress: 1322/2373 symbols completed. MCS took 33.1s. Estimated remaining: 2h 19m 37s. Rate: 7.5 symbols/min [2025-09-24T19:55:40.280529] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:40.331194] [DEBUG] [LOCAL ] MDU: Loaded 47881 existing records from primary storage. [2025-09-24T19:55:40.331336] [INFO ] [MAIN ] MDU: Loaded 47881 existing records. [2025-09-24T19:55:40.517025] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:40.517501] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-24T19:55:40.517572] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-24T19:55:40.524295] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-24T19:55:40.534416] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-24T19:55:40.600898] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:55:40.646156] [INFO ] [REMOTE ] MD: Full fetch complete (55247 records). [2025-09-24T19:55:40.646377] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-24T19:55:40.826888] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-24T19:55:41.275994] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:41.331689] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-24T19:55:41.331795] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-24T19:55:41.332674] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-24T19:55:41.332737] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-24T19:55:41.333912] [DEBUG] [LOCAL ] MD: Trimmed 55247 records to 38661 (keeping 200 days of data) [2025-09-24T19:55:41.573248] [DEBUG] [LOCAL ] MD: Primary data saved (38661 records). [2025-09-24T19:55:41.573490] [INFO ] [MAIN ] MD: Full history saved. [2025-09-24T19:55:41.573709] [INFO ] [MAIN ] Update Progress: 1323/2373 symbols completed. MD took 34.5s. Estimated remaining: 2h 19m 23s. Rate: 7.5 symbols/min [2025-09-24T19:55:41.618026] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-24T19:55:41.754897] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:41.765636] [DEBUG] [LOCAL ] MDV: Loaded 8749 existing records from primary storage. [2025-09-24T19:55:41.765761] [INFO ] [MAIN ] MDV: Loaded 8749 existing records. [2025-09-24T19:55:41.956602] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:41.957098] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-24T19:55:41.957166] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-24T19:55:41.972866] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-24T19:55:41.985240] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-24T19:55:42.019210] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T19:55:42.043063] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T19:55:42.092409] [INFO ] [REMOTE ] MCY: Full fetch complete (41722 records). [2025-09-24T19:55:42.117486] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-24T19:55:42.424948] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-24T19:55:42.761193] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:42.794333] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-24T19:55:42.794416] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-24T19:55:42.795290] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-24T19:55:42.795355] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-24T19:55:42.796391] [DEBUG] [LOCAL ] MCY: Trimmed 41722 records to 25078 (keeping 200 days of data) [2025-09-24T19:55:42.957754] [DEBUG] [LOCAL ] MCY: Primary data saved (25078 records). [2025-09-24T19:55:42.957933] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-24T19:55:42.958226] [INFO ] [MAIN ] Update Progress: 1324/2373 symbols completed. MCY took 36.0s. Estimated remaining: 2h 19m 10s. Rate: 7.5 symbols/min [2025-09-24T19:55:43.096910] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T19:55:43.171867] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:55:43.195069] [DEBUG] [LOCAL ] MEC: Loaded 16443 existing records from primary storage. [2025-09-24T19:55:43.195253] [INFO ] [MAIN ] MEC: Loaded 16443 existing records. [2025-09-24T19:55:43.221583] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-24T19:55:43.398565] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:55:43.398857] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-24T19:55:43.398907] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-24T19:55:43.399490] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-24T19:55:43.399589] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-24T19:55:43.749422] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:55:44.016052] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-24T19:55:44.445706] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T19:55:44.797025] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T19:55:44.816034] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-24T19:55:45.010096] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T19:55:45.567614] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T19:55:45.616034] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-24T19:55:46.372389] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T19:55:46.416072] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-24T19:55:47.216132] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-24T19:55:47.407025] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T19:55:47.861354] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T19:55:48.016103] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-24T19:55:48.816099] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-24T19:55:49.442430] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T19:55:49.616072] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-24T19:55:49.668349] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T19:55:50.295529] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T19:55:50.416128] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-24T19:55:51.216160] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-24T19:55:52.025675] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-24T19:55:52.046659] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T19:55:52.147253] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T19:55:52.816080] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-24T19:55:53.616107] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-24T19:55:53.718957] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:55:54.247613] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T19:55:54.416050] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-24T19:55:54.654279] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T19:55:55.216142] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-24T19:55:55.821551] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T19:55:56.016158] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-24T19:55:56.066017] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T19:55:56.816129] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-24T19:55:57.020099] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:55:57.616089] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-24T19:55:58.416052] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-24T19:55:58.541921] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T19:55:58.547583] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T19:55:59.216090] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-24T19:56:00.016062] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-24T19:56:00.343921] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T19:56:00.557412] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T19:56:00.586511] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T19:56:00.816088] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-24T19:56:01.612055] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T19:56:01.616024] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-24T19:56:02.418054] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-24T19:56:02.419835] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T19:56:03.216108] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-24T19:56:04.016064] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-24T19:56:04.081222] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T19:56:04.816053] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-24T19:56:04.890599] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T19:56:04.961977] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T19:56:05.616134] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-24T19:56:06.417692] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-24T19:56:06.423841] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T19:56:07.216131] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-24T19:56:07.496493] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T19:56:07.660758] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T19:56:07.670425] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-24T19:56:07.670555] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-24T19:56:07.830836] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T19:56:08.030962] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-24T19:56:08.098150] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-24T19:56:08.098270] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-24T19:56:08.099891] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-24T19:56:08.099964] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-24T19:56:08.101919] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-24T19:56:08.464169] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-24T19:56:08.464437] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-24T19:56:08.464572] [INFO ] [MAIN ] Update Progress: 1325/2373 symbols completed. MDT took 40.0s. Estimated remaining: 2h 19m 16s. Rate: 7.5 symbols/min [2025-09-24T19:56:08.648051] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:08.682519] [DEBUG] [LOCAL ] MED: Loaded 21843 existing records from primary storage. [2025-09-24T19:56:08.682848] [INFO ] [MAIN ] MED: Loaded 21843 existing records. [2025-09-24T19:56:08.819919] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-24T19:56:08.888667] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T19:56:08.889133] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:08.893362] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-24T19:56:08.893305] [INFO ] [REMOTE ] MEC: Full fetch complete (22652 records). [2025-09-24T19:56:08.893465] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-24T19:56:08.893609] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-24T19:56:08.931334] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-24T19:56:08.931870] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-24T19:56:09.557966] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T19:56:09.621837] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-24T19:56:09.650115] [INFO ] [REMOTE ] MDV: Full fetch complete (11580 records). [2025-09-24T19:56:09.671782] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-24T19:56:09.768100] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-24T19:56:09.835468] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-24T19:56:09.830067] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:09.857823] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-24T19:56:09.857974] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-24T19:56:09.887793] [DEBUG] [LOCAL ] MEC: Trimmed 22652 records to 16379 (keeping 200 days of data) [2025-09-24T19:56:10.287705] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-24T19:56:10.288099] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-24T19:56:10.288440] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-24T19:56:10.288850] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-24T19:56:10.291043] [DEBUG] [LOCAL ] MDV: Trimmed 11580 records to 8649 (keeping 200 days of data) [2025-09-24T19:56:10.350899] [DEBUG] [LOCAL ] MDV: Primary data saved (8649 records). [2025-09-24T19:56:10.351620] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-24T19:56:10.352088] [INFO ] [MAIN ] Update Progress: 1326/2373 symbols completed. MDV took 28.8s. Estimated remaining: 2h 19m 3s. Rate: 7.5 symbols/min [2025-09-24T19:56:10.422162] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-24T19:56:10.528088] [DEBUG] [LOCAL ] MEC: Primary data saved (16379 records). [2025-09-24T19:56:10.537736] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-24T19:56:10.556187] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:10.556329] [INFO ] [MAIN ] Update Progress: 1327/2373 symbols completed. MEC took 27.6s. Estimated remaining: 2h 18m 49s. Rate: 7.5 symbols/min [2025-09-24T19:56:10.739352] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:10.751966] [DEBUG] [LOCAL ] MEG: Loaded 31984 existing records from primary storage. [2025-09-24T19:56:10.752184] [INFO ] [MAIN ] MEG: Loaded 31984 existing records. [2025-09-24T19:56:10.927831] [DEBUG] [LOCAL ] MEGI: Loaded 20457 existing records from primary storage. [2025-09-24T19:56:10.949337] [INFO ] [MAIN ] MEGI: Loaded 20457 existing records. [2025-09-24T19:56:10.949462] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:11.014131] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-24T19:56:11.026386] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-24T19:56:11.058725] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-24T19:56:11.097616] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-24T19:56:11.188819] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:11.211398] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-24T19:56:11.223020] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-24T19:56:11.247426] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-24T19:56:11.251683] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-24T19:56:11.825909] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T19:56:11.848940] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-24T19:56:11.873872] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:11.867499] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-24T19:56:11.891190] [INFO ] [REMOTE ] MDU: Full fetch complete (70260 records). [2025-09-24T19:56:11.912299] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-24T19:56:12.008006] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:12.021175] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-24T19:56:12.387236] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-24T19:56:12.387384] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-24T19:56:12.388750] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-24T19:56:12.388823] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-24T19:56:12.390517] [DEBUG] [LOCAL ] MDU: Trimmed 70260 records to 47888 (keeping 200 days of data) [2025-09-24T19:56:12.692887] [DEBUG] [LOCAL ] MDU: Primary data saved (47888 records). [2025-09-24T19:56:12.693048] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-24T19:56:12.693141] [INFO ] [MAIN ] Update Progress: 1328/2373 symbols completed. MDU took 32.6s. Estimated remaining: 2h 18m 37s. Rate: 7.5 symbols/min [2025-09-24T19:56:12.821256] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-24T19:56:12.872714] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:12.908033] [DEBUG] [LOCAL ] MEI: Loaded 32587 existing records from primary storage. [2025-09-24T19:56:12.908349] [INFO ] [MAIN ] MEI: Loaded 32587 existing records. [2025-09-24T19:56:13.123061] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:13.123880] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T19:56:13.129994] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-24T19:56:13.130382] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-24T19:56:13.131322] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-24T19:56:13.131405] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-24T19:56:13.411413] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T19:56:13.527246] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:13.616100] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-24T19:56:14.093126] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T19:56:14.416090] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-24T19:56:15.054867] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T19:56:15.216089] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-24T19:56:15.471289] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T19:56:16.016085] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-24T19:56:16.573379] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T19:56:16.816077] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-24T19:56:17.177045] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T19:56:17.616111] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-24T19:56:17.879013] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T19:56:18.416114] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-24T19:56:18.685549] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T19:56:19.216060] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-24T19:56:19.388452] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T19:56:20.016086] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-24T19:56:20.478548] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T19:56:20.702072] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T19:56:20.816048] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-24T19:56:21.616110] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-24T19:56:21.855914] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T19:56:22.416126] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-24T19:56:22.771458] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T19:56:23.216085] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-24T19:56:23.843390] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T19:56:24.016058] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-24T19:56:24.453083] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T19:56:24.816098] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-24T19:56:24.857790] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T19:56:25.616113] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-24T19:56:26.053464] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T19:56:26.416144] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-24T19:56:26.779947] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T19:56:27.216108] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-24T19:56:27.325217] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T19:56:28.016149] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-24T19:56:28.278871] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T19:56:28.816115] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-24T19:56:29.301109] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T19:56:29.410497] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T19:56:29.616079] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-24T19:56:30.416084] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-24T19:56:31.177797] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T19:56:31.216042] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-24T19:56:31.594084] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T19:56:32.016071] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-24T19:56:32.346864] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T19:56:32.816066] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-24T19:56:33.198737] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T19:56:33.616151] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-24T19:56:34.221934] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T19:56:34.416069] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-24T19:56:34.714053] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T19:56:35.216111] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-24T19:56:35.521068] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-24T19:56:35.530986] [INFO ] [REMOTE ] MEI: Full fetch complete (45781 records). [2025-09-24T19:56:35.531208] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-24T19:56:35.927792] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-24T19:56:35.927942] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-24T19:56:35.928912] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-24T19:56:35.929011] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-24T19:56:35.930363] [DEBUG] [LOCAL ] MEI: Trimmed 45781 records to 32456 (keeping 200 days of data) [2025-09-24T19:56:36.016101] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-24T19:56:36.044590] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T19:56:36.052626] [INFO ] [REMOTE ] MEGI: Full fetch complete (30658 records). [2025-09-24T19:56:36.052762] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-24T19:56:36.464199] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-24T19:56:36.464905] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-24T19:56:36.466054] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-24T19:56:36.466473] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-24T19:56:36.470574] [DEBUG] [LOCAL ] MEGI: Trimmed 30658 records to 20443 (keeping 200 days of data) [2025-09-24T19:56:36.670617] [DEBUG] [LOCAL ] MEGI: Primary data saved (20443 records). [2025-09-24T19:56:36.672049] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-24T19:56:36.672831] [INFO ] [MAIN ] Update Progress: 1329/2373 symbols completed. MEGI took 26.1s. Estimated remaining: 2h 18m 41s. Rate: 7.5 symbols/min [2025-09-24T19:56:36.818191] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-24T19:56:36.877899] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:36.889948] [DEBUG] [LOCAL ] MEI: Primary data saved (32456 records). [2025-09-24T19:56:36.890149] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-24T19:56:36.890315] [INFO ] [MAIN ] Update Progress: 1330/2373 symbols completed. MEI took 24.2s. Estimated remaining: 2h 18m 27s. Rate: 7.5 symbols/min [2025-09-24T19:56:37.095202] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:37.118545] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-09-24T19:56:37.118771] [INFO ] [MAIN ] MET: Loaded 53316 existing records. [2025-09-24T19:56:37.315854] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:37.316129] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-24T19:56:37.316192] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-24T19:56:37.330259] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-24T19:56:37.331405] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-24T19:56:37.388750] [DEBUG] [LOCAL ] MFA: Loaded 45274 existing records from primary storage. [2025-09-24T19:56:37.404303] [INFO ] [MAIN ] MFA: Loaded 45274 existing records. [2025-09-24T19:56:37.798703] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:37.831757] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-24T19:56:37.837516] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-24T19:56:37.845545] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-24T19:56:37.866537] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T19:56:37.864334] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-24T19:56:37.931294] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-24T19:56:38.078911] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:38.112332] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T19:56:38.385273] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:38.416048] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-24T19:56:39.154207] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T19:56:39.165185] [INFO ] [REMOTE ] MED: Full fetch complete (33012 records). [2025-09-24T19:56:39.165452] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-24T19:56:39.225127] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-24T19:56:39.578184] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-24T19:56:39.578267] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-24T19:56:39.578994] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-24T19:56:39.579074] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-24T19:56:39.580179] [DEBUG] [LOCAL ] MED: Trimmed 33012 records to 21775 (keeping 200 days of data) [2025-09-24T19:56:39.720623] [DEBUG] [LOCAL ] MED: Primary data saved (21775 records). [2025-09-24T19:56:39.720911] [INFO ] [MAIN ] MED: Full history saved. [2025-09-24T19:56:39.721075] [INFO ] [MAIN ] Update Progress: 1331/2373 symbols completed. MED took 31.3s. Estimated remaining: 2h 18m 15s. Rate: 7.5 symbols/min [2025-09-24T19:56:39.895173] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:39.903691] [DEBUG] [LOCAL ] MFAN: Loaded 4253 existing records from primary storage. [2025-09-24T19:56:39.903805] [INFO ] [MAIN ] MFAN: Loaded 4253 existing records. [2025-09-24T19:56:40.018782] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-24T19:56:40.099549] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:40.100056] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-24T19:56:40.100148] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-24T19:56:40.100580] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-24T19:56:40.100693] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-24T19:56:40.238756] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T19:56:40.528142] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:40.622808] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T19:56:40.816086] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-24T19:56:41.616093] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-24T19:56:41.811100] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T19:56:41.914489] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T19:56:42.416094] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-24T19:56:43.123799] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T19:56:43.216038] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-24T19:56:44.016127] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-24T19:56:44.088208] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T19:56:44.457975] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T19:56:44.816050] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-24T19:56:44.947844] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T19:56:45.616085] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-24T19:56:46.147850] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T19:56:46.416093] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-24T19:56:47.216058] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-24T19:56:47.303158] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T19:56:47.772285] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T19:56:47.802699] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T19:56:48.016087] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-24T19:56:48.552051] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T19:56:48.816086] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-24T19:56:49.185667] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T19:56:49.616149] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-24T19:56:50.209884] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T19:56:50.416153] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-24T19:56:51.027353] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T19:56:51.216087] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-24T19:56:51.698939] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T19:56:52.016128] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-24T19:56:52.600824] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T19:56:52.816117] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-24T19:56:53.616090] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-24T19:56:54.414952] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T19:56:54.424465] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-24T19:56:54.666398] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T19:56:54.672756] [INFO ] [REMOTE ] MEG: Full fetch complete (48219 records). [2025-09-24T19:56:54.672869] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-24T19:56:55.056938] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-24T19:56:55.057018] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-24T19:56:55.057836] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-24T19:56:55.057901] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-24T19:56:55.058958] [DEBUG] [LOCAL ] MEG: Trimmed 48219 records to 31972 (keeping 200 days of data) [2025-09-24T19:56:55.219953] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-24T19:56:55.270164] [DEBUG] [LOCAL ] MEG: Primary data saved (31972 records). [2025-09-24T19:56:55.270565] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-24T19:56:55.270874] [INFO ] [MAIN ] Update Progress: 1332/2373 symbols completed. MEG took 44.9s. Estimated remaining: 2h 18m 13s. Rate: 7.5 symbols/min [2025-09-24T19:56:55.445577] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:56:55.455534] [DEBUG] [LOCAL ] MFAO: Loaded 3817 existing records from primary storage. [2025-09-24T19:56:55.455632] [INFO ] [MAIN ] MFAO: Loaded 3817 existing records. [2025-09-24T19:56:55.636574] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:56:55.636868] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-24T19:56:55.636919] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-24T19:56:55.637267] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-24T19:56:55.637327] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-24T19:56:56.001410] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:56:56.016033] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-24T19:56:56.372332] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-24T19:56:56.595729] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T19:56:56.816070] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-24T19:56:56.886542] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T19:56:57.274593] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-24T19:56:57.616078] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-24T19:56:58.416109] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-24T19:56:58.954020] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T19:56:59.077130] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T19:56:59.216111] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-24T19:56:59.775202] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T19:57:00.016092] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-24T19:57:00.816129] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-24T19:57:01.616105] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-24T19:57:02.416091] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-24T19:57:02.639603] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-24T19:57:02.720076] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T19:57:03.216093] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-24T19:57:03.690592] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-24T19:57:04.016134] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-24T19:57:04.114334] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T19:57:04.115605] [INFO ] [REMOTE ] MFAN: Full fetch complete (5560 records). [2025-09-24T19:57:04.115702] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-24T19:57:04.450319] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-24T19:57:04.495063] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-24T19:57:04.495247] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-24T19:57:04.495439] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-24T19:57:04.495483] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-24T19:57:04.495917] [DEBUG] [LOCAL ] MFAN: Trimmed 5560 records to 4265 (keeping 200 days of data) [2025-09-24T19:57:04.524402] [DEBUG] [LOCAL ] MFAN: Primary data saved (4265 records). [2025-09-24T19:57:04.524489] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-24T19:57:04.524580] [INFO ] [MAIN ] Update Progress: 1333/2373 symbols completed. MFAN took 24.8s. Estimated remaining: 2h 18m 6s. Rate: 7.5 symbols/min [2025-09-24T19:57:04.694944] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:04.752867] [DEBUG] [LOCAL ] MFC: Loaded 51316 existing records from primary storage. [2025-09-24T19:57:04.753018] [INFO ] [MAIN ] MFC: Loaded 51316 existing records. [2025-09-24T19:57:04.821149] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-24T19:57:04.933733] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:57:04.934062] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-24T19:57:04.934114] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-24T19:57:04.935530] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-24T19:57:04.935593] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-24T19:57:05.289817] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:05.616047] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-24T19:57:05.681147] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-24T19:57:06.391423] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T19:57:06.416039] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-24T19:57:07.131429] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T19:57:07.216166] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-24T19:57:08.016080] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-24T19:57:08.179150] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:57:08.188222] [INFO ] [REMOTE ] MFA: Full fetch complete (64816 records). [2025-09-24T19:57:08.188368] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-24T19:57:08.626031] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-24T19:57:08.633161] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T19:57:08.632925] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-24T19:57:08.637745] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-24T19:57:08.637887] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-24T19:57:08.640068] [DEBUG] [LOCAL ] MFA: Trimmed 64816 records to 45317 (keeping 200 days of data) [2025-09-24T19:57:08.848052] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-24T19:57:08.993732] [DEBUG] [LOCAL ] MFA: Primary data saved (45317 records). [2025-09-24T19:57:08.994130] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-24T19:57:08.994269] [INFO ] [MAIN ] Update Progress: 1334/2373 symbols completed. MFA took 32.1s. Estimated remaining: 2h 17m 56s. Rate: 7.5 symbols/min [2025-09-24T19:57:09.233676] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:09.268619] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T19:57:09.324254] [DEBUG] [LOCAL ] MFG: Loaded 49036 existing records from primary storage. [2025-09-24T19:57:09.324453] [INFO ] [MAIN ] MFG: Loaded 49036 existing records. [2025-09-24T19:57:09.503522] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:57:09.503828] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-24T19:57:09.503881] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-24T19:57:09.504969] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-24T19:57:09.505032] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-24T19:57:09.621296] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-24T19:57:09.875480] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:10.291075] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T19:57:10.416063] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-24T19:57:10.662232] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:57:11.216095] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-24T19:57:11.927913] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T19:57:12.016060] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-24T19:57:12.816120] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-24T19:57:13.102513] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T19:57:13.151723] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T19:57:13.600578] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T19:57:13.616022] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-24T19:57:14.416087] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-24T19:57:15.216132] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-24T19:57:15.290779] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T19:57:16.011153] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T19:57:16.021348] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-24T19:57:16.816121] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-24T19:57:17.616151] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-24T19:57:17.900091] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-24T19:57:18.416066] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-24T19:57:18.515893] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T19:57:18.641798] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-24T19:57:19.216074] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-24T19:57:19.507154] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-24T19:57:19.797276] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T19:57:19.807916] [INFO ] [REMOTE ] MET: Full fetch complete (77113 records). [2025-09-24T19:57:19.808098] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-24T19:57:20.024792] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-24T19:57:20.227042] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-24T19:57:20.227132] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-24T19:57:20.228301] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-24T19:57:20.228374] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-24T19:57:20.230112] [DEBUG] [LOCAL ] MET: Trimmed 77113 records to 53316 (keeping 200 days of data) [2025-09-24T19:57:20.582636] [DEBUG] [LOCAL ] MET: Primary data saved (53316 records). [2025-09-24T19:57:20.582800] [INFO ] [MAIN ] MET: Full history saved. [2025-09-24T19:57:20.582887] [INFO ] [MAIN ] Update Progress: 1335/2373 symbols completed. MET took 43.9s. Estimated remaining: 2h 17m 50s. Rate: 7.5 symbols/min [2025-09-24T19:57:20.697844] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T19:57:20.739269] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T19:57:20.806097] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:20.821377] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-24T19:57:20.822631] [DEBUG] [LOCAL ] MFM: Loaded 14237 existing records from primary storage. [2025-09-24T19:57:20.822727] [INFO ] [MAIN ] MFM: Loaded 14237 existing records. [2025-09-24T19:57:21.008930] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:57:21.009235] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-24T19:57:21.009292] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-24T19:57:21.009841] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-24T19:57:21.009902] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-24T19:57:21.372296] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:21.616084] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-24T19:57:22.317323] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T19:57:22.416048] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-24T19:57:22.588191] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T19:57:22.800488] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-24T19:57:22.801572] [INFO ] [REMOTE ] MFAO: Full fetch complete (5209 records). [2025-09-24T19:57:22.801663] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-24T19:57:23.205327] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-24T19:57:23.205422] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-24T19:57:23.205594] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-24T19:57:23.205709] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-24T19:57:23.206268] [DEBUG] [LOCAL ] MFAO: Trimmed 5209 records to 3798 (keeping 200 days of data) [2025-09-24T19:57:23.216627] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-24T19:57:23.231262] [DEBUG] [LOCAL ] MFAO: Primary data saved (3798 records). [2025-09-24T19:57:23.231349] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-24T19:57:23.231428] [INFO ] [MAIN ] Update Progress: 1336/2373 symbols completed. MFAO took 28.0s. Estimated remaining: 2h 17m 38s. Rate: 7.5 symbols/min [2025-09-24T19:57:23.405508] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:23.405724] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-24T19:57:23.405775] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-24T19:57:23.405924] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-24T19:57:23.405968] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-24T19:57:23.406011] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-24T19:57:23.406046] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-24T19:57:23.768380] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:24.016135] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-24T19:57:24.724766] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T19:57:24.793268] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T19:57:24.816028] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-24T19:57:25.616087] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-24T19:57:25.976369] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-24T19:57:26.274121] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T19:57:26.416111] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-24T19:57:27.216093] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-24T19:57:27.856029] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T19:57:28.016098] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-24T19:57:28.173636] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T19:57:28.684588] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T19:57:28.816107] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-24T19:57:29.616116] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-24T19:57:30.416104] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-24T19:57:30.784415] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T19:57:30.904108] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T19:57:31.216035] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-24T19:57:31.349687] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T19:57:32.016109] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-24T19:57:32.816166] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-24T19:57:32.869608] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T19:57:33.036480] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:57:33.052991] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-24T19:57:33.616193] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-24T19:57:34.358316] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T19:57:34.416065] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-24T19:57:35.216058] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-24T19:57:35.365310] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T19:57:36.016069] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-24T19:57:36.357055] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-24T19:57:36.731821] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T19:57:36.816036] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-24T19:57:37.105357] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-24T19:57:37.616095] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-24T19:57:38.416115] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-24T19:57:38.741409] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-24T19:57:39.216112] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-24T19:57:39.278396] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T19:57:39.287720] [INFO ] [REMOTE ] MFC: Full fetch complete (74288 records). [2025-09-24T19:57:39.287881] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-24T19:57:39.561259] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-24T19:57:39.692036] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-24T19:57:39.692112] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-24T19:57:39.693117] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-24T19:57:39.693180] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-24T19:57:39.694567] [DEBUG] [LOCAL ] MFC: Trimmed 74288 records to 51300 (keeping 200 days of data) [2025-09-24T19:57:40.007052] [DEBUG] [LOCAL ] MFC: Primary data saved (51300 records). [2025-09-24T19:57:40.007194] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-24T19:57:40.007295] [INFO ] [MAIN ] Update Progress: 1337/2373 symbols completed. MFC took 35.5s. Estimated remaining: 2h 17m 37s. Rate: 7.5 symbols/min [2025-09-24T19:57:40.021310] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-24T19:57:40.183219] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:40.183420] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-24T19:57:40.183475] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-24T19:57:40.183623] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-24T19:57:40.183701] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-24T19:57:40.183757] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-24T19:57:40.183791] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-24T19:57:40.465415] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T19:57:40.543002] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:40.816115] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-24T19:57:41.441681] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T19:57:41.616127] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-24T19:57:41.971275] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-24T19:57:42.416157] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-24T19:57:42.855063] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T19:57:43.216128] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-24T19:57:43.552447] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T19:57:44.016105] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-24T19:57:44.816138] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-24T19:57:45.616064] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-24T19:57:45.705732] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T19:57:45.708556] [INFO ] [REMOTE ] MFM: Full fetch complete (19113 records). [2025-09-24T19:57:45.708637] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-24T19:57:45.925187] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T19:57:45.996171] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-24T19:57:46.146618] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-24T19:57:46.146733] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-24T19:57:46.147187] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-24T19:57:46.147228] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-24T19:57:46.147876] [DEBUG] [LOCAL ] MFM: Trimmed 19113 records to 14184 (keeping 200 days of data) [2025-09-24T19:57:46.232553] [DEBUG] [LOCAL ] MFM: Primary data saved (14184 records). [2025-09-24T19:57:46.232728] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-24T19:57:46.232825] [INFO ] [MAIN ] Update Progress: 1338/2373 symbols completed. MFM took 25.6s. Estimated remaining: 2h 17m 28s. Rate: 7.5 symbols/min [2025-09-24T19:57:46.411365] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:46.411858] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-24T19:57:46.412104] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-24T19:57:46.412334] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-24T19:57:46.412385] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-24T19:57:46.412433] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-24T19:57:46.412468] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-24T19:57:46.424490] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-24T19:57:46.773078] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:46.941545] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T19:57:47.216117] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-24T19:57:47.840232] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T19:57:48.016150] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-24T19:57:48.765395] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T19:57:48.816162] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-24T19:57:48.923083] [DEBUG] [REMOTE ] MFG: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-24T19:57:48.923572] [WARN ] [REMOTE ] MFG: No data returned for month 2025-09 [2025-09-24T19:57:48.923721] [INFO ] [REMOTE ] MFG: Full fetch complete (62500 records). [2025-09-24T19:57:48.923825] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-24T19:57:48.925362] [FATAL] [VALIDATOR ] MFG: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T19:57:48.925458] [FATAL] [MAIN ] MFG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:57:48.925529] [WARN ] [MAIN ] MFG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:57:48.925608] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-24T19:57:48.925719] [DEBUG] [LOCAL ] MFG: No primary data file found to delete. [2025-09-24T19:57:48.925775] [INFO ] [LOCAL ] MFG: Starting deletion of derivative data. [2025-09-24T19:57:48.926434] [DEBUG] [LOCAL ] MFG: Deleted derivative data file. [2025-09-24T19:57:48.926553] [INFO ] [MAIN ] Update Progress: 1339/2373 symbols completed. MFG took 39.9s. Estimated remaining: 2h 17m 16s. Rate: 7.5 symbols/min [2025-09-24T19:57:49.102171] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:49.102401] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-24T19:57:49.102449] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-24T19:57:49.102607] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-24T19:57:49.102688] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-24T19:57:49.102752] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-24T19:57:49.102788] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-24T19:57:49.491444] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:49.616100] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-24T19:57:50.034324] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-24T19:57:50.416109] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-24T19:57:51.002876] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T19:57:51.216080] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-24T19:57:51.732202] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T19:57:52.016106] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-24T19:57:52.648918] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T19:57:52.650178] [INFO ] [REMOTE ] MFSB: Full fetch complete (1582 records). [2025-09-24T19:57:52.650253] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-24T19:57:52.819850] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-24T19:57:52.837546] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-24T19:57:52.838999] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:57:52.839085] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:57:52.839141] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-24T19:57:52.839215] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-24T19:57:52.839257] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-24T19:57:52.839298] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-24T19:57:52.839441] [INFO ] [MAIN ] Update Progress: 1340/2373 symbols completed. MFSB took 29.6s. Estimated remaining: 2h 17m 5s. Rate: 7.5 symbols/min [2025-09-24T19:57:53.020674] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:57:53.041059] [DEBUG] [LOCAL ] MG: Loaded 16730 existing records from primary storage. [2025-09-24T19:57:53.041251] [INFO ] [MAIN ] MG: Loaded 16730 existing records. [2025-09-24T19:57:53.235577] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:57:53.235954] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-24T19:57:53.236016] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-24T19:57:53.236842] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-24T19:57:53.236990] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-24T19:57:53.320043] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T19:57:53.622639] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-24T19:57:53.629735] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:57:54.060536] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T19:57:54.416160] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-24T19:57:54.851968] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-24T19:57:55.216105] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-24T19:57:55.979698] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-24T19:57:56.016032] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-24T19:57:56.613265] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T19:57:56.816080] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-24T19:57:57.250015] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-24T19:57:57.616091] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-24T19:57:58.391949] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T19:57:58.416034] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-24T19:57:59.216111] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-24T19:57:59.395816] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T19:57:59.665112] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T19:58:00.016128] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-24T19:58:00.484037] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T19:58:00.816084] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-24T19:58:01.262148] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T19:58:01.616098] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-24T19:58:02.416174] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-24T19:58:02.585994] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T19:58:02.797616] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-24T19:58:03.216093] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-24T19:58:04.016057] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-24T19:58:04.124369] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T19:58:04.127815] [INFO ] [REMOTE ] MFSI: Full fetch complete (13211 records). [2025-09-24T19:58:04.127886] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-24T19:58:04.493607] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-24T19:58:04.493710] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-24T19:58:04.494037] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-24T19:58:04.494077] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-24T19:58:04.494567] [DEBUG] [LOCAL ] MFSI: Trimmed 13211 records to 11144 (keeping 200 days of data) [2025-09-24T19:58:04.563310] [DEBUG] [LOCAL ] MFSI: Primary data saved (11144 records). [2025-09-24T19:58:04.563463] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-24T19:58:04.563542] [INFO ] [MAIN ] Update Progress: 1341/2373 symbols completed. MFSI took 18.3s. Estimated remaining: 2h 16m 60s. Rate: 7.5 symbols/min [2025-09-24T19:58:04.737237] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:04.791929] [DEBUG] [LOCAL ] MGA: Loaded 50649 existing records from primary storage. [2025-09-24T19:58:04.792179] [INFO ] [MAIN ] MGA: Loaded 50649 existing records. [2025-09-24T19:58:04.825613] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-24T19:58:04.947108] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T19:58:05.012406] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:05.012743] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-24T19:58:05.012815] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-24T19:58:05.014320] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-24T19:58:05.014387] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-24T19:58:05.202761] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-24T19:58:05.394770] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:05.616095] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-24T19:58:06.416138] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-24T19:58:07.057028] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T19:58:07.216093] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-24T19:58:07.272921] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T19:58:07.816033] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T19:58:08.016072] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-24T19:58:08.388422] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-24T19:58:08.816079] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-24T19:58:09.616143] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-24T19:58:10.238069] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T19:58:10.358444] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T19:58:10.416039] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-24T19:58:11.216147] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-24T19:58:12.023152] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-24T19:58:12.030554] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T19:58:12.049452] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T19:58:12.052056] [INFO ] [REMOTE ] MFSG: Full fetch complete (5842 records). [2025-09-24T19:58:12.052129] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-24T19:58:12.428734] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-24T19:58:12.428825] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-24T19:58:12.429031] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-24T19:58:12.429069] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-24T19:58:12.429458] [DEBUG] [LOCAL ] MFSG: Trimmed 5842 records to 5158 (keeping 200 days of data) [2025-09-24T19:58:12.460943] [DEBUG] [LOCAL ] MFSG: Primary data saved (5158 records). [2025-09-24T19:58:12.461040] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-24T19:58:12.461114] [INFO ] [MAIN ] Update Progress: 1342/2373 symbols completed. MFSG took 32.5s. Estimated remaining: 2h 16m 52s. Rate: 7.5 symbols/min [2025-09-24T19:58:12.640536] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:12.650155] [DEBUG] [LOCAL ] MGF: Loaded 4103 existing records from primary storage. [2025-09-24T19:58:12.650287] [INFO ] [MAIN ] MGF: Loaded 4103 existing records. [2025-09-24T19:58:12.828355] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-24T19:58:12.834182] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:12.835592] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-24T19:58:12.835678] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-24T19:58:12.835977] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-24T19:58:12.836038] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-24T19:58:13.219070] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T19:58:13.310559] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:13.616135] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-24T19:58:14.069042] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T19:58:14.416050] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-24T19:58:14.611474] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T19:58:15.138597] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T19:58:15.140226] [INFO ] [REMOTE ] MFSV: Full fetch complete (3044 records). [2025-09-24T19:58:15.140301] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-24T19:58:15.221187] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-24T19:58:15.502875] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-24T19:58:15.502960] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-24T19:58:15.503096] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-24T19:58:15.503134] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-24T19:58:15.503492] [DEBUG] [LOCAL ] MFSV: Trimmed 3044 records to 2435 (keeping 200 days of data) [2025-09-24T19:58:15.518151] [DEBUG] [LOCAL ] MFSV: Primary data saved (2435 records). [2025-09-24T19:58:15.518229] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-24T19:58:15.518299] [INFO ] [MAIN ] Update Progress: 1343/2373 symbols completed. MFSV took 26.6s. Estimated remaining: 2h 16m 40s. Rate: 7.5 symbols/min [2025-09-24T19:58:15.693044] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:15.747735] [DEBUG] [LOCAL ] MGM: Loaded 53609 existing records from primary storage. [2025-09-24T19:58:15.747896] [INFO ] [MAIN ] MGM: Loaded 53609 existing records. [2025-09-24T19:58:15.929229] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:15.929506] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-24T19:58:15.929560] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-24T19:58:15.931013] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-24T19:58:15.931078] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-24T19:58:16.022294] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-24T19:58:16.264727] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T19:58:16.341934] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:16.816093] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-24T19:58:17.540948] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T19:58:17.616070] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-24T19:58:17.798615] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T19:58:18.416067] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-24T19:58:18.636723] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T19:58:19.216086] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-24T19:58:20.016089] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-24T19:58:20.131694] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T19:58:20.816086] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-24T19:58:21.103784] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T19:58:21.175168] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T19:58:21.293825] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T19:58:21.616078] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-24T19:58:22.164630] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T19:58:22.416108] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-24T19:58:23.216362] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-24T19:58:24.016059] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-24T19:58:24.224639] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T19:58:24.484863] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-24T19:58:24.816095] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-24T19:58:24.872809] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T19:58:25.616149] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-24T19:58:26.373590] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T19:58:26.416033] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-24T19:58:27.216087] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-24T19:58:27.355729] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T19:58:27.679238] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-24T19:58:27.913585] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T19:58:28.016039] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-24T19:58:28.816083] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-24T19:58:29.616049] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-24T19:58:29.834443] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T19:58:29.951027] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T19:58:30.100414] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T19:58:30.416131] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-24T19:58:31.216085] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-24T19:58:32.019623] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-24T19:58:32.026698] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T19:58:32.491263] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T19:58:32.816075] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-24T19:58:32.973336] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T19:58:33.547478] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T19:58:33.616043] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-24T19:58:34.211481] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-24T19:58:34.416142] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-24T19:58:35.216161] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-24T19:58:36.016157] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-24T19:58:36.264936] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T19:58:36.277584] [INFO ] [REMOTE ] MGA: Full fetch complete (73702 records). [2025-09-24T19:58:36.277878] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-24T19:58:36.490953] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T19:58:36.780023] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T19:58:36.789280] [INFO ] [REMOTE ] MGF: Full fetch complete (5813 records). [2025-09-24T19:58:36.806633] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-24T19:58:36.832078] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-24T19:58:36.878567] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-24T19:58:36.933858] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-24T19:58:36.951018] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-24T19:58:36.951216] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-24T19:58:37.007050] [DEBUG] [LOCAL ] MGA: Trimmed 73702 records to 50648 (keeping 200 days of data) [2025-09-24T19:58:37.335169] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-24T19:58:37.336146] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-24T19:58:37.336431] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-24T19:58:37.336797] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-24T19:58:37.338448] [DEBUG] [LOCAL ] MGF: Trimmed 5813 records to 4107 (keeping 200 days of data) [2025-09-24T19:58:37.371096] [DEBUG] [LOCAL ] MGF: Primary data saved (4107 records). [2025-09-24T19:58:37.371811] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-24T19:58:37.371943] [INFO ] [MAIN ] Update Progress: 1344/2373 symbols completed. MGF took 24.9s. Estimated remaining: 2h 16m 43s. Rate: 7.5 symbols/min [2025-09-24T19:58:37.557684] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:37.571286] [DEBUG] [LOCAL ] MGR: Loaded 5653 existing records from primary storage. [2025-09-24T19:58:37.571994] [INFO ] [MAIN ] MGR: Loaded 5653 existing records. [2025-09-24T19:58:37.627811] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-24T19:58:37.862667] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:37.866542] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-24T19:58:37.867463] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-24T19:58:37.868767] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-24T19:58:37.868846] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-24T19:58:38.274364] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:38.355743] [DEBUG] [LOCAL ] MGA: Primary data saved (50648 records). [2025-09-24T19:58:38.355903] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-24T19:58:38.355997] [INFO ] [MAIN ] Update Progress: 1345/2373 symbols completed. MGA took 33.8s. Estimated remaining: 2h 16m 29s. Rate: 7.5 symbols/min [2025-09-24T19:58:38.420721] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-24T19:58:38.565206] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:38.573733] [DEBUG] [LOCAL ] MGRB: Loaded 4083 existing records from primary storage. [2025-09-24T19:58:38.573920] [INFO ] [MAIN ] MGRB: Loaded 4083 existing records. [2025-09-24T19:58:38.646329] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T19:58:38.813737] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:38.814166] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-24T19:58:38.814281] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-24T19:58:38.815000] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-24T19:58:38.815112] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-24T19:58:38.983499] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-24T19:58:39.187727] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T19:58:39.217003] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-24T19:58:39.262095] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:40.010238] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T19:58:40.016019] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-24T19:58:40.816075] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-24T19:58:41.042620] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T19:58:41.045828] [INFO ] [REMOTE ] MG: Full fetch complete (24057 records). [2025-09-24T19:58:41.045946] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-24T19:58:41.449320] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-24T19:58:41.449413] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-24T19:58:41.450060] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-24T19:58:41.450125] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-24T19:58:41.450990] [DEBUG] [LOCAL ] MG: Trimmed 24057 records to 16674 (keeping 200 days of data) [2025-09-24T19:58:41.554952] [DEBUG] [LOCAL ] MG: Primary data saved (16674 records). [2025-09-24T19:58:41.555128] [INFO ] [MAIN ] MG: Full history saved. [2025-09-24T19:58:41.555248] [INFO ] [MAIN ] Update Progress: 1346/2373 symbols completed. MG took 48.7s. Estimated remaining: 2h 16m 18s. Rate: 7.5 symbols/min [2025-09-24T19:58:41.621739] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-24T19:58:41.746712] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:41.751502] [DEBUG] [LOCAL ] MGRD: Loaded 2211 existing records from primary storage. [2025-09-24T19:58:41.751770] [INFO ] [MAIN ] MGRD: Loaded 2211 existing records. [2025-09-24T19:58:41.849912] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T19:58:41.966979] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:41.967259] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-24T19:58:41.967324] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-24T19:58:41.967592] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-24T19:58:41.967702] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-24T19:58:42.358891] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:42.416096] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-24T19:58:42.989681] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T19:58:43.223726] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-24T19:58:43.243914] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T19:58:43.689558] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T19:58:44.016140] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-24T19:58:44.475064] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T19:58:44.816083] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-24T19:58:45.429069] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T19:58:45.616149] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-24T19:58:46.280691] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T19:58:46.416090] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-24T19:58:47.216198] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-24T19:58:47.781549] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T19:58:48.016079] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-24T19:58:48.058503] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T19:58:48.491768] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T19:58:48.816141] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-24T19:58:49.616301] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-24T19:58:50.359019] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T19:58:50.416069] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-24T19:58:50.729072] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T19:58:50.741377] [INFO ] [REMOTE ] MGM: Full fetch complete (77597 records). [2025-09-24T19:58:50.741523] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-24T19:58:51.088770] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-24T19:58:51.176511] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-24T19:58:51.176591] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-24T19:58:51.177812] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-24T19:58:51.177881] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-24T19:58:51.179413] [DEBUG] [LOCAL ] MGM: Trimmed 77597 records to 53608 (keeping 200 days of data) [2025-09-24T19:58:51.241090] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-24T19:58:51.520744] [DEBUG] [LOCAL ] MGM: Primary data saved (53608 records). [2025-09-24T19:58:51.520898] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-24T19:58:51.521044] [INFO ] [MAIN ] Update Progress: 1347/2373 symbols completed. MGM took 36.0s. Estimated remaining: 2h 16m 11s. Rate: 7.5 symbols/min [2025-09-24T19:58:51.697782] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:58:51.707680] [DEBUG] [LOCAL ] MGRE: Loaded 6610 existing records from primary storage. [2025-09-24T19:58:51.707783] [INFO ] [MAIN ] MGRE: Loaded 6610 existing records. [2025-09-24T19:58:51.885179] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:58:51.885422] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-24T19:58:51.885469] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-24T19:58:51.885772] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-24T19:58:51.885843] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-24T19:58:52.005439] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-24T19:58:52.016319] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-24T19:58:52.282954] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:58:52.737561] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T19:58:52.816050] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-24T19:58:53.277410] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-24T19:58:53.616107] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-24T19:58:54.223147] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T19:58:54.416079] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-24T19:58:55.027373] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T19:58:55.216156] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-24T19:58:56.014466] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T19:58:56.016832] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-24T19:58:56.644135] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T19:58:56.816135] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-24T19:58:57.200621] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-24T19:58:57.616156] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-24T19:58:58.070504] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T19:58:58.416152] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-24T19:58:58.847049] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T19:58:59.216137] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-24T19:58:59.663068] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T19:59:00.016083] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-24T19:59:00.582119] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T19:59:00.816082] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-24T19:59:01.435453] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T19:59:01.436804] [INFO ] [REMOTE ] MGRB: Full fetch complete (6309 records). [2025-09-24T19:59:01.436988] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-24T19:59:01.626952] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-24T19:59:01.828633] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-24T19:59:01.828750] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-24T19:59:01.828956] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-24T19:59:01.829045] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-24T19:59:01.829505] [DEBUG] [LOCAL ] MGRB: Trimmed 6309 records to 4080 (keeping 200 days of data) [2025-09-24T19:59:01.860428] [DEBUG] [LOCAL ] MGRB: Primary data saved (4080 records). [2025-09-24T19:59:01.860604] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-24T19:59:01.860806] [INFO ] [MAIN ] Update Progress: 1348/2373 symbols completed. MGRB took 23.5s. Estimated remaining: 2h 16m 5s. Rate: 7.5 symbols/min [2025-09-24T19:59:02.042692] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:02.115573] [DEBUG] [LOCAL ] MGY: Loaded 52427 existing records from primary storage. [2025-09-24T19:59:02.115805] [INFO ] [MAIN ] MGY: Loaded 52427 existing records. [2025-09-24T19:59:02.230441] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T19:59:02.305472] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:59:02.305822] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-24T19:59:02.305897] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-24T19:59:02.307887] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-24T19:59:02.307960] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-24T19:59:02.421254] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-24T19:59:02.663735] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:02.974308] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T19:59:03.216082] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-24T19:59:03.841813] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T19:59:04.016074] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-24T19:59:04.389423] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-24T19:59:04.816102] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-24T19:59:05.410716] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T19:59:05.616081] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-24T19:59:06.073253] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T19:59:06.074234] [INFO ] [REMOTE ] MGRD: Full fetch complete (3482 records). [2025-09-24T19:59:06.074336] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-24T19:59:06.421344] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-24T19:59:06.493090] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-24T19:59:06.493200] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-24T19:59:06.493411] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-24T19:59:06.493481] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-24T19:59:06.493955] [DEBUG] [LOCAL ] MGRD: Trimmed 3482 records to 2214 (keeping 200 days of data) [2025-09-24T19:59:06.510400] [DEBUG] [LOCAL ] MGRD: Primary data saved (2214 records). [2025-09-24T19:59:06.510532] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-24T19:59:06.510711] [INFO ] [MAIN ] Update Progress: 1349/2373 symbols completed. MGRD took 25.0s. Estimated remaining: 2h 15m 55s. Rate: 7.5 symbols/min [2025-09-24T19:59:06.725786] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:06.726152] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-24T19:59:06.726210] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-24T19:59:06.726399] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-24T19:59:06.726445] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-24T19:59:06.726494] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-24T19:59:06.726547] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-24T19:59:07.133292] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:07.151897] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T19:59:07.216091] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-24T19:59:07.905607] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T19:59:08.016103] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-24T19:59:08.816110] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-24T19:59:09.026987] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:09.027480] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-24T19:59:09.617933] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-24T19:59:09.625307] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T19:59:10.285636] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T19:59:10.416084] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-24T19:59:11.216102] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-24T19:59:11.775987] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T19:59:12.016093] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-24T19:59:12.195166] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T19:59:12.693145] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T19:59:12.816091] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-24T19:59:13.616123] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-24T19:59:13.678966] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T19:59:14.290310] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T19:59:14.292241] [INFO ] [REMOTE ] MGR: Full fetch complete (8365 records). [2025-09-24T19:59:14.292315] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-24T19:59:14.421165] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-24T19:59:14.680851] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-24T19:59:14.680931] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-24T19:59:14.681148] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-24T19:59:14.681186] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-24T19:59:14.681755] [DEBUG] [LOCAL ] MGR: Trimmed 8365 records to 5627 (keeping 200 days of data) [2025-09-24T19:59:14.717225] [DEBUG] [LOCAL ] MGR: Primary data saved (5627 records). [2025-09-24T19:59:14.717335] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-24T19:59:14.717496] [INFO ] [MAIN ] Update Progress: 1350/2373 symbols completed. MGR took 37.3s. Estimated remaining: 2h 15m 47s. Rate: 7.5 symbols/min [2025-09-24T19:59:14.890985] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:14.919439] [DEBUG] [LOCAL ] MHD: Loaded 12118 existing records from primary storage. [2025-09-24T19:59:14.919607] [INFO ] [MAIN ] MHD: Loaded 12118 existing records. [2025-09-24T19:59:15.118725] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:59:15.119064] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-24T19:59:15.119131] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-24T19:59:15.119806] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-24T19:59:15.119914] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-24T19:59:15.220836] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-24T19:59:15.241323] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T19:59:15.492754] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:15.525945] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:15.526099] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-24T19:59:16.016110] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-24T19:59:16.816061] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-24T19:59:16.984422] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T19:59:17.498937] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T19:59:17.616115] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-24T19:59:18.416122] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-24T19:59:18.540932] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T19:59:19.180363] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T19:59:19.182197] [INFO ] [REMOTE ] MGRE: Full fetch complete (9396 records). [2025-09-24T19:59:19.182287] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-24T19:59:19.221284] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-24T19:59:19.550077] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-24T19:59:19.550227] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-24T19:59:19.550516] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-24T19:59:19.550558] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-24T19:59:19.551046] [DEBUG] [LOCAL ] MGRE: Trimmed 9396 records to 6620 (keeping 200 days of data) [2025-09-24T19:59:19.595949] [DEBUG] [LOCAL ] MGRE: Primary data saved (6620 records). [2025-09-24T19:59:19.596083] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-24T19:59:19.596245] [INFO ] [MAIN ] Update Progress: 1351/2373 symbols completed. MGRE took 28.1s. Estimated remaining: 2h 15m 37s. Rate: 7.5 symbols/min [2025-09-24T19:59:19.767695] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:19.780322] [DEBUG] [LOCAL ] MHF: Loaded 8663 existing records from primary storage. [2025-09-24T19:59:19.780432] [INFO ] [MAIN ] MHF: Loaded 8663 existing records. [2025-09-24T19:59:19.963721] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:59:19.964037] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-24T19:59:19.964087] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-24T19:59:19.964621] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-24T19:59:19.964716] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-24T19:59:20.027046] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-24T19:59:20.208312] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T19:59:20.289515] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:20.310358] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-24T19:59:20.362994] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:20.816098] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-24T19:59:21.616064] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-24T19:59:21.821551] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T19:59:21.977462] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:21.977845] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-24T19:59:22.416088] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-24T19:59:23.216090] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-24T19:59:24.016087] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-24T19:59:24.136815] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T19:59:24.197591] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T19:59:24.803860] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T19:59:24.816025] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-24T19:59:25.525291] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T19:59:25.616088] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-24T19:59:26.416108] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-24T19:59:27.216131] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-24T19:59:27.360515] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T19:59:27.372091] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-24T19:59:27.433142] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:27.433409] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-24T19:59:28.016082] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-24T19:59:28.802445] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T19:59:28.816024] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-24T19:59:29.523635] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T19:59:29.616088] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-24T19:59:30.416099] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-24T19:59:31.219638] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T19:59:31.217203] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-24T19:59:31.353132] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T19:59:31.724241] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-24T19:59:32.016126] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-24T19:59:32.816112] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-24T19:59:33.424321] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T19:59:33.488387] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T19:59:33.616126] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-24T19:59:33.806254] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:33.806601] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-24T19:59:34.416109] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-24T19:59:35.212675] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T19:59:35.216039] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-24T19:59:36.016083] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-24T19:59:36.074894] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T19:59:36.816114] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-24T19:59:37.014198] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T19:59:37.014542] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-24T19:59:37.605860] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T19:59:37.616030] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-24T19:59:38.416143] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-24T19:59:38.512131] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T19:59:39.144777] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-24T19:59:39.148313] [INFO ] [REMOTE ] MHD: Full fetch complete (18761 records). [2025-09-24T19:59:39.148430] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-24T19:59:39.221247] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-24T19:59:39.518477] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-24T19:59:39.518630] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-24T19:59:39.519086] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-24T19:59:39.519131] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-24T19:59:39.519721] [DEBUG] [LOCAL ] MHD: Trimmed 18761 records to 12114 (keeping 200 days of data) [2025-09-24T19:59:39.601230] [DEBUG] [LOCAL ] MHD: Primary data saved (12114 records). [2025-09-24T19:59:39.601379] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-24T19:59:39.601466] [INFO ] [MAIN ] Update Progress: 1352/2373 symbols completed. MHD took 24.9s. Estimated remaining: 2h 15m 38s. Rate: 7.5 symbols/min [2025-09-24T19:59:39.774228] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:39.825694] [DEBUG] [LOCAL ] MHK: Loaded 42523 existing records from primary storage. [2025-09-24T19:59:39.825866] [INFO ] [MAIN ] MHK: Loaded 42523 existing records. [2025-09-24T19:59:40.002844] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:59:40.003099] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-24T19:59:40.003147] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-24T19:59:40.004265] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-24T19:59:40.004327] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-24T19:59:40.024703] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-24T19:59:40.388038] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:40.714370] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T19:59:40.816046] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-24T19:59:41.616088] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-24T19:59:41.830290] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T19:59:42.364967] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T19:59:42.373040] [INFO ] [REMOTE ] MH: Full fetch complete (12266 records). [2025-09-24T19:59:42.373197] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-24T19:59:42.421264] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-24T19:59:42.602543] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-24T19:59:42.602865] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-24T19:59:42.602955] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-24T19:59:42.603030] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-24T19:59:42.603095] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-24T19:59:42.603144] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-24T19:59:42.603226] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-24T19:59:42.603309] [INFO ] [MAIN ] Update Progress: 1353/2373 symbols completed. MH took 36.1s. Estimated remaining: 2h 15m 26s. Rate: 7.5 symbols/min [2025-09-24T19:59:42.781382] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:42.781564] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-24T19:59:42.781603] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-24T19:59:42.781773] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-24T19:59:42.781822] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-24T19:59:42.781921] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-24T19:59:42.781972] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-24T19:59:43.172086] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:43.196130] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T19:59:43.216042] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-24T19:59:43.641260] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-24T19:59:44.016059] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-24T19:59:44.508905] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T19:59:44.816058] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-24T19:59:44.828734] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T19:59:45.616134] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-24T19:59:46.416147] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-24T19:59:46.577684] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T19:59:46.588299] [INFO ] [REMOTE ] MGY: Full fetch complete (75530 records). [2025-09-24T19:59:46.588487] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-24T19:59:47.172415] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T19:59:47.231793] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-24T19:59:47.288745] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-24T19:59:47.288959] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-24T19:59:47.290765] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-24T19:59:47.290892] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-24T19:59:47.300439] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-24T19:59:47.305109] [DEBUG] [LOCAL ] MGY: Trimmed 75530 records to 52423 (keeping 200 days of data) [2025-09-24T19:59:47.567630] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-24T19:59:47.676733] [DEBUG] [LOCAL ] MGY: Primary data saved (52423 records). [2025-09-24T19:59:47.676928] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-24T19:59:47.677081] [INFO ] [MAIN ] Update Progress: 1354/2373 symbols completed. MGY took 45.8s. Estimated remaining: 2h 15m 16s. Rate: 7.5 symbols/min [2025-09-24T19:59:47.863897] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T19:59:47.873584] [DEBUG] [LOCAL ] MHN: Loaded 7787 existing records from primary storage. [2025-09-24T19:59:47.873728] [INFO ] [MAIN ] MHN: Loaded 7787 existing records. [2025-09-24T19:59:48.024440] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-24T19:59:48.062248] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T19:59:48.062525] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-24T19:59:48.062583] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-24T19:59:48.062994] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-24T19:59:48.063068] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-24T19:59:48.463428] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T19:59:48.555545] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T19:59:48.816178] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-24T19:59:49.525395] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T19:59:49.616168] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-24T19:59:50.341035] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T19:59:50.416134] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-24T19:59:51.216143] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-24T19:59:51.902119] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T19:59:51.968036] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T19:59:52.016102] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-24T19:59:52.369890] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T19:59:52.816080] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-24T19:59:53.180671] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-24T19:59:53.616097] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-24T19:59:54.416135] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-24T19:59:55.202015] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T19:59:55.216042] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-24T19:59:55.247152] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T19:59:56.016089] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-24T19:59:56.560768] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T19:59:56.598283] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T19:59:56.816087] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-24T19:59:57.616158] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-24T19:59:57.962953] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T19:59:58.238431] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T19:59:58.416076] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-24T19:59:58.650187] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-24T19:59:59.216134] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-24T19:59:59.898245] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T19:59:59.900761] [INFO ] [REMOTE ] MHF: Full fetch complete (12775 records). [2025-09-24T19:59:59.900852] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-24T20:00:00.016174] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-24T20:00:00.304874] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-24T20:00:00.304977] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-24T20:00:00.305330] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-24T20:00:00.305372] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-24T20:00:00.306143] [DEBUG] [LOCAL ] MHF: Trimmed 12775 records to 8635 (keeping 200 days of data) [2025-09-24T20:00:00.361776] [DEBUG] [LOCAL ] MHF: Primary data saved (8635 records). [2025-09-24T20:00:00.361938] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-24T20:00:00.362058] [INFO ] [MAIN ] Update Progress: 1355/2373 symbols completed. MHF took 40.8s. Estimated remaining: 2h 15m 11s. Rate: 7.5 symbols/min [2025-09-24T20:00:00.447821] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T20:00:00.553836] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:00.581226] [DEBUG] [LOCAL ] MHO: Loaded 24390 existing records from primary storage. [2025-09-24T20:00:00.581381] [INFO ] [MAIN ] MHO: Loaded 24390 existing records. [2025-09-24T20:00:00.780380] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:00.780702] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-24T20:00:00.780761] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-24T20:00:00.781439] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-24T20:00:00.781502] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-24T20:00:00.821328] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-24T20:00:01.165988] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:01.616108] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-24T20:00:02.408712] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:00:02.416086] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-24T20:00:03.216118] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-24T20:00:04.016267] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-24T20:00:04.102735] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T20:00:04.103876] [INFO ] [REMOTE ] MHLA: Full fetch complete (1553 records). [2025-09-24T20:00:04.104007] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-24T20:00:04.321407] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-24T20:00:04.321788] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:00:04.321865] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:00:04.321942] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-24T20:00:04.322023] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-24T20:00:04.322061] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-24T20:00:04.322102] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-24T20:00:04.322178] [INFO ] [MAIN ] Update Progress: 1356/2373 symbols completed. MHLA took 21.7s. Estimated remaining: 2h 15m 0s. Rate: 7.5 symbols/min [2025-09-24T20:00:04.536200] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:04.536547] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-24T20:00:04.536608] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-24T20:00:04.537066] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-24T20:00:04.537130] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-24T20:00:04.537199] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-24T20:00:04.537239] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-24T20:00:04.937680] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:04.938021] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-24T20:00:05.411407] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T20:00:05.528922] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:05.529275] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-24T20:00:05.616130] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-24T20:00:05.831145] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:05.831676] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-24T20:00:05.945020] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-24T20:00:06.202571] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (4.59 seconds). [2025-09-24T20:00:06.416089] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-24T20:00:06.638285] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:06.638630] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-24T20:00:07.216127] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-24T20:00:08.016148] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-24T20:00:08.221157] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:08.221615] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-24T20:00:08.699241] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T20:00:08.816119] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-24T20:00:09.616119] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-24T20:00:09.831869] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:09.832391] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-24T20:00:10.215815] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T20:00:10.416115] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-24T20:00:11.216114] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-24T20:00:11.784308] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T20:00:12.015961] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T20:00:12.016036] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-24T20:00:12.816113] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-24T20:00:13.035689] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:13.036161] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-24T20:00:13.560091] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T20:00:13.616120] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-24T20:00:14.251683] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T20:00:14.416074] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-24T20:00:15.216060] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-24T20:00:15.293557] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-24T20:00:16.016145] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-24T20:00:16.793439] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:00:16.816057] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-24T20:00:17.616076] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-24T20:00:17.936889] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T20:00:17.947493] [INFO ] [REMOTE ] MHK: Full fetch complete (60883 records). [2025-09-24T20:00:17.947696] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-24T20:00:18.121013] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T20:00:18.382670] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-24T20:00:18.389607] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-24T20:00:18.391540] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-24T20:00:18.392022] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-24T20:00:18.391920] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T20:00:18.396446] [DEBUG] [LOCAL ] MHK: Trimmed 60883 records to 42535 (keeping 200 days of data) [2025-09-24T20:00:18.455030] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-24T20:00:18.671824] [DEBUG] [LOCAL ] MHK: Primary data saved (42535 records). [2025-09-24T20:00:18.671975] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-24T20:00:18.672068] [INFO ] [MAIN ] Update Progress: 1357/2373 symbols completed. MHK took 39.1s. Estimated remaining: 2h 14m 57s. Rate: 7.5 symbols/min [2025-09-24T20:00:18.692246] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:18.692538] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-24T20:00:19.216126] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-24T20:00:20.016196] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-24T20:00:20.120197] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T20:00:20.220386] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:00:20.220781] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-24T20:00:20.816116] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-24T20:00:21.616076] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-24T20:00:21.755078] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T20:00:21.757496] [INFO ] [REMOTE ] MHN: Full fetch complete (11834 records). [2025-09-24T20:00:21.757599] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-24T20:00:22.133047] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-24T20:00:22.133163] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-24T20:00:22.133465] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-24T20:00:22.133506] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-24T20:00:22.134002] [DEBUG] [LOCAL ] MHN: Trimmed 11834 records to 7802 (keeping 200 days of data) [2025-09-24T20:00:22.179722] [DEBUG] [LOCAL ] MHN: Primary data saved (7802 records). [2025-09-24T20:00:22.179827] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-24T20:00:22.179911] [INFO ] [MAIN ] Update Progress: 1358/2373 symbols completed. MHN took 34.5s. Estimated remaining: 2h 14m 46s. Rate: 7.5 symbols/min [2025-09-24T20:00:22.416109] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-24T20:00:22.643326] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T20:00:23.216150] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-24T20:00:23.790611] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T20:00:24.016114] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-24T20:00:24.295387] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T20:00:24.816182] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-24T20:00:25.652933] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:00:25.659878] [INFO ] [REMOTE ] MIAX: Full fetch complete (8810 records). [2025-09-24T20:00:25.659996] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-24T20:00:25.848772] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 29 unique days, need 200 days [2025-09-24T20:00:25.849039] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:00:25.849112] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:00:25.849185] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-24T20:00:25.849252] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-24T20:00:25.849290] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-24T20:00:25.849331] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-24T20:00:25.849391] [INFO ] [MAIN ] Update Progress: 1359/2373 symbols completed. MIAX took 21.5s. Estimated remaining: 2h 14m 35s. Rate: 7.5 symbols/min [2025-09-24T20:00:26.136797] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T20:00:26.143253] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-24T20:00:27.501559] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T20:00:27.506307] [INFO ] [REMOTE ] MHO: Full fetch complete (37518 records). [2025-09-24T20:00:27.506404] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-24T20:00:27.899573] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-24T20:00:27.899675] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-24T20:00:27.900470] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-24T20:00:27.900533] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-24T20:00:27.901378] [DEBUG] [LOCAL ] MHO: Trimmed 37518 records to 24357 (keeping 200 days of data) [2025-09-24T20:00:28.067129] [DEBUG] [LOCAL ] MHO: Primary data saved (24357 records). [2025-09-24T20:00:28.067282] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-24T20:00:28.067391] [INFO ] [MAIN ] Update Progress: 1360/2373 symbols completed. MHO took 27.7s. Estimated remaining: 2h 14m 23s. Rate: 7.5 symbols/min [2025-09-24T20:00:28.686272] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:28.713334] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-24T20:00:28.769361] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-24T20:00:28.793157] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-24T20:00:28.814999] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-24T20:00:28.818838] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:28.837828] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:28.817199] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:28.838677] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-24T20:00:28.839450] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-24T20:00:28.930216] [DEBUG] [LOCAL ] MITP: Loaded 2436 existing records from primary storage. [2025-09-24T20:00:28.946619] [INFO ] [MAIN ] MITP: Loaded 2436 existing records. [2025-09-24T20:00:28.952687] [DEBUG] [LOCAL ] MIN: Loaded 13122 existing records from primary storage. [2025-09-24T20:00:28.979625] [INFO ] [MAIN ] MIN: Loaded 13122 existing records. [2025-09-24T20:00:29.488046] [DEBUG] [LOCAL ] MIR: Loaded 50832 existing records from primary storage. [2025-09-24T20:00:29.571140] [INFO ] [MAIN ] MIR: Loaded 50832 existing records. [2025-09-24T20:00:29.570563] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:29.608294] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-24T20:00:29.617174] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:29.661386] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-24T20:00:29.713008] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-24T20:00:29.742577] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-24T20:00:29.734967] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-24T20:00:29.745613] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:29.745822] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-24T20:00:29.772261] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-24T20:00:29.772309] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-24T20:00:29.823037] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-24T20:00:30.101216] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:30.175099] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-24T20:00:30.176696] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-24T20:00:30.220300] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-24T20:00:30.241518] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-24T20:00:30.334032] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-24T20:00:30.373445] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-24T20:00:30.731863] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:30.755363] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:30.761487] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-24T20:00:30.761185] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-24T20:00:30.908865] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T20:00:30.910548] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-24T20:00:30.997465] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:30.997835] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-24T20:00:31.344124] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T20:00:31.345376] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-24T20:00:31.364487] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T20:00:31.769198] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T20:00:31.792994] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T20:00:32.016085] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-24T20:00:32.480793] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T20:00:32.514424] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T20:00:32.816119] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-24T20:00:33.419742] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-24T20:00:33.616122] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-24T20:00:34.110349] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T20:00:34.416080] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-24T20:00:34.856295] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T20:00:35.216105] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-24T20:00:35.558886] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-24T20:00:36.016131] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-24T20:00:36.564520] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T20:00:36.816110] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-24T20:00:37.616079] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-24T20:00:38.000313] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-24T20:00:38.200503] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T20:00:38.416170] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-24T20:00:38.757528] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T20:00:39.216172] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-24T20:00:40.016136] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-24T20:00:40.462323] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T20:00:40.768369] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T20:00:40.816130] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-24T20:00:41.616148] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-24T20:00:42.013975] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T20:00:42.407340] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:00:42.417623] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-24T20:00:42.985321] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T20:00:43.216077] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-24T20:00:43.641118] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T20:00:44.016113] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-24T20:00:44.354595] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T20:00:44.816085] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-24T20:00:45.303979] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T20:00:45.616109] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-24T20:00:46.416111] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-24T20:00:46.751408] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-24T20:00:47.216109] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-24T20:00:47.281063] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:00:47.652067] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T20:00:47.652920] [INFO ] [REMOTE ] MITN: Full fetch complete (2299 records). [2025-09-24T20:00:47.653024] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-24T20:00:47.842380] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T20:00:47.842665] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:00:47.842790] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:00:47.842885] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-24T20:00:47.842973] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-24T20:00:47.843014] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-24T20:00:47.843057] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-24T20:00:47.843122] [INFO ] [MAIN ] Update Progress: 1361/2373 symbols completed. MITN took 19.8s. Estimated remaining: 2h 14m 23s. Rate: 7.5 symbols/min [2025-09-24T20:00:48.016435] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-24T20:00:48.016320] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:48.042849] [DEBUG] [LOCAL ] MITT: Loaded 22872 existing records from primary storage. [2025-09-24T20:00:48.042987] [INFO ] [MAIN ] MITT: Loaded 22872 existing records. [2025-09-24T20:00:48.224083] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:48.224326] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-24T20:00:48.224374] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-24T20:00:48.225094] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-24T20:00:48.225154] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-24T20:00:48.584704] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:48.771488] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T20:00:48.816046] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-24T20:00:49.486454] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-24T20:00:49.616127] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-24T20:00:50.416089] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-24T20:00:51.216070] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-24T20:00:51.307819] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T20:00:51.703702] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:00:51.888589] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T20:00:52.016085] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-24T20:00:52.816111] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-24T20:00:53.616083] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-24T20:00:53.719372] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T20:00:53.774356] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T20:00:54.416118] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-24T20:00:54.587011] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:00:54.903118] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-24T20:00:54.904092] [INFO ] [REMOTE ] MITP: Full fetch complete (3341 records). [2025-09-24T20:00:54.904159] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-24T20:00:55.228767] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-24T20:00:55.274308] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-24T20:00:55.274395] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-24T20:00:55.274545] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-24T20:00:55.274670] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-24T20:00:55.275073] [DEBUG] [LOCAL ] MITP: Trimmed 3341 records to 2428 (keeping 200 days of data) [2025-09-24T20:00:55.290776] [DEBUG] [LOCAL ] MITP: Primary data saved (2428 records). [2025-09-24T20:00:55.290880] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-24T20:00:55.290972] [INFO ] [MAIN ] Update Progress: 1362/2373 symbols completed. MITP took 27.2s. Estimated remaining: 2h 14m 15s. Rate: 7.5 symbols/min [2025-09-24T20:00:55.462930] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:00:55.471477] [DEBUG] [LOCAL ] MIY: Loaded 5983 existing records from primary storage. [2025-09-24T20:00:55.471590] [INFO ] [MAIN ] MIY: Loaded 5983 existing records. [2025-09-24T20:00:55.648496] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:00:55.648808] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-24T20:00:55.648863] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-24T20:00:55.649271] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-24T20:00:55.649333] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-24T20:00:56.018369] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-24T20:00:56.018290] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:00:56.816185] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-24T20:00:57.045667] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T20:00:57.073566] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T20:00:57.616150] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-24T20:00:57.674357] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T20:00:58.397342] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T20:00:58.416046] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-24T20:00:58.942055] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-24T20:00:59.216141] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-24T20:01:00.016062] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-24T20:01:00.143612] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T20:01:00.575143] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T20:01:00.816101] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-24T20:01:01.616091] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-24T20:01:02.161954] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T20:01:02.416057] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-24T20:01:02.727299] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T20:01:03.158404] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T20:01:03.216049] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-24T20:01:04.016083] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-24T20:01:04.816103] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-24T20:01:05.244821] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T20:01:05.254516] [INFO ] [REMOTE ] MIR: Full fetch complete (73410 records). [2025-09-24T20:01:05.254708] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-24T20:01:05.392976] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T20:01:05.619527] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-24T20:01:05.634508] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T20:01:05.682982] [INFO ] [REMOTE ] MIN: Full fetch complete (17816 records). [2025-09-24T20:01:05.701232] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-24T20:01:05.846325] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-24T20:01:05.851603] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-24T20:01:05.864672] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-24T20:01:05.873291] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-24T20:01:05.934534] [DEBUG] [LOCAL ] MIR: Trimmed 73410 records to 50842 (keeping 200 days of data) [2025-09-24T20:01:06.286446] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-24T20:01:06.289518] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-24T20:01:06.292742] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-24T20:01:06.292883] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-24T20:01:06.297150] [DEBUG] [LOCAL ] MIN: Trimmed 17816 records to 13147 (keeping 200 days of data) [2025-09-24T20:01:06.419572] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-24T20:01:06.503027] [DEBUG] [LOCAL ] MIN: Primary data saved (13147 records). [2025-09-24T20:01:06.505975] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-24T20:01:06.513628] [INFO ] [MAIN ] Update Progress: 1363/2373 symbols completed. MIN took 38.4s. Estimated remaining: 2h 14m 9s. Rate: 7.5 symbols/min [2025-09-24T20:01:06.750268] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:06.771739] [DEBUG] [LOCAL ] MIR: Primary data saved (50842 records). [2025-09-24T20:01:06.771910] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-24T20:01:06.772019] [INFO ] [MAIN ] Update Progress: 1364/2373 symbols completed. MIR took 38.7s. Estimated remaining: 2h 13m 56s. Rate: 7.5 symbols/min [2025-09-24T20:01:07.017209] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:07.019795] [DEBUG] [LOCAL ] MKC: Loaded 52433 existing records from primary storage. [2025-09-24T20:01:07.020510] [INFO ] [MAIN ] MKC: Loaded 52433 existing records. [2025-09-24T20:01:07.138503] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T20:01:07.216818] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-24T20:01:07.241954] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:07.242275] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-24T20:01:07.242344] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-24T20:01:07.250985] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-24T20:01:07.274897] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:01:07.273883] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-24T20:01:07.281033] [DEBUG] [LOCAL ] MKL: Loaded 34101 existing records from primary storage. [2025-09-24T20:01:07.323471] [INFO ] [MAIN ] MKL: Loaded 34101 existing records. [2025-09-24T20:01:07.730099] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:07.761555] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-24T20:01:07.764953] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-24T20:01:07.771128] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-24T20:01:07.791696] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-24T20:01:07.943948] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T20:01:07.938501] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:08.027213] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-24T20:01:08.258872] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:08.816046] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-24T20:01:09.214192] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T20:01:09.616103] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-24T20:01:09.636142] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:01:10.416091] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-24T20:01:10.832572] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:01:11.081998] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T20:01:11.216093] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-24T20:01:12.016164] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-24T20:01:12.265461] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T20:01:12.816129] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-24T20:01:13.093596] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T20:01:13.616114] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-24T20:01:13.957921] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T20:01:14.416105] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-24T20:01:15.216126] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-24T20:01:15.409855] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T20:01:15.443523] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:01:15.928674] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:01:15.930423] [INFO ] [REMOTE ] MIY: Full fetch complete (9073 records). [2025-09-24T20:01:15.930503] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-24T20:01:16.021373] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-24T20:01:16.329109] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-24T20:01:16.329255] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-24T20:01:16.329689] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-24T20:01:16.329760] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-24T20:01:16.330775] [DEBUG] [LOCAL ] MIY: Trimmed 9073 records to 6007 (keeping 200 days of data) [2025-09-24T20:01:16.372683] [DEBUG] [LOCAL ] MIY: Primary data saved (6007 records). [2025-09-24T20:01:16.372890] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-24T20:01:16.373006] [INFO ] [MAIN ] Update Progress: 1365/2373 symbols completed. MIY took 21.1s. Estimated remaining: 2h 13m 49s. Rate: 7.5 symbols/min [2025-09-24T20:01:16.551993] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:16.598513] [DEBUG] [LOCAL ] MLI: Loaded 43850 existing records from primary storage. [2025-09-24T20:01:16.598703] [INFO ] [MAIN ] MLI: Loaded 43850 existing records. [2025-09-24T20:01:16.781939] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:16.782263] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-24T20:01:16.782397] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-24T20:01:16.783979] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-24T20:01:16.784041] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-24T20:01:16.821254] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-24T20:01:17.163486] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:17.488085] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T20:01:17.616098] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-24T20:01:17.823262] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T20:01:17.827584] [INFO ] [REMOTE ] MITT: Full fetch complete (35103 records). [2025-09-24T20:01:17.827707] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-24T20:01:18.202264] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-24T20:01:18.202370] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-24T20:01:18.203297] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-24T20:01:18.203394] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-24T20:01:18.205357] [DEBUG] [LOCAL ] MITT: Trimmed 35103 records to 23064 (keeping 200 days of data) [2025-09-24T20:01:18.362475] [DEBUG] [LOCAL ] MITT: Primary data saved (23064 records). [2025-09-24T20:01:18.362624] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-24T20:01:18.362787] [INFO ] [MAIN ] Update Progress: 1366/2373 symbols completed. MITT took 30.5s. Estimated remaining: 2h 13m 37s. Rate: 7.5 symbols/min [2025-09-24T20:01:18.428209] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-24T20:01:18.542116] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:18.583059] [DEBUG] [LOCAL ] MLM: Loaded 30849 existing records from primary storage. [2025-09-24T20:01:18.583273] [INFO ] [MAIN ] MLM: Loaded 30849 existing records. [2025-09-24T20:01:18.767740] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:18.768016] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-24T20:01:18.768066] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-24T20:01:18.768978] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-24T20:01:18.769041] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-24T20:01:19.142778] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:19.216050] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-24T20:01:19.379480] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T20:01:20.016095] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-24T20:01:20.059498] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T20:01:20.648893] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T20:01:20.816093] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-24T20:01:21.616059] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-24T20:01:21.654838] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T20:01:22.416112] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-24T20:01:22.449837] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T20:01:23.216112] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-24T20:01:23.386159] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T20:01:24.016057] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-24T20:01:24.209526] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:01:24.518611] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T20:01:24.816114] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-24T20:01:25.392318] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T20:01:25.616122] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-24T20:01:25.909269] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T20:01:26.416122] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-24T20:01:27.216074] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-24T20:01:27.262984] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T20:01:28.021530] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-24T20:01:28.032568] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T20:01:28.683271] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T20:01:28.816046] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-24T20:01:29.021911] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T20:01:29.616137] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-24T20:01:30.192090] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T20:01:30.416132] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-24T20:01:31.216113] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-24T20:01:31.526791] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T20:01:32.016188] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-24T20:01:32.129151] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T20:01:32.343291] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T20:01:32.816103] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-24T20:01:33.616096] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-24T20:01:33.807891] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:01:34.416066] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-24T20:01:34.454548] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T20:01:35.216104] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-24T20:01:35.282300] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T20:01:35.945618] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T20:01:35.951705] [INFO ] [REMOTE ] MKL: Full fetch complete (49580 records). [2025-09-24T20:01:35.951813] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-24T20:01:36.021232] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-24T20:01:36.349137] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-24T20:01:36.349219] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-24T20:01:36.350118] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-24T20:01:36.350187] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-24T20:01:36.351290] [DEBUG] [LOCAL ] MKL: Trimmed 49580 records to 34084 (keeping 200 days of data) [2025-09-24T20:01:36.568352] [DEBUG] [LOCAL ] MKL: Primary data saved (34084 records). [2025-09-24T20:01:36.568494] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-24T20:01:36.568611] [INFO ] [MAIN ] Update Progress: 1367/2373 symbols completed. MKL took 29.8s. Estimated remaining: 2h 13m 36s. Rate: 7.5 symbols/min [2025-09-24T20:01:36.740475] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:36.768159] [DEBUG] [LOCAL ] MLNK: Loaded 25677 existing records from primary storage. [2025-09-24T20:01:36.768289] [INFO ] [MAIN ] MLNK: Loaded 25677 existing records. [2025-09-24T20:01:36.821076] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-24T20:01:36.970472] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:36.970965] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-24T20:01:36.971222] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-24T20:01:36.972178] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-24T20:01:36.972252] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-24T20:01:37.345620] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:37.378101] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T20:01:37.616053] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-24T20:01:37.741042] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T20:01:37.893892] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T20:01:38.416485] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-24T20:01:39.115729] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:01:39.216078] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-24T20:01:39.305135] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T20:01:40.016077] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-24T20:01:40.816085] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-24T20:01:41.187559] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T20:01:41.198631] [INFO ] [REMOTE ] MKC: Full fetch complete (75499 records). [2025-09-24T20:01:41.198837] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-24T20:01:41.542976] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T20:01:41.621587] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-24T20:01:41.650789] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-24T20:01:41.650883] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-24T20:01:41.652145] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-24T20:01:41.652426] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-24T20:01:41.653983] [DEBUG] [LOCAL ] MKC: Trimmed 75499 records to 52430 (keeping 200 days of data) [2025-09-24T20:01:41.993330] [DEBUG] [LOCAL ] MKC: Primary data saved (52430 records). [2025-09-24T20:01:41.993500] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-24T20:01:41.993706] [INFO ] [MAIN ] Update Progress: 1368/2373 symbols completed. MKC took 35.5s. Estimated remaining: 2h 13m 26s. Rate: 7.5 symbols/min [2025-09-24T20:01:42.192954] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T20:01:42.191671] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:42.207142] [DEBUG] [LOCAL ] MLP: Loaded 3085 existing records from primary storage. [2025-09-24T20:01:42.207243] [INFO ] [MAIN ] MLP: Loaded 3085 existing records. [2025-09-24T20:01:42.392473] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:42.392933] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-24T20:01:42.393005] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-24T20:01:42.393230] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-24T20:01:42.393307] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-24T20:01:42.422742] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-24T20:01:42.760533] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:42.790528] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T20:01:43.216097] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-24T20:01:43.561314] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T20:01:43.929683] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T20:01:44.016053] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-24T20:01:44.816089] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-24T20:01:45.090946] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T20:01:45.426789] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T20:01:45.616119] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-24T20:01:46.416182] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-24T20:01:46.842538] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T20:01:47.185368] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T20:01:47.216042] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-24T20:01:48.016065] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-24T20:01:48.367113] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T20:01:48.459357] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:01:48.816078] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-24T20:01:49.616121] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-24T20:01:50.160139] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T20:01:50.165257] [INFO ] [REMOTE ] MLM: Full fetch complete (45753 records). [2025-09-24T20:01:50.165353] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-24T20:01:50.421396] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-24T20:01:50.585861] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-24T20:01:50.585995] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-24T20:01:50.587188] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-24T20:01:50.587333] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-24T20:01:50.589084] [DEBUG] [LOCAL ] MLM: Trimmed 45753 records to 30687 (keeping 200 days of data) [2025-09-24T20:01:50.821613] [DEBUG] [LOCAL ] MLM: Primary data saved (30687 records). [2025-09-24T20:01:50.821912] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-24T20:01:50.822200] [INFO ] [MAIN ] Update Progress: 1369/2373 symbols completed. MLM took 32.5s. Estimated remaining: 2h 13m 19s. Rate: 7.5 symbols/min [2025-09-24T20:01:51.000519] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:51.028796] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T20:01:51.048233] [DEBUG] [LOCAL ] MLR: Loaded 12929 existing records from primary storage. [2025-09-24T20:01:51.048383] [INFO ] [MAIN ] MLR: Loaded 12929 existing records. [2025-09-24T20:01:51.217680] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-24T20:01:51.231821] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:51.232041] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-24T20:01:51.232087] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-24T20:01:51.232577] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-24T20:01:51.232637] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-24T20:01:51.596321] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:01:51.610535] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T20:01:52.016115] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-24T20:01:52.712193] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T20:01:52.816126] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-24T20:01:53.064566] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T20:01:53.300609] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T20:01:53.616131] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-24T20:01:54.226454] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T20:01:54.416093] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-24T20:01:55.216077] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-24T20:01:55.970555] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T20:01:56.016043] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-24T20:01:56.033440] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T20:01:56.816074] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-24T20:01:57.616077] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-24T20:01:57.805738] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T20:01:57.821710] [INFO ] [REMOTE ] MLI: Full fetch complete (63619 records). [2025-09-24T20:01:57.821969] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T20:01:57.824788] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-24T20:01:58.236833] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-24T20:01:58.236915] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-24T20:01:58.237851] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-24T20:01:58.237921] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-24T20:01:58.239224] [DEBUG] [LOCAL ] MLI: Trimmed 63619 records to 43813 (keeping 200 days of data) [2025-09-24T20:01:58.450108] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-24T20:01:58.511782] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T20:01:58.573999] [DEBUG] [LOCAL ] MLI: Primary data saved (43813 records). [2025-09-24T20:01:58.574145] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-24T20:01:58.574266] [INFO ] [MAIN ] Update Progress: 1370/2373 symbols completed. MLI took 42.2s. Estimated remaining: 2h 13m 11s. Rate: 7.5 symbols/min [2025-09-24T20:01:58.746461] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:01:58.805861] [DEBUG] [LOCAL ] MMC: Loaded 51808 existing records from primary storage. [2025-09-24T20:01:58.806009] [INFO ] [MAIN ] MMC: Loaded 51808 existing records. [2025-09-24T20:01:58.990204] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:01:58.990560] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-24T20:01:58.990618] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-24T20:01:58.992037] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-24T20:01:58.992114] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-24T20:01:59.216943] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-24T20:01:59.303675] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T20:01:59.378339] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:00.016082] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-24T20:02:00.189609] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T20:02:00.385512] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-24T20:02:00.816093] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-24T20:02:01.616094] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-24T20:02:02.039503] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T20:02:02.416160] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-24T20:02:02.709950] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T20:02:02.746271] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-24T20:02:03.216145] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-24T20:02:03.886628] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T20:02:03.888186] [INFO ] [REMOTE ] MLP: Full fetch complete (4656 records). [2025-09-24T20:02:03.888262] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-24T20:02:04.021256] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-24T20:02:04.283191] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-24T20:02:04.283286] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-24T20:02:04.283438] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-24T20:02:04.283478] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-24T20:02:04.283921] [DEBUG] [LOCAL ] MLP: Trimmed 4656 records to 3093 (keeping 200 days of data) [2025-09-24T20:02:04.303909] [DEBUG] [LOCAL ] MLP: Primary data saved (3093 records). [2025-09-24T20:02:04.304066] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-24T20:02:04.304174] [INFO ] [MAIN ] Update Progress: 1371/2373 symbols completed. MLP took 22.3s. Estimated remaining: 2h 13m 1s. Rate: 7.5 symbols/min [2025-09-24T20:02:04.477260] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:04.502412] [DEBUG] [LOCAL ] MMD: Loaded 11144 existing records from primary storage. [2025-09-24T20:02:04.502585] [INFO ] [MAIN ] MMD: Loaded 11144 existing records. [2025-09-24T20:02:04.691468] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:04.691776] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-24T20:02:04.691831] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-24T20:02:04.692346] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-24T20:02:04.692408] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-24T20:02:04.821384] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-24T20:02:05.079758] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:05.196909] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T20:02:05.616149] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-24T20:02:06.237694] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T20:02:06.416129] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-24T20:02:06.659960] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T20:02:07.216131] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-24T20:02:07.584822] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:02:07.591752] [INFO ] [REMOTE ] MLNK: Full fetch complete (35876 records). [2025-09-24T20:02:07.591974] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-24T20:02:08.004140] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-24T20:02:08.004514] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-24T20:02:08.005461] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-24T20:02:08.005535] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-24T20:02:08.006919] [DEBUG] [LOCAL ] MLNK: Trimmed 35876 records to 25614 (keeping 200 days of data) [2025-09-24T20:02:08.016141] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-24T20:02:08.187706] [DEBUG] [LOCAL ] MLNK: Primary data saved (25614 records). [2025-09-24T20:02:08.187902] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-24T20:02:08.188020] [INFO ] [MAIN ] Update Progress: 1372/2373 symbols completed. MLNK took 31.6s. Estimated remaining: 2h 12m 50s. Rate: 7.5 symbols/min [2025-09-24T20:02:08.367620] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:08.381059] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:02:08.402239] [DEBUG] [LOCAL ] MMI: Loaded 15328 existing records from primary storage. [2025-09-24T20:02:08.402415] [INFO ] [MAIN ] MMI: Loaded 15328 existing records. [2025-09-24T20:02:08.588160] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:08.588492] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-24T20:02:08.588550] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-24T20:02:08.589778] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-24T20:02:08.589851] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-24T20:02:08.816185] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-24T20:02:08.955028] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-24T20:02:09.050127] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:09.616136] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-24T20:02:10.400431] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T20:02:10.416029] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-24T20:02:10.757591] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T20:02:10.948966] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T20:02:11.216106] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-24T20:02:11.921910] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T20:02:12.016123] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-24T20:02:12.809950] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:02:12.816069] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-24T20:02:13.616095] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-24T20:02:13.640183] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T20:02:14.416125] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-24T20:02:14.632591] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T20:02:15.216103] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-24T20:02:16.016075] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-24T20:02:16.087682] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:02:16.148635] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:02:16.152198] [INFO ] [REMOTE ] MLR: Full fetch complete (18635 records). [2025-09-24T20:02:16.152317] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-24T20:02:16.566181] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-24T20:02:16.566355] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-24T20:02:16.566979] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-24T20:02:16.567051] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-24T20:02:16.568232] [DEBUG] [LOCAL ] MLR: Trimmed 18635 records to 12828 (keeping 200 days of data) [2025-09-24T20:02:16.666547] [DEBUG] [LOCAL ] MLR: Primary data saved (12828 records). [2025-09-24T20:02:16.666883] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-24T20:02:16.667008] [INFO ] [MAIN ] Update Progress: 1373/2373 symbols completed. MLR took 25.8s. Estimated remaining: 2h 12m 43s. Rate: 7.5 symbols/min [2025-09-24T20:02:16.817711] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-24T20:02:16.848638] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:16.858496] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T20:02:16.861821] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-24T20:02:16.862741] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-24T20:02:16.862941] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-24T20:02:16.862989] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-24T20:02:16.863037] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-24T20:02:16.863074] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-24T20:02:17.241808] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:17.616124] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-24T20:02:17.877861] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T20:02:18.416118] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-24T20:02:19.209018] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:02:19.219469] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-24T20:02:19.422231] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:19.422578] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-24T20:02:19.593589] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T20:02:20.016113] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-24T20:02:20.816045] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-09-24T20:02:21.058305] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:21.059339] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T20:02:21.064326] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-09-24T20:02:21.616108] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-24T20:02:22.416097] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-24T20:02:22.600162] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T20:02:23.216111] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-24T20:02:23.282475] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T20:02:24.016143] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-24T20:02:24.072520] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T20:02:24.816176] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-24T20:02:24.845701] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T20:02:25.616096] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-02. [2025-09-24T20:02:25.805522] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:25.805771] [WARN ] [REMOTE ] MMID: No data returned for month 2025-02 [2025-09-24T20:02:26.416117] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-03. [2025-09-24T20:02:26.549871] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:02:26.617272] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:26.617730] [WARN ] [REMOTE ] MMID: No data returned for month 2025-03 [2025-09-24T20:02:27.216083] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-24T20:02:28.016109] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-24T20:02:28.794972] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T20:02:28.816042] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-24T20:02:29.014800] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T20:02:29.616104] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-24T20:02:30.416062] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-04. [2025-09-24T20:02:30.620605] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:30.620974] [WARN ] [REMOTE ] MMID: No data returned for month 2025-04 [2025-09-24T20:02:30.677976] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T20:02:30.738613] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T20:02:31.216103] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-05. [2025-09-24T20:02:31.409702] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:31.410058] [WARN ] [REMOTE ] MMID: No data returned for month 2025-05 [2025-09-24T20:02:32.016076] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-24T20:02:32.816070] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-24T20:02:32.835782] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T20:02:33.417486] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T20:02:33.616170] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-06. [2025-09-24T20:02:33.832041] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:33.832367] [WARN ] [REMOTE ] MMID: No data returned for month 2025-06 [2025-09-24T20:02:34.416112] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-24T20:02:35.216062] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-24T20:02:35.415413] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T20:02:35.418419] [INFO ] [REMOTE ] MMI: Full fetch complete (20952 records). [2025-09-24T20:02:35.418496] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-24T20:02:35.808600] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-24T20:02:35.808723] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-24T20:02:35.809234] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-24T20:02:35.809279] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-24T20:02:35.809957] [DEBUG] [LOCAL ] MMI: Trimmed 20952 records to 15306 (keeping 200 days of data) [2025-09-24T20:02:35.883850] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-24T20:02:35.914186] [DEBUG] [LOCAL ] MMI: Primary data saved (15306 records). [2025-09-24T20:02:35.914321] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-24T20:02:35.914405] [INFO ] [MAIN ] Update Progress: 1374/2373 symbols completed. MMI took 27.7s. Estimated remaining: 2h 12m 43s. Rate: 7.5 symbols/min [2025-09-24T20:02:36.019722] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-24T20:02:36.094297] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:36.094477] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-24T20:02:36.094517] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-24T20:02:36.094740] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-24T20:02:36.094797] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-24T20:02:36.094844] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-24T20:02:36.094878] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-24T20:02:36.467197] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:36.816092] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-24T20:02:37.616136] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-24T20:02:37.769604] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T20:02:37.770681] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T20:02:38.060545] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-24T20:02:38.416099] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-24T20:02:39.216114] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-24T20:02:40.016104] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-07. [2025-09-24T20:02:40.219414] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:40.219748] [WARN ] [REMOTE ] MMID: No data returned for month 2025-07 [2025-09-24T20:02:40.277351] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T20:02:40.295296] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T20:02:40.297972] [INFO ] [REMOTE ] MMD: Full fetch complete (18011 records). [2025-09-24T20:02:40.298046] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-24T20:02:40.663237] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-24T20:02:40.663316] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-24T20:02:40.663781] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-24T20:02:40.663843] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-24T20:02:40.664380] [DEBUG] [LOCAL ] MMD: Trimmed 18011 records to 11203 (keeping 200 days of data) [2025-09-24T20:02:40.734517] [DEBUG] [LOCAL ] MMD: Primary data saved (11203 records). [2025-09-24T20:02:40.734686] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-24T20:02:40.734786] [INFO ] [MAIN ] Update Progress: 1375/2373 symbols completed. MMD took 36.4s. Estimated remaining: 2h 12m 33s. Rate: 7.5 symbols/min [2025-09-24T20:02:40.821260] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-24T20:02:40.909705] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:40.973101] [DEBUG] [LOCAL ] MMM: Loaded 53253 existing records from primary storage. [2025-09-24T20:02:40.973317] [INFO ] [MAIN ] MMM: Loaded 53253 existing records. [2025-09-24T20:02:41.149293] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:41.149577] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-24T20:02:41.149626] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-24T20:02:41.151227] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-24T20:02:41.151288] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-24T20:02:41.511473] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:41.616050] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-24T20:02:42.416080] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-08. [2025-09-24T20:02:42.632473] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:42.632868] [WARN ] [REMOTE ] MMID: No data returned for month 2025-08 [2025-09-24T20:02:42.873024] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T20:02:42.882371] [INFO ] [REMOTE ] MMC: Full fetch complete (74700 records). [2025-09-24T20:02:42.882496] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-24T20:02:43.225362] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-24T20:02:43.288460] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-24T20:02:43.288597] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-24T20:02:43.289750] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-24T20:02:43.289967] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-24T20:02:43.291533] [DEBUG] [LOCAL ] MMC: Trimmed 74700 records to 51817 (keeping 200 days of data) [2025-09-24T20:02:43.558533] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T20:02:43.672504] [DEBUG] [LOCAL ] MMC: Primary data saved (51817 records). [2025-09-24T20:02:43.672687] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-24T20:02:43.672817] [INFO ] [MAIN ] Update Progress: 1376/2373 symbols completed. MMC took 45.1s. Estimated remaining: 2h 12m 21s. Rate: 7.5 symbols/min [2025-09-24T20:02:43.791635] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T20:02:43.857352] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:43.894159] [DEBUG] [LOCAL ] MMS: Loaded 33982 existing records from primary storage. [2025-09-24T20:02:43.894359] [INFO ] [MAIN ] MMS: Loaded 33982 existing records. [2025-09-24T20:02:44.021267] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-24T20:02:44.077491] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:44.077762] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-24T20:02:44.077818] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-24T20:02:44.079188] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-24T20:02:44.079252] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-24T20:02:44.446907] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:44.816120] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-24T20:02:45.235182] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-24T20:02:45.616133] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-24T20:02:46.061755] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-24T20:02:46.416093] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-24T20:02:46.864521] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T20:02:47.150289] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T20:02:47.216045] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-24T20:02:48.016084] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-09. [2025-09-24T20:02:48.246862] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:02:48.247254] [WARN ] [REMOTE ] MMID: No data returned for month 2025-09 [2025-09-24T20:02:48.247373] [INFO ] [REMOTE ] MMID: Full fetch complete (0 records). [2025-09-24T20:02:48.247439] [DEBUG] [VALIDATOR ] MMID: Validating primary data. [2025-09-24T20:02:48.247500] [WARN ] [VALIDATOR ] MMID: No data provided for validation! [2025-09-24T20:02:48.247578] [FATAL] [MAIN ] MMID: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:02:48.247687] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:02:48.247788] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-24T20:02:48.247886] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-24T20:02:48.247942] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-24T20:02:48.248078] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-24T20:02:48.248210] [INFO ] [MAIN ] Update Progress: 1377/2373 symbols completed. MMID took 31.6s. Estimated remaining: 2h 12m 11s. Rate: 7.5 symbols/min [2025-09-24T20:02:48.441517] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:48.454416] [DEBUG] [LOCAL ] MMT: Loaded 11029 existing records from primary storage. [2025-09-24T20:02:48.454555] [INFO ] [MAIN ] MMT: Loaded 11029 existing records. [2025-09-24T20:02:48.653496] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:48.653872] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-24T20:02:48.653948] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-24T20:02:48.654495] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-24T20:02:48.654557] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-24T20:02:48.826547] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-24T20:02:49.001980] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T20:02:49.083777] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:49.351992] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-24T20:02:49.616110] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-24T20:02:50.416115] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-24T20:02:50.859518] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T20:02:51.201390] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T20:02:51.216028] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-24T20:02:52.016129] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-24T20:02:52.407963] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-24T20:02:52.708752] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T20:02:52.816124] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-24T20:02:53.158184] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T20:02:53.616140] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-24T20:02:54.125855] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T20:02:54.416127] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-24T20:02:55.216092] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-24T20:02:55.654784] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:02:56.016137] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-24T20:02:56.062477] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T20:02:56.449934] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T20:02:56.451103] [INFO ] [REMOTE ] MMKT: Full fetch complete (2133 records). [2025-09-24T20:02:56.451196] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-24T20:02:56.717150] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T20:02:56.717409] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:02:56.717494] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:02:56.717581] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-24T20:02:56.717693] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-24T20:02:56.717763] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-24T20:02:56.717823] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-24T20:02:56.717944] [INFO ] [MAIN ] Update Progress: 1378/2373 symbols completed. MMKT took 20.8s. Estimated remaining: 2h 12m 3s. Rate: 7.5 symbols/min [2025-09-24T20:02:56.821719] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-24T20:02:56.900065] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:02:56.917479] [DEBUG] [LOCAL ] MMU: Loaded 16994 existing records from primary storage. [2025-09-24T20:02:56.917599] [INFO ] [MAIN ] MMU: Loaded 16994 existing records. [2025-09-24T20:02:57.108703] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:02:57.108996] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-24T20:02:57.109073] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-24T20:02:57.109781] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-24T20:02:57.109844] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-24T20:02:57.496281] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:02:57.616074] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-24T20:02:57.743388] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T20:02:58.416081] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-24T20:02:58.674162] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T20:02:59.031712] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T20:02:59.216081] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-24T20:03:00.016081] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-24T20:03:00.111547] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T20:03:00.816074] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-24T20:03:01.572674] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:03:01.591283] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T20:03:01.616092] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-24T20:03:02.416092] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-24T20:03:03.097801] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T20:03:03.216072] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-24T20:03:04.016129] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-24T20:03:04.098380] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T20:03:04.120771] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T20:03:04.816119] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-24T20:03:05.435203] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T20:03:05.616068] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-24T20:03:05.936229] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T20:03:06.364097] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T20:03:06.416150] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-24T20:03:07.182160] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T20:03:07.216033] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-24T20:03:08.016064] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-24T20:03:08.121884] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T20:03:08.816112] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-24T20:03:09.026475] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T20:03:09.616071] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-24T20:03:09.699449] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T20:03:10.159106] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T20:03:10.416086] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-24T20:03:11.216134] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-24T20:03:11.924155] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:03:11.925545] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:03:11.935139] [INFO ] [REMOTE ] MMT: Full fetch complete (16363 records). [2025-09-24T20:03:11.935551] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-24T20:03:12.021210] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-24T20:03:12.323662] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-24T20:03:12.323754] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-24T20:03:12.324192] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-24T20:03:12.324231] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-24T20:03:12.324815] [DEBUG] [LOCAL ] MMT: Trimmed 16363 records to 10920 (keeping 200 days of data) [2025-09-24T20:03:12.388150] [DEBUG] [LOCAL ] MMT: Primary data saved (10920 records). [2025-09-24T20:03:12.388291] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-24T20:03:12.388392] [INFO ] [MAIN ] Update Progress: 1379/2373 symbols completed. MMT took 24.1s. Estimated remaining: 2h 12m 1s. Rate: 7.5 symbols/min [2025-09-24T20:03:12.564463] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:12.590403] [DEBUG] [LOCAL ] MNR: Loaded 24702 existing records from primary storage. [2025-09-24T20:03:12.590564] [INFO ] [MAIN ] MNR: Loaded 24702 existing records. [2025-09-24T20:03:12.777767] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:03:12.778010] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-24T20:03:12.778067] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-24T20:03:12.779022] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-24T20:03:12.779086] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-24T20:03:12.823503] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-24T20:03:13.169821] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:13.530967] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T20:03:13.616036] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-24T20:03:13.822036] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T20:03:14.416141] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-24T20:03:15.143873] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T20:03:15.150933] [INFO ] [REMOTE ] MMS: Full fetch complete (52223 records). [2025-09-24T20:03:15.151089] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-24T20:03:15.221377] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-24T20:03:15.554910] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-24T20:03:15.555045] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-24T20:03:15.555928] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-24T20:03:15.556011] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-24T20:03:15.571738] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:03:15.577269] [DEBUG] [LOCAL ] MMS: Trimmed 52223 records to 33878 (keeping 200 days of data) [2025-09-24T20:03:15.787745] [DEBUG] [LOCAL ] MMS: Primary data saved (33878 records). [2025-09-24T20:03:15.787883] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-24T20:03:15.787966] [INFO ] [MAIN ] Update Progress: 1380/2373 symbols completed. MMS took 32.1s. Estimated remaining: 2h 11m 50s. Rate: 7.5 symbols/min [2025-09-24T20:03:15.960464] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:16.004327] [DEBUG] [LOCAL ] MNSO: Loaded 44382 existing records from primary storage. [2025-09-24T20:03:16.004523] [INFO ] [MAIN ] MNSO: Loaded 44382 existing records. [2025-09-24T20:03:16.025250] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-24T20:03:16.188216] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:03:16.188447] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-24T20:03:16.188506] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-24T20:03:16.190517] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-24T20:03:16.190582] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-24T20:03:16.353725] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T20:03:16.565263] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:16.816067] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-24T20:03:17.616092] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-24T20:03:17.968884] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T20:03:18.416106] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-24T20:03:18.682624] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T20:03:19.216085] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-24T20:03:19.788145] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-24T20:03:19.828583] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T20:03:20.016056] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-24T20:03:20.105504] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T20:03:20.109860] [INFO ] [REMOTE ] MMU: Full fetch complete (25723 records). [2025-09-24T20:03:20.109999] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-24T20:03:20.527872] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-24T20:03:20.527985] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-24T20:03:20.528741] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-24T20:03:20.528812] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-24T20:03:20.529947] [DEBUG] [LOCAL ] MMU: Trimmed 25723 records to 16934 (keeping 200 days of data) [2025-09-24T20:03:20.643927] [DEBUG] [LOCAL ] MMU: Primary data saved (16934 records). [2025-09-24T20:03:20.644096] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-24T20:03:20.644190] [INFO ] [MAIN ] Update Progress: 1381/2373 symbols completed. MMU took 23.9s. Estimated remaining: 2h 11m 39s. Rate: 7.5 symbols/min [2025-09-24T20:03:20.821777] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-24T20:03:20.854533] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:20.854789] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-24T20:03:20.854860] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-24T20:03:20.855019] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-24T20:03:20.855087] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-24T20:03:20.855146] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-24T20:03:20.855182] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-24T20:03:21.253683] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T20:03:21.308833] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:21.616151] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-24T20:03:21.832698] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:03:21.833173] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-24T20:03:22.416120] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-24T20:03:22.653345] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T20:03:23.216064] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-24T20:03:23.500069] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T20:03:24.016166] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-24T20:03:24.816069] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-24T20:03:24.848427] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T20:03:25.058534] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:03:25.060105] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T20:03:25.071411] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-24T20:03:25.616133] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-24T20:03:26.416094] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-24T20:03:26.616719] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:03:26.617064] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-24T20:03:27.216042] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-24T20:03:27.404007] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:03:28.016132] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-24T20:03:28.606923] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T20:03:28.816097] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-24T20:03:29.026352] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:03:29.026703] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-24T20:03:29.616037] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-24T20:03:29.814256] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T20:03:30.416099] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-24T20:03:30.891709] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T20:03:31.216120] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-24T20:03:32.016908] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-24T20:03:32.020104] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T20:03:32.488406] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T20:03:32.816131] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-24T20:03:33.616136] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-24T20:03:33.948182] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T20:03:34.008463] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-24T20:03:34.416091] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-24T20:03:34.639822] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:03:34.640156] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-24T20:03:35.206559] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T20:03:35.216029] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-24T20:03:36.016124] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-24T20:03:36.816109] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-24T20:03:37.018432] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T20:03:37.026467] [INFO ] [REMOTE ] MNR: Full fetch complete (37034 records). [2025-09-24T20:03:37.026803] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-24T20:03:37.403949] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-24T20:03:37.621332] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-24T20:03:37.708223] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-24T20:03:37.708360] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-24T20:03:37.709297] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-24T20:03:37.709366] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-24T20:03:37.710707] [DEBUG] [LOCAL ] MNR: Trimmed 37034 records to 24681 (keeping 200 days of data) [2025-09-24T20:03:37.891482] [DEBUG] [LOCAL ] MNR: Primary data saved (24681 records). [2025-09-24T20:03:37.891675] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-24T20:03:37.891792] [INFO ] [MAIN ] Update Progress: 1382/2373 symbols completed. MNR took 25.5s. Estimated remaining: 2h 11m 38s. Rate: 7.5 symbols/min [2025-09-24T20:03:38.086965] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:38.087240] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-24T20:03:38.087306] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-24T20:03:38.087462] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-24T20:03:38.087507] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-24T20:03:38.087552] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-24T20:03:38.087587] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-24T20:03:38.421299] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-24T20:03:38.489935] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:38.517346] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T20:03:38.630171] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T20:03:38.641074] [INFO ] [REMOTE ] MMM: Full fetch complete (77140 records). [2025-09-24T20:03:38.641219] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-24T20:03:39.045600] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-24T20:03:39.045730] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-24T20:03:39.046866] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-24T20:03:39.046934] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-24T20:03:39.048525] [DEBUG] [LOCAL ] MMM: Trimmed 77140 records to 53229 (keeping 200 days of data) [2025-09-24T20:03:39.236745] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-24T20:03:39.394403] [DEBUG] [LOCAL ] MMM: Primary data saved (53229 records). [2025-09-24T20:03:39.394559] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-24T20:03:39.394672] [INFO ] [MAIN ] Update Progress: 1383/2373 symbols completed. MMM took 58.7s. Estimated remaining: 2h 11m 25s. Rate: 7.5 symbols/min [2025-09-24T20:03:39.565490] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:39.613348] [DEBUG] [LOCAL ] MOD: Loaded 45597 existing records from primary storage. [2025-09-24T20:03:39.613496] [INFO ] [MAIN ] MOD: Loaded 45597 existing records. [2025-09-24T20:03:39.796879] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:03:39.797159] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-24T20:03:39.797240] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-24T20:03:39.798794] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-24T20:03:39.798859] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-24T20:03:40.016407] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-24T20:03:40.174446] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:40.209524] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T20:03:40.697294] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T20:03:40.816085] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-24T20:03:41.616094] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-24T20:03:42.419915] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-24T20:03:42.425756] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T20:03:42.511483] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-24T20:03:43.221202] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-24T20:03:43.231615] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:03:44.016070] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-24T20:03:44.061845] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T20:03:44.816102] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-24T20:03:45.616068] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-24T20:03:45.688118] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T20:03:45.729000] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-24T20:03:46.371366] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:03:46.416129] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-24T20:03:46.815568] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T20:03:47.216154] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-24T20:03:48.016177] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-24T20:03:48.566144] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-24T20:03:48.816107] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-24T20:03:49.008863] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T20:03:49.527463] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T20:03:49.534892] [INFO ] [REMOTE ] MNTN: Full fetch complete (24989 records). [2025-09-24T20:03:49.534979] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-24T20:03:49.621407] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-24T20:03:49.759311] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 86 unique days, need 200 days [2025-09-24T20:03:49.759799] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:03:49.759910] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:03:49.760029] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-24T20:03:49.760172] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-24T20:03:49.760249] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-24T20:03:49.760339] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-24T20:03:49.760462] [INFO ] [MAIN ] Update Progress: 1384/2373 symbols completed. MNTN took 29.1s. Estimated remaining: 2h 11m 19s. Rate: 7.5 symbols/min [2025-09-24T20:03:49.957827] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:50.024265] [DEBUG] [LOCAL ] MODG: Loaded 51574 existing records from primary storage. [2025-09-24T20:03:50.024418] [INFO ] [MAIN ] MODG: Loaded 51574 existing records. [2025-09-24T20:03:50.221907] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:03:50.222209] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-24T20:03:50.222283] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-24T20:03:50.223962] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-24T20:03:50.224039] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-24T20:03:50.424521] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-24T20:03:50.620127] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:51.214123] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-24T20:03:51.218601] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-24T20:03:51.556193] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T20:03:52.016066] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-24T20:03:52.096756] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T20:03:52.683082] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T20:03:52.816101] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-24T20:03:53.616089] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-24T20:03:54.363752] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T20:03:54.417755] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-24T20:03:54.420527] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T20:03:55.216121] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-24T20:03:55.521986] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T20:03:56.016144] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-24T20:03:56.057052] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T20:03:56.816061] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-24T20:03:56.892909] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:03:56.906377] [INFO ] [REMOTE ] MNSO: Full fetch complete (64249 records). [2025-09-24T20:03:56.906734] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-24T20:03:57.368793] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-24T20:03:57.368889] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-24T20:03:57.369861] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-24T20:03:57.369947] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-24T20:03:57.371330] [DEBUG] [LOCAL ] MNSO: Trimmed 64249 records to 44333 (keeping 200 days of data) [2025-09-24T20:03:57.616957] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-24T20:03:57.679834] [DEBUG] [LOCAL ] MNSO: Primary data saved (44333 records). [2025-09-24T20:03:57.680057] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-24T20:03:57.680473] [INFO ] [MAIN ] Update Progress: 1385/2373 symbols completed. MNSO took 41.9s. Estimated remaining: 2h 11m 11s. Rate: 7.5 symbols/min [2025-09-24T20:03:57.877944] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:03:57.926300] [DEBUG] [LOCAL ] MOH: Loaded 41771 existing records from primary storage. [2025-09-24T20:03:57.926476] [INFO ] [MAIN ] MOH: Loaded 41771 existing records. [2025-09-24T20:03:58.108929] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:03:58.109443] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-24T20:03:58.109492] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-24T20:03:58.111894] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-24T20:03:58.111968] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-24T20:03:58.513075] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:03:58.513946] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-24T20:03:58.558544] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-24T20:03:58.608974] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T20:03:58.890894] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T20:03:59.216109] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-24T20:03:59.764898] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T20:04:00.016096] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-24T20:04:00.816144] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-24T20:04:01.344343] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T20:04:01.616103] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-24T20:04:01.902835] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T20:04:02.384699] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T20:04:02.416292] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-24T20:04:03.216134] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-24T20:04:03.954756] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T20:04:04.016112] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-24T20:04:04.078698] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-24T20:04:04.286617] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T20:04:04.816107] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-24T20:04:05.408736] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T20:04:05.616096] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-24T20:04:06.416051] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-24T20:04:06.526596] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T20:04:07.216125] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-24T20:04:07.791764] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-24T20:04:07.872738] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T20:04:08.016070] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-24T20:04:08.816145] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-24T20:04:09.158021] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T20:04:09.616116] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-24T20:04:09.947329] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T20:04:09.957240] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-24T20:04:09.957433] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-24T20:04:10.171338] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:04:10.172305] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:04:10.172394] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:04:10.172481] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-24T20:04:10.172572] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-24T20:04:10.172633] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-24T20:04:10.172744] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-24T20:04:10.172864] [INFO ] [MAIN ] Update Progress: 1386/2373 symbols completed. MO took 32.3s. Estimated remaining: 2h 11m 6s. Rate: 7.5 symbols/min [2025-09-24T20:04:10.355569] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:10.419694] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-24T20:04:10.426528] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-24T20:04:10.426728] [INFO ] [MAIN ] MOS: Loaded 53506 existing records. [2025-09-24T20:04:10.666071] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T20:04:10.666338] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:10.679901] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-24T20:04:10.679989] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-24T20:04:10.681516] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-24T20:04:10.681587] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-24T20:04:11.055475] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:11.108097] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T20:04:11.216111] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-24T20:04:11.998148] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T20:04:12.016037] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-24T20:04:12.816097] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-24T20:04:13.082623] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T20:04:13.616113] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-24T20:04:13.809844] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T20:04:14.239578] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T20:04:14.416159] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-24T20:04:15.216242] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-24T20:04:15.408061] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T20:04:15.916455] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T20:04:16.016100] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-24T20:04:16.816072] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-24T20:04:17.151473] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T20:04:17.160590] [INFO ] [REMOTE ] MOD: Full fetch complete (66264 records). [2025-09-24T20:04:17.160760] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-24T20:04:17.558559] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-24T20:04:17.558772] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-24T20:04:17.560234] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-24T20:04:17.560410] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-24T20:04:17.563413] [DEBUG] [LOCAL ] MOD: Trimmed 66264 records to 45590 (keeping 200 days of data) [2025-09-24T20:04:17.642313] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-24T20:04:17.684264] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:04:17.887171] [DEBUG] [LOCAL ] MOD: Primary data saved (45590 records). [2025-09-24T20:04:17.887326] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-24T20:04:17.887470] [INFO ] [MAIN ] Update Progress: 1387/2373 symbols completed. MOD took 38.5s. Estimated remaining: 2h 10m 58s. Rate: 7.5 symbols/min [2025-09-24T20:04:18.082555] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:18.107206] [DEBUG] [LOCAL ] MOV: Loaded 22219 existing records from primary storage. [2025-09-24T20:04:18.107374] [INFO ] [MAIN ] MOV: Loaded 22219 existing records. [2025-09-24T20:04:18.289635] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T20:04:18.335408] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:18.335710] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-24T20:04:18.335770] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-24T20:04:18.336418] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-24T20:04:18.336480] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-24T20:04:18.421201] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-24T20:04:18.730662] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:19.181472] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T20:04:19.192344] [INFO ] [REMOTE ] MODG: Full fetch complete (74760 records). [2025-09-24T20:04:19.192598] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-24T20:04:19.227458] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-24T20:04:19.645678] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-24T20:04:19.645790] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-24T20:04:19.646927] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-24T20:04:19.646995] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-24T20:04:19.649779] [DEBUG] [LOCAL ] MODG: Trimmed 74760 records to 51602 (keeping 200 days of data) [2025-09-24T20:04:19.999065] [DEBUG] [LOCAL ] MODG: Primary data saved (51602 records). [2025-09-24T20:04:19.999240] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-24T20:04:19.999366] [INFO ] [MAIN ] Update Progress: 1388/2373 symbols completed. MODG took 30.2s. Estimated remaining: 2h 10m 46s. Rate: 7.5 symbols/min [2025-09-24T20:04:20.049197] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-24T20:04:20.241775] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:20.342043] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T20:04:20.372267] [DEBUG] [LOCAL ] MP: Loaded 53663 existing records from primary storage. [2025-09-24T20:04:20.373403] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T20:04:20.373606] [INFO ] [MAIN ] MP: Loaded 53663 existing records. [2025-09-24T20:04:20.591321] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:20.591688] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-24T20:04:20.591752] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-24T20:04:20.593016] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-24T20:04:20.593084] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-24T20:04:20.821249] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-24T20:04:21.033960] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:21.616147] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-24T20:04:21.984993] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T20:04:22.229409] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T20:04:22.416065] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-24T20:04:22.708771] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T20:04:23.216139] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-24T20:04:24.016067] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-24T20:04:24.361141] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T20:04:24.408159] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T20:04:24.816101] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-24T20:04:25.552273] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T20:04:25.561604] [INFO ] [REMOTE ] MOH: Full fetch complete (58152 records). [2025-09-24T20:04:25.561797] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-24T20:04:25.622247] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-24T20:04:25.985732] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-24T20:04:25.985945] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-24T20:04:25.987368] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-24T20:04:25.987444] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-24T20:04:25.989593] [DEBUG] [LOCAL ] MOH: Trimmed 58152 records to 41754 (keeping 200 days of data) [2025-09-24T20:04:26.279558] [DEBUG] [LOCAL ] MOH: Primary data saved (41754 records). [2025-09-24T20:04:26.279783] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-24T20:04:26.279903] [INFO ] [MAIN ] Update Progress: 1389/2373 symbols completed. MOH took 28.6s. Estimated remaining: 2h 10m 37s. Rate: 7.5 symbols/min [2025-09-24T20:04:26.421213] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-24T20:04:26.496588] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:26.506563] [DEBUG] [LOCAL ] MPA: Loaded 5226 existing records from primary storage. [2025-09-24T20:04:26.506778] [INFO ] [MAIN ] MPA: Loaded 5226 existing records. [2025-09-24T20:04:26.736163] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:26.736955] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-24T20:04:26.737195] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-24T20:04:26.737636] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-24T20:04:26.737731] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-24T20:04:26.879155] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-24T20:04:27.150366] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:27.216065] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-24T20:04:27.433533] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T20:04:27.480259] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T20:04:27.806139] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T20:04:28.016093] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-24T20:04:28.816115] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-24T20:04:29.117080] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T20:04:29.281216] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-24T20:04:29.616149] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-24T20:04:30.416192] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-24T20:04:31.216113] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-24T20:04:31.552315] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T20:04:31.612924] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-24T20:04:32.016109] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-24T20:04:32.103137] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T20:04:32.816113] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-24T20:04:33.190158] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T20:04:33.388926] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T20:04:33.616109] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-24T20:04:34.175781] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T20:04:34.416104] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-24T20:04:35.216088] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-24T20:04:35.458683] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T20:04:35.821476] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T20:04:36.016106] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-24T20:04:36.816070] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-24T20:04:36.849436] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T20:04:37.616143] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-24T20:04:38.213824] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T20:04:38.341701] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T20:04:38.416079] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-24T20:04:39.216101] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-24T20:04:39.968513] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T20:04:40.004308] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T20:04:40.016087] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-24T20:04:40.816172] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-24T20:04:41.472846] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T20:04:41.616102] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-24T20:04:41.836305] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T20:04:42.416139] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-24T20:04:42.981178] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T20:04:43.216095] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-24T20:04:43.589860] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T20:04:43.825456] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T20:04:43.827334] [INFO ] [REMOTE ] MPA: Full fetch complete (7089 records). [2025-09-24T20:04:43.827411] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-24T20:04:44.021342] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-24T20:04:44.235581] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-24T20:04:44.235703] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-24T20:04:44.235974] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-24T20:04:44.236017] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-24T20:04:44.236585] [DEBUG] [LOCAL ] MPA: Trimmed 7089 records to 5208 (keeping 200 days of data) [2025-09-24T20:04:44.269878] [DEBUG] [LOCAL ] MPA: Primary data saved (5208 records). [2025-09-24T20:04:44.270023] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-24T20:04:44.270112] [INFO ] [MAIN ] Update Progress: 1390/2373 symbols completed. MPA took 18.0s. Estimated remaining: 2h 10m 36s. Rate: 7.5 symbols/min [2025-09-24T20:04:44.452886] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:44.513505] [DEBUG] [LOCAL ] MPC: Loaded 52130 existing records from primary storage. [2025-09-24T20:04:44.513683] [INFO ] [MAIN ] MPC: Loaded 52130 existing records. [2025-09-24T20:04:44.703462] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:44.703780] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-24T20:04:44.703841] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-24T20:04:44.705611] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-24T20:04:44.705703] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-24T20:04:44.821357] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-24T20:04:45.095811] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:45.340174] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T20:04:45.345194] [INFO ] [REMOTE ] MOV: Full fetch complete (30730 records). [2025-09-24T20:04:45.345403] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-24T20:04:45.621427] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-24T20:04:45.779926] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-24T20:04:45.780009] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-24T20:04:45.780717] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-24T20:04:45.780779] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-24T20:04:45.781545] [DEBUG] [LOCAL ] MOV: Trimmed 30730 records to 22172 (keeping 200 days of data) [2025-09-24T20:04:45.921876] [DEBUG] [LOCAL ] MOV: Primary data saved (22172 records). [2025-09-24T20:04:45.922008] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-24T20:04:45.922105] [INFO ] [MAIN ] Update Progress: 1391/2373 symbols completed. MOV took 28.0s. Estimated remaining: 2h 10m 24s. Rate: 7.5 symbols/min [2025-09-24T20:04:46.096975] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:46.157786] [DEBUG] [LOCAL ] MPLX: Loaded 50738 existing records from primary storage. [2025-09-24T20:04:46.157938] [INFO ] [MAIN ] MPLX: Loaded 50738 existing records. [2025-09-24T20:04:46.337733] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:46.338039] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-24T20:04:46.338089] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-24T20:04:46.339265] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-24T20:04:46.339328] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-24T20:04:46.421406] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-24T20:04:46.711130] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:47.216082] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-24T20:04:47.287207] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-24T20:04:47.587211] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T20:04:48.016095] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-24T20:04:48.070892] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T20:04:48.081043] [INFO ] [REMOTE ] MOS: Full fetch complete (77451 records). [2025-09-24T20:04:48.081198] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-24T20:04:48.546821] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-24T20:04:48.547097] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-24T20:04:48.548561] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-24T20:04:48.548693] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-24T20:04:48.551040] [DEBUG] [LOCAL ] MOS: Trimmed 77451 records to 53506 (keeping 200 days of data) [2025-09-24T20:04:48.820953] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-24T20:04:48.875018] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T20:04:48.988596] [DEBUG] [LOCAL ] MOS: Primary data saved (53506 records). [2025-09-24T20:04:48.988807] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-24T20:04:48.988934] [INFO ] [MAIN ] Update Progress: 1392/2373 symbols completed. MOS took 38.8s. Estimated remaining: 2h 10m 12s. Rate: 7.5 symbols/min [2025-09-24T20:04:49.182954] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:04:49.191705] [DEBUG] [LOCAL ] MPV: Loaded 5142 existing records from primary storage. [2025-09-24T20:04:49.191858] [INFO ] [MAIN ] MPV: Loaded 5142 existing records. [2025-09-24T20:04:49.403361] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:04:49.403664] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-24T20:04:49.403728] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-24T20:04:49.404031] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-24T20:04:49.404092] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-24T20:04:49.636962] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-24T20:04:49.821361] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:04:50.034989] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T20:04:50.416138] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-24T20:04:50.725112] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-24T20:04:51.216096] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-24T20:04:51.465055] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T20:04:51.921027] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T20:04:52.016102] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-24T20:04:52.816042] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-24T20:04:53.089077] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-24T20:04:53.486792] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T20:04:53.616068] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-24T20:04:53.713955] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T20:04:54.090552] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T20:04:54.416137] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-24T20:04:55.216096] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-24T20:04:55.859550] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T20:04:56.016091] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-24T20:04:56.184376] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T20:04:56.592018] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T20:04:56.816089] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-24T20:04:57.440120] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T20:04:57.616093] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-24T20:04:58.416100] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-24T20:04:59.216140] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-24T20:04:59.389672] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T20:05:00.016130] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-24T20:05:00.816132] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-24T20:05:01.132593] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-24T20:05:01.204048] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T20:05:01.616941] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-24T20:05:01.628958] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:05:01.713344] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T20:05:02.416103] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-24T20:05:02.991840] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T20:05:03.216230] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-24T20:05:03.518561] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T20:05:04.016117] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-24T20:05:04.816101] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-24T20:05:05.616252] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-24T20:05:05.662379] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-24T20:05:05.827529] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T20:05:06.162404] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T20:05:06.416108] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-24T20:05:06.565603] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T20:05:07.216126] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-24T20:05:07.788586] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T20:05:07.790090] [INFO ] [REMOTE ] MPV: Full fetch complete (8054 records). [2025-09-24T20:05:07.790172] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-24T20:05:08.023834] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-24T20:05:08.201132] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-24T20:05:08.201252] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-24T20:05:08.201729] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-24T20:05:08.201799] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-24T20:05:08.202436] [DEBUG] [LOCAL ] MPV: Trimmed 8054 records to 5054 (keeping 200 days of data) [2025-09-24T20:05:08.238305] [DEBUG] [LOCAL ] MPV: Primary data saved (5054 records). [2025-09-24T20:05:08.238519] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-24T20:05:08.238682] [INFO ] [MAIN ] Update Progress: 1393/2373 symbols completed. MPV took 19.2s. Estimated remaining: 2h 10m 12s. Rate: 7.5 symbols/min [2025-09-24T20:05:08.427889] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:08.494052] [DEBUG] [LOCAL ] MPW: Loaded 53506 existing records from primary storage. [2025-09-24T20:05:08.494297] [INFO ] [MAIN ] MPW: Loaded 53506 existing records. [2025-09-24T20:05:08.699146] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:08.699771] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-24T20:05:08.699844] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-24T20:05:08.701244] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-24T20:05:08.701316] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-24T20:05:08.819190] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-24T20:05:09.116038] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:09.161434] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-24T20:05:09.172431] [INFO ] [REMOTE ] MP: Full fetch complete (77298 records). [2025-09-24T20:05:09.172881] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-24T20:05:09.616299] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-24T20:05:09.616805] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-24T20:05:09.618302] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-24T20:05:09.619712] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-24T20:05:09.619977] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-24T20:05:09.656076] [DEBUG] [LOCAL ] MP: Trimmed 77298 records to 53664 (keeping 200 days of data) [2025-09-24T20:05:09.660374] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T20:05:10.009350] [DEBUG] [LOCAL ] MP: Primary data saved (53664 records). [2025-09-24T20:05:10.009504] [INFO ] [MAIN ] MP: Full history saved. [2025-09-24T20:05:10.009600] [INFO ] [MAIN ] Update Progress: 1394/2373 symbols completed. MP took 50.0s. Estimated remaining: 2h 9m 60s. Rate: 7.5 symbols/min [2025-09-24T20:05:10.190392] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:10.196980] [DEBUG] [LOCAL ] MPX: Loaded 4195 existing records from primary storage. [2025-09-24T20:05:10.197132] [INFO ] [MAIN ] MPX: Loaded 4195 existing records. [2025-09-24T20:05:10.399952] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:10.400582] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-24T20:05:10.400824] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-24T20:05:10.401204] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-24T20:05:10.401271] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-24T20:05:10.438031] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-24T20:05:10.786898] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T20:05:10.891831] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:11.216193] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-24T20:05:11.401433] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T20:05:11.896398] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T20:05:12.016121] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-24T20:05:12.816144] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-24T20:05:13.014467] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T20:05:13.616094] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-24T20:05:13.854057] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T20:05:14.246941] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T20:05:14.416093] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-24T20:05:14.467802] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T20:05:15.216095] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-24T20:05:16.016138] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-24T20:05:16.305850] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T20:05:16.315355] [INFO ] [REMOTE ] MPLX: Full fetch complete (73991 records). [2025-09-24T20:05:16.315520] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-24T20:05:16.738854] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-24T20:05:16.738549] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T20:05:16.741066] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-24T20:05:16.742243] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-24T20:05:16.742315] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-24T20:05:16.743793] [DEBUG] [LOCAL ] MPLX: Trimmed 73991 records to 50731 (keeping 200 days of data) [2025-09-24T20:05:16.835524] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-24T20:05:17.010438] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T20:05:17.127637] [DEBUG] [LOCAL ] MPLX: Primary data saved (50731 records). [2025-09-24T20:05:17.127929] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-24T20:05:17.128061] [INFO ] [MAIN ] Update Progress: 1395/2373 symbols completed. MPLX took 31.2s. Estimated remaining: 2h 9m 51s. Rate: 7.5 symbols/min [2025-09-24T20:05:17.300213] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:17.315205] [DEBUG] [LOCAL ] MQT: Loaded 8399 existing records from primary storage. [2025-09-24T20:05:17.315334] [INFO ] [MAIN ] MQT: Loaded 8399 existing records. [2025-09-24T20:05:17.495183] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:17.495461] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-24T20:05:17.495516] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-24T20:05:17.495893] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-24T20:05:17.495954] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-24T20:05:17.617558] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-24T20:05:17.788383] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T20:05:17.875279] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:18.416133] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-24T20:05:19.100891] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-24T20:05:19.216050] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-24T20:05:19.292242] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T20:05:20.016106] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-24T20:05:20.816121] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-24T20:05:21.408630] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-24T20:05:21.595192] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:05:21.616031] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-24T20:05:21.729688] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T20:05:21.739180] [INFO ] [REMOTE ] MPC: Full fetch complete (75893 records). [2025-09-24T20:05:21.739340] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-24T20:05:22.196684] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-24T20:05:22.197001] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-24T20:05:22.198887] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-24T20:05:22.199126] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-24T20:05:22.216523] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T20:05:22.222372] [DEBUG] [LOCAL ] MPC: Trimmed 75893 records to 52122 (keeping 200 days of data) [2025-09-24T20:05:22.482103] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-24T20:05:22.712040] [DEBUG] [LOCAL ] MPC: Primary data saved (52122 records). [2025-09-24T20:05:22.712259] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-24T20:05:22.712393] [INFO ] [MAIN ] Update Progress: 1396/2373 symbols completed. MPC took 38.4s. Estimated remaining: 2h 9m 42s. Rate: 7.5 symbols/min [2025-09-24T20:05:22.987253] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:23.010869] [DEBUG] [LOCAL ] MQY: Loaded 16742 existing records from primary storage. [2025-09-24T20:05:23.011108] [INFO ] [MAIN ] MQY: Loaded 16742 existing records. [2025-09-24T20:05:23.223958] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-24T20:05:23.256053] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:23.256481] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-24T20:05:23.256550] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-24T20:05:23.257191] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-24T20:05:23.257255] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-24T20:05:23.430786] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T20:05:23.703718] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:23.953711] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:05:24.016172] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-24T20:05:24.816137] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-24T20:05:25.148595] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T20:05:25.505250] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T20:05:25.616094] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-24T20:05:26.416324] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-24T20:05:27.157142] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T20:05:27.216066] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-24T20:05:27.278958] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:05:27.813181] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:05:28.016069] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-24T20:05:28.634405] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T20:05:28.816105] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-24T20:05:29.412743] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:05:29.616076] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-24T20:05:30.195512] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T20:05:30.416056] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-24T20:05:31.126862] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T20:05:31.216042] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-24T20:05:32.016115] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-24T20:05:32.281694] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T20:05:32.570362] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T20:05:32.816101] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-24T20:05:33.569920] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T20:05:33.616096] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-24T20:05:34.379165] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T20:05:34.416073] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-24T20:05:35.216124] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-24T20:05:35.350601] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:05:35.353474] [INFO ] [REMOTE ] MQT: Full fetch complete (13332 records). [2025-09-24T20:05:35.353602] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-24T20:05:35.726066] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-24T20:05:35.726219] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-24T20:05:35.726672] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-24T20:05:35.726735] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-24T20:05:35.727901] [DEBUG] [LOCAL ] MQT: Trimmed 13332 records to 8446 (keeping 200 days of data) [2025-09-24T20:05:35.785293] [DEBUG] [LOCAL ] MQT: Primary data saved (8446 records). [2025-09-24T20:05:35.785439] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-24T20:05:35.785560] [INFO ] [MAIN ] Update Progress: 1397/2373 symbols completed. MQT took 18.7s. Estimated remaining: 2h 9m 37s. Rate: 7.5 symbols/min [2025-09-24T20:05:35.966861] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:05:35.968144] [INFO ] [REMOTE ] MPX: Full fetch complete (6834 records). [2025-09-24T20:05:35.968225] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-24T20:05:36.023390] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-24T20:05:36.338808] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-24T20:05:36.338891] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-24T20:05:36.339086] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-24T20:05:36.339124] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-24T20:05:36.339549] [DEBUG] [LOCAL ] MPX: Trimmed 6834 records to 4165 (keeping 200 days of data) [2025-09-24T20:05:36.364801] [DEBUG] [LOCAL ] MPX: Primary data saved (4165 records). [2025-09-24T20:05:36.364885] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-24T20:05:36.365003] [INFO ] [MAIN ] Update Progress: 1398/2373 symbols completed. MPX took 26.4s. Estimated remaining: 2h 9m 24s. Rate: 7.5 symbols/min [2025-09-24T20:05:36.816115] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-24T20:05:37.157471] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T20:05:37.616144] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-24T20:05:38.487059] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T20:05:38.491884] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-24T20:05:38.747791] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T20:05:39.206668] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T20:05:39.216020] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-24T20:05:40.016075] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-24T20:05:40.213924] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T20:05:40.816112] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-24T20:05:41.756541] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T20:05:41.760976] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-24T20:05:41.835128] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T20:05:42.416143] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-24T20:05:42.856823] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T20:05:43.216148] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-24T20:05:43.959906] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T20:05:44.016095] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-24T20:05:44.408241] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T20:05:44.766624] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:05:44.771099] [INFO ] [REMOTE ] MQY: Full fetch complete (27120 records). [2025-09-24T20:05:44.771205] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-24T20:05:44.826766] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-24T20:05:45.216120] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-24T20:05:45.216289] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-24T20:05:45.217124] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-24T20:05:45.217227] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-24T20:05:45.221562] [DEBUG] [LOCAL ] MQY: Trimmed 27120 records to 16761 (keeping 200 days of data) [2025-09-24T20:05:45.344123] [DEBUG] [LOCAL ] MQY: Primary data saved (16761 records). [2025-09-24T20:05:45.344438] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-24T20:05:45.344583] [INFO ] [MAIN ] Update Progress: 1399/2373 symbols completed. MQY took 22.6s. Estimated remaining: 2h 9m 17s. Rate: 7.5 symbols/min [2025-09-24T20:05:46.866343] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T20:05:46.879561] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-24T20:05:48.875060] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T20:05:48.885329] [INFO ] [REMOTE ] MPW: Full fetch complete (77525 records). [2025-09-24T20:05:48.885577] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-24T20:05:49.328955] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-24T20:05:49.329327] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-24T20:05:49.331111] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-24T20:05:49.331191] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-24T20:05:49.333324] [DEBUG] [LOCAL ] MPW: Trimmed 77525 records to 53501 (keeping 200 days of data) [2025-09-24T20:05:49.684238] [DEBUG] [LOCAL ] MPW: Primary data saved (53501 records). [2025-09-24T20:05:49.684452] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-24T20:05:49.684667] [INFO ] [MAIN ] Update Progress: 1400/2373 symbols completed. MPW took 41.4s. Estimated remaining: 2h 9m 6s. Rate: 7.5 symbols/min [2025-09-24T20:05:50.384459] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:50.456287] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:50.482370] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:50.477908] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:05:50.483146] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-24T20:05:50.483272] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-24T20:05:50.486744] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-24T20:05:50.486860] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-24T20:05:50.486990] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-24T20:05:50.487071] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-24T20:05:50.830233] [DEBUG] [LOCAL ] MRC: Loaded 37580 existing records from primary storage. [2025-09-24T20:05:50.835867] [INFO ] [MAIN ] MRC: Loaded 37580 existing records. [2025-09-24T20:05:51.044474] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-24T20:05:51.059452] [INFO ] [MAIN ] MS: Loaded 53693 existing records. [2025-09-24T20:05:51.109492] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:51.117361] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-24T20:05:51.111460] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-24T20:05:51.135542] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-09-24T20:05:51.427249] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:51.478086] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:05:51.489072] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-24T20:05:51.500244] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-24T20:05:51.511546] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-24T20:05:51.538737] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-24T20:05:51.538369] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-24T20:05:51.556007] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-24T20:05:51.595876] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:51.614764] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:05:51.671397] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-24T20:05:51.663611] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-24T20:05:51.674913] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-24T20:05:51.675524] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-24T20:05:51.681020] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-24T20:05:51.691632] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-24T20:05:51.696978] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-24T20:05:51.726867] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-24T20:05:51.814426] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:05:51.891272] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-24T20:05:52.011143] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-24T20:05:52.393597] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:52.439305] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-24T20:05:52.704231] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:52.727228] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-24T20:05:52.726945] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:05:52.728256] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-24T20:05:53.348729] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T20:05:53.357238] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-24T20:05:53.392238] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T20:05:53.399844] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-24T20:05:54.431851] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:05:54.441144] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-24T20:05:54.584682] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T20:05:54.596825] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-24T20:05:54.709603] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T20:05:54.720946] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-24T20:05:54.922008] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T20:05:55.216146] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-24T20:05:55.479364] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T20:05:56.016105] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-24T20:05:56.543223] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T20:05:56.583887] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T20:05:56.659262] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T20:05:56.816051] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-24T20:05:57.110524] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T20:05:57.616078] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-24T20:05:58.416067] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-24T20:05:58.649820] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T20:05:58.768451] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T20:05:59.216099] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-24T20:06:00.016137] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-24T20:06:00.734263] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-24T20:06:00.816036] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-24T20:06:01.110961] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T20:06:01.415445] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T20:06:01.616124] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-24T20:06:02.416101] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-24T20:06:03.216142] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-24T20:06:03.926359] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-24T20:06:04.016036] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-24T20:06:04.686510] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-24T20:06:04.816048] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-24T20:06:04.941045] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T20:06:05.012002] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-24T20:06:05.616097] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-24T20:06:06.192988] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-24T20:06:06.416048] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-24T20:06:06.966523] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-24T20:06:07.216105] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-24T20:06:07.501736] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T20:06:08.016127] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-24T20:06:08.800734] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-24T20:06:08.816025] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-24T20:06:08.873467] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:06:09.442325] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:06:09.616083] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-24T20:06:10.416175] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-24T20:06:10.957331] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-24T20:06:11.216052] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-24T20:06:11.320439] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T20:06:12.000810] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T20:06:12.016030] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-24T20:06:12.816089] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-24T20:06:13.589870] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-24T20:06:13.616038] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-24T20:06:13.636862] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T20:06:13.644299] [INFO ] [REMOTE ] MRC: Full fetch complete (54551 records). [2025-09-24T20:06:13.644434] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-24T20:06:14.039195] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-24T20:06:14.039361] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-24T20:06:14.040282] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-24T20:06:14.040372] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-24T20:06:14.041470] [DEBUG] [LOCAL ] MRC: Trimmed 54551 records to 37590 (keeping 200 days of data) [2025-09-24T20:06:14.274253] [DEBUG] [LOCAL ] MRC: Primary data saved (37590 records). [2025-09-24T20:06:14.274426] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-24T20:06:14.274586] [INFO ] [MAIN ] Update Progress: 1401/2373 symbols completed. MRC took 24.6s. Estimated remaining: 2h 9m 10s. Rate: 7.5 symbols/min [2025-09-24T20:06:14.422161] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-24T20:06:14.456867] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:14.480108] [DEBUG] [LOCAL ] MSA: Loaded 18742 existing records from primary storage. [2025-09-24T20:06:14.480265] [INFO ] [MAIN ] MSA: Loaded 18742 existing records. [2025-09-24T20:06:14.683825] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T20:06:14.689742] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:14.699099] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-24T20:06:14.699220] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-24T20:06:14.700327] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-24T20:06:14.700403] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-24T20:06:14.726800] [INFO ] [REMOTE ] MRP: Full fetch complete (54602 records). [2025-09-24T20:06:14.744239] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-24T20:06:15.268182] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-24T20:06:15.313405] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:06:15.330637] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:06:15.346624] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-24T20:06:15.385284] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-24T20:06:15.411838] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-24T20:06:15.439336] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-24T20:06:15.476480] [INFO ] [MAIN ] Update Progress: 1402/2373 symbols completed. MRP took 25.8s. Estimated remaining: 2h 8m 57s. Rate: 7.5 symbols/min [2025-09-24T20:06:15.527401] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:15.533772] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-24T20:06:15.802115] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:15.817261] [DEBUG] [LOCAL ] MSB: Loaded 7854 existing records from primary storage. [2025-09-24T20:06:15.817443] [INFO ] [MAIN ] MSB: Loaded 7854 existing records. [2025-09-24T20:06:16.047270] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:16.047771] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-24T20:06:16.047830] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-24T20:06:16.048577] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-24T20:06:16.048637] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-24T20:06:16.423347] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:16.423700] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-24T20:06:17.057261] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (3.44 seconds). [2025-09-24T20:06:17.070818] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-24T20:06:17.168836] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-24T20:06:17.165686] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T20:06:17.198561] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T20:06:17.616151] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-24T20:06:18.416141] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-24T20:06:19.216065] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-24T20:06:19.298987] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T20:06:19.414834] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T20:06:19.424859] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-24T20:06:19.425008] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-24T20:06:19.840257] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-24T20:06:19.840466] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-24T20:06:19.841582] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-24T20:06:19.841690] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-24T20:06:19.843437] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 53789 (keeping 200 days of data) [2025-09-24T20:06:19.983361] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-24T20:06:20.017597] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-24T20:06:20.166940] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T20:06:20.263917] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-24T20:06:20.264066] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-24T20:06:20.264187] [INFO ] [MAIN ] Update Progress: 1403/2373 symbols completed. MRK took 30.6s. Estimated remaining: 2h 8m 47s. Rate: 7.5 symbols/min [2025-09-24T20:06:20.433898] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:20.434090] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-24T20:06:20.434147] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-24T20:06:20.434299] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-24T20:06:20.434344] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-24T20:06:20.434387] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-24T20:06:20.434422] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-24T20:06:20.824511] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-24T20:06:20.867172] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:20.876868] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:06:21.616045] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-24T20:06:21.989604] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T20:06:22.295530] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T20:06:22.416080] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-24T20:06:23.216100] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-24T20:06:24.016116] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-24T20:06:24.329080] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-24T20:06:24.384813] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-24T20:06:24.411553] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T20:06:24.816116] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-24T20:06:25.616109] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-24T20:06:26.416120] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-24T20:06:26.606183] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-24T20:06:27.075022] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T20:06:27.183526] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-24T20:06:27.198962] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-09-24T20:06:27.199264] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-24T20:06:27.222697] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-24T20:06:27.637530] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-24T20:06:27.637677] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-24T20:06:27.638898] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-24T20:06:27.638971] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-24T20:06:27.640879] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 53693 (keeping 200 days of data) [2025-09-24T20:06:27.986816] [DEBUG] [LOCAL ] MS: Primary data saved (53693 records). [2025-09-24T20:06:27.986952] [INFO ] [MAIN ] MS: Full history saved. [2025-09-24T20:06:27.987038] [INFO ] [MAIN ] Update Progress: 1404/2373 symbols completed. MS took 38.3s. Estimated remaining: 2h 8m 39s. Rate: 7.5 symbols/min [2025-09-24T20:06:28.019168] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-24T20:06:28.164170] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:28.204943] [DEBUG] [LOCAL ] MSCI: Loaded 34875 existing records from primary storage. [2025-09-24T20:06:28.205096] [INFO ] [MAIN ] MSCI: Loaded 34875 existing records. [2025-09-24T20:06:28.382134] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:28.382360] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-24T20:06:28.382408] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-24T20:06:28.383733] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-24T20:06:28.383794] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-24T20:06:28.624705] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T20:06:28.667401] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T20:06:28.779901] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:28.816039] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-24T20:06:29.616108] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-24T20:06:30.114571] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T20:06:30.416096] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-24T20:06:30.619717] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T20:06:30.730766] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-24T20:06:31.216127] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-24T20:06:32.016092] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-24T20:06:32.396973] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T20:06:32.528380] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T20:06:32.816083] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-24T20:06:33.616134] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-24T20:06:34.040959] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T20:06:34.053242] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-24T20:06:34.416097] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-24T20:06:35.216093] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-24T20:06:35.954098] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T20:06:36.016068] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-24T20:06:36.816118] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-24T20:06:37.616097] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-24T20:06:43.893708] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (7.88 seconds). [2025-09-24T20:06:43.897079] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-24T20:06:44.289179] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (7.47 seconds). [2025-09-24T20:06:44.290359] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-24T20:06:44.664227] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T20:06:44.667374] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-24T20:06:44.689789] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-24T20:06:44.690991] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-24T20:06:45.029875] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-24T20:06:45.031013] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-24T20:06:45.340582] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T20:06:45.342750] [INFO ] [REMOTE ] MSB: Full fetch complete (12831 records). [2025-09-24T20:06:45.342854] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-24T20:06:45.434038] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-24T20:06:45.456608] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-24T20:06:45.784849] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-24T20:06:45.785692] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-24T20:06:45.786348] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (8.17 seconds). [2025-09-24T20:06:45.787145] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-24T20:06:45.791161] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-24T20:06:45.792980] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-24T20:06:45.793475] [DEBUG] [LOCAL ] MSB: Trimmed 12831 records to 7829 (keeping 200 days of data) [2025-09-24T20:06:45.848499] [DEBUG] [LOCAL ] MSB: Primary data saved (7829 records). [2025-09-24T20:06:45.848791] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-24T20:06:45.848978] [INFO ] [MAIN ] Update Progress: 1405/2373 symbols completed. MSB took 30.3s. Estimated remaining: 2h 8m 38s. Rate: 7.5 symbols/min [2025-09-24T20:06:45.937024] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-24T20:06:45.958238] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-24T20:06:46.045742] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:46.065455] [DEBUG] [LOCAL ] MSD: Loaded 15585 existing records from primary storage. [2025-09-24T20:06:46.065631] [INFO ] [MAIN ] MSD: Loaded 15585 existing records. [2025-09-24T20:06:46.266260] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:46.266629] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-24T20:06:46.266718] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-24T20:06:46.267453] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-24T20:06:46.267520] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-24T20:06:46.666599] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:46.671838] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-24T20:06:46.672079] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:06:46.674830] [INFO ] [REMOTE ] MSC: Full fetch complete (2493 records). [2025-09-24T20:06:46.674936] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-24T20:06:46.876363] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-24T20:06:46.876826] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:06:46.876899] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:06:46.876972] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-24T20:06:46.877061] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-24T20:06:46.877107] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-24T20:06:46.877149] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-24T20:06:46.877275] [INFO ] [MAIN ] Update Progress: 1406/2373 symbols completed. MSC took 26.6s. Estimated remaining: 2h 8m 25s. Rate: 7.5 symbols/min [2025-09-24T20:06:47.058222] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:47.075823] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T20:06:47.080944] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-24T20:06:47.120906] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (12.70 seconds). [2025-09-24T20:06:47.129572] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-24T20:06:47.144065] [DEBUG] [LOCAL ] MSDL: Loaded 38020 existing records from primary storage. [2025-09-24T20:06:47.144240] [INFO ] [MAIN ] MSDL: Loaded 38020 existing records. [2025-09-24T20:06:47.324615] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:47.324924] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-24T20:06:47.324976] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-24T20:06:47.326123] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-24T20:06:47.326184] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-24T20:06:47.698573] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:47.704458] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-24T20:06:47.711712] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T20:06:48.016505] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-24T20:06:48.407095] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T20:06:48.410893] [INFO ] [REMOTE ] MSA: Full fetch complete (25730 records). [2025-09-24T20:06:48.410974] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-24T20:06:48.803244] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T20:06:48.852219] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-24T20:06:48.853162] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-24T20:06:48.854062] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-24T20:06:48.855727] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-24T20:06:48.857065] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-24T20:06:48.879708] [DEBUG] [LOCAL ] MSA: Trimmed 25730 records to 18776 (keeping 200 days of data) [2025-09-24T20:06:48.882541] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T20:06:48.986495] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T20:06:49.025973] [DEBUG] [LOCAL ] MSA: Primary data saved (18776 records). [2025-09-24T20:06:49.026149] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-24T20:06:49.026262] [INFO ] [MAIN ] Update Progress: 1407/2373 symbols completed. MSA took 34.8s. Estimated remaining: 2h 8m 13s. Rate: 7.5 symbols/min [2025-09-24T20:06:49.194783] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:06:49.226282] [DEBUG] [LOCAL ] MSGE: Loaded 27130 existing records from primary storage. [2025-09-24T20:06:49.226488] [INFO ] [MAIN ] MSGE: Loaded 27130 existing records. [2025-09-24T20:06:49.405339] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:06:49.405621] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-24T20:06:49.405700] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-24T20:06:49.406699] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-24T20:06:49.406765] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-24T20:06:49.621258] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-24T20:06:49.778602] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:06:50.295122] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T20:06:50.416062] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-24T20:06:50.464975] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T20:06:51.216132] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-24T20:06:51.787094] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T20:06:52.016120] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-24T20:06:52.101403] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T20:06:52.816100] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-24T20:06:53.303696] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:06:53.616168] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-24T20:06:54.326862] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:06:54.416128] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-24T20:06:54.478083] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:06:55.216059] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-24T20:06:55.289205] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T20:06:56.016109] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-24T20:06:56.141368] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T20:06:56.816086] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-24T20:06:57.515797] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:06:57.616125] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-24T20:06:58.144912] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T20:06:58.266908] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T20:06:58.416121] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-24T20:06:59.216089] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-24T20:06:59.827594] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T20:06:59.992730] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T20:07:00.016036] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-24T20:07:00.816090] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-24T20:07:01.133474] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T20:07:01.616141] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-24T20:07:02.324338] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T20:07:02.416129] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-24T20:07:02.908791] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T20:07:03.216093] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-24T20:07:04.016091] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-24T20:07:04.227724] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T20:07:04.236293] [INFO ] [REMOTE ] MSCI: Full fetch complete (50353 records). [2025-09-24T20:07:04.236517] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-24T20:07:04.362177] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T20:07:04.383002] [INFO ] [REMOTE ] MSD: Full fetch complete (22146 records). [2025-09-24T20:07:04.393514] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-24T20:07:04.854570] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-24T20:07:04.947550] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-24T20:07:04.947700] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-24T20:07:04.948721] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-24T20:07:04.954181] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-24T20:07:05.020315] [DEBUG] [LOCAL ] MSCI: Trimmed 50353 records to 34828 (keeping 200 days of data) [2025-09-24T20:07:05.250251] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-24T20:07:05.258484] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-24T20:07:05.261870] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-24T20:07:05.261971] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-24T20:07:05.267099] [DEBUG] [LOCAL ] MSD: Trimmed 22146 records to 15558 (keeping 200 days of data) [2025-09-24T20:07:05.464557] [DEBUG] [LOCAL ] MSCI: Primary data saved (34828 records). [2025-09-24T20:07:05.469988] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-24T20:07:05.472288] [INFO ] [MAIN ] Update Progress: 1408/2373 symbols completed. MSCI took 37.5s. Estimated remaining: 2h 8m 11s. Rate: 7.5 symbols/min [2025-09-24T20:07:05.481081] [DEBUG] [LOCAL ] MSD: Primary data saved (15558 records). [2025-09-24T20:07:05.513003] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-24T20:07:05.541208] [INFO ] [MAIN ] Update Progress: 1409/2373 symbols completed. MSD took 19.7s. Estimated remaining: 2h 7m 58s. Rate: 7.5 symbols/min [2025-09-24T20:07:05.665727] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T20:07:05.815761] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:05.821358] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-24T20:07:05.906884] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:05.916591] [DEBUG] [LOCAL ] MSGS: Loaded 16869 existing records from primary storage. [2025-09-24T20:07:05.916794] [INFO ] [MAIN ] MSGS: Loaded 16869 existing records. [2025-09-24T20:07:06.117085] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:06.118358] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-24T20:07:06.118540] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-24T20:07:06.119387] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-24T20:07:06.119462] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-24T20:07:06.248511] [DEBUG] [LOCAL ] MSI: Loaded 40590 existing records from primary storage. [2025-09-24T20:07:06.259358] [INFO ] [MAIN ] MSI: Loaded 40590 existing records. [2025-09-24T20:07:06.561977] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T20:07:06.593377] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-24T20:07:06.756824] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:06.761121] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:06.761762] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-24T20:07:06.761834] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-24T20:07:06.763714] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-24T20:07:06.764005] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-24T20:07:07.149535] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:07.216069] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-24T20:07:07.297875] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T20:07:07.797451] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T20:07:07.945123] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T20:07:08.016059] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-24T20:07:08.816128] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-24T20:07:08.851147] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:07:09.616176] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-24T20:07:10.421216] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-24T20:07:10.437707] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:07:10.804083] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T20:07:11.216088] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-24T20:07:12.016068] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-24T20:07:12.166095] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T20:07:12.186411] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T20:07:12.816061] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-24T20:07:13.191709] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T20:07:13.616102] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-24T20:07:14.209449] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T20:07:14.416059] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-24T20:07:14.605669] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T20:07:15.216048] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-24T20:07:15.450728] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T20:07:16.016094] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-24T20:07:16.435223] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T20:07:16.441351] [INFO ] [REMOTE ] MSGE: Full fetch complete (40136 records). [2025-09-24T20:07:16.441468] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-24T20:07:16.832740] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-24T20:07:16.850598] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-24T20:07:16.850714] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-24T20:07:16.851972] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-24T20:07:16.852041] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-24T20:07:16.853277] [DEBUG] [LOCAL ] MSGE: Trimmed 40136 records to 27077 (keeping 200 days of data) [2025-09-24T20:07:17.026350] [DEBUG] [LOCAL ] MSGE: Primary data saved (27077 records). [2025-09-24T20:07:17.026525] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-24T20:07:17.026672] [INFO ] [MAIN ] Update Progress: 1410/2373 symbols completed. MSGE took 28.0s. Estimated remaining: 2h 7m 52s. Rate: 7.5 symbols/min [2025-09-24T20:07:17.244432] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:17.245080] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-24T20:07:17.245146] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-24T20:07:17.267370] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-24T20:07:17.268346] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T20:07:17.276824] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-24T20:07:17.277569] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-24T20:07:17.277632] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-24T20:07:17.627321] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-24T20:07:17.659923] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:17.987743] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T20:07:18.416113] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-24T20:07:18.941312] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T20:07:19.216103] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-24T20:07:20.025303] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-24T20:07:20.031778] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T20:07:20.252038] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:07:20.252398] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-24T20:07:20.536542] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T20:07:20.816103] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-24T20:07:21.616068] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-24T20:07:21.655635] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T20:07:22.416072] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-24T20:07:23.216097] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-24T20:07:23.250547] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:07:23.258904] [INFO ] [REMOTE ] MSDL: Full fetch complete (54277 records). [2025-09-24T20:07:23.259131] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-24T20:07:23.734301] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-24T20:07:23.734479] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-24T20:07:23.735565] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-24T20:07:23.735634] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-24T20:07:23.737097] [DEBUG] [LOCAL ] MSDL: Trimmed 54277 records to 38031 (keeping 200 days of data) [2025-09-24T20:07:24.004227] [DEBUG] [LOCAL ] MSDL: Primary data saved (38031 records). [2025-09-24T20:07:24.004381] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-24T20:07:24.004474] [INFO ] [MAIN ] Update Progress: 1411/2373 symbols completed. MSDL took 37.1s. Estimated remaining: 2h 7m 43s. Rate: 7.5 symbols/min [2025-09-24T20:07:24.022128] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-24T20:07:24.199983] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:24.226355] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T20:07:24.271693] [DEBUG] [LOCAL ] MSM: Loaded 35420 existing records from primary storage. [2025-09-24T20:07:24.271841] [INFO ] [MAIN ] MSM: Loaded 35420 existing records. [2025-09-24T20:07:24.471271] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:24.484446] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-24T20:07:24.485690] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T20:07:24.485199] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-24T20:07:24.491435] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-24T20:07:24.491506] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-24T20:07:24.602597] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T20:07:24.821342] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-24T20:07:24.892527] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:25.616131] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-24T20:07:26.416159] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-24T20:07:26.524286] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T20:07:26.579037] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T20:07:27.216076] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-24T20:07:27.968709] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T20:07:28.006247] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T20:07:28.016030] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-24T20:07:28.816101] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-24T20:07:29.214521] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T20:07:29.219084] [INFO ] [REMOTE ] MSGS: Full fetch complete (22382 records). [2025-09-24T20:07:29.219192] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-24T20:07:29.626455] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-24T20:07:29.628261] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-24T20:07:29.629122] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-24T20:07:29.629733] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-24T20:07:29.629798] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-24T20:07:29.630723] [DEBUG] [LOCAL ] MSGS: Trimmed 22382 records to 16903 (keeping 200 days of data) [2025-09-24T20:07:29.742446] [DEBUG] [LOCAL ] MSGS: Primary data saved (16903 records). [2025-09-24T20:07:29.742602] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-24T20:07:29.742716] [INFO ] [MAIN ] Update Progress: 1412/2373 symbols completed. MSGS took 24.3s. Estimated remaining: 2h 7m 34s. Rate: 7.5 symbols/min [2025-09-24T20:07:29.936529] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:29.992276] [DEBUG] [LOCAL ] MT: Loaded 50737 existing records from primary storage. [2025-09-24T20:07:29.992482] [INFO ] [MAIN ] MT: Loaded 50737 existing records. [2025-09-24T20:07:30.185864] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:30.186388] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-24T20:07:30.186472] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-24T20:07:30.188895] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-24T20:07:30.188965] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-24T20:07:30.414081] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T20:07:30.422587] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-24T20:07:30.634154] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:31.094714] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T20:07:31.216134] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-24T20:07:31.379799] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T20:07:32.016118] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-24T20:07:32.633879] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T20:07:32.661221] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T20:07:32.816106] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-24T20:07:33.616127] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-24T20:07:33.859753] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T20:07:34.115062] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T20:07:34.416130] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-24T20:07:35.014245] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:07:35.216116] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-24T20:07:36.016124] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-24T20:07:36.643365] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:07:36.816142] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-24T20:07:37.616125] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-24T20:07:37.817032] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T20:07:37.841488] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T20:07:38.416155] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-24T20:07:39.082260] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T20:07:39.216175] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-24T20:07:40.016071] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-24T20:07:40.208115] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T20:07:40.494196] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T20:07:40.807195] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T20:07:40.816029] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-24T20:07:41.616078] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-24T20:07:41.706567] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T20:07:42.416117] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-24T20:07:43.216150] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-24T20:07:43.333271] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T20:07:44.016096] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-24T20:07:44.382631] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T20:07:44.555000] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T20:07:44.820737] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-24T20:07:45.468086] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T20:07:45.616177] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-24T20:07:46.134460] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T20:07:46.416124] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-24T20:07:47.216217] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-24T20:07:48.016080] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-24T20:07:48.615119] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-24T20:07:48.623959] [INFO ] [REMOTE ] MSI: Full fetch complete (58629 records). [2025-09-24T20:07:48.624214] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-24T20:07:49.005404] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T20:07:49.065485] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-24T20:07:49.200340] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-24T20:07:49.236002] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-24T20:07:49.223233] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T20:07:49.241066] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-24T20:07:49.241287] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-24T20:07:49.249615] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-24T20:07:49.250080] [INFO ] [REMOTE ] MSIF: Full fetch complete (16261 records). [2025-09-24T20:07:49.262772] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-24T20:07:49.263787] [DEBUG] [LOCAL ] MSI: Trimmed 58629 records to 40594 (keeping 200 days of data) [2025-09-24T20:07:49.610004] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-24T20:07:49.611529] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:07:49.611898] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:07:49.612540] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-24T20:07:49.613155] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-24T20:07:49.613513] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-24T20:07:49.614393] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-24T20:07:49.614783] [INFO ] [MAIN ] Update Progress: 1413/2373 symbols completed. MSIF took 32.6s. Estimated remaining: 2h 7m 34s. Rate: 7.5 symbols/min [2025-09-24T20:07:49.621194] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-24T20:07:49.819334] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:49.878771] [DEBUG] [LOCAL ] MTAL: Loaded 36328 existing records from primary storage. [2025-09-24T20:07:49.881907] [INFO ] [MAIN ] MTAL: Loaded 36328 existing records. [2025-09-24T20:07:50.182535] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:50.184456] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-24T20:07:50.184816] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-24T20:07:50.188736] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-24T20:07:50.189073] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-24T20:07:50.286845] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T20:07:50.427223] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-24T20:07:50.649682] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:50.671780] [DEBUG] [LOCAL ] MSI: Primary data saved (40594 records). [2025-09-24T20:07:50.672146] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-24T20:07:50.672462] [INFO ] [MAIN ] Update Progress: 1414/2373 symbols completed. MSI took 45.1s. Estimated remaining: 2h 7m 21s. Rate: 7.5 symbols/min [2025-09-24T20:07:50.857899] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:50.927925] [DEBUG] [LOCAL ] MTB: Loaded 47070 existing records from primary storage. [2025-09-24T20:07:50.928131] [INFO ] [MAIN ] MTB: Loaded 47070 existing records. [2025-09-24T20:07:51.131737] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:51.132363] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-24T20:07:51.132673] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-24T20:07:51.135739] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-24T20:07:51.135847] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-24T20:07:51.218315] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-24T20:07:51.593348] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T20:07:51.620790] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:52.020127] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-24T20:07:52.030113] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T20:07:52.040037] [INFO ] [REMOTE ] MSM: Full fetch complete (51989 records). [2025-09-24T20:07:52.040312] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-24T20:07:52.458985] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-24T20:07:52.459178] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-24T20:07:52.472026] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-24T20:07:52.478272] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-24T20:07:52.481736] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T20:07:52.489508] [DEBUG] [LOCAL ] MSM: Trimmed 51989 records to 35344 (keeping 200 days of data) [2025-09-24T20:07:52.740762] [DEBUG] [LOCAL ] MSM: Primary data saved (35344 records). [2025-09-24T20:07:52.740976] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-24T20:07:52.741114] [INFO ] [MAIN ] Update Progress: 1415/2373 symbols completed. MSM took 28.7s. Estimated remaining: 2h 7m 10s. Rate: 7.5 symbols/min [2025-09-24T20:07:52.821357] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-24T20:07:52.942836] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:07:52.968488] [DEBUG] [LOCAL ] MTD: Loaded 15173 existing records from primary storage. [2025-09-24T20:07:52.968707] [INFO ] [MAIN ] MTD: Loaded 15173 existing records. [2025-09-24T20:07:53.168701] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:07:53.169121] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-24T20:07:53.169197] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-24T20:07:53.169847] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-24T20:07:53.169922] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-24T20:07:53.553247] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:07:53.616049] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-24T20:07:53.686900] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:07:53.980394] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:07:54.387779] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T20:07:54.416039] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-24T20:07:55.205757] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:07:55.216028] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-24T20:07:56.016076] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-24T20:07:56.247946] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T20:07:56.816127] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-24T20:07:57.497115] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T20:07:57.616157] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-24T20:07:58.403066] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T20:07:58.416062] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-24T20:07:59.216144] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-24T20:07:59.485113] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T20:07:59.783934] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T20:08:00.016072] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-24T20:08:00.207321] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T20:08:00.816361] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-24T20:08:01.616074] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-24T20:08:01.948029] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T20:08:01.978439] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T20:08:02.416092] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-24T20:08:03.216179] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-24T20:08:03.468187] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T20:08:04.023162] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-24T20:08:04.042952] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T20:08:04.783089] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T20:08:04.795052] [INFO ] [REMOTE ] MT: Full fetch complete (73458 records). [2025-09-24T20:08:04.795263] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-24T20:08:04.828347] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-24T20:08:05.232303] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T20:08:05.231139] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-24T20:08:05.237763] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-24T20:08:05.241022] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-24T20:08:05.241120] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-24T20:08:05.245418] [DEBUG] [LOCAL ] MT: Trimmed 73458 records to 50682 (keeping 200 days of data) [2025-09-24T20:08:05.577318] [DEBUG] [LOCAL ] MT: Primary data saved (50682 records). [2025-09-24T20:08:05.577464] [INFO ] [MAIN ] MT: Full history saved. [2025-09-24T20:08:05.577665] [INFO ] [MAIN ] Update Progress: 1416/2373 symbols completed. MT took 35.8s. Estimated remaining: 2h 7m 5s. Rate: 7.5 symbols/min [2025-09-24T20:08:05.621163] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-24T20:08:05.751264] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:05.816854] [DEBUG] [LOCAL ] MTDR: Loaded 51550 existing records from primary storage. [2025-09-24T20:08:05.817246] [INFO ] [MAIN ] MTDR: Loaded 51550 existing records. [2025-09-24T20:08:06.006034] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:06.006427] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-24T20:08:06.006492] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-24T20:08:06.008005] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-24T20:08:06.008080] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-24T20:08:06.375416] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:06.416157] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-24T20:08:06.874803] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T20:08:07.216144] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-24T20:08:08.016158] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-24T20:08:08.064131] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T20:08:08.205835] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T20:08:08.816140] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-24T20:08:09.254518] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:08:09.541067] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T20:08:09.616142] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-24T20:08:10.416114] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-24T20:08:10.896218] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T20:08:11.216096] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-24T20:08:11.655288] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (6.83 seconds). [2025-09-24T20:08:12.017940] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-24T20:08:12.023422] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T20:08:12.580613] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T20:08:12.816080] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-24T20:08:12.932733] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T20:08:13.616115] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-24T20:08:14.312468] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T20:08:14.416092] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-24T20:08:14.623172] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T20:08:14.625495] [INFO ] [REMOTE ] MTD: Full fetch complete (21019 records). [2025-09-24T20:08:14.625571] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-24T20:08:14.986922] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-24T20:08:14.987020] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-24T20:08:14.987626] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-24T20:08:14.987713] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-24T20:08:14.989295] [DEBUG] [LOCAL ] MTD: Trimmed 21019 records to 15171 (keeping 200 days of data) [2025-09-24T20:08:15.103080] [DEBUG] [LOCAL ] MTD: Primary data saved (15171 records). [2025-09-24T20:08:15.103683] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-24T20:08:15.103920] [INFO ] [MAIN ] Update Progress: 1417/2373 symbols completed. MTD took 22.4s. Estimated remaining: 2h 6m 58s. Rate: 7.5 symbols/min [2025-09-24T20:08:15.221250] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-24T20:08:15.291557] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:15.349571] [DEBUG] [LOCAL ] MTG: Loaded 51366 existing records from primary storage. [2025-09-24T20:08:15.349784] [INFO ] [MAIN ] MTG: Loaded 51366 existing records. [2025-09-24T20:08:15.539186] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:15.539466] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-24T20:08:15.539525] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-24T20:08:15.541087] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-24T20:08:15.541170] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-24T20:08:15.933253] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:16.016037] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-24T20:08:16.050991] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T20:08:16.816141] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-24T20:08:16.968461] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T20:08:17.626841] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-24T20:08:17.634227] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:08:18.161975] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T20:08:18.416144] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-24T20:08:18.735737] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T20:08:19.216159] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-24T20:08:20.026505] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-24T20:08:20.056325] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T20:08:20.750119] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T20:08:20.816089] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-24T20:08:21.616050] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-24T20:08:21.736471] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T20:08:22.416071] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-24T20:08:22.677210] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T20:08:23.216134] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-24T20:08:23.280467] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:08:23.287627] [INFO ] [REMOTE ] MTAL: Full fetch complete (46822 records). [2025-09-24T20:08:23.287783] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-24T20:08:23.736573] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-24T20:08:23.736702] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-24T20:08:23.738152] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-24T20:08:23.738220] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-24T20:08:23.739719] [DEBUG] [LOCAL ] MTAL: Trimmed 46822 records to 36387 (keeping 200 days of data) [2025-09-24T20:08:23.986831] [DEBUG] [LOCAL ] MTAL: Primary data saved (36387 records). [2025-09-24T20:08:23.987002] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-24T20:08:23.987119] [INFO ] [MAIN ] Update Progress: 1418/2373 symbols completed. MTAL took 34.4s. Estimated remaining: 2h 6m 51s. Rate: 7.5 symbols/min [2025-09-24T20:08:24.021207] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-24T20:08:24.174340] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T20:08:24.213907] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:24.223746] [INFO ] [REMOTE ] MTB: Full fetch complete (68343 records). [2025-09-24T20:08:24.224031] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-24T20:08:24.589079] [DEBUG] [LOCAL ] MTH: Loaded 43945 existing records from primary storage. [2025-09-24T20:08:24.599519] [INFO ] [MAIN ] MTH: Loaded 43945 existing records. [2025-09-24T20:08:24.779389] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-24T20:08:24.792617] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-24T20:08:24.794724] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-24T20:08:24.795209] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-24T20:08:24.886711] [DEBUG] [LOCAL ] MTB: Trimmed 68343 records to 46971 (keeping 200 days of data) [2025-09-24T20:08:24.886891] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:24.888271] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-24T20:08:24.888760] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-24T20:08:24.890152] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-24T20:08:24.890245] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-24T20:08:25.400558] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:25.406168] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-24T20:08:25.456449] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T20:08:25.617362] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-24T20:08:25.634906] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T20:08:25.711828] [DEBUG] [LOCAL ] MTB: Primary data saved (46971 records). [2025-09-24T20:08:25.711974] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-24T20:08:25.712081] [INFO ] [MAIN ] Update Progress: 1419/2373 symbols completed. MTB took 35.0s. Estimated remaining: 2h 6m 38s. Rate: 7.5 symbols/min [2025-09-24T20:08:25.883679] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:25.925453] [DEBUG] [LOCAL ] MTN: Loaded 39014 existing records from primary storage. [2025-09-24T20:08:25.925593] [INFO ] [MAIN ] MTN: Loaded 39014 existing records. [2025-09-24T20:08:26.174168] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:26.174475] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-24T20:08:26.174537] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-24T20:08:26.175601] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-24T20:08:26.175694] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-24T20:08:26.421264] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-24T20:08:26.547695] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:26.874329] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:08:27.216107] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-24T20:08:27.506841] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T20:08:28.001022] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:08:28.016035] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-24T20:08:28.454517] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T20:08:28.816078] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-24T20:08:29.616102] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-24T20:08:29.748694] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:08:30.421163] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-24T20:08:30.434012] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T20:08:30.925181] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T20:08:31.216089] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-24T20:08:31.771631] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T20:08:32.016090] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-24T20:08:32.816056] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-24T20:08:32.855273] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T20:08:33.534832] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T20:08:33.616086] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-24T20:08:34.416083] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-24T20:08:34.468256] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T20:08:35.067578] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T20:08:35.216074] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-24T20:08:35.693414] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T20:08:36.016158] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-24T20:08:36.745137] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T20:08:36.816116] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-24T20:08:37.608533] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T20:08:37.618561] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-24T20:08:38.140979] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T20:08:38.416179] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-24T20:08:39.216163] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-24T20:08:39.395355] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T20:08:39.803801] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T20:08:40.016134] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-24T20:08:40.684335] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T20:08:40.816136] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-24T20:08:41.480973] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T20:08:41.616223] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-24T20:08:42.416068] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-24T20:08:42.555001] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T20:08:42.884720] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T20:08:43.216146] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-24T20:08:43.627749] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T20:08:44.016230] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-24T20:08:44.816107] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-24T20:08:44.959541] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T20:08:45.616160] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-24T20:08:45.820341] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T20:08:45.829789] [INFO ] [REMOTE ] MTDR: Full fetch complete (73397 records). [2025-09-24T20:08:45.829924] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-24T20:08:46.239615] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-24T20:08:46.240088] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-24T20:08:46.241547] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-24T20:08:46.241773] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-24T20:08:46.243539] [DEBUG] [LOCAL ] MTDR: Trimmed 73397 records to 51547 (keeping 200 days of data) [2025-09-24T20:08:46.381076] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T20:08:46.419075] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-24T20:08:46.640199] [DEBUG] [LOCAL ] MTDR: Primary data saved (51547 records). [2025-09-24T20:08:46.640362] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-24T20:08:46.640488] [INFO ] [MAIN ] Update Progress: 1420/2373 symbols completed. MTDR took 41.1s. Estimated remaining: 2h 6m 39s. Rate: 7.5 symbols/min [2025-09-24T20:08:46.827448] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:46.827839] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-24T20:08:46.827944] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-24T20:08:46.828231] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-24T20:08:46.828344] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-24T20:08:46.828562] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-24T20:08:46.828621] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-24T20:08:47.219188] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-24T20:08:47.219071] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:47.254460] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T20:08:47.803284] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:08:48.016065] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-24T20:08:48.816119] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-24T20:08:49.125823] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T20:08:49.136074] [INFO ] [REMOTE ] MTG: Full fetch complete (74009 records). [2025-09-24T20:08:49.136255] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-24T20:08:49.518246] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:08:49.621465] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-24T20:08:49.647758] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-24T20:08:49.647869] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-24T20:08:49.649195] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-24T20:08:49.649285] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-24T20:08:49.651075] [DEBUG] [LOCAL ] MTG: Trimmed 74009 records to 51372 (keeping 200 days of data) [2025-09-24T20:08:49.991414] [DEBUG] [LOCAL ] MTG: Primary data saved (51372 records). [2025-09-24T20:08:49.991613] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-24T20:08:49.991752] [INFO ] [MAIN ] Update Progress: 1421/2373 symbols completed. MTG took 34.9s. Estimated remaining: 2h 6m 28s. Rate: 7.5 symbols/min [2025-09-24T20:08:50.163908] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:50.182740] [DEBUG] [LOCAL ] MTRN: Loaded 18095 existing records from primary storage. [2025-09-24T20:08:50.182871] [INFO ] [MAIN ] MTRN: Loaded 18095 existing records. [2025-09-24T20:08:50.365618] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:50.365937] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-24T20:08:50.365991] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-24T20:08:50.366827] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-24T20:08:50.366890] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-24T20:08:50.421551] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-24T20:08:50.681017] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T20:08:50.708953] [INFO ] [REMOTE ] MTH: Full fetch complete (62732 records). [2025-09-24T20:08:50.719480] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-24T20:08:50.838101] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:50.937385] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-24T20:08:51.221916] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-24T20:08:51.282902] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-24T20:08:51.283076] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-24T20:08:51.284291] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-24T20:08:51.284366] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-24T20:08:51.285901] [DEBUG] [LOCAL ] MTH: Trimmed 62732 records to 43867 (keeping 200 days of data) [2025-09-24T20:08:51.419142] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T20:08:51.428433] [INFO ] [REMOTE ] MTN: Full fetch complete (56117 records). [2025-09-24T20:08:51.429186] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-24T20:08:51.838627] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T20:08:51.953966] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-24T20:08:51.980911] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-24T20:08:51.982535] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-24T20:08:51.982627] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-24T20:08:51.987571] [DEBUG] [LOCAL ] MTN: Trimmed 56117 records to 39051 (keeping 200 days of data) [2025-09-24T20:08:52.046515] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-24T20:08:52.297708] [DEBUG] [LOCAL ] MTH: Primary data saved (43867 records). [2025-09-24T20:08:52.299215] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-24T20:08:52.299368] [INFO ] [MAIN ] Update Progress: 1422/2373 symbols completed. MTH took 28.3s. Estimated remaining: 2h 6m 16s. Rate: 7.5 symbols/min [2025-09-24T20:08:52.394028] [DEBUG] [LOCAL ] MTN: Primary data saved (39051 records). [2025-09-24T20:08:52.418222] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-24T20:08:52.418716] [INFO ] [MAIN ] Update Progress: 1423/2373 symbols completed. MTN took 26.7s. Estimated remaining: 2h 6m 3s. Rate: 7.5 symbols/min [2025-09-24T20:08:52.611373] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:52.725703] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:08:52.750414] [DEBUG] [LOCAL ] MTUS: Loaded 28728 existing records from primary storage. [2025-09-24T20:08:52.750554] [INFO ] [MAIN ] MTUS: Loaded 28728 existing records. [2025-09-24T20:08:52.823380] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-24T20:08:52.896133] [DEBUG] [LOCAL ] MTW: Loaded 26521 existing records from primary storage. [2025-09-24T20:08:52.934414] [INFO ] [MAIN ] MTW: Loaded 26521 existing records. [2025-09-24T20:08:52.968288] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:52.992108] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-24T20:08:52.992232] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-24T20:08:53.008727] [DEBUG] [REMOTE ] MTR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-24T20:08:53.003427] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-24T20:08:53.019585] [WARN ] [REMOTE ] MTR: No data returned for month 2025-02 [2025-09-24T20:08:53.044213] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-24T20:08:53.155880] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T20:08:53.314808] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:08:53.381022] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-24T20:08:53.422459] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-24T20:08:53.450723] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-24T20:08:53.456845] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-24T20:08:53.631450] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-24T20:08:53.701545] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:53.955721] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:08:54.407434] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:08:54.416035] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-24T20:08:55.216112] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-24T20:08:55.320353] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T20:08:55.564939] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T20:08:56.016141] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-24T20:08:56.816095] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-24T20:08:57.015912] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T20:08:57.616160] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-24T20:08:57.982779] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T20:08:58.032413] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T20:08:58.416216] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-24T20:08:59.216131] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-24T20:08:59.628636] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T20:09:00.016157] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-24T20:09:00.221190] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T20:09:00.446814] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T20:09:00.816130] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-24T20:09:01.616138] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-24T20:09:02.355186] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T20:09:02.416380] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-24T20:09:03.216108] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-24T20:09:03.344192] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:09:04.016076] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-24T20:09:04.816177] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-24T20:09:04.872558] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-24T20:09:04.934219] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T20:09:05.375417] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T20:09:05.616152] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-24T20:09:05.876634] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T20:09:06.416136] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-24T20:09:06.891726] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T20:09:06.959897] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T20:09:07.216140] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-24T20:09:08.016404] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-24T20:09:08.183076] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:09:08.377128] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-24T20:09:08.816152] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-24T20:09:09.616127] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-24T20:09:10.157733] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T20:09:10.416126] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-24T20:09:10.519501] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T20:09:11.216135] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-24T20:09:11.591052] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T20:09:12.016252] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-24T20:09:12.240208] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T20:09:12.675451] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T20:09:12.676958] [INFO ] [REMOTE ] MTR: Full fetch complete (2444 records). [2025-09-24T20:09:12.677060] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-24T20:09:12.821218] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-24T20:09:12.946361] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T20:09:12.946816] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:09:12.946870] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:09:12.946946] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-24T20:09:12.947024] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-24T20:09:12.947065] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-24T20:09:12.947108] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-24T20:09:12.947179] [INFO ] [MAIN ] Update Progress: 1424/2373 symbols completed. MTR took 26.3s. Estimated remaining: 2h 6m 4s. Rate: 7.5 symbols/min [2025-09-24T20:09:13.148994] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:13.178451] [DEBUG] [LOCAL ] MTX: Loaded 22897 existing records from primary storage. [2025-09-24T20:09:13.178728] [INFO ] [MAIN ] MTX: Loaded 22897 existing records. [2025-09-24T20:09:13.371592] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:13.371967] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-24T20:09:13.372026] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-24T20:09:13.372981] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-24T20:09:13.373046] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-24T20:09:13.621234] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-24T20:09:13.797105] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:14.024198] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T20:09:14.416153] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-24T20:09:14.981152] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T20:09:14.984828] [INFO ] [REMOTE ] MTRN: Full fetch complete (23363 records). [2025-09-24T20:09:14.984953] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-24T20:09:15.218620] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-24T20:09:15.414398] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-24T20:09:15.414550] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-24T20:09:15.415675] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-24T20:09:15.415764] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-24T20:09:15.416792] [DEBUG] [LOCAL ] MTRN: Trimmed 23363 records to 18116 (keeping 200 days of data) [2025-09-24T20:09:15.536224] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T20:09:15.575746] [DEBUG] [LOCAL ] MTRN: Primary data saved (18116 records). [2025-09-24T20:09:15.575916] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-24T20:09:15.576008] [INFO ] [MAIN ] Update Progress: 1425/2373 symbols completed. MTRN took 25.6s. Estimated remaining: 2h 5m 52s. Rate: 7.5 symbols/min [2025-09-24T20:09:15.751378] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:15.801632] [DEBUG] [LOCAL ] MTZ: Loaded 43439 existing records from primary storage. [2025-09-24T20:09:15.801841] [INFO ] [MAIN ] MTZ: Loaded 43439 existing records. [2025-09-24T20:09:15.981249] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:15.981509] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-24T20:09:15.981558] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-24T20:09:15.982700] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-24T20:09:15.982763] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-24T20:09:16.024889] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-24T20:09:16.345101] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:16.387787] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T20:09:16.808777] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:09:16.816029] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-24T20:09:17.616099] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-24T20:09:17.995483] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T20:09:18.416135] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-24T20:09:18.805222] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T20:09:19.216093] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-24T20:09:19.981910] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T20:09:20.016109] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-24T20:09:20.816135] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-24T20:09:20.878388] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T20:09:21.616148] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-24T20:09:21.888881] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T20:09:21.995076] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-24T20:09:22.416239] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-24T20:09:22.856128] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:09:23.216197] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-24T20:09:23.673776] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T20:09:24.016235] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-24T20:09:24.365798] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T20:09:24.816085] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-24T20:09:25.533225] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T20:09:25.616067] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-24T20:09:26.097120] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T20:09:26.416105] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-24T20:09:27.015633] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T20:09:27.216137] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-24T20:09:27.657331] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T20:09:28.016211] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-24T20:09:28.392960] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T20:09:28.816223] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-24T20:09:29.268053] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T20:09:29.616213] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-24T20:09:30.416212] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-24T20:09:30.478459] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:09:30.815532] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T20:09:31.216137] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-24T20:09:31.327897] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T20:09:32.016123] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-24T20:09:32.489877] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T20:09:32.816104] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-24T20:09:33.360805] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T20:09:33.366051] [INFO ] [REMOTE ] MTW: Full fetch complete (38383 records). [2025-09-24T20:09:33.366226] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-24T20:09:33.628452] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-24T20:09:33.795914] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-24T20:09:33.796011] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-24T20:09:33.797029] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-24T20:09:33.797094] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-24T20:09:33.798344] [DEBUG] [LOCAL ] MTW: Trimmed 38383 records to 26513 (keeping 200 days of data) [2025-09-24T20:09:33.965915] [DEBUG] [LOCAL ] MTW: Primary data saved (26513 records). [2025-09-24T20:09:33.966349] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-24T20:09:33.966523] [INFO ] [MAIN ] Update Progress: 1426/2373 symbols completed. MTW took 41.5s. Estimated remaining: 2h 5m 51s. Rate: 7.5 symbols/min [2025-09-24T20:09:34.116953] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T20:09:34.179422] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:34.194281] [DEBUG] [LOCAL ] MUA: Loaded 12209 existing records from primary storage. [2025-09-24T20:09:34.194426] [INFO ] [MAIN ] MUA: Loaded 12209 existing records. [2025-09-24T20:09:34.377145] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:34.377513] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-24T20:09:34.377569] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-24T20:09:34.378009] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-24T20:09:34.378070] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-24T20:09:34.422572] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-24T20:09:34.743676] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:35.011334] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:09:35.179255] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T20:09:35.216066] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-24T20:09:36.016134] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-24T20:09:36.154797] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T20:09:36.158991] [INFO ] [REMOTE ] MTX: Full fetch complete (31085 records). [2025-09-24T20:09:36.159077] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-24T20:09:36.527399] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-24T20:09:36.527523] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-24T20:09:36.528380] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-24T20:09:36.528444] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-24T20:09:36.529445] [DEBUG] [LOCAL ] MTX: Trimmed 31085 records to 22844 (keeping 200 days of data) [2025-09-24T20:09:36.687094] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-24T20:09:36.687740] [DEBUG] [LOCAL ] MTX: Primary data saved (22844 records). [2025-09-24T20:09:36.691272] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-24T20:09:36.691374] [INFO ] [MAIN ] Update Progress: 1427/2373 symbols completed. MTX took 23.7s. Estimated remaining: 2h 5m 40s. Rate: 7.5 symbols/min [2025-09-24T20:09:36.821280] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-24T20:09:36.868725] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:36.891973] [DEBUG] [LOCAL ] MUC: Loaded 20165 existing records from primary storage. [2025-09-24T20:09:36.892122] [INFO ] [MAIN ] MUC: Loaded 20165 existing records. [2025-09-24T20:09:37.076133] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:37.076436] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-24T20:09:37.076487] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-24T20:09:37.077223] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-24T20:09:37.077287] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-24T20:09:37.478574] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:37.616097] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-24T20:09:37.807878] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T20:09:37.814080] [INFO ] [REMOTE ] MTUS: Full fetch complete (42717 records). [2025-09-24T20:09:37.814216] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-24T20:09:38.187018] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-24T20:09:38.187096] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-24T20:09:38.187817] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-24T20:09:38.187880] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-24T20:09:38.188812] [DEBUG] [LOCAL ] MTUS: Trimmed 42717 records to 28641 (keeping 200 days of data) [2025-09-24T20:09:38.357889] [DEBUG] [LOCAL ] MTUS: Primary data saved (28641 records). [2025-09-24T20:09:38.358026] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-24T20:09:38.358117] [INFO ] [MAIN ] Update Progress: 1428/2373 symbols completed. MTUS took 46.1s. Estimated remaining: 2h 5m 27s. Rate: 7.5 symbols/min [2025-09-24T20:09:38.421320] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-24T20:09:38.529875] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:38.544812] [DEBUG] [LOCAL ] MUE: Loaded 11990 existing records from primary storage. [2025-09-24T20:09:38.544984] [INFO ] [MAIN ] MUE: Loaded 11990 existing records. [2025-09-24T20:09:38.754112] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:38.754570] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-24T20:09:38.754738] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-24T20:09:38.755236] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-24T20:09:38.755295] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-24T20:09:39.034894] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T20:09:39.140514] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:39.216093] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-24T20:09:40.016060] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-24T20:09:40.088503] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T20:09:40.165600] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T20:09:40.816098] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-24T20:09:41.154014] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:09:41.616109] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-24T20:09:42.416048] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-24T20:09:42.494777] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:09:42.517463] [INFO ] [REMOTE ] MTZ: Full fetch complete (63402 records). [2025-09-24T20:09:42.518684] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T20:09:42.518870] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-24T20:09:42.931504] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-24T20:09:42.931633] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-24T20:09:42.932786] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-24T20:09:42.932856] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-24T20:09:42.934401] [DEBUG] [LOCAL ] MTZ: Trimmed 63402 records to 43360 (keeping 200 days of data) [2025-09-24T20:09:43.161944] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T20:09:43.219521] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-24T20:09:43.228975] [DEBUG] [LOCAL ] MTZ: Primary data saved (43360 records). [2025-09-24T20:09:43.229101] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-24T20:09:43.229205] [INFO ] [MAIN ] Update Progress: 1429/2373 symbols completed. MTZ took 27.7s. Estimated remaining: 2h 5m 17s. Rate: 7.5 symbols/min [2025-09-24T20:09:43.400265] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:43.454986] [DEBUG] [LOCAL ] MUFG: Loaded 52623 existing records from primary storage. [2025-09-24T20:09:43.455178] [INFO ] [MAIN ] MUFG: Loaded 52623 existing records. [2025-09-24T20:09:43.631789] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:09:43.632041] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-24T20:09:43.632091] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-24T20:09:43.633394] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-24T20:09:43.633467] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-24T20:09:44.003308] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:09:44.016031] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-24T20:09:44.315427] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T20:09:44.816084] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-24T20:09:45.575484] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T20:09:45.616047] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-24T20:09:45.739341] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T20:09:46.393772] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T20:09:46.416036] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-24T20:09:47.050325] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T20:09:47.216099] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-24T20:09:48.016100] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-24T20:09:48.401857] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T20:09:48.536920] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T20:09:48.816159] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-24T20:09:49.616147] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-24T20:09:49.916479] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T20:09:50.416091] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-24T20:09:50.444623] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T20:09:51.216147] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-24T20:09:51.965687] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:09:52.016086] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-24T20:09:52.107261] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T20:09:52.816110] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-24T20:09:52.836220] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:09:53.616145] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-24T20:09:54.416061] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-24T20:09:54.495537] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T20:09:54.532691] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T20:09:55.188343] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T20:09:55.216103] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-24T20:09:55.913662] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T20:09:56.016142] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-24T20:09:56.816137] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-24T20:09:57.616126] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-24T20:09:57.874528] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T20:09:57.908112] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T20:09:58.187153] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T20:09:58.416174] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-24T20:09:59.115994] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T20:09:59.119729] [INFO ] [REMOTE ] MUE: Full fetch complete (16202 records). [2025-09-24T20:09:59.119859] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-24T20:09:59.221198] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-24T20:09:59.546023] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-24T20:09:59.546148] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-24T20:09:59.546944] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-24T20:09:59.547079] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-24T20:09:59.547857] [DEBUG] [LOCAL ] MUE: Trimmed 16202 records to 11992 (keeping 200 days of data) [2025-09-24T20:09:59.640162] [DEBUG] [LOCAL ] MUE: Primary data saved (11992 records). [2025-09-24T20:09:59.640386] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-24T20:09:59.640680] [INFO ] [MAIN ] Update Progress: 1430/2373 symbols completed. MUE took 21.3s. Estimated remaining: 2h 5m 15s. Rate: 7.5 symbols/min [2025-09-24T20:09:59.857153] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:09:59.880221] [DEBUG] [LOCAL ] MUJ: Loaded 13307 existing records from primary storage. [2025-09-24T20:09:59.880583] [INFO ] [MAIN ] MUJ: Loaded 13307 existing records. [2025-09-24T20:10:00.018485] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-24T20:10:00.098757] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:00.099711] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-24T20:10:00.111749] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-24T20:10:00.111591] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:10:00.114951] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-24T20:10:00.115610] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-24T20:10:00.514451] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:00.816105] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-24T20:10:01.616060] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-24T20:10:01.769631] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T20:10:01.970778] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T20:10:02.416145] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-24T20:10:02.851217] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T20:10:03.043619] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T20:10:03.216105] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-24T20:10:04.016126] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-24T20:10:04.290094] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T20:10:04.816132] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-24T20:10:05.616241] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-24T20:10:05.637344] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T20:10:05.837621] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T20:10:06.416158] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-24T20:10:06.790732] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-24T20:10:07.216138] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-24T20:10:07.476300] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T20:10:08.016090] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-24T20:10:08.807786] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T20:10:08.819825] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-24T20:10:08.877534] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:10:09.616092] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-24T20:10:09.748885] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:10:09.753689] [INFO ] [REMOTE ] MUC: Full fetch complete (30130 records). [2025-09-24T20:10:09.753845] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-24T20:10:10.178621] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-24T20:10:10.178757] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-24T20:10:10.179537] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-24T20:10:10.179609] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-24T20:10:10.180542] [DEBUG] [LOCAL ] MUC: Trimmed 30130 records to 20230 (keeping 200 days of data) [2025-09-24T20:10:10.331172] [DEBUG] [LOCAL ] MUC: Primary data saved (20230 records). [2025-09-24T20:10:10.331366] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-24T20:10:10.331715] [INFO ] [MAIN ] Update Progress: 1431/2373 symbols completed. MUC took 33.6s. Estimated remaining: 2h 5m 9s. Rate: 7.5 symbols/min [2025-09-24T20:10:10.421228] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-24T20:10:10.522343] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:10.597715] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-24T20:10:10.597906] [INFO ] [MAIN ] MUR: Loaded 52929 existing records. [2025-09-24T20:10:10.780899] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:10.781187] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-24T20:10:10.781246] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-24T20:10:10.782537] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-24T20:10:10.782610] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-24T20:10:11.219579] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-24T20:10:11.231036] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:11.277422] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T20:10:11.280232] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T20:10:12.016083] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-24T20:10:12.349513] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T20:10:12.352963] [INFO ] [REMOTE ] MUA: Full fetch complete (18779 records). [2025-09-24T20:10:12.353095] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-24T20:10:12.755984] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-24T20:10:12.756077] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-24T20:10:12.756626] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-24T20:10:12.756750] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-24T20:10:12.757525] [DEBUG] [LOCAL ] MUA: Trimmed 18779 records to 12246 (keeping 200 days of data) [2025-09-24T20:10:12.827799] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-24T20:10:12.855040] [DEBUG] [LOCAL ] MUA: Primary data saved (12246 records). [2025-09-24T20:10:12.855206] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-24T20:10:12.855352] [INFO ] [MAIN ] Update Progress: 1432/2373 symbols completed. MUA took 38.9s. Estimated remaining: 2h 4m 57s. Rate: 7.5 symbols/min [2025-09-24T20:10:13.035005] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:13.066636] [DEBUG] [LOCAL ] MUSA: Loaded 24995 existing records from primary storage. [2025-09-24T20:10:13.066833] [INFO ] [MAIN ] MUSA: Loaded 24995 existing records. [2025-09-24T20:10:13.254721] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:13.255018] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-24T20:10:13.255069] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-24T20:10:13.256102] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-24T20:10:13.256168] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-24T20:10:13.627996] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-24T20:10:13.643021] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T20:10:13.683372] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:13.767419] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T20:10:14.416085] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-24T20:10:15.221217] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-24T20:10:15.237161] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-24T20:10:15.588467] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T20:10:16.016083] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-24T20:10:16.084298] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:10:16.816117] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-24T20:10:17.616117] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-24T20:10:17.909972] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T20:10:17.961632] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T20:10:18.416135] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-24T20:10:19.216174] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-24T20:10:19.340511] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T20:10:19.583873] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T20:10:19.601740] [INFO ] [REMOTE ] MUFG: Full fetch complete (75425 records). [2025-09-24T20:10:19.601992] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-24T20:10:20.018198] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-24T20:10:20.083970] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-24T20:10:20.084405] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-24T20:10:20.086719] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-24T20:10:20.087611] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-24T20:10:20.091473] [DEBUG] [LOCAL ] MUFG: Trimmed 75425 records to 52608 (keeping 200 days of data) [2025-09-24T20:10:20.496172] [DEBUG] [LOCAL ] MUFG: Primary data saved (52608 records). [2025-09-24T20:10:20.496425] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-24T20:10:20.496561] [INFO ] [MAIN ] Update Progress: 1433/2373 symbols completed. MUFG took 37.3s. Estimated remaining: 2h 4m 49s. Rate: 7.5 symbols/min [2025-09-24T20:10:20.683244] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:20.683853] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-24T20:10:20.684006] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-24T20:10:20.684459] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-24T20:10:20.684607] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-24T20:10:20.685013] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-24T20:10:20.685078] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-24T20:10:20.820897] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-24T20:10:21.100106] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T20:10:21.203134] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:21.270976] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T20:10:21.616109] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-24T20:10:21.845137] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T20:10:22.416224] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-24T20:10:22.623474] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T20:10:23.216219] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-24T20:10:23.324029] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T20:10:24.016214] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-24T20:10:24.268272] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-24T20:10:24.457491] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:10:24.816258] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-24T20:10:25.616210] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-24T20:10:25.926258] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:10:25.927017] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-24T20:10:25.961070] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T20:10:26.416256] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-24T20:10:27.216239] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-24T20:10:27.410308] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T20:10:27.416073] [INFO ] [REMOTE ] MUJ: Full fetch complete (20328 records). [2025-09-24T20:10:27.416358] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-24T20:10:27.903874] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-24T20:10:27.904003] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-24T20:10:27.904806] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-24T20:10:27.904877] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-24T20:10:27.906239] [DEBUG] [LOCAL ] MUJ: Trimmed 20328 records to 13328 (keeping 200 days of data) [2025-09-24T20:10:28.005315] [DEBUG] [LOCAL ] MUJ: Primary data saved (13328 records). [2025-09-24T20:10:28.005589] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-24T20:10:28.005767] [INFO ] [MAIN ] Update Progress: 1434/2373 symbols completed. MUJ took 28.4s. Estimated remaining: 2h 4m 41s. Rate: 7.5 symbols/min [2025-09-24T20:10:28.021223] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-24T20:10:28.224535] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:28.307903] [DEBUG] [LOCAL ] MUX: Loaded 42469 existing records from primary storage. [2025-09-24T20:10:28.308319] [INFO ] [MAIN ] MUX: Loaded 42469 existing records. [2025-09-24T20:10:28.545196] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:28.545902] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-24T20:10:28.546234] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-24T20:10:28.548569] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-24T20:10:28.548662] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-24T20:10:28.824996] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-24T20:10:29.042845] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:29.066924] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T20:10:29.092923] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:10:29.125792] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-24T20:10:29.130938] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T20:10:29.616088] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-24T20:10:30.416158] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-24T20:10:30.632104] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-24T20:10:30.963814] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T20:10:31.216136] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-24T20:10:32.016169] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-24T20:10:32.596702] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T20:10:32.816149] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-24T20:10:33.089450] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-24T20:10:33.310287] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T20:10:33.616081] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-24T20:10:34.416123] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-24T20:10:34.508150] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T20:10:35.216124] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-24T20:10:36.016112] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-24T20:10:36.195410] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T20:10:36.816165] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-24T20:10:36.887984] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:10:37.040858] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-24T20:10:37.323897] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T20:10:37.328855] [INFO ] [REMOTE ] MUSA: Full fetch complete (35035 records). [2025-09-24T20:10:37.329002] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-24T20:10:37.622077] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-24T20:10:37.714663] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-24T20:10:37.714757] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-24T20:10:37.715586] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-24T20:10:37.715628] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-24T20:10:37.716849] [DEBUG] [LOCAL ] MUSA: Trimmed 35035 records to 24915 (keeping 200 days of data) [2025-09-24T20:10:37.890661] [DEBUG] [LOCAL ] MUSA: Primary data saved (24915 records). [2025-09-24T20:10:37.890821] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-24T20:10:37.890918] [INFO ] [MAIN ] Update Progress: 1435/2373 symbols completed. MUSA took 25.0s. Estimated remaining: 2h 4m 34s. Rate: 7.5 symbols/min [2025-09-24T20:10:38.079427] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:38.094122] [DEBUG] [LOCAL ] MVF: Loaded 12776 existing records from primary storage. [2025-09-24T20:10:38.094244] [INFO ] [MAIN ] MVF: Loaded 12776 existing records. [2025-09-24T20:10:38.284002] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:38.284358] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-24T20:10:38.284425] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-24T20:10:38.284915] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-24T20:10:38.284981] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-24T20:10:38.421970] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-24T20:10:38.646063] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:38.700050] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-24T20:10:39.216053] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-24T20:10:39.257088] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T20:10:39.991170] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T20:10:40.016045] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-24T20:10:40.793138] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:10:40.816043] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-24T20:10:41.616106] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-24T20:10:41.707931] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T20:10:41.841080] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-24T20:10:42.416125] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-24T20:10:43.216068] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-24T20:10:43.473570] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T20:10:44.016093] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-24T20:10:44.720144] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T20:10:44.816124] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-24T20:10:45.616114] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-24T20:10:46.179441] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:10:46.179830] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-24T20:10:46.179959] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-24T20:10:46.180039] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-24T20:10:46.180730] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:10:46.180810] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:10:46.180888] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:10:46.180965] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-24T20:10:46.181034] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-24T20:10:46.181084] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-24T20:10:46.181176] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-24T20:10:46.181272] [INFO ] [MAIN ] Update Progress: 1436/2373 symbols completed. MUSE took 25.7s. Estimated remaining: 2h 4m 26s. Rate: 7.5 symbols/min [2025-09-24T20:10:46.387627] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-09-24T20:10:46.391147] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:10:46.411631] [DEBUG] [LOCAL ] MVO: Loaded 9070 existing records from primary storage. [2025-09-24T20:10:46.411815] [INFO ] [MAIN ] MVO: Loaded 9070 existing records. [2025-09-24T20:10:46.423165] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-24T20:10:46.625225] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:10:46.625506] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-24T20:10:46.625562] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-24T20:10:46.625941] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-24T20:10:46.626009] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-24T20:10:47.054452] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:10:47.108488] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-24T20:10:47.209553] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T20:10:47.216236] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-24T20:10:47.845028] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T20:10:48.016103] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-24T20:10:48.816104] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-24T20:10:49.542792] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T20:10:49.621327] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-24T20:10:49.637996] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T20:10:50.420938] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-24T20:10:50.425431] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T20:10:51.216104] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-24T20:10:51.906783] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T20:10:52.016131] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-24T20:10:52.363235] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:10:52.816071] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-24T20:10:53.203986] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T20:10:53.616092] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-24T20:10:54.416059] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-24T20:10:54.492790] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:10:54.503154] [INFO ] [REMOTE ] MUR: Full fetch complete (76395 records). [2025-09-24T20:10:54.503339] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-24T20:10:54.936254] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-24T20:10:54.936440] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-24T20:10:54.938006] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-24T20:10:54.938085] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-24T20:10:54.939897] [DEBUG] [LOCAL ] MUR: Trimmed 76395 records to 52929 (keeping 200 days of data) [2025-09-24T20:10:55.195504] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:10:55.216128] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-24T20:10:55.323990] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T20:10:55.354221] [DEBUG] [LOCAL ] MUR: Primary data saved (52929 records). [2025-09-24T20:10:55.354396] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-24T20:10:55.354521] [INFO ] [MAIN ] Update Progress: 1437/2373 symbols completed. MUR took 45.0s. Estimated remaining: 2h 4m 19s. Rate: 7.5 symbols/min [2025-09-24T20:10:56.016149] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-24T20:10:56.410580] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T20:10:56.816127] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-24T20:10:56.903358] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T20:10:57.616090] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-24T20:10:57.809058] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T20:10:57.812670] [INFO ] [REMOTE ] MVF: Full fetch complete (19175 records). [2025-09-24T20:10:57.812798] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-24T20:10:58.284590] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-24T20:10:58.284804] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-24T20:10:58.285356] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-24T20:10:58.285427] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-24T20:10:58.294272] [DEBUG] [LOCAL ] MVF: Trimmed 19175 records to 12751 (keeping 200 days of data) [2025-09-24T20:10:58.294608] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T20:10:58.377010] [DEBUG] [LOCAL ] MVF: Primary data saved (12751 records). [2025-09-24T20:10:58.377184] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-24T20:10:58.377280] [INFO ] [MAIN ] Update Progress: 1438/2373 symbols completed. MVF took 20.5s. Estimated remaining: 2h 4m 8s. Rate: 7.5 symbols/min [2025-09-24T20:10:58.416117] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-24T20:10:59.216165] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-24T20:11:00.554619] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-24T20:11:00.563541] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-24T20:11:01.031818] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:11:01.035020] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-24T20:11:02.139122] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T20:11:02.141440] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-24T20:11:02.888152] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:11:02.892940] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-24T20:11:03.171764] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-24T20:11:03.216099] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-24T20:11:03.549939] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T20:11:04.016118] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-24T20:11:04.740710] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T20:11:04.788438] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T20:11:04.816037] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-24T20:11:05.616085] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-24T20:11:06.449566] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:11:06.452049] [INFO ] [REMOTE ] MVO: Full fetch complete (14553 records). [2025-09-24T20:11:06.452133] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-24T20:11:06.842212] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-24T20:11:06.842442] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-24T20:11:06.843082] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-24T20:11:06.843219] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-24T20:11:06.844057] [DEBUG] [LOCAL ] MVO: Trimmed 14553 records to 9065 (keeping 200 days of data) [2025-09-24T20:11:06.919428] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-24T20:11:06.945692] [DEBUG] [LOCAL ] MVO: Primary data saved (9065 records). [2025-09-24T20:11:06.946148] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-24T20:11:06.945883] [INFO ] [REMOTE ] MUX: Full fetch complete (58758 records). [2025-09-24T20:11:06.946403] [INFO ] [MAIN ] Update Progress: 1439/2373 symbols completed. MVO took 20.8s. Estimated remaining: 2h 4m 0s. Rate: 7.5 symbols/min [2025-09-24T20:11:06.946762] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-24T20:11:07.384302] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-24T20:11:07.384420] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-24T20:11:07.385611] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-24T20:11:07.385707] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-24T20:11:07.387505] [DEBUG] [LOCAL ] MUX: Trimmed 58758 records to 42544 (keeping 200 days of data) [2025-09-24T20:11:07.666761] [DEBUG] [LOCAL ] MUX: Primary data saved (42544 records). [2025-09-24T20:11:07.666934] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-24T20:11:07.667050] [INFO ] [MAIN ] Update Progress: 1440/2373 symbols completed. MUX took 39.7s. Estimated remaining: 2h 3m 48s. Rate: 7.5 symbols/min [2025-09-24T20:11:08.461696] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:08.495099] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:08.489983] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:08.510747] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-24T20:11:08.535627] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:08.535934] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-24T20:11:08.536785] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-24T20:11:08.537233] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-24T20:11:08.537737] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-24T20:11:08.537820] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-24T20:11:08.623535] [DEBUG] [LOCAL ] MVT: Loaded 10081 existing records from primary storage. [2025-09-24T20:11:08.655304] [INFO ] [MAIN ] MVT: Loaded 10081 existing records. [2025-09-24T20:11:08.815251] [DEBUG] [LOCAL ] MX: Loaded 23049 existing records from primary storage. [2025-09-24T20:11:08.912722] [INFO ] [MAIN ] MX: Loaded 23049 existing records. [2025-09-24T20:11:09.142630] [DEBUG] [LOCAL ] MWA: Loaded 47125 existing records from primary storage. [2025-09-24T20:11:09.235234] [INFO ] [MAIN ] MWA: Loaded 47125 existing records. [2025-09-24T20:11:09.371300] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:09.420963] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:09.480098] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-24T20:11:09.484282] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:09.490372] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-24T20:11:09.495756] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-24T20:11:09.516834] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-24T20:11:09.523101] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-24T20:11:09.526891] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-24T20:11:09.527020] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-24T20:11:09.538307] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-24T20:11:09.564795] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-24T20:11:09.885399] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:09.949998] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-24T20:11:09.952633] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-24T20:11:10.013449] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T20:11:10.021409] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-24T20:11:10.044576] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-24T20:11:10.054557] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-24T20:11:10.468908] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:10.508279] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-24T20:11:10.511361] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:10.531466] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-24T20:11:10.760967] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T20:11:10.766567] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:10.766907] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-24T20:11:10.768225] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-24T20:11:11.393952] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T20:11:11.395164] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-24T20:11:11.479687] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T20:11:11.621339] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T20:11:11.818724] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-24T20:11:12.016102] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-24T20:11:12.382928] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-24T20:11:12.386074] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:11:12.816138] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-24T20:11:13.616088] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-24T20:11:13.763361] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T20:11:14.035478] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-24T20:11:14.416085] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-24T20:11:14.774698] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-24T20:11:15.216110] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-24T20:11:15.615378] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-24T20:11:16.016098] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-24T20:11:16.816161] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-24T20:11:17.611996] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T20:11:17.622923] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-24T20:11:17.645475] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T20:11:18.026887] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-24T20:11:18.416165] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-24T20:11:18.930442] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T20:11:18.931575] [INFO ] [REMOTE ] MXE: Full fetch complete (2678 records). [2025-09-24T20:11:18.931673] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-24T20:11:19.126843] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T20:11:19.127089] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:11:19.127161] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:11:19.127237] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-24T20:11:19.127306] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-24T20:11:19.127346] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-24T20:11:19.127387] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-24T20:11:19.127450] [INFO ] [MAIN ] Update Progress: 1441/2373 symbols completed. MXE took 11.5s. Estimated remaining: 2h 3m 42s. Rate: 7.5 symbols/min [2025-09-24T20:11:19.221273] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-24T20:11:19.312384] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:19.325450] [DEBUG] [LOCAL ] MXF: Loaded 6002 existing records from primary storage. [2025-09-24T20:11:19.325600] [INFO ] [MAIN ] MXF: Loaded 6002 existing records. [2025-09-24T20:11:19.517863] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:19.518170] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-24T20:11:19.518223] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-24T20:11:19.518673] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-24T20:11:19.518741] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-24T20:11:19.972819] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T20:11:19.977948] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:20.016126] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-24T20:11:20.769877] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T20:11:20.816093] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-24T20:11:21.616129] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-24T20:11:21.705448] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T20:11:22.416084] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-24T20:11:22.521280] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T20:11:23.216075] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-24T20:11:23.226808] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T20:11:24.016355] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-24T20:11:24.371603] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T20:11:24.816122] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-24T20:11:25.034932] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T20:11:25.616112] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-24T20:11:26.207521] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T20:11:26.416211] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-24T20:11:26.550093] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T20:11:27.216220] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-24T20:11:27.993852] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:11:28.016143] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-24T20:11:28.213225] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:11:28.816143] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-24T20:11:29.277708] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T20:11:29.616095] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-24T20:11:30.185050] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T20:11:30.223285] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T20:11:30.416130] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-24T20:11:31.216120] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-24T20:11:31.658151] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T20:11:31.936404] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T20:11:32.016206] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-24T20:11:32.819457] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-24T20:11:33.616131] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-24T20:11:33.682972] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T20:11:33.950292] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:11:34.382742] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T20:11:34.416128] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-24T20:11:35.028625] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T20:11:35.031219] [INFO ] [REMOTE ] MVT: Full fetch complete (14639 records). [2025-09-24T20:11:35.031389] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-24T20:11:35.221425] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-24T20:11:35.408331] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-24T20:11:35.408420] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-24T20:11:35.408893] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-24T20:11:35.408957] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-24T20:11:35.409570] [DEBUG] [LOCAL ] MVT: Trimmed 14639 records to 10084 (keeping 200 days of data) [2025-09-24T20:11:35.479980] [DEBUG] [LOCAL ] MVT: Primary data saved (10084 records). [2025-09-24T20:11:35.480147] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-24T20:11:35.480244] [INFO ] [MAIN ] Update Progress: 1442/2373 symbols completed. MVT took 27.8s. Estimated remaining: 2h 3m 39s. Rate: 7.5 symbols/min [2025-09-24T20:11:35.664625] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:35.681558] [DEBUG] [LOCAL ] MYD: Loaded 13760 existing records from primary storage. [2025-09-24T20:11:35.681744] [INFO ] [MAIN ] MYD: Loaded 13760 existing records. [2025-09-24T20:11:35.869013] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:35.869496] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-24T20:11:35.869557] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-24T20:11:35.870260] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-24T20:11:35.870323] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-24T20:11:36.021268] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-24T20:11:36.275214] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:36.625062] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T20:11:36.711269] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T20:11:36.816076] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-24T20:11:37.594983] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T20:11:37.616052] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-24T20:11:38.416117] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-24T20:11:38.459953] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T20:11:39.216136] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-24T20:11:39.512278] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T20:11:39.715233] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T20:11:40.016147] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-24T20:11:40.816128] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-24T20:11:41.099419] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T20:11:41.351482] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T20:11:41.616097] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-24T20:11:42.264355] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-24T20:11:42.416107] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-24T20:11:43.216150] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-24T20:11:43.261867] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T20:11:44.016116] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-24T20:11:44.460145] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T20:11:44.464810] [INFO ] [REMOTE ] MX: Full fetch complete (31903 records). [2025-09-24T20:11:44.464903] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-24T20:11:44.668863] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T20:11:44.748184] [INFO ] [REMOTE ] MXF: Full fetch complete (10471 records). [2025-09-24T20:11:44.759721] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-24T20:11:44.829723] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-24T20:11:45.061699] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-24T20:11:45.094634] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-24T20:11:45.150762] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-24T20:11:45.174031] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-24T20:11:45.223145] [DEBUG] [LOCAL ] MX: Trimmed 31903 records to 23108 (keeping 200 days of data) [2025-09-24T20:11:45.410540] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-24T20:11:45.413093] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-24T20:11:45.414482] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-24T20:11:45.415500] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-24T20:11:45.421012] [DEBUG] [LOCAL ] MXF: Trimmed 10471 records to 5969 (keeping 200 days of data) [2025-09-24T20:11:45.500903] [DEBUG] [LOCAL ] MX: Primary data saved (23108 records). [2025-09-24T20:11:45.502422] [DEBUG] [LOCAL ] MXF: Primary data saved (5969 records). [2025-09-24T20:11:45.502759] [INFO ] [MAIN ] MX: Full history saved. [2025-09-24T20:11:45.502880] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-24T20:11:45.503081] [INFO ] [MAIN ] Update Progress: 1443/2373 symbols completed. MX took 37.8s. Estimated remaining: 2h 3m 33s. Rate: 7.5 symbols/min [2025-09-24T20:11:45.503612] [INFO ] [MAIN ] Update Progress: 1444/2373 symbols completed. MXF took 26.4s. Estimated remaining: 2h 3m 20s. Rate: 7.5 symbols/min [2025-09-24T20:11:45.638401] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-24T20:11:45.886991] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:45.910945] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:11:45.941098] [DEBUG] [LOCAL ] MYI: Loaded 19317 existing records from primary storage. [2025-09-24T20:11:45.948683] [INFO ] [MAIN ] MYI: Loaded 19317 existing records. [2025-09-24T20:11:46.018788] [DEBUG] [LOCAL ] MYE: Loaded 25195 existing records from primary storage. [2025-09-24T20:11:46.030326] [INFO ] [MAIN ] MYE: Loaded 25195 existing records. [2025-09-24T20:11:46.255305] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:46.276697] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-24T20:11:46.303694] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-24T20:11:46.336714] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:11:46.337181] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-24T20:11:46.337238] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-24T20:11:46.337279] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-24T20:11:46.337382] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-24T20:11:46.360662] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-24T20:11:46.417719] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-24T20:11:46.790067] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T20:11:46.905056] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-24T20:11:47.158240] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:47.160196] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-24T20:11:47.227433] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-24T20:11:47.280870] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:11:47.872609] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T20:11:48.016099] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-24T20:11:48.524689] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T20:11:48.816109] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-24T20:11:49.092850] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T20:11:49.616118] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-24T20:11:49.927523] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T20:11:50.416096] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-24T20:11:50.592222] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T20:11:51.216093] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-24T20:11:51.646362] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T20:11:52.016166] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-24T20:11:52.273308] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T20:11:52.816074] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-24T20:11:52.880639] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:11:53.496322] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-24T20:11:53.616113] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-24T20:11:54.416210] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-24T20:11:54.678500] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T20:11:55.216118] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-24T20:11:56.025688] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-24T20:11:56.052983] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T20:11:56.661262] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T20:11:56.816117] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-24T20:11:57.115439] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T20:11:57.616126] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-24T20:11:57.877200] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T20:11:58.416100] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-24T20:11:58.683031] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T20:11:59.211036] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T20:11:59.216213] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-24T20:12:00.016094] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-24T20:12:00.816125] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-24T20:12:00.990301] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T20:12:00.998560] [INFO ] [REMOTE ] MWA: Full fetch complete (67816 records). [2025-09-24T20:12:00.998740] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-24T20:12:01.128118] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T20:12:01.416225] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-24T20:12:01.416328] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-24T20:12:01.417542] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-24T20:12:01.417611] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-24T20:12:01.419210] [DEBUG] [LOCAL ] MWA: Trimmed 67816 records to 47050 (keeping 200 days of data) [2025-09-24T20:12:01.625728] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-24T20:12:01.742693] [DEBUG] [LOCAL ] MWA: Primary data saved (47050 records). [2025-09-24T20:12:01.742869] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-24T20:12:01.742983] [INFO ] [MAIN ] Update Progress: 1445/2373 symbols completed. MWA took 54.1s. Estimated remaining: 2h 3m 17s. Rate: 7.5 symbols/min [2025-09-24T20:12:01.919835] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:01.933869] [DEBUG] [LOCAL ] MYN: Loaded 10315 existing records from primary storage. [2025-09-24T20:12:01.934116] [INFO ] [MAIN ] MYN: Loaded 10315 existing records. [2025-09-24T20:12:02.175994] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:02.176703] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-24T20:12:02.176813] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-24T20:12:02.177327] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-24T20:12:02.177389] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-24T20:12:02.418433] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-24T20:12:02.589620] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:02.604418] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:12:03.216096] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-24T20:12:04.016094] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-24T20:12:04.211772] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-24T20:12:04.532987] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T20:12:04.680948] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-24T20:12:04.709796] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T20:12:04.816103] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-24T20:12:05.616096] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-24T20:12:05.710438] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:12:06.158054] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T20:12:06.416107] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-24T20:12:07.216059] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-24T20:12:07.372040] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T20:12:08.016135] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-24T20:12:08.318614] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T20:12:08.721492] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T20:12:08.816121] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-24T20:12:09.616139] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-24T20:12:09.891725] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T20:12:10.416208] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-24T20:12:10.535477] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T20:12:10.538631] [INFO ] [REMOTE ] MYD: Full fetch complete (20804 records). [2025-09-24T20:12:10.538778] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-24T20:12:10.949973] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-24T20:12:10.950150] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-24T20:12:10.950915] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-24T20:12:10.951003] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-24T20:12:10.952672] [DEBUG] [LOCAL ] MYD: Trimmed 20804 records to 13773 (keeping 200 days of data) [2025-09-24T20:12:11.046885] [DEBUG] [LOCAL ] MYD: Primary data saved (13773 records). [2025-09-24T20:12:11.047054] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-24T20:12:11.047281] [INFO ] [MAIN ] Update Progress: 1446/2373 symbols completed. MYD took 35.6s. Estimated remaining: 2h 3m 10s. Rate: 7.5 symbols/min [2025-09-24T20:12:11.220333] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:11.218763] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-24T20:12:11.266524] [DEBUG] [LOCAL ] NABL: Loaded 39949 existing records from primary storage. [2025-09-24T20:12:11.266696] [INFO ] [MAIN ] NABL: Loaded 39949 existing records. [2025-09-24T20:12:11.446841] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:11.447161] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-24T20:12:11.447212] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-24T20:12:11.448380] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-24T20:12:11.448444] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-24T20:12:11.815165] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T20:12:11.847320] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:11.841250] [INFO ] [REMOTE ] MYI: Full fetch complete (29542 records). [2025-09-24T20:12:11.847532] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-24T20:12:12.022635] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-24T20:12:12.219158] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-24T20:12:12.219240] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-24T20:12:12.219971] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-24T20:12:12.220034] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-24T20:12:12.221347] [DEBUG] [LOCAL ] MYI: Trimmed 29542 records to 19328 (keeping 200 days of data) [2025-09-24T20:12:12.351015] [DEBUG] [LOCAL ] MYI: Primary data saved (19328 records). [2025-09-24T20:12:12.351169] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-24T20:12:12.351286] [INFO ] [MAIN ] Update Progress: 1447/2373 symbols completed. MYI took 26.8s. Estimated remaining: 2h 2m 58s. Rate: 7.5 symbols/min [2025-09-24T20:12:12.519431] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:12.545190] [DEBUG] [LOCAL ] NAC: Loaded 24661 existing records from primary storage. [2025-09-24T20:12:12.545325] [INFO ] [MAIN ] NAC: Loaded 24661 existing records. [2025-09-24T20:12:12.745789] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:12.746411] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-24T20:12:12.746684] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-24T20:12:12.752953] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-24T20:12:12.756735] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-24T20:12:12.816420] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-24T20:12:12.828809] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T20:12:12.875630] [INFO ] [REMOTE ] MYE: Full fetch complete (36796 records). [2025-09-24T20:12:12.878397] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-24T20:12:13.450040] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:13.537322] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-24T20:12:13.537409] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-24T20:12:13.538278] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-24T20:12:13.538354] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-24T20:12:13.539597] [DEBUG] [LOCAL ] MYE: Trimmed 36796 records to 25021 (keeping 200 days of data) [2025-09-24T20:12:13.639547] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-24T20:12:13.714821] [DEBUG] [LOCAL ] MYE: Primary data saved (25021 records). [2025-09-24T20:12:13.714954] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-24T20:12:13.715044] [INFO ] [MAIN ] Update Progress: 1448/2373 symbols completed. MYE took 28.2s. Estimated remaining: 2h 2m 46s. Rate: 7.5 symbols/min [2025-09-24T20:12:13.914896] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:13.961790] [DEBUG] [LOCAL ] NAD: Loaded 34040 existing records from primary storage. [2025-09-24T20:12:13.961938] [INFO ] [MAIN ] NAD: Loaded 34040 existing records. [2025-09-24T20:12:14.149579] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-24T20:12:14.154961] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:14.158241] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-24T20:12:14.158421] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-24T20:12:14.159798] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-24T20:12:14.159862] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-24T20:12:14.421173] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-24T20:12:14.544673] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:14.662487] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T20:12:15.181312] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:12:15.216043] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-24T20:12:15.275301] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T20:12:16.016118] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-24T20:12:16.433482] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T20:12:16.816130] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-24T20:12:17.334333] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T20:12:17.616112] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-24T20:12:17.676133] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T20:12:18.416104] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-24T20:12:18.877663] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T20:12:19.216073] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-24T20:12:19.321155] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T20:12:20.016118] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-24T20:12:20.825030] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-24T20:12:20.830479] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T20:12:20.864046] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T20:12:21.616084] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-24T20:12:22.226431] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T20:12:22.292105] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:12:22.416112] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-24T20:12:23.216084] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-24T20:12:23.369953] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T20:12:24.016104] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-24T20:12:24.672913] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T20:12:24.758495] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T20:12:24.761241] [INFO ] [REMOTE ] MYN: Full fetch complete (15495 records). [2025-09-24T20:12:24.761370] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-24T20:12:24.824562] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-24T20:12:25.149275] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-24T20:12:25.149371] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-24T20:12:25.149904] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-24T20:12:25.149986] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-24T20:12:25.151682] [DEBUG] [LOCAL ] MYN: Trimmed 15495 records to 10238 (keeping 200 days of data) [2025-09-24T20:12:25.224306] [DEBUG] [LOCAL ] MYN: Primary data saved (10238 records). [2025-09-24T20:12:25.224468] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-24T20:12:25.224619] [INFO ] [MAIN ] Update Progress: 1449/2373 symbols completed. MYN took 23.5s. Estimated remaining: 2h 2m 40s. Rate: 7.5 symbols/min [2025-09-24T20:12:25.403086] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:25.416162] [DEBUG] [LOCAL ] NAN: Loaded 9048 existing records from primary storage. [2025-09-24T20:12:25.416341] [INFO ] [MAIN ] NAN: Loaded 9048 existing records. [2025-09-24T20:12:25.613827] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:25.614329] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-24T20:12:25.614404] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-24T20:12:25.614944] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-24T20:12:25.615020] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-24T20:12:25.626630] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-24T20:12:26.004729] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:26.041739] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T20:12:26.416088] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-24T20:12:26.811156] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T20:12:27.216117] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-24T20:12:27.320186] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T20:12:28.016056] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-24T20:12:28.484311] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T20:12:28.816208] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-24T20:12:29.616117] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-24T20:12:29.640328] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:12:29.731835] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T20:12:30.416134] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-24T20:12:30.882525] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T20:12:31.216092] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-24T20:12:31.227759] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T20:12:32.016083] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-24T20:12:32.301548] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T20:12:32.816053] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-24T20:12:33.237337] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T20:12:33.616093] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-24T20:12:33.733836] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T20:12:34.416215] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-24T20:12:34.735909] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T20:12:35.216107] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-24T20:12:35.842543] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T20:12:35.970501] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T20:12:36.016040] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-24T20:12:36.816091] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-24T20:12:37.449836] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T20:12:37.616117] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-24T20:12:37.933759] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T20:12:38.416137] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-24T20:12:38.465906] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T20:12:39.216082] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-24T20:12:39.602361] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T20:12:40.016129] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-24T20:12:40.581721] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T20:12:40.816125] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-24T20:12:41.255301] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T20:12:41.265639] [INFO ] [REMOTE ] NABL: Full fetch complete (56733 records). [2025-09-24T20:12:41.265901] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-24T20:12:41.619577] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-24T20:12:41.679748] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-24T20:12:41.679846] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-24T20:12:41.681040] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-24T20:12:41.681138] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-24T20:12:41.682718] [DEBUG] [LOCAL ] NABL: Trimmed 56733 records to 39814 (keeping 200 days of data) [2025-09-24T20:12:41.931517] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T20:12:41.956991] [DEBUG] [LOCAL ] NABL: Primary data saved (39814 records). [2025-09-24T20:12:41.957160] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-24T20:12:41.957336] [INFO ] [MAIN ] Update Progress: 1450/2373 symbols completed. NABL took 30.9s. Estimated remaining: 2h 2m 37s. Rate: 7.5 symbols/min [2025-09-24T20:12:42.134168] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:42.183084] [DEBUG] [LOCAL ] NAT: Loaded 49132 existing records from primary storage. [2025-09-24T20:12:42.183255] [INFO ] [MAIN ] NAT: Loaded 49132 existing records. [2025-09-24T20:12:42.366534] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:42.366813] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-24T20:12:42.366866] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-24T20:12:42.368275] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-24T20:12:42.368340] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-24T20:12:42.424947] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-24T20:12:42.765011] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:43.036489] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T20:12:43.216104] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-24T20:12:43.447669] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T20:12:44.016066] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-24T20:12:44.261706] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T20:12:44.816118] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-24T20:12:45.370971] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T20:12:45.616091] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-24T20:12:46.100808] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:12:46.108794] [INFO ] [REMOTE ] NAC: Full fetch complete (36271 records). [2025-09-24T20:12:46.109005] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-24T20:12:46.385143] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T20:12:46.421194] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-24T20:12:46.562516] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-24T20:12:46.562614] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-24T20:12:46.563962] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-24T20:12:46.564038] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-24T20:12:46.565420] [DEBUG] [LOCAL ] NAC: Trimmed 36271 records to 24631 (keeping 200 days of data) [2025-09-24T20:12:46.720668] [DEBUG] [LOCAL ] NAC: Primary data saved (24631 records). [2025-09-24T20:12:46.720820] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-24T20:12:46.720912] [INFO ] [MAIN ] Update Progress: 1451/2373 symbols completed. NAC took 34.4s. Estimated remaining: 2h 2m 27s. Rate: 7.5 symbols/min [2025-09-24T20:12:46.890173] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:46.928536] [DEBUG] [LOCAL ] NATL: Loaded 32802 existing records from primary storage. [2025-09-24T20:12:46.928705] [INFO ] [MAIN ] NATL: Loaded 32802 existing records. [2025-09-24T20:12:47.104769] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:47.105079] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-24T20:12:47.105133] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-24T20:12:47.106067] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-24T20:12:47.106130] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-24T20:12:47.221154] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-24T20:12:47.463130] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:48.005092] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T20:12:48.016521] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-24T20:12:48.725151] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:12:48.816041] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-24T20:12:49.475159] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T20:12:49.616098] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-24T20:12:49.901928] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T20:12:49.908046] [INFO ] [REMOTE ] NAD: Full fetch complete (50100 records). [2025-09-24T20:12:49.908143] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-24T20:12:50.282829] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-24T20:12:50.282912] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-24T20:12:50.283764] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-24T20:12:50.283831] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-24T20:12:50.284907] [DEBUG] [LOCAL ] NAD: Trimmed 50100 records to 33965 (keeping 200 days of data) [2025-09-24T20:12:50.450362] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-24T20:12:50.505568] [DEBUG] [LOCAL ] NAD: Primary data saved (33965 records). [2025-09-24T20:12:50.505714] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-24T20:12:50.505809] [INFO ] [MAIN ] Update Progress: 1452/2373 symbols completed. NAD took 36.8s. Estimated remaining: 2h 2m 17s. Rate: 7.5 symbols/min [2025-09-24T20:12:50.673736] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:50.678029] [DEBUG] [LOCAL ] NAZ: Loaded 2624 existing records from primary storage. [2025-09-24T20:12:50.678101] [INFO ] [MAIN ] NAZ: Loaded 2624 existing records. [2025-09-24T20:12:50.858293] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:50.858691] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-24T20:12:50.858766] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-24T20:12:50.859109] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-24T20:12:50.859180] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-24T20:12:51.064512] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T20:12:51.221279] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-24T20:12:51.275674] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:52.016078] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-24T20:12:52.216027] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T20:12:52.253834] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:12:52.482858] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-24T20:12:52.816114] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-24T20:12:53.616078] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-24T20:12:53.782188] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T20:12:54.396226] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T20:12:54.416064] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-24T20:12:55.216099] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-24T20:12:55.785547] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T20:12:56.016103] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-24T20:12:56.220762] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:12:56.816098] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-24T20:12:56.843006] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:12:56.845291] [INFO ] [REMOTE ] NAN: Full fetch complete (14014 records). [2025-09-24T20:12:56.845371] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-24T20:12:57.223210] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-24T20:12:57.223299] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-24T20:12:57.223685] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-24T20:12:57.223747] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-24T20:12:57.224247] [DEBUG] [LOCAL ] NAN: Trimmed 14014 records to 9041 (keeping 200 days of data) [2025-09-24T20:12:57.281209] [DEBUG] [LOCAL ] NAN: Primary data saved (9041 records). [2025-09-24T20:12:57.281349] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-24T20:12:57.281439] [INFO ] [MAIN ] Update Progress: 1453/2373 symbols completed. NAN took 32.1s. Estimated remaining: 2h 2m 8s. Rate: 7.5 symbols/min [2025-09-24T20:12:57.453443] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:12:57.465146] [DEBUG] [LOCAL ] NBB: Loaded 8868 existing records from primary storage. [2025-09-24T20:12:57.465273] [INFO ] [MAIN ] NBB: Loaded 8868 existing records. [2025-09-24T20:12:57.644335] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:12:57.638447] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-24T20:12:57.645454] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-24T20:12:57.645518] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-24T20:12:57.645907] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-24T20:12:57.645968] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-24T20:12:58.003272] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:12:58.246864] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:12:58.416090] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-24T20:12:58.966926] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T20:12:59.216074] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-24T20:12:59.390165] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T20:12:59.783890] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T20:13:00.016076] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-24T20:13:00.816063] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-24T20:13:01.024302] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T20:13:01.616118] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-24T20:13:02.202761] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T20:13:02.416150] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-24T20:13:03.218954] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-24T20:13:03.240736] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T20:13:03.648112] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T20:13:03.842235] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T20:13:04.016079] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-24T20:13:04.483047] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T20:13:04.816085] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-24T20:13:05.295400] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T20:13:05.616134] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-24T20:13:06.087670] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T20:13:06.416254] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-24T20:13:07.216119] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-24T20:13:07.442420] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:13:08.016236] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-24T20:13:08.591927] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T20:13:08.816084] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-24T20:13:08.867375] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T20:13:09.586618] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T20:13:09.616274] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-24T20:13:10.416217] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-24T20:13:10.779822] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T20:13:10.831165] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T20:13:11.216211] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-24T20:13:12.016125] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-24T20:13:12.582301] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T20:13:12.816119] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-24T20:13:12.888802] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T20:13:12.890232] [INFO ] [REMOTE ] NAZ: Full fetch complete (4425 records). [2025-09-24T20:13:12.890307] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-24T20:13:13.290484] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-24T20:13:13.290606] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-24T20:13:13.290820] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-24T20:13:13.290884] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-24T20:13:13.291387] [DEBUG] [LOCAL ] NAZ: Trimmed 4425 records to 2671 (keeping 200 days of data) [2025-09-24T20:13:13.312687] [DEBUG] [LOCAL ] NAZ: Primary data saved (2671 records). [2025-09-24T20:13:13.312902] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-24T20:13:13.313064] [INFO ] [MAIN ] Update Progress: 1454/2373 symbols completed. NAZ took 22.8s. Estimated remaining: 2h 2m 5s. Rate: 7.5 symbols/min [2025-09-24T20:13:13.536791] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:13.570432] [DEBUG] [LOCAL ] NBHC: Loaded 23147 existing records from primary storage. [2025-09-24T20:13:13.570710] [INFO ] [MAIN ] NBHC: Loaded 23147 existing records. [2025-09-24T20:13:13.621341] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-24T20:13:13.787676] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:13.788004] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-24T20:13:13.788065] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-24T20:13:13.789046] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-24T20:13:13.789109] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-24T20:13:14.232403] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:14.289174] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T20:13:14.320503] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:13:14.416214] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-24T20:13:15.216138] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-24T20:13:15.515146] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-24T20:13:16.016217] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-24T20:13:16.519369] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T20:13:16.527135] [INFO ] [REMOTE ] NATL: Full fetch complete (45584 records). [2025-09-24T20:13:16.527385] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-24T20:13:16.821193] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-24T20:13:16.936542] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T20:13:17.016236] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-24T20:13:17.016400] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-24T20:13:17.017546] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-24T20:13:17.017630] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-24T20:13:17.019461] [DEBUG] [LOCAL ] NATL: Trimmed 45584 records to 32862 (keeping 200 days of data) [2025-09-24T20:13:17.235257] [DEBUG] [LOCAL ] NATL: Primary data saved (32862 records). [2025-09-24T20:13:17.235554] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-24T20:13:17.235738] [INFO ] [MAIN ] Update Progress: 1455/2373 symbols completed. NATL took 30.5s. Estimated remaining: 2h 1m 55s. Rate: 7.5 symbols/min [2025-09-24T20:13:17.434629] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:17.476230] [DEBUG] [LOCAL ] NBR: Loaded 34912 existing records from primary storage. [2025-09-24T20:13:17.476488] [INFO ] [MAIN ] NBR: Loaded 34912 existing records. [2025-09-24T20:13:17.621296] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-24T20:13:17.715824] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:17.716372] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-24T20:13:17.716438] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-24T20:13:17.717547] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-24T20:13:17.717618] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-24T20:13:18.100974] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T20:13:18.196429] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:18.206006] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T20:13:18.416132] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-24T20:13:19.177914] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T20:13:19.216156] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-24T20:13:20.016119] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-24T20:13:20.623411] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T20:13:20.816135] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-24T20:13:21.254832] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T20:13:21.616202] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-24T20:13:22.421306] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-24T20:13:22.439815] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T20:13:23.052009] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T20:13:23.173707] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T20:13:23.216091] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-24T20:13:24.016135] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-24T20:13:24.639863] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T20:13:24.816189] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-24T20:13:25.095622] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T20:13:25.616194] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-24T20:13:26.376674] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T20:13:26.416077] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-24T20:13:26.693599] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T20:13:27.216157] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-24T20:13:27.363032] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T20:13:27.366523] [INFO ] [REMOTE ] NBB: Full fetch complete (13893 records). [2025-09-24T20:13:27.366617] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-24T20:13:27.766262] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-24T20:13:27.766391] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-24T20:13:27.766884] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-24T20:13:27.766947] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-24T20:13:27.767515] [DEBUG] [LOCAL ] NBB: Trimmed 13893 records to 8877 (keeping 200 days of data) [2025-09-24T20:13:27.830005] [DEBUG] [LOCAL ] NBB: Primary data saved (8877 records). [2025-09-24T20:13:27.830176] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-24T20:13:27.830275] [INFO ] [MAIN ] Update Progress: 1456/2373 symbols completed. NBB took 30.5s. Estimated remaining: 2h 1m 48s. Rate: 7.5 symbols/min [2025-09-24T20:13:28.007676] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:28.016075] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-24T20:13:28.035429] [DEBUG] [LOCAL ] NBXG: Loaded 22623 existing records from primary storage. [2025-09-24T20:13:28.035599] [INFO ] [MAIN ] NBXG: Loaded 22623 existing records. [2025-09-24T20:13:28.252735] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:28.253050] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-24T20:13:28.253105] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-24T20:13:28.253917] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-24T20:13:28.253982] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-24T20:13:28.668710] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:28.816074] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-24T20:13:29.040570] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T20:13:29.551512] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T20:13:29.600437] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T20:13:29.616084] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-24T20:13:30.416056] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-24T20:13:30.661997] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T20:13:31.216125] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-24T20:13:32.016077] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-24T20:13:32.338676] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T20:13:32.348851] [INFO ] [REMOTE ] NAT: Full fetch complete (72155 records). [2025-09-24T20:13:32.349018] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-24T20:13:32.835718] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-24T20:13:32.841505] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-24T20:13:32.817157] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T20:13:32.841870] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-24T20:13:32.851247] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-24T20:13:32.854024] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-24T20:13:32.861898] [DEBUG] [LOCAL ] NAT: Trimmed 72155 records to 49103 (keeping 200 days of data) [2025-09-24T20:13:32.873403] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:13:33.178262] [DEBUG] [LOCAL ] NAT: Primary data saved (49103 records). [2025-09-24T20:13:33.178462] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-24T20:13:33.178598] [INFO ] [MAIN ] Update Progress: 1457/2373 symbols completed. NAT took 51.2s. Estimated remaining: 2h 1m 39s. Rate: 7.5 symbols/min [2025-09-24T20:13:33.351625] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:33.355965] [DEBUG] [LOCAL ] NC: Loaded 1907 existing records from primary storage. [2025-09-24T20:13:33.356077] [INFO ] [MAIN ] NC: Loaded 1907 existing records. [2025-09-24T20:13:33.543704] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:33.544047] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-24T20:13:33.544108] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-24T20:13:33.544388] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-24T20:13:33.544448] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-24T20:13:33.621315] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-24T20:13:33.921136] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:34.087115] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T20:13:34.416105] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-24T20:13:35.010832] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T20:13:35.216104] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-24T20:13:35.481897] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T20:13:35.598120] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-24T20:13:36.016079] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-24T20:13:36.386401] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-24T20:13:36.816120] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-24T20:13:37.284902] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T20:13:37.616087] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-24T20:13:38.073920] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T20:13:38.416119] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-24T20:13:39.216098] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-24T20:13:39.979590] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T20:13:40.016031] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-24T20:13:40.227603] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T20:13:40.816088] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-24T20:13:41.394379] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T20:13:41.616109] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-24T20:13:42.309011] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T20:13:42.416093] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-24T20:13:42.632744] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T20:13:43.216114] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-24T20:13:43.702733] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T20:13:43.755754] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T20:13:44.016090] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-24T20:13:44.509852] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T20:13:44.816086] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-24T20:13:45.616058] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-24T20:13:45.687826] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T20:13:46.065683] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T20:13:46.416087] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-24T20:13:46.907785] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T20:13:47.216097] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-24T20:13:48.016097] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-24T20:13:48.386360] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-24T20:13:48.457185] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T20:13:48.464529] [INFO ] [REMOTE ] NBHC: Full fetch complete (31927 records). [2025-09-24T20:13:48.464763] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-24T20:13:48.821221] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-24T20:13:48.899827] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-24T20:13:48.899939] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-24T20:13:48.900961] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-24T20:13:48.901037] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-24T20:13:48.902145] [DEBUG] [LOCAL ] NBHC: Trimmed 31927 records to 23172 (keeping 200 days of data) [2025-09-24T20:13:49.048615] [DEBUG] [LOCAL ] NBHC: Primary data saved (23172 records). [2025-09-24T20:13:49.048791] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-24T20:13:49.048891] [INFO ] [MAIN ] Update Progress: 1458/2373 symbols completed. NBHC took 35.7s. Estimated remaining: 2h 1m 36s. Rate: 7.5 symbols/min [2025-09-24T20:13:49.221232] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:49.232691] [DEBUG] [LOCAL ] NCA: Loaded 10038 existing records from primary storage. [2025-09-24T20:13:49.232831] [INFO ] [MAIN ] NCA: Loaded 10038 existing records. [2025-09-24T20:13:49.415384] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:49.415710] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-24T20:13:49.415768] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-24T20:13:49.416282] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-24T20:13:49.416344] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-24T20:13:49.624558] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-24T20:13:49.785896] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:49.966777] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T20:13:50.416087] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-24T20:13:51.216115] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-24T20:13:51.281681] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:13:51.305988] [INFO ] [REMOTE ] NBR: Full fetch complete (49494 records). [2025-09-24T20:13:51.307591] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T20:13:51.306949] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-24T20:13:51.732861] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-24T20:13:51.733063] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-24T20:13:51.734269] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-24T20:13:51.739178] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-24T20:13:51.739337] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T20:13:51.741119] [INFO ] [REMOTE ] NC: Full fetch complete (2713 records). [2025-09-24T20:13:51.741443] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-24T20:13:51.833390] [DEBUG] [LOCAL ] NBR: Trimmed 49494 records to 34854 (keeping 200 days of data) [2025-09-24T20:13:52.022681] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-24T20:13:52.359666] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-24T20:13:52.360895] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-24T20:13:52.361720] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-24T20:13:52.361801] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-24T20:13:52.366452] [DEBUG] [LOCAL ] NC: Trimmed 2713 records to 1909 (keeping 200 days of data) [2025-09-24T20:13:52.389619] [DEBUG] [LOCAL ] NC: Primary data saved (1909 records). [2025-09-24T20:13:52.390326] [INFO ] [MAIN ] NC: Full history saved. [2025-09-24T20:13:52.390829] [INFO ] [MAIN ] Update Progress: 1459/2373 symbols completed. NC took 19.2s. Estimated remaining: 2h 1m 25s. Rate: 7.5 symbols/min [2025-09-24T20:13:52.582364] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:52.588972] [DEBUG] [LOCAL ] NBR: Primary data saved (34854 records). [2025-09-24T20:13:52.589144] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-24T20:13:52.589270] [INFO ] [MAIN ] Update Progress: 1460/2373 symbols completed. NBR took 35.4s. Estimated remaining: 2h 1m 12s. Rate: 7.5 symbols/min [2025-09-24T20:13:52.766334] [DEBUG] [LOCAL ] NCDL: Loaded 21570 existing records from primary storage. [2025-09-24T20:13:52.786837] [INFO ] [MAIN ] NCDL: Loaded 21570 existing records. [2025-09-24T20:13:52.786759] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:13:52.820483] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-24T20:13:52.986031] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:52.993324] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-24T20:13:52.993425] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-24T20:13:52.994450] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T20:13:52.996803] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-24T20:13:52.998026] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-24T20:13:53.290441] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-24T20:13:53.296790] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-09-24T20:13:53.583667] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:53.619756] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:13:53.619508] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-24T20:13:53.621487] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-24T20:13:53.621561] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-24T20:13:53.623687] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-24T20:13:53.623757] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-24T20:13:53.921701] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:13:54.084130] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:13:54.416136] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-24T20:13:54.449430] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T20:13:55.216121] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-24T20:13:56.016207] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-24T20:13:56.194861] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T20:13:56.345716] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T20:13:56.816091] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-24T20:13:57.373276] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T20:13:57.616085] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-24T20:13:58.416059] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-24T20:13:58.497555] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:13:58.771819] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:13:59.216096] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-24T20:13:59.496637] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T20:14:00.016109] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-24T20:14:00.816059] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-24T20:14:01.061391] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T20:14:01.181314] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:14:01.185882] [INFO ] [REMOTE ] NBXG: Full fetch complete (32966 records). [2025-09-24T20:14:01.185991] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-24T20:14:01.598092] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-24T20:14:01.598255] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-24T20:14:01.599199] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-24T20:14:01.599266] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-24T20:14:01.600532] [DEBUG] [LOCAL ] NBXG: Trimmed 32966 records to 22519 (keeping 200 days of data) [2025-09-24T20:14:01.685956] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-24T20:14:01.802872] [DEBUG] [LOCAL ] NBXG: Primary data saved (22519 records). [2025-09-24T20:14:01.803066] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-24T20:14:01.803168] [INFO ] [MAIN ] Update Progress: 1461/2373 symbols completed. NBXG took 34.0s. Estimated remaining: 2h 1m 5s. Rate: 7.5 symbols/min [2025-09-24T20:14:01.987407] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:02.004714] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T20:14:02.026521] [DEBUG] [LOCAL ] NCV: Loaded 13373 existing records from primary storage. [2025-09-24T20:14:02.026760] [INFO ] [MAIN ] NCV: Loaded 13373 existing records. [2025-09-24T20:14:02.210799] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:02.211246] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-24T20:14:02.211299] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-24T20:14:02.212481] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-24T20:14:02.212544] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-24T20:14:02.421317] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-24T20:14:02.592831] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:02.601868] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T20:14:03.216122] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-24T20:14:04.016099] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-24T20:14:04.396221] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T20:14:04.631439] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T20:14:04.660798] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T20:14:04.816118] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-24T20:14:05.616098] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-24T20:14:05.680923] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:14:06.416089] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-24T20:14:06.469215] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T20:14:07.216112] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-24T20:14:07.619580] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T20:14:08.016095] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-24T20:14:08.816135] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-24T20:14:09.056725] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T20:14:09.510833] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-24T20:14:09.616046] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-24T20:14:09.682889] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T20:14:10.416099] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-24T20:14:11.144246] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:14:11.216127] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-24T20:14:11.829220] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-24T20:14:12.016146] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-24T20:14:12.355075] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T20:14:12.816112] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-24T20:14:13.510107] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T20:14:13.616094] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-24T20:14:13.898255] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T20:14:14.351453] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T20:14:14.416197] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-24T20:14:15.216104] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-24T20:14:15.546077] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:14:16.007744] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T20:14:16.016025] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-24T20:14:16.816147] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-24T20:14:17.079119] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T20:14:17.082132] [INFO ] [REMOTE ] NCA: Full fetch complete (15628 records). [2025-09-24T20:14:17.082269] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-24T20:14:17.521565] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-24T20:14:17.521861] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-24T20:14:17.522610] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-24T20:14:17.522734] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-24T20:14:17.523618] [DEBUG] [LOCAL ] NCA: Trimmed 15628 records to 10054 (keeping 200 days of data) [2025-09-24T20:14:17.611981] [DEBUG] [LOCAL ] NCA: Primary data saved (10054 records). [2025-09-24T20:14:17.612237] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-24T20:14:17.612392] [INFO ] [MAIN ] Update Progress: 1462/2373 symbols completed. NCA took 28.6s. Estimated remaining: 2h 1m 2s. Rate: 7.5 symbols/min [2025-09-24T20:14:17.624328] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-24T20:14:17.796251] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T20:14:17.856388] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:17.872128] [DEBUG] [LOCAL ] NCZ: Loaded 11753 existing records from primary storage. [2025-09-24T20:14:17.872282] [INFO ] [MAIN ] NCZ: Loaded 11753 existing records. [2025-09-24T20:14:18.076231] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:18.076852] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-24T20:14:18.076938] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-24T20:14:18.077735] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-24T20:14:18.077834] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-24T20:14:18.423514] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-24T20:14:18.446532] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:18.767404] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T20:14:19.216104] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-24T20:14:19.364686] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-24T20:14:20.016118] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-24T20:14:20.816118] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-24T20:14:21.050422] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T20:14:21.521986] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-24T20:14:21.616067] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-24T20:14:21.724110] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T20:14:22.416150] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-24T20:14:22.448513] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T20:14:23.216099] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-24T20:14:23.358748] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T20:14:24.016084] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-24T20:14:24.130910] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T20:14:24.709783] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T20:14:24.816194] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-24T20:14:25.503759] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T20:14:25.616179] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-24T20:14:26.416080] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-24T20:14:26.529239] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T20:14:27.216089] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-24T20:14:28.016102] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-24T20:14:28.337233] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T20:14:28.342316] [INFO ] [REMOTE ] NCDL: Full fetch complete (33245 records). [2025-09-24T20:14:28.342529] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-24T20:14:28.763585] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-24T20:14:28.763741] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-24T20:14:28.764770] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-24T20:14:28.765008] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-24T20:14:28.780471] [DEBUG] [LOCAL ] NCDL: Trimmed 33245 records to 21524 (keeping 200 days of data) [2025-09-24T20:14:28.810220] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-24T20:14:28.876959] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-24T20:14:28.971542] [DEBUG] [LOCAL ] NCDL: Primary data saved (21524 records). [2025-09-24T20:14:28.971782] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-24T20:14:28.971956] [INFO ] [MAIN ] Update Progress: 1463/2373 symbols completed. NCDL took 36.6s. Estimated remaining: 2h 0m 56s. Rate: 7.5 symbols/min [2025-09-24T20:14:29.154684] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:29.178345] [DEBUG] [LOCAL ] NDMO: Loaded 16614 existing records from primary storage. [2025-09-24T20:14:29.178589] [INFO ] [MAIN ] NDMO: Loaded 16614 existing records. [2025-09-24T20:14:29.390925] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T20:14:29.391139] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:29.396146] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-24T20:14:29.396526] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-24T20:14:29.398036] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-24T20:14:29.397930] [INFO ] [REMOTE ] NCV: Full fetch complete (23054 records). [2025-09-24T20:14:29.398372] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-24T20:14:29.398270] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-24T20:14:29.621255] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-24T20:14:30.328026] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T20:14:30.327164] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:30.342522] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-24T20:14:30.342996] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-24T20:14:30.344196] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-24T20:14:30.344279] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-24T20:14:30.345696] [DEBUG] [LOCAL ] NCV: Trimmed 23054 records to 13371 (keeping 200 days of data) [2025-09-24T20:14:30.421303] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-24T20:14:30.449455] [DEBUG] [LOCAL ] NCV: Primary data saved (13371 records). [2025-09-24T20:14:30.449638] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-24T20:14:30.449803] [INFO ] [MAIN ] Update Progress: 1464/2373 symbols completed. NCV took 28.6s. Estimated remaining: 2h 0m 44s. Rate: 7.5 symbols/min [2025-09-24T20:14:30.636960] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:30.701740] [DEBUG] [LOCAL ] NE: Loaded 52390 existing records from primary storage. [2025-09-24T20:14:30.701920] [INFO ] [MAIN ] NE: Loaded 52390 existing records. [2025-09-24T20:14:30.899591] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:30.899891] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-24T20:14:30.899980] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-24T20:14:30.901451] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-24T20:14:30.901522] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-24T20:14:31.222274] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-24T20:14:31.267728] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:31.706421] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:14:31.951900] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-24T20:14:31.963411] [INFO ] [REMOTE ] NCLH: Full fetch complete (77809 records). [2025-09-24T20:14:31.963605] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-24T20:14:32.021290] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-24T20:14:32.331552] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T20:14:32.439434] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-24T20:14:32.439543] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-24T20:14:32.441453] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-24T20:14:32.441582] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-24T20:14:32.443614] [DEBUG] [LOCAL ] NCLH: Trimmed 77809 records to 53753 (keeping 200 days of data) [2025-09-24T20:14:32.816153] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-24T20:14:32.828016] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-24T20:14:32.828207] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-24T20:14:32.828380] [INFO ] [MAIN ] Update Progress: 1465/2373 symbols completed. NCLH took 40.2s. Estimated remaining: 2h 0m 32s. Rate: 7.5 symbols/min [2025-09-24T20:14:33.024286] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:33.068120] [DEBUG] [LOCAL ] NEA: Loaded 35279 existing records from primary storage. [2025-09-24T20:14:33.068305] [INFO ] [MAIN ] NEA: Loaded 35279 existing records. [2025-09-24T20:14:33.278676] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:33.279262] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-24T20:14:33.279324] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-24T20:14:33.280439] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-24T20:14:33.280504] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-24T20:14:33.621316] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-24T20:14:33.687730] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:33.728110] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T20:14:33.837466] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T20:14:34.416054] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-24T20:14:34.557819] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T20:14:35.216086] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-24T20:14:35.348560] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T20:14:36.016084] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-24T20:14:36.687698] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T20:14:36.816065] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-24T20:14:37.035705] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T20:14:37.617525] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-24T20:14:37.620639] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T20:14:37.624156] [INFO ] [REMOTE ] NCZ: Full fetch complete (21550 records). [2025-09-24T20:14:37.624244] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-24T20:14:38.006742] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-24T20:14:38.006847] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-24T20:14:38.007697] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-24T20:14:38.007774] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-24T20:14:38.008461] [DEBUG] [LOCAL ] NCZ: Trimmed 21550 records to 11770 (keeping 200 days of data) [2025-09-24T20:14:38.084778] [DEBUG] [LOCAL ] NCZ: Primary data saved (11770 records). [2025-09-24T20:14:38.084923] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-24T20:14:38.085052] [INFO ] [MAIN ] Update Progress: 1466/2373 symbols completed. NCZ took 20.5s. Estimated remaining: 2h 0m 23s. Rate: 7.5 symbols/min [2025-09-24T20:14:38.271581] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:38.281989] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-24T20:14:38.363186] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-24T20:14:38.364011] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-09-24T20:14:38.421513] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-24T20:14:38.570414] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:38.570781] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-24T20:14:38.570841] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-24T20:14:38.572834] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-24T20:14:38.572950] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-24T20:14:38.952537] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:14:39.216108] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-24T20:14:39.848466] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T20:14:40.016191] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-24T20:14:40.816100] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-24T20:14:40.903228] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T20:14:40.925872] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T20:14:41.616097] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-24T20:14:42.416096] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-24T20:14:42.926705] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-24T20:14:43.094741] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T20:14:43.216043] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-24T20:14:44.016055] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-24T20:14:44.160784] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T20:14:44.569159] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T20:14:44.816090] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-24T20:14:45.616123] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-24T20:14:45.659427] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T20:14:46.170009] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:14:46.416100] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-24T20:14:47.216112] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-24T20:14:47.724216] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T20:14:47.795483] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T20:14:48.016058] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-24T20:14:48.250352] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T20:14:48.816088] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-24T20:14:49.101031] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T20:14:49.410520] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-24T20:14:49.616088] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-24T20:14:50.416094] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-24T20:14:50.724799] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T20:14:51.216140] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-24T20:14:52.016072] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-24T20:14:52.207426] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T20:14:52.816128] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-24T20:14:53.107597] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T20:14:53.447186] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:14:53.616097] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-24T20:14:54.416051] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-24T20:14:54.604049] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:14:55.090859] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T20:14:55.222676] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-24T20:14:55.227984] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:14:56.016138] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-24T20:14:56.816197] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-24T20:14:56.921259] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T20:14:57.160078] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T20:14:57.616145] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-24T20:14:58.416248] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-24T20:14:58.720277] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T20:14:58.757664] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T20:14:58.764956] [INFO ] [REMOTE ] NEA: Full fetch complete (52268 records). [2025-09-24T20:14:58.765115] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-24T20:14:59.206826] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-24T20:14:59.207121] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-24T20:14:59.209293] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-24T20:14:59.209632] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-24T20:14:59.211933] [DEBUG] [LOCAL ] NEA: Trimmed 52268 records to 35277 (keeping 200 days of data) [2025-09-24T20:14:59.280309] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-24T20:14:59.474443] [DEBUG] [LOCAL ] NEA: Primary data saved (35277 records). [2025-09-24T20:14:59.474716] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-24T20:14:59.474858] [INFO ] [MAIN ] Update Progress: 1467/2373 symbols completed. NEA took 26.6s. Estimated remaining: 2h 0m 23s. Rate: 7.5 symbols/min [2025-09-24T20:14:59.630027] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T20:14:59.700979] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:14:59.773040] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-24T20:14:59.773260] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-09-24T20:14:59.978560] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:14:59.979070] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-24T20:14:59.979132] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-24T20:14:59.981011] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-24T20:14:59.981090] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-24T20:15:00.021269] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-24T20:15:00.481207] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:00.816148] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-24T20:15:01.235165] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T20:15:01.239454] [INFO ] [REMOTE ] NDMO: Full fetch complete (25048 records). [2025-09-24T20:15:01.239574] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-24T20:15:01.620564] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-24T20:15:01.688011] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-24T20:15:01.688314] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-24T20:15:01.689119] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-24T20:15:01.689203] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-24T20:15:01.690459] [DEBUG] [LOCAL ] NDMO: Trimmed 25048 records to 16693 (keeping 200 days of data) [2025-09-24T20:15:01.809233] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-24T20:15:01.848119] [DEBUG] [LOCAL ] NDMO: Primary data saved (16693 records). [2025-09-24T20:15:01.848270] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-24T20:15:01.848377] [INFO ] [MAIN ] Update Progress: 1468/2373 symbols completed. NDMO took 32.9s. Estimated remaining: 2h 0m 12s. Rate: 7.5 symbols/min [2025-09-24T20:15:02.029682] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:02.096854] [DEBUG] [LOCAL ] NET: Loaded 53063 existing records from primary storage. [2025-09-24T20:15:02.097043] [INFO ] [MAIN ] NET: Loaded 53063 existing records. [2025-09-24T20:15:02.338620] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:02.338976] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-24T20:15:02.339046] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-24T20:15:02.340826] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-24T20:15:02.340923] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-24T20:15:02.422307] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-24T20:15:02.777066] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:03.216067] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-24T20:15:03.527068] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-24T20:15:04.016148] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-24T20:15:05.684223] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (4.06 seconds). [2025-09-24T20:15:05.696411] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-24T20:15:05.753834] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:15:05.763896] [INFO ] [REMOTE ] NE: Full fetch complete (75393 records). [2025-09-24T20:15:05.764043] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-24T20:15:06.207027] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-24T20:15:06.207346] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-24T20:15:06.220737] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-24T20:15:06.220960] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-24T20:15:06.250624] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (3.83 seconds). [2025-09-24T20:15:06.262009] [DEBUG] [LOCAL ] NE: Trimmed 75393 records to 52384 (keeping 200 days of data) [2025-09-24T20:15:06.264454] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-24T20:15:06.407051] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-24T20:15:06.421464] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-24T20:15:06.669446] [DEBUG] [LOCAL ] NE: Primary data saved (52384 records). [2025-09-24T20:15:06.669598] [INFO ] [MAIN ] NE: Full history saved. [2025-09-24T20:15:06.669722] [INFO ] [MAIN ] Update Progress: 1469/2373 symbols completed. NE took 36.2s. Estimated remaining: 2h 0m 2s. Rate: 7.5 symbols/min [2025-09-24T20:15:06.844893] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:06.854767] [DEBUG] [LOCAL ] NEU: Loaded 8116 existing records from primary storage. [2025-09-24T20:15:06.854890] [INFO ] [MAIN ] NEU: Loaded 8116 existing records. [2025-09-24T20:15:07.039922] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:07.040259] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-24T20:15:07.040318] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-24T20:15:07.040747] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-24T20:15:07.040811] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-24T20:15:07.632260] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:07.632919] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-24T20:15:08.012289] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-24T20:15:08.030202] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-24T20:15:08.320360] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T20:15:08.467276] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-24T20:15:08.511352] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-24T20:15:08.816151] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-24T20:15:09.345233] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-24T20:15:09.616125] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-24T20:15:10.257468] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T20:15:10.257093] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-24T20:15:10.416117] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-24T20:15:11.216190] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-24T20:15:12.016175] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-24T20:15:12.671805] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T20:15:12.702320] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-24T20:15:12.816077] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-24T20:15:13.616098] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-24T20:15:14.416086] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-24T20:15:14.688129] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (3.47 seconds). [2025-09-24T20:15:15.113736] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T20:15:15.216083] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-24T20:15:15.875474] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T20:15:16.016080] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-24T20:15:16.519358] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (3.70 seconds). [2025-09-24T20:15:16.521972] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-24T20:15:16.816092] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-24T20:15:17.616098] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-24T20:15:18.421193] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-24T20:15:18.444272] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-24T20:15:18.999339] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-24T20:15:19.216144] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-24T20:15:19.420367] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T20:15:19.755759] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T20:15:20.016106] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-24T20:15:20.820504] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-24T20:15:20.822196] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T20:15:21.445481] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-24T20:15:21.616096] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-24T20:15:22.416135] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-24T20:15:22.975545] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T20:15:22.986097] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-24T20:15:22.986348] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-24T20:15:23.217082] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-24T20:15:23.550737] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-24T20:15:23.550949] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-24T20:15:23.554067] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-24T20:15:23.554335] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-24T20:15:23.557206] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 53707 (keeping 200 days of data) [2025-09-24T20:15:23.599608] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-24T20:15:24.018357] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-24T20:15:24.055806] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T20:15:24.064249] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-24T20:15:24.064423] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-24T20:15:24.064522] [INFO ] [MAIN ] Update Progress: 1470/2373 symbols completed. NEE took 46.0s. Estimated remaining: 1h 59m 60s. Rate: 7.5 symbols/min [2025-09-24T20:15:24.245311] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:24.249749] [DEBUG] [LOCAL ] NEUE: Loaded 2248 existing records from primary storage. [2025-09-24T20:15:24.249868] [INFO ] [MAIN ] NEUE: Loaded 2248 existing records. [2025-09-24T20:15:24.449830] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:24.450525] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-24T20:15:24.450585] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-24T20:15:24.451003] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-24T20:15:24.451256] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-24T20:15:24.819238] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-24T20:15:24.939703] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:24.977514] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-24T20:15:25.616062] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-24T20:15:25.678512] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T20:15:25.682103] [INFO ] [REMOTE ] NEU: Full fetch complete (10232 records). [2025-09-24T20:15:25.682225] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-24T20:15:26.157445] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-24T20:15:26.157659] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-24T20:15:26.158049] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-24T20:15:26.158196] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-24T20:15:26.159102] [DEBUG] [LOCAL ] NEU: Trimmed 10232 records to 8119 (keeping 200 days of data) [2025-09-24T20:15:26.216148] [DEBUG] [LOCAL ] NEU: Primary data saved (8119 records). [2025-09-24T20:15:26.216592] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-24T20:15:26.216756] [INFO ] [MAIN ] Update Progress: 1471/2373 symbols completed. NEU took 19.5s. Estimated remaining: 1h 59m 48s. Rate: 7.5 symbols/min [2025-09-24T20:15:26.411870] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T20:15:26.417226] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-24T20:15:26.488500] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:26.497177] [DEBUG] [LOCAL ] NEXA: Loaded 4075 existing records from primary storage. [2025-09-24T20:15:26.497316] [INFO ] [MAIN ] NEXA: Loaded 4075 existing records. [2025-09-24T20:15:26.712185] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:26.712453] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-24T20:15:26.712507] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-24T20:15:26.712821] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-24T20:15:26.712885] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-24T20:15:27.143264] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:27.151691] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T20:15:27.216107] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-24T20:15:27.406931] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:15:28.016106] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-24T20:15:28.816096] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-24T20:15:29.415090] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T20:15:29.458824] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T20:15:29.616067] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-24T20:15:30.050143] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T20:15:30.338521] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T20:15:30.416089] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-24T20:15:31.012285] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T20:15:31.216078] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-24T20:15:31.665947] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T20:15:32.016360] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-24T20:15:32.816137] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-24T20:15:33.234501] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-24T20:15:33.616093] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-24T20:15:34.367368] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-24T20:15:34.379377] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-24T20:15:34.379582] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-24T20:15:34.421384] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-24T20:15:34.893589] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-24T20:15:34.893728] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-24T20:15:34.895226] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-24T20:15:34.895301] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-24T20:15:34.897438] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 53708 (keeping 200 days of data) [2025-09-24T20:15:35.217528] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-24T20:15:35.273153] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T20:15:35.290467] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-24T20:15:35.290673] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-24T20:15:35.290816] [INFO ] [MAIN ] Update Progress: 1472/2373 symbols completed. NEM took 35.8s. Estimated remaining: 1h 59m 41s. Rate: 7.5 symbols/min [2025-09-24T20:15:35.467352] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:35.508615] [DEBUG] [LOCAL ] NFG: Loaded 38470 existing records from primary storage. [2025-09-24T20:15:35.508806] [INFO ] [MAIN ] NFG: Loaded 38470 existing records. [2025-09-24T20:15:35.696803] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:35.697475] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-24T20:15:35.697636] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-24T20:15:35.698868] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-24T20:15:35.698937] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-24T20:15:35.732799] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T20:15:35.866432] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T20:15:36.021441] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-24T20:15:36.161482] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:36.816127] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-24T20:15:37.601551] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:15:37.616024] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-24T20:15:38.197919] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T20:15:38.260492] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-24T20:15:38.271693] [INFO ] [REMOTE ] NET: Full fetch complete (76877 records). [2025-09-24T20:15:38.271991] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-24T20:15:38.421399] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-24T20:15:38.712547] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-24T20:15:38.712679] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-24T20:15:38.713903] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-24T20:15:38.713974] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-24T20:15:38.715679] [DEBUG] [LOCAL ] NET: Trimmed 76877 records to 53059 (keeping 200 days of data) [2025-09-24T20:15:38.980865] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T20:15:39.076369] [DEBUG] [LOCAL ] NET: Primary data saved (53059 records). [2025-09-24T20:15:39.076544] [INFO ] [MAIN ] NET: Full history saved. [2025-09-24T20:15:39.076720] [INFO ] [MAIN ] Update Progress: 1473/2373 symbols completed. NET took 37.2s. Estimated remaining: 1h 59m 30s. Rate: 7.5 symbols/min [2025-09-24T20:15:39.223785] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-24T20:15:39.253588] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:39.276270] [DEBUG] [LOCAL ] NFJ: Loaded 20291 existing records from primary storage. [2025-09-24T20:15:39.276427] [INFO ] [MAIN ] NFJ: Loaded 20291 existing records. [2025-09-24T20:15:39.452765] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:39.453053] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-24T20:15:39.453140] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-24T20:15:39.453874] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-24T20:15:39.453936] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-24T20:15:39.823231] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:40.016087] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-24T20:15:40.653684] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T20:15:40.816044] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-24T20:15:41.167370] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T20:15:41.213023] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T20:15:41.616096] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-24T20:15:42.041825] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T20:15:42.416090] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-24T20:15:42.878134] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T20:15:42.879136] [INFO ] [REMOTE ] NEUE: Full fetch complete (4032 records). [2025-09-24T20:15:42.879211] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-24T20:15:43.221309] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-24T20:15:43.324870] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-24T20:15:43.324959] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-24T20:15:43.325147] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-24T20:15:43.325188] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-24T20:15:43.325585] [DEBUG] [LOCAL ] NEUE: Trimmed 4032 records to 2237 (keeping 200 days of data) [2025-09-24T20:15:43.341186] [DEBUG] [LOCAL ] NEUE: Primary data saved (2237 records). [2025-09-24T20:15:43.341333] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-24T20:15:43.341438] [INFO ] [MAIN ] Update Progress: 1474/2373 symbols completed. NEUE took 19.3s. Estimated remaining: 1h 59m 20s. Rate: 7.5 symbols/min [2025-09-24T20:15:43.511767] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:43.567840] [DEBUG] [LOCAL ] NGG: Loaded 46138 existing records from primary storage. [2025-09-24T20:15:43.568018] [INFO ] [MAIN ] NGG: Loaded 46138 existing records. [2025-09-24T20:15:43.761707] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:43.762266] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-24T20:15:43.762330] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-24T20:15:43.764066] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-24T20:15:43.764177] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-24T20:15:43.868346] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T20:15:44.021249] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-24T20:15:44.176556] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:44.816080] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-24T20:15:45.188756] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T20:15:45.446146] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T20:15:45.616137] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-24T20:15:46.203743] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T20:15:46.416138] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-24T20:15:46.954398] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T20:15:47.216123] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-24T20:15:48.016106] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-24T20:15:48.168319] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T20:15:48.464273] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T20:15:48.816115] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-24T20:15:49.616136] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-24T20:15:50.376460] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:15:50.416188] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-24T20:15:50.852240] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T20:15:51.216139] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-24T20:15:51.583806] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T20:15:52.016111] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-24T20:15:52.728615] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T20:15:52.816205] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-24T20:15:53.120845] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T20:15:53.616107] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-24T20:15:54.330229] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T20:15:54.416096] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-24T20:15:54.725782] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T20:15:55.216124] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-24T20:15:56.016176] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-24T20:15:56.103338] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T20:15:56.291314] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T20:15:56.816227] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-24T20:15:57.616091] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-24T20:15:57.631593] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T20:15:57.633634] [INFO ] [REMOTE ] NEXA: Full fetch complete (7524 records). [2025-09-24T20:15:57.633804] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-24T20:15:58.042693] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T20:15:58.060514] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-24T20:15:58.060742] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-24T20:15:58.061008] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-24T20:15:58.061108] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-24T20:15:58.061953] [DEBUG] [LOCAL ] NEXA: Trimmed 7524 records to 4133 (keeping 200 days of data) [2025-09-24T20:15:58.091861] [DEBUG] [LOCAL ] NEXA: Primary data saved (4133 records). [2025-09-24T20:15:58.092042] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-24T20:15:58.092222] [INFO ] [MAIN ] Update Progress: 1475/2373 symbols completed. NEXA took 31.9s. Estimated remaining: 1h 59m 16s. Rate: 7.5 symbols/min [2025-09-24T20:15:58.294080] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:15:58.344383] [DEBUG] [LOCAL ] NGL: Loaded 30539 existing records from primary storage. [2025-09-24T20:15:58.344700] [INFO ] [MAIN ] NGL: Loaded 30539 existing records. [2025-09-24T20:15:58.428559] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-24T20:15:58.585681] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:15:58.586384] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-24T20:15:58.586544] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-24T20:15:58.587463] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-24T20:15:58.587555] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-24T20:15:58.821636] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T20:15:59.028151] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:15:59.216141] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-24T20:16:00.016255] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-24T20:16:00.157254] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T20:16:00.706072] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T20:16:00.815695] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T20:16:00.821756] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-24T20:16:01.616112] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-24T20:16:01.956311] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T20:16:02.416320] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-24T20:16:03.136413] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T20:16:03.216111] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-24T20:16:04.016140] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-24T20:16:04.145047] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T20:16:04.495520] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T20:16:04.816112] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-24T20:16:05.082564] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T20:16:05.086687] [INFO ] [REMOTE ] NFJ: Full fetch complete (30401 records). [2025-09-24T20:16:05.086810] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-24T20:16:05.581224] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-24T20:16:05.581362] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-24T20:16:05.583347] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-24T20:16:05.583453] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-24T20:16:05.585434] [DEBUG] [LOCAL ] NFJ: Trimmed 30401 records to 20212 (keeping 200 days of data) [2025-09-24T20:16:05.665273] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-24T20:16:05.751432] [DEBUG] [LOCAL ] NFJ: Primary data saved (20212 records). [2025-09-24T20:16:05.751579] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-24T20:16:05.751714] [INFO ] [MAIN ] Update Progress: 1476/2373 symbols completed. NFJ took 26.7s. Estimated remaining: 1h 59m 8s. Rate: 7.5 symbols/min [2025-09-24T20:16:05.942748] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:05.960407] [DEBUG] [LOCAL ] NGS: Loaded 11521 existing records from primary storage. [2025-09-24T20:16:05.960549] [INFO ] [MAIN ] NGS: Loaded 11521 existing records. [2025-09-24T20:16:06.148889] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:06.149192] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-24T20:16:06.149244] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-24T20:16:06.149763] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-24T20:16:06.149844] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-24T20:16:06.422498] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-24T20:16:06.564809] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:06.606027] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T20:16:07.216077] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-24T20:16:07.742363] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T20:16:07.743589] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T20:16:08.016103] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-24T20:16:08.816079] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-24T20:16:08.974292] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T20:16:09.616116] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-24T20:16:09.817778] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T20:16:09.908254] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T20:16:10.416120] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-24T20:16:10.892271] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:16:10.900163] [INFO ] [REMOTE ] NFG: Full fetch complete (56667 records). [2025-09-24T20:16:10.900331] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-24T20:16:11.221518] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-24T20:16:11.334358] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-24T20:16:11.334457] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-24T20:16:11.335527] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-24T20:16:11.335659] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-24T20:16:11.337160] [DEBUG] [LOCAL ] NFG: Trimmed 56667 records to 38534 (keeping 200 days of data) [2025-09-24T20:16:11.609116] [DEBUG] [LOCAL ] NFG: Primary data saved (38534 records). [2025-09-24T20:16:11.609281] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-24T20:16:11.609433] [INFO ] [MAIN ] Update Progress: 1477/2373 symbols completed. NFG took 36.3s. Estimated remaining: 1h 58m 59s. Rate: 7.5 symbols/min [2025-09-24T20:16:12.016151] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-24T20:16:12.649089] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:16:12.816134] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-24T20:16:13.103552] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T20:16:13.149507] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-24T20:16:13.616139] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-24T20:16:13.880582] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T20:16:14.421310] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-24T20:16:15.216407] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-24T20:16:15.461435] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T20:16:15.490045] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T20:16:16.016093] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-24T20:16:16.383520] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T20:16:16.747041] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:16:16.816090] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-24T20:16:17.616116] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-24T20:16:18.288321] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T20:16:18.416142] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-24T20:16:18.780669] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T20:16:19.216132] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-24T20:16:20.016123] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-24T20:16:20.163910] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T20:16:20.672836] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T20:16:20.722514] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T20:16:20.816098] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-24T20:16:21.616108] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-24T20:16:22.218687] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T20:16:22.416096] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-24T20:16:22.899921] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:16:22.914720] [INFO ] [REMOTE ] NGG: Full fetch complete (66350 records). [2025-09-24T20:16:22.914965] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-24T20:16:23.221240] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-24T20:16:23.326571] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-24T20:16:23.326687] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-24T20:16:23.327946] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-24T20:16:23.328013] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-24T20:16:23.329423] [DEBUG] [LOCAL ] NGG: Trimmed 66350 records to 46191 (keeping 200 days of data) [2025-09-24T20:16:23.577939] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T20:16:23.662481] [DEBUG] [LOCAL ] NGG: Primary data saved (46191 records). [2025-09-24T20:16:23.662896] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-24T20:16:23.662996] [INFO ] [MAIN ] Update Progress: 1478/2373 symbols completed. NGG took 40.3s. Estimated remaining: 1h 58m 53s. Rate: 7.5 symbols/min [2025-09-24T20:16:24.016101] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-24T20:16:24.590602] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T20:16:24.598976] [INFO ] [REMOTE ] NGL: Full fetch complete (40978 records). [2025-09-24T20:16:24.599163] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-24T20:16:24.975985] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T20:16:25.015126] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-24T20:16:25.015272] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-24T20:16:25.016488] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-24T20:16:25.016592] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-24T20:16:25.017212] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-24T20:16:25.019911] [DEBUG] [LOCAL ] NGL: Trimmed 40978 records to 30421 (keeping 200 days of data) [2025-09-24T20:16:25.210482] [DEBUG] [LOCAL ] NGL: Primary data saved (30421 records). [2025-09-24T20:16:25.210670] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-24T20:16:25.210802] [INFO ] [MAIN ] Update Progress: 1479/2373 symbols completed. NGL took 27.1s. Estimated remaining: 1h 58m 41s. Rate: 7.5 symbols/min [2025-09-24T20:16:25.981768] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T20:16:25.985050] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-24T20:16:26.818988] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:16:26.822726] [INFO ] [REMOTE ] NGS: Full fetch complete (17223 records). [2025-09-24T20:16:26.822876] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-24T20:16:27.219814] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-24T20:16:27.219895] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-24T20:16:27.220375] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-24T20:16:27.220422] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-24T20:16:27.221022] [DEBUG] [LOCAL ] NGS: Trimmed 17223 records to 11534 (keeping 200 days of data) [2025-09-24T20:16:27.306898] [DEBUG] [LOCAL ] NGS: Primary data saved (11534 records). [2025-09-24T20:16:27.307045] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-24T20:16:27.307140] [INFO ] [MAIN ] Update Progress: 1480/2373 symbols completed. NGS took 21.6s. Estimated remaining: 1h 58m 30s. Rate: 7.5 symbols/min [2025-09-24T20:16:27.822086] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:27.914162] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:27.935108] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-24T20:16:28.012539] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-24T20:16:28.035303] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:28.063143] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:28.036527] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-24T20:16:28.064007] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-24T20:16:28.064109] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-24T20:16:28.064497] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-24T20:16:28.118418] [DEBUG] [LOCAL ] NGVC: Loaded 22329 existing records from primary storage. [2025-09-24T20:16:28.132520] [INFO ] [MAIN ] NGVC: Loaded 22329 existing records. [2025-09-24T20:16:28.363388] [DEBUG] [LOCAL ] NHI: Loaded 22081 existing records from primary storage. [2025-09-24T20:16:28.396481] [INFO ] [MAIN ] NHI: Loaded 22081 existing records. [2025-09-24T20:16:28.423328] [DEBUG] [LOCAL ] NGVT: Loaded 24417 existing records from primary storage. [2025-09-24T20:16:28.494594] [INFO ] [MAIN ] NGVT: Loaded 24417 existing records. [2025-09-24T20:16:28.661466] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:28.723982] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-24T20:16:28.780982] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-24T20:16:28.827983] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-24T20:16:28.880170] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-24T20:16:29.037738] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:29.113774] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:29.138524] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-24T20:16:29.137920] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-24T20:16:29.148949] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-24T20:16:29.178631] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:29.188809] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-24T20:16:29.204620] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-24T20:16:29.224806] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-24T20:16:29.259725] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-24T20:16:29.427188] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-24T20:16:29.437809] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-24T20:16:29.845330] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:29.890039] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-24T20:16:30.302444] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:30.328299] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-24T20:16:30.372030] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:30.372513] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-24T20:16:31.109043] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T20:16:31.120974] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-24T20:16:31.184979] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:16:31.189186] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-24T20:16:31.573306] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T20:16:31.579716] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-24T20:16:31.658713] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T20:16:31.923483] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T20:16:32.016110] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-24T20:16:32.763095] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T20:16:32.802097] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:16:32.816032] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-24T20:16:33.138294] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T20:16:33.616090] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-24T20:16:34.416095] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-24T20:16:34.572923] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T20:16:34.623460] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T20:16:35.216093] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-24T20:16:35.674373] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T20:16:36.016100] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-24T20:16:36.565233] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:16:36.816127] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-24T20:16:37.616059] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-24T20:16:38.123489] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T20:16:38.188364] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-24T20:16:38.416094] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-24T20:16:38.973768] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T20:16:39.216214] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-24T20:16:39.571451] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T20:16:40.016114] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-24T20:16:40.816145] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-24T20:16:41.035331] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:16:41.168423] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T20:16:41.616108] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-24T20:16:41.762355] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T20:16:42.416098] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-24T20:16:42.702697] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T20:16:43.216103] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-24T20:16:43.632455] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T20:16:44.016099] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-24T20:16:44.822087] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-24T20:16:44.828587] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T20:16:45.319738] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T20:16:45.616216] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-24T20:16:45.917711] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:16:46.416131] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-24T20:16:46.542915] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T20:16:47.216081] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-24T20:16:47.648792] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T20:16:48.016109] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-24T20:16:48.403278] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T20:16:48.816089] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-24T20:16:49.070994] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T20:16:49.616130] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-24T20:16:50.324242] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T20:16:50.416049] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-24T20:16:51.006892] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T20:16:51.216150] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-24T20:16:52.016092] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-24T20:16:52.438697] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T20:16:52.443799] [INFO ] [REMOTE ] NGVT: Full fetch complete (34566 records). [2025-09-24T20:16:52.443924] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-24T20:16:52.657141] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-24T20:16:52.822785] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-24T20:16:52.994546] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-24T20:16:52.994884] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-24T20:16:52.996338] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-24T20:16:52.996440] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-24T20:16:52.998075] [DEBUG] [LOCAL ] NGVT: Trimmed 34566 records to 24353 (keeping 200 days of data) [2025-09-24T20:16:53.200589] [DEBUG] [LOCAL ] NGVT: Primary data saved (24353 records). [2025-09-24T20:16:53.200885] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-24T20:16:53.201082] [INFO ] [MAIN ] Update Progress: 1481/2373 symbols completed. NGVT took 25.9s. Estimated remaining: 1h 58m 33s. Rate: 7.5 symbols/min [2025-09-24T20:16:53.438629] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T20:16:53.501186] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:53.522530] [DEBUG] [LOCAL ] NIC: Loaded 8869 existing records from primary storage. [2025-09-24T20:16:53.522809] [INFO ] [MAIN ] NIC: Loaded 8869 existing records. [2025-09-24T20:16:53.632342] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-24T20:16:53.860178] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T20:16:53.874880] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:53.875333] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-24T20:16:53.875412] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-24T20:16:53.878409] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-24T20:16:53.878696] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-24T20:16:54.420773] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-24T20:16:54.420674] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:54.750483] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T20:16:54.755771] [INFO ] [REMOTE ] NGVC: Full fetch complete (30296 records). [2025-09-24T20:16:54.755959] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-24T20:16:55.180256] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-24T20:16:55.180407] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-24T20:16:55.181443] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-24T20:16:55.181511] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-24T20:16:55.182505] [DEBUG] [LOCAL ] NGVC: Trimmed 30296 records to 22321 (keeping 200 days of data) [2025-09-24T20:16:55.243515] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-24T20:16:55.351290] [DEBUG] [LOCAL ] NGVC: Primary data saved (22321 records). [2025-09-24T20:16:55.351501] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-24T20:16:55.351618] [INFO ] [MAIN ] Update Progress: 1482/2373 symbols completed. NGVC took 28.0s. Estimated remaining: 1h 58m 21s. Rate: 7.5 symbols/min [2025-09-24T20:16:55.564701] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:16:55.585513] [DEBUG] [LOCAL ] NIE: Loaded 11612 existing records from primary storage. [2025-09-24T20:16:55.585867] [INFO ] [MAIN ] NIE: Loaded 11612 existing records. [2025-09-24T20:16:55.789404] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T20:16:55.840702] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:16:55.842220] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-24T20:16:55.842322] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-24T20:16:55.843101] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-24T20:16:55.843168] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-24T20:16:56.020267] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-24T20:16:56.273871] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:16:56.816178] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-24T20:16:56.976971] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T20:16:57.252445] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T20:16:57.350694] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T20:16:57.616090] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-24T20:16:58.416114] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-24T20:16:58.463542] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T20:16:59.216095] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-24T20:16:59.727569] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T20:16:59.731856] [INFO ] [REMOTE ] NHI: Full fetch complete (31578 records). [2025-09-24T20:16:59.731948] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-24T20:17:00.021408] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-24T20:17:00.155894] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-24T20:17:00.156037] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-24T20:17:00.157590] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-24T20:17:00.157714] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-24T20:17:00.159064] [DEBUG] [LOCAL ] NHI: Trimmed 31578 records to 21990 (keeping 200 days of data) [2025-09-24T20:17:00.271741] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T20:17:00.338884] [DEBUG] [LOCAL ] NHI: Primary data saved (21990 records). [2025-09-24T20:17:00.339082] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-24T20:17:00.339195] [INFO ] [MAIN ] Update Progress: 1483/2373 symbols completed. NHI took 33.0s. Estimated remaining: 1h 58m 12s. Rate: 7.5 symbols/min [2025-09-24T20:17:00.573130] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:00.582422] [DEBUG] [LOCAL ] NIM: Loaded 4101 existing records from primary storage. [2025-09-24T20:17:00.582719] [INFO ] [MAIN ] NIM: Loaded 4101 existing records. [2025-09-24T20:17:00.821097] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-24T20:17:00.826244] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:17:00.827946] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-24T20:17:00.828068] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-24T20:17:00.828479] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-24T20:17:00.828551] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-24T20:17:01.308465] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:01.313033] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T20:17:01.323927] [INFO ] [REMOTE ] NI: Full fetch complete (76874 records). [2025-09-24T20:17:01.324207] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-24T20:17:01.325546] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:17:01.325679] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:17:01.325736] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:17:01.325784] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-24T20:17:01.325855] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-24T20:17:01.325895] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-24T20:17:01.326004] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-24T20:17:01.326103] [INFO ] [MAIN ] Update Progress: 1484/2373 symbols completed. NI took 34.0s. Estimated remaining: 1h 57m 59s. Rate: 7.5 symbols/min [2025-09-24T20:17:01.557181] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:01.591918] [DEBUG] [LOCAL ] NINE: Loaded 28506 existing records from primary storage. [2025-09-24T20:17:01.592117] [INFO ] [MAIN ] NINE: Loaded 28506 existing records. [2025-09-24T20:17:01.623613] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-24T20:17:01.679588] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:17:01.817048] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:17:01.817397] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-24T20:17:01.817453] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-24T20:17:01.818487] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-24T20:17:01.818550] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-24T20:17:02.260673] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:02.416121] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-24T20:17:02.509851] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T20:17:03.216105] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-24T20:17:03.687276] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T20:17:04.016130] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-24T20:17:04.168040] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T20:17:04.684980] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T20:17:04.816093] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-24T20:17:05.616143] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-24T20:17:05.678431] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:17:06.341943] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T20:17:06.416090] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-24T20:17:07.214482] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T20:17:07.216883] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-24T20:17:08.016101] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-24T20:17:08.639133] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T20:17:08.816106] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-24T20:17:08.920360] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T20:17:09.494787] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T20:17:09.616130] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-24T20:17:10.289829] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T20:17:10.416100] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-24T20:17:11.063477] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T20:17:11.216090] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-24T20:17:12.016112] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-24T20:17:12.196279] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T20:17:12.684999] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-24T20:17:12.816088] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-24T20:17:13.616084] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-24T20:17:13.672038] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T20:17:14.416099] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-24T20:17:14.438270] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T20:17:15.216218] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-24T20:17:15.793424] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T20:17:16.016126] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-24T20:17:16.076891] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:17:16.816139] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-24T20:17:17.491101] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T20:17:17.616197] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-24T20:17:17.675504] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T20:17:18.154728] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T20:17:18.416186] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-24T20:17:19.216148] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-24T20:17:19.614139] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T20:17:20.016209] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-24T20:17:20.119808] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T20:17:20.441907] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T20:17:20.443294] [INFO ] [REMOTE ] NIM: Full fetch complete (6819 records). [2025-09-24T20:17:20.443378] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-24T20:17:20.821304] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-24T20:17:20.888149] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-24T20:17:20.888299] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-24T20:17:20.888610] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-24T20:17:20.888733] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-24T20:17:20.889316] [DEBUG] [LOCAL ] NIM: Trimmed 6819 records to 4103 (keeping 200 days of data) [2025-09-24T20:17:20.917766] [DEBUG] [LOCAL ] NIM: Primary data saved (4103 records). [2025-09-24T20:17:20.917948] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-24T20:17:20.918063] [INFO ] [MAIN ] Update Progress: 1485/2373 symbols completed. NIM took 20.6s. Estimated remaining: 1h 57m 58s. Rate: 7.5 symbols/min [2025-09-24T20:17:21.111791] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:21.112001] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-09-24T20:17:21.112040] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-09-24T20:17:21.112200] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-24T20:17:21.112249] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-24T20:17:21.112342] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-09-24T20:17:21.112405] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-24T20:17:21.543431] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:21.616127] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-24T20:17:21.832772] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T20:17:22.416131] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-24T20:17:22.824912] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T20:17:22.998547] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T20:17:23.000722] [INFO ] [REMOTE ] NIC: Full fetch complete (12132 records). [2025-09-24T20:17:23.000801] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-24T20:17:23.221233] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-24T20:17:23.437198] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-24T20:17:23.437305] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-24T20:17:23.437750] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-24T20:17:23.437817] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-24T20:17:23.438405] [DEBUG] [LOCAL ] NIC: Trimmed 12132 records to 8889 (keeping 200 days of data) [2025-09-24T20:17:23.512351] [DEBUG] [LOCAL ] NIC: Primary data saved (8889 records). [2025-09-24T20:17:23.512588] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-24T20:17:23.512742] [INFO ] [MAIN ] Update Progress: 1486/2373 symbols completed. NIC took 30.3s. Estimated remaining: 1h 57m 47s. Rate: 7.5 symbols/min [2025-09-24T20:17:23.741123] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:23.741426] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-24T20:17:23.741468] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-24T20:17:23.741671] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-24T20:17:23.741766] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-24T20:17:23.741816] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-24T20:17:23.741852] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-24T20:17:24.025938] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-24T20:17:24.214200] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:24.244586] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T20:17:24.816127] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-24T20:17:25.423507] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T20:17:25.616139] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-24T20:17:25.656748] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T20:17:25.913737] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:25.914298] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-24T20:17:26.416123] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-24T20:17:27.216122] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-24T20:17:28.016127] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-24T20:17:28.333928] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:28.334853] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-24T20:17:28.338401] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T20:17:28.816103] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-24T20:17:29.616056] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-24T20:17:29.738344] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T20:17:29.937156] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:29.958384] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-24T20:17:29.962335] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-24T20:17:30.416146] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-24T20:17:31.216134] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-24T20:17:31.950598] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T20:17:32.016073] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-24T20:17:32.816140] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-24T20:17:33.369966] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T20:17:33.616143] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-24T20:17:33.727240] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T20:17:33.729841] [INFO ] [REMOTE ] NIE: Full fetch complete (16343 records). [2025-09-24T20:17:33.729939] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-24T20:17:34.025238] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-24T20:17:34.216191] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-24T20:17:34.216316] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-24T20:17:34.217052] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-24T20:17:34.217126] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-24T20:17:34.218099] [DEBUG] [LOCAL ] NIE: Trimmed 16343 records to 11620 (keeping 200 days of data) [2025-09-24T20:17:34.308439] [DEBUG] [LOCAL ] NIE: Primary data saved (11620 records). [2025-09-24T20:17:34.308659] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-24T20:17:34.308780] [INFO ] [MAIN ] Update Progress: 1487/2373 symbols completed. NIE took 39.0s. Estimated remaining: 1h 57m 41s. Rate: 7.5 symbols/min [2025-09-24T20:17:34.421315] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-24T20:17:34.493128] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:34.544538] [DEBUG] [LOCAL ] NJR: Loaded 38098 existing records from primary storage. [2025-09-24T20:17:34.544731] [INFO ] [MAIN ] NJR: Loaded 38098 existing records. [2025-09-24T20:17:34.753485] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:17:34.754122] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-24T20:17:34.754212] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-24T20:17:34.756387] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-24T20:17:34.756454] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-24T20:17:34.900573] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:17:34.958881] [INFO ] [REMOTE ] NINE: Full fetch complete (44314 records). [2025-09-24T20:17:35.004010] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-24T20:17:35.257208] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-24T20:17:35.291355] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:35.594958] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:35.595415] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-24T20:17:35.595927] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-24T20:17:35.596259] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-24T20:17:35.597894] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-24T20:17:35.598962] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-24T20:17:35.600345] [DEBUG] [LOCAL ] NINE: Trimmed 44314 records to 28346 (keeping 200 days of data) [2025-09-24T20:17:35.777737] [DEBUG] [LOCAL ] NINE: Primary data saved (28346 records). [2025-09-24T20:17:35.777900] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-24T20:17:35.778000] [INFO ] [MAIN ] Update Progress: 1488/2373 symbols completed. NINE took 34.5s. Estimated remaining: 1h 57m 29s. Rate: 7.5 symbols/min [2025-09-24T20:17:35.958825] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:35.959257] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-24T20:17:35.959316] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-24T20:17:35.959527] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-24T20:17:35.959582] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-24T20:17:35.959628] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-24T20:17:35.959702] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-24T20:17:36.028121] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-24T20:17:36.364353] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:36.365874] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:36.367068] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-24T20:17:36.816058] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-24T20:17:37.074449] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:37.075061] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-24T20:17:37.177091] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-24T20:17:37.616143] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-24T20:17:37.886947] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:17:37.887506] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-24T20:17:38.416229] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-24T20:17:39.216177] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-24T20:17:40.016178] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-24T20:17:40.344185] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T20:17:40.816079] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-24T20:17:41.074424] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-24T20:17:41.279583] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T20:17:41.616216] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-24T20:17:42.416202] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-24T20:17:42.604574] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T20:17:43.216135] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-24T20:17:44.016235] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-24T20:17:44.325704] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-24T20:17:44.656246] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T20:17:44.665086] [INFO ] [REMOTE ] NIQ: Full fetch complete (15390 records). [2025-09-24T20:17:44.665333] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-24T20:17:44.827815] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-24T20:17:44.884260] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-24T20:17:44.886536] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:17:44.886902] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:17:44.887078] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-24T20:17:44.887365] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-24T20:17:44.887474] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-24T20:17:44.887779] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-24T20:17:44.887937] [INFO ] [MAIN ] Update Progress: 1489/2373 symbols completed. NIQ took 21.4s. Estimated remaining: 1h 57m 22s. Rate: 7.5 symbols/min [2025-09-24T20:17:45.128712] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:17:45.177847] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-24T20:17:45.227189] [DEBUG] [LOCAL ] NKX: Loaded 13537 existing records from primary storage. [2025-09-24T20:17:45.229782] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T20:17:45.238559] [INFO ] [MAIN ] NKX: Loaded 13537 existing records. [2025-09-24T20:17:45.436970] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:17:45.437331] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-24T20:17:45.437409] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-24T20:17:45.438226] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-24T20:17:45.438293] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-24T20:17:45.625729] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-24T20:17:45.856935] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:17:46.416241] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-24T20:17:47.216096] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-24T20:17:47.469137] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T20:17:47.798538] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-24T20:17:48.016115] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-24T20:17:48.276352] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-24T20:17:48.642964] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T20:17:48.816223] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-24T20:17:49.616223] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-24T20:17:49.740526] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T20:17:50.416064] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-24T20:17:50.552737] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-24T20:17:51.216281] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-24T20:17:51.275098] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T20:17:52.016137] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-24T20:17:52.816198] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-24T20:17:52.870214] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-24T20:17:53.427691] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-24T20:17:53.616136] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-24T20:17:53.671871] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:17:53.776401] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-24T20:17:54.416182] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-24T20:17:54.559452] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T20:17:55.216202] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-24T20:17:55.980088] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:17:56.016111] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-24T20:17:56.816223] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-24T20:17:57.551510] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T20:17:57.616185] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-24T20:17:57.984183] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-24T20:17:58.416134] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-24T20:17:58.638967] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T20:17:59.216138] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-24T20:17:59.529675] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-24T20:17:59.888459] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T20:18:00.016125] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-24T20:18:00.090600] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T20:18:00.816205] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-24T20:18:01.616143] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-24T20:18:01.782732] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T20:18:02.335240] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T20:18:02.416143] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-24T20:18:03.216216] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-24T20:18:04.016122] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-24T20:18:05.229704] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-24T20:18:05.234488] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-24T20:18:05.505917] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (3.89 seconds). [2025-09-24T20:18:05.618713] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-24T20:18:05.622581] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-24T20:18:05.631206] [INFO ] [REMOTE ] NJR: Full fetch complete (54367 records). [2025-09-24T20:18:05.631481] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-24T20:18:06.139568] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-24T20:18:06.139792] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-24T20:18:06.141093] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-24T20:18:06.141197] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-24T20:18:06.144049] [DEBUG] [LOCAL ] NJR: Trimmed 54367 records to 38112 (keeping 200 days of data) [2025-09-24T20:18:06.275093] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T20:18:06.422044] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-24T20:18:06.453306] [DEBUG] [LOCAL ] NJR: Primary data saved (38112 records). [2025-09-24T20:18:06.453562] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-24T20:18:06.453735] [INFO ] [MAIN ] Update Progress: 1490/2373 symbols completed. NJR took 32.1s. Estimated remaining: 1h 57m 22s. Rate: 7.5 symbols/min [2025-09-24T20:18:06.665260] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:06.665733] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-24T20:18:06.665796] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-24T20:18:06.666217] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-24T20:18:06.666313] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-24T20:18:06.666394] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-24T20:18:06.666492] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-24T20:18:07.092724] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:07.216323] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-24T20:18:07.338398] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-24T20:18:07.504370] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T20:18:07.508534] [INFO ] [REMOTE ] NKX: Full fetch complete (19488 records). [2025-09-24T20:18:07.508782] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-24T20:18:07.930019] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-24T20:18:07.930242] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-24T20:18:07.934054] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-24T20:18:07.938721] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-24T20:18:07.940398] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T20:18:07.943728] [DEBUG] [LOCAL ] NKX: Trimmed 19488 records to 13619 (keeping 200 days of data) [2025-09-24T20:18:08.022785] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-24T20:18:08.055865] [DEBUG] [LOCAL ] NKX: Primary data saved (13619 records). [2025-09-24T20:18:08.056058] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-24T20:18:08.056338] [INFO ] [MAIN ] Update Progress: 1491/2373 symbols completed. NKX took 23.2s. Estimated remaining: 1h 57m 10s. Rate: 7.5 symbols/min [2025-09-24T20:18:08.269995] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:08.325883] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-24T20:18:08.345585] [DEBUG] [LOCAL ] NLOP: Loaded 11813 existing records from primary storage. [2025-09-24T20:18:08.346597] [INFO ] [MAIN ] NLOP: Loaded 11813 existing records. [2025-09-24T20:18:08.564896] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:08.565705] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-24T20:18:08.565876] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-24T20:18:08.567286] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-24T20:18:08.567468] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-24T20:18:08.794399] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T20:18:08.821762] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-24T20:18:08.862344] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-24T20:18:08.867985] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-24T20:18:09.312756] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:09.538979] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-24T20:18:09.539197] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-24T20:18:09.540920] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-24T20:18:09.541036] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-24T20:18:09.544622] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-09-24T20:18:09.618677] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-24T20:18:09.657830] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:18:09.928703] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-24T20:18:09.928909] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-24T20:18:09.929011] [INFO ] [MAIN ] Update Progress: 1492/2373 symbols completed. NIO took 49.0s. Estimated remaining: 1h 56m 59s. Rate: 7.5 symbols/min [2025-09-24T20:18:10.111935] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:10.177275] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-24T20:18:10.177451] [INFO ] [MAIN ] NLY: Loaded 53581 existing records. [2025-09-24T20:18:10.381072] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:10.381334] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-24T20:18:10.381387] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-24T20:18:10.383034] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-24T20:18:10.383115] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-24T20:18:10.421178] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-24T20:18:10.805694] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:11.216180] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-24T20:18:11.394561] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T20:18:11.854716] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T20:18:12.016226] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-24T20:18:12.319256] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-24T20:18:12.816172] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-24T20:18:13.106453] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T20:18:13.616137] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-24T20:18:14.416115] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-24T20:18:14.481173] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T20:18:14.679511] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T20:18:15.216117] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-24T20:18:16.016120] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-24T20:18:16.759966] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T20:18:16.816133] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-24T20:18:17.616192] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-24T20:18:17.738838] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-24T20:18:18.346219] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T20:18:18.371674] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T20:18:18.416108] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-24T20:18:19.031824] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T20:18:19.216137] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-24T20:18:19.409423] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (3.39 seconds). [2025-09-24T20:18:20.016213] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-24T20:18:20.821454] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-24T20:18:21.489761] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T20:18:21.522419] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T20:18:21.563590] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-24T20:18:21.567578] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-24T20:18:21.577633] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T20:18:21.621208] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-24T20:18:21.814506] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T20:18:21.815729] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:18:21.815845] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:18:21.815962] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-24T20:18:21.816067] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-24T20:18:21.816134] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-24T20:18:21.816241] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-24T20:18:21.816402] [INFO ] [MAIN ] Update Progress: 1493/2373 symbols completed. NKE took 46.0s. Estimated remaining: 1h 56m 53s. Rate: 7.5 symbols/min [2025-09-24T20:18:22.001673] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:22.023361] [DEBUG] [LOCAL ] NMAI: Loaded 13132 existing records from primary storage. [2025-09-24T20:18:22.023576] [INFO ] [MAIN ] NMAI: Loaded 13132 existing records. [2025-09-24T20:18:22.258180] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:22.258881] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-24T20:18:22.258944] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-24T20:18:22.259867] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-24T20:18:22.259932] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-24T20:18:22.424234] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-24T20:18:22.471493] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T20:18:22.678627] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:23.216199] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-24T20:18:23.559215] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:18:24.016219] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-24T20:18:24.258500] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T20:18:24.526722] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T20:18:24.816211] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-24T20:18:25.616093] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-24T20:18:25.739458] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T20:18:26.416216] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-24T20:18:27.216219] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-24T20:18:27.422503] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T20:18:27.659224] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-24T20:18:28.016079] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-24T20:18:28.241947] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:18:28.816126] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-24T20:18:29.529920] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T20:18:29.616066] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-24T20:18:29.961116] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T20:18:30.257041] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T20:18:30.261812] [INFO ] [REMOTE ] NLOP: Full fetch complete (17699 records). [2025-09-24T20:18:30.262018] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-24T20:18:30.421352] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-24T20:18:30.707444] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-24T20:18:30.707557] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-24T20:18:30.708141] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-24T20:18:30.708207] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-24T20:18:30.709128] [DEBUG] [LOCAL ] NLOP: Trimmed 17699 records to 11843 (keeping 200 days of data) [2025-09-24T20:18:30.791846] [DEBUG] [LOCAL ] NLOP: Primary data saved (11843 records). [2025-09-24T20:18:30.792084] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-24T20:18:30.792211] [INFO ] [MAIN ] Update Progress: 1494/2373 symbols completed. NLOP took 22.7s. Estimated remaining: 1h 56m 46s. Rate: 7.5 symbols/min [2025-09-24T20:18:30.989205] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:30.989441] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-24T20:18:30.989479] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-24T20:18:30.989677] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-24T20:18:30.989746] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-24T20:18:30.989843] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-24T20:18:30.989899] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-24T20:18:31.223562] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-24T20:18:31.441990] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:31.444252] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T20:18:32.016134] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-24T20:18:32.779041] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T20:18:32.816043] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-24T20:18:33.389775] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-24T20:18:33.616232] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-24T20:18:33.784433] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T20:18:33.789234] [INFO ] [REMOTE ] NL: Full fetch complete (6916 records). [2025-09-24T20:18:33.789573] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-24T20:18:34.031894] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:18:34.032335] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:18:34.032412] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:18:34.032493] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-24T20:18:34.032589] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-24T20:18:34.032673] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-24T20:18:34.032745] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-24T20:18:34.032843] [INFO ] [MAIN ] Update Progress: 1495/2373 symbols completed. NL took 27.6s. Estimated remaining: 1h 56m 35s. Rate: 7.5 symbols/min [2025-09-24T20:18:34.103317] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:18:34.135097] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-24T20:18:34.221755] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:34.250276] [DEBUG] [LOCAL ] NMCO: Loaded 16543 existing records from primary storage. [2025-09-24T20:18:34.250710] [INFO ] [MAIN ] NMCO: Loaded 16543 existing records. [2025-09-24T20:18:34.418885] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-24T20:18:34.452984] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:34.453326] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-24T20:18:34.453380] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-24T20:18:34.454498] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-24T20:18:34.454564] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-24T20:18:34.940165] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:35.216116] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-24T20:18:35.473841] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T20:18:36.016170] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-24T20:18:36.816104] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-24T20:18:37.342912] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T20:18:37.366614] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:18:37.367017] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-24T20:18:37.376043] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T20:18:37.616087] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-24T20:18:37.915476] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:18:37.915847] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-24T20:18:38.416133] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-24T20:18:39.216087] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-24T20:18:39.435216] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T20:18:40.016122] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-24T20:18:40.412470] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T20:18:40.816111] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-24T20:18:41.616109] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-24T20:18:42.069289] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T20:18:42.108919] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T20:18:42.155394] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T20:18:42.416207] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-24T20:18:43.216131] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-24T20:18:43.400545] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T20:18:44.016093] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-24T20:18:44.816183] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-24T20:18:45.019972] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T20:18:45.616095] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-24T20:18:45.805802] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-24T20:18:45.863700] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T20:18:46.416094] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-24T20:18:46.616673] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T20:18:47.216070] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-24T20:18:47.340467] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T20:18:48.016132] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-24T20:18:48.816143] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-24T20:18:49.317315] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T20:18:49.616121] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-24T20:18:49.768731] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T20:18:50.039537] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T20:18:50.416094] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-24T20:18:51.216088] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-24T20:18:51.553008] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T20:18:51.562936] [INFO ] [REMOTE ] NLY: Full fetch complete (77556 records). [2025-09-24T20:18:51.563126] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-24T20:18:51.962963] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-24T20:18:51.963068] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-24T20:18:51.964404] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-24T20:18:51.964476] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-24T20:18:51.966525] [DEBUG] [LOCAL ] NLY: Trimmed 77556 records to 53581 (keeping 200 days of data) [2025-09-24T20:18:52.025505] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-24T20:18:52.379207] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-24T20:18:52.402963] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T20:18:52.407288] [DEBUG] [LOCAL ] NLY: Primary data saved (53581 records). [2025-09-24T20:18:52.411700] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-24T20:18:52.411829] [INFO ] [MAIN ] Update Progress: 1496/2373 symbols completed. NLY took 42.5s. Estimated remaining: 1h 56m 33s. Rate: 7.5 symbols/min [2025-09-24T20:18:52.592406] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:52.601899] [DEBUG] [LOCAL ] NMG: Loaded 7560 existing records from primary storage. [2025-09-24T20:18:52.602020] [INFO ] [MAIN ] NMG: Loaded 7560 existing records. [2025-09-24T20:18:52.779109] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:52.779384] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-24T20:18:52.779433] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-24T20:18:52.779802] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-24T20:18:52.779862] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-24T20:18:52.821208] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-24T20:18:52.897015] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T20:18:53.169742] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:53.616114] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-24T20:18:53.855580] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T20:18:53.859831] [INFO ] [REMOTE ] NMAI: Full fetch complete (19982 records). [2025-09-24T20:18:53.859944] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-24T20:18:54.282010] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-24T20:18:54.282106] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-24T20:18:54.282623] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-24T20:18:54.282695] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-24T20:18:54.283436] [DEBUG] [LOCAL ] NMAI: Trimmed 19982 records to 13047 (keeping 200 days of data) [2025-09-24T20:18:54.382137] [DEBUG] [LOCAL ] NMAI: Primary data saved (13047 records). [2025-09-24T20:18:54.382361] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-24T20:18:54.382490] [INFO ] [MAIN ] Update Progress: 1497/2373 symbols completed. NMAI took 32.6s. Estimated remaining: 1h 56m 21s. Rate: 7.5 symbols/min [2025-09-24T20:18:54.421250] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-24T20:18:54.525519] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T20:18:54.591804] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:18:54.599389] [DEBUG] [LOCAL ] NMI: Loaded 4064 existing records from primary storage. [2025-09-24T20:18:54.599577] [INFO ] [MAIN ] NMI: Loaded 4064 existing records. [2025-09-24T20:18:54.809203] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:18:54.809573] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-24T20:18:54.809627] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-24T20:18:54.810046] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-24T20:18:54.810110] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-24T20:18:55.212060] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:18:55.216064] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-24T20:18:55.548032] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T20:18:56.016943] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-24T20:18:56.020065] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T20:18:56.816069] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-24T20:18:56.986052] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T20:18:57.616096] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-24T20:18:57.658470] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:18:58.254026] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T20:18:58.416095] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-24T20:18:59.216253] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-24T20:18:59.271932] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:19:00.016101] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-24T20:19:00.719366] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T20:19:00.816056] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-24T20:19:01.002590] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T20:19:01.411837] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T20:19:01.616127] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-24T20:19:02.300573] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-24T20:19:02.416127] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-24T20:19:03.216083] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-24T20:19:03.367812] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T20:19:03.371165] [INFO ] [REMOTE ] NMCO: Full fetch complete (24470 records). [2025-09-24T20:19:03.371242] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-24T20:19:03.737999] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-24T20:19:03.738082] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-24T20:19:03.738681] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-24T20:19:03.738743] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-24T20:19:03.739379] [DEBUG] [LOCAL ] NMCO: Trimmed 24470 records to 16552 (keeping 200 days of data) [2025-09-24T20:19:03.844827] [DEBUG] [LOCAL ] NMCO: Primary data saved (16552 records). [2025-09-24T20:19:03.844973] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-24T20:19:03.845061] [INFO ] [MAIN ] Update Progress: 1498/2373 symbols completed. NMCO took 29.8s. Estimated remaining: 1h 56m 14s. Rate: 7.5 symbols/min [2025-09-24T20:19:04.016174] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:04.016276] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-24T20:19:04.033375] [DEBUG] [LOCAL ] NMM: Loaded 14304 existing records from primary storage. [2025-09-24T20:19:04.033515] [INFO ] [MAIN ] NMM: Loaded 14304 existing records. [2025-09-24T20:19:04.214836] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:04.215152] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-24T20:19:04.215249] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-24T20:19:04.215940] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-24T20:19:04.216008] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-24T20:19:04.593511] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:04.717764] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T20:19:04.816064] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-24T20:19:04.906751] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T20:19:05.267822] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-24T20:19:05.616090] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-24T20:19:06.241220] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T20:19:06.416141] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-24T20:19:07.216135] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-24T20:19:07.894458] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T20:19:08.016063] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-24T20:19:08.180365] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T20:19:08.191533] [INFO ] [REMOTE ] NMAX: Full fetch complete (40262 records). [2025-09-24T20:19:08.191718] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-24T20:19:08.405432] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 123 unique days, need 200 days [2025-09-24T20:19:08.405960] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:19:08.406035] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:19:08.406509] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-24T20:19:08.406853] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-24T20:19:08.406908] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-24T20:19:08.406957] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-24T20:19:08.407093] [INFO ] [MAIN ] Update Progress: 1499/2373 symbols completed. NMAX took 37.6s. Estimated remaining: 1h 56m 4s. Rate: 7.5 symbols/min [2025-09-24T20:19:08.544980] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-24T20:19:08.620049] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:08.664154] [DEBUG] [LOCAL ] NMR: Loaded 35045 existing records from primary storage. [2025-09-24T20:19:08.664359] [INFO ] [MAIN ] NMR: Loaded 35045 existing records. [2025-09-24T20:19:08.821222] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-24T20:19:08.868217] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:08.868577] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-24T20:19:08.868693] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-24T20:19:08.870184] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-24T20:19:08.870253] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-24T20:19:09.282912] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:09.616091] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-24T20:19:09.646343] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:19:09.647895] [INFO ] [REMOTE ] NMI: Full fetch complete (6227 records). [2025-09-24T20:19:09.647970] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-24T20:19:10.007930] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-24T20:19:10.008018] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-24T20:19:10.008201] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-24T20:19:10.008240] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-24T20:19:10.008638] [DEBUG] [LOCAL ] NMI: Trimmed 6227 records to 4058 (keeping 200 days of data) [2025-09-24T20:19:10.033371] [DEBUG] [LOCAL ] NMI: Primary data saved (4058 records). [2025-09-24T20:19:10.033486] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-24T20:19:10.033574] [INFO ] [MAIN ] Update Progress: 1500/2373 symbols completed. NMI took 15.7s. Estimated remaining: 1h 55m 53s. Rate: 7.5 symbols/min [2025-09-24T20:19:10.207498] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:10.212631] [DEBUG] [LOCAL ] NMS: Loaded 2884 existing records from primary storage. [2025-09-24T20:19:10.212795] [INFO ] [MAIN ] NMS: Loaded 2884 existing records. [2025-09-24T20:19:10.408943] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:10.409346] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-24T20:19:10.409424] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-24T20:19:10.409755] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-24T20:19:10.409828] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-24T20:19:10.422143] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-24T20:19:10.537204] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T20:19:10.827798] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:11.216072] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-24T20:19:11.982183] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:19:11.990801] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T20:19:12.016025] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-24T20:19:12.816192] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-24T20:19:13.475057] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T20:19:13.562065] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:19:13.616106] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-24T20:19:14.416097] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-24T20:19:14.532252] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T20:19:15.216088] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-24T20:19:15.340765] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T20:19:15.753129] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T20:19:16.016123] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-24T20:19:16.816127] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-24T20:19:17.431821] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T20:19:17.432145] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T20:19:17.616138] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-24T20:19:18.416174] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-24T20:19:18.951238] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T20:19:19.042214] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:19:19.216119] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-24T20:19:20.016261] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-24T20:19:20.262716] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T20:19:20.816228] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-24T20:19:20.838626] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T20:19:20.841842] [INFO ] [REMOTE ] NMG: Full fetch complete (13016 records). [2025-09-24T20:19:20.841960] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-24T20:19:21.241027] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-24T20:19:21.241118] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-24T20:19:21.241519] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-24T20:19:21.241559] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-24T20:19:21.242081] [DEBUG] [LOCAL ] NMG: Trimmed 13016 records to 7741 (keeping 200 days of data) [2025-09-24T20:19:21.286888] [DEBUG] [LOCAL ] NMG: Primary data saved (7741 records). [2025-09-24T20:19:21.287038] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-24T20:19:21.287139] [INFO ] [MAIN ] Update Progress: 1501/2373 symbols completed. NMG took 28.9s. Estimated remaining: 1h 55m 47s. Rate: 7.5 symbols/min [2025-09-24T20:19:21.460966] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:21.466957] [DEBUG] [LOCAL ] NMT: Loaded 2847 existing records from primary storage. [2025-09-24T20:19:21.467043] [INFO ] [MAIN ] NMT: Loaded 2847 existing records. [2025-09-24T20:19:21.616837] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-24T20:19:21.655754] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:21.656602] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-24T20:19:21.656696] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-24T20:19:21.657239] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-24T20:19:21.657490] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-24T20:19:21.978094] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T20:19:22.160259] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:22.257599] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T20:19:22.416118] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-24T20:19:23.216099] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-24T20:19:23.494156] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T20:19:24.016224] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-24T20:19:24.675833] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T20:19:24.816061] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-24T20:19:24.905727] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T20:19:25.616046] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-24T20:19:25.980438] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T20:19:26.099855] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T20:19:26.416177] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-24T20:19:27.216108] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-24T20:19:27.959465] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T20:19:27.983747] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T20:19:28.016053] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-24T20:19:28.816131] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-24T20:19:29.335890] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T20:19:29.361639] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-24T20:19:29.616090] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-24T20:19:30.196081] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T20:19:30.416172] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-24T20:19:31.028428] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-24T20:19:31.216063] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-24T20:19:31.736503] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T20:19:32.016098] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-24T20:19:32.547177] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T20:19:32.816100] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-24T20:19:33.370160] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T20:19:33.616125] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-24T20:19:34.253528] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T20:19:34.416191] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-24T20:19:35.216083] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-24T20:19:35.366241] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T20:19:35.889379] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T20:19:36.016168] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-24T20:19:36.816108] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-24T20:19:37.142400] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:19:37.616095] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-24T20:19:38.262305] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:19:38.416112] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-24T20:19:38.511058] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T20:19:39.216174] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-24T20:19:39.880972] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T20:19:40.016099] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-24T20:19:40.275458] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-24T20:19:40.816125] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-24T20:19:41.411192] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T20:19:41.417513] [INFO ] [REMOTE ] NMR: Full fetch complete (50237 records). [2025-09-24T20:19:41.417687] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-24T20:19:41.482285] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T20:19:41.626749] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-24T20:19:41.825084] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-24T20:19:41.825175] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-24T20:19:41.826136] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-24T20:19:41.826229] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-24T20:19:41.827733] [DEBUG] [LOCAL ] NMR: Trimmed 50237 records to 35034 (keeping 200 days of data) [2025-09-24T20:19:42.037984] [DEBUG] [LOCAL ] NMR: Primary data saved (35034 records). [2025-09-24T20:19:42.038149] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-24T20:19:42.038254] [INFO ] [MAIN ] Update Progress: 1502/2373 symbols completed. NMR took 33.6s. Estimated remaining: 1h 55m 46s. Rate: 7.5 symbols/min [2025-09-24T20:19:42.215027] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:42.237446] [DEBUG] [LOCAL ] NMZ: Loaded 21604 existing records from primary storage. [2025-09-24T20:19:42.237588] [INFO ] [MAIN ] NMZ: Loaded 21604 existing records. [2025-09-24T20:19:42.424036] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-24T20:19:42.432207] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:42.432503] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-24T20:19:42.432558] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-24T20:19:42.433590] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-24T20:19:42.433693] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-24T20:19:42.748696] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T20:19:42.793133] [INFO ] [REMOTE ] NMM: Full fetch complete (22305 records). [2025-09-24T20:19:42.803780] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-24T20:19:42.823281] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:43.133474] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T20:19:43.224514] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-24T20:19:43.222851] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-24T20:19:43.225429] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-24T20:19:43.226098] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-24T20:19:43.226202] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-24T20:19:43.227506] [DEBUG] [LOCAL ] NMM: Trimmed 22305 records to 14317 (keeping 200 days of data) [2025-09-24T20:19:43.320078] [DEBUG] [LOCAL ] NMM: Primary data saved (14317 records). [2025-09-24T20:19:43.320243] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-24T20:19:43.320340] [INFO ] [MAIN ] Update Progress: 1503/2373 symbols completed. NMM took 39.5s. Estimated remaining: 1h 55m 34s. Rate: 7.5 symbols/min [2025-09-24T20:19:43.497125] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:43.510110] [DEBUG] [LOCAL ] NNI: Loaded 9959 existing records from primary storage. [2025-09-24T20:19:43.510235] [INFO ] [MAIN ] NNI: Loaded 9959 existing records. [2025-09-24T20:19:43.728692] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:43.728933] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-24T20:19:43.728985] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-24T20:19:43.729429] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-24T20:19:43.729492] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-24T20:19:43.844542] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T20:19:43.867802] [INFO ] [REMOTE ] NMS: Full fetch complete (4049 records). [2025-09-24T20:19:43.889172] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-24T20:19:44.027775] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-24T20:19:44.488013] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:44.570914] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-24T20:19:44.571008] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-24T20:19:44.571158] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-24T20:19:44.571379] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-24T20:19:44.571839] [DEBUG] [LOCAL ] NMS: Trimmed 4049 records to 2883 (keeping 200 days of data) [2025-09-24T20:19:44.591072] [DEBUG] [LOCAL ] NMS: Primary data saved (2883 records). [2025-09-24T20:19:44.591229] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-24T20:19:44.591327] [INFO ] [MAIN ] Update Progress: 1504/2373 symbols completed. NMS took 34.6s. Estimated remaining: 1h 55m 22s. Rate: 7.5 symbols/min [2025-09-24T20:19:44.770508] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:44.822227] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-24T20:19:44.825857] [DEBUG] [LOCAL ] NNN: Loaded 48450 existing records from primary storage. [2025-09-24T20:19:44.826026] [INFO ] [MAIN ] NNN: Loaded 48450 existing records. [2025-09-24T20:19:45.015455] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:45.015756] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-24T20:19:45.015815] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-24T20:19:45.017435] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-24T20:19:45.017501] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-24T20:19:45.393089] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:45.411278] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T20:19:45.520890] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T20:19:45.616133] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-24T20:19:46.416112] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-24T20:19:47.025161] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T20:19:47.129910] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T20:19:47.216141] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-24T20:19:48.016091] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-24T20:19:48.816110] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-24T20:19:48.944449] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T20:19:49.056816] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T20:19:49.616117] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-24T20:19:50.175884] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T20:19:50.416107] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-24T20:19:51.216095] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-24T20:19:51.323230] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T20:19:51.357982] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T20:19:51.799302] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T20:19:51.800683] [INFO ] [REMOTE ] NMT: Full fetch complete (4258 records). [2025-09-24T20:19:51.800760] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-24T20:19:52.021232] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-24T20:19:52.178277] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-24T20:19:52.178386] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-24T20:19:52.178564] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-24T20:19:52.178606] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-24T20:19:52.179023] [DEBUG] [LOCAL ] NMT: Trimmed 4258 records to 2853 (keeping 200 days of data) [2025-09-24T20:19:52.197075] [DEBUG] [LOCAL ] NMT: Primary data saved (2853 records). [2025-09-24T20:19:52.197174] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-24T20:19:52.197260] [INFO ] [MAIN ] Update Progress: 1505/2373 symbols completed. NMT took 30.9s. Estimated remaining: 1h 55m 14s. Rate: 7.5 symbols/min [2025-09-24T20:19:52.368955] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:19:52.377178] [DEBUG] [LOCAL ] NNY: Loaded 5702 existing records from primary storage. [2025-09-24T20:19:52.377314] [INFO ] [MAIN ] NNY: Loaded 5702 existing records. [2025-09-24T20:19:52.581525] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:19:52.581943] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-24T20:19:52.582005] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-24T20:19:52.582502] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-24T20:19:52.582573] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-24T20:19:52.825801] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-24T20:19:53.025304] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:19:53.616258] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-24T20:19:53.942511] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T20:19:53.978043] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T20:19:54.416104] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-24T20:19:54.423692] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T20:19:55.216094] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-24T20:19:55.779157] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T20:19:56.016103] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-24T20:19:56.045027] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T20:19:56.816112] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-24T20:19:57.616105] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-24T20:19:57.775246] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T20:19:57.916488] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T20:19:58.416079] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-24T20:19:58.459127] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T20:19:59.216086] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-24T20:19:59.457837] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T20:20:00.016046] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-24T20:20:00.405371] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T20:20:00.816130] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-24T20:20:01.616182] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-24T20:20:01.713518] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T20:20:01.751161] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T20:20:02.416117] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-24T20:20:02.549905] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T20:20:02.932970] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T20:20:03.216082] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-24T20:20:04.016227] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-24T20:20:04.816079] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-24T20:20:05.024514] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T20:20:05.368433] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T20:20:05.402870] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T20:20:05.616107] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-24T20:20:06.416096] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-24T20:20:06.565711] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T20:20:07.216078] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-24T20:20:07.878528] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T20:20:08.016085] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-24T20:20:08.141315] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T20:20:08.814690] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-24T20:20:08.816627] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-24T20:20:09.616116] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-24T20:20:09.868438] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T20:20:09.873691] [INFO ] [REMOTE ] NMZ: Full fetch complete (31880 records). [2025-09-24T20:20:09.873821] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-24T20:20:10.286812] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-24T20:20:10.286960] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-24T20:20:10.288337] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-24T20:20:10.288441] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-24T20:20:10.290153] [DEBUG] [LOCAL ] NMZ: Trimmed 31880 records to 21602 (keeping 200 days of data) [2025-09-24T20:20:10.416312] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-24T20:20:10.443368] [DEBUG] [LOCAL ] NMZ: Primary data saved (21602 records). [2025-09-24T20:20:10.443536] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-24T20:20:10.443692] [INFO ] [MAIN ] Update Progress: 1506/2373 symbols completed. NMZ took 28.4s. Estimated remaining: 1h 55m 12s. Rate: 7.5 symbols/min [2025-09-24T20:20:10.561260] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T20:20:10.639664] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:10.659541] [DEBUG] [LOCAL ] NOA: Loaded 16275 existing records from primary storage. [2025-09-24T20:20:10.659716] [INFO ] [MAIN ] NOA: Loaded 16275 existing records. [2025-09-24T20:20:10.840783] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:20:10.841050] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-24T20:20:10.841135] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-24T20:20:10.842947] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-24T20:20:10.843022] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-24T20:20:11.220481] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-24T20:20:11.234493] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:11.944398] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T20:20:12.016128] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-24T20:20:12.258476] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T20:20:12.816065] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-24T20:20:12.880428] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T20:20:13.508261] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T20:20:13.616092] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-24T20:20:14.416063] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-24T20:20:14.489367] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T20:20:15.216113] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-24T20:20:15.324118] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T20:20:15.327156] [INFO ] [REMOTE ] NNI: Full fetch complete (12664 records). [2025-09-24T20:20:15.327265] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-24T20:20:15.764248] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-24T20:20:15.764337] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-24T20:20:15.764699] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-24T20:20:15.764819] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-24T20:20:15.765710] [DEBUG] [LOCAL ] NNI: Trimmed 12664 records to 9996 (keeping 200 days of data) [2025-09-24T20:20:15.843511] [DEBUG] [LOCAL ] NNI: Primary data saved (9996 records). [2025-09-24T20:20:15.843708] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-24T20:20:15.843839] [INFO ] [MAIN ] Update Progress: 1507/2373 symbols completed. NNI took 32.5s. Estimated remaining: 1h 55m 3s. Rate: 7.5 symbols/min [2025-09-24T20:20:16.021272] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-24T20:20:16.056981] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:16.085544] [DEBUG] [LOCAL ] NOAH: Loaded 20090 existing records from primary storage. [2025-09-24T20:20:16.085789] [INFO ] [MAIN ] NOAH: Loaded 20090 existing records. [2025-09-24T20:20:16.307927] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:20:16.308268] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-24T20:20:16.308332] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-24T20:20:16.309089] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-24T20:20:16.309176] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-24T20:20:16.713570] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:16.795395] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T20:20:16.816098] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-24T20:20:17.159815] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:20:17.616101] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-24T20:20:17.745993] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-24T20:20:18.273984] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T20:20:18.416201] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-24T20:20:19.216066] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-24T20:20:19.296480] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T20:20:20.016135] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-24T20:20:20.635353] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T20:20:20.816077] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-24T20:20:20.861309] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T20:20:20.864026] [INFO ] [REMOTE ] NNY: Full fetch complete (8918 records). [2025-09-24T20:20:20.864141] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-24T20:20:21.289109] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-24T20:20:21.289230] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-24T20:20:21.289519] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-24T20:20:21.289603] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-24T20:20:21.290083] [DEBUG] [LOCAL ] NNY: Trimmed 8918 records to 5703 (keeping 200 days of data) [2025-09-24T20:20:21.328066] [DEBUG] [LOCAL ] NNY: Primary data saved (5703 records). [2025-09-24T20:20:21.328145] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-24T20:20:21.328279] [INFO ] [MAIN ] Update Progress: 1508/2373 symbols completed. NNY took 29.1s. Estimated remaining: 1h 54m 53s. Rate: 7.5 symbols/min [2025-09-24T20:20:21.502783] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:21.571031] [DEBUG] [LOCAL ] NOC: Loaded 42599 existing records from primary storage. [2025-09-24T20:20:21.571231] [INFO ] [MAIN ] NOC: Loaded 42599 existing records. [2025-09-24T20:20:21.626927] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-24T20:20:21.758948] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:20:21.759406] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-24T20:20:21.759464] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-24T20:20:21.760847] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-24T20:20:21.760912] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-24T20:20:22.162819] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:20:22.168859] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:22.416138] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-24T20:20:23.216130] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-24T20:20:23.266805] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:20:23.295260] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T20:20:23.295495] [INFO ] [REMOTE ] NNN: Full fetch complete (70163 records). [2025-09-24T20:20:23.300737] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-24T20:20:23.716508] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-24T20:20:23.716614] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-24T20:20:23.717865] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-24T20:20:23.717937] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-24T20:20:23.722332] [DEBUG] [LOCAL ] NNN: Trimmed 70163 records to 48412 (keeping 200 days of data) [2025-09-24T20:20:24.025945] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-24T20:20:24.063195] [DEBUG] [LOCAL ] NNN: Primary data saved (48412 records). [2025-09-24T20:20:24.063337] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-24T20:20:24.063477] [INFO ] [MAIN ] Update Progress: 1509/2373 symbols completed. NNN took 39.5s. Estimated remaining: 1h 54m 42s. Rate: 7.5 symbols/min [2025-09-24T20:20:24.228146] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T20:20:24.265790] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:24.325403] [DEBUG] [LOCAL ] NOG: Loaded 51164 existing records from primary storage. [2025-09-24T20:20:24.325559] [INFO ] [MAIN ] NOG: Loaded 51164 existing records. [2025-09-24T20:20:24.501850] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:20:24.502180] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-24T20:20:24.502241] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-24T20:20:24.503477] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-24T20:20:24.503549] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-24T20:20:24.821411] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-24T20:20:24.880121] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:25.183381] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T20:20:25.616081] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-24T20:20:26.000832] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T20:20:26.416187] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-24T20:20:27.216125] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-24T20:20:27.375622] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T20:20:27.434829] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T20:20:28.016106] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-24T20:20:28.206105] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T20:20:28.816118] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-24T20:20:28.917545] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T20:20:29.616105] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-24T20:20:30.092946] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T20:20:30.416106] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-24T20:20:30.499823] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T20:20:31.216123] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-24T20:20:31.991863] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T20:20:32.016081] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-24T20:20:32.224044] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T20:20:32.227806] [INFO ] [REMOTE ] NOA: Full fetch complete (21858 records). [2025-09-24T20:20:32.227957] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-24T20:20:32.616254] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-24T20:20:32.616350] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-24T20:20:32.616933] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-24T20:20:32.617012] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-24T20:20:32.618000] [DEBUG] [LOCAL ] NOA: Trimmed 21858 records to 16255 (keeping 200 days of data) [2025-09-24T20:20:32.726288] [DEBUG] [LOCAL ] NOA: Primary data saved (16255 records). [2025-09-24T20:20:32.726459] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-24T20:20:32.726627] [INFO ] [MAIN ] Update Progress: 1510/2373 symbols completed. NOA took 22.3s. Estimated remaining: 1h 54m 35s. Rate: 7.5 symbols/min [2025-09-24T20:20:32.818366] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-24T20:20:32.903532] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:32.972376] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-24T20:20:32.972542] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-09-24T20:20:33.085157] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T20:20:33.172817] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:20:33.174055] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-24T20:20:33.174116] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-24T20:20:33.175924] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-24T20:20:33.175988] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-24T20:20:33.528971] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:33.616113] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-24T20:20:34.416062] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-24T20:20:34.691530] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T20:20:34.862226] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T20:20:35.216100] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-24T20:20:36.016139] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-24T20:20:36.187786] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T20:20:36.627878] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T20:20:36.695470] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T20:20:36.816111] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-24T20:20:37.616085] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-24T20:20:37.954594] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T20:20:38.416115] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-24T20:20:39.216104] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-24T20:20:39.588797] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:20:39.595872] [INFO ] [REMOTE ] NOAH: Full fetch complete (28931 records). [2025-09-24T20:20:39.596097] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-24T20:20:39.923126] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-24T20:20:40.051030] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-24T20:20:40.141295] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-24T20:20:40.141402] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-24T20:20:40.142264] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-24T20:20:40.142333] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-24T20:20:40.144003] [DEBUG] [LOCAL ] NOAH: Trimmed 28931 records to 20175 (keeping 200 days of data) [2025-09-24T20:20:40.277929] [DEBUG] [LOCAL ] NOAH: Primary data saved (20175 records). [2025-09-24T20:20:40.278071] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-24T20:20:40.278175] [INFO ] [MAIN ] Update Progress: 1511/2373 symbols completed. NOAH took 24.4s. Estimated remaining: 1h 54m 27s. Rate: 7.5 symbols/min [2025-09-24T20:20:40.455258] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:20:40.455494] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-24T20:20:40.455547] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-24T20:20:40.455741] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-24T20:20:40.455793] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-24T20:20:40.455836] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-24T20:20:40.455870] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-24T20:20:40.828721] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-24T20:20:40.834981] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:20:41.102675] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T20:20:41.616197] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-24T20:20:41.991865] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T20:20:42.416098] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-24T20:20:42.894837] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T20:20:43.216090] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-24T20:20:43.676960] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-24T20:20:43.751009] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T20:20:43.936567] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T20:20:44.016175] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-24T20:20:44.816091] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-24T20:20:45.616370] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-24T20:20:45.864277] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T20:20:46.416204] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-24T20:20:46.753922] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T20:20:47.216205] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-24T20:20:47.560332] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T20:20:48.016130] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-24T20:20:48.099035] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T20:20:48.472192] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T20:20:48.816184] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-24T20:20:49.276189] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-24T20:20:49.563628] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-24T20:20:49.616054] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-24T20:20:50.416193] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-24T20:20:51.216204] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-24T20:20:51.781346] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T20:20:51.935564] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-24T20:20:52.016126] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-24T20:20:52.344725] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T20:20:52.461128] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T20:20:52.816086] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-24T20:20:53.251580] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T20:20:53.616089] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-24T20:20:54.416096] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-24T20:20:55.216122] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-24T20:20:55.634874] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T20:20:55.713893] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-24T20:20:56.016115] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-24T20:20:56.247930] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T20:20:56.816177] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-24T20:20:57.616117] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-24T20:20:58.007081] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T20:20:58.416123] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-24T20:20:58.676067] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T20:20:59.216170] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-24T20:20:59.589467] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T20:21:00.016062] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-24T20:21:00.066075] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T20:21:00.604031] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T20:21:00.816094] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-24T20:21:00.950535] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T20:21:00.960159] [INFO ] [REMOTE ] NOG: Full fetch complete (73649 records). [2025-09-24T20:21:00.960339] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-24T20:21:01.286393] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T20:21:01.394038] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-24T20:21:01.394154] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-24T20:21:01.395465] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-24T20:21:01.395553] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-24T20:21:01.397501] [DEBUG] [LOCAL ] NOG: Trimmed 73649 records to 51167 (keeping 200 days of data) [2025-09-24T20:21:01.626562] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-24T20:21:01.765800] [DEBUG] [LOCAL ] NOG: Primary data saved (51167 records). [2025-09-24T20:21:01.766046] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-24T20:21:01.766241] [INFO ] [MAIN ] Update Progress: 1512/2373 symbols completed. NOG took 37.7s. Estimated remaining: 1h 54m 26s. Rate: 7.5 symbols/min [2025-09-24T20:21:01.951045] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:01.993704] [DEBUG] [LOCAL ] NOMD: Loaded 41396 existing records from primary storage. [2025-09-24T20:21:01.993857] [INFO ] [MAIN ] NOMD: Loaded 41396 existing records. [2025-09-24T20:21:02.184945] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:02.185204] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-24T20:21:02.185256] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-24T20:21:02.186333] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-24T20:21:02.186399] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-24T20:21:02.421297] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-24T20:21:02.576328] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:03.216082] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-24T20:21:04.016202] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-24T20:21:04.844904] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:21:04.845966] [INFO ] [REMOTE ] NOM: Full fetch complete (1727 records). [2025-09-24T20:21:04.846043] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-24T20:21:05.050780] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-24T20:21:05.051025] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:21:05.051100] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:21:05.051177] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-24T20:21:05.051254] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-24T20:21:05.051296] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-24T20:21:05.051402] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-24T20:21:05.051506] [INFO ] [MAIN ] Update Progress: 1513/2373 symbols completed. NOM took 24.8s. Estimated remaining: 1h 54m 16s. Rate: 7.5 symbols/min [2025-09-24T20:21:05.255428] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:05.313514] [DEBUG] [LOCAL ] NOTE: Loaded 42980 existing records from primary storage. [2025-09-24T20:21:05.313711] [INFO ] [MAIN ] NOTE: Loaded 42980 existing records. [2025-09-24T20:21:05.528378] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:05.528846] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-24T20:21:05.529027] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-24T20:21:05.530040] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-24T20:21:05.530104] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-24T20:21:05.937165] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (4.31 seconds). [2025-09-24T20:21:05.971490] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:05.972986] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-24T20:21:05.973620] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-24T20:21:05.999787] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T20:21:06.416142] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-24T20:21:06.773953] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (4.35 seconds). [2025-09-24T20:21:07.216189] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-24T20:21:07.641852] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T20:21:07.654411] [INFO ] [REMOTE ] NOC: Full fetch complete (62179 records). [2025-09-24T20:21:07.654755] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-24T20:21:08.200174] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-24T20:21:08.200835] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-24T20:21:08.203114] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-24T20:21:08.205307] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T20:21:08.227940] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-24T20:21:08.217357] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-24T20:21:08.229195] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-24T20:21:08.233922] [DEBUG] [LOCAL ] NOC: Trimmed 62179 records to 42606 (keeping 200 days of data) [2025-09-24T20:21:08.550831] [DEBUG] [LOCAL ] NOC: Primary data saved (42606 records). [2025-09-24T20:21:08.551048] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-24T20:21:08.551169] [INFO ] [MAIN ] Update Progress: 1514/2373 symbols completed. NOC took 47.2s. Estimated remaining: 1h 54m 5s. Rate: 7.5 symbols/min [2025-09-24T20:21:08.750096] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:08.812624] [DEBUG] [LOCAL ] NOV: Loaded 53184 existing records from primary storage. [2025-09-24T20:21:08.812892] [INFO ] [MAIN ] NOV: Loaded 53184 existing records. [2025-09-24T20:21:08.850630] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-24T20:21:09.040382] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:09.040896] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-24T20:21:09.040965] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-24T20:21:09.042453] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-24T20:21:09.042595] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-24T20:21:09.473210] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:09.514598] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-24T20:21:09.616175] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-24T20:21:10.186335] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T20:21:10.423346] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-24T20:21:10.429024] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T20:21:11.216078] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-24T20:21:11.477752] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T20:21:11.491842] [INFO ] [REMOTE ] NOK: Full fetch complete (77634 records). [2025-09-24T20:21:11.492075] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-24T20:21:11.934673] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-24T20:21:11.934887] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-24T20:21:11.936681] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-24T20:21:11.936836] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-24T20:21:11.938557] [DEBUG] [LOCAL ] NOK: Trimmed 77634 records to 53620 (keeping 200 days of data) [2025-09-24T20:21:12.029474] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-24T20:21:12.297322] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T20:21:12.329619] [DEBUG] [LOCAL ] NOK: Primary data saved (53620 records). [2025-09-24T20:21:12.329812] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-24T20:21:12.329913] [INFO ] [MAIN ] Update Progress: 1515/2373 symbols completed. NOK took 39.6s. Estimated remaining: 1h 53m 55s. Rate: 7.5 symbols/min [2025-09-24T20:21:12.505120] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:12.505326] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-24T20:21:12.505363] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-24T20:21:12.505511] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-24T20:21:12.505554] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-24T20:21:12.505595] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-24T20:21:12.505630] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-24T20:21:12.826751] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-24T20:21:12.868063] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:13.616207] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-24T20:21:13.732807] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-24T20:21:14.416244] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-24T20:21:14.849263] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-24T20:21:15.216102] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-24T20:21:15.459206] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-24T20:21:16.016101] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-24T20:21:16.061429] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T20:21:16.277281] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-24T20:21:16.769777] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T20:21:16.816131] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-24T20:21:17.495752] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T20:21:17.616137] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-24T20:21:18.416129] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-24T20:21:18.493134] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T20:21:19.216107] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-24T20:21:19.344257] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:21:20.016130] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-24T20:21:20.349901] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T20:21:20.794615] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T20:21:20.816057] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-24T20:21:21.616132] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-24T20:21:21.925389] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T20:21:22.329518] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:21:22.416119] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-24T20:21:23.216231] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-24T20:21:23.510950] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T20:21:23.578217] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T20:21:24.016110] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-24T20:21:24.816138] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-24T20:21:24.938715] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T20:21:25.575207] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T20:21:25.583522] [INFO ] [REMOTE ] NOMD: Full fetch complete (58872 records). [2025-09-24T20:21:25.583719] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-24T20:21:25.621237] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-24T20:21:26.002250] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-24T20:21:26.002374] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-24T20:21:26.003670] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-24T20:21:26.003743] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-24T20:21:26.005566] [DEBUG] [LOCAL ] NOMD: Trimmed 58872 records to 41326 (keeping 200 days of data) [2025-09-24T20:21:26.283286] [DEBUG] [LOCAL ] NOMD: Primary data saved (41326 records). [2025-09-24T20:21:26.283483] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-24T20:21:26.283603] [INFO ] [MAIN ] Update Progress: 1516/2373 symbols completed. NOMD took 24.5s. Estimated remaining: 1h 53m 50s. Rate: 7.5 symbols/min [2025-09-24T20:21:26.421231] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-24T20:21:26.491855] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:26.492265] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-24T20:21:26.492339] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-24T20:21:26.492610] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-24T20:21:26.492694] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-24T20:21:26.492756] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-24T20:21:26.492793] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-24T20:21:26.881728] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:26.918899] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T20:21:27.216138] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-24T20:21:27.766358] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T20:21:28.016173] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-24T20:21:28.683795] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-24T20:21:28.823552] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-24T20:21:28.830810] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T20:21:29.103346] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:21:29.103866] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-24T20:21:29.590324] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T20:21:29.616103] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-24T20:21:30.416128] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-24T20:21:30.782115] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:21:30.782497] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-24T20:21:31.216111] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-24T20:21:31.851774] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-24T20:21:32.016141] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-24T20:21:32.628056] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T20:21:32.634921] [INFO ] [REMOTE ] NOTE: Full fetch complete (64460 records). [2025-09-24T20:21:32.635125] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-24T20:21:32.837902] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-24T20:21:33.064397] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-24T20:21:33.064489] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-24T20:21:33.065681] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-24T20:21:33.065748] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-24T20:21:33.067099] [DEBUG] [LOCAL ] NOTE: Trimmed 64460 records to 42812 (keeping 200 days of data) [2025-09-24T20:21:33.322479] [DEBUG] [LOCAL ] NOTE: Primary data saved (42812 records). [2025-09-24T20:21:33.322628] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-24T20:21:33.322767] [INFO ] [MAIN ] Update Progress: 1517/2373 symbols completed. NOTE took 28.3s. Estimated remaining: 1h 53m 42s. Rate: 7.5 symbols/min [2025-09-24T20:21:33.533038] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T20:21:33.616060] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-24T20:21:33.777544] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T20:21:34.416134] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-24T20:21:35.216062] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-24T20:21:35.434632] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T20:21:36.016046] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-24T20:21:36.268224] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T20:21:36.795833] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T20:21:36.816032] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-24T20:21:37.616101] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-24T20:21:37.863837] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T20:21:38.416196] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-24T20:21:38.542995] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T20:21:39.125595] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-24T20:21:39.216197] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-24T20:21:40.016234] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-24T20:21:40.050788] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T20:21:40.187257] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T20:21:40.198826] [INFO ] [REMOTE ] NOV: Full fetch complete (76987 records). [2025-09-24T20:21:40.199117] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-24T20:21:40.635876] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-24T20:21:40.636034] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-24T20:21:40.637417] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-24T20:21:40.637484] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-24T20:21:40.639453] [DEBUG] [LOCAL ] NOV: Trimmed 76987 records to 53183 (keeping 200 days of data) [2025-09-24T20:21:40.827367] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-24T20:21:40.994810] [DEBUG] [LOCAL ] NOV: Primary data saved (53183 records). [2025-09-24T20:21:40.994978] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-24T20:21:40.995073] [INFO ] [MAIN ] Update Progress: 1518/2373 symbols completed. NOV took 32.4s. Estimated remaining: 1h 53m 34s. Rate: 7.5 symbols/min [2025-09-24T20:21:41.750692] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T20:21:41.754890] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-24T20:21:41.967749] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T20:21:42.416082] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-24T20:21:42.802377] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T20:21:43.216106] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-24T20:21:44.247833] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T20:21:44.252507] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-24T20:21:44.633480] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T20:21:44.816116] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-24T20:21:45.330511] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T20:21:45.334244] [INFO ] [REMOTE ] NPB: Full fetch complete (16232 records). [2025-09-24T20:21:45.334343] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-24T20:21:45.544432] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-24T20:21:45.544892] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:21:45.544969] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:21:45.545021] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-24T20:21:45.545086] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-24T20:21:45.545124] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-24T20:21:45.545181] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-24T20:21:45.545269] [INFO ] [MAIN ] Update Progress: 1519/2373 symbols completed. NPB took 19.3s. Estimated remaining: 1h 53m 24s. Rate: 7.5 symbols/min [2025-09-24T20:21:47.063214] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T20:21:47.075175] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-24T20:21:47.888355] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T20:21:47.896527] [INFO ] [REMOTE ] NOW: Full fetch complete (70428 records). [2025-09-24T20:21:47.896691] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-24T20:21:47.897521] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:21:47.897610] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:21:47.897695] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:21:47.897748] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-24T20:21:47.897834] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-24T20:21:47.897892] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-24T20:21:47.897938] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-24T20:21:47.898014] [INFO ] [MAIN ] Update Progress: 1520/2373 symbols completed. NOW took 35.6s. Estimated remaining: 1h 53m 13s. Rate: 7.5 symbols/min [2025-09-24T20:21:48.410855] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:48.658538] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:48.654050] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:48.680338] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:21:48.681077] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-24T20:21:48.681189] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-24T20:21:48.681952] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-24T20:21:48.682000] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-24T20:21:48.682045] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-24T20:21:48.682081] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-24T20:21:48.794303] [DEBUG] [LOCAL ] NPFD: Loaded 9670 existing records from primary storage. [2025-09-24T20:21:48.800584] [INFO ] [MAIN ] NPFD: Loaded 9670 existing records. [2025-09-24T20:21:48.795363] [DEBUG] [LOCAL ] NPK: Loaded 8076 existing records from primary storage. [2025-09-24T20:21:48.800923] [INFO ] [MAIN ] NPK: Loaded 8076 existing records. [2025-09-24T20:21:48.794906] [DEBUG] [LOCAL ] NPCT: Loaded 16832 existing records from primary storage. [2025-09-24T20:21:48.857616] [INFO ] [MAIN ] NPCT: Loaded 16832 existing records. [2025-09-24T20:21:49.576962] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:49.645503] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:49.691047] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-24T20:21:49.704690] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-24T20:21:49.708893] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-24T20:21:49.711530] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-24T20:21:49.710875] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:49.734153] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:21:49.734569] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-24T20:21:49.734718] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-24T20:21:49.735847] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-24T20:21:49.735981] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-24T20:21:49.736107] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-24T20:21:49.746766] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-24T20:21:49.761030] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-24T20:21:49.823440] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-24T20:21:49.843470] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-24T20:21:50.850320] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:50.890490] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-24T20:21:50.897830] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:50.898189] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-24T20:21:50.991005] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:21:50.992024] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T20:21:50.992374] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-24T20:21:50.996130] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-24T20:21:51.895688] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T20:21:51.899842] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-24T20:21:51.927526] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T20:21:51.930073] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-24T20:21:52.051751] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:21:52.057067] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-24T20:21:52.391277] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T20:21:52.470242] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T20:21:52.616690] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T20:21:52.816070] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-24T20:21:53.191054] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T20:21:53.616082] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-24T20:21:53.696204] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T20:21:54.416079] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-24T20:21:54.477022] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:21:55.216076] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-24T20:21:55.697985] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T20:21:55.899801] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T20:21:56.016109] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-24T20:21:56.816092] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-24T20:21:57.547960] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T20:21:57.616343] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-24T20:21:58.074497] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T20:21:58.416089] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-24T20:21:59.165231] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T20:21:59.216095] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-24T20:21:59.261504] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T20:22:00.016132] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-24T20:22:00.787709] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T20:22:00.816058] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-24T20:22:01.041533] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T20:22:01.616101] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-24T20:22:02.416088] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-24T20:22:02.476709] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T20:22:02.499663] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T20:22:03.216020] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-24T20:22:03.224560] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T20:22:04.016214] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-24T20:22:04.722361] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:22:04.816098] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-24T20:22:04.882024] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T20:22:05.387253] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T20:22:05.616095] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-24T20:22:06.416167] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-24T20:22:06.500236] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T20:22:07.216126] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-24T20:22:07.667871] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T20:22:07.989731] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T20:22:08.016032] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-24T20:22:08.816124] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-24T20:22:08.940056] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T20:22:09.616073] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-24T20:22:09.698584] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T20:22:10.416123] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-24T20:22:11.158116] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T20:22:11.216075] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-24T20:22:11.410136] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T20:22:12.016205] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-24T20:22:12.673524] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T20:22:12.680335] [INFO ] [REMOTE ] NPKI: Full fetch complete (53054 records). [2025-09-24T20:22:12.680483] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-24T20:22:12.827526] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-24T20:22:12.886305] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-24T20:22:12.888205] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:22:12.896900] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T20:22:12.896529] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:22:12.900192] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-24T20:22:12.900842] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-24T20:22:12.900904] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-24T20:22:12.900974] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-24T20:22:12.901078] [INFO ] [MAIN ] Update Progress: 1521/2373 symbols completed. NPKI took 25.0s. Estimated remaining: 1h 53m 14s. Rate: 7.5 symbols/min [2025-09-24T20:22:13.076468] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:13.092741] [DEBUG] [LOCAL ] NPO: Loaded 12839 existing records from primary storage. [2025-09-24T20:22:13.092903] [INFO ] [MAIN ] NPO: Loaded 12839 existing records. [2025-09-24T20:22:13.274754] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:13.275033] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-24T20:22:13.275083] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-24T20:22:13.275765] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-24T20:22:13.275827] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-24T20:22:13.617739] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-24T20:22:13.659916] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:14.055805] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T20:22:14.378351] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T20:22:14.380069] [INFO ] [REMOTE ] NPK: Full fetch complete (10888 records). [2025-09-24T20:22:14.380174] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-24T20:22:14.421249] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-24T20:22:14.786225] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-24T20:22:14.786329] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-24T20:22:14.786665] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-24T20:22:14.786749] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-24T20:22:14.787499] [DEBUG] [LOCAL ] NPK: Trimmed 10888 records to 8028 (keeping 200 days of data) [2025-09-24T20:22:14.847700] [DEBUG] [LOCAL ] NPK: Primary data saved (8028 records). [2025-09-24T20:22:14.848062] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-24T20:22:14.848445] [INFO ] [MAIN ] Update Progress: 1522/2373 symbols completed. NPK took 26.9s. Estimated remaining: 1h 53m 3s. Rate: 7.5 symbols/min [2025-09-24T20:22:15.039054] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:15.049153] [DEBUG] [LOCAL ] NPV: Loaded 5013 existing records from primary storage. [2025-09-24T20:22:15.049293] [INFO ] [MAIN ] NPV: Loaded 5013 existing records. [2025-09-24T20:22:15.231479] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-24T20:22:15.237826] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:15.239536] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-24T20:22:15.239663] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-24T20:22:15.240017] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-24T20:22:15.240078] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-24T20:22:15.643004] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:15.872191] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:22:16.016109] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-24T20:22:16.151177] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T20:22:16.816059] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-24T20:22:17.043535] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T20:22:17.616129] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-24T20:22:17.715714] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T20:22:17.718883] [INFO ] [REMOTE ] NPFD: Full fetch complete (14768 records). [2025-09-24T20:22:17.719013] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-24T20:22:18.148902] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-24T20:22:18.149096] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-24T20:22:18.149556] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-24T20:22:18.149670] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-24T20:22:18.151023] [DEBUG] [LOCAL ] NPFD: Trimmed 14768 records to 9643 (keeping 200 days of data) [2025-09-24T20:22:18.229411] [DEBUG] [LOCAL ] NPFD: Primary data saved (9643 records). [2025-09-24T20:22:18.229846] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-24T20:22:18.230136] [INFO ] [MAIN ] Update Progress: 1523/2373 symbols completed. NPFD took 30.3s. Estimated remaining: 1h 52m 52s. Rate: 7.5 symbols/min [2025-09-24T20:22:18.425949] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-24T20:22:18.435564] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:22:18.437446] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:18.503773] [DEBUG] [LOCAL ] NPWR: Loaded 43187 existing records from primary storage. [2025-09-24T20:22:18.503993] [INFO ] [MAIN ] NPWR: Loaded 43187 existing records. [2025-09-24T20:22:18.706466] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:18.706785] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-24T20:22:18.706841] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-24T20:22:18.708315] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-24T20:22:18.708404] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-24T20:22:19.067140] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:19.216051] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-24T20:22:19.416590] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T20:22:20.016106] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-24T20:22:20.735113] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T20:22:20.753343] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T20:22:20.756944] [INFO ] [REMOTE ] NPCT: Full fetch complete (25143 records). [2025-09-24T20:22:20.757042] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-24T20:22:20.821773] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-24T20:22:21.148566] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-24T20:22:21.148692] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-24T20:22:21.149351] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-24T20:22:21.149398] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-24T20:22:21.150498] [DEBUG] [LOCAL ] NPCT: Trimmed 25143 records to 16797 (keeping 200 days of data) [2025-09-24T20:22:21.275779] [DEBUG] [LOCAL ] NPCT: Primary data saved (16797 records). [2025-09-24T20:22:21.275948] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-24T20:22:21.276083] [INFO ] [MAIN ] Update Progress: 1524/2373 symbols completed. NPCT took 33.4s. Estimated remaining: 1h 52m 42s. Rate: 7.5 symbols/min [2025-09-24T20:22:21.486753] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:21.508210] [DEBUG] [LOCAL ] NQP: Loaded 9312 existing records from primary storage. [2025-09-24T20:22:21.508391] [INFO ] [MAIN ] NQP: Loaded 9312 existing records. [2025-09-24T20:22:21.621443] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-24T20:22:21.718668] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:21.719195] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-24T20:22:21.719315] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-24T20:22:21.719841] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-24T20:22:21.719906] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-24T20:22:22.001592] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T20:22:22.140836] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:22.262754] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T20:22:22.416114] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-24T20:22:23.087768] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T20:22:23.216217] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-24T20:22:23.883213] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T20:22:24.016105] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-24T20:22:24.646069] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T20:22:24.816141] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-24T20:22:25.530147] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T20:22:25.616121] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-24T20:22:26.281931] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T20:22:26.416120] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-24T20:22:27.216093] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-24T20:22:27.355666] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T20:22:28.008572] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T20:22:28.016023] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-24T20:22:28.794119] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T20:22:28.816065] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-24T20:22:29.603262] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T20:22:29.616108] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-24T20:22:30.420517] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-24T20:22:31.069532] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T20:22:31.216042] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-24T20:22:31.675944] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T20:22:32.016091] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-24T20:22:32.434902] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T20:22:32.616907] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T20:22:32.816114] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-24T20:22:33.609615] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T20:22:33.616023] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-24T20:22:34.416073] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-24T20:22:34.431518] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T20:22:35.079402] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T20:22:35.216039] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-24T20:22:35.973283] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T20:22:36.016106] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-24T20:22:36.816088] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-24T20:22:36.887079] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T20:22:37.557916] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T20:22:37.616176] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-24T20:22:38.416102] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-24T20:22:38.520030] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T20:22:39.166005] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:22:39.169507] [INFO ] [REMOTE ] NPV: Full fetch complete (6868 records). [2025-09-24T20:22:39.169664] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-24T20:22:39.226070] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-24T20:22:39.590551] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-24T20:22:39.590671] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-24T20:22:39.590930] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-24T20:22:39.590973] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-24T20:22:39.591437] [DEBUG] [LOCAL ] NPV: Trimmed 6868 records to 5018 (keeping 200 days of data) [2025-09-24T20:22:39.631781] [DEBUG] [LOCAL ] NPV: Primary data saved (5018 records). [2025-09-24T20:22:39.631916] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-24T20:22:39.632069] [INFO ] [MAIN ] Update Progress: 1525/2373 symbols completed. NPV took 24.8s. Estimated remaining: 1h 52m 40s. Rate: 7.5 symbols/min [2025-09-24T20:22:39.804245] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:39.864122] [DEBUG] [LOCAL ] NRDY: Loaded 33119 existing records from primary storage. [2025-09-24T20:22:39.864266] [INFO ] [MAIN ] NRDY: Loaded 33119 existing records. [2025-09-24T20:22:40.021237] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-24T20:22:40.057025] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:40.057375] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-24T20:22:40.057463] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-24T20:22:40.059466] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-24T20:22:40.059573] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-24T20:22:40.420206] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:40.816049] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-24T20:22:40.916130] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:22:41.142898] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T20:22:41.616125] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-24T20:22:41.664603] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T20:22:42.416101] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-24T20:22:43.216098] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-24T20:22:43.307839] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T20:22:43.361115] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T20:22:43.365148] [INFO ] [REMOTE ] NPO: Full fetch complete (18034 records). [2025-09-24T20:22:43.365341] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-24T20:22:43.803937] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-24T20:22:43.804024] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-24T20:22:43.804759] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-24T20:22:43.804825] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-24T20:22:43.805979] [DEBUG] [LOCAL ] NPO: Trimmed 18034 records to 12821 (keeping 200 days of data) [2025-09-24T20:22:43.925785] [DEBUG] [LOCAL ] NPO: Primary data saved (12821 records). [2025-09-24T20:22:43.925988] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-24T20:22:43.926123] [INFO ] [MAIN ] Update Progress: 1526/2373 symbols completed. NPO took 31.0s. Estimated remaining: 1h 52m 29s. Rate: 7.5 symbols/min [2025-09-24T20:22:44.021300] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-24T20:22:44.113181] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:22:44.123928] [DEBUG] [LOCAL ] NREF: Loaded 7864 existing records from primary storage. [2025-09-24T20:22:44.124059] [INFO ] [MAIN ] NREF: Loaded 7864 existing records. [2025-09-24T20:22:44.316042] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:22:44.316339] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-24T20:22:44.316393] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-24T20:22:44.316920] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-24T20:22:44.316986] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-24T20:22:44.698415] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:22:44.816105] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-24T20:22:45.070996] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T20:22:45.616082] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-24T20:22:45.679443] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:22:45.708172] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T20:22:46.416095] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-24T20:22:47.216092] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-24T20:22:47.294929] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:22:47.500031] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T20:22:48.016131] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-24T20:22:48.772137] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:22:48.816057] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-24T20:22:48.860550] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T20:22:49.616205] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-24T20:22:50.416115] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-24T20:22:50.461881] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T20:22:51.152260] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T20:22:51.216104] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-24T20:22:51.282450] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:22:52.016114] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-24T20:22:52.816123] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-24T20:22:53.616131] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-24T20:23:05.059984] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (13.84 seconds). [2025-09-24T20:23:05.061858] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-24T20:23:05.103797] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (11.49 seconds). [2025-09-24T20:23:05.112903] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-24T20:23:05.552606] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (13.54 seconds). [2025-09-24T20:23:05.561684] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-24T20:23:06.059217] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T20:23:06.061635] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-24T20:23:06.127200] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (13.31 seconds). [2025-09-24T20:23:06.130489] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-24T20:23:06.805238] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:23:06.812723] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-24T20:23:06.957777] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:23:06.960270] [INFO ] [REMOTE ] NQP: Full fetch complete (13503 records). [2025-09-24T20:23:06.960365] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-24T20:23:07.252826] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T20:23:07.275811] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-24T20:23:07.375113] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-24T20:23:07.375215] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-24T20:23:07.375610] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-24T20:23:07.375691] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-24T20:23:07.380466] [DEBUG] [LOCAL ] NQP: Trimmed 13503 records to 9317 (keeping 200 days of data) [2025-09-24T20:23:07.447886] [DEBUG] [LOCAL ] NQP: Primary data saved (9317 records). [2025-09-24T20:23:07.448102] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-24T20:23:07.448273] [INFO ] [MAIN ] Update Progress: 1527/2373 symbols completed. NQP took 46.2s. Estimated remaining: 1h 52m 30s. Rate: 7.5 symbols/min [2025-09-24T20:23:07.646410] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:07.646612] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-24T20:23:07.646722] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-24T20:23:07.646888] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-24T20:23:07.646932] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-24T20:23:07.646974] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-24T20:23:07.647008] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-24T20:23:08.067701] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T20:23:08.067206] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:08.068384] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-24T20:23:08.072079] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-24T20:23:08.075994] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-24T20:23:08.099994] [INFO ] [REMOTE ] NPWR: Full fetch complete (59063 records). [2025-09-24T20:23:08.110919] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-24T20:23:08.114833] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T20:23:08.234758] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-24T20:23:08.542617] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-24T20:23:08.542757] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-24T20:23:08.543808] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-24T20:23:08.543880] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-24T20:23:08.545567] [DEBUG] [LOCAL ] NPWR: Trimmed 59063 records to 43218 (keeping 200 days of data) [2025-09-24T20:23:08.861249] [DEBUG] [LOCAL ] NPWR: Primary data saved (43218 records). [2025-09-24T20:23:08.861418] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-24T20:23:08.861533] [INFO ] [MAIN ] Update Progress: 1528/2373 symbols completed. NPWR took 50.6s. Estimated remaining: 1h 52m 19s. Rate: 7.5 symbols/min [2025-09-24T20:23:09.038088] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:09.045971] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:23:09.049317] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-24T20:23:09.090636] [DEBUG] [LOCAL ] NRGV: Loaded 42910 existing records from primary storage. [2025-09-24T20:23:09.090821] [INFO ] [MAIN ] NRGV: Loaded 42910 existing records. [2025-09-24T20:23:09.283357] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:09.283665] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-24T20:23:09.283732] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-24T20:23:09.285289] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-24T20:23:09.285355] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-24T20:23:09.730913] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:09.731256] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-24T20:23:09.832543] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T20:23:09.840677] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-24T20:23:10.024591] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-24T20:23:10.027000] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T20:23:10.041390] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-24T20:23:10.042146] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-24T20:23:10.989472] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T20:23:10.991877] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-24T20:23:11.218583] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:23:11.227172] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-24T20:23:11.311993] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T20:23:11.322133] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-24T20:23:11.560745] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T20:23:11.562944] [INFO ] [REMOTE ] NREF: Full fetch complete (10849 records). [2025-09-24T20:23:11.563017] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-24T20:23:11.992537] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-24T20:23:11.992855] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-24T20:23:11.993584] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-24T20:23:11.993819] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-24T20:23:11.995470] [DEBUG] [LOCAL ] NREF: Trimmed 10849 records to 7845 (keeping 200 days of data) [2025-09-24T20:23:12.053445] [DEBUG] [LOCAL ] NREF: Primary data saved (7845 records). [2025-09-24T20:23:12.053590] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-24T20:23:12.053717] [INFO ] [MAIN ] Update Progress: 1529/2373 symbols completed. NREF took 28.1s. Estimated remaining: 1h 52m 8s. Rate: 7.5 symbols/min [2025-09-24T20:23:12.276348] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:12.310705] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-24T20:23:12.322004] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-24T20:23:12.343329] [DEBUG] [LOCAL ] NRK: Loaded 19632 existing records from primary storage. [2025-09-24T20:23:12.343472] [INFO ] [MAIN ] NRK: Loaded 19632 existing records. [2025-09-24T20:23:12.576293] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:12.576863] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-24T20:23:12.577073] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-24T20:23:12.601486] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-24T20:23:12.601977] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-24T20:23:12.609359] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T20:23:12.680563] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-24T20:23:13.041368] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:13.042019] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-24T20:23:13.086619] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T20:23:13.100703] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-24T20:23:13.903480] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T20:23:13.909522] [INFO ] [REMOTE ] NRDY: Full fetch complete (52358 records). [2025-09-24T20:23:13.909666] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-24T20:23:14.335539] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-24T20:23:14.335774] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-24T20:23:14.337781] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-24T20:23:14.338272] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-24T20:23:14.372078] [DEBUG] [LOCAL ] NRDY: Trimmed 52358 records to 33011 (keeping 200 days of data) [2025-09-24T20:23:14.403873] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T20:23:14.409905] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T20:23:14.415525] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-24T20:23:14.476974] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-24T20:23:14.524891] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-24T20:23:14.554706] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-24T20:23:14.712146] [DEBUG] [LOCAL ] NRDY: Primary data saved (33011 records). [2025-09-24T20:23:14.712340] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-24T20:23:14.712515] [INFO ] [MAIN ] Update Progress: 1530/2373 symbols completed. NRDY took 35.1s. Estimated remaining: 1h 51m 57s. Rate: 7.5 symbols/min [2025-09-24T20:23:14.911671] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:14.919403] [DEBUG] [LOCAL ] NRP: Loaded 4099 existing records from primary storage. [2025-09-24T20:23:14.919552] [INFO ] [MAIN ] NRP: Loaded 4099 existing records. [2025-09-24T20:23:15.110677] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:15.110982] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-24T20:23:15.111034] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-24T20:23:15.111324] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-24T20:23:15.111385] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-24T20:23:15.523242] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:15.523629] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-24T20:23:15.622819] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T20:23:15.626995] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-24T20:23:16.012557] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-24T20:23:16.016027] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-24T20:23:16.382269] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T20:23:16.427869] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T20:23:16.515917] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T20:23:16.577733] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T20:23:16.816309] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-24T20:23:17.616350] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-24T20:23:18.370298] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T20:23:18.416129] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-24T20:23:18.696533] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T20:23:19.062388] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-24T20:23:19.216132] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-24T20:23:20.016207] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-24T20:23:20.816136] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-24T20:23:21.165936] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T20:23:21.251059] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T20:23:21.616174] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-24T20:23:22.416114] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-24T20:23:22.570162] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T20:23:22.745627] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:23:22.892807] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-24T20:23:23.216188] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-24T20:23:24.016140] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-24T20:23:24.816090] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-24T20:23:25.232886] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-24T20:23:25.563950] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T20:23:25.595402] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T20:23:25.616037] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-24T20:23:26.416099] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-24T20:23:27.183676] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T20:23:27.211676] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T20:23:27.220029] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-24T20:23:28.016117] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-24T20:23:28.642769] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T20:23:28.816097] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-24T20:23:29.477278] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-24T20:23:29.616104] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-24T20:23:30.192534] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T20:23:30.406584] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T20:23:30.416027] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-24T20:23:31.216091] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-24T20:23:32.016115] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-24T20:23:32.235466] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T20:23:32.641021] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T20:23:32.642366] [INFO ] [REMOTE ] NRP: Full fetch complete (6530 records). [2025-09-24T20:23:32.642436] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-24T20:23:32.829056] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-24T20:23:33.026381] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-24T20:23:33.026510] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-24T20:23:33.026865] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-24T20:23:33.026945] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-24T20:23:33.027789] [DEBUG] [LOCAL ] NRP: Trimmed 6530 records to 4082 (keeping 200 days of data) [2025-09-24T20:23:33.054918] [DEBUG] [LOCAL ] NRP: Primary data saved (4082 records). [2025-09-24T20:23:33.055135] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-24T20:23:33.055266] [INFO ] [MAIN ] Update Progress: 1531/2373 symbols completed. NRP took 18.3s. Estimated remaining: 1h 51m 55s. Rate: 7.5 symbols/min [2025-09-24T20:23:33.232828] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T20:23:33.278392] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:33.285466] [DEBUG] [LOCAL ] NRT: Loaded 4858 existing records from primary storage. [2025-09-24T20:23:33.285588] [INFO ] [MAIN ] NRT: Loaded 4858 existing records. [2025-09-24T20:23:33.466821] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:33.467093] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-24T20:23:33.467144] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-24T20:23:33.467419] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-24T20:23:33.467479] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-24T20:23:33.624993] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-24T20:23:33.844358] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T20:23:33.880953] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:34.416067] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-24T20:23:34.464014] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:23:34.473890] [INFO ] [REMOTE ] NRG: Full fetch complete (76174 records). [2025-09-24T20:23:34.474030] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-24T20:23:34.475044] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:23:34.475146] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:23:34.475191] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:23:34.475267] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-24T20:23:34.475351] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-24T20:23:34.475422] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-24T20:23:34.475498] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-24T20:23:34.475588] [INFO ] [MAIN ] Update Progress: 1532/2373 symbols completed. NRG took 27.0s. Estimated remaining: 1h 51m 43s. Rate: 7.5 symbols/min [2025-09-24T20:23:34.655738] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:34.662570] [DEBUG] [LOCAL ] NRUC: Loaded 3074 existing records from primary storage. [2025-09-24T20:23:34.662697] [INFO ] [MAIN ] NRUC: Loaded 3074 existing records. [2025-09-24T20:23:34.844553] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:34.844829] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-24T20:23:34.844885] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-24T20:23:34.845160] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-24T20:23:34.845223] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-24T20:23:35.225964] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-24T20:23:35.238421] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:35.246569] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T20:23:36.016083] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-24T20:23:36.816097] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-24T20:23:36.831148] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:23:37.020815] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T20:23:37.029707] [INFO ] [REMOTE ] NRGV: Full fetch complete (61802 records). [2025-09-24T20:23:37.029827] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-24T20:23:37.418863] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-24T20:23:37.418952] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-24T20:23:37.420109] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-24T20:23:37.420177] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-24T20:23:37.421572] [DEBUG] [LOCAL ] NRGV: Trimmed 61802 records to 42987 (keeping 200 days of data) [2025-09-24T20:23:37.622471] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-24T20:23:37.679614] [DEBUG] [LOCAL ] NRGV: Primary data saved (42987 records). [2025-09-24T20:23:37.679798] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-24T20:23:37.679900] [INFO ] [MAIN ] Update Progress: 1533/2373 symbols completed. NRGV took 28.8s. Estimated remaining: 1h 51m 33s. Rate: 7.5 symbols/min [2025-09-24T20:23:37.878680] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:37.879605] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-09-24T20:23:37.880133] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T20:23:37.879706] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-09-24T20:23:37.884889] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-24T20:23:37.885283] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-24T20:23:37.885352] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-09-24T20:23:37.885388] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-24T20:23:38.243908] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:38.302292] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T20:23:38.416117] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-24T20:23:39.216099] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-24T20:23:39.956371] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:23:40.016088] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-24T20:23:40.405673] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T20:23:40.816103] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-24T20:23:41.519555] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T20:23:41.550823] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T20:23:41.616096] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-24T20:23:42.416101] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-24T20:23:43.000599] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T20:23:43.103519] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T20:23:43.216082] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-24T20:23:44.016129] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-24T20:23:44.541996] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T20:23:44.816101] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-24T20:23:45.596809] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:23:45.616057] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-24T20:23:46.017310] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T20:23:46.022201] [INFO ] [REMOTE ] NRK: Full fetch complete (27721 records). [2025-09-24T20:23:46.022377] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-24T20:23:46.408095] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T20:23:46.417843] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-24T20:23:46.671740] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-24T20:23:46.671893] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-24T20:23:46.673795] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-24T20:23:46.673905] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-24T20:23:46.675983] [DEBUG] [LOCAL ] NRK: Trimmed 27721 records to 19685 (keeping 200 days of data) [2025-09-24T20:23:46.881308] [DEBUG] [LOCAL ] NRK: Primary data saved (19685 records). [2025-09-24T20:23:46.881520] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-24T20:23:46.881680] [INFO ] [MAIN ] Update Progress: 1534/2373 symbols completed. NRK took 34.8s. Estimated remaining: 1h 51m 25s. Rate: 7.5 symbols/min [2025-09-24T20:23:47.152611] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:47.152894] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-24T20:23:47.152956] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-24T20:23:47.153145] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-24T20:23:47.153196] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-24T20:23:47.153245] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-24T20:23:47.153283] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-24T20:23:47.221499] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-24T20:23:47.569752] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:48.016096] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-24T20:23:48.150001] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T20:23:48.185457] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T20:23:48.816109] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-24T20:23:49.239441] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-24T20:23:49.616084] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-24T20:23:49.833992] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T20:23:50.266741] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T20:23:50.416104] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-24T20:23:51.050071] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T20:23:51.216127] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-24T20:23:52.016089] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-24T20:23:52.644130] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T20:23:52.816068] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-24T20:23:52.861563] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T20:23:53.523813] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:23:53.525430] [INFO ] [REMOTE ] NRT: Full fetch complete (8076 records). [2025-09-24T20:23:53.525515] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-24T20:23:53.621180] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-24T20:23:53.911676] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-24T20:23:53.911832] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-24T20:23:53.912109] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-24T20:23:53.912153] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-24T20:23:53.912576] [DEBUG] [LOCAL ] NRT: Trimmed 8076 records to 4882 (keeping 200 days of data) [2025-09-24T20:23:53.945435] [DEBUG] [LOCAL ] NRT: Primary data saved (4882 records). [2025-09-24T20:23:53.945665] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-24T20:23:53.945793] [INFO ] [MAIN ] Update Progress: 1535/2373 symbols completed. NRT took 20.9s. Estimated remaining: 1h 51m 17s. Rate: 7.5 symbols/min [2025-09-24T20:23:54.115951] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:23:54.151993] [DEBUG] [LOCAL ] NSP: Loaded 34921 existing records from primary storage. [2025-09-24T20:23:54.152143] [INFO ] [MAIN ] NSP: Loaded 34921 existing records. [2025-09-24T20:23:54.334104] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:23:54.340874] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-24T20:23:54.341057] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T20:23:54.343270] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-24T20:23:54.344575] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-24T20:23:54.344685] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-24T20:23:54.421218] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-24T20:23:54.706297] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:23:55.155968] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:23:55.216108] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-24T20:23:56.016110] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-24T20:23:56.682666] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:23:56.816133] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-24T20:23:57.616109] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-24T20:23:57.750432] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T20:23:58.248423] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T20:23:58.416075] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-24T20:23:58.521383] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T20:23:59.216115] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-24T20:23:59.954423] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T20:24:00.016061] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-24T20:24:00.410026] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T20:24:00.816128] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-24T20:24:01.010172] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T20:24:01.616178] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-24T20:24:02.416137] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-24T20:24:03.216163] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-24T20:24:03.723703] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-24T20:24:04.016113] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-24T20:24:04.225525] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-24T20:24:04.412464] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T20:24:04.791320] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-24T20:24:04.816078] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-24T20:24:05.590485] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T20:24:05.616045] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-24T20:24:06.176125] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T20:24:06.416084] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-24T20:24:06.448257] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T20:24:07.186925] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T20:24:07.216104] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-24T20:24:07.662090] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T20:24:07.663310] [INFO ] [REMOTE ] NRUC: Full fetch complete (5573 records). [2025-09-24T20:24:07.663402] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-24T20:24:08.021249] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-24T20:24:08.064618] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-24T20:24:08.064744] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-24T20:24:08.064988] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-24T20:24:08.065064] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-24T20:24:08.065521] [DEBUG] [LOCAL ] NRUC: Trimmed 5573 records to 3096 (keeping 200 days of data) [2025-09-24T20:24:08.088696] [DEBUG] [LOCAL ] NRUC: Primary data saved (3096 records). [2025-09-24T20:24:08.088841] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-24T20:24:08.088975] [INFO ] [MAIN ] Update Progress: 1536/2373 symbols completed. NRUC took 33.6s. Estimated remaining: 1h 51m 12s. Rate: 7.5 symbols/min [2025-09-24T20:24:08.315606] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:08.343708] [DEBUG] [LOCAL ] NTB: Loaded 20685 existing records from primary storage. [2025-09-24T20:24:08.343862] [INFO ] [MAIN ] NTB: Loaded 20685 existing records. [2025-09-24T20:24:08.550041] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:24:08.550309] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-24T20:24:08.550361] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-24T20:24:08.551928] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-24T20:24:08.551994] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-24T20:24:08.821256] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-24T20:24:08.920798] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:09.616094] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-24T20:24:09.861867] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T20:24:10.416062] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-24T20:24:10.440135] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T20:24:10.508352] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T20:24:11.216109] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-24T20:24:12.016079] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-24T20:24:12.065916] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T20:24:12.564827] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T20:24:12.816180] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-24T20:24:13.616182] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-24T20:24:14.416079] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-24T20:24:14.504353] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-24T20:24:14.893772] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T20:24:15.216110] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-24T20:24:15.444574] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T20:24:15.876755] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T20:24:15.888095] [INFO ] [REMOTE ] NSA: Full fetch complete (61773 records). [2025-09-24T20:24:15.888344] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-24T20:24:16.021384] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-24T20:24:16.337261] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-24T20:24:16.337418] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-24T20:24:16.339408] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-24T20:24:16.339497] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-24T20:24:16.341259] [DEBUG] [LOCAL ] NSA: Trimmed 61773 records to 44875 (keeping 200 days of data) [2025-09-24T20:24:16.633337] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T20:24:16.680745] [DEBUG] [LOCAL ] NSA: Primary data saved (44875 records). [2025-09-24T20:24:16.680912] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-24T20:24:16.681001] [INFO ] [MAIN ] Update Progress: 1537/2373 symbols completed. NSA took 39.0s. Estimated remaining: 1h 51m 5s. Rate: 7.5 symbols/min [2025-09-24T20:24:16.822707] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-24T20:24:16.858606] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:16.858857] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-24T20:24:16.858913] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-24T20:24:16.859065] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-24T20:24:16.859121] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-24T20:24:16.859190] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-24T20:24:16.859227] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-24T20:24:17.241426] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:17.360868] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T20:24:17.616175] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-24T20:24:18.179457] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T20:24:18.416130] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-24T20:24:18.964786] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-24T20:24:19.118559] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T20:24:19.216069] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-24T20:24:20.016125] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-24T20:24:20.781062] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T20:24:20.816077] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-24T20:24:21.606050] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T20:24:21.616496] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-24T20:24:22.416056] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-24T20:24:22.456879] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T20:24:22.507904] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:24:23.021146] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T20:24:23.216216] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-24T20:24:24.016130] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-24T20:24:24.816115] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-24T20:24:25.616081] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-24T20:24:25.726317] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T20:24:25.736534] [INFO ] [REMOTE ] NSC: Full fetch complete (70604 records). [2025-09-24T20:24:25.736786] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-24T20:24:25.737830] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:24:25.737966] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:24:25.738038] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:24:25.738117] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-24T20:24:25.738241] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-24T20:24:25.738302] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-24T20:24:25.738368] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-24T20:24:25.738510] [INFO ] [MAIN ] Update Progress: 1538/2373 symbols completed. NSC took 38.9s. Estimated remaining: 1h 50m 57s. Rate: 7.5 symbols/min [2025-09-24T20:24:25.871438] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T20:24:25.960366] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:26.028274] [DEBUG] [LOCAL ] NTR: Loaded 52579 existing records from primary storage. [2025-09-24T20:24:26.028455] [INFO ] [MAIN ] NTR: Loaded 52579 existing records. [2025-09-24T20:24:26.223542] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-24T20:24:26.242035] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T20:24:26.249132] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:24:26.250180] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-24T20:24:26.251999] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-24T20:24:26.252614] [INFO ] [REMOTE ] NSP: Full fetch complete (49472 records). [2025-09-24T20:24:26.252892] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-24T20:24:26.259560] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-24T20:24:26.259759] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-24T20:24:26.421425] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-24T20:24:27.060251] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T20:24:27.099722] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-24T20:24:27.104994] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-24T20:24:27.118097] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-24T20:24:27.125791] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-24T20:24:27.151327] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:27.155607] [DEBUG] [LOCAL ] NSP: Trimmed 49472 records to 34932 (keeping 200 days of data) [2025-09-24T20:24:27.225140] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-24T20:24:27.395356] [DEBUG] [LOCAL ] NSP: Primary data saved (34932 records). [2025-09-24T20:24:27.395566] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-24T20:24:27.395724] [INFO ] [MAIN ] Update Progress: 1539/2373 symbols completed. NSP took 33.4s. Estimated remaining: 1h 50m 46s. Rate: 7.5 symbols/min [2025-09-24T20:24:27.570748] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:27.622000] [DEBUG] [LOCAL ] NTST: Loaded 43542 existing records from primary storage. [2025-09-24T20:24:27.622177] [INFO ] [MAIN ] NTST: Loaded 43542 existing records. [2025-09-24T20:24:27.800108] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:24:27.800376] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-24T20:24:27.800428] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-24T20:24:27.801960] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-24T20:24:27.802032] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-24T20:24:28.021871] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-24T20:24:28.164682] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:28.649680] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T20:24:28.816074] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-24T20:24:29.139766] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T20:24:29.616081] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-24T20:24:29.911383] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T20:24:30.416130] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-24T20:24:31.174143] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:24:31.216072] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-24T20:24:31.571361] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T20:24:32.016135] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-24T20:24:32.596836] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T20:24:32.816227] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-24T20:24:32.860875] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:24:32.864771] [INFO ] [REMOTE ] NTB: Full fetch complete (30932 records). [2025-09-24T20:24:32.864857] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-24T20:24:33.247123] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-24T20:24:33.247218] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-24T20:24:33.248260] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-24T20:24:33.248324] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-24T20:24:33.249335] [DEBUG] [LOCAL ] NTB: Trimmed 30932 records to 20700 (keeping 200 days of data) [2025-09-24T20:24:33.390902] [DEBUG] [LOCAL ] NTB: Primary data saved (20700 records). [2025-09-24T20:24:33.391048] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-24T20:24:33.391217] [INFO ] [MAIN ] Update Progress: 1540/2373 symbols completed. NTB took 25.3s. Estimated remaining: 1h 50m 37s. Rate: 7.5 symbols/min [2025-09-24T20:24:33.560225] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:33.622332] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-24T20:24:33.626171] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-24T20:24:33.626316] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-24T20:24:33.809154] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:24:33.809448] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-24T20:24:33.809513] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-24T20:24:33.811078] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-24T20:24:33.811154] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-24T20:24:34.167431] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:34.416068] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-24T20:24:34.779282] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T20:24:34.841865] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T20:24:35.216093] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-24T20:24:36.016089] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-24T20:24:36.816124] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-24T20:24:36.937338] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-24T20:24:37.011736] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T20:24:37.341015] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T20:24:37.616118] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-24T20:24:37.688365] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T20:24:38.416135] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-24T20:24:39.216191] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-24T20:24:39.888842] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-24T20:24:39.994893] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-24T20:24:40.016029] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-24T20:24:40.136179] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T20:24:40.816169] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-24T20:24:41.548679] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T20:24:41.616087] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-24T20:24:42.198593] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T20:24:42.335616] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-24T20:24:42.416128] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-24T20:24:43.216122] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-24T20:24:44.016123] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-24T20:24:44.777990] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:24:44.819382] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-24T20:24:44.826387] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-24T20:24:45.414442] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-24T20:24:45.415355] [INFO ] [REMOTE ] NTEST: Full fetch complete (1987 records). [2025-09-24T20:24:45.415429] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-24T20:24:45.608933] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-24T20:24:45.609319] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:24:45.609489] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:24:45.609681] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-24T20:24:45.609865] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-24T20:24:45.609958] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-24T20:24:45.610114] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-24T20:24:45.610223] [INFO ] [MAIN ] Update Progress: 1541/2373 symbols completed. NTEST took 28.9s. Estimated remaining: 1h 50m 31s. Rate: 7.5 symbols/min [2025-09-24T20:24:45.621167] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-24T20:24:45.827138] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:45.831578] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-24T20:24:45.832512] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-24T20:24:45.834340] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T20:24:45.834772] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-24T20:24:45.845780] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-24T20:24:45.846392] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-24T20:24:45.846592] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-24T20:24:46.259267] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:46.416124] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-24T20:24:47.216093] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-24T20:24:47.933429] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-24T20:24:48.016093] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-24T20:24:48.571937] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-24T20:24:48.624778] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T20:24:48.816109] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-24T20:24:49.616123] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-24T20:24:49.942351] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T20:24:50.416084] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-24T20:24:51.188863] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-24T20:24:51.216034] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-24T20:24:51.257215] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T20:24:52.016060] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-24T20:24:52.189442] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T20:24:52.816105] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-24T20:24:53.445420] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-24T20:24:53.616078] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-24T20:24:53.750591] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T20:24:54.427974] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-24T20:24:54.431054] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T20:24:55.216092] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-24T20:24:55.908770] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-24T20:24:56.016174] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-24T20:24:56.201264] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T20:24:56.541094] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T20:24:56.550850] [INFO ] [REMOTE ] NTST: Full fetch complete (60771 records). [2025-09-24T20:24:56.551026] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-24T20:24:56.823374] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-24T20:24:56.973569] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-24T20:24:56.973694] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-24T20:24:56.974868] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-24T20:24:56.974937] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-24T20:24:56.978709] [DEBUG] [LOCAL ] NTST: Trimmed 60771 records to 43575 (keeping 200 days of data) [2025-09-24T20:24:57.256337] [DEBUG] [LOCAL ] NTST: Primary data saved (43575 records). [2025-09-24T20:24:57.256478] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-24T20:24:57.256594] [INFO ] [MAIN ] Update Progress: 1542/2373 symbols completed. NTST took 29.9s. Estimated remaining: 1h 50m 25s. Rate: 7.5 symbols/min [2025-09-24T20:24:57.428715] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:24:57.468275] [DEBUG] [LOCAL ] NUS: Loaded 36464 existing records from primary storage. [2025-09-24T20:24:57.468430] [INFO ] [MAIN ] NUS: Loaded 36464 existing records. [2025-09-24T20:24:57.618736] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-24T20:24:57.655726] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:24:57.656387] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-24T20:24:57.656471] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-24T20:24:57.657886] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-24T20:24:57.657950] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-24T20:24:58.024050] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:24:58.079115] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T20:24:58.416128] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-24T20:24:59.216060] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-24T20:24:59.296486] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-24T20:24:59.353889] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T20:25:00.008491] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T20:25:00.016211] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-24T20:25:00.816120] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-24T20:25:01.181828] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T20:25:01.616247] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-24T20:25:02.377256] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-24T20:25:02.388186] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-24T20:25:02.388467] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-24T20:25:02.426564] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-24T20:25:02.843164] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-24T20:25:02.843306] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-24T20:25:02.844600] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-24T20:25:02.844868] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-24T20:25:02.846812] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-24T20:25:02.974137] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T20:25:03.216172] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-24T20:25:03.243910] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-24T20:25:03.244122] [INFO ] [MAIN ] NU: Full history saved. [2025-09-24T20:25:03.244220] [INFO ] [MAIN ] Update Progress: 1543/2373 symbols completed. NU took 29.9s. Estimated remaining: 1h 50m 16s. Rate: 7.5 symbols/min [2025-09-24T20:25:03.418991] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:03.443876] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T20:25:03.469638] [DEBUG] [LOCAL ] NUV: Loaded 23239 existing records from primary storage. [2025-09-24T20:25:03.469801] [INFO ] [MAIN ] NUV: Loaded 23239 existing records. [2025-09-24T20:25:03.647812] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:03.648095] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-24T20:25:03.648144] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-24T20:25:03.648975] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-24T20:25:03.649038] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-24T20:25:04.016166] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-24T20:25:04.075467] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:04.335927] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T20:25:04.816057] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-24T20:25:05.168478] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T20:25:05.624825] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-24T20:25:05.629858] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T20:25:06.267728] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T20:25:06.416079] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-24T20:25:07.216069] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-24T20:25:07.551377] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:25:07.585972] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T20:25:07.595684] [INFO ] [REMOTE ] NTR: Full fetch complete (76289 records). [2025-09-24T20:25:07.595850] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-24T20:25:07.992943] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-24T20:25:07.993086] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-24T20:25:07.994252] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-24T20:25:07.994324] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-24T20:25:07.995905] [DEBUG] [LOCAL ] NTR: Trimmed 76289 records to 52579 (keeping 200 days of data) [2025-09-24T20:25:08.067799] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-24T20:25:08.338337] [DEBUG] [LOCAL ] NTR: Primary data saved (52579 records). [2025-09-24T20:25:08.338495] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-24T20:25:08.338602] [INFO ] [MAIN ] Update Progress: 1544/2373 symbols completed. NTR took 42.6s. Estimated remaining: 1h 50m 7s. Rate: 7.5 symbols/min [2025-09-24T20:25:08.512151] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:08.570205] [DEBUG] [LOCAL ] NUVB: Loaded 51209 existing records from primary storage. [2025-09-24T20:25:08.570388] [INFO ] [MAIN ] NUVB: Loaded 51209 existing records. [2025-09-24T20:25:08.756760] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:08.757068] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-24T20:25:08.757121] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-24T20:25:08.758547] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-24T20:25:08.758609] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-24T20:25:08.825933] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-24T20:25:09.122540] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:09.252282] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-24T20:25:09.616213] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-24T20:25:09.745442] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T20:25:09.829304] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T20:25:10.416128] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-24T20:25:11.216136] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-24T20:25:11.286866] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:25:12.016057] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-24T20:25:12.372954] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T20:25:12.528182] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-24T20:25:12.816099] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-24T20:25:13.616066] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-24T20:25:13.793531] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T20:25:14.421198] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-24T20:25:14.433438] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T20:25:14.965696] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T20:25:15.216109] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-24T20:25:16.016055] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-24T20:25:16.223277] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T20:25:16.384451] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T20:25:16.816115] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-24T20:25:17.616085] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-24T20:25:17.673931] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T20:25:17.682237] [INFO ] [REMOTE ] NUE: Full fetch complete (74556 records). [2025-09-24T20:25:17.682389] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-24T20:25:17.683411] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:25:17.683549] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:25:17.683618] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:25:17.683718] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-24T20:25:17.683789] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-24T20:25:17.683826] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-24T20:25:17.683865] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-24T20:25:17.683939] [INFO ] [MAIN ] Update Progress: 1545/2373 symbols completed. NUE took 32.1s. Estimated remaining: 1h 49m 59s. Rate: 7.5 symbols/min [2025-09-24T20:25:17.878826] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T20:25:17.912230] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:17.930817] [DEBUG] [LOCAL ] NUW: Loaded 7438 existing records from primary storage. [2025-09-24T20:25:17.931004] [INFO ] [MAIN ] NUW: Loaded 7438 existing records. [2025-09-24T20:25:18.130306] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:18.130586] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-24T20:25:18.130672] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-24T20:25:18.131385] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-24T20:25:18.131450] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-24T20:25:18.421245] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-24T20:25:18.493874] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:18.711267] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:25:19.216081] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-24T20:25:19.974976] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T20:25:20.016060] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-24T20:25:20.472991] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T20:25:20.816270] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-24T20:25:21.559948] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T20:25:21.616203] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-24T20:25:21.647051] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T20:25:22.416082] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-24T20:25:23.216062] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-24T20:25:23.269435] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T20:25:23.973842] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T20:25:24.016037] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-24T20:25:24.377565] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:25:24.382419] [INFO ] [REMOTE ] NUV: Full fetch complete (34407 records). [2025-09-24T20:25:24.382580] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-24T20:25:24.783055] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-24T20:25:24.783176] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-24T20:25:24.784296] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-24T20:25:24.784372] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-24T20:25:24.785565] [DEBUG] [LOCAL ] NUV: Trimmed 34407 records to 23234 (keeping 200 days of data) [2025-09-24T20:25:24.838437] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-24T20:25:24.936793] [DEBUG] [LOCAL ] NUV: Primary data saved (23234 records). [2025-09-24T20:25:24.936962] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-24T20:25:24.937053] [INFO ] [MAIN ] Update Progress: 1546/2373 symbols completed. NUV took 21.7s. Estimated remaining: 1h 49m 51s. Rate: 7.5 symbols/min [2025-09-24T20:25:25.108562] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:25.108818] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-09-24T20:25:25.108875] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-09-24T20:25:25.109026] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-24T20:25:25.109070] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-24T20:25:25.109111] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-09-24T20:25:25.109144] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-24T20:25:25.472998] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:25.616067] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-24T20:25:25.839202] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T20:25:26.154639] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-24T20:25:26.416098] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-24T20:25:26.919165] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T20:25:26.925526] [INFO ] [REMOTE ] NUS: Full fetch complete (53920 records). [2025-09-24T20:25:26.925638] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-24T20:25:27.221205] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-24T20:25:27.318402] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-24T20:25:27.318488] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-24T20:25:27.319460] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-24T20:25:27.319523] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-24T20:25:27.320721] [DEBUG] [LOCAL ] NUS: Trimmed 53920 records to 36465 (keeping 200 days of data) [2025-09-24T20:25:27.542664] [DEBUG] [LOCAL ] NUS: Primary data saved (36465 records). [2025-09-24T20:25:27.542836] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-24T20:25:27.542931] [INFO ] [MAIN ] Update Progress: 1547/2373 symbols completed. NUS took 30.3s. Estimated remaining: 1h 49m 40s. Rate: 7.5 symbols/min [2025-09-24T20:25:27.719591] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:27.754346] [DEBUG] [LOCAL ] NVGS: Loaded 31106 existing records from primary storage. [2025-09-24T20:25:27.754491] [INFO ] [MAIN ] NVGS: Loaded 31106 existing records. [2025-09-24T20:25:27.943240] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:27.943853] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-24T20:25:27.943924] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-24T20:25:27.945232] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-24T20:25:27.945300] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-24T20:25:28.030596] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-24T20:25:28.191221] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T20:25:28.226885] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T20:25:28.364488] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:28.816181] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-24T20:25:29.546351] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T20:25:29.616046] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-24T20:25:29.701585] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T20:25:30.416119] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-24T20:25:30.643639] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:25:31.216183] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-24T20:25:32.016124] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-24T20:25:32.375190] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:25:32.387725] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T20:25:32.816168] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-24T20:25:33.258517] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T20:25:33.616107] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-24T20:25:34.017868] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T20:25:34.416105] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-24T20:25:34.913846] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T20:25:35.216050] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-24T20:25:35.614941] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T20:25:36.016087] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-24T20:25:36.816078] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-24T20:25:36.936550] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T20:25:37.307234] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T20:25:37.400288] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T20:25:37.616095] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-24T20:25:38.416108] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-24T20:25:38.573636] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T20:25:39.216087] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-24T20:25:40.016130] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-24T20:25:40.076677] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:25:40.355186] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T20:25:40.816081] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-24T20:25:41.337045] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T20:25:41.619893] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-24T20:25:41.622097] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:25:42.416093] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-24T20:25:43.216528] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-24T20:25:43.631151] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:25:43.783223] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T20:25:44.016093] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-24T20:25:44.594280] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T20:25:44.816108] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-24T20:25:45.616067] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-24T20:25:45.952281] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:25:46.229568] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T20:25:46.352925] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T20:25:46.416085] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-24T20:25:47.216167] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-24T20:25:47.922107] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T20:25:48.016205] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-24T20:25:48.545412] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-24T20:25:48.555169] [INFO ] [REMOTE ] NUVB: Full fetch complete (72566 records). [2025-09-24T20:25:48.555333] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-24T20:25:48.821177] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-24T20:25:48.954569] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-24T20:25:48.954718] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-24T20:25:48.956092] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-24T20:25:48.956191] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-24T20:25:48.957958] [DEBUG] [LOCAL ] NUVB: Trimmed 72566 records to 51241 (keeping 200 days of data) [2025-09-24T20:25:49.288926] [DEBUG] [LOCAL ] NUVB: Primary data saved (51241 records). [2025-09-24T20:25:49.289106] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-24T20:25:49.289207] [INFO ] [MAIN ] Update Progress: 1548/2373 symbols completed. NUVB took 41.0s. Estimated remaining: 1h 49m 40s. Rate: 7.5 symbols/min [2025-09-24T20:25:49.463428] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:49.523876] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-24T20:25:49.533229] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-24T20:25:49.608814] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T20:25:49.619951] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-24T20:25:49.732303] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:49.732622] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-24T20:25:49.732709] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-24T20:25:49.734112] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-24T20:25:49.734174] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-24T20:25:50.104773] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:50.121140] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T20:25:50.184620] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T20:25:50.186409] [INFO ] [REMOTE ] NUW: Full fetch complete (11776 records). [2025-09-24T20:25:50.186496] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-24T20:25:50.421196] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-24T20:25:50.576267] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-24T20:25:50.576386] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-24T20:25:50.577015] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-24T20:25:50.577081] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-24T20:25:50.577595] [DEBUG] [LOCAL ] NUW: Trimmed 11776 records to 7437 (keeping 200 days of data) [2025-09-24T20:25:50.633399] [DEBUG] [LOCAL ] NUW: Primary data saved (7437 records). [2025-09-24T20:25:50.633600] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-24T20:25:50.633779] [INFO ] [MAIN ] Update Progress: 1549/2373 symbols completed. NUW took 32.9s. Estimated remaining: 1h 49m 28s. Rate: 7.5 symbols/min [2025-09-24T20:25:50.815969] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:50.838903] [DEBUG] [LOCAL ] NVR: Loaded 19206 existing records from primary storage. [2025-09-24T20:25:50.839043] [INFO ] [MAIN ] NVR: Loaded 19206 existing records. [2025-09-24T20:25:51.017710] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:51.017998] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-24T20:25:51.018047] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-24T20:25:51.018679] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-24T20:25:51.018741] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-24T20:25:51.226336] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-24T20:25:51.376828] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:52.016124] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-24T20:25:52.821264] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-24T20:25:52.843404] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T20:25:53.018938] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T20:25:53.154253] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-24T20:25:53.616086] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-24T20:25:54.009512] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T20:25:54.416090] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-24T20:25:55.122024] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T20:25:55.216132] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-24T20:25:55.817149] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T20:25:56.016123] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-24T20:25:56.479084] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T20:25:56.485174] [INFO ] [REMOTE ] NVG: Full fetch complete (40727 records). [2025-09-24T20:25:56.485316] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-24T20:25:56.822385] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-24T20:25:56.924439] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-24T20:25:56.924630] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-24T20:25:56.925715] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-24T20:25:56.925833] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-24T20:25:56.927093] [DEBUG] [LOCAL ] NVG: Trimmed 40727 records to 27288 (keeping 200 days of data) [2025-09-24T20:25:57.106192] [DEBUG] [LOCAL ] NVG: Primary data saved (27288 records). [2025-09-24T20:25:57.106351] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-24T20:25:57.106439] [INFO ] [MAIN ] Update Progress: 1550/2373 symbols completed. NVG took 32.2s. Estimated remaining: 1h 49m 19s. Rate: 7.5 symbols/min [2025-09-24T20:25:57.254073] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T20:25:57.308509] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:57.347764] [DEBUG] [LOCAL ] NVRI: Loaded 38782 existing records from primary storage. [2025-09-24T20:25:57.347945] [INFO ] [MAIN ] NVRI: Loaded 38782 existing records. [2025-09-24T20:25:57.552704] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:57.552997] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-24T20:25:57.553048] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-24T20:25:57.554007] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-24T20:25:57.554070] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-24T20:25:57.621297] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-24T20:25:57.918169] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:25:58.416102] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-24T20:25:58.825416] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T20:25:58.832011] [INFO ] [REMOTE ] NVGS: Full fetch complete (41543 records). [2025-09-24T20:25:58.832124] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-24T20:25:59.228594] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-24T20:25:59.246569] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-24T20:25:59.246700] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-24T20:25:59.247777] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-24T20:25:59.247855] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-24T20:25:59.249243] [DEBUG] [LOCAL ] NVGS: Trimmed 41543 records to 31109 (keeping 200 days of data) [2025-09-24T20:25:59.456800] [DEBUG] [LOCAL ] NVGS: Primary data saved (31109 records). [2025-09-24T20:25:59.456963] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-24T20:25:59.457059] [INFO ] [MAIN ] Update Progress: 1551/2373 symbols completed. NVGS took 31.9s. Estimated remaining: 1h 49m 8s. Rate: 7.5 symbols/min [2025-09-24T20:25:59.641820] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:25:59.682049] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-09-24T20:25:59.742387] [DEBUG] [LOCAL ] NVS: Loaded 51667 existing records from primary storage. [2025-09-24T20:25:59.742604] [INFO ] [MAIN ] NVS: Loaded 51667 existing records. [2025-09-24T20:25:59.934435] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:25:59.934817] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-24T20:25:59.934877] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-24T20:25:59.936878] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-24T20:25:59.936944] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-24T20:26:00.018907] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-24T20:26:00.243025] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T20:26:00.366315] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:00.605319] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T20:26:00.816172] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-24T20:26:01.616163] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-24T20:26:02.416074] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-24T20:26:02.512966] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T20:26:02.623019] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-24T20:26:02.938864] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T20:26:03.216174] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-24T20:26:03.633037] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T20:26:04.016093] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-24T20:26:04.816093] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-24T20:26:05.201257] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T20:26:05.271080] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T20:26:05.616126] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-24T20:26:06.103762] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T20:26:06.416168] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-24T20:26:07.196496] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T20:26:07.216037] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-24T20:26:08.016132] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-24T20:26:08.325517] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T20:26:08.816098] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-24T20:26:09.211257] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-24T20:26:09.616069] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-24T20:26:09.654668] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T20:26:10.084339] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T20:26:10.416107] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-24T20:26:11.216081] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-24T20:26:12.016095] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-24T20:26:12.377103] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T20:26:12.477526] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-24T20:26:12.778263] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T20:26:12.816058] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-24T20:26:12.906396] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T20:26:13.616057] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-24T20:26:13.888090] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T20:26:13.894099] [INFO ] [REMOTE ] NVR: Full fetch complete (29881 records). [2025-09-24T20:26:13.894405] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-24T20:26:14.285311] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-24T20:26:14.285478] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-24T20:26:14.286916] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-24T20:26:14.287072] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-24T20:26:14.288413] [DEBUG] [LOCAL ] NVR: Trimmed 29881 records to 19120 (keeping 200 days of data) [2025-09-24T20:26:14.419475] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-24T20:26:14.438376] [DEBUG] [LOCAL ] NVR: Primary data saved (19120 records). [2025-09-24T20:26:14.438630] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-24T20:26:14.438830] [INFO ] [MAIN ] Update Progress: 1552/2373 symbols completed. NVR took 23.8s. Estimated remaining: 1h 49m 4s. Rate: 7.5 symbols/min [2025-09-24T20:26:14.615032] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:26:14.681088] [DEBUG] [LOCAL ] NVST: Loaded 51650 existing records from primary storage. [2025-09-24T20:26:14.681253] [INFO ] [MAIN ] NVST: Loaded 51650 existing records. [2025-09-24T20:26:14.862253] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:26:14.862688] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-24T20:26:14.862758] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-24T20:26:14.863803] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-24T20:26:14.863874] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-24T20:26:15.225357] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-24T20:26:15.313308] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T20:26:15.310840] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:16.016094] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-24T20:26:16.290432] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T20:26:16.816110] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-24T20:26:17.616077] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-24T20:26:17.850797] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T20:26:18.273192] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-24T20:26:18.314106] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T20:26:18.416186] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-24T20:26:19.216074] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-24T20:26:19.669562] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T20:26:20.016194] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-24T20:26:20.713434] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T20:26:20.816125] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-24T20:26:21.159515] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-24T20:26:21.616097] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-24T20:26:21.979804] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T20:26:22.233958] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T20:26:22.416091] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-24T20:26:23.216180] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-24T20:26:24.016178] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-24T20:26:24.455171] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T20:26:24.590049] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-24T20:26:24.802101] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T20:26:24.816046] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-24T20:26:25.616162] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-24T20:26:25.677156] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T20:26:26.423510] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-24T20:26:26.425393] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T20:26:26.434143] [INFO ] [REMOTE ] NVRI: Full fetch complete (55858 records). [2025-09-24T20:26:26.434331] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-24T20:26:26.870014] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-24T20:26:26.870157] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-24T20:26:26.871256] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-24T20:26:26.871356] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-24T20:26:26.872794] [DEBUG] [LOCAL ] NVRI: Trimmed 55858 records to 38754 (keeping 200 days of data) [2025-09-24T20:26:27.113717] [DEBUG] [LOCAL ] NVRI: Primary data saved (38754 records). [2025-09-24T20:26:27.113903] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-24T20:26:27.114173] [INFO ] [MAIN ] Update Progress: 1553/2373 symbols completed. NVRI took 30.0s. Estimated remaining: 1h 48m 59s. Rate: 7.5 symbols/min [2025-09-24T20:26:27.218838] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-24T20:26:27.324714] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:26:27.388422] [DEBUG] [LOCAL ] NVT: Loaded 51600 existing records from primary storage. [2025-09-24T20:26:27.402723] [INFO ] [MAIN ] NVT: Loaded 51600 existing records. [2025-09-24T20:26:27.487477] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T20:26:27.538286] [INFO ] [REMOTE ] NVS: Full fetch complete (74772 records). [2025-09-24T20:26:27.538861] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-24T20:26:27.754389] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:26:27.771676] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-24T20:26:27.771780] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-24T20:26:27.793540] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-24T20:26:27.811574] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-24T20:26:28.499981] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-24T20:26:28.510173] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-24T20:26:28.517962] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-24T20:26:28.533930] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-24T20:26:28.539513] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:28.539926] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-24T20:26:28.544407] [DEBUG] [LOCAL ] NVS: Trimmed 74772 records to 51610 (keeping 200 days of data) [2025-09-24T20:26:28.901670] [DEBUG] [LOCAL ] NVS: Primary data saved (51610 records). [2025-09-24T20:26:28.902085] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-24T20:26:28.902235] [INFO ] [MAIN ] Update Progress: 1554/2373 symbols completed. NVS took 29.4s. Estimated remaining: 1h 48m 47s. Rate: 7.5 symbols/min [2025-09-24T20:26:29.090620] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:26:29.125546] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T20:26:29.138040] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-24T20:26:29.188602] [DEBUG] [LOCAL ] NWG: Loaded 51614 existing records from primary storage. [2025-09-24T20:26:29.188855] [INFO ] [MAIN ] NWG: Loaded 51614 existing records. [2025-09-24T20:26:29.380252] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:26:29.380818] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-24T20:26:29.381228] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-24T20:26:29.382785] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-24T20:26:29.382859] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-24T20:26:29.764320] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.34 seconds). [2025-09-24T20:26:29.807469] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-24T20:26:29.886995] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:30.275096] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T20:26:30.416135] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-24T20:26:30.936280] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:26:31.216171] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-24T20:26:32.016118] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-24T20:26:32.058723] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T20:26:32.573989] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-24T20:26:32.584980] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-24T20:26:32.585179] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-24T20:26:32.821249] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-24T20:26:33.042472] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T20:26:33.112139] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-24T20:26:33.112905] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-24T20:26:33.114445] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-24T20:26:33.114537] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-24T20:26:33.116700] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-09-24T20:26:33.471816] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-24T20:26:33.471972] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-24T20:26:33.472113] [INFO ] [MAIN ] Update Progress: 1555/2373 symbols completed. NVO took 44.2s. Estimated remaining: 1h 48m 38s. Rate: 7.5 symbols/min [2025-09-24T20:26:33.622509] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-24T20:26:33.649581] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:26:33.682691] [DEBUG] [LOCAL ] NWN: Loaded 26869 existing records from primary storage. [2025-09-24T20:26:33.682859] [INFO ] [MAIN ] NWN: Loaded 26869 existing records. [2025-09-24T20:26:33.874855] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:26:33.875632] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-24T20:26:33.875853] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-24T20:26:33.887605] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-24T20:26:33.892846] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-24T20:26:34.016967] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T20:26:34.291431] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:34.416090] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-24T20:26:34.730319] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T20:26:35.051980] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T20:26:35.216103] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-24T20:26:36.016102] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-24T20:26:36.816079] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-24T20:26:37.058926] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T20:26:37.122904] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-24T20:26:37.616101] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-24T20:26:37.789201] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T20:26:38.416046] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-24T20:26:38.484778] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T20:26:39.216087] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-24T20:26:39.352926] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T20:26:39.686391] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T20:26:40.016079] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-24T20:26:40.816057] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-24T20:26:41.105824] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T20:26:41.616163] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-24T20:26:42.000698] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T20:26:42.416120] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-24T20:26:42.561252] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T20:26:43.216185] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-24T20:26:43.449199] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T20:26:44.016172] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-24T20:26:44.430638] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-24T20:26:44.489883] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T20:26:44.816182] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-24T20:26:45.616195] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-24T20:26:45.793621] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T20:26:45.803516] [INFO ] [REMOTE ] NVST: Full fetch complete (74053 records). [2025-09-24T20:26:45.803932] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-24T20:26:46.269120] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-24T20:26:46.268913] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T20:26:46.269447] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-24T20:26:46.277435] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-24T20:26:46.277581] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-24T20:26:46.279748] [DEBUG] [LOCAL ] NVST: Trimmed 74053 records to 51623 (keeping 200 days of data) [2025-09-24T20:26:46.416238] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-24T20:26:46.616290] [DEBUG] [LOCAL ] NVST: Primary data saved (51623 records). [2025-09-24T20:26:46.616463] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-24T20:26:46.616599] [INFO ] [MAIN ] Update Progress: 1556/2373 symbols completed. NVST took 32.2s. Estimated remaining: 1h 48m 32s. Rate: 7.5 symbols/min [2025-09-24T20:26:46.795637] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:26:46.834404] [DEBUG] [LOCAL ] NX: Loaded 33437 existing records from primary storage. [2025-09-24T20:26:46.834624] [INFO ] [MAIN ] NX: Loaded 33437 existing records. [2025-09-24T20:26:47.038404] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:26:47.038790] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-24T20:26:47.038849] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-24T20:26:47.039933] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-24T20:26:47.039999] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-24T20:26:47.217152] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-24T20:26:47.444051] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:26:47.473036] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T20:26:47.908852] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T20:26:48.016048] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-24T20:26:48.816056] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-24T20:26:48.867339] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T20:26:49.410713] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T20:26:49.616072] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-24T20:26:50.416129] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-24T20:26:50.861699] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T20:26:51.168786] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T20:26:51.216035] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-24T20:26:52.016085] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-24T20:26:52.423890] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T20:26:52.681362] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T20:26:52.816107] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-24T20:26:53.616066] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-24T20:26:53.671487] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T20:26:54.416093] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-24T20:26:54.451681] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T20:26:54.916441] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T20:26:55.216173] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-24T20:26:56.016170] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-24T20:26:56.162449] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T20:26:56.172169] [INFO ] [REMOTE ] NWG: Full fetch complete (73134 records). [2025-09-24T20:26:56.172324] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-24T20:26:56.568150] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-24T20:26:56.568256] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-24T20:26:56.569378] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-24T20:26:56.569444] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-24T20:26:56.573053] [DEBUG] [LOCAL ] NWG: Trimmed 73134 records to 51589 (keeping 200 days of data) [2025-09-24T20:26:56.816090] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-24T20:26:56.910552] [DEBUG] [LOCAL ] NWG: Primary data saved (51589 records). [2025-09-24T20:26:56.910782] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-24T20:26:56.910896] [INFO ] [MAIN ] Update Progress: 1557/2373 symbols completed. NWG took 28.0s. Estimated remaining: 1h 48m 26s. Rate: 7.5 symbols/min [2025-09-24T20:26:57.153907] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T20:26:57.519008] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T20:26:57.616042] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-24T20:26:57.926962] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T20:26:58.416173] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-24T20:26:58.948178] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T20:26:59.216176] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-24T20:26:59.961385] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T20:27:00.016067] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-24T20:27:00.791135] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T20:27:00.816039] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-24T20:27:01.616113] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-24T20:27:01.837262] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:27:02.416176] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-24T20:27:03.181254] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-24T20:27:03.191145] [INFO ] [REMOTE ] NVT: Full fetch complete (74508 records). [2025-09-24T20:27:03.191363] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-24T20:27:03.620135] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-24T20:27:03.620246] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-24T20:27:03.621556] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-24T20:27:03.621623] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-24T20:27:03.623553] [DEBUG] [LOCAL ] NVT: Trimmed 74508 records to 51587 (keeping 200 days of data) [2025-09-24T20:27:03.976802] [DEBUG] [LOCAL ] NVT: Primary data saved (51587 records). [2025-09-24T20:27:03.977028] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-24T20:27:03.977155] [INFO ] [MAIN ] Update Progress: 1558/2373 symbols completed. NVT took 36.9s. Estimated remaining: 1h 48m 17s. Rate: 7.5 symbols/min [2025-09-24T20:27:04.465462] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-24T20:27:04.470129] [INFO ] [REMOTE ] NWN: Full fetch complete (37097 records). [2025-09-24T20:27:04.470225] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-24T20:27:04.838804] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-24T20:27:04.946852] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-24T20:27:04.956928] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-24T20:27:04.956983] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-24T20:27:04.957802] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-24T20:27:04.957947] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-24T20:27:04.958876] [DEBUG] [LOCAL ] NWN: Trimmed 37097 records to 26910 (keeping 200 days of data) [2025-09-24T20:27:05.135936] [DEBUG] [LOCAL ] NWN: Primary data saved (26910 records). [2025-09-24T20:27:05.136089] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-24T20:27:05.136237] [INFO ] [MAIN ] Update Progress: 1559/2373 symbols completed. NWN took 31.7s. Estimated remaining: 1h 48m 6s. Rate: 7.5 symbols/min [2025-09-24T20:27:06.425281] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T20:27:06.432959] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-24T20:27:07.971528] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T20:27:07.980054] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-24T20:27:09.273067] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T20:27:09.280190] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-24T20:27:10.861191] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T20:27:10.869794] [INFO ] [REMOTE ] NX: Full fetch complete (48279 records). [2025-09-24T20:27:10.870034] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-24T20:27:11.290419] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-24T20:27:11.290516] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-24T20:27:11.291522] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-24T20:27:11.291590] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-24T20:27:11.292855] [DEBUG] [LOCAL ] NX: Trimmed 48279 records to 33367 (keeping 200 days of data) [2025-09-24T20:27:11.509119] [DEBUG] [LOCAL ] NX: Primary data saved (33367 records). [2025-09-24T20:27:11.509300] [INFO ] [MAIN ] NX: Full history saved. [2025-09-24T20:27:11.509402] [INFO ] [MAIN ] Update Progress: 1560/2373 symbols completed. NX took 24.9s. Estimated remaining: 1h 47m 57s. Rate: 7.5 symbols/min [2025-09-24T20:27:12.127485] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:12.174993] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:12.193969] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:12.244145] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-24T20:27:12.243777] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:12.244485] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-24T20:27:12.245875] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-24T20:27:12.245929] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-24T20:27:12.245975] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-24T20:27:12.246011] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-24T20:27:12.320225] [DEBUG] [LOCAL ] NXC: Loaded 4210 existing records from primary storage. [2025-09-24T20:27:12.340320] [INFO ] [MAIN ] NXC: Loaded 4210 existing records. [2025-09-24T20:27:12.472779] [DEBUG] [LOCAL ] NXDT: Loaded 16417 existing records from primary storage. [2025-09-24T20:27:12.571204] [INFO ] [MAIN ] NXDT: Loaded 16417 existing records. [2025-09-24T20:27:12.876187] [DEBUG] [LOCAL ] NXE: Loaded 52985 existing records from primary storage. [2025-09-24T20:27:12.898880] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:12.899329] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-24T20:27:12.926119] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-24T20:27:12.899437] [INFO ] [MAIN ] NXE: Loaded 52985 existing records. [2025-09-24T20:27:13.079095] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-24T20:27:13.119264] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-24T20:27:13.109688] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:13.128793] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-24T20:27:13.153131] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:13.249074] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-24T20:27:13.291930] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-24T20:27:13.323417] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-24T20:27:13.365425] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-24T20:27:13.534045] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:13.579920] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:13.597747] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-24T20:27:13.598185] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-24T20:27:13.598095] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-24T20:27:13.634363] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-24T20:27:13.659085] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-24T20:27:13.659744] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-24T20:27:13.880405] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:13.894682] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-24T20:27:14.318326] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:14.330769] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-24T20:27:14.408937] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:14.409216] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-24T20:27:15.039084] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:15.039437] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-24T20:27:15.040155] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-24T20:27:15.674790] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T20:27:15.676776] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-24T20:27:15.909312] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:15.909705] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-24T20:27:15.910183] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-24T20:27:16.248619] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:16.249012] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-24T20:27:16.249482] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-24T20:27:16.325162] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T20:27:16.326581] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-24T20:27:16.445804] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-24T20:27:16.450894] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-24T20:27:16.627999] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:16.628417] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-24T20:27:16.628932] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-24T20:27:16.886515] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:16.886956] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-24T20:27:16.887418] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-24T20:27:16.991825] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T20:27:16.993635] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-24T20:27:17.241290] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:27:17.241754] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-24T20:27:17.342927] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T20:27:17.517923] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-09-24T20:27:17.544675] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T20:27:17.616068] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-24T20:27:18.416112] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-24T20:27:18.841536] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T20:27:19.216200] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-24T20:27:19.430202] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T20:27:20.016090] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-24T20:27:20.816081] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-24T20:27:21.030322] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T20:27:21.463473] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T20:27:21.479358] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T20:27:21.616117] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-24T20:27:22.416091] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-24T20:27:22.742136] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:27:23.216123] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-24T20:27:23.272251] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:27:24.016088] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-24T20:27:24.223167] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T20:27:24.669318] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T20:27:24.816175] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-24T20:27:25.616082] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-24T20:27:26.416193] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-24T20:27:27.050297] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-24T20:27:27.216894] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-24T20:27:27.444979] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T20:27:27.888071] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-24T20:27:27.897086] [INFO ] [REMOTE ] NXDR: Full fetch complete (16965 records). [2025-09-24T20:27:27.897249] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-24T20:27:28.021169] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-24T20:27:28.096888] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 47 unique days, need 200 days [2025-09-24T20:27:28.097256] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:27:28.097329] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:27:28.097403] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-24T20:27:28.097472] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-24T20:27:28.097510] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-24T20:27:28.097613] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-24T20:27:28.097736] [INFO ] [MAIN ] Update Progress: 1561/2373 symbols completed. NXDR took 16.6s. Estimated remaining: 1h 47m 53s. Rate: 7.5 symbols/min [2025-09-24T20:27:28.270512] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:28.282783] [DEBUG] [LOCAL ] NXG: Loaded 10489 existing records from primary storage. [2025-09-24T20:27:28.282913] [INFO ] [MAIN ] NXG: Loaded 10489 existing records. [2025-09-24T20:27:28.467144] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:28.467476] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-24T20:27:28.467528] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-24T20:27:28.468039] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-24T20:27:28.468101] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-24T20:27:28.654612] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T20:27:28.770830] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T20:27:28.823397] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-24T20:27:28.855110] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:29.580924] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T20:27:29.582664] [INFO ] [REMOTE ] NXC: Full fetch complete (6073 records). [2025-09-24T20:27:29.582739] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-24T20:27:29.621278] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-24T20:27:29.980118] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-24T20:27:29.980219] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-24T20:27:29.980427] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-24T20:27:29.980467] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-24T20:27:29.980927] [DEBUG] [LOCAL ] NXC: Trimmed 6073 records to 4227 (keeping 200 days of data) [2025-09-24T20:27:30.007896] [DEBUG] [LOCAL ] NXC: Primary data saved (4227 records). [2025-09-24T20:27:30.008048] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-24T20:27:30.008154] [INFO ] [MAIN ] Update Progress: 1562/2373 symbols completed. NXC took 18.5s. Estimated remaining: 1h 47m 42s. Rate: 7.5 symbols/min [2025-09-24T20:27:30.181304] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:30.205257] [DEBUG] [LOCAL ] NXJ: Loaded 14965 existing records from primary storage. [2025-09-24T20:27:30.205485] [INFO ] [MAIN ] NXJ: Loaded 14965 existing records. [2025-09-24T20:27:30.391087] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:30.391510] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-24T20:27:30.391570] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-24T20:27:30.392423] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-24T20:27:30.392489] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-24T20:27:30.424057] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-24T20:27:30.728830] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T20:27:30.799545] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:31.216124] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-24T20:27:32.016195] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-24T20:27:32.342614] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T20:27:32.378225] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T20:27:32.755921] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T20:27:32.816091] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-24T20:27:33.616093] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-24T20:27:33.628234] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T20:27:34.416079] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-24T20:27:34.656600] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T20:27:35.072043] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T20:27:35.074971] [INFO ] [REMOTE ] NXDT: Full fetch complete (25753 records). [2025-09-24T20:27:35.075076] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-24T20:27:35.222525] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-24T20:27:35.468851] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-24T20:27:35.468935] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-24T20:27:35.469530] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-24T20:27:35.469569] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-24T20:27:35.470230] [DEBUG] [LOCAL ] NXDT: Trimmed 25753 records to 16404 (keeping 200 days of data) [2025-09-24T20:27:35.565281] [DEBUG] [LOCAL ] NXDT: Primary data saved (16404 records). [2025-09-24T20:27:35.565410] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-24T20:27:35.565500] [INFO ] [MAIN ] Update Progress: 1563/2373 symbols completed. NXDT took 24.1s. Estimated remaining: 1h 47m 33s. Rate: 7.5 symbols/min [2025-09-24T20:27:35.735865] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:35.739977] [DEBUG] [LOCAL ] NXN: Loaded 2336 existing records from primary storage. [2025-09-24T20:27:35.740051] [INFO ] [MAIN ] NXN: Loaded 2336 existing records. [2025-09-24T20:27:35.919363] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:35.919804] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-24T20:27:35.919873] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-24T20:27:35.920239] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-24T20:27:35.920319] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-24T20:27:36.021741] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-24T20:27:36.195387] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T20:27:36.297123] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:36.816086] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-24T20:27:37.301989] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T20:27:37.472552] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T20:27:37.616364] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-24T20:27:38.416169] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-24T20:27:38.514952] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T20:27:39.216087] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-24T20:27:39.364756] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T20:27:40.016122] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-24T20:27:40.029728] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T20:27:40.816123] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-24T20:27:41.016274] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T20:27:41.359742] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T20:27:41.616126] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-24T20:27:42.416123] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-24T20:27:42.963091] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T20:27:43.216158] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-24T20:27:43.514734] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T20:27:44.016065] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-24T20:27:44.071887] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:27:44.816166] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-24T20:27:45.616075] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-24T20:27:45.648534] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T20:27:45.979786] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T20:27:46.143969] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T20:27:46.416173] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-24T20:27:47.216115] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-24T20:27:47.241143] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:27:48.016131] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-24T20:27:48.284467] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T20:27:48.816112] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-24T20:27:49.616102] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-24T20:27:49.847222] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T20:27:49.949996] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T20:27:50.143151] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-24T20:27:50.416129] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-24T20:27:51.216130] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-24T20:27:51.247094] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:27:51.249716] [INFO ] [REMOTE ] NXG: Full fetch complete (14319 records). [2025-09-24T20:27:51.249799] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-24T20:27:51.637912] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-24T20:27:51.638001] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-24T20:27:51.638385] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-24T20:27:51.638425] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-24T20:27:51.638954] [DEBUG] [LOCAL ] NXG: Trimmed 14319 records to 10450 (keeping 200 days of data) [2025-09-24T20:27:51.711543] [DEBUG] [LOCAL ] NXG: Primary data saved (10450 records). [2025-09-24T20:27:51.711748] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-24T20:27:51.711904] [INFO ] [MAIN ] Update Progress: 1564/2373 symbols completed. NXG took 23.6s. Estimated remaining: 1h 47m 29s. Rate: 7.5 symbols/min [2025-09-24T20:27:51.905611] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:51.923289] [DEBUG] [LOCAL ] NXP: Loaded 12323 existing records from primary storage. [2025-09-24T20:27:51.923434] [INFO ] [MAIN ] NXP: Loaded 12323 existing records. [2025-09-24T20:27:52.021285] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-24T20:27:52.125974] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:52.126504] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-24T20:27:52.126683] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-24T20:27:52.127208] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-24T20:27:52.127274] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-24T20:27:52.529315] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:52.620050] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:27:52.816090] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-24T20:27:53.103839] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T20:27:53.522766] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T20:27:53.616131] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-24T20:27:54.156871] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T20:27:54.416184] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-24T20:27:55.071283] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T20:27:55.216169] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-24T20:27:56.016127] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-24T20:27:56.072849] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T20:27:56.654764] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T20:27:56.655854] [INFO ] [REMOTE ] NXN: Full fetch complete (3704 records). [2025-09-24T20:27:56.655929] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-24T20:27:56.820882] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-24T20:27:57.047514] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-24T20:27:57.047599] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-24T20:27:57.047749] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-24T20:27:57.047810] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-24T20:27:57.048191] [DEBUG] [LOCAL ] NXN: Trimmed 3704 records to 2363 (keeping 200 days of data) [2025-09-24T20:27:57.064042] [DEBUG] [LOCAL ] NXN: Primary data saved (2363 records). [2025-09-24T20:27:57.064136] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-24T20:27:57.064217] [INFO ] [MAIN ] Update Progress: 1565/2373 symbols completed. NXN took 21.5s. Estimated remaining: 1h 47m 20s. Rate: 7.5 symbols/min [2025-09-24T20:27:57.233290] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:27:57.253238] [DEBUG] [LOCAL ] NXRT: Loaded 19024 existing records from primary storage. [2025-09-24T20:27:57.253381] [INFO ] [MAIN ] NXRT: Loaded 19024 existing records. [2025-09-24T20:27:57.432181] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:27:57.432466] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-24T20:27:57.432516] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-24T20:27:57.433246] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-24T20:27:57.433308] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-24T20:27:57.625023] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-24T20:27:57.795255] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:27:58.416078] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-24T20:27:58.785288] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T20:27:58.803548] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T20:27:59.216184] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-24T20:27:59.369824] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T20:28:00.004519] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T20:28:00.016055] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-24T20:28:00.816109] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-24T20:28:01.084698] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T20:28:01.616093] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-24T20:28:01.802937] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T20:28:02.416184] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-24T20:28:02.754205] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T20:28:03.216115] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-24T20:28:03.485758] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T20:28:04.016198] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-24T20:28:04.816112] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-24T20:28:05.002303] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T20:28:05.243383] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T20:28:05.616128] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-24T20:28:05.872099] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-24T20:28:06.327582] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T20:28:06.416083] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-24T20:28:07.216124] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-24T20:28:07.298241] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T20:28:08.016085] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-24T20:28:08.327772] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T20:28:08.816050] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-24T20:28:09.050502] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T20:28:09.616071] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-24T20:28:09.857316] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T20:28:10.416096] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-24T20:28:10.593949] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T20:28:11.216090] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-24T20:28:12.016116] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-24T20:28:12.143271] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:28:12.146732] [INFO ] [REMOTE ] NXJ: Full fetch complete (21091 records). [2025-09-24T20:28:12.146967] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-24T20:28:12.528325] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T20:28:12.582779] [INFO ] [REMOTE ] NXE: Full fetch complete (76640 records). [2025-09-24T20:28:12.598486] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-24T20:28:12.610545] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-24T20:28:12.610689] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-24T20:28:12.616861] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-24T20:28:12.616972] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-24T20:28:12.684536] [DEBUG] [LOCAL ] NXJ: Trimmed 21091 records to 14949 (keeping 200 days of data) [2025-09-24T20:28:12.826154] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-24T20:28:12.911996] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T20:28:12.962853] [INFO ] [REMOTE ] NXP: Full fetch complete (16700 records). [2025-09-24T20:28:12.984565] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-24T20:28:13.282294] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-24T20:28:13.282451] [DEBUG] [LOCAL ] NXJ: Primary data saved (14949 records). [2025-09-24T20:28:13.287683] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-24T20:28:13.320150] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-24T20:28:13.294590] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-24T20:28:13.361978] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-24T20:28:13.341607] [INFO ] [MAIN ] Update Progress: 1566/2373 symbols completed. NXJ took 43.3s. Estimated remaining: 1h 47m 16s. Rate: 7.5 symbols/min [2025-09-24T20:28:13.533991] [DEBUG] [LOCAL ] NXE: Trimmed 76640 records to 52985 (keeping 200 days of data) [2025-09-24T20:28:13.713272] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-24T20:28:13.773981] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-24T20:28:13.803626] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-24T20:28:13.802753] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:13.804035] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-24T20:28:13.804993] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-24T20:28:13.805281] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-24T20:28:13.806896] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-24T20:28:13.807335] [DEBUG] [LOCAL ] NXP: Trimmed 16700 records to 12326 (keeping 200 days of data) [2025-09-24T20:28:13.807222] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-24T20:28:13.807861] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-24T20:28:13.808498] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-24T20:28:14.210443] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T20:28:14.244293] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-24T20:28:14.309529] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:14.365776] [DEBUG] [LOCAL ] NXP: Primary data saved (12326 records). [2025-09-24T20:28:14.375437] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-24T20:28:14.403232] [INFO ] [MAIN ] Update Progress: 1567/2373 symbols completed. NXP took 22.7s. Estimated remaining: 1h 47m 5s. Rate: 7.5 symbols/min [2025-09-24T20:28:14.417335] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-24T20:28:14.599052] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:14.720358] [DEBUG] [LOCAL ] NYT: Loaded 49929 existing records from primary storage. [2025-09-24T20:28:14.721153] [INFO ] [MAIN ] NYT: Loaded 49929 existing records. [2025-09-24T20:28:14.859078] [DEBUG] [LOCAL ] NXE: Primary data saved (52985 records). [2025-09-24T20:28:14.911408] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-24T20:28:14.919562] [INFO ] [MAIN ] Update Progress: 1568/2373 symbols completed. NXE took 1m 3s. Estimated remaining: 1h 46m 53s. Rate: 7.5 symbols/min [2025-09-24T20:28:14.919724] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-24T20:28:14.919922] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:28:14.921463] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-24T20:28:14.921530] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-24T20:28:15.001154] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-24T20:28:15.026469] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-24T20:28:15.229477] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-24T20:28:15.287875] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:15.511776] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:15.513973] [DEBUG] [LOCAL ] NZF: Loaded 29085 existing records from primary storage. [2025-09-24T20:28:15.514081] [INFO ] [MAIN ] NZF: Loaded 29085 existing records. [2025-09-24T20:28:15.635754] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T20:28:15.715233] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:28:15.715491] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-24T20:28:15.715543] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-24T20:28:15.716599] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-24T20:28:15.716701] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-24T20:28:15.969302] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T20:28:16.021185] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-24T20:28:16.088706] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:16.816111] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-24T20:28:17.616065] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-24T20:28:17.717566] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T20:28:17.993074] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T20:28:18.416085] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-24T20:28:18.826045] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T20:28:19.216094] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-24T20:28:20.016062] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-24T20:28:20.238312] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T20:28:20.726793] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T20:28:20.816069] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-24T20:28:21.121454] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T20:28:21.616155] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-24T20:28:22.416057] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-24T20:28:22.453372] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T20:28:22.475099] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T20:28:22.921403] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T20:28:23.216077] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-24T20:28:24.016087] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-24T20:28:24.517044] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T20:28:24.816117] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-24T20:28:25.034250] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T20:28:25.616091] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-24T20:28:26.220914] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T20:28:26.416102] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-24T20:28:26.769455] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T20:28:27.216083] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-24T20:28:27.708418] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T20:28:28.016106] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-24T20:28:28.284506] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T20:28:28.816105] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-24T20:28:29.496086] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T20:28:29.616111] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-24T20:28:29.816964] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T20:28:29.820790] [INFO ] [REMOTE ] NXRT: Full fetch complete (25151 records). [2025-09-24T20:28:29.820885] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-24T20:28:30.201316] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-24T20:28:30.201414] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-24T20:28:30.202302] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-24T20:28:30.202367] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-24T20:28:30.203737] [DEBUG] [LOCAL ] NXRT: Trimmed 25151 records to 19042 (keeping 200 days of data) [2025-09-24T20:28:30.356096] [DEBUG] [LOCAL ] NXRT: Primary data saved (19042 records). [2025-09-24T20:28:30.356353] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-24T20:28:30.356540] [INFO ] [MAIN ] Update Progress: 1569/2373 symbols completed. NXRT took 33.3s. Estimated remaining: 1h 46m 49s. Rate: 7.5 symbols/min [2025-09-24T20:28:30.424955] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-24T20:28:30.681971] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:30.682351] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-24T20:28:30.682411] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-24T20:28:30.682733] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-24T20:28:30.682824] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-24T20:28:30.682905] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-24T20:28:30.682967] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-24T20:28:30.968902] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T20:28:31.220890] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-24T20:28:31.261868] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:31.296559] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T20:28:31.770065] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T20:28:32.016083] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-24T20:28:32.816100] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-24T20:28:33.286085] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-24T20:28:33.616065] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-24T20:28:33.750196] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T20:28:34.416102] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-24T20:28:34.588357] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T20:28:34.804738] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-24T20:28:35.216102] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-24T20:28:36.016089] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-24T20:28:36.816122] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-24T20:28:37.325142] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T20:28:37.327662] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T20:28:37.334739] [INFO ] [REMOTE ] NYC: Full fetch complete (1917 records). [2025-09-24T20:28:37.334935] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-24T20:28:37.535456] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-24T20:28:37.535873] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:28:37.535972] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:28:37.536074] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-24T20:28:37.536284] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-24T20:28:37.536344] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-24T20:28:37.536403] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-24T20:28:37.536743] [INFO ] [MAIN ] Update Progress: 1570/2373 symbols completed. NYC took 24.1s. Estimated remaining: 1h 46m 40s. Rate: 7.5 symbols/min [2025-09-24T20:28:37.617778] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-24T20:28:37.713569] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:37.778895] [DEBUG] [LOCAL ] OBDC: Loaded 51652 existing records from primary storage. [2025-09-24T20:28:37.779053] [INFO ] [MAIN ] OBDC: Loaded 51652 existing records. [2025-09-24T20:28:37.963237] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:28:37.963753] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-24T20:28:37.963914] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-24T20:28:37.976809] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-24T20:28:37.996978] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-24T20:28:38.063968] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-24T20:28:38.392052] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:38.416104] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-24T20:28:39.037128] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T20:28:39.216153] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-24T20:28:40.016184] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-24T20:28:40.179400] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T20:28:40.619508] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T20:28:40.816089] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-24T20:28:41.616126] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-24T20:28:41.994843] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T20:28:42.416096] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-24T20:28:42.547947] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:28:43.216095] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-24T20:28:43.587001] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-24T20:28:43.990455] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-24T20:28:44.016032] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-24T20:28:44.816170] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-24T20:28:45.032977] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T20:28:45.616179] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-24T20:28:45.780885] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T20:28:45.837738] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T20:28:45.843962] [INFO ] [REMOTE ] NZF: Full fetch complete (43661 records). [2025-09-24T20:28:45.844101] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-24T20:28:46.229374] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-24T20:28:46.229499] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-24T20:28:46.230496] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-24T20:28:46.230584] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-24T20:28:46.232343] [DEBUG] [LOCAL ] NZF: Trimmed 43661 records to 29014 (keeping 200 days of data) [2025-09-24T20:28:46.421523] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-24T20:28:46.443222] [DEBUG] [LOCAL ] NZF: Primary data saved (29014 records). [2025-09-24T20:28:46.443410] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-24T20:28:46.443574] [INFO ] [MAIN ] Update Progress: 1571/2373 symbols completed. NZF took 31.5s. Estimated remaining: 1h 46m 33s. Rate: 7.5 symbols/min [2025-09-24T20:28:46.621307] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:46.642358] [DEBUG] [LOCAL ] OBK: Loaded 16316 existing records from primary storage. [2025-09-24T20:28:46.642512] [INFO ] [MAIN ] OBK: Loaded 16316 existing records. [2025-09-24T20:28:46.820209] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:28:46.820488] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-24T20:28:46.820539] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-24T20:28:46.821298] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-24T20:28:46.821371] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-24T20:28:47.197840] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:47.216168] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-24T20:28:47.924916] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-24T20:28:48.017563] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-24T20:28:48.023739] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T20:28:48.816065] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-24T20:28:48.927107] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T20:28:48.944936] [INFO ] [REMOTE ] NYT: Full fetch complete (72061 records). [2025-09-24T20:28:48.945172] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-24T20:28:49.358565] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-24T20:28:49.358691] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-24T20:28:49.360678] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-24T20:28:49.360743] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-24T20:28:49.362332] [DEBUG] [LOCAL ] NYT: Trimmed 72061 records to 49899 (keeping 200 days of data) [2025-09-24T20:28:49.620399] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-24T20:28:49.691523] [DEBUG] [LOCAL ] NYT: Primary data saved (49899 records). [2025-09-24T20:28:49.692576] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T20:28:49.692204] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-24T20:28:49.692867] [INFO ] [MAIN ] Update Progress: 1572/2373 symbols completed. NYT took 35.3s. Estimated remaining: 1h 46m 23s. Rate: 7.5 symbols/min [2025-09-24T20:28:49.864592] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:28:49.913246] [DEBUG] [LOCAL ] OC: Loaded 44759 existing records from primary storage. [2025-09-24T20:28:49.913395] [INFO ] [MAIN ] OC: Loaded 44759 existing records. [2025-09-24T20:28:50.094117] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:28:50.094913] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-24T20:28:50.094993] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-24T20:28:50.096747] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-24T20:28:50.096819] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-24T20:28:50.421239] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-24T20:28:50.460090] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:28:50.754901] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-24T20:28:51.197552] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:28:51.216027] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-24T20:28:51.564290] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:28:52.016225] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-24T20:28:52.816058] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-24T20:28:53.154964] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T20:28:53.616077] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-24T20:28:53.683446] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:28:54.416175] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-24T20:28:55.216112] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-24T20:28:55.452697] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T20:28:55.498639] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-24T20:28:56.027757] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-24T20:28:56.050919] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T20:28:56.320467] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T20:28:56.816090] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-24T20:28:57.616059] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-24T20:28:57.846426] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T20:28:57.945553] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T20:28:58.416104] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-24T20:28:59.216100] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-24T20:28:59.681308] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T20:29:00.016175] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-24T20:29:00.314989] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-24T20:29:00.816084] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-24T20:29:01.262909] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T20:29:01.533444] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T20:29:01.616063] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-24T20:29:02.416097] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-24T20:29:03.216062] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-24T20:29:03.383399] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T20:29:03.394039] [INFO ] [REMOTE ] OBDC: Full fetch complete (74866 records). [2025-09-24T20:29:03.394200] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-24T20:29:03.820392] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-24T20:29:03.820877] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-24T20:29:03.822314] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-24T20:29:03.822424] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-24T20:29:03.858388] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-24T20:29:03.869579] [DEBUG] [LOCAL ] OBDC: Trimmed 74866 records to 51654 (keeping 200 days of data) [2025-09-24T20:29:04.063587] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-24T20:29:04.227146] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T20:29:04.238114] [DEBUG] [LOCAL ] OBDC: Primary data saved (51654 records). [2025-09-24T20:29:04.238299] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-24T20:29:04.238495] [INFO ] [MAIN ] Update Progress: 1573/2373 symbols completed. OBDC took 26.7s. Estimated remaining: 1h 46m 18s. Rate: 7.5 symbols/min [2025-09-24T20:29:04.430392] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:04.454514] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T20:29:04.471615] [DEBUG] [LOCAL ] OCFT: Loaded 8974 existing records from primary storage. [2025-09-24T20:29:04.471797] [INFO ] [MAIN ] OCFT: Loaded 8974 existing records. [2025-09-24T20:29:04.666315] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:04.666602] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-24T20:29:04.666682] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-24T20:29:04.667166] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-24T20:29:04.667230] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-24T20:29:04.823132] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-24T20:29:05.044120] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:05.616108] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-24T20:29:05.721138] [DEBUG] [REMOTE ] OBK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-24T20:29:05.721512] [WARN ] [REMOTE ] OBK: No data returned for month 2025-07 [2025-09-24T20:29:06.416212] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-24T20:29:06.738287] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T20:29:07.065515] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-24T20:29:07.110769] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T20:29:07.216080] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-24T20:29:08.016100] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-24T20:29:08.220889] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T20:29:08.816091] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-24T20:29:09.616058] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-24T20:29:09.989501] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:29:09.993367] [INFO ] [REMOTE ] OBK: Full fetch complete (21501 records). [2025-09-24T20:29:09.993449] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-24T20:29:10.190829] [WARN ] [VALIDATOR ] OBK: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-24T20:29:10.191353] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:29:10.191449] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:29:10.191539] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-24T20:29:10.191634] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-09-24T20:29:10.191745] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-09-24T20:29:10.192775] [DEBUG] [LOCAL ] OBK: Deleted derivative data file. [2025-09-24T20:29:10.192900] [INFO ] [MAIN ] Update Progress: 1574/2373 symbols completed. OBK took 23.7s. Estimated remaining: 1h 46m 9s. Rate: 7.5 symbols/min [2025-09-24T20:29:10.368529] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:10.378616] [DEBUG] [LOCAL ] ODC: Loaded 8589 existing records from primary storage. [2025-09-24T20:29:10.378754] [INFO ] [MAIN ] ODC: Loaded 8589 existing records. [2025-09-24T20:29:10.421867] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-24T20:29:10.557326] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T20:29:10.570839] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:10.572785] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-24T20:29:10.572844] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-24T20:29:10.573217] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-24T20:29:10.573280] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-24T20:29:10.931095] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:11.216057] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-24T20:29:11.546750] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (3.53 seconds). [2025-09-24T20:29:12.016104] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-24T20:29:12.816185] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-24T20:29:13.592927] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-24T20:29:13.616045] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-24T20:29:13.768690] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T20:29:14.155111] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (3.73 seconds). [2025-09-24T20:29:14.416113] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-24T20:29:15.223142] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-24T20:29:15.254461] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-09-24T20:29:15.264932] [INFO ] [REMOTE ] O: Full fetch complete (77558 records). [2025-09-24T20:29:15.265147] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-24T20:29:15.494816] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:29:15.496077] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:29:15.496222] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:29:15.496291] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-24T20:29:15.496387] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-24T20:29:15.496432] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-24T20:29:15.496477] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-24T20:29:15.496577] [INFO ] [MAIN ] Update Progress: 1575/2373 symbols completed. O took 45.1s. Estimated remaining: 1h 45m 60s. Rate: 7.5 symbols/min [2025-09-24T20:29:15.687826] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:15.719384] [DEBUG] [LOCAL ] ODV: Loaded 25476 existing records from primary storage. [2025-09-24T20:29:15.719578] [INFO ] [MAIN ] ODV: Loaded 25476 existing records. [2025-09-24T20:29:15.914553] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:15.914972] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-24T20:29:15.915115] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-24T20:29:15.916249] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-24T20:29:15.916334] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-24T20:29:16.134237] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T20:29:16.156377] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-24T20:29:16.332211] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:16.360801] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T20:29:16.763309] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-24T20:29:16.816076] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-24T20:29:17.616059] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-24T20:29:17.656511] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T20:29:18.416091] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-24T20:29:18.706522] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T20:29:18.947619] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (5.33 seconds). [2025-09-24T20:29:19.216099] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-24T20:29:20.017740] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-24T20:29:20.021045] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T20:29:20.075009] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:29:20.629335] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-24T20:29:20.816101] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-24T20:29:21.616106] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-24T20:29:21.737067] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T20:29:22.416101] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-24T20:29:22.547562] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T20:29:23.216206] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-24T20:29:23.395924] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T20:29:24.016210] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-24T20:29:24.816101] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-24T20:29:25.417956] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T20:29:25.565820] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:29:25.595879] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-24T20:29:25.616090] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-24T20:29:26.416096] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-24T20:29:26.752264] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T20:29:27.196902] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T20:29:27.216030] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-24T20:29:27.830666] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T20:29:28.016085] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-24T20:29:28.565710] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T20:29:28.567230] [INFO ] [REMOTE ] OCFT: Full fetch complete (11840 records). [2025-09-24T20:29:28.567302] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-24T20:29:28.821228] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-24T20:29:28.993625] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-24T20:29:28.993738] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-24T20:29:28.994054] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-24T20:29:28.994092] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-24T20:29:28.994588] [DEBUG] [LOCAL ] OCFT: Trimmed 11840 records to 8892 (keeping 200 days of data) [2025-09-24T20:29:29.045679] [DEBUG] [LOCAL ] OCFT: Primary data saved (8892 records). [2025-09-24T20:29:29.045838] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-24T20:29:29.045953] [INFO ] [MAIN ] Update Progress: 1576/2373 symbols completed. OCFT took 24.8s. Estimated remaining: 1h 45m 54s. Rate: 7.5 symbols/min [2025-09-24T20:29:29.223715] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:29.262350] [DEBUG] [LOCAL ] OEC: Loaded 37160 existing records from primary storage. [2025-09-24T20:29:29.262491] [INFO ] [MAIN ] OEC: Loaded 37160 existing records. [2025-09-24T20:29:29.444312] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:29.444577] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-24T20:29:29.444625] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-24T20:29:29.445825] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-24T20:29:29.445886] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-24T20:29:29.625843] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-24T20:29:29.818811] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:29.867245] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-24T20:29:30.198758] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T20:29:30.416088] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-24T20:29:31.216088] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-24T20:29:31.959138] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:29:32.016094] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-24T20:29:32.816922] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-24T20:29:32.818509] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T20:29:33.414720] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T20:29:33.616097] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-24T20:29:33.706267] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T20:29:34.416090] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-24T20:29:35.216103] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-24T20:29:35.347195] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T20:29:35.355525] [INFO ] [REMOTE ] OC: Full fetch complete (64067 records). [2025-09-24T20:29:35.355639] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-24T20:29:35.497041] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T20:29:35.759008] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-24T20:29:35.759107] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-24T20:29:35.760203] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-24T20:29:35.760272] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-24T20:29:35.761598] [DEBUG] [LOCAL ] OC: Trimmed 64067 records to 44705 (keeping 200 days of data) [2025-09-24T20:29:36.017753] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-24T20:29:36.050670] [DEBUG] [LOCAL ] OC: Primary data saved (44705 records). [2025-09-24T20:29:36.050951] [INFO ] [MAIN ] OC: Full history saved. [2025-09-24T20:29:36.051048] [INFO ] [MAIN ] Update Progress: 1577/2373 symbols completed. OC took 46.4s. Estimated remaining: 1h 45m 46s. Rate: 7.5 symbols/min [2025-09-24T20:29:36.187602] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T20:29:36.237084] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:36.259791] [DEBUG] [LOCAL ] OFG: Loaded 22215 existing records from primary storage. [2025-09-24T20:29:36.260006] [INFO ] [MAIN ] OFG: Loaded 22215 existing records. [2025-09-24T20:29:36.436191] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:36.436461] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-24T20:29:36.436511] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-24T20:29:36.437170] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-24T20:29:36.437231] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-24T20:29:36.795365] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:36.816117] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-24T20:29:37.586946] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T20:29:37.616039] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-24T20:29:38.085744] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T20:29:38.416115] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-24T20:29:39.114393] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T20:29:39.216087] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-24T20:29:39.318660] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-24T20:29:40.016166] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-24T20:29:40.362746] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T20:29:40.816104] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-24T20:29:40.930710] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T20:29:41.616096] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-24T20:29:42.274279] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T20:29:42.416176] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-24T20:29:42.504806] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T20:29:42.506972] [INFO ] [REMOTE ] ODC: Full fetch complete (10950 records). [2025-09-24T20:29:42.507046] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-24T20:29:42.880994] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-24T20:29:42.881077] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-24T20:29:42.881395] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-24T20:29:42.881436] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-24T20:29:42.881993] [DEBUG] [LOCAL ] ODC: Trimmed 10950 records to 8547 (keeping 200 days of data) [2025-09-24T20:29:42.935201] [DEBUG] [LOCAL ] ODC: Primary data saved (8547 records). [2025-09-24T20:29:42.935336] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-24T20:29:42.935427] [INFO ] [MAIN ] Update Progress: 1578/2373 symbols completed. ODC took 32.7s. Estimated remaining: 1h 45m 37s. Rate: 7.5 symbols/min [2025-09-24T20:29:43.113794] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:43.169849] [DEBUG] [LOCAL ] OGE: Loaded 46423 existing records from primary storage. [2025-09-24T20:29:43.170003] [INFO ] [MAIN ] OGE: Loaded 46423 existing records. [2025-09-24T20:29:43.224999] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-24T20:29:43.355005] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:43.355286] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-24T20:29:43.355385] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-24T20:29:43.356912] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-24T20:29:43.356976] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-24T20:29:43.725042] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:44.016090] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-24T20:29:44.082451] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T20:29:44.596244] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T20:29:44.816126] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-24T20:29:45.411974] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-24T20:29:45.619257] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-24T20:29:46.416079] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-24T20:29:46.525050] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T20:29:47.037215] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T20:29:47.044400] [INFO ] [REMOTE ] ODV: Full fetch complete (31971 records). [2025-09-24T20:29:47.044500] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-24T20:29:47.221561] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-24T20:29:47.447566] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-24T20:29:47.447723] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-24T20:29:47.448673] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-24T20:29:47.448803] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-24T20:29:47.449889] [DEBUG] [LOCAL ] ODV: Trimmed 31971 records to 25728 (keeping 200 days of data) [2025-09-24T20:29:47.558323] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T20:29:47.639431] [DEBUG] [LOCAL ] ODV: Primary data saved (25728 records). [2025-09-24T20:29:47.639588] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-24T20:29:47.639730] [INFO ] [MAIN ] Update Progress: 1579/2373 symbols completed. ODV took 32.1s. Estimated remaining: 1h 45m 28s. Rate: 7.5 symbols/min [2025-09-24T20:29:47.810489] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:47.867946] [DEBUG] [LOCAL ] OGN: Loaded 53127 existing records from primary storage. [2025-09-24T20:29:47.868107] [INFO ] [MAIN ] OGN: Loaded 53127 existing records. [2025-09-24T20:29:48.022188] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-24T20:29:48.056753] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:48.057048] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-24T20:29:48.057116] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-24T20:29:48.058791] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-24T20:29:48.058859] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-24T20:29:48.430851] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:29:48.449265] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T20:29:48.816110] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-24T20:29:49.616068] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-24T20:29:49.934326] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T20:29:49.995438] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T20:29:50.416119] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-24T20:29:51.216064] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-24T20:29:51.266794] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T20:29:51.574589] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T20:29:52.019452] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-24T20:29:52.662500] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:29:52.816085] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-24T20:29:53.616056] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-24T20:29:53.775054] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T20:29:53.991602] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T20:29:54.416156] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-24T20:29:55.149316] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T20:29:55.216071] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-24T20:29:55.306872] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T20:29:56.016126] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-24T20:29:56.816065] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-24T20:29:56.890527] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:29:57.227230] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T20:29:57.616052] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-24T20:29:57.891193] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T20:29:57.897472] [INFO ] [REMOTE ] OEC: Full fetch complete (52586 records). [2025-09-24T20:29:57.897572] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-24T20:29:58.272201] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-24T20:29:58.272288] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-24T20:29:58.273213] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-24T20:29:58.273277] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-24T20:29:58.274396] [DEBUG] [LOCAL ] OEC: Trimmed 52586 records to 37158 (keeping 200 days of data) [2025-09-24T20:29:58.444454] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-24T20:29:58.509125] [DEBUG] [LOCAL ] OEC: Primary data saved (37158 records). [2025-09-24T20:29:58.509256] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-24T20:29:58.509345] [INFO ] [MAIN ] Update Progress: 1580/2373 symbols completed. OEC took 29.5s. Estimated remaining: 1h 45m 21s. Rate: 7.5 symbols/min [2025-09-24T20:29:58.697572] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:29:58.733923] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T20:29:58.751676] [DEBUG] [LOCAL ] OGS: Loaded 33914 existing records from primary storage. [2025-09-24T20:29:58.751845] [INFO ] [MAIN ] OGS: Loaded 33914 existing records. [2025-09-24T20:29:58.948158] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:29:58.948542] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-24T20:29:58.948601] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-24T20:29:58.949780] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-24T20:29:58.949845] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-24T20:29:59.221319] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-24T20:29:59.345722] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:00.016233] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-24T20:30:00.216093] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T20:30:00.239245] [INFO ] [REMOTE ] OFG: Full fetch complete (34487 records). [2025-09-24T20:30:00.250236] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-24T20:30:00.253256] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T20:30:00.662522] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-24T20:30:00.662612] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-24T20:30:00.663538] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-24T20:30:00.663606] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-24T20:30:00.664498] [DEBUG] [LOCAL ] OFG: Trimmed 34487 records to 22099 (keeping 200 days of data) [2025-09-24T20:30:00.804094] [DEBUG] [LOCAL ] OFG: Primary data saved (22099 records). [2025-09-24T20:30:00.804246] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-24T20:30:00.804371] [INFO ] [MAIN ] Update Progress: 1581/2373 symbols completed. OFG took 24.8s. Estimated remaining: 1h 45m 11s. Rate: 7.5 symbols/min [2025-09-24T20:30:00.826491] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-24T20:30:00.988956] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:01.041511] [DEBUG] [LOCAL ] OHI: Loaded 52107 existing records from primary storage. [2025-09-24T20:30:01.041718] [INFO ] [MAIN ] OHI: Loaded 52107 existing records. [2025-09-24T20:30:01.231609] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:01.231957] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-24T20:30:01.232013] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-24T20:30:01.233722] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-24T20:30:01.233785] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-24T20:30:01.610715] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:01.616034] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-24T20:30:02.329420] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-24T20:30:02.416169] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-24T20:30:03.216184] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-24T20:30:03.956248] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-24T20:30:04.016099] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-24T20:30:04.336285] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-24T20:30:04.816197] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-24T20:30:05.159806] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-24T20:30:05.616177] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-24T20:30:05.705705] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-24T20:30:05.914005] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T20:30:06.416102] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-24T20:30:06.533613] [DEBUG] [REMOTE ] OGE: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-24T20:30:06.534108] [WARN ] [REMOTE ] OGE: No data returned for month 2025-06 [2025-09-24T20:30:06.802018] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T20:30:06.854241] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T20:30:07.216176] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-24T20:30:08.016211] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-24T20:30:08.816066] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-24T20:30:09.235199] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T20:30:09.616059] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-24T20:30:09.795320] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T20:30:09.960312] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T20:30:10.416094] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-24T20:30:11.216086] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-24T20:30:11.344686] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T20:30:11.715477] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T20:30:12.016113] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-24T20:30:12.816100] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-24T20:30:13.191183] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T20:30:13.421561] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T20:30:13.616179] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-24T20:30:14.416113] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-24T20:30:15.216096] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-24T20:30:15.767577] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-24T20:30:16.016118] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-24T20:30:16.757296] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (3.14 seconds). [2025-09-24T20:30:16.765332] [INFO ] [REMOTE ] OGE: Full fetch complete (59788 records). [2025-09-24T20:30:16.765485] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-24T20:30:16.956819] [WARN ] [VALIDATOR ] OGE: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T20:30:16.957477] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:30:16.957551] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:30:16.957603] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-24T20:30:16.957717] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-09-24T20:30:16.957777] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-09-24T20:30:16.958490] [DEBUG] [LOCAL ] OGE: Deleted derivative data file. [2025-09-24T20:30:16.958595] [INFO ] [MAIN ] Update Progress: 1582/2373 symbols completed. OGE took 34.0s. Estimated remaining: 1h 45m 7s. Rate: 7.5 symbols/min [2025-09-24T20:30:17.130623] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:17.178511] [DEBUG] [LOCAL ] OI: Loaded 47375 existing records from primary storage. [2025-09-24T20:30:17.178702] [INFO ] [MAIN ] OI: Loaded 47375 existing records. [2025-09-24T20:30:17.361909] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:17.362556] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-24T20:30:17.362615] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-24T20:30:17.363632] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-24T20:30:17.363726] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-24T20:30:17.696400] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T20:30:17.722556] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-24T20:30:17.836885] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (3.42 seconds). [2025-09-24T20:30:17.843868] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:17.888295] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-24T20:30:17.901842] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T20:30:18.416155] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-24T20:30:19.216110] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-24T20:30:19.320727] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T20:30:19.687138] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T20:30:20.016181] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-24T20:30:20.296553] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T20:30:20.305994] [INFO ] [REMOTE ] OGN: Full fetch complete (76811 records). [2025-09-24T20:30:20.306179] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-24T20:30:20.700241] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-24T20:30:20.700337] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-24T20:30:20.701472] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-24T20:30:20.701538] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-24T20:30:20.703186] [DEBUG] [LOCAL ] OGN: Trimmed 76811 records to 53116 (keeping 200 days of data) [2025-09-24T20:30:20.816275] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-24T20:30:21.049459] [DEBUG] [LOCAL ] OGN: Primary data saved (53116 records). [2025-09-24T20:30:21.049684] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-24T20:30:21.049811] [INFO ] [MAIN ] Update Progress: 1583/2373 symbols completed. OGN took 33.4s. Estimated remaining: 1h 44m 57s. Rate: 7.5 symbols/min [2025-09-24T20:30:21.222595] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:21.237932] [DEBUG] [LOCAL ] OIA: Loaded 14010 existing records from primary storage. [2025-09-24T20:30:21.238071] [INFO ] [MAIN ] OIA: Loaded 14010 existing records. [2025-09-24T20:30:21.430001] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:21.430328] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-24T20:30:21.430437] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-24T20:30:21.431116] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-24T20:30:21.431182] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-24T20:30:21.597361] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T20:30:21.692025] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-24T20:30:21.861604] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T20:30:21.901241] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:22.310385] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T20:30:22.416122] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-24T20:30:23.216050] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-24T20:30:23.424997] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T20:30:23.835674] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T20:30:24.016091] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-24T20:30:24.777560] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T20:30:24.816084] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-24T20:30:25.165078] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T20:30:25.616102] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-24T20:30:26.416100] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-24T20:30:26.585221] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T20:30:26.741272] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T20:30:27.216084] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-24T20:30:27.955847] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T20:30:28.016096] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-24T20:30:28.816108] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-24T20:30:29.067304] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T20:30:29.267803] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T20:30:29.273499] [INFO ] [REMOTE ] OGS: Full fetch complete (47943 records). [2025-09-24T20:30:29.273631] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-24T20:30:29.621195] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-24T20:30:29.664124] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-24T20:30:29.664214] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-24T20:30:29.665150] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-24T20:30:29.665215] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-24T20:30:29.667108] [DEBUG] [LOCAL ] OGS: Trimmed 47943 records to 33933 (keeping 200 days of data) [2025-09-24T20:30:29.889540] [DEBUG] [LOCAL ] OGS: Primary data saved (33933 records). [2025-09-24T20:30:29.889729] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-24T20:30:29.889866] [INFO ] [MAIN ] Update Progress: 1584/2373 symbols completed. OGS took 31.4s. Estimated remaining: 1h 44m 49s. Rate: 7.5 symbols/min [2025-09-24T20:30:30.059462] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:30.106904] [DEBUG] [LOCAL ] OII: Loaded 42945 existing records from primary storage. [2025-09-24T20:30:30.107092] [INFO ] [MAIN ] OII: Loaded 42945 existing records. [2025-09-24T20:30:30.285392] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:30.285720] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-24T20:30:30.285779] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-24T20:30:30.286847] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-24T20:30:30.286919] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-24T20:30:30.434033] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-24T20:30:30.664704] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:30.726565] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T20:30:30.728461] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T20:30:31.216078] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-24T20:30:32.016062] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-24T20:30:32.092374] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:30:32.816048] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-24T20:30:33.362410] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T20:30:33.616159] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-24T20:30:33.679742] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T20:30:34.416126] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-24T20:30:34.552697] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T20:30:35.216267] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-24T20:30:35.316895] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T20:30:35.651076] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T20:30:36.016163] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-24T20:30:36.816170] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-24T20:30:36.887922] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T20:30:37.555673] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T20:30:37.614278] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T20:30:37.622525] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-24T20:30:38.416113] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-24T20:30:39.216092] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-24T20:30:39.484165] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T20:30:39.493412] [INFO ] [REMOTE ] OHI: Full fetch complete (75128 records). [2025-09-24T20:30:39.493604] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-24T20:30:39.926249] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-24T20:30:39.926438] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-24T20:30:39.927707] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-24T20:30:39.927790] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-24T20:30:39.931631] [DEBUG] [LOCAL ] OHI: Trimmed 75128 records to 52100 (keeping 200 days of data) [2025-09-24T20:30:40.016966] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-24T20:30:40.220620] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:30:40.337470] [DEBUG] [LOCAL ] OHI: Primary data saved (52100 records). [2025-09-24T20:30:40.337683] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-24T20:30:40.337880] [INFO ] [MAIN ] Update Progress: 1585/2373 symbols completed. OHI took 39.5s. Estimated remaining: 1h 44m 42s. Rate: 7.5 symbols/min [2025-09-24T20:30:40.525634] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:40.569001] [DEBUG] [LOCAL ] OIS: Loaded 40687 existing records from primary storage. [2025-09-24T20:30:40.569163] [INFO ] [MAIN ] OIS: Loaded 40687 existing records. [2025-09-24T20:30:40.781184] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:40.781597] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-24T20:30:40.781806] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-24T20:30:40.782794] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-24T20:30:40.782874] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-24T20:30:40.826840] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-24T20:30:41.148611] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:30:41.165569] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T20:30:41.219869] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:41.616159] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-24T20:30:42.416065] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-24T20:30:42.520966] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T20:30:43.143518] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-24T20:30:43.216036] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-24T20:30:43.234155] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T20:30:44.016120] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-24T20:30:44.638626] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T20:30:44.816123] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-24T20:30:44.993239] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T20:30:45.616156] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-24T20:30:46.248505] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T20:30:46.416207] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-24T20:30:46.487096] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T20:30:47.216167] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-24T20:30:47.622171] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T20:30:48.016200] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-24T20:30:48.035902] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T20:30:48.816096] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-24T20:30:49.522830] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T20:30:49.616120] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-24T20:30:50.416164] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-24T20:30:50.460161] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:30:50.469365] [INFO ] [REMOTE ] OI: Full fetch complete (68281 records). [2025-09-24T20:30:50.469516] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-24T20:30:50.868286] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-24T20:30:50.868379] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-24T20:30:50.869419] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-24T20:30:50.869514] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-24T20:30:50.871895] [DEBUG] [LOCAL ] OI: Trimmed 68281 records to 47344 (keeping 200 days of data) [2025-09-24T20:30:51.181476] [DEBUG] [LOCAL ] OI: Primary data saved (47344 records). [2025-09-24T20:30:51.181670] [INFO ] [MAIN ] OI: Full history saved. [2025-09-24T20:30:51.181831] [INFO ] [MAIN ] Update Progress: 1586/2373 symbols completed. OI took 34.2s. Estimated remaining: 1h 44m 36s. Rate: 7.5 symbols/min [2025-09-24T20:30:51.221284] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-24T20:30:51.366183] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:51.397982] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T20:30:51.459579] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-24T20:30:51.459792] [INFO ] [MAIN ] OKE: Loaded 53536 existing records. [2025-09-24T20:30:51.642282] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:30:51.642608] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-24T20:30:51.642705] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-24T20:30:51.644035] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-24T20:30:51.644106] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-24T20:30:52.019573] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-24T20:30:52.098888] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:52.127591] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T20:30:52.267768] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T20:30:52.272393] [INFO ] [REMOTE ] OIA: Full fetch complete (21198 records). [2025-09-24T20:30:52.272471] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-24T20:30:52.635745] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-24T20:30:52.635829] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-24T20:30:52.636310] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-24T20:30:52.636371] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-24T20:30:52.637818] [DEBUG] [LOCAL ] OIA: Trimmed 21198 records to 14019 (keeping 200 days of data) [2025-09-24T20:30:52.735421] [DEBUG] [LOCAL ] OIA: Primary data saved (14019 records). [2025-09-24T20:30:52.736157] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-24T20:30:52.736430] [INFO ] [MAIN ] Update Progress: 1587/2373 symbols completed. OIA took 31.7s. Estimated remaining: 1h 44m 25s. Rate: 7.5 symbols/min [2025-09-24T20:30:52.821379] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-24T20:30:52.913359] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:30:52.913528] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-24T20:30:52.913570] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-24T20:30:52.913771] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-24T20:30:52.913817] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-24T20:30:52.913858] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-24T20:30:52.913892] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-24T20:30:53.267615] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:30:53.616176] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-24T20:30:53.819282] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T20:30:54.297115] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T20:30:54.416044] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-24T20:30:55.216120] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-24T20:30:56.016099] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-24T20:30:56.161042] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T20:30:56.217238] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-24T20:30:56.821171] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-24T20:30:56.840865] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T20:30:57.616078] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-24T20:30:57.690984] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:30:58.416169] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-24T20:30:59.125128] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T20:30:59.136226] [INFO ] [REMOTE ] OII: Full fetch complete (62094 records). [2025-09-24T20:30:59.136369] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-24T20:30:59.219677] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-24T20:30:59.463116] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-24T20:30:59.589252] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-24T20:30:59.589351] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-24T20:30:59.590461] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-24T20:30:59.590526] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-24T20:30:59.591808] [DEBUG] [LOCAL ] OII: Trimmed 62094 records to 42843 (keeping 200 days of data) [2025-09-24T20:30:59.857567] [DEBUG] [LOCAL ] OII: Primary data saved (42843 records). [2025-09-24T20:30:59.857758] [INFO ] [MAIN ] OII: Full history saved. [2025-09-24T20:30:59.857902] [INFO ] [MAIN ] Update Progress: 1588/2373 symbols completed. OII took 30.0s. Estimated remaining: 1h 44m 16s. Rate: 7.5 symbols/min [2025-09-24T20:31:00.020231] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-24T20:31:00.049706] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:00.098407] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T20:31:00.151057] [DEBUG] [LOCAL ] OLN: Loaded 51742 existing records from primary storage. [2025-09-24T20:31:00.151220] [INFO ] [MAIN ] OLN: Loaded 51742 existing records. [2025-09-24T20:31:00.336626] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:00.336947] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-24T20:31:00.336998] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-24T20:31:00.339125] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-24T20:31:00.339190] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-24T20:31:00.716062] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:00.816090] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-24T20:31:01.400001] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T20:31:01.616161] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-24T20:31:02.416070] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-24T20:31:02.584986] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T20:31:02.767025] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-24T20:31:03.185451] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T20:31:03.216062] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-24T20:31:03.907516] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T20:31:04.016096] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-24T20:31:04.816073] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-24T20:31:04.939308] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T20:31:05.593118] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:31:05.616062] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-24T20:31:06.164157] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T20:31:06.170504] [INFO ] [REMOTE ] OIS: Full fetch complete (56998 records). [2025-09-24T20:31:06.170678] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-24T20:31:06.424305] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-24T20:31:06.577470] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-24T20:31:06.577568] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-24T20:31:06.578625] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-24T20:31:06.578718] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-24T20:31:06.580102] [DEBUG] [LOCAL ] OIS: Trimmed 56998 records to 40610 (keeping 200 days of data) [2025-09-24T20:31:06.837023] [DEBUG] [LOCAL ] OIS: Primary data saved (40610 records). [2025-09-24T20:31:06.837161] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-24T20:31:06.837266] [INFO ] [MAIN ] Update Progress: 1589/2373 symbols completed. OIS took 26.5s. Estimated remaining: 1h 44m 8s. Rate: 7.5 symbols/min [2025-09-24T20:31:07.012628] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:07.024544] [DEBUG] [LOCAL ] OLP: Loaded 9720 existing records from primary storage. [2025-09-24T20:31:07.024707] [INFO ] [MAIN ] OLP: Loaded 9720 existing records. [2025-09-24T20:31:07.202163] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:07.202444] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-24T20:31:07.202493] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-24T20:31:07.202943] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-24T20:31:07.203009] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-24T20:31:07.226871] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-24T20:31:07.608732] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:07.657305] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-24T20:31:08.016340] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-24T20:31:08.816114] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-24T20:31:09.039106] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T20:31:09.281470] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-24T20:31:09.616060] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-24T20:31:09.863944] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T20:31:10.165433] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T20:31:10.416096] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-24T20:31:11.216091] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-24T20:31:11.303247] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T20:31:12.016161] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-24T20:31:12.525616] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-24T20:31:12.661825] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T20:31:12.816079] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-24T20:31:13.616092] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-24T20:31:14.069014] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T20:31:14.284417] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T20:31:14.416078] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-24T20:31:14.482160] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T20:31:15.216098] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-24T20:31:16.016165] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-24T20:31:16.234476] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T20:31:16.816087] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-24T20:31:17.308859] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-24T20:31:17.616086] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-24T20:31:18.416053] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-24T20:31:18.562931] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T20:31:18.676246] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T20:31:18.766999] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-24T20:31:19.216088] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-24T20:31:20.016070] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-24T20:31:20.102956] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T20:31:20.357159] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:31:20.816096] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-24T20:31:21.456269] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T20:31:21.616094] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-24T20:31:21.655911] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T20:31:22.416097] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-24T20:31:23.216179] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-24T20:31:24.016073] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-24T20:31:24.259027] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T20:31:24.268483] [INFO ] [REMOTE ] OKE: Full fetch complete (77485 records). [2025-09-24T20:31:24.268699] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-24T20:31:24.730967] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T20:31:24.734698] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-24T20:31:24.734894] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-24T20:31:24.739740] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-24T20:31:24.739925] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-24T20:31:24.742227] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-09-24T20:31:24.755407] [DEBUG] [LOCAL ] OKE: Trimmed 77485 records to 53536 (keeping 200 days of data) [2025-09-24T20:31:24.832907] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-24T20:31:24.891760] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T20:31:25.146105] [DEBUG] [LOCAL ] OKE: Primary data saved (53536 records). [2025-09-24T20:31:25.146288] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-24T20:31:25.146405] [INFO ] [MAIN ] Update Progress: 1590/2373 symbols completed. OKE took 34.0s. Estimated remaining: 1h 44m 5s. Rate: 7.5 symbols/min [2025-09-24T20:31:25.318909] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:25.371918] [DEBUG] [LOCAL ] OMC: Loaded 53294 existing records from primary storage. [2025-09-24T20:31:25.372122] [INFO ] [MAIN ] OMC: Loaded 53294 existing records. [2025-09-24T20:31:25.555386] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:25.555639] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-24T20:31:25.555724] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-24T20:31:25.557011] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-24T20:31:25.557076] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-24T20:31:25.623344] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-24T20:31:25.853090] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T20:31:25.933167] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:26.416162] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-24T20:31:27.216088] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-24T20:31:28.016188] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-24T20:31:28.075185] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T20:31:28.247376] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T20:31:28.268075] [INFO ] [REMOTE ] OLN: Full fetch complete (74522 records). [2025-09-24T20:31:28.268421] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-24T20:31:28.817725] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-24T20:31:28.939141] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-24T20:31:28.939354] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-24T20:31:28.940618] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-24T20:31:28.940858] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-24T20:31:28.984712] [DEBUG] [LOCAL ] OLN: Trimmed 74522 records to 51739 (keeping 200 days of data) [2025-09-24T20:31:28.989029] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-09-24T20:31:29.349753] [DEBUG] [LOCAL ] OLN: Primary data saved (51739 records). [2025-09-24T20:31:29.349898] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-24T20:31:29.349987] [INFO ] [MAIN ] Update Progress: 1591/2373 symbols completed. OLN took 29.5s. Estimated remaining: 1h 43m 55s. Rate: 7.5 symbols/min [2025-09-24T20:31:29.523547] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:29.567912] [DEBUG] [LOCAL ] OMF: Loaded 46272 existing records from primary storage. [2025-09-24T20:31:29.568080] [INFO ] [MAIN ] OMF: Loaded 46272 existing records. [2025-09-24T20:31:29.634163] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-24T20:31:29.691112] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T20:31:29.737783] [INFO ] [REMOTE ] OLP: Full fetch complete (14014 records). [2025-09-24T20:31:29.778500] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-24T20:31:29.787548] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:29.802859] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-24T20:31:29.826911] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-24T20:31:29.856087] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-24T20:31:29.868164] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-24T20:31:30.571110] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-24T20:31:30.580873] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-24T20:31:30.605265] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-24T20:31:30.610514] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-24T20:31:30.610399] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:30.611622] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-24T20:31:30.613161] [DEBUG] [LOCAL ] OLP: Trimmed 14014 records to 9752 (keeping 200 days of data) [2025-09-24T20:31:30.702162] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-24T20:31:30.737628] [DEBUG] [LOCAL ] OLP: Primary data saved (9752 records). [2025-09-24T20:31:30.737826] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-24T20:31:30.737942] [INFO ] [MAIN ] Update Progress: 1592/2373 symbols completed. OLP took 23.9s. Estimated remaining: 1h 43m 44s. Rate: 7.5 symbols/min [2025-09-24T20:31:30.918006] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:30.962615] [DEBUG] [LOCAL ] OMI: Loaded 45856 existing records from primary storage. [2025-09-24T20:31:30.962792] [INFO ] [MAIN ] OMI: Loaded 45856 existing records. [2025-09-24T20:31:31.142787] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:31.143051] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-24T20:31:31.143109] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-24T20:31:31.144214] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-24T20:31:31.144277] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-24T20:31:31.221198] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-24T20:31:31.508821] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:32.016120] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-24T20:31:32.307097] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T20:31:32.595374] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.96 seconds). [2025-09-24T20:31:32.816050] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-24T20:31:33.005313] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T20:31:33.245629] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-24T20:31:33.616098] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-24T20:31:34.328895] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T20:31:34.416230] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-24T20:31:34.977836] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T20:31:35.216285] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-24T20:31:36.016096] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-24T20:31:36.106890] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T20:31:36.116688] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-24T20:31:36.116847] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-24T20:31:36.117971] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:31:36.118063] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:31:36.118108] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:31:36.118176] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-24T20:31:36.118246] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-24T20:31:36.118308] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-24T20:31:36.118351] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-24T20:31:36.118427] [INFO ] [MAIN ] Update Progress: 1593/2373 symbols completed. OKLO took 43.4s. Estimated remaining: 1h 43m 35s. Rate: 7.5 symbols/min [2025-09-24T20:31:36.291323] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:36.330030] [DEBUG] [LOCAL ] ONIT: Loaded 7783 existing records from primary storage. [2025-09-24T20:31:36.330194] [INFO ] [MAIN ] ONIT: Loaded 7783 existing records. [2025-09-24T20:31:36.402385] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T20:31:36.524602] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:36.524905] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-24T20:31:36.524956] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-24T20:31:36.525292] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-24T20:31:36.525353] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-24T20:31:36.821253] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-24T20:31:36.882329] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:37.616060] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-24T20:31:37.647321] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T20:31:38.416059] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-24T20:31:38.668964] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T20:31:38.931801] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-24T20:31:39.216105] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-24T20:31:39.374920] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T20:31:40.016104] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-24T20:31:40.772535] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-24T20:31:40.816063] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-24T20:31:41.005894] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:31:41.619423] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-24T20:31:42.416179] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-24T20:31:42.800251] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T20:31:43.216160] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-24T20:31:43.344365] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:31:43.932756] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T20:31:44.016089] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-24T20:31:44.816107] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-24T20:31:45.123126] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T20:31:45.616094] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-24T20:31:45.780453] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T20:31:46.416057] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-24T20:31:46.555284] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T20:31:47.216106] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-24T20:31:47.460165] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T20:31:47.541768] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:31:48.016087] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-24T20:31:48.816143] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-24T20:31:48.952054] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T20:31:49.595067] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T20:31:49.616069] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-24T20:31:49.966963] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T20:31:50.212303] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T20:31:50.416103] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-24T20:31:51.216089] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-24T20:31:52.016119] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-24T20:31:52.212755] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T20:31:52.821166] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-24T20:31:52.837586] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T20:31:52.869996] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T20:31:53.616095] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-24T20:31:54.270249] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:31:54.416085] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-24T20:31:55.216116] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-24T20:31:55.449124] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T20:31:55.458592] [INFO ] [REMOTE ] OMC: Full fetch complete (76856 records). [2025-09-24T20:31:55.458805] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-24T20:31:55.863697] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-24T20:31:55.863834] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-24T20:31:55.865125] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-24T20:31:55.865235] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-24T20:31:55.867765] [DEBUG] [LOCAL ] OMC: Trimmed 76856 records to 53292 (keeping 200 days of data) [2025-09-24T20:31:56.004074] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T20:31:56.016252] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-24T20:31:56.166686] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-24T20:31:56.293166] [DEBUG] [LOCAL ] OMC: Primary data saved (53292 records). [2025-09-24T20:31:56.293366] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-24T20:31:56.293470] [INFO ] [MAIN ] Update Progress: 1594/2373 symbols completed. OMC took 31.1s. Estimated remaining: 1h 43m 33s. Rate: 7.5 symbols/min [2025-09-24T20:31:56.461943] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:56.496623] [DEBUG] [LOCAL ] ONL: Loaded 31829 existing records from primary storage. [2025-09-24T20:31:56.496800] [INFO ] [MAIN ] ONL: Loaded 31829 existing records. [2025-09-24T20:31:56.675281] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:56.675513] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-24T20:31:56.675561] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-24T20:31:56.679832] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-24T20:31:56.679899] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-24T20:31:56.821138] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-24T20:31:56.948780] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T20:31:57.062802] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:31:57.616197] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-24T20:31:58.416047] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-24T20:31:58.582243] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T20:31:58.591180] [INFO ] [REMOTE ] OMI: Full fetch complete (63813 records). [2025-09-24T20:31:58.591313] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-24T20:31:58.958555] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T20:31:59.019897] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-24T20:31:59.019986] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-24T20:31:59.021002] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-24T20:31:59.021069] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-24T20:31:59.022455] [DEBUG] [LOCAL ] OMI: Trimmed 63813 records to 45840 (keeping 200 days of data) [2025-09-24T20:31:59.218602] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-24T20:31:59.288905] [DEBUG] [LOCAL ] OMI: Primary data saved (45840 records). [2025-09-24T20:31:59.289049] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-24T20:31:59.289159] [INFO ] [MAIN ] Update Progress: 1595/2373 symbols completed. OMI took 28.6s. Estimated remaining: 1h 43m 22s. Rate: 7.5 symbols/min [2025-09-24T20:31:59.459780] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:31:59.516441] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-24T20:31:59.516604] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-09-24T20:31:59.705180] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:31:59.705480] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-24T20:31:59.705548] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-24T20:31:59.706786] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-24T20:31:59.706854] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-24T20:32:00.021048] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-24T20:32:00.078361] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:00.104731] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T20:32:00.591998] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T20:32:00.816177] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-24T20:32:00.925355] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T20:32:01.616109] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-24T20:32:02.416161] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-24T20:32:02.849757] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T20:32:02.942266] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T20:32:03.216107] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-24T20:32:04.016096] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-24T20:32:04.057990] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:32:04.065634] [INFO ] [REMOTE ] OMF: Full fetch complete (66643 records). [2025-09-24T20:32:04.065787] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-24T20:32:04.458662] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-24T20:32:04.458802] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-24T20:32:04.459798] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-24T20:32:04.459862] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-24T20:32:04.461188] [DEBUG] [LOCAL ] OMF: Trimmed 66643 records to 46213 (keeping 200 days of data) [2025-09-24T20:32:04.750460] [DEBUG] [LOCAL ] OMF: Primary data saved (46213 records). [2025-09-24T20:32:04.750602] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-24T20:32:04.750714] [INFO ] [MAIN ] Update Progress: 1596/2373 symbols completed. OMF took 35.4s. Estimated remaining: 1h 43m 13s. Rate: 7.5 symbols/min [2025-09-24T20:32:04.821082] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-24T20:32:04.883260] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T20:32:04.938529] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:04.963617] [DEBUG] [LOCAL ] ONTF: Loaded 23025 existing records from primary storage. [2025-09-24T20:32:04.963883] [INFO ] [MAIN ] ONTF: Loaded 23025 existing records. [2025-09-24T20:32:05.150422] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:32:05.150807] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-24T20:32:05.150995] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-24T20:32:05.151884] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-24T20:32:05.151949] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-24T20:32:05.545486] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:05.547902] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-24T20:32:05.616058] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-24T20:32:06.416163] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-24T20:32:06.532591] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T20:32:06.892883] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T20:32:06.966325] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T20:32:07.216120] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-24T20:32:08.016121] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-24T20:32:08.816098] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-24T20:32:08.849411] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T20:32:09.616084] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-24T20:32:09.926909] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T20:32:10.244768] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-24T20:32:10.416077] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-24T20:32:10.512926] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T20:32:10.514920] [INFO ] [REMOTE ] ONIT: Full fetch complete (11231 records). [2025-09-24T20:32:10.514992] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-24T20:32:10.963034] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-24T20:32:10.963141] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-24T20:32:10.963513] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-24T20:32:10.963585] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-24T20:32:10.964192] [DEBUG] [LOCAL ] ONIT: Trimmed 11231 records to 7800 (keeping 200 days of data) [2025-09-24T20:32:11.015744] [DEBUG] [LOCAL ] ONIT: Primary data saved (7800 records). [2025-09-24T20:32:11.015880] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-24T20:32:11.016021] [INFO ] [MAIN ] Update Progress: 1597/2373 symbols completed. ONIT took 34.9s. Estimated remaining: 1h 43m 4s. Rate: 7.5 symbols/min [2025-09-24T20:32:11.216158] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-24T20:32:12.016073] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-24T20:32:12.205692] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T20:32:12.738240] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-24T20:32:12.816107] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-24T20:32:13.616055] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-24T20:32:13.710100] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T20:32:13.965814] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T20:32:14.416090] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-24T20:32:15.216096] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-24T20:32:15.535213] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T20:32:15.865872] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-24T20:32:16.016080] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-24T20:32:16.771740] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:32:16.816057] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-24T20:32:17.616161] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-24T20:32:18.123535] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-24T20:32:18.196920] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:32:18.416109] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-24T20:32:18.878864] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T20:32:19.216097] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-24T20:32:19.522542] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T20:32:20.016115] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-24T20:32:20.816114] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-24T20:32:21.139001] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T20:32:21.171261] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:32:21.178776] [INFO ] [REMOTE ] ONL: Full fetch complete (43558 records). [2025-09-24T20:32:21.178957] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-24T20:32:21.621610] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-24T20:32:21.747888] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-24T20:32:21.748993] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-24T20:32:21.751502] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-24T20:32:21.751714] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-24T20:32:21.753502] [DEBUG] [LOCAL ] ONL: Trimmed 43558 records to 31583 (keeping 200 days of data) [2025-09-24T20:32:22.054901] [DEBUG] [LOCAL ] ONL: Primary data saved (31583 records). [2025-09-24T20:32:22.055316] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-24T20:32:22.055781] [INFO ] [MAIN ] Update Progress: 1598/2373 symbols completed. ONL took 25.8s. Estimated remaining: 1h 42m 58s. Rate: 7.5 symbols/min [2025-09-24T20:32:22.143777] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T20:32:22.416177] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-24T20:32:23.723333] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T20:32:23.729899] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-24T20:32:23.825681] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T20:32:24.016091] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-24T20:32:24.964678] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T20:32:24.971238] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-24T20:32:26.130793] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:32:26.135824] [INFO ] [REMOTE ] ONTF: Full fetch complete (31810 records). [2025-09-24T20:32:26.135982] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-24T20:32:26.501636] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-24T20:32:26.563136] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-24T20:32:26.577557] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-24T20:32:26.577688] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-24T20:32:26.578553] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-24T20:32:26.578601] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-24T20:32:26.579815] [DEBUG] [LOCAL ] ONTF: Trimmed 31810 records to 22934 (keeping 200 days of data) [2025-09-24T20:32:26.718447] [DEBUG] [LOCAL ] ONTF: Primary data saved (22934 records). [2025-09-24T20:32:26.718590] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-24T20:32:26.718738] [INFO ] [MAIN ] Update Progress: 1599/2373 symbols completed. ONTF took 22.0s. Estimated remaining: 1h 42m 48s. Rate: 7.5 symbols/min [2025-09-24T20:32:28.633808] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T20:32:28.643980] [INFO ] [REMOTE ] ONON: Full fetch complete (77559 records). [2025-09-24T20:32:28.644152] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-24T20:32:29.060536] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-24T20:32:29.060683] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-24T20:32:29.061936] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-24T20:32:29.062020] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-24T20:32:29.063793] [DEBUG] [LOCAL ] ONON: Trimmed 77559 records to 53612 (keeping 200 days of data) [2025-09-24T20:32:29.404514] [DEBUG] [LOCAL ] ONON: Primary data saved (53612 records). [2025-09-24T20:32:29.404766] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-24T20:32:29.405006] [INFO ] [MAIN ] Update Progress: 1600/2373 symbols completed. ONON took 30.1s. Estimated remaining: 1h 42m 38s. Rate: 7.5 symbols/min [2025-09-24T20:32:30.055792] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:30.007004] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:30.103247] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:30.154685] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:30.207178] [DEBUG] [LOCAL ] OPAD: Loaded 19745 existing records from primary storage. [2025-09-24T20:32:30.207934] [INFO ] [MAIN ] OPAD: Loaded 19745 existing records. [2025-09-24T20:32:30.207797] [DEBUG] [LOCAL ] OOMA: Loaded 19147 existing records from primary storage. [2025-09-24T20:32:30.223697] [INFO ] [MAIN ] OOMA: Loaded 19147 existing records. [2025-09-24T20:32:30.515139] [DEBUG] [LOCAL ] OPFI: Loaded 46651 existing records from primary storage. [2025-09-24T20:32:30.567400] [INFO ] [MAIN ] OPFI: Loaded 46651 existing records. [2025-09-24T20:32:30.629478] [DEBUG] [LOCAL ] ONTO: Loaded 46626 existing records from primary storage. [2025-09-24T20:32:30.640263] [INFO ] [MAIN ] ONTO: Loaded 46626 existing records. [2025-09-24T20:32:30.723722] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:32:30.743471] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:32:30.844597] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-24T20:32:30.888084] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-24T20:32:30.899571] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-24T20:32:30.899497] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-24T20:32:30.907562] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-24T20:32:30.907754] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-24T20:32:30.972139] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-24T20:32:31.061491] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-24T20:32:31.200230] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:32:31.228003] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-24T20:32:31.227913] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:32:31.228167] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-24T20:32:31.249980] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-24T20:32:31.285346] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-24T20:32:31.285685] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-24T20:32:31.285537] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-24T20:32:31.323669] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-24T20:32:31.370183] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-24T20:32:32.000693] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:32.082295] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-24T20:32:32.593196] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:32.563507] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:32.594074] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-24T20:32:32.593822] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-24T20:32:32.675873] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:32.676318] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-24T20:32:33.130176] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T20:32:33.132718] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-24T20:32:33.790184] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T20:32:33.792137] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-24T20:32:33.888511] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:32:33.893078] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-24T20:32:34.258874] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:32:34.270268] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-24T20:32:34.296231] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:32:34.304122] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-24T20:32:34.715445] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T20:32:34.717750] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-24T20:32:34.729344] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:32:34.733488] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-24T20:32:35.427600] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T20:32:35.429967] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-24T20:32:35.647400] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T20:32:36.016163] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-24T20:32:36.257495] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T20:32:36.343755] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T20:32:36.373270] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T20:32:36.816119] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-24T20:32:36.938568] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T20:32:37.616161] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-24T20:32:38.416111] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-24T20:32:38.579436] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T20:32:38.813256] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T20:32:39.216195] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-24T20:32:40.016045] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-24T20:32:40.340987] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T20:32:40.376875] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T20:32:40.534374] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-24T20:32:40.816154] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-24T20:32:41.616153] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-24T20:32:41.766636] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-24T20:32:42.416099] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-24T20:32:43.192373] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T20:32:43.216042] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-24T20:32:43.386889] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T20:32:44.016200] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-24T20:32:44.588095] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T20:32:44.816107] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-24T20:32:45.616154] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-24T20:32:45.901331] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T20:32:45.947023] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T20:32:46.416116] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-24T20:32:47.216108] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-24T20:32:47.586679] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-24T20:32:47.622619] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T20:32:48.016112] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-24T20:32:48.816108] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-24T20:32:49.091495] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T20:32:49.159405] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T20:32:49.165090] [INFO ] [REMOTE ] OOMA: Full fetch complete (26401 records). [2025-09-24T20:32:49.165221] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-24T20:32:49.540834] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-24T20:32:49.540977] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-24T20:32:49.541790] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-24T20:32:49.541860] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-24T20:32:49.542905] [DEBUG] [LOCAL ] OOMA: Trimmed 26401 records to 19065 (keeping 200 days of data) [2025-09-24T20:32:49.627089] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-24T20:32:49.664756] [DEBUG] [LOCAL ] OOMA: Primary data saved (19065 records). [2025-09-24T20:32:49.665003] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-24T20:32:49.665129] [INFO ] [MAIN ] Update Progress: 1601/2373 symbols completed. OOMA took 20.3s. Estimated remaining: 1h 42m 36s. Rate: 7.5 symbols/min [2025-09-24T20:32:49.857286] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:49.857711] [DEBUG] [LOCAL ] OPP: No existing data file found in primary storage. [2025-09-24T20:32:49.857770] [WARN ] [MAIN ] OPP: No existing data found, performing full refresh instead. [2025-09-24T20:32:49.857969] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-24T20:32:49.858024] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-24T20:32:49.858072] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-09-24T20:32:49.858108] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-24T20:32:50.233926] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:50.416104] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-24T20:32:50.557391] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T20:32:51.216095] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-24T20:32:51.540277] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T20:32:51.568068] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:32:52.016176] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-24T20:32:52.712244] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T20:32:52.816031] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-24T20:32:53.616092] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-24T20:32:54.405165] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:32:54.421144] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-24T20:32:54.435712] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-24T20:32:54.445564] [INFO ] [REMOTE ] OPAD: Full fetch complete (23173 records). [2025-09-24T20:32:54.445719] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-24T20:32:54.855371] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-24T20:32:54.855553] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-24T20:32:54.856263] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-24T20:32:54.856348] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-24T20:32:54.857796] [DEBUG] [LOCAL ] OPAD: Trimmed 23173 records to 20033 (keeping 200 days of data) [2025-09-24T20:32:54.969422] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T20:32:55.016058] [DEBUG] [LOCAL ] OPAD: Primary data saved (20033 records). [2025-09-24T20:32:55.016216] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-24T20:32:55.016324] [INFO ] [MAIN ] Update Progress: 1602/2373 symbols completed. OPAD took 25.6s. Estimated remaining: 1h 42m 27s. Rate: 7.5 symbols/min [2025-09-24T20:32:55.199689] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:32:55.199896] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-24T20:32:55.199955] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-24T20:32:55.200131] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-24T20:32:55.200185] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-24T20:32:55.200230] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-24T20:32:55.200264] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-24T20:32:55.222273] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-24T20:32:55.595584] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:32:56.016097] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-24T20:32:56.335029] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T20:32:56.816084] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-24T20:32:56.992837] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T20:32:57.023383] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T20:32:57.616165] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-24T20:32:58.403279] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:32:58.416023] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-24T20:32:58.711175] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T20:32:59.125558] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T20:32:59.216066] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-24T20:33:00.016115] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-24T20:33:00.045766] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T20:33:00.776926] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T20:33:00.816088] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-24T20:33:01.616117] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-24T20:33:01.958684] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T20:33:02.416096] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-24T20:33:03.216092] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-24T20:33:04.016170] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-24T20:33:04.904253] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T20:33:04.906709] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-24T20:33:05.424850] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T20:33:05.583967] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (3.97 seconds). [2025-09-24T20:33:05.628413] [INFO ] [REMOTE ] ONTO: Full fetch complete (65640 records). [2025-09-24T20:33:05.625127] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-24T20:33:05.631561] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (3.22 seconds). [2025-09-24T20:33:05.629225] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-24T20:33:05.736530] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T20:33:06.050234] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-24T20:33:06.050323] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-24T20:33:06.051380] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-24T20:33:06.051446] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-24T20:33:06.052899] [DEBUG] [LOCAL ] ONTO: Trimmed 65640 records to 46659 (keeping 200 days of data) [2025-09-24T20:33:06.348567] [DEBUG] [LOCAL ] ONTO: Primary data saved (46659 records). [2025-09-24T20:33:06.348799] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-24T20:33:06.348917] [INFO ] [MAIN ] Update Progress: 1603/2373 symbols completed. ONTO took 36.9s. Estimated remaining: 1h 42m 20s. Rate: 7.5 symbols/min [2025-09-24T20:33:06.421225] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-24T20:33:06.536767] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:06.580547] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-24T20:33:06.600358] [DEBUG] [LOCAL ] OR: Loaded 45995 existing records from primary storage. [2025-09-24T20:33:06.600512] [INFO ] [MAIN ] OR: Loaded 45995 existing records. [2025-09-24T20:33:06.777507] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:33:06.777803] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-24T20:33:06.777855] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-24T20:33:06.779480] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-24T20:33:06.779542] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-24T20:33:07.182127] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:07.216100] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-24T20:33:08.016073] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-24T20:33:08.300113] [DEBUG] [REMOTE ] OPP: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-24T20:33:08.300458] [WARN ] [REMOTE ] OPP: No data returned for month 2025-05 [2025-09-24T20:33:08.345354] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T20:33:08.660106] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T20:33:08.816048] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-24T20:33:09.616091] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-24T20:33:10.177981] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T20:33:10.416045] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-24T20:33:10.581293] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:33:11.216068] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-24T20:33:11.233386] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:33:12.016090] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-24T20:33:12.816091] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-24T20:33:13.385346] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-24T20:33:13.394520] [INFO ] [REMOTE ] OPFI: Full fetch complete (67495 records). [2025-09-24T20:33:13.394745] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-24T20:33:13.622218] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-24T20:33:13.852840] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-24T20:33:13.853012] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-24T20:33:13.855496] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-24T20:33:13.855630] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-24T20:33:13.857744] [DEBUG] [LOCAL ] OPFI: Trimmed 67495 records to 46589 (keeping 200 days of data) [2025-09-24T20:33:14.284212] [DEBUG] [LOCAL ] OPFI: Primary data saved (46589 records). [2025-09-24T20:33:14.284419] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-24T20:33:14.284552] [INFO ] [MAIN ] Update Progress: 1604/2373 symbols completed. OPFI took 44.9s. Estimated remaining: 1h 42m 12s. Rate: 7.5 symbols/min [2025-09-24T20:33:14.586098] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:14.630143] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-24T20:33:14.640560] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-24T20:33:14.679803] [DEBUG] [LOCAL ] ORA: Loaded 32612 existing records from primary storage. [2025-09-24T20:33:14.680000] [INFO ] [MAIN ] ORA: Loaded 32612 existing records. [2025-09-24T20:33:14.909243] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:33:14.909899] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-24T20:33:14.910020] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-24T20:33:14.911549] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-24T20:33:14.911619] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-24T20:33:15.054946] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-24T20:33:15.139219] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T20:33:15.221485] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-24T20:33:15.358835] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:16.016069] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-24T20:33:16.200328] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T20:33:16.415782] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T20:33:16.816158] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-24T20:33:16.880172] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T20:33:16.882927] [INFO ] [REMOTE ] OPY: Full fetch complete (10047 records). [2025-09-24T20:33:16.883054] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-24T20:33:17.090254] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:33:17.090547] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:33:17.090639] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:33:17.090738] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-24T20:33:17.090810] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-24T20:33:17.090849] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-24T20:33:17.090889] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-24T20:33:17.090951] [INFO ] [MAIN ] Update Progress: 1605/2373 symbols completed. OPY took 22.1s. Estimated remaining: 1h 42m 2s. Rate: 7.5 symbols/min [2025-09-24T20:33:17.264635] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:17.330516] [DEBUG] [LOCAL ] ORC: Loaded 52307 existing records from primary storage. [2025-09-24T20:33:17.330693] [INFO ] [MAIN ] ORC: Loaded 52307 existing records. [2025-09-24T20:33:17.509509] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:33:17.509828] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-24T20:33:17.509916] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-24T20:33:17.511734] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-24T20:33:17.511798] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-24T20:33:17.621453] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-24T20:33:17.878831] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:18.416176] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-24T20:33:18.634171] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:33:19.216066] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-24T20:33:19.330328] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T20:33:20.016107] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-24T20:33:20.398965] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T20:33:20.662417] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T20:33:20.816100] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-24T20:33:20.900836] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T20:33:20.903625] [INFO ] [REMOTE ] OPP: Full fetch complete (15736 records). [2025-09-24T20:33:20.903822] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-24T20:33:21.097777] [WARN ] [VALIDATOR ] OPP: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T20:33:21.098146] [FATAL] [MAIN ] OPP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:33:21.098239] [WARN ] [MAIN ] OPP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:33:21.098329] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-24T20:33:21.098413] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-09-24T20:33:21.098490] [INFO ] [LOCAL ] OPP: Starting deletion of derivative data. [2025-09-24T20:33:21.098582] [DEBUG] [LOCAL ] OPP: No derivative data file found to delete. [2025-09-24T20:33:21.098712] [INFO ] [MAIN ] Update Progress: 1606/2373 symbols completed. OPP took 31.4s. Estimated remaining: 1h 41m 52s. Rate: 7.5 symbols/min [2025-09-24T20:33:21.275696] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:21.275922] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-24T20:33:21.275979] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-24T20:33:21.276200] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-24T20:33:21.276253] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-24T20:33:21.276296] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-24T20:33:21.276328] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-24T20:33:21.619168] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-24T20:33:21.654613] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:22.416080] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-24T20:33:22.637597] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T20:33:23.216051] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-24T20:33:23.264332] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T20:33:23.336152] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T20:33:24.016184] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-24T20:33:24.816087] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-24T20:33:25.616058] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-24T20:33:25.938348] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-24T20:33:26.039745] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-24T20:33:26.416072] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-24T20:33:26.892141] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-24T20:33:27.044883] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:33:27.216072] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-24T20:33:27.253842] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T20:33:28.016082] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-24T20:33:28.821046] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-24T20:33:28.832865] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T20:33:29.183321] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T20:33:29.616094] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-24T20:33:30.416087] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-24T20:33:30.734898] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T20:33:31.200725] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:33:31.216035] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-24T20:33:31.322415] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T20:33:32.016169] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-24T20:33:32.816110] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-24T20:33:32.965365] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T20:33:33.616070] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-24T20:33:33.697354] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:33:33.707754] [INFO ] [REMOTE ] OR: Full fetch complete (65023 records). [2025-09-24T20:33:33.708074] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-24T20:33:34.144096] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T20:33:34.175236] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-24T20:33:34.175468] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-24T20:33:34.176769] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-24T20:33:34.176857] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-24T20:33:34.178345] [DEBUG] [LOCAL ] OR: Trimmed 65023 records to 46062 (keeping 200 days of data) [2025-09-24T20:33:34.416480] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-24T20:33:34.461476] [DEBUG] [LOCAL ] OR: Primary data saved (46062 records). [2025-09-24T20:33:34.461604] [INFO ] [MAIN ] OR: Full history saved. [2025-09-24T20:33:34.461707] [INFO ] [MAIN ] Update Progress: 1607/2373 symbols completed. OR took 28.1s. Estimated remaining: 1h 41m 46s. Rate: 7.5 symbols/min [2025-09-24T20:33:34.632736] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:34.632946] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-24T20:33:34.633003] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-24T20:33:34.633163] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-24T20:33:34.633212] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-24T20:33:34.633256] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-24T20:33:34.633292] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-24T20:33:35.000941] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:35.216149] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-24T20:33:35.692226] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T20:33:35.852412] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T20:33:36.016101] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-24T20:33:36.816068] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-24T20:33:36.886011] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:33:37.231960] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:33:37.616204] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-24T20:33:38.416167] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-24T20:33:38.932558] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-24T20:33:39.032558] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T20:33:39.207165] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T20:33:39.216034] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-24T20:33:40.016118] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-24T20:33:40.760711] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T20:33:40.820891] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-24T20:33:40.825498] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T20:33:41.616179] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-24T20:33:42.416103] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-24T20:33:42.965028] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-24T20:33:43.216057] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-24T20:33:43.409354] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T20:33:43.706408] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T20:33:43.712404] [INFO ] [REMOTE ] ORA: Full fetch complete (49317 records). [2025-09-24T20:33:43.712555] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-24T20:33:44.021204] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-24T20:33:44.100798] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-24T20:33:44.100886] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-24T20:33:44.101761] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-24T20:33:44.101824] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-24T20:33:44.102955] [DEBUG] [LOCAL ] ORA: Trimmed 49317 records to 32542 (keeping 200 days of data) [2025-09-24T20:33:44.309012] [DEBUG] [LOCAL ] ORA: Primary data saved (32542 records). [2025-09-24T20:33:44.309164] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-24T20:33:44.309256] [INFO ] [MAIN ] Update Progress: 1608/2373 symbols completed. ORA took 30.0s. Estimated remaining: 1h 41m 39s. Rate: 7.5 symbols/min [2025-09-24T20:33:44.498554] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:44.531283] [DEBUG] [LOCAL ] ORN: Loaded 31707 existing records from primary storage. [2025-09-24T20:33:44.531433] [INFO ] [MAIN ] ORN: Loaded 31707 existing records. [2025-09-24T20:33:44.735798] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:33:44.736082] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-24T20:33:44.736172] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-24T20:33:44.737299] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-24T20:33:44.737384] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-24T20:33:44.821230] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-24T20:33:45.203279] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:45.260127] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-24T20:33:45.616112] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-24T20:33:45.750038] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-24T20:33:46.416206] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-24T20:33:46.709084] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T20:33:47.158633] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:33:47.216073] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-24T20:33:47.355877] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T20:33:48.016195] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-24T20:33:48.480155] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T20:33:48.489022] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-24T20:33:48.489195] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-24T20:33:48.490077] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:33:48.490175] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:33:48.490218] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:33:48.490258] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-24T20:33:48.490320] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-24T20:33:48.490357] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-24T20:33:48.490401] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-24T20:33:48.490461] [INFO ] [MAIN ] Update Progress: 1609/2373 symbols completed. ORCL took 27.4s. Estimated remaining: 1h 41m 30s. Rate: 7.5 symbols/min [2025-09-24T20:33:48.665867] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:48.728707] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-24T20:33:48.728861] [INFO ] [MAIN ] OSCR: Loaded 53722 existing records. [2025-09-24T20:33:48.821270] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-24T20:33:48.921028] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:33:48.921422] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-24T20:33:48.921482] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-24T20:33:48.923144] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-24T20:33:48.923211] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-24T20:33:49.318030] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-24T20:33:49.323598] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:49.616098] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-24T20:33:50.416104] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-24T20:33:50.822540] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T20:33:51.216148] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-24T20:33:51.462433] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T20:33:51.491196] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T20:33:52.016078] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-24T20:33:52.816064] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-24T20:33:53.225006] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T20:33:53.616053] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-24T20:33:53.689832] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T20:33:54.416181] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-24T20:33:54.630837] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T20:33:54.640848] [INFO ] [REMOTE ] ORC: Full fetch complete (75180 records). [2025-09-24T20:33:54.641033] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-24T20:33:55.052932] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-24T20:33:55.053059] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-24T20:33:55.054430] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-24T20:33:55.054518] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-24T20:33:55.056742] [DEBUG] [LOCAL ] ORC: Trimmed 75180 records to 52315 (keeping 200 days of data) [2025-09-24T20:33:55.246416] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-24T20:33:55.418952] [DEBUG] [LOCAL ] ORC: Primary data saved (52315 records). [2025-09-24T20:33:55.419175] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-24T20:33:55.419318] [INFO ] [MAIN ] Update Progress: 1610/2373 symbols completed. ORC took 38.3s. Estimated remaining: 1h 41m 21s. Rate: 7.5 symbols/min [2025-09-24T20:33:55.605805] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:33:55.606352] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-24T20:33:55.606422] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-24T20:33:55.606847] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-24T20:33:55.607041] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-24T20:33:55.607194] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-24T20:33:55.607282] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-24T20:33:55.807615] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-24T20:33:56.021199] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-24T20:33:56.120477] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:33:56.178748] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T20:33:56.743740] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T20:33:56.816114] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-24T20:33:57.616090] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-24T20:33:58.177771] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-24T20:33:58.242901] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:33:58.416141] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-24T20:33:59.216149] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-24T20:33:59.515149] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T20:34:00.016169] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-24T20:34:00.690287] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-24T20:34:00.719988] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T20:34:00.816139] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-24T20:34:01.616098] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-24T20:34:02.134697] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T20:34:02.219905] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T20:34:02.416087] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-24T20:34:03.216057] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-24T20:34:03.401128] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T20:34:03.906241] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T20:34:04.016098] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-24T20:34:04.354599] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T20:34:04.816086] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-24T20:34:05.616093] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-24T20:34:05.968440] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T20:34:06.211427] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T20:34:06.416078] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-24T20:34:07.112344] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T20:34:07.121145] [INFO ] [REMOTE ] ORI: Full fetch complete (70172 records). [2025-09-24T20:34:07.121307] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-24T20:34:07.221798] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-24T20:34:07.325514] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:34:07.326349] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:34:07.326425] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:34:07.326564] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-24T20:34:07.326705] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-24T20:34:07.326766] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-24T20:34:07.326815] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-24T20:34:07.326906] [INFO ] [MAIN ] Update Progress: 1611/2373 symbols completed. ORI took 32.9s. Estimated remaining: 1h 41m 15s. Rate: 7.5 symbols/min [2025-09-24T20:34:07.502573] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:07.502819] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-24T20:34:07.502876] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-24T20:34:07.503054] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-24T20:34:07.503109] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-24T20:34:07.503157] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-24T20:34:07.503193] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-24T20:34:07.866044] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:08.016094] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-24T20:34:08.820377] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-24T20:34:08.827526] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-24T20:34:09.069117] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T20:34:09.136502] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:09.137010] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-24T20:34:09.392193] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:34:09.616085] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-24T20:34:10.416112] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-24T20:34:11.216160] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-24T20:34:11.854954] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:34:12.016103] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-24T20:34:12.268576] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-24T20:34:12.314979] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:12.315289] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-24T20:34:12.731486] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T20:34:12.816083] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-24T20:34:13.070048] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:13.070515] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-24T20:34:13.616097] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-24T20:34:14.416169] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-24T20:34:14.941769] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T20:34:14.947855] [INFO ] [REMOTE ] ORN: Full fetch complete (45718 records). [2025-09-24T20:34:14.947960] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-24T20:34:15.221157] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-24T20:34:15.341096] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-24T20:34:15.341178] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-24T20:34:15.342007] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-24T20:34:15.342069] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-24T20:34:15.343710] [DEBUG] [LOCAL ] ORN: Trimmed 45718 records to 31573 (keeping 200 days of data) [2025-09-24T20:34:15.521164] [DEBUG] [LOCAL ] ORN: Primary data saved (31573 records). [2025-09-24T20:34:15.521307] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-24T20:34:15.521397] [INFO ] [MAIN ] Update Progress: 1612/2373 symbols completed. ORN took 31.2s. Estimated remaining: 1h 41m 7s. Rate: 7.5 symbols/min [2025-09-24T20:34:15.625214] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:15.628260] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-24T20:34:15.698962] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:15.755028] [DEBUG] [LOCAL ] OTIS: Loaded 52712 existing records from primary storage. [2025-09-24T20:34:15.755204] [INFO ] [MAIN ] OTIS: Loaded 52712 existing records. [2025-09-24T20:34:15.942936] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:15.943392] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-24T20:34:15.943596] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-24T20:34:15.945383] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-24T20:34:15.945466] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-24T20:34:16.016551] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-24T20:34:16.153119] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T20:34:16.346941] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:16.371352] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:16.371794] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-24T20:34:16.816086] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-24T20:34:17.616080] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-24T20:34:18.416091] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-24T20:34:19.216071] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-24T20:34:19.246472] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T20:34:19.505579] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:34:19.505959] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-24T20:34:19.691714] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-24T20:34:20.021147] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-24T20:34:20.040897] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:34:20.816091] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-24T20:34:21.616100] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-24T20:34:22.416054] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-24T20:34:22.497035] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T20:34:22.657985] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T20:34:22.841379] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-24T20:34:23.216080] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-24T20:34:24.016076] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-24T20:34:24.073262] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T20:34:24.164129] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T20:34:24.816087] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-24T20:34:25.616092] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-24T20:34:25.753238] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T20:34:26.231796] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T20:34:26.416106] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-24T20:34:27.090018] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T20:34:27.216097] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-24T20:34:27.890181] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-24T20:34:27.899554] [INFO ] [REMOTE ] OSCR: Full fetch complete (77480 records). [2025-09-24T20:34:27.899726] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-24T20:34:28.021257] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-24T20:34:28.296718] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-24T20:34:28.296855] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-24T20:34:28.297943] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-24T20:34:28.298007] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-24T20:34:28.299585] [DEBUG] [LOCAL ] OSCR: Trimmed 77480 records to 53722 (keeping 200 days of data) [2025-09-24T20:34:28.626757] [DEBUG] [LOCAL ] OSCR: Primary data saved (53722 records). [2025-09-24T20:34:28.627360] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-24T20:34:28.627466] [INFO ] [MAIN ] Update Progress: 1613/2373 symbols completed. OSCR took 40.1s. Estimated remaining: 1h 41m 2s. Rate: 7.5 symbols/min [2025-09-24T20:34:28.802758] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:28.816170] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-24T20:34:28.850383] [DEBUG] [LOCAL ] OUT: Loaded 48091 existing records from primary storage. [2025-09-24T20:34:28.850547] [INFO ] [MAIN ] OUT: Loaded 48091 existing records. [2025-09-24T20:34:29.043077] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:29.043459] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-24T20:34:29.043575] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-24T20:34:29.045699] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-24T20:34:29.045763] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-24T20:34:29.447764] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:29.450319] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-24T20:34:29.482282] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T20:34:29.490041] [INFO ] [REMOTE ] OSK: Full fetch complete (61581 records). [2025-09-24T20:34:29.490255] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-24T20:34:29.621208] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-24T20:34:29.708408] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:34:29.709180] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:34:29.709252] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:34:29.709326] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-24T20:34:29.709394] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-24T20:34:29.709432] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-24T20:34:29.709471] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-24T20:34:29.709539] [INFO ] [MAIN ] Update Progress: 1614/2373 symbols completed. OSK took 34.3s. Estimated remaining: 1h 40m 50s. Rate: 7.5 symbols/min [2025-09-24T20:34:29.884364] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:29.901707] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T20:34:29.907796] [INFO ] [REMOTE ] OTF: Full fetch complete (8645 records). [2025-09-24T20:34:29.907892] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-24T20:34:30.107062] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-24T20:34:30.107363] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:34:30.107435] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:34:30.107505] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-24T20:34:30.107587] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-24T20:34:30.107674] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-24T20:34:30.107742] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-24T20:34:30.107818] [INFO ] [MAIN ] Update Progress: 1615/2373 symbols completed. OTF took 22.8s. Estimated remaining: 1h 40m 39s. Rate: 7.5 symbols/min [2025-09-24T20:34:30.252621] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-09-24T20:34:30.279869] [INFO ] [MAIN ] OVV: Loaded 53516 existing records. [2025-09-24T20:34:30.363472] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:30.420252] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-24T20:34:30.486438] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:30.486716] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-24T20:34:30.486772] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-24T20:34:30.488442] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-24T20:34:30.488508] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-24T20:34:30.707564] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-24T20:34:30.746177] [INFO ] [MAIN ] OWL: Loaded 53555 existing records. [2025-09-24T20:34:31.071554] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:31.071445] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:31.072058] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-24T20:34:31.072113] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-24T20:34:31.074423] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-24T20:34:31.074488] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-24T20:34:31.228264] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-24T20:34:31.445662] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:31.539614] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T20:34:32.016055] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-24T20:34:32.427920] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T20:34:32.816144] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-24T20:34:33.358279] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T20:34:33.616160] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-24T20:34:33.673121] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T20:34:34.230215] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T20:34:34.416080] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-24T20:34:35.216082] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-24T20:34:35.443784] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T20:34:36.016114] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-24T20:34:36.053785] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T20:34:36.816107] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-24T20:34:37.202259] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-24T20:34:37.478386] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T20:34:37.616093] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-24T20:34:38.416112] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-24T20:34:38.631034] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T20:34:39.216146] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-24T20:34:39.441664] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T20:34:40.016109] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-24T20:34:40.292855] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T20:34:40.816266] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-24T20:34:41.046151] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T20:34:41.616059] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-24T20:34:41.977360] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T20:34:42.416108] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-24T20:34:42.627530] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T20:34:43.216096] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-24T20:34:43.615973] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T20:34:44.016090] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-24T20:34:44.282076] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T20:34:44.816068] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-24T20:34:45.024727] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T20:34:45.616099] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-24T20:34:45.892500] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T20:34:46.416051] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-24T20:34:46.614348] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T20:34:47.216072] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-24T20:34:47.307568] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T20:34:48.016757] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-24T20:34:48.027211] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T20:34:48.816070] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-24T20:34:49.112443] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T20:34:49.121960] [INFO ] [REMOTE ] OTIS: Full fetch complete (75846 records). [2025-09-24T20:34:49.122127] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-24T20:34:49.566686] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-24T20:34:49.566931] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-24T20:34:49.568440] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-24T20:34:49.568558] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-24T20:34:49.570416] [DEBUG] [LOCAL ] OTIS: Trimmed 75846 records to 52712 (keeping 200 days of data) [2025-09-24T20:34:49.649439] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-24T20:34:49.708411] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T20:34:49.960213] [DEBUG] [LOCAL ] OTIS: Primary data saved (52712 records). [2025-09-24T20:34:49.960378] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-24T20:34:49.960549] [INFO ] [MAIN ] Update Progress: 1616/2373 symbols completed. OTIS took 34.4s. Estimated remaining: 1h 40m 36s. Rate: 7.5 symbols/min [2025-09-24T20:34:50.139961] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:50.153249] [DEBUG] [LOCAL ] OWLT: Loaded 8989 existing records from primary storage. [2025-09-24T20:34:50.153385] [INFO ] [MAIN ] OWLT: Loaded 8989 existing records. [2025-09-24T20:34:50.342499] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:50.343403] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-24T20:34:50.343888] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-24T20:34:50.344299] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-24T20:34:50.344370] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-24T20:34:50.421621] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-24T20:34:50.581715] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T20:34:50.780009] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:51.216108] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-24T20:34:51.666894] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T20:34:52.016043] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-24T20:34:52.071008] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T20:34:52.478892] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T20:34:52.816082] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-24T20:34:53.448533] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T20:34:53.616062] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-24T20:34:53.781005] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T20:34:54.416098] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-24T20:34:55.216070] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-24T20:34:55.453452] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T20:34:55.906982] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T20:34:56.016059] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-24T20:34:56.213567] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T20:34:56.223838] [INFO ] [REMOTE ] OVV: Full fetch complete (77300 records). [2025-09-24T20:34:56.224033] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-24T20:34:56.670002] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-24T20:34:56.670086] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-24T20:34:56.671133] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-24T20:34:56.671198] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-24T20:34:56.672684] [DEBUG] [LOCAL ] OVV: Trimmed 77300 records to 53515 (keeping 200 days of data) [2025-09-24T20:34:56.816305] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-24T20:34:57.044456] [DEBUG] [LOCAL ] OVV: Primary data saved (53515 records). [2025-09-24T20:34:57.044666] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-24T20:34:57.044846] [INFO ] [MAIN ] Update Progress: 1617/2373 symbols completed. OVV took 27.3s. Estimated remaining: 1h 40m 28s. Rate: 7.5 symbols/min [2025-09-24T20:34:57.233964] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:34:57.273311] [DEBUG] [LOCAL ] OXM: Loaded 33516 existing records from primary storage. [2025-09-24T20:34:57.274184] [INFO ] [MAIN ] OXM: Loaded 33516 existing records. [2025-09-24T20:34:57.471523] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:34:57.471875] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-24T20:34:57.471947] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-24T20:34:57.473105] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-24T20:34:57.473169] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-24T20:34:57.626387] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-24T20:34:57.771149] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T20:34:57.895337] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:34:57.925425] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T20:34:58.416136] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-24T20:34:59.216105] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-24T20:34:59.430772] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T20:34:59.790614] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T20:34:59.881770] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:35:00.016040] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-24T20:35:00.816091] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-24T20:35:01.523958] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T20:35:01.616096] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-24T20:35:01.657767] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T20:35:02.416092] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-24T20:35:03.216069] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-24T20:35:03.243026] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:35:03.251289] [INFO ] [REMOTE ] OUT: Full fetch complete (69060 records). [2025-09-24T20:35:03.251408] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-24T20:35:03.652530] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-24T20:35:03.652665] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-24T20:35:03.654555] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-24T20:35:03.654657] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-24T20:35:03.656341] [DEBUG] [LOCAL ] OUT: Trimmed 69060 records to 48046 (keeping 200 days of data) [2025-09-24T20:35:03.964846] [DEBUG] [LOCAL ] OUT: Primary data saved (48046 records). [2025-09-24T20:35:03.965042] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-24T20:35:03.965225] [INFO ] [MAIN ] Update Progress: 1618/2373 symbols completed. OUT took 35.3s. Estimated remaining: 1h 40m 20s. Rate: 7.5 symbols/min [2025-09-24T20:35:04.028931] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-24T20:35:04.140359] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:04.140509] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-24T20:35:04.140547] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-24T20:35:04.140722] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-24T20:35:04.140785] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-24T20:35:04.140854] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-24T20:35:04.140899] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-24T20:35:04.400444] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T20:35:04.530126] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:04.563538] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T20:35:04.816054] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-24T20:35:05.367020] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T20:35:05.616076] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-24T20:35:05.757477] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T20:35:06.416176] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-24T20:35:07.216101] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-24T20:35:07.490723] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T20:35:08.016112] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-24T20:35:08.601894] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T20:35:08.816092] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-24T20:35:08.931365] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T20:35:09.452782] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-09-24T20:35:09.616083] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-24T20:35:10.139726] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T20:35:10.207983] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T20:35:10.210401] [INFO ] [REMOTE ] OWLT: Full fetch complete (11675 records). [2025-09-24T20:35:10.210488] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-24T20:35:10.422806] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-24T20:35:10.606805] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-24T20:35:10.606903] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-24T20:35:10.607220] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-24T20:35:10.607258] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-24T20:35:10.607793] [DEBUG] [LOCAL ] OWLT: Trimmed 11675 records to 8978 (keeping 200 days of data) [2025-09-24T20:35:10.664849] [DEBUG] [LOCAL ] OWLT: Primary data saved (8978 records). [2025-09-24T20:35:10.665004] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-24T20:35:10.665148] [INFO ] [MAIN ] Update Progress: 1619/2373 symbols completed. OWLT took 20.7s. Estimated remaining: 1h 40m 11s. Rate: 7.5 symbols/min [2025-09-24T20:35:10.848431] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:10.907209] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-24T20:35:10.907367] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-24T20:35:11.084065] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:11.084382] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-24T20:35:11.084432] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-24T20:35:11.086279] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-24T20:35:11.086341] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-24T20:35:11.229995] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-24T20:35:11.450821] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:12.016095] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-24T20:35:12.341279] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-24T20:35:12.350939] [INFO ] [REMOTE ] OWL: Full fetch complete (77522 records). [2025-09-24T20:35:12.351092] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-24T20:35:12.755148] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-24T20:35:12.755279] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-24T20:35:12.756425] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-24T20:35:12.756508] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-24T20:35:12.758221] [DEBUG] [LOCAL ] OWL: Trimmed 77522 records to 53555 (keeping 200 days of data) [2025-09-24T20:35:12.828338] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-24T20:35:13.118521] [DEBUG] [LOCAL ] OWL: Primary data saved (53555 records). [2025-09-24T20:35:13.118849] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-24T20:35:13.118993] [INFO ] [MAIN ] Update Progress: 1620/2373 symbols completed. OWL took 43.0s. Estimated remaining: 1h 40m 0s. Rate: 7.5 symbols/min [2025-09-24T20:35:13.298035] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:13.312426] [DEBUG] [LOCAL ] PAC: Loaded 11545 existing records from primary storage. [2025-09-24T20:35:13.312561] [INFO ] [MAIN ] PAC: Loaded 11545 existing records. [2025-09-24T20:35:13.492610] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:13.492961] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-24T20:35:13.493014] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-24T20:35:13.493916] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-24T20:35:13.493977] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-24T20:35:13.880719] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:13.881125] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-24T20:35:13.918105] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-24T20:35:13.996691] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T20:35:14.298251] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T20:35:14.416098] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-24T20:35:15.125691] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T20:35:15.216104] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-24T20:35:16.016070] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-24T20:35:16.047053] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T20:35:16.165046] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T20:35:16.816079] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-24T20:35:17.616112] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-24T20:35:17.787584] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T20:35:18.416171] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-24T20:35:18.612969] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-24T20:35:18.740393] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T20:35:19.216147] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-24T20:35:20.016076] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-24T20:35:20.241351] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T20:35:20.816059] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-24T20:35:20.903947] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T20:35:21.616149] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-24T20:35:21.845427] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-24T20:35:22.366938] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T20:35:22.416079] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-24T20:35:22.860221] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-24T20:35:23.216081] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-24T20:35:24.016096] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-24T20:35:24.816277] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-24T20:35:24.904864] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-24T20:35:24.994992] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T20:35:25.177941] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T20:35:25.290840] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-24T20:35:25.297010] [INFO ] [REMOTE ] OXM: Full fetch complete (45994 records). [2025-09-24T20:35:25.297117] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-24T20:35:25.297751] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:35:25.297842] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:35:25.297887] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:35:25.297992] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-24T20:35:25.298076] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-09-24T20:35:25.298114] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-09-24T20:35:25.298576] [DEBUG] [LOCAL ] OXM: Deleted derivative data file. [2025-09-24T20:35:25.298701] [INFO ] [MAIN ] Update Progress: 1621/2373 symbols completed. OXM took 28.3s. Estimated remaining: 1h 39m 54s. Rate: 7.5 symbols/min [2025-09-24T20:35:25.482498] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:25.521225] [DEBUG] [LOCAL ] PACK: Loaded 32065 existing records from primary storage. [2025-09-24T20:35:25.521396] [INFO ] [MAIN ] PACK: Loaded 32065 existing records. [2025-09-24T20:35:25.621242] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-24T20:35:25.721294] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:25.721542] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-24T20:35:25.721592] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-24T20:35:25.722522] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-24T20:35:25.722587] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-24T20:35:26.205221] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:26.353871] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T20:35:26.416081] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-24T20:35:27.216063] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-24T20:35:27.378476] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T20:35:28.016171] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-24T20:35:28.816225] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-24T20:35:29.195687] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T20:35:29.616088] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-24T20:35:29.682635] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T20:35:29.749959] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-24T20:35:30.416201] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-24T20:35:30.770266] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T20:35:31.216092] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-24T20:35:32.016148] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-24T20:35:32.478061] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T20:35:32.816092] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-24T20:35:32.987493] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T20:35:32.989547] [INFO ] [REMOTE ] PAC: Full fetch complete (16415 records). [2025-09-24T20:35:32.989624] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-24T20:35:33.360940] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-24T20:35:33.361064] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-24T20:35:33.361532] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-24T20:35:33.361598] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-24T20:35:33.362388] [DEBUG] [LOCAL ] PAC: Trimmed 16415 records to 11566 (keeping 200 days of data) [2025-09-24T20:35:33.442267] [DEBUG] [LOCAL ] PAC: Primary data saved (11566 records). [2025-09-24T20:35:33.442461] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-24T20:35:33.442577] [INFO ] [MAIN ] Update Progress: 1622/2373 symbols completed. PAC took 20.3s. Estimated remaining: 1h 39m 47s. Rate: 7.5 symbols/min [2025-09-24T20:35:33.619678] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:33.616212] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-24T20:35:33.658445] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-24T20:35:33.701543] [DEBUG] [LOCAL ] PACS: Loaded 34079 existing records from primary storage. [2025-09-24T20:35:33.701729] [INFO ] [MAIN ] PACS: Loaded 34079 existing records. [2025-09-24T20:35:33.882778] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:33.883068] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-24T20:35:33.883118] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-24T20:35:33.883860] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-24T20:35:33.883920] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-24T20:35:34.235385] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:34.416068] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-24T20:35:34.642771] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T20:35:34.673505] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T20:35:35.216104] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-24T20:35:36.006756] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T20:35:36.016023] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-24T20:35:36.816087] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-24T20:35:37.288735] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T20:35:37.517175] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T20:35:37.616163] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-24T20:35:38.416079] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-24T20:35:39.066318] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T20:35:39.216078] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-24T20:35:39.425938] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-24T20:35:39.481168] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T20:35:40.016148] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-24T20:35:40.816060] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-24T20:35:41.086378] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T20:35:41.382225] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T20:35:41.616100] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-24T20:35:42.416108] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-24T20:35:43.216144] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-24T20:35:43.326341] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-24T20:35:43.745808] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T20:35:43.778171] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T20:35:44.016085] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-24T20:35:44.569204] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:35:44.816102] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-24T20:35:45.616103] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-24T20:35:45.860311] [DEBUG] [REMOTE ] PACK: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-24T20:35:45.860488] [WARN ] [REMOTE ] PACK: No data returned for month 2025-06 [2025-09-24T20:35:46.322357] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T20:35:46.334299] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-24T20:35:46.334497] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-24T20:35:46.431745] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-24T20:35:46.562156] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-24T20:35:46.563048] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:35:46.563254] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:35:46.563510] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-24T20:35:46.563696] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-24T20:35:46.563817] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-24T20:35:46.564051] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-24T20:35:46.564254] [INFO ] [MAIN ] Update Progress: 1623/2373 symbols completed. OXY took 42.6s. Estimated remaining: 1h 39m 41s. Rate: 7.5 symbols/min [2025-09-24T20:35:46.760725] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:35:46.792028] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:46.816209] [DEBUG] [LOCAL ] PAG: Loaded 21938 existing records from primary storage. [2025-09-24T20:35:46.816378] [INFO ] [MAIN ] PAG: Loaded 21938 existing records. [2025-09-24T20:35:47.004235] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:47.004488] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-24T20:35:47.004539] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-24T20:35:47.005307] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-24T20:35:47.005371] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-24T20:35:47.226846] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-24T20:35:47.400424] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:47.804415] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T20:35:48.016143] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-24T20:35:48.816067] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-24T20:35:49.173588] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:35:49.346689] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-24T20:35:49.356669] [INFO ] [REMOTE ] PAAS: Full fetch complete (77372 records). [2025-09-24T20:35:49.356850] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-24T20:35:49.625751] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-24T20:35:49.801131] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-24T20:35:49.801225] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-24T20:35:49.802384] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-24T20:35:49.802453] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-24T20:35:49.804080] [DEBUG] [LOCAL ] PAAS: Trimmed 77372 records to 53603 (keeping 200 days of data) [2025-09-24T20:35:50.148446] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-24T20:35:50.148595] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-24T20:35:50.148719] [INFO ] [MAIN ] Update Progress: 1624/2373 symbols completed. PAAS took 39.5s. Estimated remaining: 1h 39m 31s. Rate: 7.5 symbols/min [2025-09-24T20:35:50.331768] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:50.353129] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T20:35:50.409299] [DEBUG] [LOCAL ] PAGS: Loaded 52684 existing records from primary storage. [2025-09-24T20:35:50.409448] [INFO ] [MAIN ] PAGS: Loaded 52684 existing records. [2025-09-24T20:35:50.422509] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-24T20:35:50.603402] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:50.603809] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-24T20:35:50.603896] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-24T20:35:50.613991] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-24T20:35:50.615004] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T20:35:50.615098] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-24T20:35:50.984684] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:51.216085] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-24T20:35:51.857398] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T20:35:52.016085] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-24T20:35:52.816053] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-24T20:35:52.993792] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T20:35:53.266196] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T20:35:53.616089] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-24T20:35:54.375689] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T20:35:54.382217] [INFO ] [REMOTE ] PACK: Full fetch complete (39557 records). [2025-09-24T20:35:54.382349] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-24T20:35:54.425733] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-24T20:35:54.581991] [WARN ] [VALIDATOR ] PACK: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T20:35:54.582503] [FATAL] [MAIN ] PACK: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:35:54.582580] [WARN ] [MAIN ] PACK: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:35:54.582693] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-24T20:35:54.582778] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-09-24T20:35:54.582819] [INFO ] [LOCAL ] PACK: Starting deletion of derivative data. [2025-09-24T20:35:54.583169] [DEBUG] [LOCAL ] PACK: Deleted derivative data file. [2025-09-24T20:35:54.583283] [INFO ] [MAIN ] Update Progress: 1625/2373 symbols completed. PACK took 29.3s. Estimated remaining: 1h 39m 21s. Rate: 7.5 symbols/min [2025-09-24T20:35:54.760407] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:35:54.765233] [DEBUG] [LOCAL ] PAI: Loaded 2707 existing records from primary storage. [2025-09-24T20:35:54.765339] [INFO ] [MAIN ] PAI: Loaded 2707 existing records. [2025-09-24T20:35:54.944702] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:35:54.944967] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-24T20:35:54.945015] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-24T20:35:54.945324] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-24T20:35:54.945384] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-24T20:35:55.223966] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-24T20:35:55.309453] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:35:55.767412] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T20:35:55.898414] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T20:35:56.016077] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-24T20:35:56.654492] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T20:35:56.816153] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-24T20:35:57.616106] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-24T20:35:57.696913] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T20:35:58.212679] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-24T20:35:58.228777] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T20:35:58.416090] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-24T20:35:58.855419] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-24T20:35:59.216105] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-24T20:35:59.773413] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T20:36:00.016088] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-24T20:36:00.816192] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-24T20:36:01.301981] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T20:36:01.616209] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-24T20:36:02.416090] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-24T20:36:03.216140] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-24T20:36:03.597028] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-24T20:36:04.016097] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-24T20:36:04.656940] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-24T20:36:04.816107] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-24T20:36:04.836183] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T20:36:05.109184] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-24T20:36:05.616165] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-24T20:36:06.185154] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T20:36:06.345551] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T20:36:06.416094] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-24T20:36:06.999857] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-24T20:36:07.216091] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-24T20:36:07.661905] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T20:36:07.755187] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T20:36:08.016094] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-24T20:36:08.816173] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-24T20:36:09.356427] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-24T20:36:09.454757] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:36:09.616106] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-24T20:36:10.416155] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-24T20:36:10.873446] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T20:36:11.216167] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-24T20:36:12.016093] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-24T20:36:12.320096] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T20:36:12.773868] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T20:36:12.783020] [INFO ] [REMOTE ] PACS: Full fetch complete (50747 records). [2025-09-24T20:36:12.783226] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-24T20:36:12.821256] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-24T20:36:13.200907] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-24T20:36:13.201010] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-24T20:36:13.201993] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-24T20:36:13.202064] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-24T20:36:13.203370] [DEBUG] [LOCAL ] PACS: Trimmed 50747 records to 34103 (keeping 200 days of data) [2025-09-24T20:36:13.432297] [DEBUG] [LOCAL ] PACS: Primary data saved (34103 records). [2025-09-24T20:36:13.432550] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-24T20:36:13.432713] [INFO ] [MAIN ] Update Progress: 1626/2373 symbols completed. PACS took 40.0s. Estimated remaining: 1h 39m 18s. Rate: 7.5 symbols/min [2025-09-24T20:36:13.637389] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:13.630862] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-24T20:36:13.639896] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T20:36:13.640096] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-24T20:36:13.644995] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-24T20:36:13.645696] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-24T20:36:13.645769] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-24T20:36:13.645884] [INFO ] [REMOTE ] PAG: Full fetch complete (29976 records). [2025-09-24T20:36:13.646080] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-24T20:36:13.646228] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-24T20:36:13.646507] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-24T20:36:14.479176] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:14.487594] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-24T20:36:14.487450] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-24T20:36:14.488448] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-24T20:36:14.489280] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-24T20:36:14.489457] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-24T20:36:14.490578] [DEBUG] [LOCAL ] PAG: Trimmed 29976 records to 21917 (keeping 200 days of data) [2025-09-24T20:36:14.638663] [DEBUG] [LOCAL ] PAG: Primary data saved (21917 records). [2025-09-24T20:36:14.638808] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-24T20:36:14.638897] [INFO ] [MAIN ] Update Progress: 1627/2373 symbols completed. PAG took 28.1s. Estimated remaining: 1h 39m 7s. Rate: 7.5 symbols/min [2025-09-24T20:36:14.807439] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:14.835110] [DEBUG] [LOCAL ] PAM: Loaded 27935 existing records from primary storage. [2025-09-24T20:36:14.835253] [INFO ] [MAIN ] PAM: Loaded 27935 existing records. [2025-09-24T20:36:15.016041] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:15.016325] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-24T20:36:15.016375] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-24T20:36:15.017268] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-24T20:36:15.017330] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-24T20:36:15.146370] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:15.173028] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-24T20:36:15.183960] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-24T20:36:15.216324] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-24T20:36:15.421399] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:15.843081] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T20:36:16.016108] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-24T20:36:16.427558] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-24T20:36:16.497059] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-24T20:36:16.499425] [INFO ] [REMOTE ] PAI: Full fetch complete (4113 records). [2025-09-24T20:36:16.499533] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-24T20:36:16.829098] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-24T20:36:16.872754] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-24T20:36:16.872845] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-24T20:36:16.873143] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-24T20:36:16.873220] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-24T20:36:16.873847] [DEBUG] [LOCAL ] PAI: Trimmed 4113 records to 2706 (keeping 200 days of data) [2025-09-24T20:36:16.892363] [DEBUG] [LOCAL ] PAI: Primary data saved (2706 records). [2025-09-24T20:36:16.892523] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-24T20:36:16.892623] [INFO ] [MAIN ] Update Progress: 1628/2373 symbols completed. PAI took 22.3s. Estimated remaining: 1h 38m 57s. Rate: 7.5 symbols/min [2025-09-24T20:36:17.073888] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:17.109160] [DEBUG] [LOCAL ] PAR: Loaded 32612 existing records from primary storage. [2025-09-24T20:36:17.109312] [INFO ] [MAIN ] PAR: Loaded 32612 existing records. [2025-09-24T20:36:17.300247] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:17.300557] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-24T20:36:17.300614] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-24T20:36:17.301516] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-24T20:36:17.301580] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-24T20:36:17.628224] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-24T20:36:17.671294] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:18.416111] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-24T20:36:18.458856] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T20:36:18.972450] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T20:36:19.216077] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-24T20:36:19.767142] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T20:36:20.016075] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-24T20:36:20.601792] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T20:36:20.816054] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-24T20:36:21.102708] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:21.103042] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-24T20:36:21.197449] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T20:36:21.616156] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-24T20:36:22.416154] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-24T20:36:22.989902] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T20:36:23.216156] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-24T20:36:24.016089] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-24T20:36:24.816109] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-24T20:36:25.151223] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-24T20:36:25.378796] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:25.379147] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-24T20:36:25.604981] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-24T20:36:25.616032] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-24T20:36:26.184205] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T20:36:26.416104] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-24T20:36:26.884510] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T20:36:27.216156] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-24T20:36:27.642362] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T20:36:28.016097] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-24T20:36:28.816143] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-24T20:36:28.953880] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:36:28.963713] [INFO ] [REMOTE ] PAGS: Full fetch complete (76332 records). [2025-09-24T20:36:28.963853] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-24T20:36:29.370538] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-24T20:36:29.370795] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-24T20:36:29.372229] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-24T20:36:29.372428] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-24T20:36:29.374120] [DEBUG] [LOCAL ] PAGS: Trimmed 76332 records to 52679 (keeping 200 days of data) [2025-09-24T20:36:29.487476] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T20:36:29.628580] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-24T20:36:29.748665] [DEBUG] [LOCAL ] PAGS: Primary data saved (52679 records). [2025-09-24T20:36:29.748847] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-24T20:36:29.748945] [INFO ] [MAIN ] Update Progress: 1629/2373 symbols completed. PAGS took 39.6s. Estimated remaining: 1h 38m 51s. Rate: 7.5 symbols/min [2025-09-24T20:36:29.910248] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:29.928834] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:29.930063] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-24T20:36:29.987301] [DEBUG] [LOCAL ] PARR: Loaded 48351 existing records from primary storage. [2025-09-24T20:36:29.987592] [INFO ] [MAIN ] PARR: Loaded 48351 existing records. [2025-09-24T20:36:30.176288] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:30.176694] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-24T20:36:30.176755] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-24T20:36:30.178003] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-24T20:36:30.178066] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-24T20:36:30.354802] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T20:36:30.421510] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-24T20:36:30.576189] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:31.216082] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-24T20:36:32.025636] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-24T20:36:32.027989] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-24T20:36:32.803409] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T20:36:32.816068] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-24T20:36:32.997312] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:36:33.616081] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-24T20:36:34.416140] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-24T20:36:34.468529] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T20:36:34.743905] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:34.744378] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-24T20:36:34.811285] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T20:36:35.216167] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-24T20:36:35.461553] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:35.462009] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-24T20:36:36.016092] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-24T20:36:36.816084] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-24T20:36:37.340711] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T20:36:37.616146] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-24T20:36:38.416155] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-24T20:36:38.506515] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T20:36:38.758534] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T20:36:39.216163] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-24T20:36:39.462732] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:39.463052] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-24T20:36:39.805831] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T20:36:40.016087] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-24T20:36:40.288493] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:40.288883] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-24T20:36:40.816085] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-24T20:36:41.616091] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-24T20:36:42.137344] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T20:36:42.416073] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-24T20:36:43.217852] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-24T20:36:43.220732] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T20:36:43.494931] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:36:43.495276] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-24T20:36:43.963547] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T20:36:43.971549] [INFO ] [REMOTE ] PAR: Full fetch complete (47189 records). [2025-09-24T20:36:43.971727] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-24T20:36:44.026165] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-24T20:36:44.368745] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-24T20:36:44.368857] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-24T20:36:44.369916] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-24T20:36:44.369982] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-24T20:36:44.371315] [DEBUG] [LOCAL ] PAR: Trimmed 47189 records to 32612 (keeping 200 days of data) [2025-09-24T20:36:44.583337] [DEBUG] [LOCAL ] PAR: Primary data saved (32612 records). [2025-09-24T20:36:44.583533] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-24T20:36:44.583708] [INFO ] [MAIN ] Update Progress: 1630/2373 symbols completed. PAR took 27.7s. Estimated remaining: 1h 38m 46s. Rate: 7.5 symbols/min [2025-09-24T20:36:44.757971] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:44.814333] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-24T20:36:44.814483] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-09-24T20:36:44.825777] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-24T20:36:44.998799] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:44.999116] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-24T20:36:44.999170] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-24T20:36:45.000384] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-24T20:36:45.000456] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-24T20:36:45.372843] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:45.616132] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-24T20:36:45.647822] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T20:36:45.656543] [INFO ] [REMOTE ] PAM: Full fetch complete (41935 records). [2025-09-24T20:36:45.656936] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-24T20:36:46.002299] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-24T20:36:46.017013] [INFO ] [REMOTE ] PAII: Full fetch complete (83 records). [2025-09-24T20:36:46.022894] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-24T20:36:46.172807] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-24T20:36:46.173001] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-24T20:36:46.174040] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-24T20:36:46.180085] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-24T20:36:46.240897] [DEBUG] [LOCAL ] PAM: Trimmed 41935 records to 27952 (keeping 200 days of data) [2025-09-24T20:36:46.263047] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-24T20:36:46.264202] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:36:46.264662] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:36:46.264840] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-24T20:36:46.264972] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-24T20:36:46.265061] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-24T20:36:46.265178] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-24T20:36:46.265424] [INFO ] [MAIN ] Update Progress: 1631/2373 symbols completed. PAII took 32.8s. Estimated remaining: 1h 38m 35s. Rate: 7.5 symbols/min [2025-09-24T20:36:46.429236] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-24T20:36:46.555137] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:46.590481] [DEBUG] [LOCAL ] PAXS: Loaded 21016 existing records from primary storage. [2025-09-24T20:36:46.590874] [INFO ] [MAIN ] PAXS: Loaded 21016 existing records. [2025-09-24T20:36:46.840707] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:46.857124] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T20:36:46.857553] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-24T20:36:46.867886] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-24T20:36:46.869918] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-24T20:36:46.870291] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-24T20:36:47.212559] [DEBUG] [LOCAL ] PAM: Primary data saved (27952 records). [2025-09-24T20:36:47.238061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-24T20:36:47.243485] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-24T20:36:47.243786] [INFO ] [MAIN ] Update Progress: 1632/2373 symbols completed. PAM took 32.6s. Estimated remaining: 1h 38m 24s. Rate: 7.5 symbols/min [2025-09-24T20:36:47.292634] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:47.480266] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:36:47.530784] [DEBUG] [LOCAL ] PAY: Loaded 38383 existing records from primary storage. [2025-09-24T20:36:47.530966] [INFO ] [MAIN ] PAY: Loaded 38383 existing records. [2025-09-24T20:36:47.730284] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:36:47.730556] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-24T20:36:47.730605] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-24T20:36:47.731471] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-24T20:36:47.731550] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-24T20:36:48.021359] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-24T20:36:48.094596] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:36:48.742762] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-24T20:36:48.816071] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-24T20:36:48.861498] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T20:36:48.988365] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T20:36:49.616188] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-24T20:36:50.416098] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-24T20:36:50.762844] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T20:36:50.906092] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-24T20:36:51.216102] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-24T20:36:52.022045] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-24T20:36:52.050860] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T20:36:52.816103] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-24T20:36:53.539850] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T20:36:53.581083] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-24T20:36:53.616154] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-24T20:36:54.264459] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:36:54.416058] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-24T20:36:54.658388] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T20:36:55.216182] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-24T20:36:55.820571] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T20:36:56.016153] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-24T20:36:56.816082] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-24T20:36:56.881911] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T20:36:57.222860] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T20:36:57.616178] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-24T20:36:57.930952] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T20:36:58.416155] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-24T20:36:58.750137] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:36:59.216097] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-24T20:37:00.016054] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-24T20:37:00.167582] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T20:37:00.177765] [INFO ] [REMOTE ] PARR: Full fetch complete (68568 records). [2025-09-24T20:37:00.177912] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-24T20:37:00.600232] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-24T20:37:00.600365] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-24T20:37:00.601400] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-24T20:37:00.601490] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-24T20:37:00.603591] [DEBUG] [LOCAL ] PARR: Trimmed 68568 records to 48352 (keeping 200 days of data) [2025-09-24T20:37:00.817375] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-24T20:37:00.904511] [DEBUG] [LOCAL ] PARR: Primary data saved (48352 records). [2025-09-24T20:37:00.904673] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-24T20:37:00.904813] [INFO ] [MAIN ] Update Progress: 1633/2373 symbols completed. PARR took 31.2s. Estimated remaining: 1h 38m 19s. Rate: 7.5 symbols/min [2025-09-24T20:37:01.090593] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:01.137359] [DEBUG] [LOCAL ] PAYC: Loaded 36312 existing records from primary storage. [2025-09-24T20:37:01.137513] [INFO ] [MAIN ] PAYC: Loaded 36312 existing records. [2025-09-24T20:37:01.329218] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:01.329734] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-24T20:37:01.329798] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-24T20:37:01.330895] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-24T20:37:01.330964] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-24T20:37:01.590764] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-24T20:37:01.666526] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-24T20:37:01.805663] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:01.811825] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:37:01.838126] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T20:37:02.416081] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-24T20:37:03.216097] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-24T20:37:03.961389] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T20:37:04.016173] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-24T20:37:04.688814] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T20:37:04.802806] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-09-24T20:37:04.816060] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-24T20:37:05.261279] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T20:37:05.616087] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-24T20:37:06.416084] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-24T20:37:07.112595] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-24T20:37:07.216088] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-24T20:37:07.268614] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T20:37:08.007116] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T20:37:08.016021] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-24T20:37:08.816089] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-24T20:37:09.616142] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-24T20:37:09.668298] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T20:37:09.749041] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-24T20:37:09.914401] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:37:10.416072] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-24T20:37:10.900199] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T20:37:11.216101] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-24T20:37:11.359944] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T20:37:12.016085] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-24T20:37:12.816091] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-24T20:37:13.535755] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T20:37:13.616094] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-24T20:37:13.679528] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:37:13.731472] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T20:37:14.416072] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-24T20:37:15.035854] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T20:37:15.216074] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-24T20:37:16.016098] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-24T20:37:16.219211] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T20:37:16.816081] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-24T20:37:17.055474] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T20:37:17.061121] [INFO ] [REMOTE ] PAXS: Full fetch complete (31284 records). [2025-09-24T20:37:17.061455] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-24T20:37:17.505746] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-24T20:37:17.505911] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-24T20:37:17.506920] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-24T20:37:17.507010] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-24T20:37:17.508121] [DEBUG] [LOCAL ] PAXS: Trimmed 31284 records to 20964 (keeping 200 days of data) [2025-09-24T20:37:17.617562] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-24T20:37:17.664270] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-24T20:37:17.709679] [DEBUG] [LOCAL ] PAXS: Primary data saved (20964 records). [2025-09-24T20:37:17.709831] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-24T20:37:17.709961] [INFO ] [MAIN ] Update Progress: 1634/2373 symbols completed. PAXS took 31.4s. Estimated remaining: 1h 38m 15s. Rate: 7.5 symbols/min [2025-09-24T20:37:17.896233] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:17.951362] [DEBUG] [LOCAL ] PB: Loaded 41376 existing records from primary storage. [2025-09-24T20:37:17.951525] [INFO ] [MAIN ] PB: Loaded 41376 existing records. [2025-09-24T20:37:18.146664] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:18.147032] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-24T20:37:18.147089] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-24T20:37:18.148511] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-24T20:37:18.148573] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-24T20:37:18.428586] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-24T20:37:18.537256] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:18.548788] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T20:37:19.216050] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-24T20:37:19.265847] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T20:37:20.016102] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-24T20:37:20.615405] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T20:37:20.821681] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-24T20:37:20.833496] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-24T20:37:20.843600] [INFO ] [REMOTE ] PATH: Full fetch complete (77765 records). [2025-09-24T20:37:20.843779] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-24T20:37:21.238965] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-24T20:37:21.239063] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-24T20:37:21.240157] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-24T20:37:21.240223] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-24T20:37:21.241816] [DEBUG] [LOCAL ] PATH: Trimmed 77765 records to 53678 (keeping 200 days of data) [2025-09-24T20:37:21.607561] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T20:37:21.616049] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-24T20:37:21.621745] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-09-24T20:37:21.621854] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-24T20:37:21.621953] [INFO ] [MAIN ] Update Progress: 1635/2373 symbols completed. PATH took 37.0s. Estimated remaining: 1h 38m 5s. Rate: 7.5 symbols/min [2025-09-24T20:37:21.794121] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:21.848205] [DEBUG] [LOCAL ] PBA: Loaded 48964 existing records from primary storage. [2025-09-24T20:37:21.848364] [INFO ] [MAIN ] PBA: Loaded 48964 existing records. [2025-09-24T20:37:22.036895] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:22.037204] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-24T20:37:22.037288] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-24T20:37:22.038561] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-24T20:37:22.038627] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-24T20:37:22.427684] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-24T20:37:22.470931] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:22.495272] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T20:37:22.504127] [INFO ] [REMOTE ] PAY: Full fetch complete (53292 records). [2025-09-24T20:37:22.504287] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-24T20:37:22.947852] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-24T20:37:22.947988] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-24T20:37:22.948925] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-24T20:37:22.948990] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-24T20:37:22.950237] [DEBUG] [LOCAL ] PAY: Trimmed 53292 records to 38400 (keeping 200 days of data) [2025-09-24T20:37:23.183947] [DEBUG] [LOCAL ] PAY: Primary data saved (38400 records). [2025-09-24T20:37:23.184227] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-24T20:37:23.184456] [INFO ] [MAIN ] Update Progress: 1636/2373 symbols completed. PAY took 35.9s. Estimated remaining: 1h 37m 54s. Rate: 7.5 symbols/min [2025-09-24T20:37:23.218119] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-24T20:37:23.373496] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:23.404768] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T20:37:23.465374] [DEBUG] [LOCAL ] PBF: Loaded 53092 existing records from primary storage. [2025-09-24T20:37:23.465548] [INFO ] [MAIN ] PBF: Loaded 53092 existing records. [2025-09-24T20:37:23.641399] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:23.641703] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-24T20:37:23.641759] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-24T20:37:23.642980] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-24T20:37:23.643040] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-24T20:37:24.016298] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-24T20:37:24.026406] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:24.167755] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T20:37:24.674016] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T20:37:24.816134] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-24T20:37:25.569747] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T20:37:25.616044] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-24T20:37:26.416047] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-24T20:37:26.497162] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:37:27.222024] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-24T20:37:27.226770] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T20:37:28.016098] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-24T20:37:28.108555] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T20:37:28.725975] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T20:37:28.732770] [INFO ] [REMOTE ] PAYC: Full fetch complete (52793 records). [2025-09-24T20:37:28.732916] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-24T20:37:28.824494] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-24T20:37:29.121189] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-24T20:37:29.121280] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-24T20:37:29.122167] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-24T20:37:29.122231] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-24T20:37:29.123386] [DEBUG] [LOCAL ] PAYC: Trimmed 52793 records to 36272 (keeping 200 days of data) [2025-09-24T20:37:29.354866] [DEBUG] [LOCAL ] PAYC: Primary data saved (36272 records). [2025-09-24T20:37:29.355023] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-24T20:37:29.355132] [INFO ] [MAIN ] Update Progress: 1637/2373 symbols completed. PAYC took 28.5s. Estimated remaining: 1h 37m 45s. Rate: 7.5 symbols/min [2025-09-24T20:37:29.596841] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:37:29.616037] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-24T20:37:30.353723] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T20:37:30.416146] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-24T20:37:30.798766] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T20:37:31.216080] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-24T20:37:31.941875] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T20:37:32.016039] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-24T20:37:32.701630] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T20:37:32.816048] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-24T20:37:33.616063] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-24T20:37:33.832799] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T20:37:34.416094] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-24T20:37:34.495042] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T20:37:35.216144] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-24T20:37:35.358833] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T20:37:36.016067] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-24T20:37:36.295155] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T20:37:36.817779] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T20:37:36.816490] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-24T20:37:37.364988] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:37:37.616169] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-24T20:37:38.416166] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-24T20:37:38.461217] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T20:37:39.150703] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T20:37:39.216092] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-24T20:37:39.931178] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T20:37:39.939312] [INFO ] [REMOTE ] PB: Full fetch complete (57972 records). [2025-09-24T20:37:39.939450] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-24T20:37:40.021241] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-24T20:37:40.346186] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-24T20:37:40.346281] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-24T20:37:40.347367] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-24T20:37:40.347431] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-24T20:37:40.348752] [DEBUG] [LOCAL ] PB: Trimmed 57972 records to 41367 (keeping 200 days of data) [2025-09-24T20:37:40.609331] [DEBUG] [LOCAL ] PB: Primary data saved (41367 records). [2025-09-24T20:37:40.609469] [INFO ] [MAIN ] PB: Full history saved. [2025-09-24T20:37:40.609553] [INFO ] [MAIN ] Update Progress: 1638/2373 symbols completed. PB took 22.9s. Estimated remaining: 1h 37m 39s. Rate: 7.5 symbols/min [2025-09-24T20:37:40.986423] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T20:37:40.997272] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-24T20:37:42.075515] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T20:37:42.086556] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-24T20:37:42.722897] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T20:37:42.733272] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-24T20:37:43.870509] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T20:37:43.882533] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-24T20:37:44.603623] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T20:37:44.616867] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-24T20:37:45.644295] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T20:37:45.657220] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-24T20:37:46.303757] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T20:37:46.314563] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-24T20:37:47.537494] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-24T20:37:47.551615] [INFO ] [REMOTE ] PBF: Full fetch complete (76570 records). [2025-09-24T20:37:47.551866] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-24T20:37:47.970226] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:37:48.018334] [INFO ] [REMOTE ] PBA: Full fetch complete (71480 records). [2025-09-24T20:37:48.022230] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-24T20:37:48.022387] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-24T20:37:48.022444] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-24T20:37:48.023961] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-24T20:37:48.024157] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-24T20:37:48.132760] [DEBUG] [LOCAL ] PBF: Trimmed 76570 records to 53090 (keeping 200 days of data) [2025-09-24T20:37:48.562564] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-24T20:37:48.563352] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-24T20:37:48.565210] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-24T20:37:48.565301] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-24T20:37:48.572668] [DEBUG] [LOCAL ] PBA: Trimmed 71480 records to 48938 (keeping 200 days of data) [2025-09-24T20:37:49.045610] [DEBUG] [LOCAL ] PBF: Primary data saved (53090 records). [2025-09-24T20:37:49.046565] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-24T20:37:49.046966] [INFO ] [MAIN ] Update Progress: 1639/2373 symbols completed. PBF took 25.9s. Estimated remaining: 1h 37m 31s. Rate: 7.5 symbols/min [2025-09-24T20:37:49.122326] [DEBUG] [LOCAL ] PBA: Primary data saved (48938 records). [2025-09-24T20:37:49.122478] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-24T20:37:49.122570] [INFO ] [MAIN ] Update Progress: 1640/2373 symbols completed. PBA took 27.5s. Estimated remaining: 1h 37m 20s. Rate: 7.5 symbols/min [2025-09-24T20:37:49.658195] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:49.831710] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:49.853367] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:49.872724] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:37:49.903704] [DEBUG] [LOCAL ] PBH: Loaded 31622 existing records from primary storage. [2025-09-24T20:37:49.904103] [INFO ] [MAIN ] PBH: Loaded 31622 existing records. [2025-09-24T20:37:49.968030] [DEBUG] [LOCAL ] PBT: Loaded 17399 existing records from primary storage. [2025-09-24T20:37:49.988397] [INFO ] [MAIN ] PBT: Loaded 17399 existing records. [2025-09-24T20:37:50.253588] [DEBUG] [LOCAL ] PBI: Loaded 50044 existing records from primary storage. [2025-09-24T20:37:50.261997] [INFO ] [MAIN ] PBI: Loaded 50044 existing records. [2025-09-24T20:37:50.287891] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-24T20:37:50.299128] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-09-24T20:37:50.281721] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:50.376581] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-24T20:37:50.480450] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-24T20:37:50.536013] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:50.565086] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-24T20:37:50.590949] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-24T20:37:50.617015] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-24T20:37:50.606540] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-24T20:37:50.714582] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-24T20:37:50.753901] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-24T20:37:50.754100] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:50.765295] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:37:50.809214] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-24T20:37:50.809081] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-24T20:37:50.870891] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-24T20:37:50.865544] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-24T20:37:50.933490] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-24T20:37:50.940576] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-24T20:37:50.957087] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-24T20:37:50.951835] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-24T20:37:52.054010] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:52.090878] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-24T20:37:52.134429] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:52.155783] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-24T20:37:52.249215] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:52.276787] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-24T20:37:52.310179] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:37:52.310683] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-24T20:37:53.284434] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T20:37:53.289244] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-24T20:37:53.385099] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T20:37:53.389879] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-24T20:37:54.049327] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T20:37:54.059418] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-24T20:37:54.210352] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T20:37:54.214422] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-24T20:37:54.606885] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-24T20:37:54.618471] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-24T20:37:54.635468] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T20:37:54.642370] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-24T20:37:54.836782] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T20:37:54.842307] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-24T20:37:55.627662] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T20:37:55.637863] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-24T20:37:55.720364] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T20:37:55.917687] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T20:37:56.016146] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-24T20:37:56.816064] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-24T20:37:56.883236] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T20:37:56.982598] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-24T20:37:57.483824] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T20:37:57.616151] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-24T20:37:58.160394] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T20:37:58.416056] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-24T20:37:58.642587] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T20:37:59.216076] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-24T20:37:59.807983] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T20:37:59.921233] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T20:38:00.016129] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-24T20:38:00.816075] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-24T20:38:01.096442] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T20:38:01.616091] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-24T20:38:02.416200] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-24T20:38:02.880955] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T20:38:03.166872] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T20:38:03.216041] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-24T20:38:04.016099] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-24T20:38:04.307955] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T20:38:04.402261] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T20:38:04.816080] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-24T20:38:05.240377] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T20:38:05.616130] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-24T20:38:06.416063] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-24T20:38:06.581348] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T20:38:06.961815] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T20:38:07.216167] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-24T20:38:08.016063] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-24T20:38:08.259629] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T20:38:08.263410] [INFO ] [REMOTE ] PBT: Full fetch complete (25353 records). [2025-09-24T20:38:08.263499] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-24T20:38:08.650615] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-24T20:38:08.650820] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-24T20:38:08.651596] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-24T20:38:08.651703] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-24T20:38:08.652770] [DEBUG] [LOCAL ] PBT: Trimmed 25353 records to 17360 (keeping 200 days of data) [2025-09-24T20:38:08.771377] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-24T20:38:08.804820] [DEBUG] [LOCAL ] PBT: Primary data saved (17360 records). [2025-09-24T20:38:08.804967] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-24T20:38:08.805064] [INFO ] [MAIN ] Update Progress: 1641/2373 symbols completed. PBT took 19.7s. Estimated remaining: 1h 37m 17s. Rate: 7.5 symbols/min [2025-09-24T20:38:08.825765] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-24T20:38:08.977465] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:08.987554] [DEBUG] [LOCAL ] PCF: Loaded 8660 existing records from primary storage. [2025-09-24T20:38:08.987772] [INFO ] [MAIN ] PCF: Loaded 8660 existing records. [2025-09-24T20:38:09.165200] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:09.165459] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-24T20:38:09.165507] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-24T20:38:09.165887] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-24T20:38:09.165948] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-24T20:38:09.551033] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:09.616033] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-24T20:38:09.872147] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T20:38:10.416091] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-24T20:38:11.029455] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T20:38:11.216093] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-24T20:38:11.309618] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T20:38:11.724261] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T20:38:12.016435] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-24T20:38:12.016829] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T20:38:12.816083] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-24T20:38:13.616124] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-24T20:38:14.363256] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-24T20:38:14.401829] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T20:38:14.416035] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-24T20:38:15.216098] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-24T20:38:15.561388] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T20:38:16.016163] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-24T20:38:16.690491] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T20:38:16.697598] [INFO ] [REMOTE ] PBH: Full fetch complete (42899 records). [2025-09-24T20:38:16.697830] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-24T20:38:16.820799] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-24T20:38:16.826329] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-24T20:38:16.949425] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T20:38:17.164727] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-24T20:38:17.164820] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-24T20:38:17.165759] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-24T20:38:17.165823] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-24T20:38:17.166937] [DEBUG] [LOCAL ] PBH: Trimmed 42899 records to 31589 (keeping 200 days of data) [2025-09-24T20:38:17.356250] [DEBUG] [LOCAL ] PBH: Primary data saved (31589 records). [2025-09-24T20:38:17.356386] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-24T20:38:17.356474] [INFO ] [MAIN ] Update Progress: 1642/2373 symbols completed. PBH took 28.2s. Estimated remaining: 1h 37m 9s. Rate: 7.5 symbols/min [2025-09-24T20:38:17.523335] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:17.523554] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-24T20:38:17.523610] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-24T20:38:17.523773] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-24T20:38:17.523816] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-24T20:38:17.523858] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-24T20:38:17.523890] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-24T20:38:17.621232] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-24T20:38:17.901807] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:18.416085] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-24T20:38:18.738680] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T20:38:19.216188] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-24T20:38:19.274004] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T20:38:19.585014] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T20:38:20.016151] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-24T20:38:20.816080] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-24T20:38:20.958952] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-24T20:38:21.220765] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T20:38:21.616152] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-24T20:38:22.178079] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T20:38:22.416086] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-24T20:38:22.559075] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T20:38:23.216071] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-24T20:38:23.356416] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T20:38:24.016160] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-24T20:38:24.816086] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-24T20:38:24.864542] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T20:38:25.215714] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T20:38:25.226205] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-24T20:38:25.226426] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-24T20:38:25.621296] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-24T20:38:25.679024] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-24T20:38:25.679177] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-24T20:38:25.680517] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-24T20:38:25.680733] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-24T20:38:25.682684] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 53713 (keeping 200 days of data) [2025-09-24T20:38:26.029856] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-09-24T20:38:26.030009] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-24T20:38:26.030118] [INFO ] [MAIN ] Update Progress: 1643/2373 symbols completed. PBR took 36.9s. Estimated remaining: 1h 37m 1s. Rate: 7.5 symbols/min [2025-09-24T20:38:26.199685] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:26.208099] [DEBUG] [LOCAL ] PCM: Loaded 6808 existing records from primary storage. [2025-09-24T20:38:26.208204] [INFO ] [MAIN ] PCM: Loaded 6808 existing records. [2025-09-24T20:38:26.391019] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:26.391279] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-24T20:38:26.391332] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-24T20:38:26.391734] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-24T20:38:26.391799] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-24T20:38:26.425780] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-24T20:38:26.781207] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:26.868460] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-24T20:38:27.216194] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-24T20:38:27.266783] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T20:38:27.364155] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:38:27.372995] [INFO ] [REMOTE ] PBI: Full fetch complete (71936 records). [2025-09-24T20:38:27.373121] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-24T20:38:27.764770] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-24T20:38:27.764866] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-24T20:38:27.765910] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-24T20:38:27.765974] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-24T20:38:27.767446] [DEBUG] [LOCAL ] PBI: Trimmed 71936 records to 50024 (keeping 200 days of data) [2025-09-24T20:38:28.038250] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-24T20:38:28.075673] [DEBUG] [LOCAL ] PBI: Primary data saved (50024 records). [2025-09-24T20:38:28.075800] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-24T20:38:28.075922] [INFO ] [MAIN ] Update Progress: 1644/2373 symbols completed. PBI took 39.0s. Estimated remaining: 1h 36m 51s. Rate: 7.5 symbols/min [2025-09-24T20:38:28.247271] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:28.271773] [DEBUG] [LOCAL ] PCN: Loaded 24269 existing records from primary storage. [2025-09-24T20:38:28.271907] [INFO ] [MAIN ] PCN: Loaded 24269 existing records. [2025-09-24T20:38:28.452144] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:28.452438] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-24T20:38:28.452488] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-24T20:38:28.453429] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-24T20:38:28.453490] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-24T20:38:28.826751] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:28.820844] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-24T20:38:28.860296] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T20:38:28.920246] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T20:38:28.922905] [INFO ] [REMOTE ] PCF: Full fetch complete (14402 records). [2025-09-24T20:38:28.922977] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-24T20:38:29.306254] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-24T20:38:29.306336] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-24T20:38:29.306675] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-24T20:38:29.306736] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-24T20:38:29.307232] [DEBUG] [LOCAL ] PCF: Trimmed 14402 records to 8630 (keeping 200 days of data) [2025-09-24T20:38:29.358589] [DEBUG] [LOCAL ] PCF: Primary data saved (8630 records). [2025-09-24T20:38:29.358726] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-24T20:38:29.358817] [INFO ] [MAIN ] Update Progress: 1645/2373 symbols completed. PCF took 20.6s. Estimated remaining: 1h 36m 40s. Rate: 7.5 symbols/min [2025-09-24T20:38:29.537733] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:29.582339] [DEBUG] [LOCAL ] PCOR: Loaded 48183 existing records from primary storage. [2025-09-24T20:38:29.582544] [INFO ] [MAIN ] PCOR: Loaded 48183 existing records. [2025-09-24T20:38:29.621359] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-24T20:38:29.787931] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:29.788256] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-24T20:38:29.788308] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-24T20:38:29.789737] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-24T20:38:29.789801] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-24T20:38:29.963351] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T20:38:30.172789] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:30.416083] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-24T20:38:31.072236] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T20:38:31.216164] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-24T20:38:31.865187] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T20:38:31.900163] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T20:38:32.016150] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-24T20:38:32.770246] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T20:38:32.816041] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-24T20:38:33.616086] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-24T20:38:33.644557] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T20:38:34.416155] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-24T20:38:35.216125] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-24T20:38:35.507089] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T20:38:35.530972] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T20:38:36.010634] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T20:38:36.016018] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-24T20:38:36.680911] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T20:38:36.816093] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-24T20:38:37.616058] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-24T20:38:37.952226] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T20:38:38.416062] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-24T20:38:39.216054] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-24T20:38:39.466603] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T20:38:39.540055] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T20:38:40.016066] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-24T20:38:40.081721] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T20:38:40.816155] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-24T20:38:41.538775] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T20:38:41.616101] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-24T20:38:42.416055] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-24T20:38:42.561055] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T20:38:43.216052] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-24T20:38:43.296285] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T20:38:43.862471] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T20:38:44.016101] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-24T20:38:44.816103] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-24T20:38:45.080575] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T20:38:45.205115] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-24T20:38:45.476026] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T20:38:45.616161] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-24T20:38:46.416073] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-24T20:38:47.216077] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-24T20:38:47.405125] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:38:48.016216] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-24T20:38:48.396057] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T20:38:48.667236] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-24T20:38:48.816099] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-24T20:38:49.616100] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-24T20:38:49.726416] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T20:38:49.768600] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T20:38:50.116939] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T20:38:50.416076] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-24T20:38:51.216086] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-24T20:38:52.016206] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-24T20:38:52.190959] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T20:38:52.816175] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-24T20:38:52.891527] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T20:38:53.616152] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-24T20:38:54.012068] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T20:38:54.017996] [INFO ] [REMOTE ] PCN: Full fetch complete (33920 records). [2025-09-24T20:38:54.018358] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-24T20:38:54.280275] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-24T20:38:54.422394] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-24T20:38:54.471790] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T20:38:54.501752] [INFO ] [REMOTE ] PCM: Full fetch complete (10428 records). [2025-09-24T20:38:54.521306] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-24T20:38:54.638739] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-24T20:38:54.649301] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-24T20:38:54.658767] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-24T20:38:54.661299] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-24T20:38:54.688945] [DEBUG] [LOCAL ] PCN: Trimmed 33920 records to 24313 (keeping 200 days of data) [2025-09-24T20:38:55.083531] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-24T20:38:55.087811] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-24T20:38:55.087898] [DEBUG] [LOCAL ] PCN: Primary data saved (24313 records). [2025-09-24T20:38:55.088299] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-24T20:38:55.088408] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-24T20:38:55.088492] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-24T20:38:55.088634] [INFO ] [MAIN ] Update Progress: 1646/2373 symbols completed. PCN took 27.0s. Estimated remaining: 1h 36m 40s. Rate: 7.5 symbols/min [2025-09-24T20:38:55.158175] [DEBUG] [LOCAL ] PCM: Trimmed 10428 records to 6803 (keeping 200 days of data) [2025-09-24T20:38:55.219769] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-24T20:38:55.300575] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:55.314812] [DEBUG] [LOCAL ] PCM: Primary data saved (6803 records). [2025-09-24T20:38:55.315683] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-24T20:38:55.315806] [INFO ] [MAIN ] Update Progress: 1647/2373 symbols completed. PCM took 29.3s. Estimated remaining: 1h 36m 28s. Rate: 7.5 symbols/min [2025-09-24T20:38:55.433909] [DEBUG] [LOCAL ] PCQ: Loaded 11979 existing records from primary storage. [2025-09-24T20:38:55.434177] [INFO ] [MAIN ] PCQ: Loaded 11979 existing records. [2025-09-24T20:38:55.651070] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:55.715151] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:55.715437] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-24T20:38:55.715521] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-24T20:38:55.716135] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-24T20:38:55.716200] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-24T20:38:56.119305] [DEBUG] [LOCAL ] PD: Loaded 47890 existing records from primary storage. [2025-09-24T20:38:56.135842] [INFO ] [MAIN ] PD: Loaded 47890 existing records. [2025-09-24T20:38:56.175166] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:56.196715] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-24T20:38:56.415965] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T20:38:56.421447] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:38:56.461974] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-24T20:38:56.464126] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T20:38:56.464294] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-24T20:38:56.474533] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-24T20:38:56.474698] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-24T20:38:56.480064] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-24T20:38:56.524388] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-24T20:38:56.554140] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:38:56.577958] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:38:56.587210] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:38:56.587304] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-24T20:38:56.590316] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-24T20:38:56.590379] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-24T20:38:56.590449] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-24T20:38:56.590921] [INFO ] [MAIN ] Update Progress: 1648/2373 symbols completed. PCG took 39.2s. Estimated remaining: 1h 36m 18s. Rate: 7.5 symbols/min [2025-09-24T20:38:56.826184] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-24T20:38:57.011411] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:38:57.020342] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-24T20:38:57.040252] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:57.035951] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-24T20:38:57.040732] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-24T20:38:57.040785] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-24T20:38:57.040829] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-24T20:38:57.040861] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-24T20:38:57.410884] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:38:57.469452] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T20:38:57.616044] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-24T20:38:57.943631] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-24T20:38:58.416144] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-24T20:38:58.563110] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T20:38:59.216062] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-24T20:38:59.277077] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:38:59.549053] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-24T20:39:00.016139] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-24T20:39:00.806727] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T20:39:00.816032] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-24T20:39:01.616090] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-24T20:39:01.965403] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T20:39:02.416072] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-24T20:39:03.216192] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-24T20:39:04.016173] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-24T20:39:04.330508] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T20:39:04.811818] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T20:39:04.816096] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-24T20:39:05.203484] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (3.59 seconds). [2025-09-24T20:39:05.616093] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-24T20:39:05.709559] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:39:06.416054] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-24T20:39:06.480524] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-24T20:39:06.766595] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T20:39:06.935288] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T20:39:07.216085] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-24T20:39:08.016137] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-24T20:39:08.517206] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T20:39:08.816205] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-24T20:39:08.957140] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T20:39:09.351217] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T20:39:09.616127] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-24T20:39:10.028196] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T20:39:10.416134] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-24T20:39:10.882408] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T20:39:11.216147] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-24T20:39:11.698051] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T20:39:12.016162] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-24T20:39:12.816196] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-24T20:39:13.540774] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T20:39:13.616060] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-24T20:39:14.320835] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:39:14.416078] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-24T20:39:14.800578] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-24T20:39:14.801428] [INFO ] [REMOTE ] PDCC: Full fetch complete (1329 records). [2025-09-24T20:39:14.801526] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-24T20:39:14.994079] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-24T20:39:14.994320] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:39:14.994424] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:39:14.994538] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-24T20:39:14.994668] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-24T20:39:14.994761] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-24T20:39:14.994848] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-24T20:39:14.994945] [INFO ] [MAIN ] Update Progress: 1649/2373 symbols completed. PDCC took 18.4s. Estimated remaining: 1h 36m 14s. Rate: 7.5 symbols/min [2025-09-24T20:39:15.183809] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:15.199125] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T20:39:15.216049] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-24T20:39:15.264734] [DEBUG] [LOCAL ] PDI: Loaded 50218 existing records from primary storage. [2025-09-24T20:39:15.264955] [INFO ] [MAIN ] PDI: Loaded 50218 existing records. [2025-09-24T20:39:15.449961] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:15.450289] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-24T20:39:15.450361] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-24T20:39:15.451751] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-24T20:39:15.451813] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-24T20:39:15.804519] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:16.016085] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-24T20:39:16.035206] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T20:39:16.039293] [INFO ] [REMOTE ] PCQ: Full fetch complete (17378 records). [2025-09-24T20:39:16.039373] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-24T20:39:16.419242] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-24T20:39:16.419370] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-24T20:39:16.420010] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-24T20:39:16.420103] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-24T20:39:16.421963] [DEBUG] [LOCAL ] PCQ: Trimmed 17378 records to 11972 (keeping 200 days of data) [2025-09-24T20:39:16.500176] [DEBUG] [LOCAL ] PCQ: Primary data saved (11972 records). [2025-09-24T20:39:16.500327] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-24T20:39:16.500445] [INFO ] [MAIN ] Update Progress: 1650/2373 symbols completed. PCQ took 21.4s. Estimated remaining: 1h 36m 3s. Rate: 7.5 symbols/min [2025-09-24T20:39:16.681813] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:16.732100] [DEBUG] [LOCAL ] PDM: Loaded 39851 existing records from primary storage. [2025-09-24T20:39:16.732315] [INFO ] [MAIN ] PDM: Loaded 39851 existing records. [2025-09-24T20:39:16.826016] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-24T20:39:16.927702] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:16.927969] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-24T20:39:16.928022] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-24T20:39:16.929011] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-24T20:39:16.929074] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-24T20:39:17.307122] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:17.616084] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-24T20:39:17.909379] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T20:39:18.416258] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-24T20:39:18.570759] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:39:18.584624] [INFO ] [REMOTE ] PCOR: Full fetch complete (69705 records). [2025-09-24T20:39:18.584782] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-24T20:39:19.029318] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-24T20:39:19.029507] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-24T20:39:19.030681] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-24T20:39:19.030750] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-24T20:39:19.032744] [DEBUG] [LOCAL ] PCOR: Trimmed 69705 records to 48193 (keeping 200 days of data) [2025-09-24T20:39:19.234080] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-24T20:39:19.298264] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T20:39:19.383182] [DEBUG] [LOCAL ] PCOR: Primary data saved (48193 records). [2025-09-24T20:39:19.383348] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-24T20:39:19.383495] [INFO ] [MAIN ] Update Progress: 1651/2373 symbols completed. PCOR took 50.0s. Estimated remaining: 1h 35m 53s. Rate: 7.5 symbols/min [2025-09-24T20:39:19.571238] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:19.614372] [DEBUG] [LOCAL ] PDO: Loaded 31798 existing records from primary storage. [2025-09-24T20:39:19.614542] [INFO ] [MAIN ] PDO: Loaded 31798 existing records. [2025-09-24T20:39:19.861813] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:19.862342] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-24T20:39:19.862506] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-24T20:39:19.863703] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-24T20:39:19.863768] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-24T20:39:20.016060] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-24T20:39:20.260867] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:20.266057] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T20:39:20.823004] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-24T20:39:20.842193] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T20:39:21.616156] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-24T20:39:21.819736] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T20:39:22.416150] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-24T20:39:22.636161] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T20:39:23.017501] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T20:39:23.216174] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-24T20:39:23.975478] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T20:39:24.016102] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-24T20:39:24.816155] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-24T20:39:25.609134] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-24T20:39:25.616878] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-24T20:39:25.970169] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T20:39:26.416184] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-24T20:39:26.899363] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T20:39:27.216084] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-24T20:39:27.412823] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T20:39:27.458693] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-24T20:39:28.016089] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-24T20:39:28.816054] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-24T20:39:28.928341] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T20:39:29.436520] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T20:39:29.616180] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-24T20:39:30.416125] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-24T20:39:30.484415] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T20:39:31.216199] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-24T20:39:31.485085] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T20:39:31.967630] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T20:39:32.016083] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-24T20:39:32.816150] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-24T20:39:32.896973] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T20:39:33.616156] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-24T20:39:33.678016] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:39:34.416060] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-24T20:39:34.768631] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T20:39:34.991864] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T20:39:35.216091] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-24T20:39:36.016148] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-24T20:39:36.465292] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T20:39:36.816251] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-24T20:39:37.168580] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T20:39:37.177866] [INFO ] [REMOTE ] PD: Full fetch complete (67510 records). [2025-09-24T20:39:37.178031] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-24T20:39:37.363567] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T20:39:37.609469] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-24T20:39:37.609565] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-24T20:39:37.610608] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-24T20:39:37.610696] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-24T20:39:37.612118] [DEBUG] [LOCAL ] PD: Trimmed 67510 records to 47875 (keeping 200 days of data) [2025-09-24T20:39:37.616172] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-24T20:39:37.902383] [DEBUG] [LOCAL ] PD: Primary data saved (47875 records). [2025-09-24T20:39:37.902529] [INFO ] [MAIN ] PD: Full history saved. [2025-09-24T20:39:37.902616] [INFO ] [MAIN ] Update Progress: 1652/2373 symbols completed. PD took 42.6s. Estimated remaining: 1h 35m 50s. Rate: 7.5 symbols/min [2025-09-24T20:39:38.071614] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:38.089867] [DEBUG] [LOCAL ] PDS: Loaded 18197 existing records from primary storage. [2025-09-24T20:39:38.089991] [INFO ] [MAIN ] PDS: Loaded 18197 existing records. [2025-09-24T20:39:38.266154] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:38.266389] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-24T20:39:38.266437] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-24T20:39:38.267144] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-24T20:39:38.267205] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-24T20:39:38.421952] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-24T20:39:38.639954] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:38.780002] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T20:39:38.814904] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T20:39:39.216144] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-24T20:39:39.575487] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T20:39:40.016197] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-24T20:39:40.816136] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-24T20:39:40.944088] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T20:39:41.090785] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T20:39:41.616132] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-24T20:39:42.251737] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:39:42.416192] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-24T20:39:43.221531] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-24T20:39:43.245058] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T20:39:43.266765] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-24T20:39:44.016100] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-24T20:39:44.816075] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-24T20:39:45.124419] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T20:39:45.453735] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:39:45.616086] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-24T20:39:46.101435] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T20:39:46.107249] [INFO ] [REMOTE ] PDO: Full fetch complete (47999 records). [2025-09-24T20:39:46.107428] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-24T20:39:46.421154] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-24T20:39:46.488843] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-24T20:39:46.488936] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-24T20:39:46.489831] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-24T20:39:46.489893] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-24T20:39:46.490940] [DEBUG] [LOCAL ] PDO: Trimmed 47999 records to 31740 (keeping 200 days of data) [2025-09-24T20:39:46.686919] [DEBUG] [LOCAL ] PDO: Primary data saved (31740 records). [2025-09-24T20:39:46.687062] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-24T20:39:46.687149] [INFO ] [MAIN ] Update Progress: 1653/2373 symbols completed. PDO took 27.3s. Estimated remaining: 1h 35m 42s. Rate: 7.5 symbols/min [2025-09-24T20:39:46.859995] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:46.877937] [DEBUG] [LOCAL ] PDT: Loaded 17267 existing records from primary storage. [2025-09-24T20:39:46.878125] [INFO ] [MAIN ] PDT: Loaded 17267 existing records. [2025-09-24T20:39:47.061734] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:47.061999] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-24T20:39:47.062048] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-24T20:39:47.063394] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-24T20:39:47.063461] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-24T20:39:47.219730] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-24T20:39:47.448924] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:47.479480] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T20:39:47.513055] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T20:39:48.016200] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-24T20:39:48.795330] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T20:39:48.802341] [INFO ] [REMOTE ] PDM: Full fetch complete (57344 records). [2025-09-24T20:39:48.802486] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-24T20:39:48.824094] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-24T20:39:49.224371] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-24T20:39:49.224775] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-24T20:39:49.226226] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-24T20:39:49.226300] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-24T20:39:49.229037] [DEBUG] [LOCAL ] PDM: Trimmed 57344 records to 39873 (keeping 200 days of data) [2025-09-24T20:39:49.353769] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-24T20:39:49.487856] [DEBUG] [LOCAL ] PDM: Primary data saved (39873 records). [2025-09-24T20:39:49.488009] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-24T20:39:49.488113] [INFO ] [MAIN ] Update Progress: 1654/2373 symbols completed. PDM took 33.0s. Estimated remaining: 1h 35m 32s. Rate: 7.5 symbols/min [2025-09-24T20:39:49.621394] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-24T20:39:49.670814] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:49.688708] [DEBUG] [LOCAL ] PDX: Loaded 14342 existing records from primary storage. [2025-09-24T20:39:49.688869] [INFO ] [MAIN ] PDX: Loaded 14342 existing records. [2025-09-24T20:39:49.868878] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:49.869139] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-24T20:39:49.869188] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-24T20:39:49.869750] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-24T20:39:49.869819] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-24T20:39:50.260678] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:50.416094] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-24T20:39:50.852200] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T20:39:50.862052] [INFO ] [REMOTE ] PDI: Full fetch complete (73086 records). [2025-09-24T20:39:50.862175] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-24T20:39:51.187867] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T20:39:51.221343] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-24T20:39:51.297305] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-24T20:39:51.297396] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-24T20:39:51.298578] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-24T20:39:51.298667] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-24T20:39:51.300172] [DEBUG] [LOCAL ] PDI: Trimmed 73086 records to 50205 (keeping 200 days of data) [2025-09-24T20:39:51.554438] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T20:39:51.647671] [DEBUG] [LOCAL ] PDI: Primary data saved (50205 records). [2025-09-24T20:39:51.647824] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-24T20:39:51.647911] [INFO ] [MAIN ] Update Progress: 1655/2373 symbols completed. PDI took 36.7s. Estimated remaining: 1h 35m 21s. Rate: 7.5 symbols/min [2025-09-24T20:39:51.816582] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:39:51.867358] [DEBUG] [LOCAL ] PEB: Loaded 50733 existing records from primary storage. [2025-09-24T20:39:51.867542] [INFO ] [MAIN ] PEB: Loaded 50733 existing records. [2025-09-24T20:39:52.021286] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-24T20:39:52.053219] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:39:52.053512] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-24T20:39:52.053563] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-24T20:39:52.054906] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-24T20:39:52.054976] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-24T20:39:52.421017] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:39:52.701035] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T20:39:52.733565] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T20:39:52.816086] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-24T20:39:53.616094] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-24T20:39:53.842819] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-24T20:39:54.416169] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-24T20:39:55.216165] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-24T20:39:55.312623] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T20:39:55.401521] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T20:39:56.016070] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-24T20:39:56.309239] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T20:39:56.816088] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-24T20:39:57.616149] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-24T20:39:57.764794] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T20:39:58.416057] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-24T20:39:58.561231] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T20:39:58.721221] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T20:39:59.216052] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-24T20:39:59.521715] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T20:40:00.016095] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-24T20:40:00.442955] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T20:40:00.816185] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-24T20:40:01.143540] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:40:01.616205] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-24T20:40:02.423611] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-24T20:40:02.448151] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T20:40:02.873602] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T20:40:03.216133] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-24T20:40:03.426673] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-24T20:40:04.016205] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-24T20:40:04.146742] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T20:40:04.816064] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-24T20:40:04.972214] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T20:40:05.616070] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-24T20:40:06.416058] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-24T20:40:06.682759] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T20:40:06.711566] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T20:40:07.216052] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-24T20:40:07.470875] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T20:40:07.473894] [INFO ] [REMOTE ] PDS: Full fetch complete (25667 records). [2025-09-24T20:40:07.473993] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-24T20:40:07.851500] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-24T20:40:07.851632] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-24T20:40:07.852238] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-24T20:40:07.852284] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-24T20:40:07.853173] [DEBUG] [LOCAL ] PDS: Trimmed 25667 records to 18126 (keeping 200 days of data) [2025-09-24T20:40:07.959844] [DEBUG] [LOCAL ] PDS: Primary data saved (18126 records). [2025-09-24T20:40:07.960000] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-24T20:40:07.960091] [INFO ] [MAIN ] Update Progress: 1656/2373 symbols completed. PDS took 30.1s. Estimated remaining: 1h 35m 17s. Rate: 7.5 symbols/min [2025-09-24T20:40:08.023413] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-24T20:40:08.136287] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:08.136471] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-24T20:40:08.136508] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-24T20:40:08.136685] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-24T20:40:08.136739] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-24T20:40:08.136781] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-24T20:40:08.136814] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-24T20:40:08.497623] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T20:40:08.540171] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:08.816139] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-24T20:40:09.210950] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-24T20:40:09.616045] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-24T20:40:09.882162] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T20:40:09.885287] [INFO ] [REMOTE ] PDT: Full fetch complete (25057 records). [2025-09-24T20:40:09.885370] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-24T20:40:10.254944] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-24T20:40:10.255048] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-24T20:40:10.255591] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-24T20:40:10.255631] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-24T20:40:10.256318] [DEBUG] [LOCAL ] PDT: Trimmed 25057 records to 17234 (keeping 200 days of data) [2025-09-24T20:40:10.361295] [DEBUG] [LOCAL ] PDT: Primary data saved (17234 records). [2025-09-24T20:40:10.361439] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-24T20:40:10.361537] [INFO ] [MAIN ] Update Progress: 1657/2373 symbols completed. PDT took 23.7s. Estimated remaining: 1h 35m 7s. Rate: 7.5 symbols/min [2025-09-24T20:40:10.424481] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-24T20:40:10.534339] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:10.565564] [DEBUG] [LOCAL ] PEN: Loaded 30520 existing records from primary storage. [2025-09-24T20:40:10.565723] [INFO ] [MAIN ] PEN: Loaded 30520 existing records. [2025-09-24T20:40:10.742052] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:40:10.742322] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-24T20:40:10.742370] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-24T20:40:10.743184] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-24T20:40:10.743245] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-24T20:40:11.171153] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:11.216054] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-24T20:40:11.427703] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T20:40:11.549437] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T20:40:12.016150] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-24T20:40:12.816076] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-24T20:40:13.118163] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T20:40:13.616141] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-24T20:40:13.764858] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T20:40:14.089464] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T20:40:14.416097] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-24T20:40:15.216193] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-24T20:40:15.343038] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:40:15.428302] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T20:40:16.016148] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-24T20:40:16.816060] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-24T20:40:16.993530] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T20:40:17.068585] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-24T20:40:17.616075] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-24T20:40:17.821392] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T20:40:18.416136] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-24T20:40:19.001276] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T20:40:19.216182] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-24T20:40:20.016164] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-24T20:40:20.310072] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T20:40:20.591584] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T20:40:20.816060] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-24T20:40:21.113456] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T20:40:21.616175] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-24T20:40:22.354302] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T20:40:22.369378] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:40:22.372354] [INFO ] [REMOTE ] PDX: Full fetch complete (24612 records). [2025-09-24T20:40:22.372472] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-24T20:40:22.421390] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-24T20:40:22.779412] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-24T20:40:22.779499] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-24T20:40:22.780110] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-24T20:40:22.780174] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-24T20:40:22.780881] [DEBUG] [LOCAL ] PDX: Trimmed 24612 records to 14310 (keeping 200 days of data) [2025-09-24T20:40:22.874964] [DEBUG] [LOCAL ] PDX: Primary data saved (14310 records). [2025-09-24T20:40:22.875112] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-24T20:40:22.875197] [INFO ] [MAIN ] Update Progress: 1658/2373 symbols completed. PDX took 33.4s. Estimated remaining: 1h 35m 1s. Rate: 7.5 symbols/min [2025-09-24T20:40:23.061232] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:23.074322] [DEBUG] [LOCAL ] PEO: Loaded 10835 existing records from primary storage. [2025-09-24T20:40:23.074491] [INFO ] [MAIN ] PEO: Loaded 10835 existing records. [2025-09-24T20:40:23.229411] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-24T20:40:23.276603] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:40:23.276942] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-24T20:40:23.277000] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-24T20:40:23.277437] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-24T20:40:23.277500] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-24T20:40:23.677252] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:24.010397] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:40:24.021188] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-24T20:40:24.816153] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-24T20:40:25.041677] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T20:40:25.346910] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T20:40:25.616135] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-24T20:40:26.416074] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-24T20:40:26.767176] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T20:40:27.216055] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-24T20:40:27.306483] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T20:40:27.315161] [INFO ] [REMOTE ] PEB: Full fetch complete (72734 records). [2025-09-24T20:40:27.315291] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-24T20:40:27.713629] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-24T20:40:27.713747] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-24T20:40:27.714867] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-24T20:40:27.714935] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-24T20:40:27.716506] [DEBUG] [LOCAL ] PEB: Trimmed 72734 records to 50706 (keeping 200 days of data) [2025-09-24T20:40:28.019733] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-24T20:40:28.038384] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T20:40:28.065423] [DEBUG] [LOCAL ] PEB: Primary data saved (50706 records). [2025-09-24T20:40:28.065593] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-24T20:40:28.065720] [INFO ] [MAIN ] Update Progress: 1659/2373 symbols completed. PEB took 36.4s. Estimated remaining: 1h 34m 52s. Rate: 7.5 symbols/min [2025-09-24T20:40:28.239263] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:28.255196] [DEBUG] [LOCAL ] PERF: Loaded 14019 existing records from primary storage. [2025-09-24T20:40:28.255323] [INFO ] [MAIN ] PERF: Loaded 14019 existing records. [2025-09-24T20:40:28.436142] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:40:28.436438] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-24T20:40:28.436489] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-24T20:40:28.437009] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-24T20:40:28.437071] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-24T20:40:28.801702] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:28.816025] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-24T20:40:28.881766] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:40:29.213256] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-24T20:40:29.550112] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T20:40:29.616040] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-24T20:40:30.416130] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-24T20:40:31.022352] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T20:40:31.216156] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-24T20:40:32.016122] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-24T20:40:32.326755] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T20:40:32.385416] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T20:40:32.816143] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-24T20:40:33.177708] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:40:33.616150] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-24T20:40:34.163391] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T20:40:34.416134] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-24T20:40:35.216168] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-24T20:40:35.556489] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T20:40:35.594804] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T20:40:36.016155] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-24T20:40:36.457925] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T20:40:36.816200] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-24T20:40:37.616165] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-24T20:40:37.948941] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T20:40:37.975234] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:40:37.980331] [INFO ] [REMOTE ] PEN: Full fetch complete (44065 records). [2025-09-24T20:40:37.980442] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-24T20:40:38.420221] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-24T20:40:38.419960] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-24T20:40:38.421109] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-24T20:40:38.421980] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-24T20:40:38.422136] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-24T20:40:38.423267] [DEBUG] [LOCAL ] PEN: Trimmed 44065 records to 30504 (keeping 200 days of data) [2025-09-24T20:40:38.609496] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T20:40:38.629955] [DEBUG] [LOCAL ] PEN: Primary data saved (30504 records). [2025-09-24T20:40:38.630071] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-24T20:40:38.630151] [INFO ] [MAIN ] Update Progress: 1660/2373 symbols completed. PEN took 28.3s. Estimated remaining: 1h 34m 45s. Rate: 7.5 symbols/min [2025-09-24T20:40:38.796297] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:38.796478] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-24T20:40:38.796515] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-24T20:40:38.796691] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-24T20:40:38.796743] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-24T20:40:38.796787] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-24T20:40:38.796819] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-24T20:40:39.176494] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:39.216038] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-24T20:40:39.360722] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T20:40:39.369733] [INFO ] [REMOTE ] PEG: Full fetch complete (76273 records). [2025-09-24T20:40:39.369891] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-24T20:40:39.370713] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:40:39.370803] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:40:39.370847] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:40:39.370889] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-24T20:40:39.370968] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-24T20:40:39.371024] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-24T20:40:39.371092] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-24T20:40:39.371175] [INFO ] [MAIN ] Update Progress: 1661/2373 symbols completed. PEG took 31.4s. Estimated remaining: 1h 34m 34s. Rate: 7.5 symbols/min [2025-09-24T20:40:39.519312] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:39.545639] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-24T20:40:39.545513] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:39.552929] [DEBUG] [LOCAL ] PFD: Loaded 5136 existing records from primary storage. [2025-09-24T20:40:39.553011] [INFO ] [MAIN ] PFD: Loaded 5136 existing records. [2025-09-24T20:40:39.733601] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:40:39.733900] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-24T20:40:39.733950] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-24T20:40:39.734342] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-24T20:40:39.734403] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-24T20:40:40.021432] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-24T20:40:40.104844] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:40.379590] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:40.379941] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-24T20:40:40.816089] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-24T20:40:41.616071] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-24T20:40:41.711723] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T20:40:42.416167] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-24T20:40:42.502069] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T20:40:43.171697] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-24T20:40:43.216094] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-24T20:40:44.016156] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-24T20:40:44.141356] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T20:40:44.816061] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-24T20:40:44.880316] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T20:40:45.616134] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-24T20:40:45.735551] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T20:40:46.416056] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-24T20:40:46.706155] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T20:40:47.069292] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T20:40:47.216138] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-24T20:40:47.529790] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:47.530126] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-24T20:40:48.016083] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-24T20:40:48.294763] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:48.295099] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-24T20:40:48.816084] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-24T20:40:49.616083] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-24T20:40:49.717498] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T20:40:49.889104] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:49.889434] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-24T20:40:50.416122] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-24T20:40:51.049869] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T20:40:51.216081] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-24T20:40:52.016086] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-24T20:40:52.427281] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T20:40:52.649121] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T20:40:52.816121] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-24T20:40:53.616077] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-24T20:40:53.852673] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T20:40:54.416178] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-24T20:40:54.496634] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T20:40:54.721846] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:54.722269] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-24T20:40:55.216097] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-24T20:40:56.016064] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-24T20:40:56.222787] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T20:40:56.225731] [INFO ] [REMOTE ] PERF: Full fetch complete (21958 records). [2025-09-24T20:40:56.225810] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-24T20:40:56.611586] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-24T20:40:56.611756] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-24T20:40:56.612301] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-24T20:40:56.612345] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-24T20:40:56.613015] [DEBUG] [LOCAL ] PERF: Trimmed 21958 records to 14031 (keeping 200 days of data) [2025-09-24T20:40:56.693523] [DEBUG] [LOCAL ] PERF: Primary data saved (14031 records). [2025-09-24T20:40:56.693683] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-24T20:40:56.693786] [INFO ] [MAIN ] Update Progress: 1662/2373 symbols completed. PERF took 28.6s. Estimated remaining: 1h 34m 30s. Rate: 7.5 symbols/min [2025-09-24T20:40:56.799797] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T20:40:56.816854] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-24T20:40:56.873551] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:40:56.873718] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-24T20:40:56.873773] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-24T20:40:56.873917] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-24T20:40:56.873960] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-24T20:40:56.874004] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-24T20:40:56.874164] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-24T20:40:57.148486] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:40:57.149116] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-24T20:40:57.226117] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:40:57.616082] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-24T20:40:58.212687] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:40:58.416137] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-24T20:40:59.216080] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-24T20:41:00.016069] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-24T20:41:00.198940] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T20:41:00.816073] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-24T20:41:01.060180] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T20:41:01.616140] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-24T20:41:02.143534] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-24T20:41:02.241118] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T20:41:02.416090] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-24T20:41:02.701374] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T20:41:03.219583] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-24T20:41:04.016140] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-24T20:41:04.105798] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-24T20:41:04.816135] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-24T20:41:04.828284] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T20:41:05.308498] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-24T20:41:05.616082] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-24T20:41:05.661414] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T20:41:05.663839] [INFO ] [REMOTE ] PEO: Full fetch complete (16400 records). [2025-09-24T20:41:05.663917] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-24T20:41:06.026974] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-24T20:41:06.027058] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-24T20:41:06.027455] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-24T20:41:06.027516] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-24T20:41:06.028347] [DEBUG] [LOCAL ] PEO: Trimmed 16400 records to 10831 (keeping 200 days of data) [2025-09-24T20:41:06.098241] [DEBUG] [LOCAL ] PEO: Primary data saved (10831 records). [2025-09-24T20:41:06.098430] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-24T20:41:06.098549] [INFO ] [MAIN ] Update Progress: 1663/2373 symbols completed. PEO took 43.2s. Estimated remaining: 1h 34m 22s. Rate: 7.5 symbols/min [2025-09-24T20:41:06.267273] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:06.312254] [DEBUG] [LOCAL ] PFGC: Loaded 46970 existing records from primary storage. [2025-09-24T20:41:06.312399] [INFO ] [MAIN ] PFGC: Loaded 46970 existing records. [2025-09-24T20:41:06.421231] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-24T20:41:06.492178] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:06.492436] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-24T20:41:06.492485] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-24T20:41:06.493867] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-24T20:41:06.493940] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-24T20:41:06.886690] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:07.216067] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-24T20:41:07.259295] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T20:41:07.928546] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-24T20:41:08.016140] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-24T20:41:08.816066] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-24T20:41:08.909494] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T20:41:08.916396] [INFO ] [REMOTE ] PEW: Full fetch complete (15708 records). [2025-09-24T20:41:08.916567] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-24T20:41:09.102633] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 50 unique days, need 200 days [2025-09-24T20:41:09.102993] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:41:09.103065] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:41:09.103137] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-24T20:41:09.103204] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-24T20:41:09.103242] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-24T20:41:09.103281] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-24T20:41:09.103340] [INFO ] [MAIN ] Update Progress: 1664/2373 symbols completed. PEW took 30.5s. Estimated remaining: 1h 34m 12s. Rate: 7.5 symbols/min [2025-09-24T20:41:09.273751] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:09.283705] [DEBUG] [LOCAL ] PFH: Loaded 6888 existing records from primary storage. [2025-09-24T20:41:09.284287] [INFO ] [MAIN ] PFH: Loaded 6888 existing records. [2025-09-24T20:41:09.471116] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:09.471420] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-24T20:41:09.471477] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-24T20:41:09.471936] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-24T20:41:09.472000] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-24T20:41:09.592958] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T20:41:09.621285] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-24T20:41:09.622081] [INFO ] [REMOTE ] PFD: Full fetch complete (7360 records). [2025-09-24T20:41:09.648478] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-24T20:41:10.095166] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:10.304043] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-24T20:41:10.304133] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-24T20:41:10.304349] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-24T20:41:10.304407] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-24T20:41:10.304902] [DEBUG] [LOCAL ] PFD: Trimmed 7360 records to 5133 (keeping 200 days of data) [2025-09-24T20:41:10.339976] [DEBUG] [LOCAL ] PFD: Primary data saved (5133 records). [2025-09-24T20:41:10.340081] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-24T20:41:10.340214] [INFO ] [MAIN ] Update Progress: 1665/2373 symbols completed. PFD took 31.0s. Estimated remaining: 1h 34m 1s. Rate: 7.5 symbols/min [2025-09-24T20:41:10.421205] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-24T20:41:10.513480] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:10.530317] [DEBUG] [LOCAL ] PFL: Loaded 13823 existing records from primary storage. [2025-09-24T20:41:10.530433] [INFO ] [MAIN ] PFL: Loaded 13823 existing records. [2025-09-24T20:41:10.723682] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:10.724410] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-24T20:41:10.724511] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-24T20:41:10.725163] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-24T20:41:10.725243] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-24T20:41:10.864721] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-24T20:41:11.140730] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:11.216056] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-24T20:41:11.292338] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T20:41:11.377610] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T20:41:12.016094] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-24T20:41:12.462525] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T20:41:12.513148] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T20:41:12.816082] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-24T20:41:13.616060] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-24T20:41:13.769735] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T20:41:14.416080] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-24T20:41:15.216153] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-24T20:41:15.350537] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:41:16.016186] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-24T20:41:16.034601] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T20:41:16.816076] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-24T20:41:17.068103] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-24T20:41:17.500672] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T20:41:17.616051] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-24T20:41:17.735780] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T20:41:18.352397] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T20:41:18.416160] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-24T20:41:19.216134] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-24T20:41:19.223624] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T20:41:20.016065] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-24T20:41:20.123933] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T20:41:20.816120] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-24T20:41:21.616093] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-24T20:41:21.682500] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T20:41:22.416131] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-24T20:41:22.458339] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T20:41:23.216150] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-24T20:41:23.699838] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-24T20:41:23.982625] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T20:41:24.016063] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-24T20:41:24.171607] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T20:41:24.575250] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T20:41:24.816153] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-24T20:41:25.569086] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:41:25.616076] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-24T20:41:26.390616] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T20:41:26.416090] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-24T20:41:27.216065] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-24T20:41:27.357959] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T20:41:28.016173] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-24T20:41:28.816150] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-24T20:41:29.616059] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-24T20:41:29.641586] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T20:41:29.737287] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-24T20:41:30.116905] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-24T20:41:30.416084] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-24T20:41:30.518338] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T20:41:31.216145] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-24T20:41:31.889243] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T20:41:31.964234] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:41:31.965693] [INFO ] [REMOTE ] PFH: Full fetch complete (10672 records). [2025-09-24T20:41:31.965786] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-24T20:41:32.025807] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-24T20:41:32.367457] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-24T20:41:32.367548] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-24T20:41:32.367915] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-24T20:41:32.368009] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-24T20:41:32.368498] [DEBUG] [LOCAL ] PFH: Trimmed 10672 records to 6842 (keeping 200 days of data) [2025-09-24T20:41:32.417331] [DEBUG] [LOCAL ] PFH: Primary data saved (6842 records). [2025-09-24T20:41:32.417469] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-24T20:41:32.417589] [INFO ] [MAIN ] Update Progress: 1666/2373 symbols completed. PFH took 23.3s. Estimated remaining: 1h 33m 59s. Rate: 7.5 symbols/min [2025-09-24T20:41:32.609293] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:32.669573] [DEBUG] [LOCAL ] PFLT: Loaded 43594 existing records from primary storage. [2025-09-24T20:41:32.669744] [INFO ] [MAIN ] PFLT: Loaded 43594 existing records. [2025-09-24T20:41:32.818614] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-24T20:41:32.861298] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:32.861548] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-24T20:41:32.861605] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-24T20:41:32.863404] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-24T20:41:32.863493] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-24T20:41:33.190966] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-24T20:41:33.261948] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:33.616075] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-24T20:41:34.416144] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-24T20:41:35.216160] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-24T20:41:35.340917] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T20:41:35.378159] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T20:41:35.381836] [INFO ] [REMOTE ] PFL: Full fetch complete (20163 records). [2025-09-24T20:41:35.382021] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-24T20:41:35.782748] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-24T20:41:35.782861] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-24T20:41:35.783401] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-24T20:41:35.783483] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-24T20:41:35.784470] [DEBUG] [LOCAL ] PFL: Trimmed 20163 records to 13824 (keeping 200 days of data) [2025-09-24T20:41:35.889588] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-24T20:41:35.925417] [DEBUG] [LOCAL ] PFL: Primary data saved (13824 records). [2025-09-24T20:41:35.925576] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-24T20:41:35.925748] [INFO ] [MAIN ] Update Progress: 1667/2373 symbols completed. PFL took 25.6s. Estimated remaining: 1h 33m 49s. Rate: 7.5 symbols/min [2025-09-24T20:41:36.021353] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-24T20:41:36.117870] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:36.141818] [DEBUG] [LOCAL ] PFN: Loaded 21604 existing records from primary storage. [2025-09-24T20:41:36.141995] [INFO ] [MAIN ] PFN: Loaded 21604 existing records. [2025-09-24T20:41:36.324221] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:36.324502] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-24T20:41:36.324568] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-24T20:41:36.325180] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-24T20:41:36.325242] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-24T20:41:36.698603] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:36.816127] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-24T20:41:36.900673] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T20:41:37.474232] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T20:41:37.616051] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-24T20:41:38.285788] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:41:38.416060] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-24T20:41:39.216168] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-24T20:41:39.338890] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T20:41:40.016158] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-24T20:41:40.816077] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-24T20:41:40.878460] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T20:41:41.039759] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T20:41:41.142717] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-24T20:41:41.616168] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-24T20:41:42.427391] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-24T20:41:42.433515] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T20:41:42.456207] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T20:41:43.216139] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-24T20:41:43.300138] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T20:41:43.310353] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-24T20:41:43.310531] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-24T20:41:43.311314] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:41:43.311408] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:41:43.311467] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:41:43.311543] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-24T20:41:43.311626] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-24T20:41:43.311724] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-24T20:41:43.311833] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-24T20:41:43.311941] [INFO ] [MAIN ] Update Progress: 1668/2373 symbols completed. PFE took 46.6s. Estimated remaining: 1h 33m 41s. Rate: 7.5 symbols/min [2025-09-24T20:41:43.490779] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:43.501307] [DEBUG] [LOCAL ] PFO: Loaded 5868 existing records from primary storage. [2025-09-24T20:41:43.501426] [INFO ] [MAIN ] PFO: Loaded 5868 existing records. [2025-09-24T20:41:43.680161] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:43.680478] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-24T20:41:43.680526] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-24T20:41:43.681011] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-24T20:41:43.681072] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-24T20:41:44.019809] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-24T20:41:44.110249] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:44.816136] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-24T20:41:44.849397] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:41:44.861935] [INFO ] [REMOTE ] PFGC: Full fetch complete (67244 records). [2025-09-24T20:41:44.862119] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-24T20:41:45.280545] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-24T20:41:45.280638] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-24T20:41:45.281944] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-24T20:41:45.282017] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-24T20:41:45.283473] [DEBUG] [LOCAL ] PFGC: Trimmed 67244 records to 46955 (keeping 200 days of data) [2025-09-24T20:41:45.616474] [DEBUG] [LOCAL ] PFGC: Primary data saved (46955 records). [2025-09-24T20:41:45.616749] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-24T20:41:45.616954] [INFO ] [MAIN ] Update Progress: 1669/2373 symbols completed. PFGC took 39.5s. Estimated remaining: 1h 33m 31s. Rate: 7.5 symbols/min [2025-09-24T20:41:45.617069] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-24T20:41:45.807323] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:41:45.857731] [DEBUG] [LOCAL ] PFS: Loaded 35755 existing records from primary storage. [2025-09-24T20:41:45.858032] [INFO ] [MAIN ] PFS: Loaded 35755 existing records. [2025-09-24T20:41:46.049978] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T20:41:46.103879] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:41:46.104927] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-24T20:41:46.105283] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-24T20:41:46.123288] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-24T20:41:46.134214] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-24T20:41:46.207543] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-24T20:41:46.421202] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-24T20:41:46.530764] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:41:46.611621] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T20:41:47.216165] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-24T20:41:48.016050] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-24T20:41:48.221453] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T20:41:48.264297] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T20:41:48.816088] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-24T20:41:49.466018] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T20:41:49.616090] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-24T20:41:49.747944] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T20:41:50.256658] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T20:41:50.416130] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-24T20:41:51.007768] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T20:41:51.216094] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-24T20:41:51.874809] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T20:41:52.016080] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-24T20:41:52.716608] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T20:41:52.816068] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-24T20:41:53.616110] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-24T20:41:54.349409] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T20:41:54.416039] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-24T20:41:54.678351] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T20:41:55.216093] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-24T20:41:55.505553] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T20:41:56.016080] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-24T20:41:56.363079] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T20:41:56.722500] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T20:41:56.816094] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-24T20:41:57.616118] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-24T20:41:58.416142] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-24T20:41:58.514912] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T20:41:59.108924] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T20:41:59.216053] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-24T20:41:59.603931] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T20:42:00.016087] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-24T20:42:00.816063] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-24T20:42:01.164252] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T20:42:01.188970] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:42:01.193684] [INFO ] [REMOTE ] PFN: Full fetch complete (30629 records). [2025-09-24T20:42:01.193836] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-24T20:42:01.593174] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-24T20:42:01.593260] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-24T20:42:01.594038] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-24T20:42:01.594105] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-24T20:42:01.595137] [DEBUG] [LOCAL ] PFN: Trimmed 30629 records to 21637 (keeping 200 days of data) [2025-09-24T20:42:01.658328] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-24T20:42:01.741193] [DEBUG] [LOCAL ] PFN: Primary data saved (21637 records). [2025-09-24T20:42:01.741352] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-24T20:42:01.741459] [INFO ] [MAIN ] Update Progress: 1670/2373 symbols completed. PFN took 25.8s. Estimated remaining: 1h 33m 26s. Rate: 7.5 symbols/min [2025-09-24T20:42:01.931665] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:01.969173] [DEBUG] [LOCAL ] PFSI: Loaded 28853 existing records from primary storage. [2025-09-24T20:42:01.969338] [INFO ] [MAIN ] PFSI: Loaded 28853 existing records. [2025-09-24T20:42:02.153249] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:42:02.153547] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-24T20:42:02.153602] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-24T20:42:02.154666] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-24T20:42:02.154729] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-24T20:42:02.421269] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-24T20:42:02.549722] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:03.216087] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-24T20:42:03.349348] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-24T20:42:04.016083] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-24T20:42:04.821809] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-24T20:42:04.823368] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-24T20:42:05.108571] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (3.45 seconds). [2025-09-24T20:42:05.132608] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T20:42:05.577158] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:42:05.577772] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T20:42:05.616133] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-24T20:42:06.419271] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T20:42:06.418683] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-24T20:42:07.216164] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-24T20:42:07.828056] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T20:42:08.016140] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-24T20:42:08.816054] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-24T20:42:08.953367] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:42:08.961787] [INFO ] [REMOTE ] PFLT: Full fetch complete (63312 records). [2025-09-24T20:42:08.961958] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-24T20:42:09.379864] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-24T20:42:09.380041] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-24T20:42:09.381123] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-24T20:42:09.381208] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-24T20:42:09.398502] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T20:42:09.404563] [DEBUG] [LOCAL ] PFLT: Trimmed 63312 records to 43621 (keeping 200 days of data) [2025-09-24T20:42:09.625511] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-24T20:42:09.687805] [DEBUG] [LOCAL ] PFLT: Primary data saved (43621 records). [2025-09-24T20:42:09.687947] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-24T20:42:09.688056] [INFO ] [MAIN ] Update Progress: 1671/2373 symbols completed. PFLT took 37.3s. Estimated remaining: 1h 33m 18s. Rate: 7.5 symbols/min [2025-09-24T20:42:09.859881] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:09.860119] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-24T20:42:09.860208] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-24T20:42:09.860323] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-24T20:42:09.860362] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-24T20:42:09.860404] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-24T20:42:09.860437] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-24T20:42:10.216364] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:10.373672] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:42:10.416043] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-24T20:42:10.667179] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T20:42:11.216085] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-24T20:42:11.680206] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T20:42:12.016085] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-24T20:42:12.816156] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-24T20:42:13.616085] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-24T20:42:14.102084] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T20:42:14.105695] [INFO ] [REMOTE ] PFO: Full fetch complete (7854 records). [2025-09-24T20:42:14.105854] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-24T20:42:14.110356] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-24T20:42:14.421292] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-24T20:42:14.544378] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-24T20:42:14.544527] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-24T20:42:14.544825] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-24T20:42:14.545071] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-24T20:42:14.547120] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-24T20:42:14.557566] [DEBUG] [LOCAL ] PFO: Trimmed 7854 records to 5878 (keeping 200 days of data) [2025-09-24T20:42:14.595160] [DEBUG] [LOCAL ] PFO: Primary data saved (5878 records). [2025-09-24T20:42:14.595280] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-24T20:42:14.595384] [INFO ] [MAIN ] Update Progress: 1672/2373 symbols completed. PFO took 31.3s. Estimated remaining: 1h 33m 9s. Rate: 7.5 symbols/min [2025-09-24T20:42:14.793964] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:14.817125] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T20:42:14.829415] [DEBUG] [LOCAL ] PGP: Loaded 5468 existing records from primary storage. [2025-09-24T20:42:14.829578] [INFO ] [MAIN ] PGP: Loaded 5468 existing records. [2025-09-24T20:42:15.024914] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:42:15.025220] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-24T20:42:15.025271] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-24T20:42:15.025626] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-24T20:42:15.025747] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-24T20:42:15.221249] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-24T20:42:15.454727] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:16.016201] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-24T20:42:16.394819] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T20:42:16.795469] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T20:42:16.801753] [INFO ] [REMOTE ] PFS: Full fetch complete (51538 records). [2025-09-24T20:42:16.801882] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-24T20:42:16.823968] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-24T20:42:17.223627] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-24T20:42:17.223966] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-24T20:42:17.225151] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-24T20:42:17.225252] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-24T20:42:17.243456] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T20:42:17.249373] [DEBUG] [LOCAL ] PFS: Trimmed 51538 records to 35685 (keeping 200 days of data) [2025-09-24T20:42:17.486499] [DEBUG] [LOCAL ] PFS: Primary data saved (35685 records). [2025-09-24T20:42:17.486680] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-24T20:42:17.486787] [INFO ] [MAIN ] Update Progress: 1673/2373 symbols completed. PFS took 31.9s. Estimated remaining: 1h 32m 59s. Rate: 7.5 symbols/min [2025-09-24T20:42:17.628614] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-24T20:42:17.663409] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:17.664289] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-24T20:42:17.664440] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-24T20:42:17.664616] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-24T20:42:17.664719] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-24T20:42:17.664778] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-24T20:42:17.664812] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-24T20:42:17.775926] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T20:42:18.038624] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:18.416169] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-24T20:42:18.850546] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:42:18.907427] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-24T20:42:19.216149] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-24T20:42:19.837124] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T20:42:20.016084] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-24T20:42:20.816175] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-24T20:42:21.475819] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T20:42:21.492802] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-24T20:42:21.616091] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-24T20:42:22.237101] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-24T20:42:22.416122] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-24T20:42:23.216143] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-24T20:42:24.016220] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-24T20:42:24.478412] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-24T20:42:24.816143] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-24T20:42:24.950736] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T20:42:25.616191] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-24T20:42:26.043163] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T20:42:26.049290] [INFO ] [REMOTE ] PFSI: Full fetch complete (40665 records). [2025-09-24T20:42:26.049415] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-24T20:42:26.378454] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T20:42:26.419309] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-24T20:42:26.461869] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-24T20:42:26.462768] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-24T20:42:26.463780] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-24T20:42:26.463957] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-24T20:42:26.465534] [DEBUG] [LOCAL ] PFSI: Trimmed 40665 records to 28903 (keeping 200 days of data) [2025-09-24T20:42:26.596587] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-24T20:42:26.703130] [DEBUG] [LOCAL ] PFSI: Primary data saved (28903 records). [2025-09-24T20:42:26.703288] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-24T20:42:26.703379] [INFO ] [MAIN ] Update Progress: 1674/2373 symbols completed. PFSI took 25.0s. Estimated remaining: 1h 32m 52s. Rate: 7.5 symbols/min [2025-09-24T20:42:26.876534] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:26.923873] [DEBUG] [LOCAL ] PGRE: Loaded 46370 existing records from primary storage. [2025-09-24T20:42:26.924073] [INFO ] [MAIN ] PGRE: Loaded 46370 existing records. [2025-09-24T20:42:27.108575] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:42:27.108911] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-24T20:42:27.108963] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-24T20:42:27.109970] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-24T20:42:27.110031] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-24T20:42:27.221326] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-24T20:42:27.480299] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:28.016186] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-24T20:42:28.592128] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T20:42:28.631561] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-24T20:42:28.816081] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-24T20:42:29.211996] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T20:42:29.616160] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-24T20:42:30.416145] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-24T20:42:30.889920] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T20:42:30.915299] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T20:42:31.124235] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T20:42:31.216162] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-24T20:42:32.016136] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-24T20:42:32.816138] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-24T20:42:33.517581] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T20:42:33.519276] [INFO ] [REMOTE ] PGP: Full fetch complete (7912 records). [2025-09-24T20:42:33.519348] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-24T20:42:33.623375] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-24T20:42:33.674187] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-24T20:42:33.943894] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-24T20:42:33.943998] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-24T20:42:33.944339] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-24T20:42:33.944442] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-24T20:42:33.945107] [DEBUG] [LOCAL ] PGP: Trimmed 7912 records to 5465 (keeping 200 days of data) [2025-09-24T20:42:34.003981] [DEBUG] [LOCAL ] PGP: Primary data saved (5465 records). [2025-09-24T20:42:34.004207] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-24T20:42:34.004519] [INFO ] [MAIN ] Update Progress: 1675/2373 symbols completed. PGP took 19.4s. Estimated remaining: 1h 32m 43s. Rate: 7.5 symbols/min [2025-09-24T20:42:34.038164] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-24T20:42:34.187419] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:34.194953] [DEBUG] [LOCAL ] PGZ: Loaded 5388 existing records from primary storage. [2025-09-24T20:42:34.195075] [INFO ] [MAIN ] PGZ: Loaded 5388 existing records. [2025-09-24T20:42:34.397047] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:42:34.397409] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-24T20:42:34.397486] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-24T20:42:34.397916] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-24T20:42:34.398001] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-24T20:42:34.421178] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-24T20:42:34.777809] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:35.166489] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T20:42:35.216041] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-24T20:42:36.016150] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-24T20:42:36.361306] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T20:42:36.520732] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-24T20:42:36.816147] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-24T20:42:37.616039] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-24T20:42:38.177794] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-24T20:42:38.416127] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-24T20:42:38.554486] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T20:42:39.216123] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-24T20:42:39.815218] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-24T20:42:40.016046] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-24T20:42:40.071794] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:42:40.092025] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T20:42:40.816164] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-24T20:42:41.500853] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T20:42:41.616144] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-24T20:42:42.279299] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-24T20:42:42.305905] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T20:42:42.416144] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-24T20:42:43.216186] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-24T20:42:44.016181] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-24T20:42:44.084322] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T20:42:44.816195] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-24T20:42:45.264478] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T20:42:45.616125] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-24T20:42:46.219242] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-24T20:42:46.316770] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T20:42:46.416122] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-24T20:42:47.081664] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T20:42:47.092011] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-24T20:42:47.092250] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-24T20:42:47.093355] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:42:47.093457] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:42:47.093503] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:42:47.093549] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-24T20:42:47.093620] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-24T20:42:47.093694] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-24T20:42:47.093758] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-24T20:42:47.093836] [INFO ] [MAIN ] Update Progress: 1676/2373 symbols completed. PG took 37.4s. Estimated remaining: 1h 32m 37s. Rate: 7.5 symbols/min [2025-09-24T20:42:47.220611] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-24T20:42:47.279160] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:42:47.332951] [DEBUG] [LOCAL ] PH: Loaded 38934 existing records from primary storage. [2025-09-24T20:42:47.333165] [INFO ] [MAIN ] PH: Loaded 38934 existing records. [2025-09-24T20:42:47.544023] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:42:47.544488] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-24T20:42:47.544767] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-24T20:42:47.546338] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-24T20:42:47.546448] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-24T20:42:47.742997] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T20:42:47.925801] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T20:42:48.002146] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:42:48.016035] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-24T20:42:48.816187] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-24T20:42:49.597087] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T20:42:49.616029] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-24T20:42:50.416202] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-24T20:42:50.853974] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T20:42:51.216055] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-24T20:42:51.527577] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T20:42:51.729888] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T20:42:52.016081] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-24T20:42:52.816127] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-24T20:42:53.269160] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T20:42:53.502363] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T20:42:53.616076] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-24T20:42:53.788692] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T20:42:54.416081] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-24T20:42:55.049567] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:42:55.216152] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-24T20:42:56.001169] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:42:56.016037] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-24T20:42:56.816170] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-24T20:42:56.987272] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T20:42:57.316011] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T20:42:57.616153] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-24T20:42:57.917873] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T20:42:58.416127] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-24T20:42:59.221272] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-24T20:42:59.249547] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:42:59.263787] [INFO ] [REMOTE ] PGRE: Full fetch complete (63463 records). [2025-09-24T20:42:59.264014] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-24T20:42:59.804066] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T20:42:59.807376] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-24T20:42:59.808065] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-24T20:42:59.809293] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-24T20:42:59.809518] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-24T20:42:59.811623] [DEBUG] [LOCAL ] PGRE: Trimmed 63463 records to 46473 (keeping 200 days of data) [2025-09-24T20:42:59.944049] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T20:43:00.033604] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-24T20:43:00.142511] [DEBUG] [LOCAL ] PGRE: Primary data saved (46473 records). [2025-09-24T20:43:00.142711] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-24T20:43:00.142808] [INFO ] [MAIN ] Update Progress: 1677/2373 symbols completed. PGRE took 33.4s. Estimated remaining: 1h 32m 32s. Rate: 7.5 symbols/min [2025-09-24T20:43:00.816088] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-24T20:43:01.545434] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T20:43:01.616130] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-24T20:43:01.863329] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T20:43:02.324950] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T20:43:02.416141] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-24T20:43:03.216065] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-24T20:43:03.342673] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:43:03.344853] [INFO ] [REMOTE ] PGZ: Full fetch complete (8976 records). [2025-09-24T20:43:03.344958] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-24T20:43:03.727843] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-24T20:43:03.727934] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-24T20:43:03.728298] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-24T20:43:03.728361] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-24T20:43:03.729314] [DEBUG] [LOCAL ] PGZ: Trimmed 8976 records to 5385 (keeping 200 days of data) [2025-09-24T20:43:03.763002] [DEBUG] [LOCAL ] PGZ: Primary data saved (5385 records). [2025-09-24T20:43:03.763118] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-24T20:43:03.763203] [INFO ] [MAIN ] Update Progress: 1678/2373 symbols completed. PGZ took 29.8s. Estimated remaining: 1h 32m 22s. Rate: 7.5 symbols/min [2025-09-24T20:43:04.016142] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-24T20:43:04.910125] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-24T20:43:04.919535] [INFO ] [REMOTE ] PGR: Full fetch complete (76230 records). [2025-09-24T20:43:04.919709] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-24T20:43:04.920580] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:43:04.920708] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:43:04.920759] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:43:04.920802] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-24T20:43:04.920889] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-24T20:43:04.920949] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-24T20:43:04.921018] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-24T20:43:04.921108] [INFO ] [MAIN ] Update Progress: 1679/2373 symbols completed. PGR took 47.4s. Estimated remaining: 1h 32m 11s. Rate: 7.5 symbols/min [2025-09-24T20:43:05.126399] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-24T20:43:05.137025] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-24T20:43:06.917459] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T20:43:06.925973] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-24T20:43:08.430688] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T20:43:08.436635] [INFO ] [REMOTE ] PH: Full fetch complete (56725 records). [2025-09-24T20:43:08.436784] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-24T20:43:08.833401] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-24T20:43:08.833485] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-24T20:43:08.834508] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-24T20:43:08.834572] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-24T20:43:08.835746] [DEBUG] [LOCAL ] PH: Trimmed 56725 records to 38807 (keeping 200 days of data) [2025-09-24T20:43:09.089963] [DEBUG] [LOCAL ] PH: Primary data saved (38807 records). [2025-09-24T20:43:09.090244] [INFO ] [MAIN ] PH: Full history saved. [2025-09-24T20:43:09.090346] [INFO ] [MAIN ] Update Progress: 1680/2373 symbols completed. PH took 22.0s. Estimated remaining: 1h 32m 1s. Rate: 7.5 symbols/min [2025-09-24T20:43:09.878077] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:09.949931] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:09.956823] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:09.983413] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:10.005164] [DEBUG] [LOCAL ] PHD: Loaded 9688 existing records from primary storage. [2025-09-24T20:43:10.005568] [INFO ] [MAIN ] PHD: Loaded 9688 existing records. [2025-09-24T20:43:10.056871] [DEBUG] [LOCAL ] PHI: Loaded 14960 existing records from primary storage. [2025-09-24T20:43:10.069928] [INFO ] [MAIN ] PHI: Loaded 14960 existing records. [2025-09-24T20:43:10.200967] [DEBUG] [LOCAL ] PHIN: Loaded 33279 existing records from primary storage. [2025-09-24T20:43:10.216780] [INFO ] [MAIN ] PHIN: Loaded 33279 existing records. [2025-09-24T20:43:10.487146] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:10.510443] [DEBUG] [LOCAL ] PHG: Loaded 46196 existing records from primary storage. [2025-09-24T20:43:10.521077] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-24T20:43:10.521486] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-24T20:43:10.521319] [INFO ] [MAIN ] PHG: Loaded 46196 existing records. [2025-09-24T20:43:10.563876] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-24T20:43:10.569188] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-24T20:43:10.725194] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:10.776850] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:10.847773] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-24T20:43:10.868963] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-24T20:43:10.858417] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-24T20:43:10.874322] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-24T20:43:10.905081] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-24T20:43:10.916186] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-24T20:43:10.957495] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-24T20:43:11.073346] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-24T20:43:11.201629] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:11.319462] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-24T20:43:11.434207] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-24T20:43:11.491265] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-24T20:43:11.538417] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-24T20:43:11.794702] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:11.844828] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-24T20:43:12.170515] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:12.177267] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-24T20:43:12.356636] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:12.398414] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-24T20:43:12.543389] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:12.543748] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-24T20:43:13.127015] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-24T20:43:13.130927] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-24T20:43:13.219557] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T20:43:13.222914] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-24T20:43:13.970096] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:43:13.974365] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-24T20:43:13.997494] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T20:43:14.008251] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-24T20:43:14.041739] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:43:14.044664] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-24T20:43:14.247595] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T20:43:14.256362] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-24T20:43:14.495511] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T20:43:14.497970] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-24T20:43:14.649247] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T20:43:15.071811] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T20:43:15.216058] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-24T20:43:15.339124] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T20:43:15.600232] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T20:43:15.873678] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T20:43:16.016168] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-24T20:43:16.816123] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-24T20:43:17.441240] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T20:43:17.616075] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-24T20:43:18.211902] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T20:43:18.416215] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-24T20:43:18.452527] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T20:43:19.218023] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-24T20:43:19.222693] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T20:43:20.016133] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-24T20:43:20.213768] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T20:43:20.816164] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-24T20:43:21.616082] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-24T20:43:21.847522] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T20:43:22.368080] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T20:43:22.410506] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T20:43:22.416067] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-24T20:43:23.216128] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-24T20:43:24.016179] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-24T20:43:24.233992] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:43:24.812953] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T20:43:24.821664] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-24T20:43:24.823900] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T20:43:25.616146] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-24T20:43:26.416082] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-24T20:43:26.597088] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T20:43:26.727231] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T20:43:27.200517] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T20:43:27.216130] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-24T20:43:27.979458] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T20:43:28.016040] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-24T20:43:28.816051] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-24T20:43:28.826353] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T20:43:29.616112] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-24T20:43:29.909260] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T20:43:30.416149] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-24T20:43:31.195759] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T20:43:31.216047] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-24T20:43:31.305452] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T20:43:32.016161] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-24T20:43:32.816139] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-24T20:43:32.882069] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T20:43:33.086591] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T20:43:33.616083] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-24T20:43:34.242437] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:43:34.416120] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-24T20:43:34.891578] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:43:34.897389] [INFO ] [REMOTE ] PHI: Full fetch complete (20711 records). [2025-09-24T20:43:34.897571] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-24T20:43:35.221180] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-24T20:43:35.287922] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-24T20:43:35.288017] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-24T20:43:35.288506] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-24T20:43:35.288597] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-24T20:43:35.289367] [DEBUG] [LOCAL ] PHI: Trimmed 20711 records to 14977 (keeping 200 days of data) [2025-09-24T20:43:35.390821] [DEBUG] [LOCAL ] PHI: Primary data saved (14977 records). [2025-09-24T20:43:35.391002] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-24T20:43:35.391159] [INFO ] [MAIN ] Update Progress: 1681/2373 symbols completed. PHI took 26.3s. Estimated remaining: 1h 32m 1s. Rate: 7.5 symbols/min [2025-09-24T20:43:35.590829] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:35.626814] [DEBUG] [LOCAL ] PHK: Loaded 26466 existing records from primary storage. [2025-09-24T20:43:35.627007] [INFO ] [MAIN ] PHK: Loaded 26466 existing records. [2025-09-24T20:43:35.814345] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:35.814939] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-24T20:43:35.815017] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-24T20:43:35.815885] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-24T20:43:35.815966] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-24T20:43:36.040940] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T20:43:36.022339] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-24T20:43:36.234093] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T20:43:36.233245] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:36.238418] [INFO ] [REMOTE ] PHD: Full fetch complete (13932 records). [2025-09-24T20:43:36.238492] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-24T20:43:36.597406] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-24T20:43:36.597490] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-24T20:43:36.597826] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-24T20:43:36.597912] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-24T20:43:36.598542] [DEBUG] [LOCAL ] PHD: Trimmed 13932 records to 9775 (keeping 200 days of data) [2025-09-24T20:43:36.665942] [DEBUG] [LOCAL ] PHD: Primary data saved (9775 records). [2025-09-24T20:43:36.666106] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-24T20:43:36.666251] [INFO ] [MAIN ] Update Progress: 1682/2373 symbols completed. PHD took 27.6s. Estimated remaining: 1h 31m 50s. Rate: 7.5 symbols/min [2025-09-24T20:43:36.822465] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-24T20:43:36.857321] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:36.857461] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-24T20:43:36.857499] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-24T20:43:36.857668] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-24T20:43:36.857757] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-24T20:43:36.857875] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-24T20:43:36.857940] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-24T20:43:37.256957] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:37.616064] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-24T20:43:37.859833] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T20:43:38.141704] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T20:43:38.416165] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-24T20:43:39.216117] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-24T20:43:39.366578] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T20:43:39.774496] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T20:43:40.016164] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-24T20:43:40.817915] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-24T20:43:40.820057] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T20:43:40.829048] [INFO ] [REMOTE ] PHG: Full fetch complete (65745 records). [2025-09-24T20:43:40.829163] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-24T20:43:41.263079] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T20:43:41.289256] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-24T20:43:41.289330] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-24T20:43:41.290362] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-24T20:43:41.290447] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-24T20:43:41.293392] [INFO ] [REMOTE ] PHIN: Full fetch complete (48162 records). [2025-09-24T20:43:41.293491] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-24T20:43:41.397466] [DEBUG] [LOCAL ] PHG: Trimmed 65745 records to 46176 (keeping 200 days of data) [2025-09-24T20:43:41.627275] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-24T20:43:41.809995] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-24T20:43:41.810624] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-24T20:43:41.811807] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-24T20:43:41.812116] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-24T20:43:41.816444] [DEBUG] [LOCAL ] PHIN: Trimmed 48162 records to 33111 (keeping 200 days of data) [2025-09-24T20:43:42.090449] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T20:43:42.237281] [DEBUG] [LOCAL ] PHG: Primary data saved (46176 records). [2025-09-24T20:43:42.237400] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-24T20:43:42.237588] [INFO ] [MAIN ] Update Progress: 1683/2373 symbols completed. PHG took 33.1s. Estimated remaining: 1h 31m 41s. Rate: 7.5 symbols/min [2025-09-24T20:43:42.237193] [DEBUG] [LOCAL ] PHIN: Primary data saved (33111 records). [2025-09-24T20:43:42.237942] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-24T20:43:42.238159] [INFO ] [MAIN ] Update Progress: 1684/2373 symbols completed. PHIN took 33.1s. Estimated remaining: 1h 31m 30s. Rate: 7.5 symbols/min [2025-09-24T20:43:42.432786] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-24T20:43:42.591576] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:42.595210] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:43:42.626245] [DEBUG] [LOCAL ] PHT: Loaded 15501 existing records from primary storage. [2025-09-24T20:43:42.626398] [INFO ] [MAIN ] PHT: Loaded 15501 existing records. [2025-09-24T20:43:42.781728] [DEBUG] [LOCAL ] PHR: Loaded 37465 existing records from primary storage. [2025-09-24T20:43:42.801371] [INFO ] [MAIN ] PHR: Loaded 37465 existing records. [2025-09-24T20:43:42.943731] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:42.965244] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-24T20:43:42.984886] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-24T20:43:43.022920] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-24T20:43:43.029585] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-24T20:43:43.029487] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:43:43.103898] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-24T20:43:43.126719] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-24T20:43:43.144858] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-24T20:43:43.160440] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-24T20:43:43.642813] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:43.656842] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-24T20:43:43.806227] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T20:43:43.812275] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:43:43.850956] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-24T20:43:44.016076] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-24T20:43:44.816124] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-24T20:43:44.853660] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T20:43:45.437093] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T20:43:45.616114] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-24T20:43:46.350997] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T20:43:46.416058] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-24T20:43:47.047040] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T20:43:47.216159] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-24T20:43:48.016217] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-24T20:43:48.317069] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T20:43:48.333937] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T20:43:48.816079] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-24T20:43:48.997874] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T20:43:49.611406] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T20:43:49.616037] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-24T20:43:50.416108] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-24T20:43:50.466273] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T20:43:51.216166] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-24T20:43:52.016191] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-24T20:43:52.299109] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T20:43:52.342520] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T20:43:52.816146] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-24T20:43:53.492068] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T20:43:53.616075] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-24T20:43:53.692344] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T20:43:54.416079] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-24T20:43:55.216199] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-24T20:43:55.467167] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T20:43:55.546469] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:43:56.016079] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-24T20:43:56.631599] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T20:43:56.816129] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-24T20:43:57.616051] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-24T20:43:57.807208] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:43:58.236683] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T20:43:58.416130] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-24T20:43:58.713827] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T20:43:59.216173] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-24T20:44:00.016051] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-24T20:44:00.154414] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T20:44:00.697309] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T20:44:00.816114] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-24T20:44:00.996353] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T20:44:01.616066] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-24T20:44:01.999856] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T20:44:02.416116] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-24T20:44:02.612752] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T20:44:02.616357] [INFO ] [REMOTE ] PHT: Full fetch complete (19621 records). [2025-09-24T20:44:02.616459] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-24T20:44:02.990163] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-24T20:44:02.990255] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-24T20:44:02.990720] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-24T20:44:02.990780] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-24T20:44:02.991339] [DEBUG] [LOCAL ] PHT: Trimmed 19621 records to 15601 (keeping 200 days of data) [2025-09-24T20:44:03.086610] [DEBUG] [LOCAL ] PHT: Primary data saved (15601 records). [2025-09-24T20:44:03.086788] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-24T20:44:03.086914] [INFO ] [MAIN ] Update Progress: 1685/2373 symbols completed. PHT took 20.8s. Estimated remaining: 1h 31m 27s. Rate: 7.5 symbols/min [2025-09-24T20:44:03.227161] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-24T20:44:03.261976] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:03.320079] [DEBUG] [LOCAL ] PII: Loaded 49253 existing records from primary storage. [2025-09-24T20:44:03.320264] [INFO ] [MAIN ] PII: Loaded 49253 existing records. [2025-09-24T20:44:03.501670] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:03.501899] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-24T20:44:03.501948] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-24T20:44:03.503887] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-24T20:44:03.503948] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-24T20:44:03.812148] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T20:44:03.900811] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:04.016085] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-24T20:44:04.816070] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-24T20:44:05.226607] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-24T20:44:05.616114] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-24T20:44:05.816414] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T20:44:06.227454] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T20:44:06.324424] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:44:06.333580] [INFO ] [REMOTE ] PHM: Full fetch complete (74710 records). [2025-09-24T20:44:06.333771] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-24T20:44:06.334636] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:44:06.334762] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:44:06.334836] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:44:06.334916] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-24T20:44:06.334983] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-24T20:44:06.335035] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-24T20:44:06.335119] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-24T20:44:06.335207] [INFO ] [MAIN ] Update Progress: 1686/2373 symbols completed. PHM took 29.7s. Estimated remaining: 1h 31m 18s. Rate: 7.5 symbols/min [2025-09-24T20:44:06.421184] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-24T20:44:06.540783] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:06.547998] [DEBUG] [LOCAL ] PIM: Loaded 4751 existing records from primary storage. [2025-09-24T20:44:06.548117] [INFO ] [MAIN ] PIM: Loaded 4751 existing records. [2025-09-24T20:44:06.736416] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:06.736722] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-24T20:44:06.736778] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-24T20:44:06.737180] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-24T20:44:06.737239] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-24T20:44:07.095659] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:07.216078] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-24T20:44:08.021262] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-24T20:44:08.032664] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T20:44:08.685554] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T20:44:08.816116] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-24T20:44:08.971766] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-24T20:44:09.616156] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-24T20:44:10.238158] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T20:44:10.362486] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T20:44:10.416064] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-24T20:44:11.216159] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-24T20:44:11.719363] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T20:44:12.016131] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-24T20:44:12.105790] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T20:44:12.646717] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-24T20:44:12.816082] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-24T20:44:13.616102] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-24T20:44:14.125516] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T20:44:14.138012] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T20:44:14.416151] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-24T20:44:15.216161] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-24T20:44:15.628462] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T20:44:15.633860] [INFO ] [REMOTE ] PHK: Full fetch complete (39255 records). [2025-09-24T20:44:15.633955] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-24T20:44:16.021272] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-24T20:44:16.105004] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-24T20:44:16.105088] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-24T20:44:16.105976] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-24T20:44:16.106040] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-24T20:44:16.106996] [DEBUG] [LOCAL ] PHK: Trimmed 39255 records to 26387 (keeping 200 days of data) [2025-09-24T20:44:16.271614] [DEBUG] [LOCAL ] PHK: Primary data saved (26387 records). [2025-09-24T20:44:16.271774] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-24T20:44:16.271879] [INFO ] [MAIN ] Update Progress: 1687/2373 symbols completed. PHK took 40.9s. Estimated remaining: 1h 31m 10s. Rate: 7.5 symbols/min [2025-09-24T20:44:16.446455] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:16.463943] [DEBUG] [LOCAL ] PINE: Loaded 14232 existing records from primary storage. [2025-09-24T20:44:16.464068] [INFO ] [MAIN ] PINE: Loaded 14232 existing records. [2025-09-24T20:44:16.648981] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:16.649451] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-24T20:44:16.649619] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-24T20:44:16.657676] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-24T20:44:16.671620] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-24T20:44:16.706415] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T20:44:16.797366] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T20:44:16.820831] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-24T20:44:17.094334] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:17.526183] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T20:44:17.616154] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-24T20:44:18.416045] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-24T20:44:18.500183] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T20:44:19.216147] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-24T20:44:20.016136] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-24T20:44:20.382543] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T20:44:20.543990] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T20:44:20.552381] [INFO ] [REMOTE ] PHR: Full fetch complete (52328 records). [2025-09-24T20:44:20.552511] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-24T20:44:20.716446] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T20:44:20.825767] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-24T20:44:20.973483] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-24T20:44:20.973572] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-24T20:44:20.974473] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-24T20:44:20.974537] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-24T20:44:20.975688] [DEBUG] [LOCAL ] PHR: Trimmed 52328 records to 37469 (keeping 200 days of data) [2025-09-24T20:44:21.198433] [DEBUG] [LOCAL ] PHR: Primary data saved (37469 records). [2025-09-24T20:44:21.198596] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-24T20:44:21.198721] [INFO ] [MAIN ] Update Progress: 1688/2373 symbols completed. PHR took 39.0s. Estimated remaining: 1h 31m 1s. Rate: 7.5 symbols/min [2025-09-24T20:44:21.385464] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:21.442030] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-24T20:44:21.442177] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-24T20:44:21.561589] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T20:44:21.621132] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-24T20:44:21.652604] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:21.652854] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-24T20:44:21.652906] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-24T20:44:21.654415] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-24T20:44:21.654478] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-24T20:44:22.039913] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:22.416131] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-24T20:44:23.143433] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T20:44:23.216053] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-24T20:44:23.473136] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T20:44:24.002191] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T20:44:24.004297] [INFO ] [REMOTE ] PIM: Full fetch complete (6572 records). [2025-09-24T20:44:24.004369] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-24T20:44:24.021254] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-24T20:44:24.378806] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-24T20:44:24.378889] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-24T20:44:24.379076] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-24T20:44:24.379181] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-24T20:44:24.379621] [DEBUG] [LOCAL ] PIM: Trimmed 6572 records to 4764 (keeping 200 days of data) [2025-09-24T20:44:24.408548] [DEBUG] [LOCAL ] PIM: Primary data saved (4764 records). [2025-09-24T20:44:24.408795] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-24T20:44:24.408899] [INFO ] [MAIN ] Update Progress: 1689/2373 symbols completed. PIM took 18.1s. Estimated remaining: 1h 30m 51s. Rate: 7.5 symbols/min [2025-09-24T20:44:24.584127] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:24.602798] [DEBUG] [LOCAL ] PIPR: Loaded 15253 existing records from primary storage. [2025-09-24T20:44:24.602969] [INFO ] [MAIN ] PIPR: Loaded 15253 existing records. [2025-09-24T20:44:24.787471] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:24.787818] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-24T20:44:24.787875] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-24T20:44:24.788569] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-24T20:44:24.788631] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-24T20:44:24.821154] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-24T20:44:25.154882] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:25.616069] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-24T20:44:25.922006] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T20:44:26.185076] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T20:44:26.416146] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-24T20:44:26.916902] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-24T20:44:27.216122] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-24T20:44:28.016062] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-24T20:44:28.199749] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T20:44:28.330253] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-24T20:44:28.816075] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-24T20:44:28.918066] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T20:44:29.616133] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-24T20:44:30.313037] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:44:30.416065] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-24T20:44:31.154697] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T20:44:31.216113] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-24T20:44:32.016119] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-24T20:44:32.168439] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T20:44:32.176771] [INFO ] [REMOTE ] PII: Full fetch complete (71096 records). [2025-09-24T20:44:32.176914] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-24T20:44:32.578667] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-24T20:44:32.578813] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-24T20:44:32.579901] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-24T20:44:32.579971] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-24T20:44:32.581433] [DEBUG] [LOCAL ] PII: Trimmed 71096 records to 49159 (keeping 200 days of data) [2025-09-24T20:44:32.819908] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-24T20:44:32.901748] [DEBUG] [LOCAL ] PII: Primary data saved (49159 records). [2025-09-24T20:44:32.901949] [INFO ] [MAIN ] PII: Full history saved. [2025-09-24T20:44:32.902064] [INFO ] [MAIN ] Update Progress: 1690/2373 symbols completed. PII took 29.8s. Estimated remaining: 1h 30m 43s. Rate: 7.5 symbols/min [2025-09-24T20:44:33.038200] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T20:44:33.095258] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:33.121162] [DEBUG] [LOCAL ] PJT: Loaded 22543 existing records from primary storage. [2025-09-24T20:44:33.121307] [INFO ] [MAIN ] PJT: Loaded 22543 existing records. [2025-09-24T20:44:33.303659] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:33.304033] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-24T20:44:33.313425] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-24T20:44:33.329594] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-24T20:44:33.329744] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-24T20:44:33.401715] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-24T20:44:33.619414] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-24T20:44:33.713828] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:33.849608] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T20:44:34.416177] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-24T20:44:35.216071] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-24T20:44:35.508795] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T20:44:35.611230] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T20:44:36.020593] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-24T20:44:36.021705] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T20:44:36.816108] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-24T20:44:37.616120] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-24T20:44:38.063674] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T20:44:38.111046] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-24T20:44:38.416116] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-24T20:44:38.749958] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T20:44:39.216059] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-24T20:44:39.360612] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T20:44:40.016081] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-24T20:44:40.816061] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-24T20:44:41.135097] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T20:44:41.454612] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-24T20:44:41.616074] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-24T20:44:41.973805] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T20:44:42.416116] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-24T20:44:42.768292] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T20:44:43.216081] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-24T20:44:44.016124] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-24T20:44:44.388059] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T20:44:44.588931] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T20:44:44.816112] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-24T20:44:45.004733] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T20:44:45.616110] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-24T20:44:46.416115] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-24T20:44:47.048023] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T20:44:47.099993] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-24T20:44:47.216070] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-24T20:44:47.271375] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T20:44:48.016127] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-24T20:44:48.816045] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-24T20:44:48.893039] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T20:44:49.316637] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T20:44:49.616103] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-24T20:44:49.948779] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T20:44:50.416107] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-24T20:44:50.752136] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T20:44:51.216080] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-24T20:44:52.016066] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-24T20:44:52.073534] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:44:52.082975] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-24T20:44:52.083135] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-24T20:44:52.420284] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T20:44:52.543102] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-24T20:44:52.543195] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-24T20:44:52.544475] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-24T20:44:52.544545] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-24T20:44:52.546480] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 53693 (keeping 200 days of data) [2025-09-24T20:44:52.665453] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-24T20:44:52.819368] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-24T20:44:52.905378] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-24T20:44:52.905519] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-24T20:44:52.905608] [INFO ] [MAIN ] Update Progress: 1691/2373 symbols completed. PINS took 31.7s. Estimated remaining: 1h 30m 40s. Rate: 7.5 symbols/min [2025-09-24T20:44:53.075569] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:53.128713] [DEBUG] [LOCAL ] PK: Loaded 52884 existing records from primary storage. [2025-09-24T20:44:53.128883] [INFO ] [MAIN ] PK: Loaded 52884 existing records. [2025-09-24T20:44:53.305435] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:53.305734] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-24T20:44:53.305837] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-24T20:44:53.307533] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-24T20:44:53.307596] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-24T20:44:53.621168] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-24T20:44:53.688074] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:53.858253] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T20:44:53.861169] [INFO ] [REMOTE ] PIPR: Full fetch complete (20402 records). [2025-09-24T20:44:53.861258] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-24T20:44:54.235541] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-24T20:44:54.235631] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-24T20:44:54.236158] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-24T20:44:54.236222] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-24T20:44:54.237020] [DEBUG] [LOCAL ] PIPR: Trimmed 20402 records to 15197 (keeping 200 days of data) [2025-09-24T20:44:54.347849] [DEBUG] [LOCAL ] PIPR: Primary data saved (15197 records). [2025-09-24T20:44:54.348014] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-24T20:44:54.348108] [INFO ] [MAIN ] Update Progress: 1692/2373 symbols completed. PIPR took 29.9s. Estimated remaining: 1h 30m 30s. Rate: 7.5 symbols/min [2025-09-24T20:44:54.424102] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-24T20:44:54.527300] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:54.540709] [DEBUG] [LOCAL ] PKE: Loaded 12563 existing records from primary storage. [2025-09-24T20:44:54.540814] [INFO ] [MAIN ] PKE: Loaded 12563 existing records. [2025-09-24T20:44:54.720563] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:54.720849] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-24T20:44:54.720922] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-24T20:44:54.721524] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-24T20:44:54.721590] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-24T20:44:55.069141] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T20:44:55.112466] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:55.216037] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-24T20:44:55.321034] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T20:44:55.323902] [INFO ] [REMOTE ] PINE: Full fetch complete (21078 records). [2025-09-24T20:44:55.323978] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-24T20:44:55.691527] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-24T20:44:55.691615] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-24T20:44:55.692205] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-24T20:44:55.692263] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-24T20:44:55.692957] [DEBUG] [LOCAL ] PINE: Trimmed 21078 records to 14211 (keeping 200 days of data) [2025-09-24T20:44:55.786990] [DEBUG] [LOCAL ] PINE: Primary data saved (14211 records). [2025-09-24T20:44:55.787150] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-24T20:44:55.787242] [INFO ] [MAIN ] Update Progress: 1693/2373 symbols completed. PINE took 39.5s. Estimated remaining: 1h 30m 19s. Rate: 7.5 symbols/min [2025-09-24T20:44:55.970827] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:44:56.017881] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-24T20:44:56.019622] [DEBUG] [LOCAL ] PKG: Loaded 39286 existing records from primary storage. [2025-09-24T20:44:56.019734] [INFO ] [MAIN ] PKG: Loaded 39286 existing records. [2025-09-24T20:44:56.132149] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T20:44:56.223928] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:44:56.224185] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-24T20:44:56.224236] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-24T20:44:56.225613] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-24T20:44:56.225701] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-24T20:44:56.607184] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:44:56.816113] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-24T20:44:57.621439] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-24T20:44:57.641959] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:44:58.354148] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:44:58.391007] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T20:44:58.416031] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-24T20:44:59.216176] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-24T20:44:59.607492] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T20:45:00.016130] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-24T20:45:00.241707] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T20:45:00.816138] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-24T20:45:01.616163] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-24T20:45:02.358568] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-24T20:45:02.416167] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-24T20:45:03.025483] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-24T20:45:03.216164] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-24T20:45:03.668466] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T20:45:04.016123] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-24T20:45:04.816153] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-24T20:45:05.871818] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-09-24T20:45:05.882620] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-24T20:45:05.941295] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T20:45:06.032132] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T20:45:06.035376] [INFO ] [REMOTE ] PJT: Full fetch complete (32134 records). [2025-09-24T20:45:06.035477] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-24T20:45:06.251984] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (3.04 seconds). [2025-09-24T20:45:06.421225] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-24T20:45:06.497585] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-24T20:45:06.497727] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-24T20:45:06.498436] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-24T20:45:06.498557] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-24T20:45:06.499503] [DEBUG] [LOCAL ] PJT: Trimmed 32134 records to 22399 (keeping 200 days of data) [2025-09-24T20:45:06.645813] [DEBUG] [LOCAL ] PJT: Primary data saved (22399 records). [2025-09-24T20:45:06.645948] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-24T20:45:06.646032] [INFO ] [MAIN ] Update Progress: 1694/2373 symbols completed. PJT took 33.7s. Estimated remaining: 1h 30m 12s. Rate: 7.5 symbols/min [2025-09-24T20:45:06.816843] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:06.837932] [DEBUG] [LOCAL ] PKST: Loaded 19320 existing records from primary storage. [2025-09-24T20:45:06.838073] [INFO ] [MAIN ] PKST: Loaded 19320 existing records. [2025-09-24T20:45:07.017374] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:45:07.017633] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-24T20:45:07.017719] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-24T20:45:07.018446] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-24T20:45:07.018509] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-24T20:45:07.221831] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-24T20:45:07.342321] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T20:45:07.435821] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:07.616113] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T20:45:08.016139] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-24T20:45:08.816112] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-24T20:45:09.011405] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:45:09.072842] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T20:45:09.591987] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T20:45:09.616075] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-24T20:45:10.416072] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-24T20:45:10.470953] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T20:45:11.216074] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-24T20:45:11.517745] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T20:45:12.016123] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-24T20:45:12.816075] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-24T20:45:12.959877] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T20:45:13.121154] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T20:45:13.616075] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-24T20:45:14.416141] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-24T20:45:14.581136] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T20:45:15.216142] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-24T20:45:15.282417] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-24T20:45:16.016105] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-24T20:45:16.816052] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-24T20:45:16.976443] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-24T20:45:17.002993] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:45:17.290553] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T20:45:17.616071] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-24T20:45:18.416064] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-24T20:45:18.498012] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T20:45:19.216142] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-24T20:45:19.724481] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T20:45:19.978632] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-24T20:45:20.016044] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-24T20:45:20.807974] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T20:45:20.816023] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-24T20:45:21.616055] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-24T20:45:21.697960] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T20:45:22.194349] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T20:45:22.416113] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-24T20:45:22.653858] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T20:45:23.216326] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-24T20:45:24.016126] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-24T20:45:24.295023] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T20:45:24.816078] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-24T20:45:25.011304] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-24T20:45:25.600098] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T20:45:25.616034] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-24T20:45:25.647995] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T20:45:26.416149] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-24T20:45:27.216179] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-24T20:45:27.818026] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-24T20:45:27.824884] [INFO ] [REMOTE ] PKG: Full fetch complete (57461 records). [2025-09-24T20:45:27.825017] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-24T20:45:28.021173] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-24T20:45:28.211029] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-24T20:45:28.211113] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-24T20:45:28.212073] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-24T20:45:28.212140] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-24T20:45:28.213393] [DEBUG] [LOCAL ] PKG: Trimmed 57461 records to 39209 (keeping 200 days of data) [2025-09-24T20:45:28.472885] [DEBUG] [LOCAL ] PKG: Primary data saved (39209 records). [2025-09-24T20:45:28.473112] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-24T20:45:28.473231] [INFO ] [MAIN ] Update Progress: 1695/2373 symbols completed. PKG took 32.7s. Estimated remaining: 1h 30m 10s. Rate: 7.5 symbols/min [2025-09-24T20:45:28.651406] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:28.676606] [DEBUG] [LOCAL ] PKX: Loaded 25093 existing records from primary storage. [2025-09-24T20:45:28.676799] [INFO ] [MAIN ] PKX: Loaded 25093 existing records. [2025-09-24T20:45:28.778505] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-24T20:45:28.818340] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-24T20:45:28.885836] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T20:45:28.908582] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:45:28.914410] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-24T20:45:28.914510] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-24T20:45:28.915352] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-24T20:45:28.915426] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-24T20:45:29.278568] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:29.616066] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-24T20:45:29.881081] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T20:45:29.891548] [INFO ] [REMOTE ] PK: Full fetch complete (76361 records). [2025-09-24T20:45:29.891753] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-24T20:45:29.992573] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T20:45:30.024312] [INFO ] [REMOTE ] PKST: Full fetch complete (29693 records). [2025-09-24T20:45:30.024525] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-24T20:45:30.420732] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-24T20:45:30.662690] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-24T20:45:30.663105] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-24T20:45:30.669742] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-24T20:45:30.674982] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-24T20:45:30.755306] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-24T20:45:30.755440] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-24T20:45:30.755858] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-24T20:45:30.756282] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-24T20:45:30.756053] [DEBUG] [LOCAL ] PK: Trimmed 76361 records to 52860 (keeping 200 days of data) [2025-09-24T20:45:30.758875] [DEBUG] [LOCAL ] PKST: Trimmed 29693 records to 19242 (keeping 200 days of data) [2025-09-24T20:45:30.969230] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T20:45:31.037183] [DEBUG] [LOCAL ] PKST: Primary data saved (19242 records). [2025-09-24T20:45:31.037883] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-24T20:45:31.038284] [INFO ] [MAIN ] Update Progress: 1696/2373 symbols completed. PKST took 24.4s. Estimated remaining: 1h 29m 60s. Rate: 7.5 symbols/min [2025-09-24T20:45:31.219634] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-24T20:45:31.315691] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:31.331603] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T20:45:31.336664] [INFO ] [REMOTE ] PKE: Full fetch complete (16910 records). [2025-09-24T20:45:31.337397] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-24T20:45:31.629611] [DEBUG] [LOCAL ] PL: Loaded 53113 existing records from primary storage. [2025-09-24T20:45:31.635789] [INFO ] [MAIN ] PL: Loaded 53113 existing records. [2025-09-24T20:45:31.990767] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-24T20:45:31.992178] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-24T20:45:31.993605] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-24T20:45:31.990603] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:45:31.995180] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-24T20:45:31.996363] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-24T20:45:31.996883] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-24T20:45:31.998463] [DEBUG] [LOCAL ] PKE: Trimmed 16910 records to 12555 (keeping 200 days of data) [2025-09-24T20:45:32.000094] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-24T20:45:32.000206] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-24T20:45:32.534595] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:32.537511] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-24T20:45:32.554962] [DEBUG] [LOCAL ] PKE: Primary data saved (12555 records). [2025-09-24T20:45:32.556309] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-24T20:45:32.556563] [INFO ] [MAIN ] Update Progress: 1697/2373 symbols completed. PKE took 38.2s. Estimated remaining: 1h 29m 49s. Rate: 7.5 symbols/min [2025-09-24T20:45:32.753281] [DEBUG] [LOCAL ] PK: Primary data saved (52860 records). [2025-09-24T20:45:32.789958] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:32.791891] [INFO ] [MAIN ] PK: Full history saved. [2025-09-24T20:45:32.793226] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T20:45:32.794182] [INFO ] [MAIN ] Update Progress: 1698/2373 symbols completed. PK took 39.9s. Estimated remaining: 1h 29m 38s. Rate: 7.5 symbols/min [2025-09-24T20:45:32.822066] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-24T20:45:33.002383] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:33.002702] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-09-24T20:45:33.002803] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-09-24T20:45:33.003184] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-24T20:45:33.003270] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-24T20:45:33.003374] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-24T20:45:33.003636] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-24T20:45:33.302368] [DEBUG] [LOCAL ] PLD: Loaded 53484 existing records from primary storage. [2025-09-24T20:45:33.313945] [INFO ] [MAIN ] PLD: Loaded 53484 existing records. [2025-09-24T20:45:33.565609] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:33.605635] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:45:33.605874] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-24T20:45:33.605928] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-24T20:45:33.607710] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-24T20:45:33.607786] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-24T20:45:33.639283] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-24T20:45:33.987235] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:34.416135] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-24T20:45:34.591119] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T20:45:34.923300] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-24T20:45:35.008786] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T20:45:35.216105] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-24T20:45:36.016061] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-24T20:45:36.125897] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T20:45:36.816146] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-24T20:45:37.250102] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T20:45:37.285193] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T20:45:37.616078] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-24T20:45:38.416196] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-24T20:45:39.126882] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-24T20:45:39.195176] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:45:39.216057] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-24T20:45:39.949872] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T20:45:40.016179] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-24T20:45:40.785386] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T20:45:40.816043] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-24T20:45:41.283986] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T20:45:41.616127] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-24T20:45:42.325818] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T20:45:42.416071] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-24T20:45:43.216136] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-24T20:45:43.639556] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:45:43.682607] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-24T20:45:44.016110] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-24T20:45:44.816117] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-24T20:45:45.163480] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T20:45:45.616105] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-24T20:45:45.646061] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T20:45:46.161239] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T20:45:46.416110] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-24T20:45:47.216060] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-24T20:45:47.659665] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-24T20:45:47.682174] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T20:45:48.016143] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-24T20:45:48.816109] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-24T20:45:49.109972] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T20:45:49.445095] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T20:45:49.616106] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-24T20:45:49.827471] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-24T20:45:49.832760] [INFO ] [REMOTE ] PKX: Full fetch complete (37819 records). [2025-09-24T20:45:49.832912] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-24T20:45:50.231383] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-24T20:45:50.231463] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-24T20:45:50.232249] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-24T20:45:50.232338] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-24T20:45:50.233241] [DEBUG] [LOCAL ] PKX: Trimmed 37819 records to 24908 (keeping 200 days of data) [2025-09-24T20:45:50.408788] [DEBUG] [LOCAL ] PKX: Primary data saved (24908 records). [2025-09-24T20:45:50.408934] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-24T20:45:50.409087] [INFO ] [MAIN ] Update Progress: 1699/2373 symbols completed. PKX took 21.9s. Estimated remaining: 1h 29m 34s. Rate: 7.5 symbols/min [2025-09-24T20:45:50.422328] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-24T20:45:50.584897] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:45:50.609525] [DEBUG] [LOCAL ] PLOW: Loaded 20551 existing records from primary storage. [2025-09-24T20:45:50.609678] [INFO ] [MAIN ] PLOW: Loaded 20551 existing records. [2025-09-24T20:45:50.788544] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:45:50.788867] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-24T20:45:50.788936] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-24T20:45:50.789768] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-24T20:45:50.789834] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-24T20:45:51.170264] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:45:51.216052] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-24T20:45:51.348848] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T20:45:52.016189] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-24T20:45:52.541557] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T20:45:52.816156] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-24T20:45:53.082462] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T20:45:53.449193] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:45:53.616136] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-24T20:45:54.416185] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-24T20:45:54.825055] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T20:45:55.216150] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-24T20:45:55.477639] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T20:45:56.016185] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-24T20:45:56.567632] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T20:45:56.816166] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-24T20:45:57.081892] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T20:45:57.261513] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-24T20:45:57.616178] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-24T20:45:58.416121] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-24T20:45:58.724511] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T20:45:58.789678] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T20:45:59.216215] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-24T20:46:00.016188] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-24T20:46:00.816190] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-24T20:46:01.075785] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-24T20:46:01.141322] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T20:46:01.149806] [INFO ] [REMOTE ] PLNT: Full fetch complete (70165 records). [2025-09-24T20:46:01.149962] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-24T20:46:01.565136] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-24T20:46:01.582447] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-24T20:46:01.601478] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-24T20:46:01.602529] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-24T20:46:01.604734] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T20:46:01.628142] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T20:46:01.619775] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-24T20:46:01.637298] [DEBUG] [LOCAL ] PLNT: Trimmed 70165 records to 48440 (keeping 200 days of data) [2025-09-24T20:46:01.937768] [DEBUG] [LOCAL ] PLNT: Primary data saved (48440 records). [2025-09-24T20:46:01.937927] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-24T20:46:01.938058] [INFO ] [MAIN ] Update Progress: 1700/2373 symbols completed. PLNT took 29.1s. Estimated remaining: 1h 29m 27s. Rate: 7.5 symbols/min [2025-09-24T20:46:02.109686] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:02.144317] [DEBUG] [LOCAL ] PLYM: Loaded 33267 existing records from primary storage. [2025-09-24T20:46:02.144461] [INFO ] [MAIN ] PLYM: Loaded 33267 existing records. [2025-09-24T20:46:02.338368] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:46:02.338993] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-24T20:46:02.339066] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-24T20:46:02.339992] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-24T20:46:02.340066] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-24T20:46:02.421211] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-24T20:46:02.724018] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:03.216109] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-24T20:46:03.636969] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T20:46:03.811150] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-24T20:46:04.016166] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-24T20:46:04.697763] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T20:46:04.816149] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-24T20:46:05.355064] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T20:46:05.616127] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-24T20:46:06.416112] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-24T20:46:07.216108] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-24T20:46:07.436983] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-24T20:46:07.447793] [INFO ] [REMOTE ] PL: Full fetch complete (76944 records). [2025-09-24T20:46:07.447942] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-24T20:46:07.917731] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-24T20:46:07.918372] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-24T20:46:07.919479] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T20:46:07.920616] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-24T20:46:07.920775] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-24T20:46:07.928426] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-24T20:46:07.944886] [DEBUG] [LOCAL ] PL: Trimmed 76944 records to 53114 (keeping 200 days of data) [2025-09-24T20:46:08.036104] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-24T20:46:08.275987] [DEBUG] [LOCAL ] PL: Primary data saved (53114 records). [2025-09-24T20:46:08.276218] [INFO ] [MAIN ] PL: Full history saved. [2025-09-24T20:46:08.276341] [INFO ] [MAIN ] Update Progress: 1701/2373 symbols completed. PL took 37.2s. Estimated remaining: 1h 29m 19s. Rate: 7.5 symbols/min [2025-09-24T20:46:08.484923] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:08.485846] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-24T20:46:08.485905] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-24T20:46:08.486157] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-24T20:46:08.486211] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-24T20:46:08.486255] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-24T20:46:08.486290] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-24T20:46:08.769971] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T20:46:08.824054] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-24T20:46:08.918579] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:09.193811] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T20:46:09.616134] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-24T20:46:10.416244] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-24T20:46:10.599234] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T20:46:10.608813] [INFO ] [REMOTE ] PLD: Full fetch complete (77410 records). [2025-09-24T20:46:10.608934] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-24T20:46:11.035135] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-24T20:46:11.045269] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-24T20:46:11.046670] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-24T20:46:11.048069] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T20:46:11.047187] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-24T20:46:11.055473] [DEBUG] [LOCAL ] PLD: Trimmed 77410 records to 53466 (keeping 200 days of data) [2025-09-24T20:46:11.252105] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-24T20:46:11.418520] [DEBUG] [LOCAL ] PLD: Primary data saved (53466 records). [2025-09-24T20:46:11.418720] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-24T20:46:11.418824] [INFO ] [MAIN ] Update Progress: 1702/2373 symbols completed. PLD took 38.9s. Estimated remaining: 1h 29m 9s. Rate: 7.5 symbols/min [2025-09-24T20:46:11.593456] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:11.614032] [DEBUG] [LOCAL ] PML: Loaded 20499 existing records from primary storage. [2025-09-24T20:46:11.614163] [INFO ] [MAIN ] PML: Loaded 20499 existing records. [2025-09-24T20:46:11.869621] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:46:11.869922] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-24T20:46:11.869973] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-24T20:46:11.870802] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-24T20:46:11.870867] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-24T20:46:12.022744] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-24T20:46:12.268080] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:12.525546] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-24T20:46:12.549681] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T20:46:12.816163] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-24T20:46:13.107972] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T20:46:13.549345] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-24T20:46:13.616103] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-24T20:46:14.416165] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-24T20:46:15.216168] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-24T20:46:15.485429] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T20:46:15.800556] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T20:46:16.016095] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-24T20:46:16.235902] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T20:46:16.240572] [INFO ] [REMOTE ] PLOW: Full fetch complete (28789 records). [2025-09-24T20:46:16.240736] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-24T20:46:16.633823] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-24T20:46:16.633918] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-24T20:46:16.634561] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-24T20:46:16.634605] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-24T20:46:16.635571] [DEBUG] [LOCAL ] PLOW: Trimmed 28789 records to 20546 (keeping 200 days of data) [2025-09-24T20:46:16.772861] [DEBUG] [LOCAL ] PLOW: Primary data saved (20546 records). [2025-09-24T20:46:16.773018] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-24T20:46:16.773120] [INFO ] [MAIN ] Update Progress: 1703/2373 symbols completed. PLOW took 26.4s. Estimated remaining: 1h 28m 60s. Rate: 7.5 symbols/min [2025-09-24T20:46:16.828282] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-24T20:46:16.963040] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:16.974144] [DEBUG] [LOCAL ] PMM: Loaded 10568 existing records from primary storage. [2025-09-24T20:46:16.974259] [INFO ] [MAIN ] PMM: Loaded 10568 existing records. [2025-09-24T20:46:17.173387] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:46:17.173717] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-24T20:46:17.173785] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-24T20:46:17.174289] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-24T20:46:17.174361] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-24T20:46:17.530614] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:17.616038] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-24T20:46:17.854676] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T20:46:17.980290] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T20:46:18.416129] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-24T20:46:18.679731] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T20:46:19.216116] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-24T20:46:19.779397] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T20:46:20.016120] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-24T20:46:20.188148] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T20:46:20.816156] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-24T20:46:21.359297] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T20:46:21.616189] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-24T20:46:21.958993] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T20:46:22.416136] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-24T20:46:22.697314] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T20:46:23.216108] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-24T20:46:23.609896] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-24T20:46:24.016119] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-24T20:46:24.816069] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-24T20:46:25.091024] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T20:46:25.339991] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T20:46:25.616074] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-24T20:46:25.870798] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-24T20:46:26.416119] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-24T20:46:26.500844] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T20:46:27.216110] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-24T20:46:28.016121] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-24T20:46:28.235818] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T20:46:28.434807] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T20:46:28.816055] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-24T20:46:29.091403] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T20:46:29.616137] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-24T20:46:30.416182] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-24T20:46:30.437371] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T20:46:30.991255] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T20:46:31.216136] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-24T20:46:31.907545] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T20:46:32.016099] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-24T20:46:32.816074] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-24T20:46:33.234825] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-24T20:46:33.532635] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T20:46:33.561736] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T20:46:33.616175] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-24T20:46:34.416120] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-24T20:46:34.712194] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:46:35.216127] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-24T20:46:35.984674] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T20:46:35.992508] [INFO ] [REMOTE ] PLYM: Full fetch complete (46656 records). [2025-09-24T20:46:35.992730] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-24T20:46:36.028577] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-24T20:46:36.393885] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-24T20:46:36.394030] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-24T20:46:36.395004] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-24T20:46:36.395090] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-24T20:46:36.396306] [DEBUG] [LOCAL ] PLYM: Trimmed 46656 records to 33329 (keeping 200 days of data) [2025-09-24T20:46:36.605841] [DEBUG] [LOCAL ] PLYM: Primary data saved (33329 records). [2025-09-24T20:46:36.605997] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-24T20:46:36.606120] [INFO ] [MAIN ] Update Progress: 1704/2373 symbols completed. PLYM took 34.7s. Estimated remaining: 1h 28m 57s. Rate: 7.5 symbols/min [2025-09-24T20:46:36.790475] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:36.798950] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T20:46:36.812123] [DEBUG] [LOCAL ] PMO: Loaded 10393 existing records from primary storage. [2025-09-24T20:46:36.812284] [INFO ] [MAIN ] PMO: Loaded 10393 existing records. [2025-09-24T20:46:36.823968] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-24T20:46:37.008295] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:46:37.008820] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-24T20:46:37.008905] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-24T20:46:37.009479] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-24T20:46:37.009544] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-24T20:46:37.407089] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:37.413886] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T20:46:37.616060] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-24T20:46:37.723740] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-24T20:46:38.416162] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-24T20:46:39.216100] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-24T20:46:39.259892] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:46:39.262223] [INFO ] [REMOTE ] PMM: Full fetch complete (18253 records). [2025-09-24T20:46:39.262302] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-24T20:46:39.631205] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-24T20:46:39.631285] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-24T20:46:39.631729] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-24T20:46:39.631804] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-24T20:46:39.632324] [DEBUG] [LOCAL ] PMM: Trimmed 18253 records to 10586 (keeping 200 days of data) [2025-09-24T20:46:39.698562] [DEBUG] [LOCAL ] PMM: Primary data saved (10586 records). [2025-09-24T20:46:39.698717] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-24T20:46:39.698827] [INFO ] [MAIN ] Update Progress: 1705/2373 symbols completed. PMM took 22.9s. Estimated remaining: 1h 28m 47s. Rate: 7.5 symbols/min [2025-09-24T20:46:39.877401] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:39.925133] [DEBUG] [LOCAL ] PMT: Loaded 40341 existing records from primary storage. [2025-09-24T20:46:39.925446] [INFO ] [MAIN ] PMT: Loaded 40341 existing records. [2025-09-24T20:46:40.019328] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-24T20:46:40.116719] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:46:40.117227] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-24T20:46:40.117335] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-24T20:46:40.118510] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-24T20:46:40.118576] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-24T20:46:40.454932] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-24T20:46:40.541934] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:40.816111] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-24T20:46:41.220350] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T20:46:41.616098] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-24T20:46:42.173884] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-24T20:46:42.416048] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-24T20:46:42.450769] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T20:46:42.460475] [INFO ] [REMOTE ] PM: Full fetch complete (77313 records). [2025-09-24T20:46:42.460613] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-24T20:46:42.461425] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:46:42.461520] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:46:42.461563] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:46:42.461628] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-24T20:46:42.461733] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-24T20:46:42.461777] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-24T20:46:42.461833] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-24T20:46:42.461928] [INFO ] [MAIN ] Update Progress: 1706/2373 symbols completed. PM took 34.2s. Estimated remaining: 1h 28m 37s. Rate: 7.5 symbols/min [2025-09-24T20:46:42.636141] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:42.636359] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-24T20:46:42.636414] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-24T20:46:42.636559] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-24T20:46:42.636603] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-24T20:46:42.636672] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-24T20:46:42.636727] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-24T20:46:43.064982] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-24T20:46:43.071165] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:43.216119] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-24T20:46:43.519517] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T20:46:43.612176] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-24T20:46:44.016112] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-24T20:46:44.816059] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-24T20:46:44.824753] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T20:46:45.619372] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-24T20:46:46.331895] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T20:46:46.349404] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:46:46.416043] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-24T20:46:47.216070] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-24T20:46:47.256165] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T20:46:48.016127] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-24T20:46:48.476365] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T20:46:48.816187] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-24T20:46:48.987834] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T20:46:49.171330] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-24T20:46:49.616113] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-24T20:46:50.416104] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-24T20:46:50.817466] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T20:46:50.823004] [INFO ] [REMOTE ] PML: Full fetch complete (29571 records). [2025-09-24T20:46:50.823131] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-24T20:46:50.929124] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T20:46:51.221225] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-24T20:46:51.234669] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-24T20:46:51.234771] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-24T20:46:51.235486] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-24T20:46:51.235529] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-24T20:46:51.236911] [DEBUG] [LOCAL ] PML: Trimmed 29571 records to 20566 (keeping 200 days of data) [2025-09-24T20:46:51.363146] [DEBUG] [LOCAL ] PML: Primary data saved (20566 records). [2025-09-24T20:46:51.363288] [INFO ] [MAIN ] PML: Full history saved. [2025-09-24T20:46:51.363377] [INFO ] [MAIN ] Update Progress: 1707/2373 symbols completed. PML took 39.9s. Estimated remaining: 1h 28m 29s. Rate: 7.5 symbols/min [2025-09-24T20:46:51.552391] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:46:51.552614] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-24T20:46:51.552694] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-24T20:46:51.552851] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-24T20:46:51.552894] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-24T20:46:51.552936] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-24T20:46:51.552968] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-24T20:46:51.675420] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-24T20:46:51.940045] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:46:52.016119] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-24T20:46:52.317044] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:46:52.317426] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-24T20:46:52.816104] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-24T20:46:53.526855] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T20:46:53.616072] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-24T20:46:54.416115] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-24T20:46:54.516289] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T20:46:55.216150] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-24T20:46:55.474035] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:46:55.474402] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-24T20:46:55.999050] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T20:46:56.016041] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-24T20:46:56.816150] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-24T20:46:57.583554] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-24T20:46:57.612209] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T20:46:57.620204] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-24T20:46:58.416184] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-24T20:46:58.461017] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T20:46:59.216167] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-24T20:46:59.963395] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T20:47:00.016035] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-24T20:47:00.131956] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T20:47:00.453544] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-24T20:47:00.816151] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-24T20:47:01.616096] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-24T20:47:02.416060] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-24T20:47:02.434006] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T20:47:02.717501] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T20:47:03.216115] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-24T20:47:03.330310] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T20:47:04.016142] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-24T20:47:04.127028] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T20:47:04.668831] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T20:47:04.670971] [INFO ] [REMOTE ] PMO: Full fetch complete (17381 records). [2025-09-24T20:47:04.671048] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-24T20:47:04.821222] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-24T20:47:05.082954] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-24T20:47:05.083043] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-24T20:47:05.083517] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-24T20:47:05.083784] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-24T20:47:05.084717] [DEBUG] [LOCAL ] PMO: Trimmed 17381 records to 10360 (keeping 200 days of data) [2025-09-24T20:47:05.152800] [DEBUG] [LOCAL ] PMO: Primary data saved (10360 records). [2025-09-24T20:47:05.152950] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-24T20:47:05.153053] [INFO ] [MAIN ] Update Progress: 1708/2373 symbols completed. PMO took 28.5s. Estimated remaining: 1h 28m 23s. Rate: 7.5 symbols/min [2025-09-24T20:47:05.326315] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:05.326518] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-24T20:47:05.326556] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-24T20:47:05.326790] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-24T20:47:05.326845] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-24T20:47:05.326889] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-24T20:47:05.326923] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-24T20:47:05.617957] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-24T20:47:05.628423] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:47:05.712507] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:06.416108] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-24T20:47:07.098435] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T20:47:07.104884] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T20:47:07.216065] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-24T20:47:08.016112] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-24T20:47:08.659456] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T20:47:08.816055] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-24T20:47:08.853494] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T20:47:09.222462] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-24T20:47:09.616068] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-24T20:47:10.416100] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-24T20:47:11.104052] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:11.104505] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-24T20:47:11.148882] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T20:47:11.216146] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-24T20:47:12.016162] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-24T20:47:12.718514] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:12.719029] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-24T20:47:12.738754] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T20:47:12.745534] [INFO ] [REMOTE ] PMT: Full fetch complete (58151 records). [2025-09-24T20:47:12.745692] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-24T20:47:12.821245] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-24T20:47:13.132747] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-24T20:47:13.132834] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-24T20:47:13.133799] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-24T20:47:13.133864] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-24T20:47:13.135029] [DEBUG] [LOCAL ] PMT: Trimmed 58151 records to 40293 (keeping 200 days of data) [2025-09-24T20:47:13.384202] [DEBUG] [LOCAL ] PMT: Primary data saved (40293 records). [2025-09-24T20:47:13.384337] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-24T20:47:13.384422] [INFO ] [MAIN ] Update Progress: 1709/2373 symbols completed. PMT took 33.7s. Estimated remaining: 1h 28m 16s. Rate: 7.5 symbols/min [2025-09-24T20:47:13.493321] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T20:47:13.505403] [INFO ] [REMOTE ] PMTV: Full fetch complete (6122 records). [2025-09-24T20:47:13.515785] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-24T20:47:13.621807] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-24T20:47:13.643184] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:13.661236] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-24T20:47:13.671790] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-24T20:47:13.672358] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-24T20:47:13.683219] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-24T20:47:13.688441] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-24T20:47:13.693631] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-24T20:47:13.857198] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-24T20:47:13.857435] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:47:13.863130] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:47:13.873444] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-24T20:47:13.898065] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-24T20:47:13.908533] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-24T20:47:13.910983] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-24T20:47:13.917794] [INFO ] [MAIN ] Update Progress: 1710/2373 symbols completed. PMTV took 22.6s. Estimated remaining: 1h 28m 5s. Rate: 7.5 symbols/min [2025-09-24T20:47:13.993241] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:14.063557] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-24T20:47:14.261964] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:14.297936] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:14.303674] [DEBUG] [LOCAL ] PNI: Loaded 6709 existing records from primary storage. [2025-09-24T20:47:14.303751] [INFO ] [MAIN ] PNI: Loaded 6709 existing records. [2025-09-24T20:47:14.421221] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-24T20:47:14.511832] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:47:14.512121] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-24T20:47:14.512177] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-24T20:47:14.512574] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-24T20:47:14.512634] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-24T20:47:14.889031] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:15.216129] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-24T20:47:16.016128] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-24T20:47:16.116265] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T20:47:16.311764] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:16.312128] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-24T20:47:16.506718] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-24T20:47:16.816161] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-24T20:47:17.104779] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:17.105119] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-24T20:47:17.616113] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-24T20:47:18.416177] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-24T20:47:18.699158] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:47:18.699507] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-24T20:47:19.216199] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-24T20:47:19.589987] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T20:47:19.965733] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T20:47:20.016138] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-24T20:47:20.816154] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-24T20:47:21.616065] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-24T20:47:21.682188] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T20:47:21.841932] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T20:47:21.996779] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-24T20:47:22.416169] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-24T20:47:23.216101] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-24T20:47:23.833459] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T20:47:24.016113] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-24T20:47:24.289727] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T20:47:24.666400] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T20:47:24.816117] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-24T20:47:25.616129] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-24T20:47:26.025933] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T20:47:26.416132] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-24T20:47:26.841713] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T20:47:26.842527] [INFO ] [REMOTE ] PMTU: Full fetch complete (1212 records). [2025-09-24T20:47:26.842598] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-24T20:47:27.067157] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-24T20:47:27.070721] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:47:27.071020] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:47:27.071528] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-24T20:47:27.072723] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-24T20:47:27.083777] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-24T20:47:27.084144] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-24T20:47:27.084357] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-24T20:47:27.084459] [INFO ] [MAIN ] Update Progress: 1711/2373 symbols completed. PMTU took 44.6s. Estimated remaining: 1h 27m 59s. Rate: 7.5 symbols/min [2025-09-24T20:47:27.221208] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-24T20:47:27.269060] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:27.302856] [DEBUG] [LOCAL ] PNNT: Loaded 32872 existing records from primary storage. [2025-09-24T20:47:27.302998] [INFO ] [MAIN ] PNNT: Loaded 32872 existing records. [2025-09-24T20:47:27.492094] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:47:27.492387] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-24T20:47:27.492439] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-24T20:47:27.493559] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-24T20:47:27.493623] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-24T20:47:27.854958] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:28.016114] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-24T20:47:28.106374] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T20:47:28.816113] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-24T20:47:29.270881] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T20:47:29.282851] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T20:47:29.616122] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-24T20:47:30.416101] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-24T20:47:31.216141] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-24T20:47:31.513573] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T20:47:31.552798] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:47:31.848315] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T20:47:32.016154] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-24T20:47:32.816167] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-24T20:47:33.616101] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-24T20:47:33.752243] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T20:47:33.882503] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T20:47:34.302059] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T20:47:34.416108] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-24T20:47:35.075731] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T20:47:35.216169] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-24T20:47:36.016099] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-24T20:47:36.289886] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T20:47:36.606955] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-24T20:47:36.608303] [INFO ] [REMOTE ] PMTW: Full fetch complete (3668 records). [2025-09-24T20:47:36.608380] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-24T20:47:36.794002] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-24T20:47:36.794225] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:47:36.794298] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:47:36.794372] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-24T20:47:36.794437] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-24T20:47:36.794475] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-24T20:47:36.794541] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-24T20:47:36.794622] [INFO ] [MAIN ] Update Progress: 1712/2373 symbols completed. PMTW took 31.6s. Estimated remaining: 1h 27m 51s. Rate: 7.5 symbols/min [2025-09-24T20:47:36.824261] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-24T20:47:36.970764] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:36.970966] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-24T20:47:36.971021] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-24T20:47:36.971168] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-24T20:47:36.971212] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-24T20:47:36.971255] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-24T20:47:36.971288] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-24T20:47:37.355993] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:37.616121] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-24T20:47:37.746198] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T20:47:38.416117] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-24T20:47:39.085887] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T20:47:39.216129] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-24T20:47:39.255529] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:47:39.257709] [INFO ] [REMOTE ] PNI: Full fetch complete (9928 records). [2025-09-24T20:47:39.257784] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-24T20:47:39.620128] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-24T20:47:39.620214] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-24T20:47:39.620472] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-24T20:47:39.620535] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-24T20:47:39.620991] [DEBUG] [LOCAL ] PNI: Trimmed 9928 records to 6684 (keeping 200 days of data) [2025-09-24T20:47:39.661266] [DEBUG] [LOCAL ] PNI: Primary data saved (6684 records). [2025-09-24T20:47:39.661425] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-24T20:47:39.661563] [INFO ] [MAIN ] Update Progress: 1713/2373 symbols completed. PNI took 25.7s. Estimated remaining: 1h 27m 41s. Rate: 7.5 symbols/min [2025-09-24T20:47:39.831490] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:39.881667] [DEBUG] [LOCAL ] PNW: Loaded 45908 existing records from primary storage. [2025-09-24T20:47:39.881819] [INFO ] [MAIN ] PNW: Loaded 45908 existing records. [2025-09-24T20:47:40.022507] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-24T20:47:40.063623] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:47:40.063873] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-24T20:47:40.063920] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-24T20:47:40.065456] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-24T20:47:40.065528] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-24T20:47:40.416829] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:40.816183] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-24T20:47:40.982566] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T20:47:41.616170] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-24T20:47:42.275004] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T20:47:42.297767] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-24T20:47:42.416107] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-24T20:47:43.060780] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T20:47:43.216102] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-24T20:47:44.016059] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-24T20:47:44.293559] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T20:47:44.816058] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-24T20:47:44.947724] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:47:45.616127] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-24T20:47:45.721985] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T20:47:46.251312] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T20:47:46.259805] [INFO ] [REMOTE ] PNC: Full fetch complete (75144 records). [2025-09-24T20:47:46.259915] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-24T20:47:46.260750] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:47:46.260842] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:47:46.260886] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:47:46.260924] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-24T20:47:46.260981] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-24T20:47:46.261017] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-24T20:47:46.261064] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-24T20:47:46.261152] [INFO ] [MAIN ] Update Progress: 1714/2373 symbols completed. PNC took 32.9s. Estimated remaining: 1h 27m 33s. Rate: 7.5 symbols/min [2025-09-24T20:47:46.416562] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-24T20:47:46.434340] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:46.435271] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-09-24T20:47:46.436092] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-09-24T20:47:46.436395] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-24T20:47:46.436453] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-24T20:47:46.436499] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-09-24T20:47:46.436532] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-24T20:47:46.573289] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T20:47:46.832584] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:47.216166] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-24T20:47:48.016106] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-24T20:47:48.352914] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T20:47:48.753903] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T20:47:48.816034] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-24T20:47:49.616157] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-24T20:47:49.748923] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T20:47:50.258980] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T20:47:50.416053] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-24T20:47:50.985295] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T20:47:51.216138] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-24T20:47:52.016149] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-24T20:47:52.172923] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T20:47:52.816047] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-24T20:47:52.908675] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T20:47:53.553781] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T20:47:53.616105] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-24T20:47:54.416286] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-24T20:47:54.423704] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T20:47:55.216116] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-24T20:47:55.440603] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:47:55.912464] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T20:47:56.016118] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-24T20:47:56.541004] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T20:47:56.816091] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-24T20:47:57.390862] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T20:47:57.397456] [INFO ] [REMOTE ] PNNT: Full fetch complete (47182 records). [2025-09-24T20:47:57.397606] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-24T20:47:57.622599] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-24T20:47:57.834260] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-24T20:47:57.834353] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-24T20:47:57.835215] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-24T20:47:57.835345] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-24T20:47:57.836471] [DEBUG] [LOCAL ] PNNT: Trimmed 47182 records to 32877 (keeping 200 days of data) [2025-09-24T20:47:58.047100] [DEBUG] [LOCAL ] PNNT: Primary data saved (32877 records). [2025-09-24T20:47:58.047257] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-24T20:47:58.047351] [INFO ] [MAIN ] Update Progress: 1715/2373 symbols completed. PNNT took 31.0s. Estimated remaining: 1h 27m 26s. Rate: 7.5 symbols/min [2025-09-24T20:47:58.230789] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:47:58.281326] [DEBUG] [LOCAL ] POST: Loaded 38936 existing records from primary storage. [2025-09-24T20:47:58.281560] [INFO ] [MAIN ] POST: Loaded 38936 existing records. [2025-09-24T20:47:58.426010] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-24T20:47:58.471159] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:47:58.471791] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-24T20:47:58.472246] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-24T20:47:58.474207] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-24T20:47:58.474277] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-24T20:47:58.868204] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T20:47:58.873742] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:47:59.216151] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-24T20:47:59.505380] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T20:47:59.955780] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T20:48:00.016109] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-24T20:48:00.424380] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T20:48:00.816119] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-24T20:48:01.616063] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-24T20:48:01.881329] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T20:48:02.421047] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-24T20:48:03.004193] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T20:48:03.216150] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-24T20:48:04.016143] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-24T20:48:04.293200] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-24T20:48:04.750988] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-24T20:48:04.816043] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-24T20:48:05.255015] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-24T20:48:05.616096] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-24T20:48:05.669727] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T20:48:06.269533] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T20:48:06.416175] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-24T20:48:07.130638] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:48:07.216046] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-24T20:48:07.943173] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T20:48:08.016117] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-24T20:48:08.816089] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-24T20:48:08.874997] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T20:48:09.616108] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-24T20:48:09.718035] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T20:48:09.726778] [INFO ] [REMOTE ] PNR: Full fetch complete (68888 records). [2025-09-24T20:48:09.726933] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-24T20:48:09.758159] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:48:09.761767] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:48:09.762823] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:48:09.763879] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T20:48:09.764094] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-24T20:48:09.764249] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-24T20:48:09.774163] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-24T20:48:09.774241] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-24T20:48:09.774856] [INFO ] [MAIN ] Update Progress: 1716/2373 symbols completed. PNR took 33.0s. Estimated remaining: 1h 27m 20s. Rate: 7.5 symbols/min [2025-09-24T20:48:09.968576] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:10.041290] [DEBUG] [LOCAL ] PPG: Loaded 50698 existing records from primary storage. [2025-09-24T20:48:10.041475] [INFO ] [MAIN ] PPG: Loaded 50698 existing records. [2025-09-24T20:48:10.221690] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:10.221960] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-24T20:48:10.222009] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-24T20:48:10.223942] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-24T20:48:10.224006] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-24T20:48:10.421384] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-24T20:48:10.589897] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:11.193693] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:48:11.216026] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-24T20:48:12.016062] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-24T20:48:12.078626] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T20:48:12.816186] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-24T20:48:12.876637] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:48:13.475597] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T20:48:13.487569] [INFO ] [REMOTE ] PNW: Full fetch complete (66132 records). [2025-09-24T20:48:13.487749] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-24T20:48:13.628852] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-24T20:48:13.903895] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-24T20:48:13.904020] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-24T20:48:13.905186] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-24T20:48:13.905315] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-24T20:48:13.906900] [DEBUG] [LOCAL ] PNW: Trimmed 66132 records to 45836 (keeping 200 days of data) [2025-09-24T20:48:14.225578] [DEBUG] [LOCAL ] PNW: Primary data saved (45836 records). [2025-09-24T20:48:14.225828] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-24T20:48:14.226143] [INFO ] [MAIN ] Update Progress: 1717/2373 symbols completed. PNW took 34.6s. Estimated remaining: 1h 27m 11s. Rate: 7.5 symbols/min [2025-09-24T20:48:14.416140] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-24T20:48:14.490930] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T20:48:15.216129] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-24T20:48:15.463365] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T20:48:16.016059] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-24T20:48:16.576774] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-24T20:48:16.816123] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-24T20:48:17.050837] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T20:48:17.064980] [INFO ] [REMOTE ] POR: Full fetch complete (68084 records). [2025-09-24T20:48:17.065276] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-24T20:48:17.464126] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-24T20:48:17.464320] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-24T20:48:17.465520] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-24T20:48:17.465631] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-24T20:48:17.491376] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T20:48:17.498373] [DEBUG] [LOCAL ] POR: Trimmed 68084 records to 47037 (keeping 200 days of data) [2025-09-24T20:48:17.617715] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-24T20:48:17.802826] [DEBUG] [LOCAL ] POR: Primary data saved (47037 records). [2025-09-24T20:48:17.802975] [INFO ] [MAIN ] POR: Full history saved. [2025-09-24T20:48:17.803068] [INFO ] [MAIN ] Update Progress: 1718/2373 symbols completed. POR took 31.5s. Estimated remaining: 1h 27m 1s. Rate: 7.5 symbols/min [2025-09-24T20:48:19.352877] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-24T20:48:19.364309] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-24T20:48:19.548716] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T20:48:19.558173] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-24T20:48:21.094008] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T20:48:21.104072] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-24T20:48:21.179665] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T20:48:21.189468] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-24T20:48:22.889066] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T20:48:22.897578] [INFO ] [REMOTE ] POST: Full fetch complete (55777 records). [2025-09-24T20:48:22.897745] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-24T20:48:23.297479] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-24T20:48:23.297792] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-24T20:48:23.298766] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-24T20:48:23.298845] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-24T20:48:23.328870] [DEBUG] [LOCAL ] POST: Trimmed 55777 records to 38921 (keeping 200 days of data) [2025-09-24T20:48:23.330547] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-24T20:48:23.342915] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-24T20:48:23.587481] [DEBUG] [LOCAL ] POST: Primary data saved (38921 records). [2025-09-24T20:48:23.587631] [INFO ] [MAIN ] POST: Full history saved. [2025-09-24T20:48:23.587777] [INFO ] [MAIN ] Update Progress: 1719/2373 symbols completed. POST took 25.5s. Estimated remaining: 1h 26m 52s. Rate: 7.5 symbols/min [2025-09-24T20:48:25.282695] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T20:48:25.293863] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-24T20:48:27.260333] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T20:48:27.271381] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-24T20:48:29.020037] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T20:48:29.030638] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-24T20:48:31.227119] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T20:48:31.238631] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-24T20:48:33.118761] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T20:48:33.129823] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-24T20:48:34.873953] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T20:48:34.885093] [INFO ] [REMOTE ] PPG: Full fetch complete (73775 records). [2025-09-24T20:48:34.885287] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-24T20:48:35.330009] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-24T20:48:35.330322] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-24T20:48:35.331395] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-24T20:48:35.331460] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-24T20:48:35.332893] [DEBUG] [LOCAL ] PPG: Trimmed 73775 records to 50693 (keeping 200 days of data) [2025-09-24T20:48:35.667157] [DEBUG] [LOCAL ] PPG: Primary data saved (50693 records). [2025-09-24T20:48:35.667304] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-24T20:48:35.667401] [INFO ] [MAIN ] Update Progress: 1720/2373 symbols completed. PPG took 25.9s. Estimated remaining: 1h 26m 46s. Rate: 7.5 symbols/min [2025-09-24T20:48:36.288954] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:36.348563] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:36.388126] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-24T20:48:36.415265] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:36.429970] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-24T20:48:36.452847] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:36.453401] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-24T20:48:36.453542] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-24T20:48:36.453925] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-24T20:48:36.454003] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-24T20:48:36.659329] [DEBUG] [LOCAL ] PPT: Loaded 20146 existing records from primary storage. [2025-09-24T20:48:36.683884] [INFO ] [MAIN ] PPT: Loaded 20146 existing records. [2025-09-24T20:48:36.757484] [DEBUG] [LOCAL ] PRA: Loaded 34870 existing records from primary storage. [2025-09-24T20:48:36.809236] [INFO ] [MAIN ] PRA: Loaded 34870 existing records. [2025-09-24T20:48:36.966558] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-24T20:48:37.072796] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-24T20:48:37.193932] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:37.269859] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-24T20:48:37.273079] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:37.304537] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-24T20:48:37.315136] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-24T20:48:37.338069] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-24T20:48:37.349237] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-24T20:48:37.461890] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:37.513288] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-24T20:48:37.524062] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-24T20:48:37.602393] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-24T20:48:37.654742] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:37.654586] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-24T20:48:37.707992] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-24T20:48:37.739058] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-24T20:48:37.861037] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-24T20:48:37.923167] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-24T20:48:38.248226] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:38.265922] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-24T20:48:38.564332] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:38.577100] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-24T20:48:38.678943] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:38.679251] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-24T20:48:39.368455] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T20:48:39.379209] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-24T20:48:39.424939] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T20:48:39.429695] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-24T20:48:39.775737] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T20:48:39.780796] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-24T20:48:40.193161] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T20:48:40.204776] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-24T20:48:40.352906] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T20:48:40.357050] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-24T20:48:40.565945] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T20:48:40.569940] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-24T20:48:40.834386] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T20:48:40.845126] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-24T20:48:41.051731] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T20:48:41.055912] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-24T20:48:41.709860] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T20:48:41.714627] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-24T20:48:41.801239] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T20:48:41.811880] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-24T20:48:42.516634] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T20:48:42.523573] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-24T20:48:42.722870] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T20:48:42.733529] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-24T20:48:42.821840] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T20:48:42.826897] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-24T20:48:43.390257] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T20:48:43.400614] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-24T20:48:44.130882] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T20:48:44.140947] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T20:48:44.141788] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-24T20:48:44.147412] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-24T20:48:44.612070] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T20:48:44.623490] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-24T20:48:45.055890] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T20:48:45.068005] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-24T20:48:45.344585] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T20:48:45.350074] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-24T20:48:45.487296] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T20:48:45.496619] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-24T20:48:46.255549] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T20:48:46.266946] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-24T20:48:46.493384] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T20:48:46.498482] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-24T20:48:46.539120] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T20:48:46.622566] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T20:48:47.216162] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-24T20:48:47.646983] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T20:48:47.824704] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:48:48.016088] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-24T20:48:48.472584] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T20:48:48.816096] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-24T20:48:49.616103] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-24T20:48:49.818323] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T20:48:50.416049] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-24T20:48:50.668456] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T20:48:50.760785] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T20:48:51.216098] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-24T20:48:51.629852] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T20:48:52.016112] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-24T20:48:52.816049] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-24T20:48:53.110421] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T20:48:53.114433] [INFO ] [REMOTE ] PPT: Full fetch complete (29263 records). [2025-09-24T20:48:53.114525] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-24T20:48:53.527531] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-24T20:48:53.527681] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-24T20:48:53.528555] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-24T20:48:53.528638] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-24T20:48:53.529878] [DEBUG] [LOCAL ] PPT: Trimmed 29263 records to 20056 (keeping 200 days of data) [2025-09-24T20:48:53.575836] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-24T20:48:53.621874] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-24T20:48:53.710493] [DEBUG] [LOCAL ] PPT: Primary data saved (20056 records). [2025-09-24T20:48:53.710626] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-24T20:48:53.710787] [INFO ] [MAIN ] Update Progress: 1721/2373 symbols completed. PPT took 18.0s. Estimated remaining: 1h 26m 42s. Rate: 7.5 symbols/min [2025-09-24T20:48:53.892223] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:53.892473] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-24T20:48:53.892632] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-24T20:48:53.905709] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-24T20:48:53.906308] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-24T20:48:53.906186] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T20:48:53.909705] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-24T20:48:53.911842] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-24T20:48:53.933375] [INFO ] [REMOTE ] PRA: Full fetch complete (43398 records). [2025-09-24T20:48:53.980387] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-24T20:48:54.427008] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-24T20:48:54.616753] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:54.758309] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-24T20:48:54.758393] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-24T20:48:54.759349] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-24T20:48:54.759415] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-24T20:48:54.760478] [DEBUG] [LOCAL ] PRA: Trimmed 43398 records to 34901 (keeping 200 days of data) [2025-09-24T20:48:54.969088] [DEBUG] [LOCAL ] PRA: Primary data saved (34901 records). [2025-09-24T20:48:54.969246] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-24T20:48:54.969338] [INFO ] [MAIN ] Update Progress: 1722/2373 symbols completed. PRA took 19.3s. Estimated remaining: 1h 26m 31s. Rate: 7.5 symbols/min [2025-09-24T20:48:55.151412] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:55.183604] [DEBUG] [LOCAL ] PRG: Loaded 30129 existing records from primary storage. [2025-09-24T20:48:55.183771] [INFO ] [MAIN ] PRG: Loaded 30129 existing records. [2025-09-24T20:48:55.221179] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-24T20:48:55.377399] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:55.377909] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-24T20:48:55.377991] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-24T20:48:55.379330] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-24T20:48:55.379404] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-24T20:48:55.727948] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T20:48:55.802717] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:55.805741] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T20:48:56.016044] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-24T20:48:56.492361] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-24T20:48:56.816124] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-24T20:48:57.367002] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T20:48:57.375840] [INFO ] [REMOTE ] PPL: Full fetch complete (77026 records). [2025-09-24T20:48:57.375984] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-24T20:48:57.376900] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:48:57.376996] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:48:57.377039] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:48:57.377078] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-24T20:48:57.377139] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-24T20:48:57.377174] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-24T20:48:57.377248] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-24T20:48:57.377333] [INFO ] [MAIN ] Update Progress: 1723/2373 symbols completed. PPL took 21.7s. Estimated remaining: 1h 26m 21s. Rate: 7.5 symbols/min [2025-09-24T20:48:57.574025] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:48:57.618131] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-24T20:48:57.620064] [DEBUG] [LOCAL ] PRGO: Loaded 46900 existing records from primary storage. [2025-09-24T20:48:57.620599] [INFO ] [MAIN ] PRGO: Loaded 46900 existing records. [2025-09-24T20:48:57.803944] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:48:57.804216] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-24T20:48:57.804397] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-24T20:48:57.806247] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-24T20:48:57.806334] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-24T20:48:57.944031] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T20:48:58.215589] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:48:58.416144] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-24T20:48:59.068728] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T20:48:59.216112] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-24T20:49:00.016046] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-24T20:49:00.352194] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:49:00.495137] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T20:49:00.816150] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-24T20:49:01.621211] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-24T20:49:01.635993] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T20:49:02.182157] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-24T20:49:02.416204] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-24T20:49:02.779829] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-24T20:49:02.789130] [INFO ] [REMOTE ] PR: Full fetch complete (77593 records). [2025-09-24T20:49:02.789263] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-24T20:49:03.195078] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-24T20:49:03.195204] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-24T20:49:03.196355] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-24T20:49:03.196434] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-24T20:49:03.198036] [DEBUG] [LOCAL ] PR: Trimmed 77593 records to 53609 (keeping 200 days of data) [2025-09-24T20:49:03.253240] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-24T20:49:03.542284] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-24T20:49:03.542428] [INFO ] [MAIN ] PR: Full history saved. [2025-09-24T20:49:03.542515] [INFO ] [MAIN ] Update Progress: 1724/2373 symbols completed. PR took 27.9s. Estimated remaining: 1h 26m 12s. Rate: 7.5 symbols/min [2025-09-24T20:49:03.726848] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:03.733918] [DEBUG] [LOCAL ] PRH: Loaded 4901 existing records from primary storage. [2025-09-24T20:49:03.734254] [INFO ] [MAIN ] PRH: Loaded 4901 existing records. [2025-09-24T20:49:03.840110] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T20:49:03.924344] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:49:03.924732] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-24T20:49:03.924872] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-24T20:49:03.925375] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-24T20:49:03.925437] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-24T20:49:04.024866] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-24T20:49:04.323513] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T20:49:04.329396] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:04.582389] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-24T20:49:04.816110] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-24T20:49:05.335902] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-24T20:49:05.616143] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-24T20:49:06.416151] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-24T20:49:07.162973] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-24T20:49:07.166607] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T20:49:07.216035] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-24T20:49:08.016099] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-24T20:49:08.742374] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T20:49:08.779445] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T20:49:08.816038] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-24T20:49:09.616126] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-24T20:49:10.289637] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T20:49:10.416085] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-24T20:49:11.216185] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-24T20:49:11.276052] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T20:49:11.922794] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T20:49:12.009845] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T20:49:12.016692] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-24T20:49:12.816106] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-24T20:49:13.616057] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-24T20:49:13.860824] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T20:49:14.160142] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T20:49:14.355549] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T20:49:14.416090] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-24T20:49:15.149676] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T20:49:15.216113] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-24T20:49:16.016091] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-24T20:49:16.087575] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T20:49:16.816105] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-24T20:49:17.620058] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-24T20:49:17.622886] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T20:49:17.868865] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T20:49:18.143479] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T20:49:18.416116] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-24T20:49:19.216141] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-24T20:49:19.760063] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T20:49:19.806117] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T20:49:20.016132] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-24T20:49:20.816157] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-24T20:49:21.470249] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-24T20:49:21.616077] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-24T20:49:21.834615] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T20:49:22.416118] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-24T20:49:22.869599] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T20:49:22.874510] [INFO ] [REMOTE ] PRG: Full fetch complete (44098 records). [2025-09-24T20:49:22.874698] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-24T20:49:23.221873] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-24T20:49:23.221785] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T20:49:23.278572] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-24T20:49:23.278695] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-24T20:49:23.279578] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-24T20:49:23.279626] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-24T20:49:23.280882] [DEBUG] [LOCAL ] PRG: Trimmed 44098 records to 30048 (keeping 200 days of data) [2025-09-24T20:49:23.487072] [DEBUG] [LOCAL ] PRG: Primary data saved (30048 records). [2025-09-24T20:49:23.487296] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-24T20:49:23.487410] [INFO ] [MAIN ] Update Progress: 1725/2373 symbols completed. PRG took 28.5s. Estimated remaining: 1h 26m 9s. Rate: 7.5 symbols/min [2025-09-24T20:49:23.665209] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:23.669595] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T20:49:23.671108] [INFO ] [REMOTE ] PRCS: Full fetch complete (3786 records). [2025-09-24T20:49:23.671214] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-24T20:49:23.874019] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-24T20:49:23.874276] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:49:23.875383] [DEBUG] [LOCAL ] PRI: Loaded 18430 existing records from primary storage. [2025-09-24T20:49:23.875549] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:49:23.875801] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-24T20:49:23.875912] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-24T20:49:23.876228] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-24T20:49:23.876347] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-24T20:49:23.876041] [INFO ] [MAIN ] PRI: Loaded 18430 existing records. [2025-09-24T20:49:23.876444] [INFO ] [MAIN ] Update Progress: 1726/2373 symbols completed. PRCS took 30.2s. Estimated remaining: 1h 25m 58s. Rate: 7.5 symbols/min [2025-09-24T20:49:24.021237] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-24T20:49:24.204088] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:24.273554] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:49:24.274050] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-24T20:49:24.274117] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-24T20:49:24.275147] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-24T20:49:24.275220] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-24T20:49:24.537196] [DEBUG] [LOCAL ] PRIM: Loaded 44524 existing records from primary storage. [2025-09-24T20:49:24.559900] [INFO ] [MAIN ] PRIM: Loaded 44524 existing records. [2025-09-24T20:49:24.833253] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-24T20:49:24.844387] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:24.877724] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:49:24.877902] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-24T20:49:24.877996] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-24T20:49:24.879371] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-24T20:49:24.879433] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-24T20:49:25.280633] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:25.554323] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T20:49:25.616125] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-24T20:49:25.702143] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T20:49:26.416078] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-24T20:49:26.771756] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:49:27.216095] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-24T20:49:27.969936] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T20:49:28.016110] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-24T20:49:28.619031] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T20:49:28.816054] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-24T20:49:28.988633] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T20:49:29.446567] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T20:49:29.616085] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-24T20:49:30.147342] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T20:49:30.148470] [INFO ] [REMOTE ] PRH: Full fetch complete (7688 records). [2025-09-24T20:49:30.148540] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-24T20:49:30.425080] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-24T20:49:30.510031] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-24T20:49:30.510109] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-24T20:49:30.510342] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-24T20:49:30.510380] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-24T20:49:30.510819] [DEBUG] [LOCAL ] PRH: Trimmed 7688 records to 4870 (keeping 200 days of data) [2025-09-24T20:49:30.540557] [DEBUG] [LOCAL ] PRH: Primary data saved (4870 records). [2025-09-24T20:49:30.540680] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-24T20:49:30.540777] [INFO ] [MAIN ] Update Progress: 1727/2373 symbols completed. PRH took 27.0s. Estimated remaining: 1h 25m 50s. Rate: 7.5 symbols/min [2025-09-24T20:49:30.715370] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:30.715566] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-09-24T20:49:30.715606] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-09-24T20:49:30.715811] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-24T20:49:30.715855] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-24T20:49:30.715899] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-09-24T20:49:30.715934] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-24T20:49:31.081871] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:31.216103] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-24T20:49:32.016129] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-24T20:49:32.220453] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T20:49:32.335366] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-24T20:49:32.816176] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-24T20:49:33.616088] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-24T20:49:33.695346] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:49:34.416139] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-24T20:49:34.454557] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:49:34.463536] [INFO ] [REMOTE ] PRGO: Full fetch complete (68385 records). [2025-09-24T20:49:34.463736] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-24T20:49:34.858621] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-24T20:49:34.858827] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-24T20:49:34.859981] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-24T20:49:34.860045] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-24T20:49:34.861428] [DEBUG] [LOCAL ] PRGO: Trimmed 68385 records to 46894 (keeping 200 days of data) [2025-09-24T20:49:35.146099] [DEBUG] [LOCAL ] PRGO: Primary data saved (46894 records). [2025-09-24T20:49:35.146236] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-24T20:49:35.146332] [INFO ] [MAIN ] Update Progress: 1728/2373 symbols completed. PRGO took 37.8s. Estimated remaining: 1h 25m 40s. Rate: 7.5 symbols/min [2025-09-24T20:49:35.220989] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-24T20:49:35.322015] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:35.345358] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:49:35.370660] [DEBUG] [LOCAL ] PRLB: Loaded 20739 existing records from primary storage. [2025-09-24T20:49:35.370814] [INFO ] [MAIN ] PRLB: Loaded 20739 existing records. [2025-09-24T20:49:35.550708] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:49:35.550967] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-24T20:49:35.551023] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-24T20:49:35.551775] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-24T20:49:35.551840] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-24T20:49:35.912409] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:36.017052] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-24T20:49:36.016977] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T20:49:36.201725] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T20:49:36.816186] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-24T20:49:37.416604] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T20:49:37.616117] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-24T20:49:38.335738] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T20:49:38.416084] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-24T20:49:38.759869] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:49:39.216107] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-24T20:49:39.820974] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T20:49:40.016115] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-24T20:49:40.816121] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-24T20:49:40.981059] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T20:49:41.317286] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T20:49:41.616103] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-24T20:49:42.416099] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-24T20:49:42.465805] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T20:49:42.771274] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T20:49:43.216047] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-24T20:49:43.277570] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T20:49:44.016194] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-24T20:49:44.502866] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T20:49:44.816112] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-24T20:49:45.616177] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-24T20:49:45.686100] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T20:49:45.793728] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T20:49:46.416110] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-24T20:49:46.755492] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T20:49:47.216086] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-24T20:49:47.575548] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T20:49:48.016117] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-24T20:49:48.780831] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:49:48.816033] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-24T20:49:49.616049] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-24T20:49:49.731474] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T20:49:50.426053] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-24T20:49:50.436811] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:49:50.466421] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T20:49:51.216145] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-24T20:49:52.016087] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-24T20:49:52.123983] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T20:49:52.185284] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T20:49:52.816174] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-24T20:49:53.560084] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T20:49:53.614709] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T20:49:53.619304] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-24T20:49:54.416123] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-24T20:49:55.216077] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-24T20:49:55.243030] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T20:49:55.294321] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:49:55.302873] [INFO ] [REMOTE ] PRKS: Full fetch complete (61022 records). [2025-09-24T20:49:55.303007] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-24T20:49:55.693484] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-24T20:49:55.693606] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-24T20:49:55.694638] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-24T20:49:55.694720] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-24T20:49:55.695997] [DEBUG] [LOCAL ] PRKS: Trimmed 61022 records to 42703 (keeping 200 days of data) [2025-09-24T20:49:55.944423] [DEBUG] [LOCAL ] PRKS: Primary data saved (42703 records). [2025-09-24T20:49:55.944560] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-24T20:49:55.944635] [INFO ] [MAIN ] Update Progress: 1729/2373 symbols completed. PRKS took 25.4s. Estimated remaining: 1h 25m 37s. Rate: 7.5 symbols/min [2025-09-24T20:49:56.016849] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-24T20:49:56.122519] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:49:56.167081] [DEBUG] [LOCAL ] PRM: Loaded 44606 existing records from primary storage. [2025-09-24T20:49:56.167241] [INFO ] [MAIN ] PRM: Loaded 44606 existing records. [2025-09-24T20:49:56.351528] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:49:56.363113] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-24T20:49:56.364266] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T20:49:56.363794] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-24T20:49:56.370234] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-24T20:49:56.370311] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-24T20:49:56.742452] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:49:56.816046] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-24T20:49:57.534689] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T20:49:57.616049] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-24T20:49:58.068743] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T20:49:58.416105] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-24T20:49:59.094319] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T20:49:59.216093] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-24T20:50:00.024615] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-24T20:50:00.044732] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T20:50:00.816147] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-24T20:50:00.946478] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T20:50:01.280805] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T20:50:01.616176] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-24T20:50:02.171034] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T20:50:02.394587] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T20:50:02.399515] [INFO ] [REMOTE ] PRLB: Full fetch complete (31013 records). [2025-09-24T20:50:02.399679] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-24T20:50:02.421637] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-24T20:50:02.829530] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-24T20:50:02.829668] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-24T20:50:02.830473] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-24T20:50:02.830523] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-24T20:50:02.831629] [DEBUG] [LOCAL ] PRLB: Trimmed 31013 records to 20688 (keeping 200 days of data) [2025-09-24T20:50:02.958523] [DEBUG] [LOCAL ] PRLB: Primary data saved (20688 records). [2025-09-24T20:50:02.958688] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-24T20:50:02.958790] [INFO ] [MAIN ] Update Progress: 1730/2373 symbols completed. PRLB took 27.8s. Estimated remaining: 1h 25m 29s. Rate: 7.5 symbols/min [2025-09-24T20:50:03.132699] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:03.184119] [DEBUG] [LOCAL ] PRMB: Loaded 53179 existing records from primary storage. [2025-09-24T20:50:03.184324] [INFO ] [MAIN ] PRMB: Loaded 53179 existing records. [2025-09-24T20:50:03.226244] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-24T20:50:03.365106] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:03.365364] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-24T20:50:03.365412] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-24T20:50:03.367022] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-24T20:50:03.367083] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-24T20:50:03.728805] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:04.016057] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-24T20:50:04.263380] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T20:50:04.496760] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T20:50:04.816109] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-24T20:50:05.616108] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-24T20:50:05.669249] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T20:50:05.677335] [INFO ] [REMOTE ] PRIM: Full fetch complete (63309 records). [2025-09-24T20:50:05.677471] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-24T20:50:06.081527] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-24T20:50:06.081695] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-24T20:50:06.083056] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-24T20:50:06.083133] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-24T20:50:06.084634] [DEBUG] [LOCAL ] PRIM: Trimmed 63309 records to 44489 (keeping 200 days of data) [2025-09-24T20:50:06.381809] [DEBUG] [LOCAL ] PRIM: Primary data saved (44489 records). [2025-09-24T20:50:06.381975] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-24T20:50:06.382112] [INFO ] [MAIN ] Update Progress: 1731/2373 symbols completed. PRIM took 42.5s. Estimated remaining: 1h 25m 19s. Rate: 7.5 symbols/min [2025-09-24T20:50:06.418779] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-24T20:50:06.615196] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:06.618554] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T20:50:06.670259] [DEBUG] [LOCAL ] PRO: Loaded 37644 existing records from primary storage. [2025-09-24T20:50:06.670407] [INFO ] [MAIN ] PRO: Loaded 37644 existing records. [2025-09-24T20:50:06.859278] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:06.859625] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-24T20:50:06.859707] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-24T20:50:06.860884] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-24T20:50:06.860955] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-24T20:50:07.217048] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-24T20:50:07.216969] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:07.552001] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T20:50:07.581793] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:50:07.585754] [INFO ] [REMOTE ] PRI: Full fetch complete (25712 records). [2025-09-24T20:50:07.585838] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-24T20:50:08.017687] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-24T20:50:08.017185] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-24T20:50:08.019746] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-24T20:50:08.020774] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-24T20:50:08.021031] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-24T20:50:08.022837] [DEBUG] [LOCAL ] PRI: Trimmed 25712 records to 18455 (keeping 200 days of data) [2025-09-24T20:50:08.156740] [DEBUG] [LOCAL ] PRI: Primary data saved (18455 records). [2025-09-24T20:50:08.156910] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-24T20:50:08.157048] [INFO ] [MAIN ] Update Progress: 1732/2373 symbols completed. PRI took 44.7s. Estimated remaining: 1h 25m 9s. Rate: 7.5 symbols/min [2025-09-24T20:50:08.333133] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:08.333319] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-24T20:50:08.333411] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-24T20:50:08.333528] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-24T20:50:08.333579] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-24T20:50:08.333670] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-24T20:50:08.333725] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-24T20:50:08.693172] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:08.816104] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-24T20:50:08.880543] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T20:50:09.120420] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:50:09.120807] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-24T20:50:09.363474] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T20:50:09.616088] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-24T20:50:10.416132] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-24T20:50:10.833240] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T20:50:11.216213] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-24T20:50:11.955517] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T20:50:12.016092] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-24T20:50:12.132878] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T20:50:12.816127] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-24T20:50:13.616102] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-24T20:50:13.842839] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T20:50:14.416120] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-24T20:50:14.853617] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T20:50:14.939452] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-24T20:50:15.216138] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-24T20:50:15.794294] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T20:50:16.016118] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-24T20:50:16.816161] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-24T20:50:17.550879] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-24T20:50:17.616091] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-24T20:50:18.227256] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-24T20:50:18.235236] [INFO ] [REMOTE ] PRM: Full fetch complete (64313 records). [2025-09-24T20:50:18.235376] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-24T20:50:18.418269] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-24T20:50:18.639086] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-24T20:50:18.639177] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-24T20:50:18.640185] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-24T20:50:18.640264] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-24T20:50:18.641712] [DEBUG] [LOCAL ] PRM: Trimmed 64313 records to 44602 (keeping 200 days of data) [2025-09-24T20:50:18.909456] [DEBUG] [LOCAL ] PRM: Primary data saved (44602 records). [2025-09-24T20:50:18.909629] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-24T20:50:18.909802] [INFO ] [MAIN ] Update Progress: 1733/2373 symbols completed. PRM took 23.0s. Estimated remaining: 1h 25m 2s. Rate: 7.5 symbols/min [2025-09-24T20:50:19.100616] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:19.114796] [DEBUG] [LOCAL ] PRT: Loaded 5306 existing records from primary storage. [2025-09-24T20:50:19.114977] [INFO ] [MAIN ] PRT: Loaded 5306 existing records. [2025-09-24T20:50:19.296995] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:19.297397] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-24T20:50:19.297461] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-24T20:50:19.297834] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-24T20:50:19.297931] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-24T20:50:19.678498] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:19.678888] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-24T20:50:19.905810] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T20:50:20.016055] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-24T20:50:20.492995] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-24T20:50:20.541766] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (3.73 seconds). [2025-09-24T20:50:20.555024] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T20:50:20.816119] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-24T20:50:21.407834] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T20:50:21.616130] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-24T20:50:22.416054] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-24T20:50:22.521450] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T20:50:22.792214] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T20:50:23.216148] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-24T20:50:23.954501] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T20:50:24.000241] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:50:24.016047] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-24T20:50:24.816118] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-24T20:50:24.840077] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T20:50:25.616125] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-24T20:50:26.086163] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T20:50:26.353308] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T20:50:26.416042] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-24T20:50:27.216119] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-24T20:50:27.912564] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T20:50:27.936297] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T20:50:28.016039] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-24T20:50:28.668463] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T20:50:28.816153] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-24T20:50:29.616100] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-24T20:50:30.155160] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T20:50:30.334538] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T20:50:30.416161] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-24T20:50:31.216109] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-24T20:50:32.016089] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-24T20:50:32.050894] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T20:50:32.816099] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-24T20:50:33.140361] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T20:50:33.616126] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-24T20:50:33.802250] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T20:50:34.416107] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-24T20:50:35.228490] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-24T20:50:35.230982] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-24T20:50:35.420065] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T20:50:35.665818] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T20:50:35.828018] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-24T20:50:36.016105] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-24T20:50:36.816138] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-24T20:50:37.622404] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-24T20:50:37.645827] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T20:50:37.655308] [INFO ] [REMOTE ] PRO: Full fetch complete (51280 records). [2025-09-24T20:50:37.655537] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-24T20:50:38.109536] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-24T20:50:38.109678] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-24T20:50:38.110634] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-24T20:50:38.110755] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-24T20:50:38.114205] [DEBUG] [LOCAL ] PRO: Trimmed 51280 records to 37725 (keeping 200 days of data) [2025-09-24T20:50:38.452739] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-24T20:50:38.465343] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:50:38.471608] [INFO ] [REMOTE ] PRT: Full fetch complete (9192 records). [2025-09-24T20:50:38.473690] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-24T20:50:38.675894] [DEBUG] [LOCAL ] PRO: Primary data saved (37725 records). [2025-09-24T20:50:38.685283] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-24T20:50:38.685576] [INFO ] [MAIN ] Update Progress: 1734/2373 symbols completed. PRO took 32.3s. Estimated remaining: 1h 24m 58s. Rate: 7.5 symbols/min [2025-09-24T20:50:39.173429] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:39.284253] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-24T20:50:39.352357] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-24T20:50:39.352485] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-24T20:50:39.353286] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-24T20:50:39.353367] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-24T20:50:39.352972] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-24T20:50:39.354983] [DEBUG] [LOCAL ] PRT: Trimmed 9192 records to 5333 (keeping 200 days of data) [2025-09-24T20:50:39.414431] [DEBUG] [LOCAL ] PRT: Primary data saved (5333 records). [2025-09-24T20:50:39.414579] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-24T20:50:39.414726] [INFO ] [MAIN ] Update Progress: 1735/2373 symbols completed. PRT took 20.5s. Estimated remaining: 1h 24m 48s. Rate: 7.5 symbols/min [2025-09-24T20:50:39.565373] [DEBUG] [LOCAL ] PRU: Loaded 51508 existing records from primary storage. [2025-09-24T20:50:39.613664] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:39.610118] [INFO ] [MAIN ] PRU: Loaded 51508 existing records. [2025-09-24T20:50:39.613963] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-24T20:50:39.625236] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-24T20:50:39.681550] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-24T20:50:39.693446] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-24T20:50:39.710688] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-24T20:50:39.710823] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-24T20:50:39.918866] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:39.943214] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-24T20:50:39.989633] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-24T20:50:40.027732] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T20:50:40.079020] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-24T20:50:40.115052] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-24T20:50:40.114956] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-24T20:50:40.413793] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:40.638724] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:40.816109] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-24T20:50:41.227539] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T20:50:41.426549] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T20:50:41.616129] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-24T20:50:42.416118] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-24T20:50:42.644528] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T20:50:42.685351] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T20:50:42.691615] [INFO ] [REMOTE ] PRSU: Full fetch complete (31984 records). [2025-09-24T20:50:42.691828] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-24T20:50:42.812631] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-24T20:50:42.904716] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-24T20:50:42.905156] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:50:42.905239] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:50:42.905314] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-24T20:50:42.905434] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-24T20:50:42.905491] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-24T20:50:42.905574] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-24T20:50:42.905691] [INFO ] [MAIN ] Update Progress: 1736/2373 symbols completed. PRSU took 34.7s. Estimated remaining: 1h 24m 38s. Rate: 7.5 symbols/min [2025-09-24T20:50:43.073045] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:43.130888] [DEBUG] [LOCAL ] PSA: Loaded 41914 existing records from primary storage. [2025-09-24T20:50:43.131057] [INFO ] [MAIN ] PSA: Loaded 41914 existing records. [2025-09-24T20:50:43.221382] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-24T20:50:43.319811] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:43.320121] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-24T20:50:43.320176] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-24T20:50:43.321899] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-24T20:50:43.321961] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-24T20:50:43.681176] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:44.016162] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-24T20:50:44.816167] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-24T20:50:45.000019] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T20:50:45.009457] [INFO ] [REMOTE ] PRMB: Full fetch complete (76071 records). [2025-09-24T20:50:45.009601] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-24T20:50:45.515636] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-24T20:50:45.515773] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-24T20:50:45.517141] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-24T20:50:45.517210] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-24T20:50:45.518876] [DEBUG] [LOCAL ] PRMB: Trimmed 76071 records to 53167 (keeping 200 days of data) [2025-09-24T20:50:45.631131] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-24T20:50:45.899971] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T20:50:45.925318] [DEBUG] [LOCAL ] PRMB: Primary data saved (53167 records). [2025-09-24T20:50:45.925440] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-24T20:50:45.925534] [INFO ] [MAIN ] Update Progress: 1737/2373 symbols completed. PRMB took 43.0s. Estimated remaining: 1h 24m 28s. Rate: 7.5 symbols/min [2025-09-24T20:50:46.112799] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:50:46.124779] [DEBUG] [LOCAL ] PSBD: Loaded 6903 existing records from primary storage. [2025-09-24T20:50:46.125026] [INFO ] [MAIN ] PSBD: Loaded 6903 existing records. [2025-09-24T20:50:46.159102] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-24T20:50:46.333081] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:50:46.335008] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T20:50:46.342523] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-24T20:50:46.343158] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-24T20:50:46.343476] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-24T20:50:46.343534] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-24T20:50:46.421148] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-24T20:50:46.705235] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:50:46.788900] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T20:50:47.216099] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-24T20:50:48.016115] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-24T20:50:48.816111] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-24T20:50:48.883936] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T20:50:49.521154] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T20:50:49.616103] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-24T20:50:49.856373] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T20:50:50.026352] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-24T20:50:50.416120] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-24T20:50:51.216108] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-24T20:50:52.019461] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-24T20:50:52.012841] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T20:50:52.037018] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T20:50:52.816081] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-24T20:50:53.616120] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-24T20:50:53.992705] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T20:50:54.098594] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T20:50:54.114349] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T20:50:54.416164] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-24T20:50:54.825311] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T20:50:55.216132] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-24T20:50:56.016139] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-24T20:50:56.054167] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T20:50:56.444152] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-24T20:50:56.816117] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-24T20:50:57.616158] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-24T20:50:58.416120] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-24T20:50:58.583129] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T20:50:58.893163] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-24T20:50:59.216118] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-24T20:50:59.577859] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T20:50:59.621793] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-24T20:51:00.016154] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-24T20:51:00.816149] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-24T20:51:01.570719] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T20:51:01.616145] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-24T20:51:01.831570] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T20:51:02.416136] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-24T20:51:03.216162] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-24T20:51:03.244891] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T20:51:04.016133] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-24T20:51:04.787961] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T20:51:04.816047] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-24T20:51:04.875816] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T20:51:05.042312] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-24T20:51:05.616150] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-24T20:51:05.626522] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:51:06.416166] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-24T20:51:07.159023] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T20:51:07.178861] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T20:51:07.216035] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-24T20:51:08.013438] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T20:51:08.015980] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-24T20:51:08.816139] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-24T20:51:08.946942] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:51:08.948893] [INFO ] [REMOTE ] PSBD: Full fetch complete (9195 records). [2025-09-24T20:51:08.948968] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-24T20:51:09.308269] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-24T20:51:09.308347] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-24T20:51:09.308578] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-24T20:51:09.308617] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-24T20:51:09.309067] [DEBUG] [LOCAL ] PSBD: Trimmed 9195 records to 6921 (keeping 200 days of data) [2025-09-24T20:51:09.351001] [DEBUG] [LOCAL ] PSBD: Primary data saved (6921 records). [2025-09-24T20:51:09.351112] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-24T20:51:09.351194] [INFO ] [MAIN ] Update Progress: 1738/2373 symbols completed. PSBD took 23.4s. Estimated remaining: 1h 24m 26s. Rate: 7.5 symbols/min [2025-09-24T20:51:09.519139] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:09.527774] [DEBUG] [LOCAL ] PSF: Loaded 6766 existing records from primary storage. [2025-09-24T20:51:09.527883] [INFO ] [MAIN ] PSF: Loaded 6766 existing records. [2025-09-24T20:51:09.624174] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-24T20:51:09.710128] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:09.710407] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-24T20:51:09.710461] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-24T20:51:09.710824] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-24T20:51:09.710885] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-24T20:51:10.071055] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:10.285517] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T20:51:10.416050] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-24T20:51:11.216080] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-24T20:51:11.615278] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T20:51:11.628429] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-24T20:51:11.629268] [INFO ] [REMOTE ] PRVS: Full fetch complete (1266 records). [2025-09-24T20:51:11.629380] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-24T20:51:11.814707] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-24T20:51:11.815084] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:51:11.815156] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:51:11.815229] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-24T20:51:11.815294] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-24T20:51:11.815332] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-24T20:51:11.815372] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-24T20:51:11.815433] [INFO ] [MAIN ] Update Progress: 1739/2373 symbols completed. PRVS took 32.4s. Estimated remaining: 1h 24m 16s. Rate: 7.5 symbols/min [2025-09-24T20:51:11.993875] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:12.019242] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-24T20:51:12.034020] [DEBUG] [LOCAL ] PSFE: Loaded 30507 existing records from primary storage. [2025-09-24T20:51:12.034151] [INFO ] [MAIN ] PSFE: Loaded 30507 existing records. [2025-09-24T20:51:12.240168] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T20:51:12.246985] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:12.255758] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-24T20:51:12.256227] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-24T20:51:12.257374] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-24T20:51:12.257478] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-24T20:51:12.658006] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:12.816122] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-24T20:51:12.831950] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T20:51:13.616087] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-24T20:51:14.076684] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T20:51:14.419362] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-24T20:51:15.216165] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-24T20:51:16.021196] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-24T20:51:16.033198] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-24T20:51:16.041697] [INFO ] [REMOTE ] PSA: Full fetch complete (59110 records). [2025-09-24T20:51:16.041866] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-24T20:51:16.436942] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-24T20:51:16.437033] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-24T20:51:16.438096] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-24T20:51:16.438227] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-24T20:51:16.439532] [DEBUG] [LOCAL ] PSA: Trimmed 59110 records to 41843 (keeping 200 days of data) [2025-09-24T20:51:16.722488] [DEBUG] [LOCAL ] PSA: Primary data saved (41843 records). [2025-09-24T20:51:16.722625] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-24T20:51:16.722759] [INFO ] [MAIN ] Update Progress: 1740/2373 symbols completed. PSA took 33.8s. Estimated remaining: 1h 24m 7s. Rate: 7.5 symbols/min [2025-09-24T20:51:16.856469] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T20:51:16.919063] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-24T20:51:16.922050] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:16.983401] [DEBUG] [LOCAL ] PSN: Loaded 46265 existing records from primary storage. [2025-09-24T20:51:16.984263] [INFO ] [MAIN ] PSN: Loaded 46265 existing records. [2025-09-24T20:51:16.984953] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-24T20:51:17.171177] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:17.171415] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-24T20:51:17.171464] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-24T20:51:17.172935] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-24T20:51:17.172997] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-24T20:51:17.539121] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:17.616158] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-24T20:51:17.632199] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T20:51:17.822102] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-24T20:51:18.416207] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-24T20:51:19.013756] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T20:51:19.022339] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T20:51:19.216139] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-24T20:51:20.016129] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-24T20:51:20.654805] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T20:51:20.816049] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-24T20:51:20.849238] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T20:51:21.616150] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-24T20:51:22.421229] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-24T20:51:22.444335] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T20:51:22.587259] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T20:51:23.216115] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-24T20:51:24.001006] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T20:51:24.016033] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-24T20:51:24.263878] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T20:51:24.277256] [INFO ] [REMOTE ] PRU: Full fetch complete (74281 records). [2025-09-24T20:51:24.277452] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-24T20:51:24.680382] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T20:51:24.737310] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-24T20:51:24.737448] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-24T20:51:24.738924] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-24T20:51:24.739003] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-24T20:51:24.740873] [DEBUG] [LOCAL ] PRU: Trimmed 74281 records to 51465 (keeping 200 days of data) [2025-09-24T20:51:24.842110] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-24T20:51:25.108491] [DEBUG] [LOCAL ] PRU: Primary data saved (51465 records). [2025-09-24T20:51:25.108670] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-24T20:51:25.108797] [INFO ] [MAIN ] Update Progress: 1741/2373 symbols completed. PRU took 46.4s. Estimated remaining: 1h 23m 59s. Rate: 7.5 symbols/min [2025-09-24T20:51:25.297524] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:25.339334] [DEBUG] [LOCAL ] PSO: Loaded 37473 existing records from primary storage. [2025-09-24T20:51:25.339520] [INFO ] [MAIN ] PSO: Loaded 37473 existing records. [2025-09-24T20:51:25.521247] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:25.521543] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-24T20:51:25.521592] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-24T20:51:25.522798] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-24T20:51:25.522861] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-24T20:51:25.626480] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-24T20:51:25.890624] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:26.416047] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-24T20:51:26.448961] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T20:51:26.620238] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T20:51:27.216135] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-24T20:51:27.672316] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T20:51:27.702370] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T20:51:28.016128] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-24T20:51:28.816116] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-24T20:51:29.499781] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T20:51:29.616145] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-24T20:51:29.960355] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T20:51:30.416145] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-24T20:51:31.216145] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-24T20:51:31.367911] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T20:51:31.946706] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T20:51:32.016263] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-24T20:51:32.491185] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-24T20:51:32.494669] [INFO ] [REMOTE ] PSF: Full fetch complete (9626 records). [2025-09-24T20:51:32.494810] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-24T20:51:32.792440] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T20:51:32.821217] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-24T20:51:32.919577] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-24T20:51:32.919685] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-24T20:51:32.919937] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-24T20:51:32.919978] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-24T20:51:32.920437] [DEBUG] [LOCAL ] PSF: Trimmed 9626 records to 6776 (keeping 200 days of data) [2025-09-24T20:51:32.962354] [DEBUG] [LOCAL ] PSF: Primary data saved (6776 records). [2025-09-24T20:51:32.962495] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-24T20:51:32.962584] [INFO ] [MAIN ] Update Progress: 1742/2373 symbols completed. PSF took 23.6s. Estimated remaining: 1h 23m 51s. Rate: 7.5 symbols/min [2025-09-24T20:51:33.132907] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:33.168319] [DEBUG] [LOCAL ] PSQH: Loaded 34606 existing records from primary storage. [2025-09-24T20:51:33.168454] [INFO ] [MAIN ] PSQH: Loaded 34606 existing records. [2025-09-24T20:51:33.345285] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:33.345573] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-24T20:51:33.345628] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-24T20:51:33.350050] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-24T20:51:33.350117] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-24T20:51:33.622177] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-24T20:51:33.707557] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:34.253750] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T20:51:34.416130] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-24T20:51:35.216104] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-24T20:51:35.284439] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T20:51:35.474454] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T20:51:36.016145] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-24T20:51:36.816118] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-24T20:51:37.105263] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T20:51:37.166710] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T20:51:37.616110] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-24T20:51:38.416094] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-24T20:51:38.484451] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T20:51:39.216119] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-24T20:51:39.455672] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T20:51:40.016150] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-24T20:51:40.113661] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T20:51:40.801761] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T20:51:40.816037] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-24T20:51:41.616140] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-24T20:51:41.844332] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T20:51:42.037095] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T20:51:42.041537] [INFO ] [REMOTE ] PSFE: Full fetch complete (43198 records). [2025-09-24T20:51:42.041623] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-24T20:51:42.416809] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-24T20:51:42.416564] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-24T20:51:42.417705] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-24T20:51:42.418450] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-24T20:51:42.418609] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-24T20:51:42.419614] [DEBUG] [LOCAL ] PSFE: Trimmed 43198 records to 30406 (keeping 200 days of data) [2025-09-24T20:51:42.593794] [DEBUG] [LOCAL ] PSFE: Primary data saved (30406 records). [2025-09-24T20:51:42.593928] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-24T20:51:42.594012] [INFO ] [MAIN ] Update Progress: 1743/2373 symbols completed. PSFE took 30.8s. Estimated remaining: 1h 23m 44s. Rate: 7.5 symbols/min [2025-09-24T20:51:42.767477] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:42.836879] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:51:42.837917] [DEBUG] [LOCAL ] PSTG: Loaded 52848 existing records from primary storage. [2025-09-24T20:51:42.845682] [INFO ] [MAIN ] PSTG: Loaded 52848 existing records. [2025-09-24T20:51:43.026374] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:43.026617] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-24T20:51:43.026695] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-24T20:51:43.027914] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-24T20:51:43.027977] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-24T20:51:43.226493] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-24T20:51:43.388402] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:44.016157] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-24T20:51:44.110082] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T20:51:44.816077] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-24T20:51:45.009073] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T20:51:45.616065] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-24T20:51:45.794929] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T20:51:46.001265] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T20:51:46.416095] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-24T20:51:47.216148] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-24T20:51:47.363719] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T20:51:47.611967] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T20:51:48.016145] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-24T20:51:48.695492] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T20:51:48.816116] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-24T20:51:49.616074] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-24T20:51:49.667080] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T20:51:50.292025] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T20:51:50.416143] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-24T20:51:50.577367] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T20:51:50.583969] [INFO ] [REMOTE ] PSO: Full fetch complete (51782 records). [2025-09-24T20:51:50.584151] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-24T20:51:50.999531] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-24T20:51:50.999616] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-24T20:51:51.000527] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-24T20:51:51.000585] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-24T20:51:51.001719] [DEBUG] [LOCAL ] PSO: Trimmed 51782 records to 37363 (keeping 200 days of data) [2025-09-24T20:51:51.216746] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-24T20:51:51.233361] [DEBUG] [LOCAL ] PSO: Primary data saved (37363 records). [2025-09-24T20:51:51.233670] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-24T20:51:51.233792] [INFO ] [MAIN ] Update Progress: 1744/2373 symbols completed. PSO took 26.1s. Estimated remaining: 1h 23m 36s. Rate: 7.5 symbols/min [2025-09-24T20:51:51.402994] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:51.424078] [DEBUG] [LOCAL ] PSTL: Loaded 20441 existing records from primary storage. [2025-09-24T20:51:51.424234] [INFO ] [MAIN ] PSTL: Loaded 20441 existing records. [2025-09-24T20:51:51.604507] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:51.605097] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-24T20:51:51.605189] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-24T20:51:51.605891] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-24T20:51:51.605955] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-24T20:51:52.024133] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-24T20:51:52.030730] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:52.065065] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T20:51:52.512190] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T20:51:52.816223] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-24T20:51:53.616172] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-24T20:51:53.677355] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T20:51:54.284875] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T20:51:54.416036] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-24T20:51:55.018384] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T20:51:55.026613] [INFO ] [REMOTE ] PSN: Full fetch complete (66774 records). [2025-09-24T20:51:55.026813] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-24T20:51:55.224939] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-24T20:51:55.426788] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-24T20:51:55.426868] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-24T20:51:55.427977] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-24T20:51:55.428042] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-24T20:51:55.429414] [DEBUG] [LOCAL ] PSN: Trimmed 66774 records to 46194 (keeping 200 days of data) [2025-09-24T20:51:55.704371] [DEBUG] [LOCAL ] PSN: Primary data saved (46194 records). [2025-09-24T20:51:55.704500] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-24T20:51:55.704613] [INFO ] [MAIN ] Update Progress: 1745/2373 symbols completed. PSN took 39.0s. Estimated remaining: 1h 23m 27s. Rate: 7.5 symbols/min [2025-09-24T20:51:55.872272] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:51:55.933046] [DEBUG] [LOCAL ] PSX: Loaded 53130 existing records from primary storage. [2025-09-24T20:51:55.933190] [INFO ] [MAIN ] PSX: Loaded 53130 existing records. [2025-09-24T20:51:56.017147] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-24T20:51:56.127318] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:51:56.127635] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-24T20:51:56.127736] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-24T20:51:56.129060] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-24T20:51:56.129125] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-24T20:51:56.381809] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T20:51:56.527095] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:51:56.558870] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-24T20:51:56.816124] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-24T20:51:57.165979] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T20:51:57.616120] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-24T20:51:58.416085] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-24T20:51:58.487724] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T20:51:58.747082] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T20:51:59.216145] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-24T20:52:00.016176] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-24T20:52:00.362560] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T20:52:00.816153] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-24T20:52:00.855734] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T20:52:00.863412] [INFO ] [REMOTE ] PSQH: Full fetch complete (53863 records). [2025-09-24T20:52:00.863571] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-24T20:52:01.278299] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-24T20:52:01.278396] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-24T20:52:01.279419] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-24T20:52:01.279490] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-24T20:52:01.280870] [DEBUG] [LOCAL ] PSQH: Trimmed 53863 records to 34746 (keeping 200 days of data) [2025-09-24T20:52:01.487314] [DEBUG] [LOCAL ] PSQH: Primary data saved (34746 records). [2025-09-24T20:52:01.487488] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-24T20:52:01.487579] [INFO ] [MAIN ] Update Progress: 1746/2373 symbols completed. PSQH took 28.5s. Estimated remaining: 1h 23m 18s. Rate: 7.5 symbols/min [2025-09-24T20:52:01.617350] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-24T20:52:01.663260] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:01.680930] [DEBUG] [LOCAL ] PTA: Loaded 14961 existing records from primary storage. [2025-09-24T20:52:01.681081] [INFO ] [MAIN ] PTA: Loaded 14961 existing records. [2025-09-24T20:52:01.870690] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:01.871167] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-24T20:52:01.871396] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-24T20:52:01.883264] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-24T20:52:01.903235] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-24T20:52:01.977097] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T20:52:02.305941] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:02.416222] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-24T20:52:02.773142] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:52:02.780107] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T20:52:03.216128] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-24T20:52:03.657964] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T20:52:04.016160] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-24T20:52:04.816207] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-24T20:52:05.021489] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T20:52:05.559633] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T20:52:05.616036] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-24T20:52:06.032018] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T20:52:06.416187] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-24T20:52:07.216090] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-24T20:52:07.359328] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-24T20:52:07.406757] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T20:52:08.016099] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-24T20:52:08.306330] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T20:52:08.816093] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-24T20:52:09.616156] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-24T20:52:10.007587] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T20:52:10.035733] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T20:52:10.416170] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-24T20:52:11.216097] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-24T20:52:11.396783] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T20:52:12.016093] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-24T20:52:12.419290] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T20:52:12.478555] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T20:52:12.771954] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T20:52:12.816070] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-24T20:52:13.616095] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-24T20:52:13.817933] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T20:52:14.420957] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-24T20:52:14.814247] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T20:52:15.216158] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-24T20:52:16.016168] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-24T20:52:16.207114] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T20:52:16.431298] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:52:16.816082] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-24T20:52:17.009093] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T20:52:17.616100] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-24T20:52:18.416081] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-24T20:52:18.744252] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-24T20:52:18.755039] [INFO ] [REMOTE ] PSTG: Full fetch complete (76544 records). [2025-09-24T20:52:18.755324] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-24T20:52:19.237287] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-24T20:52:19.268547] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-24T20:52:19.268979] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-24T20:52:19.270926] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-24T20:52:19.271390] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-24T20:52:19.273860] [DEBUG] [LOCAL ] PSTG: Trimmed 76544 records to 52847 (keeping 200 days of data) [2025-09-24T20:52:19.407849] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T20:52:19.438863] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T20:52:19.703908] [DEBUG] [LOCAL ] PSTG: Primary data saved (52847 records). [2025-09-24T20:52:19.704268] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-24T20:52:19.704629] [INFO ] [MAIN ] Update Progress: 1747/2373 symbols completed. PSTG took 37.1s. Estimated remaining: 1h 23m 14s. Rate: 7.5 symbols/min [2025-09-24T20:52:19.889412] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:19.943603] [DEBUG] [LOCAL ] PTY: Loaded 37388 existing records from primary storage. [2025-09-24T20:52:19.943889] [INFO ] [MAIN ] PTY: Loaded 37388 existing records. [2025-09-24T20:52:20.022048] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-24T20:52:20.140861] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:20.141277] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-24T20:52:20.141390] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-24T20:52:20.142432] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-24T20:52:20.142506] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-24T20:52:20.492338] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-24T20:52:20.578521] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:20.816183] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-24T20:52:21.021037] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T20:52:21.616098] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-24T20:52:22.387998] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T20:52:22.404745] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T20:52:22.416029] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-24T20:52:23.216158] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-24T20:52:23.606231] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T20:52:24.016109] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-24T20:52:24.816221] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-24T20:52:24.951093] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T20:52:24.956725] [INFO ] [REMOTE ] PTA: Full fetch complete (23472 records). [2025-09-24T20:52:24.956950] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-24T20:52:25.578275] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-24T20:52:25.578502] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-24T20:52:25.579531] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-24T20:52:25.579768] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-24T20:52:25.581255] [DEBUG] [LOCAL ] PTA: Trimmed 23472 records to 15059 (keeping 200 days of data) [2025-09-24T20:52:25.661137] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-24T20:52:25.702869] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-24T20:52:25.750278] [DEBUG] [LOCAL ] PTA: Primary data saved (15059 records). [2025-09-24T20:52:25.750681] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-24T20:52:25.750892] [INFO ] [MAIN ] Update Progress: 1748/2373 symbols completed. PTA took 24.3s. Estimated remaining: 1h 23m 5s. Rate: 7.5 symbols/min [2025-09-24T20:52:25.934080] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:25.970275] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T20:52:26.031355] [DEBUG] [LOCAL ] PUK: Loaded 44922 existing records from primary storage. [2025-09-24T20:52:26.031513] [INFO ] [MAIN ] PUK: Loaded 44922 existing records. [2025-09-24T20:52:26.218107] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:26.218385] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-24T20:52:26.218435] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-24T20:52:26.219517] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-24T20:52:26.219591] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-24T20:52:26.424606] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-24T20:52:26.606550] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:26.791462] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T20:52:27.216251] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-24T20:52:27.837607] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T20:52:28.016138] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-24T20:52:28.816081] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-24T20:52:28.922629] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T20:52:29.104038] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T20:52:29.108137] [INFO ] [REMOTE ] PSTL: Full fetch complete (29660 records). [2025-09-24T20:52:29.108264] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-24T20:52:29.496706] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-24T20:52:29.496847] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-24T20:52:29.497587] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-24T20:52:29.497674] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-24T20:52:29.500509] [DEBUG] [LOCAL ] PSTL: Trimmed 29660 records to 20371 (keeping 200 days of data) [2025-09-24T20:52:29.618796] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-24T20:52:29.645706] [DEBUG] [LOCAL ] PSTL: Primary data saved (20371 records). [2025-09-24T20:52:29.645838] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-24T20:52:29.645952] [INFO ] [MAIN ] Update Progress: 1749/2373 symbols completed. PSTL took 38.4s. Estimated remaining: 1h 22m 56s. Rate: 7.5 symbols/min [2025-09-24T20:52:29.841275] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:29.907332] [DEBUG] [LOCAL ] PUMP: Loaded 49448 existing records from primary storage. [2025-09-24T20:52:29.907596] [INFO ] [MAIN ] PUMP: Loaded 49448 existing records. [2025-09-24T20:52:30.115757] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:30.116122] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-24T20:52:30.116182] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-24T20:52:30.117262] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-24T20:52:30.117328] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-24T20:52:30.425901] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-24T20:52:30.524549] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:30.610420] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T20:52:31.216070] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-24T20:52:31.292121] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T20:52:32.016195] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-24T20:52:32.395293] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T20:52:32.441874] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T20:52:32.816105] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-24T20:52:33.616129] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-24T20:52:33.735576] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T20:52:34.321365] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T20:52:34.332124] [INFO ] [REMOTE ] PSX: Full fetch complete (77045 records). [2025-09-24T20:52:34.332310] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-24T20:52:34.421385] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-24T20:52:34.754761] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-24T20:52:34.754850] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-24T20:52:34.755999] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-24T20:52:34.756164] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-24T20:52:34.757812] [DEBUG] [LOCAL ] PSX: Trimmed 77045 records to 53132 (keeping 200 days of data) [2025-09-24T20:52:35.022965] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T20:52:35.147478] [DEBUG] [LOCAL ] PSX: Primary data saved (53132 records). [2025-09-24T20:52:35.147621] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-24T20:52:35.147802] [INFO ] [MAIN ] Update Progress: 1750/2373 symbols completed. PSX took 39.4s. Estimated remaining: 1h 22m 47s. Rate: 7.5 symbols/min [2025-09-24T20:52:35.222748] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-24T20:52:35.321538] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:35.377893] [DEBUG] [LOCAL ] PVH: Loaded 50472 existing records from primary storage. [2025-09-24T20:52:35.378041] [INFO ] [MAIN ] PVH: Loaded 50472 existing records. [2025-09-24T20:52:35.555557] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:35.555837] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-24T20:52:35.555899] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-24T20:52:35.557251] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-24T20:52:35.557324] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-24T20:52:35.923810] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:36.016173] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-24T20:52:36.093368] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T20:52:36.816178] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-24T20:52:36.935376] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T20:52:37.576890] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:52:37.616115] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-24T20:52:38.282345] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T20:52:38.416106] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-24T20:52:39.058941] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T20:52:39.216093] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-24T20:52:39.976528] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T20:52:40.016032] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-24T20:52:40.816080] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-24T20:52:40.973366] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T20:52:41.507867] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T20:52:41.517167] [INFO ] [REMOTE ] PTY: Full fetch complete (53796 records). [2025-09-24T20:52:41.517330] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-24T20:52:41.622056] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-24T20:52:41.906604] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-24T20:52:41.906732] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-24T20:52:41.907685] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-24T20:52:41.907770] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-24T20:52:41.909106] [DEBUG] [LOCAL ] PTY: Trimmed 53796 records to 37399 (keeping 200 days of data) [2025-09-24T20:52:42.153365] [DEBUG] [LOCAL ] PTY: Primary data saved (37399 records). [2025-09-24T20:52:42.154267] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-24T20:52:42.154384] [INFO ] [MAIN ] Update Progress: 1751/2373 symbols completed. PTY took 22.4s. Estimated remaining: 1h 22m 38s. Rate: 7.5 symbols/min [2025-09-24T20:52:42.330792] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:42.363607] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T20:52:42.363854] [DEBUG] [LOCAL ] PVL: Loaded 4739 existing records from primary storage. [2025-09-24T20:52:42.373308] [INFO ] [MAIN ] PVL: Loaded 4739 existing records. [2025-09-24T20:52:42.416922] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-24T20:52:42.557895] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:42.558189] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-24T20:52:42.558241] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-24T20:52:42.558967] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-24T20:52:42.559031] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-24T20:52:42.923728] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:43.216079] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-24T20:52:43.273967] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T20:52:43.977184] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T20:52:44.016035] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-24T20:52:44.819237] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-24T20:52:44.824125] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T20:52:45.616078] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-24T20:52:45.713439] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T20:52:45.744262] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T20:52:46.416111] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-24T20:52:47.216085] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-24T20:52:47.496418] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T20:52:48.016083] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-24T20:52:48.135499] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T20:52:48.816202] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-24T20:52:48.977312] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T20:52:49.555546] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T20:52:49.616093] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-24T20:52:50.128834] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T20:52:50.329590] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T20:52:50.416147] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-24T20:52:51.216156] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-24T20:52:52.016153] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-24T20:52:52.292997] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T20:52:52.680041] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T20:52:52.740184] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T20:52:52.816125] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-24T20:52:53.616139] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-24T20:52:54.416157] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-24T20:52:54.597306] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T20:52:55.216103] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-24T20:52:55.564571] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T20:52:55.813007] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T20:52:55.820952] [INFO ] [REMOTE ] PUK: Full fetch complete (65100 records). [2025-09-24T20:52:55.821095] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-24T20:52:55.908389] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T20:52:56.022144] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-24T20:52:56.220022] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-24T20:52:56.220102] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-24T20:52:56.221114] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-24T20:52:56.221177] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-24T20:52:56.222533] [DEBUG] [LOCAL ] PUK: Trimmed 65100 records to 44895 (keeping 200 days of data) [2025-09-24T20:52:56.500613] [DEBUG] [LOCAL ] PUK: Primary data saved (44895 records). [2025-09-24T20:52:56.500771] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-24T20:52:56.500874] [INFO ] [MAIN ] Update Progress: 1752/2373 symbols completed. PUK took 30.7s. Estimated remaining: 1h 22m 33s. Rate: 7.5 symbols/min [2025-09-24T20:52:56.682019] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:52:56.729363] [DEBUG] [LOCAL ] PWR: Loaded 47387 existing records from primary storage. [2025-09-24T20:52:56.729504] [INFO ] [MAIN ] PWR: Loaded 47387 existing records. [2025-09-24T20:52:56.819045] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-24T20:52:56.847340] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T20:52:56.917710] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:52:56.918076] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-24T20:52:56.918126] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-24T20:52:56.919263] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-24T20:52:56.919324] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-24T20:52:57.288491] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:52:57.616161] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-24T20:52:58.282476] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T20:52:58.416070] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-24T20:52:58.465898] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T20:52:59.216110] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-24T20:52:59.269577] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T20:53:00.016188] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-24T20:53:00.816102] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-24T20:53:01.164053] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T20:53:01.417001] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T20:53:01.616177] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-24T20:53:02.061679] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T20:53:02.177041] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T20:53:02.416159] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-24T20:53:03.216143] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-24T20:53:03.958974] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T20:53:03.960496] [INFO ] [REMOTE ] PVL: Full fetch complete (7572 records). [2025-09-24T20:53:03.960567] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-24T20:53:04.022981] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-24T20:53:04.337584] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-24T20:53:04.337873] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-24T20:53:04.338167] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-24T20:53:04.338379] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-24T20:53:04.339005] [DEBUG] [LOCAL ] PVL: Trimmed 7572 records to 4745 (keeping 200 days of data) [2025-09-24T20:53:04.369167] [DEBUG] [LOCAL ] PVL: Primary data saved (4745 records). [2025-09-24T20:53:04.369343] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-24T20:53:04.369576] [INFO ] [MAIN ] Update Progress: 1753/2373 symbols completed. PVL took 22.2s. Estimated remaining: 1h 22m 25s. Rate: 7.5 symbols/min [2025-09-24T20:53:04.513598] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T20:53:04.681110] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:04.681325] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-09-24T20:53:04.681381] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-09-24T20:53:04.681526] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-24T20:53:04.681569] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-24T20:53:04.681611] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-09-24T20:53:04.681673] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-24T20:53:04.831350] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-24T20:53:05.071669] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:05.616162] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-24T20:53:05.941604] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T20:53:06.416095] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-24T20:53:06.714994] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T20:53:07.169742] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T20:53:07.216031] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-24T20:53:07.788464] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T20:53:08.016138] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-24T20:53:08.229505] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T20:53:08.816135] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-24T20:53:09.616216] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-24T20:53:09.772052] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T20:53:10.037638] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T20:53:10.416121] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-24T20:53:11.216108] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-24T20:53:11.303708] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T20:53:11.317067] [INFO ] [REMOTE ] PUMP: Full fetch complete (71730 records). [2025-09-24T20:53:11.317278] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-24T20:53:11.733220] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-24T20:53:11.733313] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-24T20:53:11.734404] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-24T20:53:11.734470] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-24T20:53:11.735968] [DEBUG] [LOCAL ] PUMP: Trimmed 71730 records to 49434 (keeping 200 days of data) [2025-09-24T20:53:12.023212] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-24T20:53:12.040992] [DEBUG] [LOCAL ] PUMP: Primary data saved (49434 records). [2025-09-24T20:53:12.041135] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-24T20:53:12.041223] [INFO ] [MAIN ] Update Progress: 1754/2373 symbols completed. PUMP took 42.4s. Estimated remaining: 1h 22m 17s. Rate: 7.5 symbols/min [2025-09-24T20:53:12.212569] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:12.212838] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-24T20:53:12.212991] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-24T20:53:12.213144] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-24T20:53:12.213189] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-24T20:53:12.213235] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-24T20:53:12.213269] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-24T20:53:12.603659] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:12.637531] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-24T20:53:12.672366] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T20:53:12.681577] [INFO ] [REMOTE ] PVH: Full fetch complete (70745 records). [2025-09-24T20:53:12.681751] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-24T20:53:12.825057] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-24T20:53:13.079343] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-24T20:53:13.079425] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-24T20:53:13.080483] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-24T20:53:13.080549] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-24T20:53:13.082036] [DEBUG] [LOCAL ] PVH: Trimmed 70745 records to 50466 (keeping 200 days of data) [2025-09-24T20:53:13.404431] [DEBUG] [LOCAL ] PVH: Primary data saved (50466 records). [2025-09-24T20:53:13.404583] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-24T20:53:13.404697] [INFO ] [MAIN ] Update Progress: 1755/2373 symbols completed. PVH took 38.3s. Estimated remaining: 1h 22m 6s. Rate: 7.5 symbols/min [2025-09-24T20:53:13.581353] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:13.600373] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T20:53:13.620875] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-24T20:53:13.633878] [DEBUG] [LOCAL ] QD: Loaded 28013 existing records from primary storage. [2025-09-24T20:53:13.634077] [INFO ] [MAIN ] QD: Loaded 28013 existing records. [2025-09-24T20:53:13.814289] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:13.814558] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-24T20:53:13.814606] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-24T20:53:13.815304] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-24T20:53:13.815366] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-24T20:53:14.174483] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:14.416076] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-24T20:53:14.671690] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T20:53:15.203875] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T20:53:15.216077] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-24T20:53:16.016155] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-24T20:53:16.816040] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-24T20:53:16.987029] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T20:53:17.204627] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T20:53:17.271429] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-24T20:53:17.616077] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-24T20:53:17.828993] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T20:53:18.416131] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-24T20:53:18.849050] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T20:53:19.216149] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-24T20:53:19.912262] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T20:53:20.016108] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-24T20:53:20.813211] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T20:53:20.821243] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-24T20:53:21.616110] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-24T20:53:22.020922] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T20:53:22.416109] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-24T20:53:23.212270] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T20:53:23.221433] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-24T20:53:23.253844] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-24T20:53:23.657838] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T20:53:24.016165] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-24T20:53:24.816072] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-24T20:53:25.063045] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T20:53:25.158490] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T20:53:25.616117] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-24T20:53:26.416128] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-24T20:53:27.216090] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-24T20:53:27.280924] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:53:27.292311] [INFO ] [REMOTE ] PWR: Full fetch complete (69018 records). [2025-09-24T20:53:27.292485] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-24T20:53:27.666083] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-24T20:53:27.693350] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T20:53:27.762524] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-24T20:53:27.762322] [INFO ] [REMOTE ] PX: Full fetch complete (51183 records). [2025-09-24T20:53:27.762678] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-24T20:53:27.762768] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-24T20:53:27.763931] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-24T20:53:27.764057] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-24T20:53:27.866358] [DEBUG] [LOCAL ] PWR: Trimmed 69018 records to 47367 (keeping 200 days of data) [2025-09-24T20:53:28.032886] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-24T20:53:28.262361] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-24T20:53:28.262956] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-24T20:53:28.264296] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-24T20:53:28.264600] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-24T20:53:28.268008] [DEBUG] [LOCAL ] PX: Trimmed 51183 records to 34711 (keeping 200 days of data) [2025-09-24T20:53:28.611326] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-24T20:53:28.700356] [DEBUG] [LOCAL ] PWR: Primary data saved (47367 records). [2025-09-24T20:53:28.701021] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-24T20:53:28.701365] [INFO ] [MAIN ] Update Progress: 1756/2373 symbols completed. PWR took 32.2s. Estimated remaining: 1h 22m 1s. Rate: 7.5 symbols/min [2025-09-24T20:53:28.818307] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-24T20:53:28.882413] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:28.884289] [DEBUG] [LOCAL ] PX: Primary data saved (34711 records). [2025-09-24T20:53:28.884578] [INFO ] [MAIN ] PX: Full history saved. [2025-09-24T20:53:28.884829] [INFO ] [MAIN ] Update Progress: 1757/2373 symbols completed. PX took 24.5s. Estimated remaining: 1h 21m 50s. Rate: 7.5 symbols/min [2025-09-24T20:53:28.929857] [DEBUG] [LOCAL ] QGEN: Loaded 49152 existing records from primary storage. [2025-09-24T20:53:28.930006] [INFO ] [MAIN ] QGEN: Loaded 49152 existing records. [2025-09-24T20:53:29.109552] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:29.109843] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-24T20:53:29.109901] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-24T20:53:29.111054] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-24T20:53:29.111117] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-24T20:53:29.465580] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:29.616043] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-24T20:53:30.481039] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:53:30.487672] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-24T20:53:30.791550] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-24T20:53:31.216141] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-24T20:53:31.301710] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T20:53:31.898144] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T20:53:32.016088] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-24T20:53:32.816107] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-24T20:53:33.153707] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T20:53:33.616134] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-24T20:53:34.024572] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-24T20:53:34.416095] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-24T20:53:34.445903] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T20:53:34.688707] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T20:53:35.216154] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-24T20:53:36.016192] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-24T20:53:36.726498] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T20:53:36.816094] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-24T20:53:37.248560] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-24T20:53:37.280124] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T20:53:37.616104] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-24T20:53:38.416100] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-24T20:53:38.694252] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T20:53:39.216079] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-24T20:53:39.609965] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T20:53:39.615340] [INFO ] [REMOTE ] QD: Full fetch complete (40777 records). [2025-09-24T20:53:39.615445] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-24T20:53:40.011986] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-24T20:53:40.012185] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-24T20:53:40.013214] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-24T20:53:40.013295] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-24T20:53:40.014382] [DEBUG] [LOCAL ] QD: Trimmed 40777 records to 28012 (keeping 200 days of data) [2025-09-24T20:53:40.138023] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-24T20:53:40.151964] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-24T20:53:40.222489] [DEBUG] [LOCAL ] QD: Primary data saved (28012 records). [2025-09-24T20:53:40.222682] [INFO ] [MAIN ] QD: Full history saved. [2025-09-24T20:53:40.222848] [INFO ] [MAIN ] Update Progress: 1758/2373 symbols completed. QD took 26.8s. Estimated remaining: 1h 21m 43s. Rate: 7.5 symbols/min [2025-09-24T20:53:40.920362] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T20:53:40.930903] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-24T20:53:42.532424] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T20:53:42.543602] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-24T20:53:43.048217] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-24T20:53:43.060281] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-24T20:53:44.368488] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T20:53:44.378635] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-24T20:53:45.778831] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-24T20:53:45.790754] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-24T20:53:46.196318] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T20:53:46.207835] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-24T20:53:46.602416] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T20:53:46.611669] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-24T20:53:46.611845] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-24T20:53:46.612769] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:53:46.612867] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:53:46.612911] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:53:46.612981] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-24T20:53:46.613048] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-24T20:53:46.613087] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-24T20:53:46.613163] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-24T20:53:46.613248] [INFO ] [MAIN ] Update Progress: 1759/2373 symbols completed. QBTS took 34.6s. Estimated remaining: 1h 21m 35s. Rate: 7.5 symbols/min [2025-09-24T20:53:47.650603] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:53:47.661158] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-24T20:53:49.376254] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T20:53:49.384819] [INFO ] [REMOTE ] QGEN: Full fetch complete (69973 records). [2025-09-24T20:53:49.384982] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-24T20:53:49.772953] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-24T20:53:49.773038] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-24T20:53:49.774094] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-24T20:53:49.774160] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-24T20:53:49.775638] [DEBUG] [LOCAL ] QGEN: Trimmed 69973 records to 49151 (keeping 200 days of data) [2025-09-24T20:53:50.078448] [DEBUG] [LOCAL ] QGEN: Primary data saved (49151 records). [2025-09-24T20:53:50.078597] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-24T20:53:50.078718] [INFO ] [MAIN ] Update Progress: 1760/2373 symbols completed. QGEN took 21.4s. Estimated remaining: 1h 21m 25s. Rate: 7.5 symbols/min [2025-09-24T20:53:50.609687] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:50.706629] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:50.759525] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:50.813550] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:53:50.843284] [DEBUG] [LOCAL ] QUAD: Loaded 23844 existing records from primary storage. [2025-09-24T20:53:50.851997] [INFO ] [MAIN ] QUAD: Loaded 23844 existing records. [2025-09-24T20:53:51.037436] [DEBUG] [LOCAL ] QTWO: Loaded 39083 existing records from primary storage. [2025-09-24T20:53:51.037827] [INFO ] [MAIN ] QTWO: Loaded 39083 existing records. [2025-09-24T20:53:51.039266] [DEBUG] [LOCAL ] QSR: Loaded 52407 existing records from primary storage. [2025-09-24T20:53:51.079187] [INFO ] [MAIN ] QSR: Loaded 52407 existing records. [2025-09-24T20:53:51.280871] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-24T20:53:51.295961] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:51.340858] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-24T20:53:51.393547] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-24T20:53:51.393727] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-24T20:53:51.498310] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-24T20:53:51.571083] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-24T20:53:51.615730] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:51.667592] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:51.719602] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-24T20:53:51.713563] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-24T20:53:51.755593] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-24T20:53:51.755516] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-24T20:53:51.799929] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-24T20:53:51.834535] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-24T20:53:51.834443] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-24T20:53:51.854449] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:53:51.870772] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-24T20:53:51.947185] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-24T20:53:51.973188] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-24T20:53:52.128870] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-24T20:53:52.206391] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-24T20:53:52.924026] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:52.993157] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-24T20:53:53.241596] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:53.263229] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-24T20:53:53.312158] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:53.369103] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-24T20:53:53.368837] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:53:53.370261] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-24T20:53:54.475440] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T20:53:54.482137] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-24T20:53:55.107326] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T20:53:55.116487] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-24T20:53:55.228994] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T20:53:55.233772] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-24T20:53:55.286577] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T20:53:55.297361] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-24T20:53:55.731425] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-24T20:53:55.743340] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-24T20:53:56.459691] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T20:53:56.465326] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-24T20:53:56.612006] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T20:53:56.620909] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-24T20:53:56.691357] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T20:53:56.701982] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-24T20:53:57.703468] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T20:53:57.710138] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-24T20:53:57.877174] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-24T20:53:57.887727] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-24T20:53:58.340129] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T20:53:58.348628] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-24T20:53:58.578514] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-24T20:53:58.589618] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-24T20:53:58.629417] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T20:53:59.216128] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-24T20:53:59.742481] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T20:53:59.942617] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T20:54:00.016031] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-24T20:54:00.190099] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-24T20:54:00.612639] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T20:54:00.816118] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-24T20:54:01.616143] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-24T20:54:02.213387] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T20:54:02.402114] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T20:54:02.416026] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-24T20:54:03.216114] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-24T20:54:04.016115] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-24T20:54:05.030766] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-09-24T20:54:05.040170] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-24T20:54:05.276145] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-24T20:54:05.616070] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-24T20:54:05.694423] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-24T20:54:06.170962] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T20:54:06.352809] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-24T20:54:06.416030] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-24T20:54:06.742964] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T20:54:07.216100] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-24T20:54:08.004221] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T20:54:08.009628] [INFO ] [REMOTE ] QUAD: Full fetch complete (34850 records). [2025-09-24T20:54:08.009754] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-24T20:54:08.024568] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-24T20:54:08.400966] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-24T20:54:08.401082] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-24T20:54:08.401974] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-24T20:54:08.402064] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-24T20:54:08.403520] [DEBUG] [LOCAL ] QUAD: Trimmed 34850 records to 23702 (keeping 200 days of data) [2025-09-24T20:54:08.533942] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-24T20:54:08.614265] [DEBUG] [LOCAL ] QUAD: Primary data saved (23702 records). [2025-09-24T20:54:08.614403] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-24T20:54:08.614491] [INFO ] [MAIN ] Update Progress: 1761/2373 symbols completed. QUAD took 18.5s. Estimated remaining: 1h 21m 21s. Rate: 7.5 symbols/min [2025-09-24T20:54:08.786288] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:08.796078] [DEBUG] [LOCAL ] QVCC: Loaded 8951 existing records from primary storage. [2025-09-24T20:54:08.796170] [INFO ] [MAIN ] QVCC: Loaded 8951 existing records. [2025-09-24T20:54:08.826716] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-24T20:54:08.983896] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:08.984163] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-24T20:54:08.984220] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-24T20:54:08.984904] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-24T20:54:08.984967] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-24T20:54:09.381421] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:09.508800] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T20:54:09.616109] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-24T20:54:10.416151] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-24T20:54:11.041366] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:54:11.159544] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-24T20:54:11.216037] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-24T20:54:12.018203] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-24T20:54:12.172577] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T20:54:12.816123] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-24T20:54:13.616117] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-24T20:54:13.845602] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T20:54:14.416143] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-24T20:54:14.720267] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-24T20:54:15.216113] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-24T20:54:15.235707] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:54:15.814001] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-09-24T20:54:15.933945] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T20:54:16.016137] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-24T20:54:16.816119] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-24T20:54:17.616079] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-24T20:54:17.880239] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-24T20:54:17.955635] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T20:54:18.097900] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T20:54:18.416134] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-24T20:54:18.543529] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T20:54:18.552102] [INFO ] [REMOTE ] QTWO: Full fetch complete (57220 records). [2025-09-24T20:54:18.552232] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-24T20:54:18.958040] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-24T20:54:18.958132] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-24T20:54:18.959183] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-24T20:54:18.959249] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-24T20:54:18.960633] [DEBUG] [LOCAL ] QTWO: Trimmed 57220 records to 39066 (keeping 200 days of data) [2025-09-24T20:54:19.193284] [DEBUG] [LOCAL ] QTWO: Primary data saved (39066 records). [2025-09-24T20:54:19.193438] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-24T20:54:19.193544] [INFO ] [MAIN ] Update Progress: 1762/2373 symbols completed. QTWO took 29.1s. Estimated remaining: 1h 21m 14s. Rate: 7.5 symbols/min [2025-09-24T20:54:19.226470] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-24T20:54:19.379962] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:19.386874] [DEBUG] [LOCAL ] QVCD: Loaded 4486 existing records from primary storage. [2025-09-24T20:54:19.386994] [INFO ] [MAIN ] QVCD: Loaded 4486 existing records. [2025-09-24T20:54:19.575063] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:19.575369] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-24T20:54:19.575420] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-24T20:54:19.575816] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-24T20:54:19.575880] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-24T20:54:19.952895] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:20.016034] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-24T20:54:20.190429] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T20:54:20.199738] [INFO ] [REMOTE ] QSR: Full fetch complete (75808 records). [2025-09-24T20:54:20.199870] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-24T20:54:20.592820] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-24T20:54:20.592909] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-24T20:54:20.594000] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-24T20:54:20.594066] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-24T20:54:20.595506] [DEBUG] [LOCAL ] QSR: Trimmed 75808 records to 52405 (keeping 200 days of data) [2025-09-24T20:54:20.717111] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T20:54:20.817699] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-24T20:54:20.934143] [DEBUG] [LOCAL ] QSR: Primary data saved (52405 records). [2025-09-24T20:54:20.934293] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-24T20:54:20.934411] [INFO ] [MAIN ] Update Progress: 1763/2373 symbols completed. QSR took 30.9s. Estimated remaining: 1h 21m 4s. Rate: 7.5 symbols/min [2025-09-24T20:54:21.105464] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:21.163195] [DEBUG] [LOCAL ] QXO: Loaded 53175 existing records from primary storage. [2025-09-24T20:54:21.163347] [INFO ] [MAIN ] QXO: Loaded 53175 existing records. [2025-09-24T20:54:21.356029] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:21.356321] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-24T20:54:21.356372] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-24T20:54:21.358106] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-24T20:54:21.358178] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-24T20:54:21.622331] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-24T20:54:21.719112] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T20:54:21.754779] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:21.796804] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-24T20:54:22.294787] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T20:54:22.416128] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-24T20:54:23.072852] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T20:54:23.216101] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-24T20:54:24.016152] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-24T20:54:24.816114] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-24T20:54:25.616135] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-24T20:54:25.747243] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-24T20:54:26.058299] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T20:54:26.186436] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T20:54:26.416174] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-24T20:54:27.216120] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-24T20:54:27.314312] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-09-24T20:54:27.323585] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-24T20:54:27.323781] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-24T20:54:27.742875] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-24T20:54:27.742986] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-24T20:54:27.744351] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-24T20:54:27.744432] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-24T20:54:27.746290] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 53742 (keeping 200 days of data) [2025-09-24T20:54:27.988138] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T20:54:28.016896] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-24T20:54:28.167877] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-24T20:54:28.168161] [INFO ] [MAIN ] QS: Full history saved. [2025-09-24T20:54:28.168303] [INFO ] [MAIN ] Update Progress: 1764/2373 symbols completed. QS took 38.1s. Estimated remaining: 1h 20m 56s. Rate: 7.5 symbols/min [2025-09-24T20:54:28.466065] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:28.521823] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T20:54:28.578050] [DEBUG] [LOCAL ] R: Loaded 29518 existing records from primary storage. [2025-09-24T20:54:28.578286] [INFO ] [MAIN ] R: Loaded 29518 existing records. [2025-09-24T20:54:28.734112] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T20:54:28.823743] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-24T20:54:28.882168] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:28.882627] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-24T20:54:28.882774] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-24T20:54:28.884283] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-24T20:54:28.884387] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-24T20:54:29.331520] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:29.616109] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-24T20:54:29.731607] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T20:54:30.416165] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-24T20:54:31.153850] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T20:54:31.190966] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T20:54:31.216080] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-24T20:54:31.809276] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T20:54:32.016109] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-24T20:54:32.798579] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T20:54:32.800674] [INFO ] [REMOTE ] QVCC: Full fetch complete (11951 records). [2025-09-24T20:54:32.800775] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-24T20:54:32.821356] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-24T20:54:33.175544] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-24T20:54:33.175680] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-24T20:54:33.176093] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-24T20:54:33.176158] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-24T20:54:33.177365] [DEBUG] [LOCAL ] QVCC: Trimmed 11951 records to 8904 (keeping 200 days of data) [2025-09-24T20:54:33.253020] [DEBUG] [LOCAL ] QVCC: Primary data saved (8904 records). [2025-09-24T20:54:33.253624] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-24T20:54:33.254288] [INFO ] [MAIN ] Update Progress: 1765/2373 symbols completed. QVCC took 24.6s. Estimated remaining: 1h 20m 47s. Rate: 7.5 symbols/min [2025-09-24T20:54:33.446585] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:33.477134] [DEBUG] [LOCAL ] RA: Loaded 21578 existing records from primary storage. [2025-09-24T20:54:33.477370] [INFO ] [MAIN ] RA: Loaded 21578 existing records. [2025-09-24T20:54:33.625742] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-24T20:54:33.674077] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:33.674477] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-24T20:54:33.674530] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-24T20:54:33.675514] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-24T20:54:33.675579] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-24T20:54:34.072050] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:34.222786] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T20:54:34.348669] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-24T20:54:34.416275] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-24T20:54:35.216118] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-24T20:54:35.855584] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T20:54:36.016182] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-24T20:54:36.323725] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T20:54:36.816154] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-24T20:54:37.616151] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-24T20:54:37.803123] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:54:38.017535] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T20:54:38.270907] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T20:54:38.416120] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-24T20:54:39.216108] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-24T20:54:40.016082] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-24T20:54:40.280788] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T20:54:40.402528] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T20:54:40.652007] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T20:54:40.816120] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-24T20:54:41.616107] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-24T20:54:42.416072] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-24T20:54:42.484932] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T20:54:42.511194] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T20:54:43.216149] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-24T20:54:43.253072] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T20:54:44.016168] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-24T20:54:44.447307] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T20:54:44.816164] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-24T20:54:45.616079] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-24T20:54:45.928850] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T20:54:46.016293] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T20:54:46.143462] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T20:54:46.145410] [INFO ] [REMOTE ] QVCD: Full fetch complete (6126 records). [2025-09-24T20:54:46.145524] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-24T20:54:46.424505] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-24T20:54:46.557695] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-24T20:54:46.557790] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-24T20:54:46.558041] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-24T20:54:46.558134] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-24T20:54:46.558565] [DEBUG] [LOCAL ] QVCD: Trimmed 6126 records to 4480 (keeping 200 days of data) [2025-09-24T20:54:46.587629] [DEBUG] [LOCAL ] QVCD: Primary data saved (4480 records). [2025-09-24T20:54:46.587822] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-24T20:54:46.588051] [INFO ] [MAIN ] Update Progress: 1766/2373 symbols completed. QVCD took 27.4s. Estimated remaining: 1h 20m 41s. Rate: 7.5 symbols/min [2025-09-24T20:54:46.758529] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:46.811029] [DEBUG] [LOCAL ] RACE: Loaded 32926 existing records from primary storage. [2025-09-24T20:54:46.811195] [INFO ] [MAIN ] RACE: Loaded 32926 existing records. [2025-09-24T20:54:46.988128] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:46.988405] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-24T20:54:46.988462] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-24T20:54:46.989525] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-24T20:54:46.989597] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-24T20:54:47.223622] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-24T20:54:47.376558] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:48.021185] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-24T20:54:48.041850] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T20:54:48.816162] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-24T20:54:49.383132] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T20:54:49.394754] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-24T20:54:49.616106] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-24T20:54:49.944150] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T20:54:50.416144] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-24T20:54:50.830290] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T20:54:51.216111] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-24T20:54:52.016126] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-24T20:54:52.077769] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T20:54:52.503393] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-24T20:54:52.816147] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-24T20:54:52.851977] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T20:54:53.616087] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-24T20:54:54.416092] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-24T20:54:54.794067] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-24T20:54:55.216082] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-24T20:54:55.437563] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T20:54:55.737213] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T20:54:56.016158] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-24T20:54:56.816191] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-24T20:54:57.234157] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-24T20:54:57.270194] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-24T20:54:57.280549] [INFO ] [REMOTE ] QXO: Full fetch complete (75465 records). [2025-09-24T20:54:57.280725] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-24T20:54:57.621204] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-24T20:54:57.693400] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-24T20:54:57.693478] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-24T20:54:57.694606] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-24T20:54:57.694695] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-24T20:54:57.696874] [DEBUG] [LOCAL ] QXO: Trimmed 75465 records to 53184 (keeping 200 days of data) [2025-09-24T20:54:58.028261] [DEBUG] [LOCAL ] QXO: Primary data saved (53184 records). [2025-09-24T20:54:58.028419] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-24T20:54:58.028552] [INFO ] [MAIN ] Update Progress: 1767/2373 symbols completed. QXO took 37.1s. Estimated remaining: 1h 20m 34s. Rate: 7.5 symbols/min [2025-09-24T20:54:58.200818] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:58.239358] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T20:54:58.257956] [DEBUG] [LOCAL ] RAMP: Loaded 37720 existing records from primary storage. [2025-09-24T20:54:58.258091] [INFO ] [MAIN ] RAMP: Loaded 37720 existing records. [2025-09-24T20:54:58.432971] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-24T20:54:58.436179] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:58.438138] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-24T20:54:58.438233] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-24T20:54:58.446602] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-24T20:54:58.448359] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-24T20:54:58.493634] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T20:54:58.557554] [INFO ] [REMOTE ] RA: Full fetch complete (31834 records). [2025-09-24T20:54:58.557870] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-24T20:54:59.133295] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:54:59.221230] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-24T20:54:59.235186] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-24T20:54:59.235298] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-24T20:54:59.236108] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-24T20:54:59.236350] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-24T20:54:59.237550] [DEBUG] [LOCAL ] RA: Trimmed 31834 records to 21573 (keeping 200 days of data) [2025-09-24T20:54:59.393313] [DEBUG] [LOCAL ] RA: Primary data saved (21573 records). [2025-09-24T20:54:59.393474] [INFO ] [MAIN ] RA: Full history saved. [2025-09-24T20:54:59.393632] [INFO ] [MAIN ] Update Progress: 1768/2373 symbols completed. RA took 26.1s. Estimated remaining: 1h 20m 23s. Rate: 7.5 symbols/min [2025-09-24T20:54:59.567057] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:54:59.620380] [DEBUG] [LOCAL ] RBA: Loaded 45974 existing records from primary storage. [2025-09-24T20:54:59.620532] [INFO ] [MAIN ] RBA: Loaded 45974 existing records. [2025-09-24T20:54:59.820228] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:54:59.822984] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T20:54:59.829777] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-24T20:54:59.829859] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-24T20:54:59.831580] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-24T20:54:59.831698] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-24T20:55:00.017997] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-24T20:55:00.199600] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:00.816128] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-24T20:55:01.293930] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-24T20:55:01.557829] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T20:55:01.616115] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-24T20:55:02.195102] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T20:55:02.416116] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-24T20:55:03.061444] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T20:55:03.216137] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-24T20:55:03.956380] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T20:55:04.016034] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-24T20:55:04.513004] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T20:55:04.816105] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-24T20:55:05.089409] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T20:55:05.616110] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-24T20:55:05.973031] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:55:06.416148] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-24T20:55:07.216118] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-24T20:55:07.335537] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T20:55:07.403664] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-24T20:55:08.016140] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-24T20:55:08.449933] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T20:55:08.816116] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-24T20:55:09.616101] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-24T20:55:09.945406] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T20:55:10.311181] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T20:55:10.416117] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-24T20:55:10.824278] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T20:55:10.829111] [INFO ] [REMOTE ] R: Full fetch complete (41856 records). [2025-09-24T20:55:10.829273] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-24T20:55:11.218145] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-24T20:55:11.217818] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-24T20:55:11.219043] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-24T20:55:11.219966] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-24T20:55:11.220043] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-24T20:55:11.222231] [DEBUG] [LOCAL ] R: Trimmed 41856 records to 29357 (keeping 200 days of data) [2025-09-24T20:55:11.429102] [DEBUG] [LOCAL ] R: Primary data saved (29357 records). [2025-09-24T20:55:11.429264] [INFO ] [MAIN ] R: Full history saved. [2025-09-24T20:55:11.429371] [INFO ] [MAIN ] Update Progress: 1769/2373 symbols completed. R took 43.3s. Estimated remaining: 1h 20m 17s. Rate: 7.5 symbols/min [2025-09-24T20:55:11.602637] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:11.624382] [DEBUG] [LOCAL ] RBC: Loaded 15141 existing records from primary storage. [2025-09-24T20:55:11.624559] [INFO ] [MAIN ] RBC: Loaded 15141 existing records. [2025-09-24T20:55:11.809833] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:55:11.810142] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-24T20:55:11.810195] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-24T20:55:11.811314] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-24T20:55:11.811379] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-24T20:55:12.035192] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-24T20:55:12.206829] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:12.237603] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T20:55:12.816076] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-24T20:55:12.846958] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T20:55:13.514841] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T20:55:13.616112] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-24T20:55:14.416186] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-24T20:55:14.625868] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T20:55:14.691794] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T20:55:14.698169] [INFO ] [REMOTE ] RACE: Full fetch complete (47674 records). [2025-09-24T20:55:14.698280] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-24T20:55:15.087980] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-24T20:55:15.088069] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-24T20:55:15.088978] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-24T20:55:15.089042] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-24T20:55:15.090109] [DEBUG] [LOCAL ] RACE: Trimmed 47674 records to 32896 (keeping 200 days of data) [2025-09-24T20:55:15.220715] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-24T20:55:15.304148] [DEBUG] [LOCAL ] RACE: Primary data saved (32896 records). [2025-09-24T20:55:15.304303] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-24T20:55:15.304398] [INFO ] [MAIN ] Update Progress: 1770/2373 symbols completed. RACE took 28.7s. Estimated remaining: 1h 20m 8s. Rate: 7.5 symbols/min [2025-09-24T20:55:15.505323] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:15.563682] [DEBUG] [LOCAL ] RBLX: Loaded 53719 existing records from primary storage. [2025-09-24T20:55:15.563844] [INFO ] [MAIN ] RBLX: Loaded 53719 existing records. [2025-09-24T20:55:15.748872] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:55:15.749134] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-24T20:55:15.749188] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-24T20:55:15.750755] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-24T20:55:15.750819] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-24T20:55:16.016904] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-24T20:55:16.176805] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:16.179882] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T20:55:16.609741] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T20:55:16.816123] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-24T20:55:17.375917] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T20:55:17.616176] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-24T20:55:18.391148] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T20:55:18.416062] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-24T20:55:18.630257] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T20:55:19.216119] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-24T20:55:19.913390] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T20:55:20.016127] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-24T20:55:20.138714] [DEBUG] [REMOTE ] RBLX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-24T20:55:20.139053] [WARN ] [REMOTE ] RBLX: No data returned for month 2024-12 [2025-09-24T20:55:20.726610] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T20:55:20.816179] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-24T20:55:21.616121] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-24T20:55:22.416081] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-24T20:55:22.455842] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T20:55:23.046354] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T20:55:23.216102] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-24T20:55:24.016104] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-24T20:55:24.170092] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T20:55:24.704879] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-24T20:55:24.816174] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-24T20:55:25.616161] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-24T20:55:25.750285] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T20:55:25.855530] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-24T20:55:26.416128] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-24T20:55:27.216100] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-24T20:55:27.538817] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-24T20:55:27.801482] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-24T20:55:28.016102] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-24T20:55:28.682050] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T20:55:28.688942] [INFO ] [REMOTE ] RAMP: Full fetch complete (53172 records). [2025-09-24T20:55:28.689053] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-24T20:55:28.821193] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-24T20:55:29.093284] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-24T20:55:29.093384] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-24T20:55:29.094445] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-24T20:55:29.094513] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-24T20:55:29.095819] [DEBUG] [LOCAL ] RAMP: Trimmed 53172 records to 37712 (keeping 200 days of data) [2025-09-24T20:55:29.326105] [DEBUG] [LOCAL ] RAMP: Primary data saved (37712 records). [2025-09-24T20:55:29.326289] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-24T20:55:29.326422] [INFO ] [MAIN ] Update Progress: 1771/2373 symbols completed. RAMP took 31.3s. Estimated remaining: 1h 20m 2s. Rate: 7.5 symbols/min [2025-09-24T20:55:29.514057] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:29.521108] [DEBUG] [LOCAL ] RBOT: Loaded 5060 existing records from primary storage. [2025-09-24T20:55:29.521225] [INFO ] [MAIN ] RBOT: Loaded 5060 existing records. [2025-09-24T20:55:29.620271] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-24T20:55:29.715350] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:55:29.715827] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-24T20:55:29.715885] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-24T20:55:29.716165] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-24T20:55:29.716227] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-24T20:55:30.083273] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-24T20:55:30.127082] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:30.166660] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-24T20:55:30.416140] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-24T20:55:31.216089] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-24T20:55:31.297021] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T20:55:31.305371] [INFO ] [REMOTE ] RBA: Full fetch complete (65358 records). [2025-09-24T20:55:31.305518] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-24T20:55:31.695697] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-24T20:55:31.695829] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-24T20:55:31.696934] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-24T20:55:31.697001] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-24T20:55:31.698460] [DEBUG] [LOCAL ] RBA: Trimmed 65358 records to 45942 (keeping 200 days of data) [2025-09-24T20:55:31.997711] [DEBUG] [LOCAL ] RBA: Primary data saved (45942 records). [2025-09-24T20:55:31.997857] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-24T20:55:31.997964] [INFO ] [MAIN ] Update Progress: 1772/2373 symbols completed. RBA took 32.6s. Estimated remaining: 1h 19m 52s. Rate: 7.5 symbols/min [2025-09-24T20:55:32.029708] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-24T20:55:32.200347] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:32.202774] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T20:55:32.263490] [DEBUG] [LOCAL ] RBRK: Loaded 53115 existing records from primary storage. [2025-09-24T20:55:32.263668] [INFO ] [MAIN ] RBRK: Loaded 53115 existing records. [2025-09-24T20:55:32.449835] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:55:32.450121] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-24T20:55:32.450173] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-24T20:55:32.451801] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-24T20:55:32.451868] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-24T20:55:32.819486] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-24T20:55:32.823470] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:32.863682] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-24T20:55:32.934271] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T20:55:33.616128] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-24T20:55:33.854776] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T20:55:34.416092] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-24T20:55:35.216098] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-24T20:55:35.230502] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T20:55:36.016115] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-24T20:55:36.816082] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-24T20:55:37.063409] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-09-24T20:55:37.103507] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T20:55:37.250127] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T20:55:37.320245] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-24T20:55:37.616106] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-24T20:55:38.416103] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-24T20:55:39.216089] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-24T20:55:39.731968] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T20:55:39.735094] [INFO ] [REMOTE ] RBC: Full fetch complete (21916 records). [2025-09-24T20:55:39.735207] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-24T20:55:40.022124] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-24T20:55:40.179345] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-24T20:55:40.179490] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-24T20:55:40.179713] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-24T20:55:40.184087] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-24T20:55:40.190717] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-24T20:55:40.192880] [DEBUG] [LOCAL ] RBC: Trimmed 21916 records to 15155 (keeping 200 days of data) [2025-09-24T20:55:40.289597] [DEBUG] [LOCAL ] RBC: Primary data saved (15155 records). [2025-09-24T20:55:40.289797] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-24T20:55:40.289901] [INFO ] [MAIN ] Update Progress: 1773/2373 symbols completed. RBC took 28.9s. Estimated remaining: 1h 19m 44s. Rate: 7.5 symbols/min [2025-09-24T20:55:40.461942] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:40.516539] [DEBUG] [LOCAL ] RC: Loaded 48995 existing records from primary storage. [2025-09-24T20:55:40.516720] [INFO ] [MAIN ] RC: Loaded 48995 existing records. [2025-09-24T20:55:40.706596] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:55:40.706882] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-24T20:55:40.706934] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-24T20:55:40.708686] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-24T20:55:40.708751] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-24T20:55:40.817347] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-24T20:55:40.819476] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T20:55:41.093964] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:41.179039] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T20:55:41.616152] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-24T20:55:42.416133] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-24T20:55:43.109943] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T20:55:43.146910] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T20:55:43.216070] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-24T20:55:43.616479] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-24T20:55:44.016128] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-24T20:55:44.545611] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T20:55:44.641363] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T20:55:44.816108] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-24T20:55:45.360452] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-24T20:55:45.616111] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-24T20:55:46.378404] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T20:55:46.416070] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-24T20:55:47.216088] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-24T20:55:47.265855] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T20:55:48.016116] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-24T20:55:48.631218] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T20:55:48.633009] [INFO ] [REMOTE ] RBOT: Full fetch complete (8570 records). [2025-09-24T20:55:48.633086] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-24T20:55:48.829169] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-24T20:55:49.034366] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-24T20:55:49.034481] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-24T20:55:49.034917] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-24T20:55:49.035126] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-24T20:55:49.035753] [DEBUG] [LOCAL ] RBOT: Trimmed 8570 records to 5058 (keeping 200 days of data) [2025-09-24T20:55:49.064241] [DEBUG] [LOCAL ] RBOT: Primary data saved (5058 records). [2025-09-24T20:55:49.064331] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-24T20:55:49.064415] [INFO ] [MAIN ] Update Progress: 1774/2373 symbols completed. RBOT took 19.7s. Estimated remaining: 1h 19m 36s. Rate: 7.5 symbols/min [2025-09-24T20:55:49.246578] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:49.268976] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-24T20:55:49.271861] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-24T20:55:49.272128] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-24T20:55:49.272836] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-24T20:55:49.274015] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-24T20:55:49.273886] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T20:55:49.274194] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-24T20:55:49.625215] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-24T20:55:49.659849] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:50.416202] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-24T20:55:50.641430] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T20:55:51.216191] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-24T20:55:52.016147] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-24T20:55:52.320873] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-24T20:55:52.378916] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T20:55:52.552974] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-24T20:55:52.736265] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T20:55:52.816102] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-24T20:55:53.616106] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-24T20:55:54.416129] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-24T20:55:54.841813] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T20:55:55.216086] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-24T20:55:55.300458] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-24T20:55:55.312086] [INFO ] [REMOTE ] RBLX: Full fetch complete (70874 records). [2025-09-24T20:55:55.312259] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-24T20:55:55.513885] [WARN ] [VALIDATOR ] RBLX: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-24T20:55:55.514635] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:55:55.514739] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:55:55.514814] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-24T20:55:55.514886] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-09-24T20:55:55.514925] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-09-24T20:55:55.515404] [DEBUG] [LOCAL ] RBLX: Deleted derivative data file. [2025-09-24T20:55:55.515510] [INFO ] [MAIN ] Update Progress: 1775/2373 symbols completed. RBLX took 40.2s. Estimated remaining: 1h 19m 28s. Rate: 7.5 symbols/min [2025-09-24T20:55:55.698592] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:55:55.699451] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-24T20:55:55.699558] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-24T20:55:55.699871] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-24T20:55:55.699927] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-24T20:55:55.699973] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-24T20:55:55.700008] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-24T20:55:55.930707] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-24T20:55:55.979601] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T20:55:56.017846] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-24T20:55:56.144222] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:55:56.816171] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-24T20:55:57.616119] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-24T20:55:58.198376] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T20:55:58.204153] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-24T20:55:58.416152] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-24T20:55:58.581816] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T20:55:59.216164] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-24T20:56:00.016138] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-24T20:56:00.473355] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-24T20:56:00.636678] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T20:56:00.689951] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-24T20:56:00.816181] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-24T20:56:01.499670] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T20:56:01.616157] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-24T20:56:02.259993] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T20:56:02.416122] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-24T20:56:03.216119] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-24T20:56:03.792762] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T20:56:04.016078] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-24T20:56:04.188552] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T20:56:04.816105] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-24T20:56:04.944923] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T20:56:05.493942] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T20:56:05.616129] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-24T20:56:06.416121] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-24T20:56:07.216140] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-24T20:56:07.508293] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T20:56:07.718660] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T20:56:08.016152] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-24T20:56:08.299786] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-24T20:56:08.816116] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-24T20:56:09.616115] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-24T20:56:10.114783] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T20:56:10.116839] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T20:56:10.303894] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T20:56:10.416131] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-24T20:56:11.048284] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T20:56:11.216167] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-24T20:56:11.664042] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T20:56:12.016149] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-24T20:56:12.465068] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T20:56:12.816146] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-24T20:56:13.616111] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-24T20:56:14.068453] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T20:56:14.081015] [INFO ] [REMOTE ] RC: Full fetch complete (70823 records). [2025-09-24T20:56:14.081199] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-24T20:56:14.244423] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T20:56:14.255268] [INFO ] [REMOTE ] RCB: Full fetch complete (3746 records). [2025-09-24T20:56:14.267323] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-24T20:56:14.436924] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-24T20:56:14.784665] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T20:56:14.791388] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:56:14.807133] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:56:14.818310] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-24T20:56:14.882716] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-24T20:56:14.911982] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-24T20:56:14.912236] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-24T20:56:14.912326] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-24T20:56:14.914783] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-24T20:56:14.914926] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-24T20:56:14.915429] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-24T20:56:14.916476] [INFO ] [MAIN ] Update Progress: 1776/2373 symbols completed. RCB took 25.9s. Estimated remaining: 1h 19m 24s. Rate: 7.5 symbols/min [2025-09-24T20:56:14.949322] [DEBUG] [LOCAL ] RC: Trimmed 70823 records to 48997 (keeping 200 days of data) [2025-09-24T20:56:15.220621] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-24T20:56:15.292882] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:15.448061] [DEBUG] [LOCAL ] RCI: Loaded 48781 existing records from primary storage. [2025-09-24T20:56:15.474801] [INFO ] [MAIN ] RCI: Loaded 48781 existing records. [2025-09-24T20:56:15.677141] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:15.682794] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-24T20:56:15.685954] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-24T20:56:15.690620] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-24T20:56:15.690760] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-24T20:56:15.967577] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T20:56:16.034078] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-24T20:56:16.161059] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:16.165758] [DEBUG] [LOCAL ] RC: Primary data saved (48997 records). [2025-09-24T20:56:16.165839] [INFO ] [MAIN ] RC: Full history saved. [2025-09-24T20:56:16.165932] [INFO ] [MAIN ] Update Progress: 1777/2373 symbols completed. RC took 35.9s. Estimated remaining: 1h 19m 13s. Rate: 7.5 symbols/min [2025-09-24T20:56:16.334217] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:16.334407] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-24T20:56:16.334462] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-24T20:56:16.334607] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-24T20:56:16.334677] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-24T20:56:16.334785] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-24T20:56:16.334835] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-24T20:56:16.603512] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T20:56:16.715600] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:16.742849] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T20:56:16.752257] [INFO ] [REMOTE ] RBRK: Full fetch complete (76520 records). [2025-09-24T20:56:16.752403] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-24T20:56:16.821252] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-24T20:56:17.153778] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-24T20:56:17.153861] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-24T20:56:17.154966] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-24T20:56:17.155030] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-24T20:56:17.156724] [DEBUG] [LOCAL ] RBRK: Trimmed 76520 records to 53117 (keeping 200 days of data) [2025-09-24T20:56:17.469477] [DEBUG] [LOCAL ] RBRK: Primary data saved (53117 records). [2025-09-24T20:56:17.469621] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-24T20:56:17.469759] [INFO ] [MAIN ] Update Progress: 1778/2373 symbols completed. RBRK took 45.5s. Estimated remaining: 1h 19m 3s. Rate: 7.5 symbols/min [2025-09-24T20:56:17.644682] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:17.641020] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-24T20:56:17.658614] [DEBUG] [LOCAL ] RCS: Loaded 11498 existing records from primary storage. [2025-09-24T20:56:17.659103] [INFO ] [MAIN ] RCS: Loaded 11498 existing records. [2025-09-24T20:56:17.858487] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:17.858799] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-24T20:56:17.858857] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-24T20:56:17.859318] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-24T20:56:17.859378] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-24T20:56:18.217933] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:18.416052] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-24T20:56:18.636318] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T20:56:18.685084] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T20:56:19.216114] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-24T20:56:19.745959] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T20:56:20.016105] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-24T20:56:20.621972] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T20:56:20.816111] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-24T20:56:20.874896] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T20:56:21.616112] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-24T20:56:22.100145] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T20:56:22.416118] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-24T20:56:22.611467] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T20:56:23.216115] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-24T20:56:23.787047] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T20:56:24.016113] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-24T20:56:24.115399] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T20:56:24.816127] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-24T20:56:25.616118] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-24T20:56:26.109252] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-24T20:56:26.330128] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T20:56:26.331492] [INFO ] [REMOTE ] RCD: Full fetch complete (6827 records). [2025-09-24T20:56:26.331565] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-24T20:56:26.421271] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-24T20:56:26.521613] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-24T20:56:26.522065] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:56:26.522208] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:56:26.522487] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-24T20:56:26.522595] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-24T20:56:26.522755] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-24T20:56:26.522913] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-24T20:56:26.523077] [INFO ] [MAIN ] Update Progress: 1779/2373 symbols completed. RCD took 31.0s. Estimated remaining: 1h 18m 56s. Rate: 7.5 symbols/min [2025-09-24T20:56:26.708479] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:26.740307] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T20:56:26.788502] [DEBUG] [LOCAL ] RCUS: Loaded 42758 existing records from primary storage. [2025-09-24T20:56:26.788682] [INFO ] [MAIN ] RCUS: Loaded 42758 existing records. [2025-09-24T20:56:26.966398] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:26.966758] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-24T20:56:26.966818] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-24T20:56:26.967928] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-24T20:56:26.967991] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-24T20:56:27.221176] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-24T20:56:27.360131] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:27.354570] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-24T20:56:28.016148] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-24T20:56:28.816099] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-24T20:56:28.963933] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T20:56:28.987073] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T20:56:29.616106] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-24T20:56:30.308540] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T20:56:30.416058] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-24T20:56:30.472818] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T20:56:31.216161] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-24T20:56:31.884125] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T20:56:32.016080] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-24T20:56:32.816137] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-24T20:56:33.255221] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T20:56:33.501722] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T20:56:33.616086] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-24T20:56:34.198292] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T20:56:34.416081] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-24T20:56:34.559195] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T20:56:35.216099] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-24T20:56:36.013106] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T20:56:36.022007] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-24T20:56:36.288234] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T20:56:36.816102] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-24T20:56:37.616101] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-24T20:56:38.261275] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-24T20:56:38.416141] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-24T20:56:38.625465] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T20:56:38.909579] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T20:56:39.216147] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-24T20:56:40.016081] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-24T20:56:40.097612] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T20:56:40.578970] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T20:56:40.816101] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-24T20:56:41.478618] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T20:56:41.616150] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-24T20:56:42.416085] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-24T20:56:42.870203] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T20:56:43.192131] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T20:56:43.216077] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-24T20:56:43.260441] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:56:43.263191] [INFO ] [REMOTE ] RCS: Full fetch complete (19219 records). [2025-09-24T20:56:43.263267] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-24T20:56:43.663477] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-24T20:56:43.663581] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-24T20:56:43.664146] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-24T20:56:43.664214] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-24T20:56:43.665046] [DEBUG] [LOCAL ] RCS: Trimmed 19219 records to 11437 (keeping 200 days of data) [2025-09-24T20:56:43.739568] [DEBUG] [LOCAL ] RCS: Primary data saved (11437 records). [2025-09-24T20:56:43.739768] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-24T20:56:43.739928] [INFO ] [MAIN ] Update Progress: 1780/2373 symbols completed. RCS took 26.3s. Estimated remaining: 1h 18m 51s. Rate: 7.5 symbols/min [2025-09-24T20:56:43.927520] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:43.991943] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-24T20:56:43.992127] [INFO ] [MAIN ] RDDT: Loaded 53784 existing records. [2025-09-24T20:56:44.023916] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-24T20:56:44.177371] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:44.177680] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-24T20:56:44.177752] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-24T20:56:44.179301] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-24T20:56:44.179374] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-24T20:56:44.561791] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:44.797629] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T20:56:44.816057] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-24T20:56:45.616050] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-24T20:56:46.050574] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T20:56:46.416108] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-24T20:56:47.070951] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T20:56:47.216191] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-24T20:56:47.386976] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-24T20:56:48.022862] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-24T20:56:48.023755] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T20:56:48.816149] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-24T20:56:49.427857] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T20:56:49.616150] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-24T20:56:50.368452] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T20:56:50.378132] [INFO ] [REMOTE ] RCUS: Full fetch complete (60283 records). [2025-09-24T20:56:50.378272] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-24T20:56:50.419153] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-24T20:56:50.730315] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-24T20:56:50.868284] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-24T20:56:50.870565] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T20:56:50.870826] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-24T20:56:50.882901] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-24T20:56:50.883009] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-24T20:56:50.885391] [DEBUG] [LOCAL ] RCUS: Trimmed 60283 records to 42690 (keeping 200 days of data) [2025-09-24T20:56:51.135657] [DEBUG] [LOCAL ] RCUS: Primary data saved (42690 records). [2025-09-24T20:56:51.135805] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-24T20:56:51.135921] [INFO ] [MAIN ] Update Progress: 1781/2373 symbols completed. RCUS took 24.6s. Estimated remaining: 1h 18m 43s. Rate: 7.5 symbols/min [2025-09-24T20:56:51.221312] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-24T20:56:51.323708] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:51.369954] [DEBUG] [LOCAL ] RDN: Loaded 45255 existing records from primary storage. [2025-09-24T20:56:51.370137] [INFO ] [MAIN ] RDN: Loaded 45255 existing records. [2025-09-24T20:56:51.550455] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:51.550789] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-24T20:56:51.550868] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-24T20:56:51.552052] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-24T20:56:51.552113] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-24T20:56:51.967864] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:51.993947] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T20:56:52.004484] [INFO ] [REMOTE ] RCI: Full fetch complete (70536 records). [2025-09-24T20:56:52.004690] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-24T20:56:52.021335] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-24T20:56:52.414070] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-24T20:56:52.414164] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-24T20:56:52.415399] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-24T20:56:52.415477] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-24T20:56:52.419614] [DEBUG] [LOCAL ] RCI: Trimmed 70536 records to 48721 (keeping 200 days of data) [2025-09-24T20:56:52.743395] [DEBUG] [LOCAL ] RCI: Primary data saved (48721 records). [2025-09-24T20:56:52.743565] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-24T20:56:52.743721] [INFO ] [MAIN ] Update Progress: 1782/2373 symbols completed. RCI took 37.8s. Estimated remaining: 1h 18m 32s. Rate: 7.5 symbols/min [2025-09-24T20:56:52.819481] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-24T20:56:52.920124] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:52.972323] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T20:56:52.981769] [INFO ] [REMOTE ] RCL: Full fetch complete (75101 records). [2025-09-24T20:56:52.981996] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-24T20:56:52.982980] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T20:56:52.983092] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:56:52.983159] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:56:52.983285] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-24T20:56:52.983370] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-24T20:56:52.983449] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-24T20:56:52.983519] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-24T20:56:52.983589] [INFO ] [MAIN ] Update Progress: 1783/2373 symbols completed. RCL took 36.8s. Estimated remaining: 1h 18m 22s. Rate: 7.5 symbols/min [2025-09-24T20:56:53.126431] [DEBUG] [LOCAL ] RDW: Loaded 52003 existing records from primary storage. [2025-09-24T20:56:53.151281] [INFO ] [MAIN ] RDW: Loaded 52003 existing records. [2025-09-24T20:56:53.235110] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:56:53.375959] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:53.376320] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-24T20:56:53.376391] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-24T20:56:53.377616] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-24T20:56:53.377712] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-24T20:56:53.710993] [DEBUG] [LOCAL ] RDY: Loaded 46799 existing records from primary storage. [2025-09-24T20:56:53.714566] [INFO ] [MAIN ] RDY: Loaded 46799 existing records. [2025-09-24T20:56:53.919320] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:53.930639] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-24T20:56:54.010734] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:56:54.011231] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-24T20:56:54.011376] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-24T20:56:54.013096] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-24T20:56:54.013164] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-24T20:56:54.455101] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (3.23 seconds). [2025-09-24T20:56:54.459476] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:56:54.470288] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-24T20:56:55.216137] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-24T20:56:56.208739] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-24T20:56:56.218268] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-24T20:56:56.298184] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T20:56:56.449885] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-24T20:56:56.816127] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-24T20:56:57.616091] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-24T20:56:57.800529] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T20:56:57.974626] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-24T20:56:58.416078] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-24T20:56:58.545874] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:56:59.216144] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-24T20:56:59.371427] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T20:57:00.016077] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-24T20:57:00.119159] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T20:57:00.816105] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-24T20:57:01.378486] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-24T20:57:01.616132] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-24T20:57:01.730544] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T20:57:02.416159] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-24T20:57:03.216156] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-24T20:57:04.130195] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (3.31 seconds). [2025-09-24T20:57:04.142890] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-24T20:57:04.626166] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-24T20:57:04.816218] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-24T20:57:05.055938] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-24T20:57:05.616144] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-24T20:57:06.560199] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T20:57:06.575904] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-24T20:57:06.807041] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (3.59 seconds). [2025-09-24T20:57:07.216157] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-24T20:57:07.344421] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:57:07.437342] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-09-24T20:57:08.016079] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-24T20:57:08.286311] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T20:57:08.816071] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-24T20:57:09.241386] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T20:57:09.616111] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-24T20:57:09.777719] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T20:57:10.139943] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T20:57:10.416096] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-24T20:57:11.216139] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-24T20:57:11.567961] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T20:57:12.016152] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-24T20:57:12.816076] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-24T20:57:12.929245] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T20:57:13.088767] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-24T20:57:13.616094] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-24T20:57:14.134578] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T20:57:14.416110] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-24T20:57:14.462533] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-24T20:57:15.216124] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-24T20:57:15.338739] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T20:57:16.016135] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-24T20:57:16.320443] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T20:57:16.816095] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-24T20:57:17.616178] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-24T20:57:17.754943] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-24T20:57:17.924289] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T20:57:18.325855] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T20:57:18.341225] [INFO ] [REMOTE ] RDN: Full fetch complete (65822 records). [2025-09-24T20:57:18.341779] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-24T20:57:18.421242] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-24T20:57:18.787481] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-24T20:57:18.787575] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-24T20:57:18.788714] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-24T20:57:18.788797] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-24T20:57:18.790204] [DEBUG] [LOCAL ] RDN: Trimmed 65822 records to 45275 (keeping 200 days of data) [2025-09-24T20:57:19.082487] [DEBUG] [LOCAL ] RDN: Primary data saved (45275 records). [2025-09-24T20:57:19.082664] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-24T20:57:19.082820] [INFO ] [MAIN ] Update Progress: 1784/2373 symbols completed. RDN took 27.9s. Estimated remaining: 1h 18m 20s. Rate: 7.5 symbols/min [2025-09-24T20:57:19.227853] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-24T20:57:19.262363] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:19.314047] [DEBUG] [LOCAL ] RELX: Loaded 47846 existing records from primary storage. [2025-09-24T20:57:19.314202] [INFO ] [MAIN ] RELX: Loaded 47846 existing records. [2025-09-24T20:57:19.492340] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:19.492585] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-24T20:57:19.492664] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-24T20:57:19.493888] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-24T20:57:19.493960] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-24T20:57:19.863501] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:19.934262] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T20:57:19.941818] [INFO ] [REMOTE ] RDY: Full fetch complete (69050 records). [2025-09-24T20:57:19.941944] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-24T20:57:20.020717] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-24T20:57:20.366492] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-24T20:57:20.367105] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-24T20:57:20.368372] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-24T20:57:20.368461] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-24T20:57:20.370182] [DEBUG] [LOCAL ] RDY: Trimmed 69050 records to 46777 (keeping 200 days of data) [2025-09-24T20:57:20.506539] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-24T20:57:20.587723] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T20:57:20.771423] [DEBUG] [LOCAL ] RDY: Primary data saved (46777 records). [2025-09-24T20:57:20.771576] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-24T20:57:20.771740] [INFO ] [MAIN ] Update Progress: 1785/2373 symbols completed. RDY took 27.8s. Estimated remaining: 1h 18m 10s. Rate: 7.5 symbols/min [2025-09-24T20:57:20.828013] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-24T20:57:20.948566] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:20.989448] [DEBUG] [LOCAL ] RERE: Loaded 41049 existing records from primary storage. [2025-09-24T20:57:20.989602] [INFO ] [MAIN ] RERE: Loaded 41049 existing records. [2025-09-24T20:57:21.168239] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:21.168552] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-24T20:57:21.168600] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-24T20:57:21.169623] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-24T20:57:21.169727] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-24T20:57:21.545002] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:21.577222] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:57:21.616074] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-24T20:57:22.416119] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-24T20:57:22.831182] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T20:57:23.216074] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-24T20:57:23.248286] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-24T20:57:23.257889] [INFO ] [REMOTE ] RDW: Full fetch complete (74434 records). [2025-09-24T20:57:23.258024] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-24T20:57:23.674829] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-24T20:57:23.674961] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-24T20:57:23.676573] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-24T20:57:23.676674] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-24T20:57:23.678712] [DEBUG] [LOCAL ] RDW: Trimmed 74434 records to 52014 (keeping 200 days of data) [2025-09-24T20:57:24.018716] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-24T20:57:24.019990] [DEBUG] [LOCAL ] RDW: Primary data saved (52014 records). [2025-09-24T20:57:24.021524] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-24T20:57:24.021866] [INFO ] [MAIN ] Update Progress: 1786/2373 symbols completed. RDW took 31.3s. Estimated remaining: 1h 18m 0s. Rate: 7.5 symbols/min [2025-09-24T20:57:24.164797] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T20:57:24.256619] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:24.302044] [DEBUG] [LOCAL ] RES: Loaded 47526 existing records from primary storage. [2025-09-24T20:57:24.302198] [INFO ] [MAIN ] RES: Loaded 47526 existing records. [2025-09-24T20:57:24.485548] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:24.485882] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-24T20:57:24.485937] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-24T20:57:24.487124] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-24T20:57:24.487196] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-24T20:57:24.821302] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-24T20:57:24.861258] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:25.613630] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T20:57:25.624993] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-24T20:57:25.891982] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-24T20:57:26.198709] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T20:57:26.416165] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-24T20:57:26.879294] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T20:57:27.219502] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-24T20:57:27.854237] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T20:57:28.016093] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-24T20:57:28.816156] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-24T20:57:28.951250] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T20:57:29.495367] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T20:57:29.616102] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-24T20:57:30.416175] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-24T20:57:30.867416] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T20:57:31.216130] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-24T20:57:31.301933] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-24T20:57:31.316999] [INFO ] [REMOTE ] RDDT: Full fetch complete (77890 records). [2025-09-24T20:57:31.317202] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-24T20:57:31.738320] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-24T20:57:31.738485] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-24T20:57:31.740336] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-24T20:57:31.740424] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-24T20:57:31.742925] [DEBUG] [LOCAL ] RDDT: Trimmed 77890 records to 53784 (keeping 200 days of data) [2025-09-24T20:57:31.881020] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T20:57:32.031914] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-24T20:57:32.177851] [DEBUG] [LOCAL ] RDDT: Primary data saved (53784 records). [2025-09-24T20:57:32.178140] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-24T20:57:32.178314] [INFO ] [MAIN ] Update Progress: 1787/2373 symbols completed. RDDT took 48.4s. Estimated remaining: 1h 17m 52s. Rate: 7.5 symbols/min [2025-09-24T20:57:32.348426] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T20:57:32.390442] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:32.433843] [DEBUG] [LOCAL ] REVG: Loaded 41044 existing records from primary storage. [2025-09-24T20:57:32.434042] [INFO ] [MAIN ] REVG: Loaded 41044 existing records. [2025-09-24T20:57:32.618760] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:32.619044] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-24T20:57:32.619102] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-24T20:57:32.620076] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-24T20:57:32.620138] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-24T20:57:32.825288] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-24T20:57:32.976525] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:33.560989] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T20:57:33.616045] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-24T20:57:34.427277] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-24T20:57:34.434100] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T20:57:35.216119] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-24T20:57:35.243580] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T20:57:35.867228] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T20:57:36.016113] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-24T20:57:36.315261] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T20:57:36.816100] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-24T20:57:37.616077] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-24T20:57:37.778742] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T20:57:37.900440] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T20:57:38.416159] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-24T20:57:39.093822] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T20:57:39.216096] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-24T20:57:39.418123] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T20:57:40.016106] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-24T20:57:40.633821] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T20:57:40.816125] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-24T20:57:41.608994] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T20:57:41.617747] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-24T20:57:42.320700] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T20:57:42.416100] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-24T20:57:43.216070] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-24T20:57:43.444316] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T20:57:44.016122] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-24T20:57:44.111985] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T20:57:44.505842] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-24T20:57:44.816136] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-24T20:57:45.616095] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-24T20:57:45.773729] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T20:57:46.416138] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-24T20:57:46.462813] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T20:57:46.684409] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T20:57:47.216113] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-24T20:57:48.016166] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-24T20:57:48.150944] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T20:57:48.816115] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-24T20:57:49.153882] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T20:57:49.162464] [INFO ] [REMOTE ] RELX: Full fetch complete (67005 records). [2025-09-24T20:57:49.162578] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-24T20:57:49.577728] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-24T20:57:49.577829] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-24T20:57:49.579099] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-24T20:57:49.579167] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-24T20:57:49.580694] [DEBUG] [LOCAL ] RELX: Trimmed 67005 records to 47852 (keeping 200 days of data) [2025-09-24T20:57:49.636508] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-24T20:57:49.853890] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T20:57:49.946836] [DEBUG] [LOCAL ] RELX: Primary data saved (47852 records). [2025-09-24T20:57:49.947064] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-24T20:57:49.947237] [INFO ] [MAIN ] Update Progress: 1788/2373 symbols completed. RELX took 30.9s. Estimated remaining: 1h 17m 48s. Rate: 7.5 symbols/min [2025-09-24T20:57:50.238032] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:50.264375] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T20:57:50.278500] [INFO ] [REMOTE ] RERE: Full fetch complete (57482 records). [2025-09-24T20:57:50.278893] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-24T20:57:50.375434] [DEBUG] [LOCAL ] REX: Loaded 13957 existing records from primary storage. [2025-09-24T20:57:50.392419] [INFO ] [MAIN ] REX: Loaded 13957 existing records. [2025-09-24T20:57:50.426121] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-24T20:57:50.807613] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:50.824109] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-24T20:57:50.848802] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-24T20:57:50.905888] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-24T20:57:50.905985] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-24T20:57:50.907263] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-24T20:57:50.907589] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-24T20:57:50.907393] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-24T20:57:50.907760] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-24T20:57:51.010844] [DEBUG] [LOCAL ] RERE: Trimmed 57482 records to 41078 (keeping 200 days of data) [2025-09-24T20:57:51.404764] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:51.408597] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-24T20:57:51.412398] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T20:57:51.560237] [DEBUG] [LOCAL ] RERE: Primary data saved (41078 records). [2025-09-24T20:57:51.560383] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-24T20:57:51.560473] [INFO ] [MAIN ] Update Progress: 1789/2373 symbols completed. RERE took 30.8s. Estimated remaining: 1h 17m 38s. Rate: 7.5 symbols/min [2025-09-24T20:57:51.734608] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:51.785903] [DEBUG] [LOCAL ] REXR: Loaded 52083 existing records from primary storage. [2025-09-24T20:57:51.786186] [INFO ] [MAIN ] REXR: Loaded 52083 existing records. [2025-09-24T20:57:51.973372] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:51.973788] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-24T20:57:51.973860] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-24T20:57:51.983218] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-24T20:57:51.989459] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-24T20:57:52.027469] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-24T20:57:52.083333] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T20:57:52.381893] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:52.523227] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-24T20:57:52.816086] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-24T20:57:53.356584] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T20:57:53.616140] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-24T20:57:53.883845] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T20:57:54.416177] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-24T20:57:55.131268] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T20:57:55.216058] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-24T20:57:56.016182] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-24T20:57:56.185783] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T20:57:56.551344] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T20:57:56.563129] [INFO ] [REMOTE ] RES: Full fetch complete (68959 records). [2025-09-24T20:57:56.563362] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-24T20:57:56.821248] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-24T20:57:56.960401] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-24T20:57:56.960485] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-24T20:57:56.961544] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-24T20:57:56.961611] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-24T20:57:56.963057] [DEBUG] [LOCAL ] RES: Trimmed 68959 records to 47504 (keeping 200 days of data) [2025-09-24T20:57:57.241596] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-24T20:57:57.256836] [DEBUG] [LOCAL ] RES: Primary data saved (47504 records). [2025-09-24T20:57:57.256947] [INFO ] [MAIN ] RES: Full history saved. [2025-09-24T20:57:57.257049] [INFO ] [MAIN ] Update Progress: 1790/2373 symbols completed. RES took 33.2s. Estimated remaining: 1h 17m 29s. Rate: 7.5 symbols/min [2025-09-24T20:57:57.429604] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:57.474925] [DEBUG] [LOCAL ] REZI: Loaded 46870 existing records from primary storage. [2025-09-24T20:57:57.475070] [INFO ] [MAIN ] REZI: Loaded 46870 existing records. [2025-09-24T20:57:57.626545] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-24T20:57:57.659017] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:57.659345] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-24T20:57:57.659433] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-24T20:57:57.660441] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-24T20:57:57.660510] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-24T20:57:58.018221] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:57:58.416158] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-24T20:57:58.480188] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T20:57:58.488680] [INFO ] [REMOTE ] REVG: Full fetch complete (58424 records). [2025-09-24T20:57:58.488820] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-24T20:57:58.917134] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-24T20:57:58.917225] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-24T20:57:58.918233] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-24T20:57:58.918298] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-24T20:57:58.919594] [DEBUG] [LOCAL ] REVG: Trimmed 58424 records to 40955 (keeping 200 days of data) [2025-09-24T20:57:59.176677] [DEBUG] [LOCAL ] REVG: Primary data saved (40955 records). [2025-09-24T20:57:59.176827] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-24T20:57:59.176921] [INFO ] [MAIN ] Update Progress: 1791/2373 symbols completed. REVG took 27.0s. Estimated remaining: 1h 17m 19s. Rate: 7.5 symbols/min [2025-09-24T20:57:59.221265] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-24T20:57:59.357699] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:57:59.412409] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-24T20:57:59.412564] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-24T20:57:59.576184] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T20:57:59.620856] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:57:59.625840] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-24T20:57:59.625938] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-24T20:57:59.627295] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-24T20:57:59.627362] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-24T20:57:59.952249] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-24T20:58:00.026917] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-24T20:58:00.070117] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:00.816151] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-24T20:58:00.961790] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T20:58:01.466597] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T20:58:01.616147] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-24T20:58:02.416141] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-24T20:58:02.718824] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T20:58:03.028570] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T20:58:03.216074] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-24T20:58:04.016170] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-24T20:58:04.263280] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T20:58:04.690888] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T20:58:04.816151] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-24T20:58:05.616084] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-24T20:58:05.937661] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-24T20:58:06.416081] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-24T20:58:06.564734] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T20:58:06.659427] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T20:58:07.216154] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-24T20:58:07.739857] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T20:58:08.016079] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-24T20:58:08.095832] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T20:58:08.816125] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-24T20:58:09.616116] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-24T20:58:09.666560] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T20:58:09.965766] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T20:58:10.416110] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-24T20:58:11.144834] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T20:58:11.216145] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-24T20:58:12.016128] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-24T20:58:12.284279] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T20:58:12.816243] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-24T20:58:13.038134] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T20:58:13.388717] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T20:58:13.616159] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-24T20:58:14.416150] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-24T20:58:14.719862] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-24T20:58:15.144080] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T20:58:15.177596] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:58:15.216145] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-24T20:58:16.016119] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-24T20:58:16.789871] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T20:58:16.811172] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T20:58:16.816035] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-24T20:58:17.616167] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-24T20:58:18.416193] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-24T20:58:18.574473] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T20:58:19.161631] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T20:58:19.165331] [INFO ] [REMOTE ] REX: Full fetch complete (21052 records). [2025-09-24T20:58:19.165441] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-24T20:58:19.222426] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-24T20:58:19.582499] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-24T20:58:19.582616] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-24T20:58:19.583411] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-24T20:58:19.583494] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-24T20:58:19.584622] [DEBUG] [LOCAL ] REX: Trimmed 21052 records to 13981 (keeping 200 days of data) [2025-09-24T20:58:19.686002] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-24T20:58:19.724349] [DEBUG] [LOCAL ] REX: Primary data saved (13981 records). [2025-09-24T20:58:19.724533] [INFO ] [MAIN ] REX: Full history saved. [2025-09-24T20:58:19.724638] [INFO ] [MAIN ] Update Progress: 1792/2373 symbols completed. REX took 29.8s. Estimated remaining: 1h 17m 15s. Rate: 7.5 symbols/min [2025-09-24T20:58:19.900781] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:58:19.912792] [DEBUG] [LOCAL ] RFI: Loaded 10473 existing records from primary storage. [2025-09-24T20:58:19.912911] [INFO ] [MAIN ] RFI: Loaded 10473 existing records. [2025-09-24T20:58:20.021245] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-24T20:58:20.098113] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:58:20.098400] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-24T20:58:20.098458] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-24T20:58:20.098950] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-24T20:58:20.099014] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-24T20:58:20.454030] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:20.816108] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-24T20:58:20.950672] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T20:58:21.616090] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-24T20:58:21.791997] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T20:58:21.801360] [INFO ] [REMOTE ] REZI: Full fetch complete (65583 records). [2025-09-24T20:58:21.801542] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-24T20:58:22.237340] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-24T20:58:22.237589] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-24T20:58:22.238725] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-24T20:58:22.238802] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-24T20:58:22.240431] [DEBUG] [LOCAL ] REZI: Trimmed 65583 records to 46856 (keeping 200 days of data) [2025-09-24T20:58:22.429811] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-24T20:58:22.501910] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T20:58:22.584360] [DEBUG] [LOCAL ] REZI: Primary data saved (46856 records). [2025-09-24T20:58:22.584511] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-24T20:58:22.584620] [INFO ] [MAIN ] Update Progress: 1793/2373 symbols completed. REZI took 25.3s. Estimated remaining: 1h 17m 5s. Rate: 7.5 symbols/min [2025-09-24T20:58:22.755210] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:58:22.773503] [DEBUG] [LOCAL ] RFL: Loaded 10923 existing records from primary storage. [2025-09-24T20:58:22.773705] [INFO ] [MAIN ] RFL: Loaded 10923 existing records. [2025-09-24T20:58:22.954756] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:58:22.955026] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-24T20:58:22.955079] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-24T20:58:22.955589] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-24T20:58:22.955687] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-24T20:58:23.217863] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-24T20:58:23.337472] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:23.348524] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T20:58:23.384988] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T20:58:24.016151] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-24T20:58:24.590262] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T20:58:24.620756] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T20:58:24.629943] [INFO ] [REMOTE ] REXR: Full fetch complete (75108 records). [2025-09-24T20:58:24.630065] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-24T20:58:24.827757] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-24T20:58:25.029168] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-24T20:58:25.029267] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-24T20:58:25.030401] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-24T20:58:25.030538] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-24T20:58:25.032170] [DEBUG] [LOCAL ] REXR: Trimmed 75108 records to 52081 (keeping 200 days of data) [2025-09-24T20:58:25.362436] [DEBUG] [LOCAL ] REXR: Primary data saved (52081 records). [2025-09-24T20:58:25.362583] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-24T20:58:25.362694] [INFO ] [MAIN ] Update Progress: 1794/2373 symbols completed. REXR took 33.8s. Estimated remaining: 1h 16m 56s. Rate: 7.5 symbols/min [2025-09-24T20:58:25.534828] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:58:25.541448] [DEBUG] [LOCAL ] RFM: Loaded 4145 existing records from primary storage. [2025-09-24T20:58:25.541560] [INFO ] [MAIN ] RFM: Loaded 4145 existing records. [2025-09-24T20:58:25.621265] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-24T20:58:25.720799] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:58:25.721022] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-24T20:58:25.721075] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-24T20:58:25.721445] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-24T20:58:25.721505] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-24T20:58:26.088443] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:26.416071] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-24T20:58:26.536334] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T20:58:26.725367] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T20:58:26.846532] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T20:58:27.216091] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-24T20:58:28.016072] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-24T20:58:28.034737] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T20:58:28.816089] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-24T20:58:29.406314] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T20:58:29.616108] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-24T20:58:30.030824] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T20:58:30.248495] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T20:58:30.416105] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-24T20:58:31.216102] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-24T20:58:31.688579] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-24T20:58:32.016108] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-24T20:58:32.300789] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T20:58:32.816081] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-24T20:58:32.850450] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T20:58:33.616073] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-24T20:58:33.690277] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T20:58:34.339066] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T20:58:34.416050] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-24T20:58:35.216088] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-24T20:58:35.425945] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T20:58:36.016114] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-24T20:58:36.629553] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T20:58:36.816167] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-24T20:58:37.156799] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T20:58:37.168065] [INFO ] [REMOTE ] RF: Full fetch complete (77624 records). [2025-09-24T20:58:37.168300] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-24T20:58:37.581198] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-24T20:58:37.581319] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-24T20:58:37.582675] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-24T20:58:37.582747] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-24T20:58:37.584578] [DEBUG] [LOCAL ] RF: Trimmed 77624 records to 53630 (keeping 200 days of data) [2025-09-24T20:58:37.643720] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-24T20:58:37.702540] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T20:58:37.970604] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-24T20:58:37.970996] [INFO ] [MAIN ] RF: Full history saved. [2025-09-24T20:58:37.971134] [INFO ] [MAIN ] Update Progress: 1795/2373 symbols completed. RF took 38.8s. Estimated remaining: 1h 16m 49s. Rate: 7.5 symbols/min [2025-09-24T20:58:38.147918] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:58:38.159597] [DEBUG] [LOCAL ] RFMZ: Loaded 8678 existing records from primary storage. [2025-09-24T20:58:38.159775] [INFO ] [MAIN ] RFMZ: Loaded 8678 existing records. [2025-09-24T20:58:38.319291] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T20:58:38.353881] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:58:38.354152] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-24T20:58:38.354204] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-24T20:58:38.354554] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-24T20:58:38.354625] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-24T20:58:38.421293] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-24T20:58:38.782155] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:39.216116] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-24T20:58:39.658382] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T20:58:39.848929] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T20:58:40.016150] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-24T20:58:40.816125] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-24T20:58:40.826427] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:58:41.616135] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-24T20:58:41.742288] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-24T20:58:42.416160] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-24T20:58:42.432126] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T20:58:43.017426] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T20:58:43.216134] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-24T20:58:43.856003] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T20:58:44.016153] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-24T20:58:44.816102] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-24T20:58:44.886575] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T20:58:45.585715] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T20:58:45.616093] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-24T20:58:46.416078] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-24T20:58:46.573278] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T20:58:47.004445] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-24T20:58:47.216102] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-24T20:58:47.819927] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T20:58:48.016158] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-24T20:58:48.687904] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-24T20:58:48.816120] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-24T20:58:49.616102] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-24T20:58:49.661545] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T20:58:49.663871] [INFO ] [REMOTE ] RFI: Full fetch complete (15758 records). [2025-09-24T20:58:49.664022] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-24T20:58:50.038600] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-24T20:58:50.038717] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-24T20:58:50.039116] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-24T20:58:50.039203] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-24T20:58:50.039844] [DEBUG] [LOCAL ] RFI: Trimmed 15758 records to 10465 (keeping 200 days of data) [2025-09-24T20:58:50.113898] [DEBUG] [LOCAL ] RFI: Primary data saved (10465 records). [2025-09-24T20:58:50.114061] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-24T20:58:50.114230] [INFO ] [MAIN ] Update Progress: 1796/2373 symbols completed. RFI took 30.4s. Estimated remaining: 1h 16m 43s. Rate: 7.5 symbols/min [2025-09-24T20:58:50.273463] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T20:58:50.331984] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:58:50.378351] [DEBUG] [LOCAL ] RGA: Loaded 30163 existing records from primary storage. [2025-09-24T20:58:50.378537] [INFO ] [MAIN ] RGA: Loaded 30163 existing records. [2025-09-24T20:58:50.421319] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-24T20:58:50.576309] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:58:50.576614] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-24T20:58:50.576713] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-24T20:58:50.577623] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-24T20:58:50.577731] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-24T20:58:50.949359] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:58:50.984178] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-24T20:58:51.216173] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-24T20:58:52.016147] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-24T20:58:52.822441] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-24T20:58:52.825590] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T20:58:52.902982] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T20:58:53.616129] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-24T20:58:53.867593] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T20:58:53.872223] [INFO ] [REMOTE ] RFL: Full fetch complete (12792 records). [2025-09-24T20:58:53.872393] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-24T20:58:54.253896] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-24T20:58:54.253978] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-24T20:58:54.254309] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-24T20:58:54.254361] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-24T20:58:54.254923] [DEBUG] [LOCAL ] RFL: Trimmed 12792 records to 10943 (keeping 200 days of data) [2025-09-24T20:58:54.325481] [DEBUG] [LOCAL ] RFL: Primary data saved (10943 records). [2025-09-24T20:58:54.325623] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-24T20:58:54.325755] [INFO ] [MAIN ] Update Progress: 1797/2373 symbols completed. RFL took 31.7s. Estimated remaining: 1h 16m 33s. Rate: 7.5 symbols/min [2025-09-24T20:58:54.416047] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-24T20:58:55.051071] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T20:58:55.160691] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T20:58:55.216148] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-24T20:58:56.016130] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-24T20:58:56.694966] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T20:58:56.821230] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-24T20:58:56.833483] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T20:58:57.620306] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-24T20:58:57.622221] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T20:58:58.416113] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-24T20:58:59.135658] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T20:58:59.216081] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-24T20:58:59.289765] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T20:59:00.016122] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-24T20:59:00.678415] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T20:59:00.680255] [INFO ] [REMOTE ] RFM: Full fetch complete (5933 records). [2025-09-24T20:59:00.680357] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-24T20:59:00.831920] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-24T20:59:01.109846] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-24T20:59:01.111609] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T20:59:01.111881] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-24T20:59:01.119580] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-24T20:59:01.119883] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-24T20:59:01.120964] [DEBUG] [LOCAL ] RFM: Trimmed 5933 records to 4154 (keeping 200 days of data) [2025-09-24T20:59:01.150406] [DEBUG] [LOCAL ] RFM: Primary data saved (4154 records). [2025-09-24T20:59:01.150493] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-24T20:59:01.150627] [INFO ] [MAIN ] Update Progress: 1798/2373 symbols completed. RFM took 35.8s. Estimated remaining: 1h 16m 25s. Rate: 7.5 symbols/min [2025-09-24T20:59:01.516434] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T20:59:01.616130] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-24T20:59:02.416166] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-24T20:59:02.457800] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T20:59:02.460223] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12935 records). [2025-09-24T20:59:02.460303] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-24T20:59:02.841121] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-24T20:59:02.841241] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-24T20:59:02.841598] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-24T20:59:02.841682] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-24T20:59:02.842800] [DEBUG] [LOCAL ] RFMZ: Trimmed 12935 records to 8713 (keeping 200 days of data) [2025-09-24T20:59:02.904370] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8713 records). [2025-09-24T20:59:02.904526] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-24T20:59:02.904672] [INFO ] [MAIN ] Update Progress: 1799/2373 symbols completed. RFMZ took 24.9s. Estimated remaining: 1h 16m 15s. Rate: 7.5 symbols/min [2025-09-24T20:59:03.862884] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T20:59:03.870296] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-24T20:59:05.086858] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T20:59:05.092520] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-24T20:59:06.412453] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T20:59:06.419002] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-24T20:59:07.777924] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-24T20:59:07.785187] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-24T20:59:09.117807] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T20:59:09.123632] [INFO ] [REMOTE ] RGA: Full fetch complete (45632 records). [2025-09-24T20:59:09.123762] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-24T20:59:09.505593] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-24T20:59:09.505703] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-24T20:59:09.506612] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-24T20:59:09.506705] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-24T20:59:09.507792] [DEBUG] [LOCAL ] RGA: Trimmed 45632 records to 30123 (keeping 200 days of data) [2025-09-24T20:59:09.717094] [DEBUG] [LOCAL ] RGA: Primary data saved (30123 records). [2025-09-24T20:59:09.717301] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-24T20:59:09.717544] [INFO ] [MAIN ] Update Progress: 1800/2373 symbols completed. RGA took 19.6s. Estimated remaining: 1h 16m 7s. Rate: 7.5 symbols/min [2025-09-24T20:59:10.404019] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:10.452987] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:10.433742] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:10.453232] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-09-24T20:59:10.430860] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:10.453397] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-09-24T20:59:10.455296] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-24T20:59:10.455398] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-24T20:59:10.455482] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-09-24T20:59:10.455552] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-24T20:59:10.518906] [DEBUG] [LOCAL ] RGT: Loaded 2879 existing records from primary storage. [2025-09-24T20:59:10.539724] [INFO ] [MAIN ] RGT: Loaded 2879 existing records. [2025-09-24T20:59:11.042699] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:11.083460] [DEBUG] [LOCAL ] RHI: Loaded 49275 existing records from primary storage. [2025-09-24T20:59:11.084402] [INFO ] [MAIN ] RHI: Loaded 49275 existing records. [2025-09-24T20:59:11.081276] [DEBUG] [LOCAL ] RH: Loaded 47705 existing records from primary storage. [2025-09-24T20:59:11.071430] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-24T20:59:11.100678] [INFO ] [MAIN ] RH: Loaded 47705 existing records. [2025-09-24T20:59:11.100472] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-24T20:59:11.187035] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-24T20:59:11.235890] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-24T20:59:11.365399] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:11.387354] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-24T20:59:11.867945] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:11.956455] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-24T20:59:12.014093] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-24T20:59:12.059683] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-24T20:59:12.077069] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-24T20:59:12.077515] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:12.180999] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-24T20:59:12.210665] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-24T20:59:12.297302] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-24T20:59:12.327117] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-24T20:59:12.611463] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:12.625336] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-24T20:59:13.025758] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:13.047113] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-24T20:59:12.999257] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T20:59:13.058870] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-24T20:59:13.118794] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:13.119112] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-24T20:59:13.422939] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T20:59:13.424420] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-24T20:59:13.938388] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-24T20:59:13.939850] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-24T20:59:14.220344] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T20:59:14.224256] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-24T20:59:14.290264] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T20:59:14.292070] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-24T20:59:14.681910] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T20:59:14.691231] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-24T20:59:14.708817] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-24T20:59:14.710991] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-24T20:59:14.775603] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T20:59:15.216171] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-24T20:59:15.339422] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T20:59:15.670548] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T20:59:16.016095] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-24T20:59:16.372515] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T20:59:16.816125] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-24T20:59:16.915270] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T20:59:17.123198] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T20:59:17.616121] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-24T20:59:18.337700] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T20:59:18.416099] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-24T20:59:18.789255] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T20:59:19.216159] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-24T20:59:19.295045] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-24T20:59:19.837495] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T20:59:20.016114] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-24T20:59:20.816129] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-24T20:59:21.616124] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-24T20:59:21.804458] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T20:59:21.829633] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T20:59:22.416095] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-24T20:59:23.216195] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-24T20:59:23.278847] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T20:59:23.778143] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-24T20:59:24.016112] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-24T20:59:24.283222] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T20:59:24.816155] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-24T20:59:24.876281] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T20:59:25.616141] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-24T20:59:26.416132] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-24T20:59:26.696838] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T20:59:26.787418] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T20:59:27.015160] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T20:59:27.216098] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-24T20:59:28.016131] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-24T20:59:28.816163] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-24T20:59:29.369766] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T20:59:29.457520] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T20:59:29.616102] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-24T20:59:29.905621] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T20:59:30.416106] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-24T20:59:31.216099] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-24T20:59:31.420575] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T20:59:31.576724] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T20:59:31.581378] [INFO ] [REMOTE ] RGR: Full fetch complete (28599 records). [2025-09-24T20:59:31.581482] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-24T20:59:31.983486] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-24T20:59:31.983833] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-24T20:59:31.984486] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-24T20:59:31.984532] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-24T20:59:31.985340] [DEBUG] [LOCAL ] RGR: Trimmed 28599 records to 20396 (keeping 200 days of data) [2025-09-24T20:59:32.045523] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-24T20:59:32.122825] [DEBUG] [LOCAL ] RGR: Primary data saved (20396 records). [2025-09-24T20:59:32.122956] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-24T20:59:32.123054] [INFO ] [MAIN ] Update Progress: 1801/2373 symbols completed. RGR took 22.4s. Estimated remaining: 1h 16m 3s. Rate: 7.5 symbols/min [2025-09-24T20:59:32.303159] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:32.303371] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-24T20:59:32.303430] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-24T20:59:32.303613] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-24T20:59:32.303692] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-24T20:59:32.303789] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-24T20:59:32.303842] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-24T20:59:32.623031] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T20:59:32.717472] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:32.773501] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T20:59:32.816056] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-24T20:59:33.616123] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-24T20:59:34.188099] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T20:59:34.189264] [INFO ] [REMOTE ] RGT: Full fetch complete (4150 records). [2025-09-24T20:59:34.189337] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-24T20:59:34.424068] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-24T20:59:34.589430] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-24T20:59:34.589678] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-24T20:59:34.589878] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-24T20:59:34.589975] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-24T20:59:34.590618] [DEBUG] [LOCAL ] RGT: Trimmed 4150 records to 2858 (keeping 200 days of data) [2025-09-24T20:59:34.639862] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T20:59:34.654450] [DEBUG] [LOCAL ] RGT: Primary data saved (2858 records). [2025-09-24T20:59:34.654573] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-24T20:59:34.654723] [INFO ] [MAIN ] Update Progress: 1802/2373 symbols completed. RGT took 24.9s. Estimated remaining: 1h 15m 54s. Rate: 7.5 symbols/min [2025-09-24T20:59:34.841204] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:34.906985] [DEBUG] [LOCAL ] RHP: Loaded 41815 existing records from primary storage. [2025-09-24T20:59:34.907144] [INFO ] [MAIN ] RHP: Loaded 41815 existing records. [2025-09-24T20:59:35.098274] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:35.098559] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-24T20:59:35.098611] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-24T20:59:35.100085] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-24T20:59:35.100157] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-24T20:59:35.221310] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-24T20:59:35.487349] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:36.016088] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-24T20:59:36.432098] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-24T20:59:36.816109] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-24T20:59:37.148319] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T20:59:37.319113] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T20:59:37.616111] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-24T20:59:38.259067] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T20:59:38.416135] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-24T20:59:39.090878] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T20:59:39.216081] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-24T20:59:39.938354] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T20:59:39.946588] [INFO ] [REMOTE ] RH: Full fetch complete (65638 records). [2025-09-24T20:59:39.946754] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-24T20:59:40.022067] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-24T20:59:40.354928] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-24T20:59:40.355030] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-24T20:59:40.356172] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-24T20:59:40.356249] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-24T20:59:40.357915] [DEBUG] [LOCAL ] RH: Trimmed 65638 records to 47654 (keeping 200 days of data) [2025-09-24T20:59:40.665068] [DEBUG] [LOCAL ] RH: Primary data saved (47654 records). [2025-09-24T20:59:40.665196] [INFO ] [MAIN ] RH: Full history saved. [2025-09-24T20:59:40.665287] [INFO ] [MAIN ] Update Progress: 1803/2373 symbols completed. RH took 30.9s. Estimated remaining: 1h 15m 45s. Rate: 7.5 symbols/min [2025-09-24T20:59:40.823794] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-24T20:59:40.842093] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:40.895515] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-24T20:59:40.895713] [INFO ] [MAIN ] RIG: Loaded 53669 existing records. [2025-09-24T20:59:41.034064] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T20:59:41.087157] [INFO ] [REMOTE ] RHI: Full fetch complete (69720 records). [2025-09-24T20:59:41.104826] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-24T20:59:41.294538] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:59:41.315696] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:41.350468] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-24T20:59:41.365635] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-24T20:59:41.382551] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-24T20:59:41.405053] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-24T20:59:41.405180] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-24T20:59:41.622751] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-09-24T20:59:42.029351] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T20:59:42.033701] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-24T20:59:42.034501] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-09-24T20:59:42.040166] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-24T20:59:42.047005] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-24T20:59:42.053734] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-24T20:59:42.140872] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-24T20:59:42.139303] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:42.149778] [DEBUG] [LOCAL ] RHI: Trimmed 69720 records to 49256 (keeping 200 days of data) [2025-09-24T20:59:42.433795] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-24T20:59:42.471189] [DEBUG] [LOCAL ] RHI: Primary data saved (49256 records). [2025-09-24T20:59:42.471335] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-24T20:59:42.471463] [INFO ] [MAIN ] Update Progress: 1804/2373 symbols completed. RHI took 32.8s. Estimated remaining: 1h 15m 35s. Rate: 7.5 symbols/min [2025-09-24T20:59:42.646775] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:42.703772] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-24T20:59:42.703989] [INFO ] [MAIN ] RIO: Loaded 53394 existing records. [2025-09-24T20:59:42.886590] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:42.886884] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-24T20:59:42.886936] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-24T20:59:42.888531] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-24T20:59:42.888593] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-24T20:59:43.221415] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-24T20:59:43.288841] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:44.016228] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-24T20:59:44.245041] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T20:59:44.816176] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-24T20:59:45.227351] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T20:59:45.616141] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-02. [2025-09-24T20:59:46.060002] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-24T20:59:46.100709] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-24T20:59:46.416077] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-03. [2025-09-24T20:59:46.695686] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T20:59:47.216179] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-24T20:59:47.494791] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T20:59:48.016157] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-04. [2025-09-24T20:59:48.816074] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-24T20:59:48.852751] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T20:59:49.214453] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T20:59:49.616133] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-05. [2025-09-24T20:59:50.418284] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-24T20:59:50.419898] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T20:59:50.448587] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T20:59:51.216153] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-24T20:59:52.016141] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-24T20:59:52.551996] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-24T20:59:52.816143] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-06. [2025-09-24T20:59:53.178938] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-24T20:59:53.256391] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T20:59:53.616109] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-24T20:59:53.624335] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T20:59:54.416150] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-07. [2025-09-24T20:59:55.216098] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-24T20:59:55.275194] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T20:59:55.518428] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T20:59:56.016160] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-08. [2025-09-24T20:59:56.737009] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T20:59:56.816166] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-09. [2025-09-24T20:59:57.201348] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T20:59:57.342193] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T20:59:57.344605] [INFO ] [REMOTE ] RHLD: Full fetch complete (11497 records). [2025-09-24T20:59:57.344707] [DEBUG] [VALIDATOR ] RHLD: Validating primary data. [2025-09-24T20:59:57.542216] [WARN ] [VALIDATOR ] RHLD: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-24T20:59:57.542571] [FATAL] [MAIN ] RHLD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T20:59:57.542669] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T20:59:57.542737] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-24T20:59:57.542801] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-24T20:59:57.542855] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-24T20:59:57.542921] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-24T20:59:57.542989] [INFO ] [MAIN ] Update Progress: 1805/2373 symbols completed. RHLD took 25.4s. Estimated remaining: 1h 15m 29s. Rate: 7.5 symbols/min [2025-09-24T20:59:57.621317] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-24T20:59:57.719553] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T20:59:57.784764] [DEBUG] [LOCAL ] RITM: Loaded 52820 existing records from primary storage. [2025-09-24T20:59:57.784943] [INFO ] [MAIN ] RITM: Loaded 52820 existing records. [2025-09-24T20:59:57.961607] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T20:59:57.961888] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-24T20:59:57.961937] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-24T20:59:57.963377] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-24T20:59:57.963439] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-24T20:59:58.320516] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T20:59:58.416050] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-24T20:59:59.216105] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-24T20:59:59.754634] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-24T20:59:59.902154] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:00:00.016056] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-24T21:00:00.809240] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:00:00.817300] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-24T21:00:01.616095] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-24T21:00:02.033549] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-24T21:00:02.416159] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-24T21:00:03.216219] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-24T21:00:03.682809] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-24T21:00:04.016265] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-24T21:00:06.408536] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (3.19 seconds). [2025-09-24T21:00:06.417351] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-24T21:00:06.696185] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (5.08 seconds). [2025-09-24T21:00:06.709483] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-24T21:00:06.740690] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (4.32 seconds). [2025-09-24T21:00:06.752110] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-24T21:00:07.335822] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-24T21:00:07.347772] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-24T21:00:08.004182] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:00:08.011859] [INFO ] [REMOTE ] RHP: Full fetch complete (57931 records). [2025-09-24T21:00:08.012033] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-24T21:00:08.417116] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-24T21:00:08.417208] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-24T21:00:08.418445] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-24T21:00:08.418515] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-24T21:00:08.419926] [DEBUG] [LOCAL ] RHP: Trimmed 57931 records to 41735 (keeping 200 days of data) [2025-09-24T21:00:08.717057] [DEBUG] [LOCAL ] RHP: Primary data saved (41735 records). [2025-09-24T21:00:08.717270] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-24T21:00:08.717411] [INFO ] [MAIN ] Update Progress: 1806/2373 symbols completed. RHP took 34.1s. Estimated remaining: 1h 15m 23s. Rate: 7.5 symbols/min [2025-09-24T21:00:08.923044] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:08.964422] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T21:00:08.982106] [DEBUG] [LOCAL ] RIV: Loaded 11908 existing records from primary storage. [2025-09-24T21:00:08.982251] [INFO ] [MAIN ] RIV: Loaded 11908 existing records. [2025-09-24T21:00:08.981981] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-24T21:00:09.191360] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:09.192157] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-24T21:00:09.192325] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-24T21:00:09.203712] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-24T21:00:09.208915] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-24T21:00:09.320717] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-24T21:00:09.386760] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-24T21:00:09.630246] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:09.630730] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-24T21:00:09.667193] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-24T21:00:10.416123] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-24T21:00:10.707237] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T21:00:11.216087] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-24T21:00:11.330126] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T21:00:11.760811] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-24T21:00:11.986426] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T21:00:12.016047] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-24T21:00:12.158957] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T21:00:12.816115] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-24T21:00:13.616116] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-24T21:00:14.416216] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-24T21:00:14.605426] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-24T21:00:14.614762] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-24T21:00:14.614893] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-24T21:00:15.007566] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-24T21:00:15.007699] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-24T21:00:15.009022] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-24T21:00:15.009114] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-24T21:00:15.011021] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53669 (keeping 200 days of data) [2025-09-24T21:00:15.231986] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:00:15.236061] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-24T21:00:15.349131] [DEBUG] [LOCAL ] RIG: Primary data saved (53669 records). [2025-09-24T21:00:15.349291] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-24T21:00:15.349399] [INFO ] [MAIN ] Update Progress: 1807/2373 symbols completed. RIG took 34.7s. Estimated remaining: 1h 15m 14s. Rate: 7.5 symbols/min [2025-09-24T21:00:15.523084] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:15.570039] [DEBUG] [LOCAL ] RJF: Loaded 47092 existing records from primary storage. [2025-09-24T21:00:15.570186] [INFO ] [MAIN ] RJF: Loaded 47092 existing records. [2025-09-24T21:00:15.752613] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:15.752899] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-24T21:00:15.752948] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-24T21:00:15.754447] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-24T21:00:15.754509] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-24T21:00:16.105678] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-09-24T21:00:16.184859] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-24T21:00:16.184265] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:16.816097] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-24T21:00:17.193008] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-24T21:00:17.616073] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-24T21:00:18.035718] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T21:00:18.318036] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:00:18.416175] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-24T21:00:19.216126] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-24T21:00:19.566179] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (4.33 seconds). [2025-09-24T21:00:19.748860] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T21:00:19.892435] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-24T21:00:20.016121] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-24T21:00:20.816090] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-24T21:00:20.864603] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T21:00:21.236331] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T21:00:21.616110] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-24T21:00:22.318713] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T21:00:22.416076] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-24T21:00:22.595434] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T21:00:23.216099] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-24T21:00:23.972757] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T21:00:24.016050] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-24T21:00:24.079420] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T21:00:24.816100] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-24T21:00:25.616158] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-24T21:00:26.221716] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T21:00:26.416104] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-24T21:00:26.522731] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-24T21:00:27.216136] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-24T21:00:27.382095] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:00:27.779343] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-24T21:00:28.016174] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-24T21:00:28.816101] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-24T21:00:28.880408] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T21:00:29.222856] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T21:00:29.229111] [INFO ] [REMOTE ] RIV: Full fetch complete (17296 records). [2025-09-24T21:00:29.229216] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-24T21:00:29.621472] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-24T21:00:29.622197] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-24T21:00:29.622549] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-24T21:00:29.623800] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-24T21:00:29.623870] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-24T21:00:29.624968] [DEBUG] [LOCAL ] RIV: Trimmed 17296 records to 11965 (keeping 200 days of data) [2025-09-24T21:00:29.707343] [DEBUG] [LOCAL ] RIV: Primary data saved (11965 records). [2025-09-24T21:00:29.707505] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-24T21:00:29.707620] [INFO ] [MAIN ] Update Progress: 1808/2373 symbols completed. RIV took 21.0s. Estimated remaining: 1h 15m 8s. Rate: 7.5 symbols/min [2025-09-24T21:00:29.895801] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:29.954191] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-24T21:00:29.954344] [INFO ] [MAIN ] RKT: Loaded 53721 existing records. [2025-09-24T21:00:30.130886] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:30.131148] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-24T21:00:30.131200] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-24T21:00:30.133012] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-24T21:00:30.133075] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-24T21:00:30.421206] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-24T21:00:30.502933] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:31.038461] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T21:00:31.216095] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-24T21:00:31.568411] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T21:00:31.578038] [INFO ] [REMOTE ] RITM: Full fetch complete (76546 records). [2025-09-24T21:00:31.578197] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-24T21:00:32.017791] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-24T21:00:32.018031] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-24T21:00:32.018314] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-24T21:00:32.020741] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-24T21:00:32.021003] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-24T21:00:32.023113] [DEBUG] [LOCAL ] RITM: Trimmed 76546 records to 52819 (keeping 200 days of data) [2025-09-24T21:00:32.055946] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T21:00:32.398206] [DEBUG] [LOCAL ] RITM: Primary data saved (52819 records). [2025-09-24T21:00:32.398373] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-24T21:00:32.398468] [INFO ] [MAIN ] Update Progress: 1809/2373 symbols completed. RITM took 34.9s. Estimated remaining: 1h 14m 59s. Rate: 7.5 symbols/min [2025-09-24T21:00:32.572569] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:32.617549] [DEBUG] [LOCAL ] RL: Loaded 41590 existing records from primary storage. [2025-09-24T21:00:32.617724] [INFO ] [MAIN ] RL: Loaded 41590 existing records. [2025-09-24T21:00:32.798782] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:32.799234] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-24T21:00:32.799400] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-24T21:00:32.800724] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-24T21:00:32.800792] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-24T21:00:32.830848] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-24T21:00:33.192533] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-24T21:00:33.214379] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:33.616058] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-24T21:00:34.092628] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-24T21:00:34.102204] [INFO ] [REMOTE ] RIO: Full fetch complete (77353 records). [2025-09-24T21:00:34.102356] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-24T21:00:34.417136] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-24T21:00:34.550962] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-24T21:00:34.551280] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-24T21:00:34.552915] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-24T21:00:34.553157] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-24T21:00:34.555561] [DEBUG] [LOCAL ] RIO: Trimmed 77353 records to 53394 (keeping 200 days of data) [2025-09-24T21:00:34.721702] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T21:00:34.989004] [DEBUG] [LOCAL ] RIO: Primary data saved (53394 records). [2025-09-24T21:00:34.989986] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-24T21:00:34.990194] [INFO ] [MAIN ] Update Progress: 1810/2373 symbols completed. RIO took 52.5s. Estimated remaining: 1h 14m 49s. Rate: 7.5 symbols/min [2025-09-24T21:00:35.227940] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-24T21:00:35.230606] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:35.264738] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T21:00:35.309631] [DEBUG] [LOCAL ] RLI: Loaded 33304 existing records from primary storage. [2025-09-24T21:00:35.309873] [INFO ] [MAIN ] RLI: Loaded 33304 existing records. [2025-09-24T21:00:35.508136] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:35.508501] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-24T21:00:35.508557] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-24T21:00:35.509728] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-24T21:00:35.509791] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-24T21:00:35.902730] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:36.016092] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-24T21:00:36.256342] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T21:00:36.816142] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-24T21:00:36.972637] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T21:00:37.616121] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-24T21:00:37.672832] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T21:00:37.950067] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T21:00:38.416128] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-24T21:00:39.037954] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T21:00:39.048698] [INFO ] [REMOTE ] RJF: Full fetch complete (68323 records). [2025-09-24T21:00:39.048892] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-24T21:00:39.220463] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-24T21:00:39.474818] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-24T21:00:39.474920] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-24T21:00:39.476133] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-24T21:00:39.476201] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-24T21:00:39.477733] [DEBUG] [LOCAL ] RJF: Trimmed 68323 records to 47095 (keeping 200 days of data) [2025-09-24T21:00:39.787350] [DEBUG] [LOCAL ] RJF: Primary data saved (47095 records). [2025-09-24T21:00:39.787531] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-24T21:00:39.787660] [INFO ] [MAIN ] Update Progress: 1811/2373 symbols completed. RJF took 24.4s. Estimated remaining: 1h 14m 40s. Rate: 7.5 symbols/min [2025-09-24T21:00:39.965359] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:40.009322] [DEBUG] [LOCAL ] RLJ: Loaded 48245 existing records from primary storage. [2025-09-24T21:00:40.009466] [INFO ] [MAIN ] RLJ: Loaded 48245 existing records. [2025-09-24T21:00:40.040890] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-24T21:00:40.192363] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:40.192727] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-24T21:00:40.192785] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-24T21:00:40.193979] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-24T21:00:40.194042] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-24T21:00:40.558153] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:40.602280] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-24T21:00:40.816064] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-24T21:00:41.015479] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T21:00:41.616156] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-24T21:00:41.669687] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:00:42.416103] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-24T21:00:43.081705] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-24T21:00:43.216068] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-24T21:00:43.240247] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:00:44.016110] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-24T21:00:44.163143] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:00:44.816125] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-24T21:00:45.494120] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-24T21:00:45.616140] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-24T21:00:45.867535] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T21:00:46.416119] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-24T21:00:46.845447] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T21:00:47.101279] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T21:00:47.216077] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-24T21:00:48.016122] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-24T21:00:48.055717] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T21:00:48.816122] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-24T21:00:49.097590] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T21:00:49.175896] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T21:00:49.616102] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-24T21:00:50.416160] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-24T21:00:50.977616] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T21:00:51.216095] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-24T21:00:51.389428] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T21:00:51.500105] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T21:00:52.016174] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-24T21:00:52.816246] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-24T21:00:53.616678] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-24T21:00:53.616544] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-24T21:00:53.682101] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T21:00:54.411432] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T21:00:54.419198] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-24T21:00:55.216145] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-24T21:00:55.314068] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T21:00:56.016147] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-24T21:00:56.583344] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T21:00:56.725398] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T21:00:56.734949] [INFO ] [REMOTE ] RKT: Full fetch complete (77350 records). [2025-09-24T21:00:56.735112] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-24T21:00:56.826384] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-24T21:00:57.165747] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-24T21:00:57.165901] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-24T21:00:57.167555] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-24T21:00:57.167663] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-24T21:00:57.169789] [DEBUG] [LOCAL ] RKT: Trimmed 77350 records to 53721 (keeping 200 days of data) [2025-09-24T21:00:57.557580] [DEBUG] [LOCAL ] RKT: Primary data saved (53721 records). [2025-09-24T21:00:57.557845] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-24T21:00:57.558005] [INFO ] [MAIN ] Update Progress: 1812/2373 symbols completed. RKT took 27.9s. Estimated remaining: 1h 14m 35s. Rate: 7.5 symbols/min [2025-09-24T21:00:57.627035] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-24T21:00:57.754633] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:00:57.771092] [DEBUG] [LOCAL ] RLTY: Loaded 11117 existing records from primary storage. [2025-09-24T21:00:57.771295] [INFO ] [MAIN ] RLTY: Loaded 11117 existing records. [2025-09-24T21:00:57.996553] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:00:57.997124] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-24T21:00:57.997185] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-24T21:00:57.997852] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-24T21:00:57.997932] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-24T21:00:58.206849] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-24T21:00:58.425045] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-24T21:00:58.450822] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:00:58.472230] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:00:59.216227] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-24T21:00:59.275485] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T21:01:00.016136] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-24T21:01:00.358987] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-24T21:01:00.816202] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-24T21:01:01.008837] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T21:01:01.102708] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T21:01:01.616108] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-24T21:01:02.380113] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T21:01:02.416102] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-24T21:01:02.789409] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T21:01:03.216129] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-24T21:01:04.016128] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-24T21:01:04.625604] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T21:01:04.816153] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-24T21:01:05.238924] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T21:01:05.300097] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T21:01:05.616107] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-24T21:01:06.369402] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T21:01:06.416100] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-24T21:01:06.980802] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T21:01:07.216177] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-24T21:01:08.016110] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-24T21:01:08.135582] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-24T21:01:08.480788] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-24T21:01:08.492881] [INFO ] [REMOTE ] RLJ: Full fetch complete (69228 records). [2025-09-24T21:01:08.493061] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-24T21:01:08.821193] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-24T21:01:08.933314] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-24T21:01:08.933424] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-24T21:01:08.934517] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-24T21:01:08.934622] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-24T21:01:08.936298] [DEBUG] [LOCAL ] RLJ: Trimmed 69228 records to 48235 (keeping 200 days of data) [2025-09-24T21:01:09.246902] [DEBUG] [LOCAL ] RLJ: Primary data saved (48235 records). [2025-09-24T21:01:09.247164] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-24T21:01:09.247386] [INFO ] [MAIN ] Update Progress: 1813/2373 symbols completed. RLJ took 29.5s. Estimated remaining: 1h 14m 28s. Rate: 7.5 symbols/min [2025-09-24T21:01:09.407343] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T21:01:09.474068] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:09.469958] [INFO ] [REMOTE ] RL: Full fetch complete (59947 records). [2025-09-24T21:01:09.474267] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-24T21:01:09.637799] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-24T21:01:09.754126] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-24T21:01:09.849040] [DEBUG] [LOCAL ] RLX: Loaded 48163 existing records from primary storage. [2025-09-24T21:01:09.849259] [INFO ] [MAIN ] RLX: Loaded 48163 existing records. [2025-09-24T21:01:10.103196] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-24T21:01:10.103310] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-24T21:01:10.104451] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-24T21:01:10.107364] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-24T21:01:10.135708] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:10.136137] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-24T21:01:10.136226] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-24T21:01:10.136368] [DEBUG] [LOCAL ] RL: Trimmed 59947 records to 41521 (keeping 200 days of data) [2025-09-24T21:01:10.138247] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-24T21:01:10.138322] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-24T21:01:10.417720] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-24T21:01:10.628261] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:10.780504] [DEBUG] [LOCAL ] RL: Primary data saved (41521 records). [2025-09-24T21:01:10.780672] [INFO ] [MAIN ] RL: Full history saved. [2025-09-24T21:01:10.780789] [INFO ] [MAIN ] Update Progress: 1814/2373 symbols completed. RL took 38.4s. Estimated remaining: 1h 14m 18s. Rate: 7.5 symbols/min [2025-09-24T21:01:10.954782] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:10.976595] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T21:01:10.986808] [INFO ] [REMOTE ] RLI: Full fetch complete (46243 records). [2025-09-24T21:01:10.990382] [DEBUG] [LOCAL ] RM: Loaded 7685 existing records from primary storage. [2025-09-24T21:01:10.990477] [INFO ] [MAIN ] RM: Loaded 7685 existing records. [2025-09-24T21:01:10.990535] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-24T21:01:11.219245] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-24T21:01:11.338439] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:11.345283] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-24T21:01:11.353428] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-24T21:01:11.366043] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-24T21:01:11.375546] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-24T21:01:11.582881] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T21:01:11.845795] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-24T21:01:11.869553] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-24T21:01:11.883477] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-24T21:01:11.883709] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-24T21:01:11.950843] [DEBUG] [LOCAL ] RLI: Trimmed 46243 records to 33293 (keeping 200 days of data) [2025-09-24T21:01:11.974304] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:12.046920] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-24T21:01:12.209990] [DEBUG] [LOCAL ] RLI: Primary data saved (33293 records). [2025-09-24T21:01:12.210157] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-24T21:01:12.210291] [INFO ] [MAIN ] Update Progress: 1815/2373 symbols completed. RLI took 37.2s. Estimated remaining: 1h 14m 8s. Rate: 7.5 symbols/min [2025-09-24T21:01:12.385423] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:12.412483] [DEBUG] [LOCAL ] RMAX: Loaded 21919 existing records from primary storage. [2025-09-24T21:01:12.412675] [INFO ] [MAIN ] RMAX: Loaded 21919 existing records. [2025-09-24T21:01:12.591620] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:12.591885] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-24T21:01:12.591935] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-24T21:01:12.592784] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-24T21:01:12.592847] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-24T21:01:12.834794] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-24T21:01:12.900907] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-24T21:01:12.968298] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:13.263495] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-24T21:01:13.616095] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-24T21:01:13.764683] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T21:01:14.416154] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-24T21:01:14.756071] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:01:15.216113] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-24T21:01:15.419373] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T21:01:16.016175] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-24T21:01:16.311961] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T21:01:16.816171] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-24T21:01:16.894244] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T21:01:17.616255] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-24T21:01:17.680385] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T21:01:18.416173] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-24T21:01:18.487030] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:01:19.216118] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-24T21:01:20.016120] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-24T21:01:20.165712] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T21:01:20.207814] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T21:01:20.616799] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-24T21:01:20.619399] [INFO ] [REMOTE ] RLTY: Full fetch complete (18149 records). [2025-09-24T21:01:20.619634] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-24T21:01:20.816219] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-24T21:01:21.038752] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-24T21:01:21.038863] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-24T21:01:21.039484] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-24T21:01:21.039592] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-24T21:01:21.040670] [DEBUG] [LOCAL ] RLTY: Trimmed 18149 records to 11089 (keeping 200 days of data) [2025-09-24T21:01:21.125788] [DEBUG] [LOCAL ] RLTY: Primary data saved (11089 records). [2025-09-24T21:01:21.125958] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-24T21:01:21.126126] [INFO ] [MAIN ] Update Progress: 1816/2373 symbols completed. RLTY took 23.6s. Estimated remaining: 1h 14m 0s. Rate: 7.5 symbols/min [2025-09-24T21:01:21.310945] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:21.366573] [DEBUG] [LOCAL ] RMD: Loaded 42314 existing records from primary storage. [2025-09-24T21:01:21.366755] [INFO ] [MAIN ] RMD: Loaded 42314 existing records. [2025-09-24T21:01:21.556372] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:21.556737] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-24T21:01:21.556806] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-24T21:01:21.558443] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-24T21:01:21.558518] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-24T21:01:21.622187] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-24T21:01:21.959469] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:22.416079] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-24T21:01:22.491428] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:01:22.703344] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T21:01:23.207833] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T21:01:23.216041] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-24T21:01:24.016132] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-24T21:01:24.045596] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T21:01:24.816121] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-24T21:01:25.616070] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-24T21:01:25.687974] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T21:01:25.805801] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:01:26.416096] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-24T21:01:27.216096] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-24T21:01:27.304423] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:01:27.564901] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T21:01:28.016088] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-24T21:01:28.079511] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T21:01:28.816089] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-24T21:01:29.141715] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:01:29.360037] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-24T21:01:29.616141] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-24T21:01:30.416148] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-24T21:01:30.975902] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T21:01:31.216174] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-24T21:01:32.016144] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-24T21:01:32.408546] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T21:01:32.501047] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T21:01:32.816142] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-24T21:01:33.616119] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-24T21:01:33.783985] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T21:01:34.085933] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T21:01:34.416115] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-24T21:01:35.216073] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-24T21:01:35.385937] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T21:01:35.622090] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T21:01:35.628372] [INFO ] [REMOTE ] RMAX: Full fetch complete (29690 records). [2025-09-24T21:01:35.628473] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-24T21:01:36.022631] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-24T21:01:36.020498] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-24T21:01:36.022906] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-24T21:01:36.024504] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-24T21:01:36.024609] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-24T21:01:36.025908] [DEBUG] [LOCAL ] RMAX: Trimmed 29690 records to 21865 (keeping 200 days of data) [2025-09-24T21:01:36.128136] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T21:01:36.176856] [DEBUG] [LOCAL ] RMAX: Primary data saved (21865 records). [2025-09-24T21:01:36.177034] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-24T21:01:36.177163] [INFO ] [MAIN ] Update Progress: 1817/2373 symbols completed. RMAX took 24.0s. Estimated remaining: 1h 13m 55s. Rate: 7.5 symbols/min [2025-09-24T21:01:36.352890] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:36.360316] [DEBUG] [LOCAL ] RMI: Loaded 4682 existing records from primary storage. [2025-09-24T21:01:36.360436] [INFO ] [MAIN ] RMI: Loaded 4682 existing records. [2025-09-24T21:01:36.556471] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:36.557903] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-24T21:01:36.557967] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-24T21:01:36.558793] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-24T21:01:36.558862] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-24T21:01:36.824211] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-24T21:01:36.930205] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:37.616153] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-24T21:01:37.650025] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T21:01:37.896118] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T21:01:38.416126] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-24T21:01:39.216184] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-24T21:01:39.331847] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T21:01:39.936173] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T21:01:39.975836] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T21:01:40.016060] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-24T21:01:40.816103] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-24T21:01:41.616291] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-24T21:01:41.711784] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T21:01:42.416067] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-24T21:01:42.482683] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T21:01:42.485460] [INFO ] [REMOTE ] RM: Full fetch complete (11557 records). [2025-09-24T21:01:42.485540] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-24T21:01:42.859627] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T21:01:42.917179] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-24T21:01:42.917264] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-24T21:01:42.917545] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-24T21:01:42.917952] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-24T21:01:42.918466] [DEBUG] [LOCAL ] RM: Trimmed 11557 records to 7664 (keeping 200 days of data) [2025-09-24T21:01:42.960843] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T21:01:42.976912] [DEBUG] [LOCAL ] RM: Primary data saved (7664 records). [2025-09-24T21:01:42.977055] [INFO ] [MAIN ] RM: Full history saved. [2025-09-24T21:01:42.977367] [INFO ] [MAIN ] Update Progress: 1818/2373 symbols completed. RM took 32.2s. Estimated remaining: 1h 13m 46s. Rate: 7.5 symbols/min [2025-09-24T21:01:43.147223] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:43.163353] [DEBUG] [LOCAL ] RMM: Loaded 10370 existing records from primary storage. [2025-09-24T21:01:43.163483] [INFO ] [MAIN ] RMM: Loaded 10370 existing records. [2025-09-24T21:01:43.225280] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-24T21:01:43.348563] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:43.348855] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-24T21:01:43.348907] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-24T21:01:43.349364] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-24T21:01:43.349429] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-24T21:01:43.730352] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:44.016159] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-24T21:01:44.816130] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-24T21:01:45.077631] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T21:01:45.181060] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T21:01:45.258282] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T21:01:45.616108] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-24T21:01:46.209361] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T21:01:46.416312] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-24T21:01:47.216111] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-24T21:01:48.016099] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-24T21:01:48.127581] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T21:01:48.136957] [INFO ] [REMOTE ] RLX: Full fetch complete (70352 records). [2025-09-24T21:01:48.137090] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-24T21:01:48.533299] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-24T21:01:48.533380] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-24T21:01:48.534457] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-24T21:01:48.534524] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-24T21:01:48.536069] [DEBUG] [LOCAL ] RLX: Trimmed 70352 records to 48255 (keeping 200 days of data) [2025-09-24T21:01:48.823464] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-24T21:01:48.842061] [DEBUG] [LOCAL ] RLX: Primary data saved (48255 records). [2025-09-24T21:01:48.842177] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-24T21:01:48.842300] [INFO ] [MAIN ] Update Progress: 1819/2373 symbols completed. RLX took 39.6s. Estimated remaining: 1h 13m 38s. Rate: 7.5 symbols/min [2025-09-24T21:01:49.017731] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:49.026258] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T21:01:49.058989] [DEBUG] [LOCAL ] RMMZ: Loaded 4843 existing records from primary storage. [2025-09-24T21:01:49.059703] [INFO ] [MAIN ] RMMZ: Loaded 4843 existing records. [2025-09-24T21:01:49.060813] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-24T21:01:49.258945] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:49.259208] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-24T21:01:49.259259] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-24T21:01:49.259605] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-24T21:01:49.259725] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-24T21:01:49.547391] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T21:01:49.631054] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:49.624892] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-24T21:01:50.260629] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T21:01:50.416146] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-24T21:01:51.216063] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-24T21:01:51.294607] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T21:01:51.858007] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T21:01:52.016139] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-24T21:01:52.816091] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-24T21:01:52.823966] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T21:01:53.450966] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T21:01:53.616105] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-24T21:01:54.382220] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T21:01:54.416075] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-24T21:01:55.196243] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T21:01:55.216106] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-24T21:01:55.868392] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T21:01:56.016158] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-24T21:01:56.750252] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-24T21:01:56.752082] [INFO ] [REMOTE ] RMI: Full fetch complete (6362 records). [2025-09-24T21:01:56.752155] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-24T21:01:56.821366] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-24T21:01:57.128349] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-24T21:01:57.128437] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-24T21:01:57.128637] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-24T21:01:57.128719] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-24T21:01:57.129140] [DEBUG] [LOCAL ] RMI: Trimmed 6362 records to 4690 (keeping 200 days of data) [2025-09-24T21:01:57.169683] [DEBUG] [LOCAL ] RMI: Primary data saved (4690 records). [2025-09-24T21:01:57.169863] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-24T21:01:57.169982] [INFO ] [MAIN ] Update Progress: 1820/2373 symbols completed. RMI took 21.0s. Estimated remaining: 1h 13m 30s. Rate: 7.5 symbols/min [2025-09-24T21:01:57.368515] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:01:57.386700] [DEBUG] [LOCAL ] RMT: Loaded 17581 existing records from primary storage. [2025-09-24T21:01:57.386841] [INFO ] [MAIN ] RMT: Loaded 17581 existing records. [2025-09-24T21:01:57.497718] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T21:01:57.582251] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:01:57.582494] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-24T21:01:57.582553] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-24T21:01:57.583229] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-24T21:01:57.583307] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-24T21:01:57.621934] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-24T21:01:57.964945] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:01:58.416101] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-24T21:01:59.123763] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T21:01:59.216069] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-24T21:01:59.412895] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:02:00.016109] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-24T21:02:00.082297] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T21:02:00.816110] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-24T21:02:01.616124] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-24T21:02:01.763403] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:02:01.776334] [INFO ] [REMOTE ] RMD: Full fetch complete (60982 records). [2025-09-24T21:02:01.776567] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-24T21:02:02.249821] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-24T21:02:02.250061] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-24T21:02:02.251972] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-24T21:02:02.252061] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-24T21:02:02.254483] [DEBUG] [LOCAL ] RMD: Trimmed 60982 records to 42266 (keeping 200 days of data) [2025-09-24T21:02:02.469999] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-24T21:02:02.627924] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T21:02:02.630121] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T21:02:02.689405] [DEBUG] [LOCAL ] RMD: Primary data saved (42266 records). [2025-09-24T21:02:02.689545] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-24T21:02:02.689726] [INFO ] [MAIN ] Update Progress: 1821/2373 symbols completed. RMD took 41.6s. Estimated remaining: 1h 13m 21s. Rate: 7.5 symbols/min [2025-09-24T21:02:02.865513] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:02.913787] [DEBUG] [LOCAL ] RNG: Loaded 48166 existing records from primary storage. [2025-09-24T21:02:02.913935] [INFO ] [MAIN ] RNG: Loaded 48166 existing records. [2025-09-24T21:02:03.096558] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:03.096854] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-24T21:02:03.096908] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-24T21:02:03.098154] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-24T21:02:03.098218] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-24T21:02:03.221181] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-24T21:02:03.495220] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:03.984268] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T21:02:04.016123] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-24T21:02:04.263581] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T21:02:04.816106] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-24T21:02:05.504590] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T21:02:05.616113] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-24T21:02:06.082274] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-24T21:02:06.416159] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-24T21:02:06.878677] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T21:02:07.216138] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-24T21:02:07.301301] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T21:02:08.016124] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-24T21:02:08.816073] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-24T21:02:09.083451] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-24T21:02:09.211738] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T21:02:09.616154] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-24T21:02:09.814470] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T21:02:10.187704] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T21:02:10.416164] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-24T21:02:11.216124] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-24T21:02:12.016131] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-24T21:02:12.108706] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T21:02:12.205093] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T21:02:12.816094] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-24T21:02:12.839244] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T21:02:13.616060] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-24T21:02:13.762322] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T21:02:14.416128] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-24T21:02:15.216125] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-24T21:02:15.460469] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T21:02:15.586804] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T21:02:15.713540] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T21:02:16.016105] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-24T21:02:16.691075] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T21:02:16.692525] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7188 records). [2025-09-24T21:02:16.692605] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-24T21:02:16.821265] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-24T21:02:17.130004] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-24T21:02:17.130086] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-24T21:02:17.130284] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-24T21:02:17.130323] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-24T21:02:17.130765] [DEBUG] [LOCAL ] RMMZ: Trimmed 7188 records to 4845 (keeping 200 days of data) [2025-09-24T21:02:17.162812] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4845 records). [2025-09-24T21:02:17.162947] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-24T21:02:17.163051] [INFO ] [MAIN ] Update Progress: 1822/2373 symbols completed. RMMZ took 28.3s. Estimated remaining: 1h 13m 15s. Rate: 7.5 symbols/min [2025-09-24T21:02:17.347159] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:17.368567] [DEBUG] [LOCAL ] RNGR: Loaded 20429 existing records from primary storage. [2025-09-24T21:02:17.368876] [INFO ] [MAIN ] RNGR: Loaded 20429 existing records. [2025-09-24T21:02:17.552746] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:17.553006] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-24T21:02:17.553054] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-24T21:02:17.553831] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-24T21:02:17.553892] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-24T21:02:17.618451] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-24T21:02:17.959389] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:17.985879] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T21:02:18.416097] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-24T21:02:19.216082] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-24T21:02:19.486859] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T21:02:19.547397] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T21:02:20.016121] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-24T21:02:20.153797] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T21:02:20.157053] [INFO ] [REMOTE ] RMM: Full fetch complete (14906 records). [2025-09-24T21:02:20.157128] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-24T21:02:20.545894] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-24T21:02:20.545999] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-24T21:02:20.546493] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-24T21:02:20.546555] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-24T21:02:20.547228] [DEBUG] [LOCAL ] RMM: Trimmed 14906 records to 10443 (keeping 200 days of data) [2025-09-24T21:02:20.613178] [DEBUG] [LOCAL ] RMM: Primary data saved (10443 records). [2025-09-24T21:02:20.613328] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-24T21:02:20.613441] [INFO ] [MAIN ] Update Progress: 1823/2373 symbols completed. RMM took 37.6s. Estimated remaining: 1h 13m 6s. Rate: 7.5 symbols/min [2025-09-24T21:02:20.791955] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:20.812024] [DEBUG] [LOCAL ] RNP: Loaded 15782 existing records from primary storage. [2025-09-24T21:02:20.812152] [INFO ] [MAIN ] RNP: Loaded 15782 existing records. [2025-09-24T21:02:20.823356] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-24T21:02:21.020956] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:21.023947] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T21:02:21.024043] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-24T21:02:21.028103] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-24T21:02:21.029036] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-24T21:02:21.029111] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-24T21:02:21.399251] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:21.616099] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-24T21:02:22.394291] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T21:02:22.416146] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-24T21:02:22.629934] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-24T21:02:23.216127] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-24T21:02:23.458198] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:02:24.016118] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-24T21:02:24.824269] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-24T21:02:24.842728] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T21:02:24.854634] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T21:02:25.616069] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-24T21:02:25.981999] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T21:02:26.416239] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-24T21:02:26.809360] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T21:02:27.216076] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-24T21:02:27.579428] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T21:02:28.016067] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-24T21:02:28.190162] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T21:02:28.816119] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-24T21:02:29.338967] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T21:02:29.616123] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-24T21:02:29.966860] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:02:30.416108] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-24T21:02:31.216095] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-24T21:02:31.317844] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T21:02:31.343488] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T21:02:32.016116] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-24T21:02:32.273342] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T21:02:32.621822] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T21:02:32.816138] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-24T21:02:33.616143] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-24T21:02:34.015231] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T21:02:34.416080] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-24T21:02:34.616001] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T21:02:34.619147] [INFO ] [REMOTE ] RMT: Full fetch complete (25528 records). [2025-09-24T21:02:34.619229] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-24T21:02:34.987220] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-24T21:02:34.987301] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-24T21:02:34.987907] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-24T21:02:34.987970] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-24T21:02:34.988634] [DEBUG] [LOCAL ] RMT: Trimmed 25528 records to 17504 (keeping 200 days of data) [2025-09-24T21:02:35.101927] [DEBUG] [LOCAL ] RMT: Primary data saved (17504 records). [2025-09-24T21:02:35.102114] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-24T21:02:35.102277] [INFO ] [MAIN ] Update Progress: 1824/2373 symbols completed. RMT took 37.9s. Estimated remaining: 1h 12m 60s. Rate: 7.5 symbols/min [2025-09-24T21:02:35.221304] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-24T21:02:35.275613] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:35.315854] [DEBUG] [LOCAL ] RNR: Loaded 34369 existing records from primary storage. [2025-09-24T21:02:35.315995] [INFO ] [MAIN ] RNR: Loaded 34369 existing records. [2025-09-24T21:02:35.492685] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:35.492947] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-24T21:02:35.492996] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-24T21:02:35.494013] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-24T21:02:35.494075] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-24T21:02:35.855517] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:36.016057] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-24T21:02:36.147128] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T21:02:36.155893] [INFO ] [REMOTE ] RNG: Full fetch complete (69498 records). [2025-09-24T21:02:36.156035] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-24T21:02:36.498430] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T21:02:36.582553] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-24T21:02:36.582634] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-24T21:02:36.583728] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-24T21:02:36.583791] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-24T21:02:36.585183] [DEBUG] [LOCAL ] RNG: Trimmed 69498 records to 48144 (keeping 200 days of data) [2025-09-24T21:02:36.817148] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-24T21:02:36.873713] [DEBUG] [LOCAL ] RNG: Primary data saved (48144 records). [2025-09-24T21:02:36.873853] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-24T21:02:36.873957] [INFO ] [MAIN ] Update Progress: 1825/2373 symbols completed. RNG took 34.2s. Estimated remaining: 1h 12m 50s. Rate: 7.5 symbols/min [2025-09-24T21:02:37.046578] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:37.085835] [DEBUG] [LOCAL ] RNST: Loaded 37214 existing records from primary storage. [2025-09-24T21:02:37.086004] [INFO ] [MAIN ] RNST: Loaded 37214 existing records. [2025-09-24T21:02:37.271176] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:37.271673] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-24T21:02:37.271739] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-24T21:02:37.272721] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-24T21:02:37.272782] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-24T21:02:37.646565] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-24T21:02:37.648624] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T21:02:37.704705] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:37.740393] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T21:02:38.416097] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-24T21:02:38.944900] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T21:02:39.216128] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-24T21:02:40.016137] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-24T21:02:40.051760] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:02:40.672915] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T21:02:40.816123] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-24T21:02:40.831061] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T21:02:41.616145] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-24T21:02:42.416138] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-24T21:02:42.486728] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T21:02:42.759259] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T21:02:43.216124] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-24T21:02:43.921800] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:02:44.016092] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-24T21:02:44.322225] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T21:02:44.816119] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-24T21:02:45.475425] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T21:02:45.616146] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-24T21:02:45.897202] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T21:02:46.416084] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-24T21:02:46.799004] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T21:02:46.803582] [INFO ] [REMOTE ] RNGR: Full fetch complete (28425 records). [2025-09-24T21:02:46.803753] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-24T21:02:47.225991] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-24T21:02:47.240723] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-24T21:02:47.240816] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-24T21:02:47.241617] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-24T21:02:47.241933] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-24T21:02:47.243171] [DEBUG] [LOCAL ] RNGR: Trimmed 28425 records to 20444 (keeping 200 days of data) [2025-09-24T21:02:47.371787] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T21:02:47.376827] [INFO ] [REMOTE ] RNP: Full fetch complete (23392 records). [2025-09-24T21:02:47.377234] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-24T21:02:47.712708] [DEBUG] [LOCAL ] RNGR: Primary data saved (20444 records). [2025-09-24T21:02:47.736912] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-24T21:02:47.739596] [INFO ] [MAIN ] Update Progress: 1826/2373 symbols completed. RNGR took 30.6s. Estimated remaining: 1h 12m 43s. Rate: 7.5 symbols/min [2025-09-24T21:02:47.946545] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-24T21:02:47.951807] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-24T21:02:47.952422] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-24T21:02:47.957624] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-24T21:02:48.013134] [DEBUG] [LOCAL ] RNP: Trimmed 23392 records to 15782 (keeping 200 days of data) [2025-09-24T21:02:48.016775] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:48.016980] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-24T21:02:48.115907] [DEBUG] [LOCAL ] ROG: Loaded 23161 existing records from primary storage. [2025-09-24T21:02:48.116607] [INFO ] [MAIN ] ROG: Loaded 23161 existing records. [2025-09-24T21:02:48.326361] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:48.328197] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-24T21:02:48.328280] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-24T21:02:48.330201] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-24T21:02:48.331014] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-24T21:02:48.639886] [DEBUG] [LOCAL ] RNP: Primary data saved (15782 records). [2025-09-24T21:02:48.650280] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-24T21:02:48.650436] [INFO ] [MAIN ] Update Progress: 1827/2373 symbols completed. RNP took 28.0s. Estimated remaining: 1h 12m 33s. Rate: 7.5 symbols/min [2025-09-24T21:02:48.796760] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:48.834079] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-24T21:02:48.914788] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:02:48.938730] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T21:02:48.992179] [DEBUG] [LOCAL ] ROK: Loaded 44010 existing records from primary storage. [2025-09-24T21:02:48.992322] [INFO ] [MAIN ] ROK: Loaded 44010 existing records. [2025-09-24T21:02:49.169761] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:02:49.169975] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-24T21:02:49.170022] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-24T21:02:49.171224] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-24T21:02:49.171285] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-24T21:02:49.543274] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:02:49.627757] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-24T21:02:49.630250] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T21:02:49.924883] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T21:02:50.416135] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-24T21:02:51.216088] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-24T21:02:51.327323] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T21:02:52.016074] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-24T21:02:52.114002] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T21:02:52.132681] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T21:02:52.816149] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-24T21:02:53.543919] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T21:02:53.616114] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-24T21:02:54.362931] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T21:02:54.416134] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-24T21:02:55.216090] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-24T21:02:55.491107] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T21:02:55.840347] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:02:56.016121] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-24T21:02:56.190874] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T21:02:56.816118] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-24T21:02:57.610186] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:02:57.619251] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-24T21:02:57.804503] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T21:02:58.416133] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-24T21:02:59.026278] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T21:02:59.216112] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-24T21:02:59.971085] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T21:03:00.016104] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-24T21:03:00.744068] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T21:03:00.816128] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-24T21:03:01.616197] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-24T21:03:02.026212] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-24T21:03:02.416137] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-24T21:03:02.904846] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T21:03:03.216158] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-24T21:03:04.016147] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-24T21:03:05.213871] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-24T21:03:05.224715] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-24T21:03:05.411495] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (3.80 seconds). [2025-09-24T21:03:05.551061] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T21:03:05.616090] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-24T21:03:05.669073] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-24T21:03:05.675584] [INFO ] [REMOTE ] RNST: Full fetch complete (52841 records). [2025-09-24T21:03:05.675774] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-24T21:03:06.084284] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-24T21:03:06.084373] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-24T21:03:06.085296] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-24T21:03:06.085361] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-24T21:03:06.086514] [DEBUG] [LOCAL ] RNST: Trimmed 52841 records to 37138 (keeping 200 days of data) [2025-09-24T21:03:06.323892] [DEBUG] [LOCAL ] RNST: Primary data saved (37138 records). [2025-09-24T21:03:06.324054] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-24T21:03:06.324147] [INFO ] [MAIN ] Update Progress: 1828/2373 symbols completed. RNST took 29.5s. Estimated remaining: 1h 12m 28s. Rate: 7.5 symbols/min [2025-09-24T21:03:06.422895] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-24T21:03:06.498481] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:06.547232] [DEBUG] [LOCAL ] ROL: Loaded 50275 existing records from primary storage. [2025-09-24T21:03:06.547377] [INFO ] [MAIN ] ROL: Loaded 50275 existing records. [2025-09-24T21:03:06.726592] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:06.726895] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-24T21:03:06.726944] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-24T21:03:06.729725] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-24T21:03:06.729793] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-24T21:03:07.098238] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:07.216137] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-24T21:03:07.368893] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-24T21:03:07.421439] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T21:03:07.429047] [INFO ] [REMOTE ] RNR: Full fetch complete (51229 records). [2025-09-24T21:03:07.429236] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-24T21:03:07.877703] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:03:07.877919] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-24T21:03:07.883401] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-24T21:03:07.884568] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-24T21:03:07.884851] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-24T21:03:07.886625] [DEBUG] [LOCAL ] RNR: Trimmed 51229 records to 34254 (keeping 200 days of data) [2025-09-24T21:03:08.021439] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-24T21:03:08.112920] [DEBUG] [LOCAL ] RNR: Primary data saved (34254 records). [2025-09-24T21:03:08.113092] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-24T21:03:08.113254] [INFO ] [MAIN ] Update Progress: 1829/2373 symbols completed. RNR took 33.0s. Estimated remaining: 1h 12m 18s. Rate: 7.5 symbols/min [2025-09-24T21:03:08.302942] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:08.349939] [DEBUG] [LOCAL ] RPM: Loaded 41108 existing records from primary storage. [2025-09-24T21:03:08.350085] [INFO ] [MAIN ] RPM: Loaded 41108 existing records. [2025-09-24T21:03:08.528148] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:08.528619] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-24T21:03:08.528741] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-24T21:03:08.529865] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-24T21:03:08.529926] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-24T21:03:08.821338] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-24T21:03:08.908893] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:09.190401] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-24T21:03:09.616112] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-24T21:03:09.940249] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T21:03:09.999105] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T21:03:10.416131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-24T21:03:11.185561] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T21:03:11.216162] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-24T21:03:12.016139] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-24T21:03:12.053589] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T21:03:12.411391] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T21:03:12.816155] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-24T21:03:13.616119] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-24T21:03:14.416841] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-24T21:03:14.416181] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-24T21:03:14.994736] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T21:03:15.216116] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-24T21:03:15.741595] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-24T21:03:15.793329] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T21:03:16.016109] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-24T21:03:16.816117] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-24T21:03:16.955861] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T21:03:16.959354] [INFO ] [REMOTE ] ROG: Full fetch complete (30640 records). [2025-09-24T21:03:16.959466] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-24T21:03:17.191293] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-24T21:03:17.394771] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-24T21:03:17.394867] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-24T21:03:17.395863] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-24T21:03:17.395948] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-24T21:03:17.396909] [DEBUG] [LOCAL ] ROG: Trimmed 30640 records to 23151 (keeping 200 days of data) [2025-09-24T21:03:17.569036] [DEBUG] [LOCAL ] ROG: Primary data saved (23151 records). [2025-09-24T21:03:17.569375] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-24T21:03:17.569625] [INFO ] [MAIN ] Update Progress: 1830/2373 symbols completed. ROG took 29.8s. Estimated remaining: 1h 12m 10s. Rate: 7.5 symbols/min [2025-09-24T21:03:17.621225] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-24T21:03:17.754154] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:17.781577] [DEBUG] [LOCAL ] RPT: Loaded 19669 existing records from primary storage. [2025-09-24T21:03:17.781759] [INFO ] [MAIN ] RPT: Loaded 19669 existing records. [2025-09-24T21:03:17.969594] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:17.969884] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-24T21:03:17.969935] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-24T21:03:17.970421] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-24T21:03:17.970505] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-24T21:03:18.355528] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:18.416097] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-24T21:03:18.736383] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T21:03:19.216133] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-24T21:03:19.391245] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T21:03:19.541839] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T21:03:20.016114] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-24T21:03:20.816076] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-24T21:03:20.905988] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T21:03:20.941503] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:03:21.616141] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-24T21:03:22.167092] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T21:03:22.416131] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-24T21:03:22.844190] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:03:22.853053] [INFO ] [REMOTE ] ROK: Full fetch complete (63466 records). [2025-09-24T21:03:22.853224] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-24T21:03:23.226196] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-24T21:03:23.270199] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-24T21:03:23.270337] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-24T21:03:23.272210] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-24T21:03:23.272283] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-24T21:03:23.274110] [DEBUG] [LOCAL ] ROK: Trimmed 63466 records to 43954 (keeping 200 days of data) [2025-09-24T21:03:23.566916] [DEBUG] [LOCAL ] ROK: Primary data saved (43954 records). [2025-09-24T21:03:23.567054] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-24T21:03:23.567182] [INFO ] [MAIN ] Update Progress: 1831/2373 symbols completed. ROK took 34.9s. Estimated remaining: 1h 12m 2s. Rate: 7.5 symbols/min [2025-09-24T21:03:23.745584] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:23.782098] [DEBUG] [LOCAL ] RQI: Loaded 29075 existing records from primary storage. [2025-09-24T21:03:23.782234] [INFO ] [MAIN ] RQI: Loaded 29075 existing records. [2025-09-24T21:03:23.970010] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:23.970448] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-24T21:03:23.970563] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-24T21:03:23.971408] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-24T21:03:23.971481] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-24T21:03:24.030264] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-24T21:03:24.353412] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T21:03:24.395137] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:24.816061] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-24T21:03:24.892392] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T21:03:25.292463] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T21:03:25.616107] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-24T21:03:26.261940] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T21:03:26.416136] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-24T21:03:27.216132] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-24T21:03:27.390214] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T21:03:27.439686] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:03:28.016123] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-24T21:03:28.816075] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-24T21:03:28.995392] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T21:03:29.487898] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T21:03:29.616082] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-24T21:03:30.072346] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T21:03:30.416126] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-24T21:03:30.537958] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T21:03:31.216117] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-24T21:03:32.016151] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-24T21:03:32.192135] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T21:03:32.816101] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-24T21:03:33.116188] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-24T21:03:33.369899] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:03:33.616103] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-24T21:03:34.416164] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-24T21:03:34.463435] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:03:35.040535] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:03:35.216085] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-24T21:03:35.852313] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T21:03:36.016093] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-24T21:03:36.295478] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T21:03:36.816132] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-24T21:03:37.616084] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-24T21:03:37.684985] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:03:37.735149] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T21:03:38.416113] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-24T21:03:38.635765] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T21:03:39.216105] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-24T21:03:39.883118] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T21:03:39.895766] [INFO ] [REMOTE ] ROL: Full fetch complete (72617 records). [2025-09-24T21:03:39.895900] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-24T21:03:40.017956] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-24T21:03:40.280229] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T21:03:40.323168] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-24T21:03:40.323569] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-24T21:03:40.324671] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-24T21:03:40.324735] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-24T21:03:40.326186] [DEBUG] [LOCAL ] ROL: Trimmed 72617 records to 50266 (keeping 200 days of data) [2025-09-24T21:03:40.644416] [DEBUG] [LOCAL ] ROL: Primary data saved (50266 records). [2025-09-24T21:03:40.644558] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-24T21:03:40.644699] [INFO ] [MAIN ] Update Progress: 1832/2373 symbols completed. ROL took 34.3s. Estimated remaining: 1h 11m 56s. Rate: 7.5 symbols/min [2025-09-24T21:03:40.822283] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:40.820403] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-24T21:03:40.880367] [DEBUG] [LOCAL ] RRC: Loaded 52776 existing records from primary storage. [2025-09-24T21:03:40.880516] [INFO ] [MAIN ] RRC: Loaded 52776 existing records. [2025-09-24T21:03:41.071070] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:41.071691] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-24T21:03:41.071940] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-24T21:03:41.078350] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-24T21:03:41.087155] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-24T21:03:41.120035] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T21:03:41.454690] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:41.616106] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-24T21:03:42.389048] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T21:03:42.416131] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-24T21:03:43.011182] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T21:03:43.216128] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-24T21:03:43.591394] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T21:03:44.016137] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-24T21:03:44.816127] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-24T21:03:45.048069] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-24T21:03:45.140408] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T21:03:45.616229] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-24T21:03:46.410709] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:03:46.416868] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-24T21:03:46.418184] [INFO ] [REMOTE ] RPM: Full fetch complete (58749 records). [2025-09-24T21:03:46.418263] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-24T21:03:46.817680] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-24T21:03:46.817811] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-24T21:03:46.818820] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-24T21:03:46.818915] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-24T21:03:46.842271] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:03:46.842452] [DEBUG] [LOCAL ] RPM: Trimmed 58749 records to 41115 (keeping 200 days of data) [2025-09-24T21:03:46.850378] [INFO ] [REMOTE ] RQI: Full fetch complete (43251 records). [2025-09-24T21:03:46.850549] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-24T21:03:47.224549] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-24T21:03:47.405318] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-24T21:03:47.405602] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-24T21:03:47.407026] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-24T21:03:47.407116] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-24T21:03:47.414247] [DEBUG] [LOCAL ] RQI: Trimmed 43251 records to 29112 (keeping 200 days of data) [2025-09-24T21:03:47.561181] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:03:47.597126] [INFO ] [REMOTE ] RPT: Full fetch complete (28673 records). [2025-09-24T21:03:47.597561] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-24T21:03:47.728332] [DEBUG] [LOCAL ] RQI: Primary data saved (29112 records). [2025-09-24T21:03:47.750055] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-24T21:03:47.750890] [INFO ] [MAIN ] Update Progress: 1833/2373 symbols completed. RQI took 24.2s. Estimated remaining: 1h 11m 48s. Rate: 7.5 symbols/min [2025-09-24T21:03:48.267277] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:48.410229] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-24T21:03:48.414076] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-24T21:03:48.418178] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-24T21:03:48.418309] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-24T21:03:48.434054] [DEBUG] [LOCAL ] RPT: Trimmed 28673 records to 19599 (keeping 200 days of data) [2025-09-24T21:03:48.450919] [DEBUG] [LOCAL ] RPM: Primary data saved (41115 records). [2025-09-24T21:03:48.451221] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-24T21:03:48.451434] [INFO ] [MAIN ] Update Progress: 1834/2373 symbols completed. RPM took 40.3s. Estimated remaining: 1h 11m 38s. Rate: 7.5 symbols/min [2025-09-24T21:03:48.660533] [DEBUG] [LOCAL ] RRX: Loaded 41114 existing records from primary storage. [2025-09-24T21:03:48.674770] [INFO ] [MAIN ] RRX: Loaded 41114 existing records. [2025-09-24T21:03:48.876928] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:48.988740] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:48.991400] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-24T21:03:48.991924] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-24T21:03:49.002801] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-24T21:03:49.003062] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-24T21:03:49.086108] [DEBUG] [LOCAL ] RS: Loaded 25564 existing records from primary storage. [2025-09-24T21:03:49.118246] [INFO ] [MAIN ] RS: Loaded 25564 existing records. [2025-09-24T21:03:49.518352] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-24T21:03:49.631842] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-24T21:03:49.643910] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:49.667334] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-24T21:03:49.686592] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-24T21:03:49.709241] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-24T21:03:49.719464] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-24T21:03:49.718957] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:49.734072] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-24T21:03:49.772975] [DEBUG] [LOCAL ] RPT: Primary data saved (19599 records). [2025-09-24T21:03:49.801163] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-24T21:03:49.812377] [INFO ] [MAIN ] Update Progress: 1835/2373 symbols completed. RPT took 32.2s. Estimated remaining: 1h 11m 28s. Rate: 7.5 symbols/min [2025-09-24T21:03:50.160120] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:03:50.261725] [DEBUG] [LOCAL ] RSF: Loaded 4128 existing records from primary storage. [2025-09-24T21:03:50.272232] [INFO ] [MAIN ] RSF: Loaded 4128 existing records. [2025-09-24T21:03:50.423143] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:50.434296] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-24T21:03:50.521561] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:03:50.521805] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-24T21:03:50.521858] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-24T21:03:50.522128] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-24T21:03:50.522188] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-24T21:03:50.885470] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:03:50.885824] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-24T21:03:51.440769] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-24T21:03:51.442088] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-24T21:03:51.519315] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T21:03:51.556869] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:03:52.016083] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-24T21:03:52.120619] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:03:52.119963] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T21:03:52.816115] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-24T21:03:53.616072] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-24T21:03:53.895997] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T21:03:54.421178] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-24T21:03:54.431266] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T21:03:54.773237] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T21:03:55.216166] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-24T21:03:56.016151] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-24T21:03:56.364310] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-24T21:03:56.418099] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T21:03:56.816116] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-24T21:03:57.278289] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T21:03:57.381918] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T21:03:57.616119] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-24T21:03:58.416122] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-24T21:03:59.175674] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T21:03:59.216065] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-24T21:03:59.750746] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T21:04:00.016125] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-24T21:04:00.650829] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T21:04:00.816132] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-24T21:04:01.618706] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-24T21:04:01.644764] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T21:04:01.674954] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T21:04:02.416130] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-24T21:04:03.030542] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T21:04:03.216110] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-24T21:04:03.825281] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-24T21:04:03.876227] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T21:04:04.016110] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-24T21:04:04.790007] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T21:04:04.816101] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-24T21:04:05.568502] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T21:04:05.616063] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-24T21:04:06.416120] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-24T21:04:07.119467] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T21:04:07.216110] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-24T21:04:08.016135] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-24T21:04:08.394908] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T21:04:08.821175] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-24T21:04:08.857532] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-24T21:04:09.439733] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T21:04:09.441022] [INFO ] [REMOTE ] RSF: Full fetch complete (5572 records). [2025-09-24T21:04:09.441112] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-24T21:04:09.616497] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-24T21:04:09.868262] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-24T21:04:09.868373] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-24T21:04:09.868731] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-24T21:04:09.868872] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-24T21:04:09.869597] [DEBUG] [LOCAL ] RSF: Trimmed 5572 records to 4135 (keeping 200 days of data) [2025-09-24T21:04:09.895760] [DEBUG] [LOCAL ] RSF: Primary data saved (4135 records). [2025-09-24T21:04:09.895944] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-24T21:04:09.896166] [INFO ] [MAIN ] Update Progress: 1836/2373 symbols completed. RSF took 20.1s. Estimated remaining: 1h 11m 24s. Rate: 7.5 symbols/min [2025-09-24T21:04:10.104902] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:10.111294] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-24T21:04:10.172109] [DEBUG] [LOCAL ] RSG: Loaded 47458 existing records from primary storage. [2025-09-24T21:04:10.172296] [INFO ] [MAIN ] RSG: Loaded 47458 existing records. [2025-09-24T21:04:10.349907] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:10.350178] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-24T21:04:10.350231] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-24T21:04:10.351440] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-24T21:04:10.351504] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-24T21:04:10.424270] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-24T21:04:10.810172] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:10.947156] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T21:04:11.216108] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-24T21:04:12.016124] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-24T21:04:12.069099] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T21:04:12.816139] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-24T21:04:13.433501] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T21:04:13.616091] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-24T21:04:13.787145] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T21:04:14.023120] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T21:04:14.416106] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-24T21:04:15.216106] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-24T21:04:15.245947] [DEBUG] [REMOTE ] RRC: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-24T21:04:15.246132] [WARN ] [REMOTE ] RRC: No data returned for month 2025-08 [2025-09-24T21:04:15.783424] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T21:04:16.016127] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-24T21:04:16.816077] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-24T21:04:17.011483] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T21:04:17.201416] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T21:04:17.207061] [INFO ] [REMOTE ] RS: Full fetch complete (39509 records). [2025-09-24T21:04:17.207194] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-24T21:04:17.605034] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-24T21:04:17.605115] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-24T21:04:17.605924] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-24T21:04:17.605986] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-24T21:04:17.607000] [DEBUG] [LOCAL ] RS: Trimmed 39509 records to 25544 (keeping 200 days of data) [2025-09-24T21:04:17.662863] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-24T21:04:17.777479] [DEBUG] [LOCAL ] RS: Primary data saved (25544 records). [2025-09-24T21:04:17.777637] [INFO ] [MAIN ] RS: Full history saved. [2025-09-24T21:04:17.777772] [INFO ] [MAIN ] Update Progress: 1837/2373 symbols completed. RS took 29.3s. Estimated remaining: 1h 11m 16s. Rate: 7.5 symbols/min [2025-09-24T21:04:18.358988] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:04:18.368554] [INFO ] [REMOTE ] RRC: Full fetch complete (68338 records). [2025-09-24T21:04:18.368753] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-24T21:04:18.426213] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-24T21:04:18.579697] [WARN ] [VALIDATOR ] RRC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T21:04:18.581231] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:04:18.581314] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:04:18.581388] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-24T21:04:18.581465] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-09-24T21:04:18.581505] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-09-24T21:04:18.582045] [DEBUG] [LOCAL ] RRC: Deleted derivative data file. [2025-09-24T21:04:18.582163] [INFO ] [MAIN ] Update Progress: 1838/2373 symbols completed. RRC took 37.9s. Estimated remaining: 1h 11m 6s. Rate: 7.5 symbols/min [2025-09-24T21:04:19.459620] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T21:04:19.468979] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-24T21:04:20.094050] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:04:20.104402] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-24T21:04:21.295998] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T21:04:21.306864] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-24T21:04:21.807201] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T21:04:21.818546] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-24T21:04:23.150039] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:04:23.161214] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-24T21:04:23.488676] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T21:04:23.495972] [INFO ] [REMOTE ] RRX: Full fetch complete (57994 records). [2025-09-24T21:04:23.499148] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-24T21:04:23.884470] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-24T21:04:23.884576] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-24T21:04:23.885556] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-24T21:04:23.885624] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-24T21:04:23.887111] [DEBUG] [LOCAL ] RRX: Trimmed 57994 records to 41153 (keeping 200 days of data) [2025-09-24T21:04:24.145988] [DEBUG] [LOCAL ] RRX: Primary data saved (41153 records). [2025-09-24T21:04:24.146153] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-24T21:04:24.146240] [INFO ] [MAIN ] Update Progress: 1839/2373 symbols completed. RRX took 36.3s. Estimated remaining: 1h 10m 57s. Rate: 7.5 symbols/min [2025-09-24T21:04:24.765416] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T21:04:24.775454] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-24T21:04:26.500270] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T21:04:26.511020] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-24T21:04:28.384492] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T21:04:28.395688] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-24T21:04:30.110250] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T21:04:30.125575] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-24T21:04:31.847110] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T21:04:31.855781] [INFO ] [REMOTE ] RSG: Full fetch complete (67910 records). [2025-09-24T21:04:31.855962] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-24T21:04:32.271593] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-24T21:04:32.271778] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-24T21:04:32.273186] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-24T21:04:32.273272] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-24T21:04:32.275066] [DEBUG] [LOCAL ] RSG: Trimmed 67910 records to 47484 (keeping 200 days of data) [2025-09-24T21:04:32.574443] [DEBUG] [LOCAL ] RSG: Primary data saved (47484 records). [2025-09-24T21:04:32.574581] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-24T21:04:32.574691] [INFO ] [MAIN ] Update Progress: 1840/2373 symbols completed. RSG took 22.7s. Estimated remaining: 1h 10m 49s. Rate: 7.5 symbols/min [2025-09-24T21:04:33.274905] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:33.269424] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:33.297921] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:33.319143] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:33.364885] [DEBUG] [LOCAL ] RSKD: Loaded 34054 existing records from primary storage. [2025-09-24T21:04:33.391350] [INFO ] [MAIN ] RSKD: Loaded 34054 existing records. [2025-09-24T21:04:33.502038] [DEBUG] [LOCAL ] RTO: Loaded 40294 existing records from primary storage. [2025-09-24T21:04:33.527885] [INFO ] [MAIN ] RTO: Loaded 40294 existing records. [2025-09-24T21:04:33.527668] [DEBUG] [LOCAL ] RTX: Loaded 53710 existing records from primary storage. [2025-09-24T21:04:33.598321] [INFO ] [MAIN ] RTX: Loaded 53710 existing records. [2025-09-24T21:04:33.693145] [DEBUG] [LOCAL ] RSI: Loaded 47111 existing records from primary storage. [2025-09-24T21:04:33.792400] [INFO ] [MAIN ] RSI: Loaded 47111 existing records. [2025-09-24T21:04:33.829390] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:33.898638] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-24T21:04:33.953613] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-24T21:04:34.065328] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-24T21:04:34.138948] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-24T21:04:34.247897] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:34.278510] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:34.303624] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-24T21:04:34.303541] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:34.319319] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-24T21:04:34.343573] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-24T21:04:34.343779] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-24T21:04:34.343834] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-24T21:04:34.343974] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-24T21:04:34.349818] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-24T21:04:34.349882] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-24T21:04:34.355134] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-24T21:04:34.360429] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-24T21:04:34.365615] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-24T21:04:34.448742] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-24T21:04:35.259631] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:35.319787] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-24T21:04:35.748731] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:35.833558] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:35.827565] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:35.834048] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-24T21:04:35.834420] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-24T21:04:35.834769] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-24T21:04:36.663287] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T21:04:36.670174] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-24T21:04:37.497831] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:04:37.509637] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-24T21:04:37.592092] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T21:04:37.602303] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-24T21:04:37.953466] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-24T21:04:37.964967] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-24T21:04:38.113745] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T21:04:38.120858] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-24T21:04:38.767563] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T21:04:38.777400] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-24T21:04:38.955275] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T21:04:38.962331] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-24T21:04:39.041784] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T21:04:39.052424] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-24T21:04:40.116164] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T21:04:40.117994] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T21:04:40.138046] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-24T21:04:40.140247] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-24T21:04:40.166838] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T21:04:40.175774] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-24T21:04:40.448216] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T21:04:40.458736] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-24T21:04:41.410123] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T21:04:41.419865] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-24T21:04:41.835966] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:04:41.847363] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-24T21:04:41.879775] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T21:04:41.891574] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-24T21:04:42.671089] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T21:04:42.683010] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-24T21:04:42.721222] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:04:42.728883] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-24T21:04:43.624473] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:04:43.634124] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-24T21:04:44.008549] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-24T21:04:44.020318] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-24T21:04:44.285055] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T21:04:44.450129] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T21:04:44.816099] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-24T21:04:45.135125] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T21:04:45.616079] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-24T21:04:46.416086] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-24T21:04:46.457471] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-24T21:04:46.592615] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T21:04:46.900964] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T21:04:47.216181] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-24T21:04:47.896580] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T21:04:48.016088] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-24T21:04:48.816136] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-24T21:04:48.985576] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T21:04:49.504020] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:04:49.616080] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-24T21:04:50.416111] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-24T21:04:50.754055] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:04:50.760291] [INFO ] [REMOTE ] RSKD: Full fetch complete (48405 records). [2025-09-24T21:04:50.760396] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-24T21:04:51.150823] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-24T21:04:51.150944] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-24T21:04:51.151853] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-24T21:04:51.152058] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-24T21:04:51.183745] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-24T21:04:51.182270] [DEBUG] [LOCAL ] RSKD: Trimmed 48405 records to 33898 (keeping 200 days of data) [2025-09-24T21:04:51.245157] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-24T21:04:51.405682] [DEBUG] [LOCAL ] RSKD: Primary data saved (33898 records). [2025-09-24T21:04:51.405855] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-24T21:04:51.405975] [INFO ] [MAIN ] Update Progress: 1841/2373 symbols completed. RSKD took 18.8s. Estimated remaining: 1h 10m 44s. Rate: 7.5 symbols/min [2025-09-24T21:04:51.573797] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:51.619450] [DEBUG] [LOCAL ] RVLV: Loaded 47858 existing records from primary storage. [2025-09-24T21:04:51.619600] [INFO ] [MAIN ] RVLV: Loaded 47858 existing records. [2025-09-24T21:04:51.802225] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:51.802726] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-24T21:04:51.802804] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-24T21:04:51.804104] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-24T21:04:51.804171] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-24T21:04:51.965939] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T21:04:52.033955] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-24T21:04:52.210618] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:52.816131] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-24T21:04:53.271095] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T21:04:53.616088] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-24T21:04:53.712775] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T21:04:54.288408] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T21:04:54.416045] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-24T21:04:55.216166] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-24T21:04:56.012805] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-24T21:04:56.023984] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-24T21:04:56.119403] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T21:04:56.494499] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T21:04:56.816109] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-24T21:04:57.268170] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T21:04:57.275739] [INFO ] [REMOTE ] RTO: Full fetch complete (58374 records). [2025-09-24T21:04:57.275906] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-24T21:04:57.621257] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-24T21:04:57.692590] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-24T21:04:57.692750] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-24T21:04:57.693992] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-24T21:04:57.694077] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-24T21:04:57.695473] [DEBUG] [LOCAL ] RTO: Trimmed 58374 records to 40234 (keeping 200 days of data) [2025-09-24T21:04:57.827180] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-24T21:04:57.997515] [DEBUG] [LOCAL ] RTO: Primary data saved (40234 records). [2025-09-24T21:04:57.997696] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-24T21:04:57.997853] [INFO ] [MAIN ] Update Progress: 1842/2373 symbols completed. RTO took 25.4s. Estimated remaining: 1h 10m 36s. Rate: 7.5 symbols/min [2025-09-24T21:04:58.165333] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:04:58.197544] [DEBUG] [LOCAL ] RVT: Loaded 27148 existing records from primary storage. [2025-09-24T21:04:58.197743] [INFO ] [MAIN ] RVT: Loaded 27148 existing records. [2025-09-24T21:04:58.373875] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:04:58.374125] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-24T21:04:58.374174] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-24T21:04:58.375117] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-24T21:04:58.375179] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-24T21:04:58.421362] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-24T21:04:58.799603] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:04:59.222372] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-24T21:04:59.242191] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:05:00.016142] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-24T21:05:00.234053] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T21:05:00.816167] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-24T21:05:01.401360] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-24T21:05:01.412873] [INFO ] [REMOTE ] RTX: Full fetch complete (77732 records). [2025-09-24T21:05:01.413059] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-24T21:05:01.623488] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-24T21:05:01.856206] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-24T21:05:01.856420] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-24T21:05:01.857576] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-24T21:05:01.857682] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-24T21:05:01.887264] [DEBUG] [LOCAL ] RTX: Trimmed 77732 records to 53709 (keeping 200 days of data) [2025-09-24T21:05:01.889240] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T21:05:02.242633] [DEBUG] [LOCAL ] RTX: Primary data saved (53709 records). [2025-09-24T21:05:02.242805] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-24T21:05:02.242896] [INFO ] [MAIN ] Update Progress: 1843/2373 symbols completed. RTX took 29.7s. Estimated remaining: 1h 10m 27s. Rate: 7.5 symbols/min [2025-09-24T21:05:02.411795] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:02.416081] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-24T21:05:02.459703] [DEBUG] [LOCAL ] RVTY: Loaded 47580 existing records from primary storage. [2025-09-24T21:05:02.459927] [INFO ] [MAIN ] RVTY: Loaded 47580 existing records. [2025-09-24T21:05:02.664780] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:02.665118] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-24T21:05:02.665177] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-24T21:05:02.666626] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-24T21:05:02.666714] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-24T21:05:03.083712] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:03.105451] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-24T21:05:03.216112] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-24T21:05:03.896751] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-24T21:05:03.905606] [INFO ] [REMOTE ] RSI: Full fetch complete (69451 records). [2025-09-24T21:05:03.905791] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-24T21:05:04.021179] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-24T21:05:04.302372] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-24T21:05:04.302456] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-24T21:05:04.303599] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-24T21:05:04.303698] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-24T21:05:04.305286] [DEBUG] [LOCAL ] RSI: Trimmed 69451 records to 47050 (keeping 200 days of data) [2025-09-24T21:05:04.603796] [DEBUG] [LOCAL ] RSI: Primary data saved (47050 records). [2025-09-24T21:05:04.603976] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-24T21:05:04.604081] [INFO ] [MAIN ] Update Progress: 1844/2373 symbols completed. RSI took 32.0s. Estimated remaining: 1h 10m 17s. Rate: 7.5 symbols/min [2025-09-24T21:05:04.785218] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:04.802449] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T21:05:04.827582] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-24T21:05:04.850038] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-24T21:05:04.898731] [DEBUG] [LOCAL ] RWT: Loaded 40723 existing records from primary storage. [2025-09-24T21:05:04.898912] [INFO ] [MAIN ] RWT: Loaded 40723 existing records. [2025-09-24T21:05:05.080372] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:05.080826] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-24T21:05:05.080885] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-24T21:05:05.082331] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-24T21:05:05.082397] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-24T21:05:05.478166] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:05.506291] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:05:05.616146] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-24T21:05:06.143042] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T21:05:06.416245] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-24T21:05:07.216222] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-24T21:05:07.478943] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T21:05:08.016161] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-24T21:05:08.421834] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T21:05:08.816138] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-24T21:05:08.946312] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T21:05:09.328695] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T21:05:09.616145] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-24T21:05:10.416097] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-24T21:05:10.657052] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T21:05:11.216136] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-24T21:05:11.307467] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T21:05:12.016116] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-24T21:05:12.149470] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T21:05:12.577405] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T21:05:12.816102] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-24T21:05:13.521233] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T21:05:13.616114] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-24T21:05:14.416096] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-24T21:05:14.451495] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:05:15.216264] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-24T21:05:15.369137] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T21:05:15.762562] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T21:05:16.016139] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-24T21:05:16.801302] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T21:05:16.816055] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-24T21:05:17.220468] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-24T21:05:17.616117] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-24T21:05:18.416079] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-24T21:05:18.544583] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:05:18.906904] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T21:05:19.216096] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-24T21:05:19.775497] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T21:05:20.016089] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-24T21:05:20.662836] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:05:20.816154] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-24T21:05:21.165593] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-24T21:05:21.616132] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-24T21:05:22.416108] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-24T21:05:22.581746] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T21:05:22.853490] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T21:05:23.216104] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-24T21:05:23.654551] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T21:05:24.016101] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-24T21:05:24.816077] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-24T21:05:24.866482] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T21:05:25.239839] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T21:05:25.246297] [INFO ] [REMOTE ] RVT: Full fetch complete (40117 records). [2025-09-24T21:05:25.246536] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-24T21:05:25.626699] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-24T21:05:25.661373] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-24T21:05:25.661523] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-24T21:05:25.663222] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-24T21:05:25.663303] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-24T21:05:25.664791] [DEBUG] [LOCAL ] RVT: Trimmed 40117 records to 27074 (keeping 200 days of data) [2025-09-24T21:05:25.843258] [DEBUG] [LOCAL ] RVT: Primary data saved (27074 records). [2025-09-24T21:05:25.843425] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-24T21:05:25.843546] [INFO ] [MAIN ] Update Progress: 1845/2373 symbols completed. RVT took 27.8s. Estimated remaining: 1h 10m 13s. Rate: 7.5 symbols/min [2025-09-24T21:05:26.014534] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:26.014765] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-24T21:05:26.014821] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-24T21:05:26.014966] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-24T21:05:26.015009] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-24T21:05:26.015052] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-24T21:05:26.015096] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-24T21:05:26.428289] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-24T21:05:26.434947] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:26.641848] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:05:27.216131] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-24T21:05:27.513795] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T21:05:28.016069] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-24T21:05:28.189854] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:05:28.397354] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T21:05:28.406591] [INFO ] [REMOTE ] RVLV: Full fetch complete (68794 records). [2025-09-24T21:05:28.406795] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-24T21:05:28.831240] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-24T21:05:28.834747] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-24T21:05:28.834824] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-24T21:05:28.835907] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-24T21:05:28.837209] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-24T21:05:28.838800] [DEBUG] [LOCAL ] RVLV: Trimmed 68794 records to 47826 (keeping 200 days of data) [2025-09-24T21:05:29.143533] [DEBUG] [LOCAL ] RVLV: Primary data saved (47826 records). [2025-09-24T21:05:29.143827] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-24T21:05:29.144069] [INFO ] [MAIN ] Update Progress: 1846/2373 symbols completed. RVLV took 37.7s. Estimated remaining: 1h 10m 4s. Rate: 7.5 symbols/min [2025-09-24T21:05:29.357852] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:29.358059] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-24T21:05:29.358118] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-24T21:05:29.358303] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-24T21:05:29.358359] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-24T21:05:29.358431] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-24T21:05:29.358468] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-24T21:05:29.619715] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-24T21:05:29.747041] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:29.773396] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T21:05:29.781943] [INFO ] [REMOTE ] RVTY: Full fetch complete (66419 records). [2025-09-24T21:05:29.782065] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-24T21:05:30.185672] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-24T21:05:30.185787] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-24T21:05:30.186901] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-24T21:05:30.186989] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-24T21:05:30.195146] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T21:05:30.195002] [DEBUG] [LOCAL ] RVTY: Trimmed 66419 records to 47533 (keeping 200 days of data) [2025-09-24T21:05:30.419910] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-24T21:05:30.546515] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T21:05:30.569057] [DEBUG] [LOCAL ] RVTY: Primary data saved (47533 records). [2025-09-24T21:05:30.569201] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-24T21:05:30.569331] [INFO ] [MAIN ] Update Progress: 1847/2373 symbols completed. RVTY took 28.3s. Estimated remaining: 1h 9m 54s. Rate: 7.5 symbols/min [2025-09-24T21:05:30.755289] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:30.755496] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-24T21:05:30.755535] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-24T21:05:30.755722] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-24T21:05:30.755775] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-24T21:05:30.755819] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-24T21:05:30.755861] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-24T21:05:31.111063] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T21:05:31.139001] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:31.216100] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-24T21:05:32.016150] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-24T21:05:32.549594] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T21:05:32.551067] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T21:05:32.559892] [INFO ] [REMOTE ] RWT: Full fetch complete (58659 records). [2025-09-24T21:05:32.560049] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-24T21:05:32.823325] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-24T21:05:32.986699] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-24T21:05:32.986833] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-24T21:05:32.988334] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-24T21:05:32.988418] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-24T21:05:32.992546] [DEBUG] [LOCAL ] RWT: Trimmed 58659 records to 40781 (keeping 200 days of data) [2025-09-24T21:05:33.260247] [DEBUG] [LOCAL ] RWT: Primary data saved (40781 records). [2025-09-24T21:05:33.260517] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-24T21:05:33.260731] [INFO ] [MAIN ] Update Progress: 1848/2373 symbols completed. RWT took 28.7s. Estimated remaining: 1h 9m 45s. Rate: 7.5 symbols/min [2025-09-24T21:05:33.414459] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T21:05:33.453955] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:33.512402] [DEBUG] [LOCAL ] RXO: Loaded 47792 existing records from primary storage. [2025-09-24T21:05:33.512623] [INFO ] [MAIN ] RXO: Loaded 47792 existing records. [2025-09-24T21:05:33.621808] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-24T21:05:33.711151] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:33.711401] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-24T21:05:33.711459] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-24T21:05:33.713049] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-24T21:05:33.713112] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-24T21:05:33.939124] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:05:33.983972] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-24T21:05:34.093246] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:34.416102] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-24T21:05:34.913789] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T21:05:35.216101] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-24T21:05:35.893711] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T21:05:36.016133] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-24T21:05:36.645123] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T21:05:36.816083] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-24T21:05:37.514948] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T21:05:37.616095] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-24T21:05:38.125815] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T21:05:38.416107] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-24T21:05:39.005160] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T21:05:39.216122] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-24T21:05:39.909946] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T21:05:40.016180] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-24T21:05:40.525787] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-24T21:05:40.816122] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-24T21:05:41.356707] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T21:05:41.616109] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-24T21:05:42.145226] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-24T21:05:42.416155] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-24T21:05:42.939142] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T21:05:43.216089] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-24T21:05:43.678319] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T21:05:44.016115] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-24T21:05:44.507805] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T21:05:44.816086] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-24T21:05:45.241631] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-24T21:05:45.616109] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-24T21:05:46.416102] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-24T21:05:46.935160] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-24T21:05:47.216067] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-24T21:05:47.257024] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-24T21:05:47.869441] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-24T21:05:48.016101] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-24T21:05:48.504473] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T21:05:48.816108] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-24T21:05:49.458674] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T21:05:49.616095] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-24T21:05:50.416099] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-24T21:05:50.860520] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T21:05:51.216071] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-24T21:05:51.373412] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T21:05:51.612634] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-24T21:05:52.016167] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-24T21:05:52.602024] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T21:05:52.816120] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-24T21:05:53.472127] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T21:05:53.616093] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-24T21:05:54.293072] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T21:05:54.294491] [INFO ] [REMOTE ] RWTP: Full fetch complete (4468 records). [2025-09-24T21:05:54.294563] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-24T21:05:54.421170] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-24T21:05:54.491473] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-24T21:05:54.491690] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:05:54.491773] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:05:54.491859] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-24T21:05:54.491939] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-24T21:05:54.491998] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-24T21:05:54.492080] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-24T21:05:54.492173] [INFO ] [MAIN ] Update Progress: 1849/2373 symbols completed. RWTP took 23.9s. Estimated remaining: 1h 9m 40s. Rate: 7.5 symbols/min [2025-09-24T21:05:54.659678] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:54.716300] [DEBUG] [LOCAL ] RY: Loaded 47921 existing records from primary storage. [2025-09-24T21:05:54.716792] [INFO ] [MAIN ] RY: Loaded 47921 existing records. [2025-09-24T21:05:54.892063] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:54.892284] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-24T21:05:54.892331] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-24T21:05:54.893925] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-24T21:05:54.893988] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-24T21:05:55.221261] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-24T21:05:55.285441] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:55.792053] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T21:05:55.793314] [INFO ] [REMOTE ] RWTN: Full fetch complete (3157 records). [2025-09-24T21:05:55.793423] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-24T21:05:55.991317] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-24T21:05:55.991586] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:05:55.991798] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:05:55.991935] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-24T21:05:55.992129] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-24T21:05:55.992283] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-24T21:05:55.992719] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-24T21:05:55.992858] [INFO ] [MAIN ] Update Progress: 1850/2373 symbols completed. RWTN took 30.1s. Estimated remaining: 1h 9m 31s. Rate: 7.5 symbols/min [2025-09-24T21:05:56.016100] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-24T21:05:56.058078] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T21:05:56.235300] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:56.284887] [DEBUG] [LOCAL ] RYAM: Loaded 35249 existing records from primary storage. [2025-09-24T21:05:56.285030] [INFO ] [MAIN ] RYAM: Loaded 35249 existing records. [2025-09-24T21:05:56.462263] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:56.462580] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-24T21:05:56.462636] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-24T21:05:56.463697] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-24T21:05:56.463758] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-24T21:05:56.821025] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-24T21:05:56.824888] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:57.496910] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T21:05:57.498521] [INFO ] [REMOTE ] RWTO: Full fetch complete (4795 records). [2025-09-24T21:05:57.498606] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-24T21:05:57.620449] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-24T21:05:57.699200] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T21:05:57.699496] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:05:57.699769] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:05:57.699972] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-24T21:05:57.700118] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-24T21:05:57.700346] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-24T21:05:57.700583] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-24T21:05:57.700762] [INFO ] [MAIN ] Update Progress: 1851/2373 symbols completed. RWTO took 28.6s. Estimated remaining: 1h 9m 21s. Rate: 7.5 symbols/min [2025-09-24T21:05:57.910482] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:05:57.916835] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T21:05:57.991962] [DEBUG] [LOCAL ] RYAN: Loaded 44116 existing records from primary storage. [2025-09-24T21:05:57.992166] [INFO ] [MAIN ] RYAN: Loaded 44116 existing records. [2025-09-24T21:05:58.179925] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:05:58.180182] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-24T21:05:58.180232] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-24T21:05:58.181604] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-24T21:05:58.181703] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-24T21:05:58.427085] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-24T21:05:58.571901] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:05:59.069672] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T21:05:59.216303] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-24T21:06:00.016222] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-24T21:06:00.273995] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T21:06:00.402197] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T21:06:00.816156] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-24T21:06:01.616102] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-24T21:06:02.066069] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T21:06:02.416114] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-24T21:06:02.623277] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T21:06:03.216102] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-24T21:06:04.016076] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-24T21:06:04.097042] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-24T21:06:04.668070] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-24T21:06:04.816128] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-24T21:06:05.368469] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-24T21:06:05.458245] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T21:06:05.616061] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-24T21:06:05.946696] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T21:06:06.416122] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-24T21:06:07.216092] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-24T21:06:07.465807] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T21:06:08.013726] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:06:08.021608] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-24T21:06:08.758161] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T21:06:08.816105] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-24T21:06:09.297406] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T21:06:09.616144] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-24T21:06:10.416098] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-24T21:06:10.564719] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T21:06:11.216069] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-24T21:06:11.634368] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T21:06:11.984076] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:06:12.016095] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-24T21:06:12.816106] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-24T21:06:13.616100] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-24T21:06:13.796584] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-24T21:06:14.266060] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T21:06:14.416117] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-24T21:06:15.084699] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T21:06:15.193829] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T21:06:15.216060] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-24T21:06:16.023139] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-24T21:06:16.041195] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T21:06:16.050434] [INFO ] [REMOTE ] RXO: Full fetch complete (68024 records). [2025-09-24T21:06:16.050575] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-24T21:06:16.448848] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-24T21:06:16.448962] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-24T21:06:16.450062] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-24T21:06:16.450129] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-24T21:06:16.451606] [DEBUG] [LOCAL ] RXO: Trimmed 68024 records to 47804 (keeping 200 days of data) [2025-09-24T21:06:16.741024] [DEBUG] [LOCAL ] RXO: Primary data saved (47804 records). [2025-09-24T21:06:16.741154] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-24T21:06:16.741243] [INFO ] [MAIN ] Update Progress: 1852/2373 symbols completed. RXO took 43.5s. Estimated remaining: 1h 9m 16s. Rate: 7.5 symbols/min [2025-09-24T21:06:16.821232] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-24T21:06:16.925862] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:16.955812] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-24T21:06:16.983613] [DEBUG] [LOCAL ] RYI: Loaded 21555 existing records from primary storage. [2025-09-24T21:06:16.983768] [INFO ] [MAIN ] RYI: Loaded 21555 existing records. [2025-09-24T21:06:17.166913] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:17.167208] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-24T21:06:17.167262] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-24T21:06:17.168257] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-24T21:06:17.168321] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-24T21:06:17.534156] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:17.616057] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-24T21:06:17.717072] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T21:06:17.913407] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T21:06:18.416064] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-24T21:06:18.799920] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T21:06:19.216088] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-24T21:06:20.016084] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-24T21:06:20.087185] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:06:20.543474] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T21:06:20.816142] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-24T21:06:21.617183] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-24T21:06:21.624704] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T21:06:22.163879] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:06:22.416173] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-24T21:06:22.912122] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T21:06:23.216120] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-24T21:06:24.016134] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-24T21:06:24.069784] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T21:06:24.178257] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:06:24.816113] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-24T21:06:25.191341] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T21:06:25.198418] [INFO ] [REMOTE ] RYAM: Full fetch complete (48757 records). [2025-09-24T21:06:25.198544] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-24T21:06:25.582997] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-24T21:06:25.583085] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-24T21:06:25.583974] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-24T21:06:25.584042] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-24T21:06:25.585103] [DEBUG] [LOCAL ] RYAM: Trimmed 48757 records to 35165 (keeping 200 days of data) [2025-09-24T21:06:25.634734] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-24T21:06:25.804284] [DEBUG] [LOCAL ] RYAM: Primary data saved (35165 records). [2025-09-24T21:06:25.804477] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-24T21:06:25.804578] [INFO ] [MAIN ] Update Progress: 1853/2373 symbols completed. RYAM took 29.8s. Estimated remaining: 1h 9m 8s. Rate: 7.5 symbols/min [2025-09-24T21:06:25.978368] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:26.029637] [DEBUG] [LOCAL ] RYN: Loaded 45711 existing records from primary storage. [2025-09-24T21:06:26.029847] [INFO ] [MAIN ] RYN: Loaded 45711 existing records. [2025-09-24T21:06:26.315006] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:26.315597] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-24T21:06:26.315750] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-24T21:06:26.317541] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-24T21:06:26.317608] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-24T21:06:26.417425] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-24T21:06:26.734466] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T21:06:26.757112] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:26.834788] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T21:06:27.216097] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-24T21:06:28.016130] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-24T21:06:28.053729] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:06:28.768450] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T21:06:28.816127] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-24T21:06:29.360934] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T21:06:29.369719] [INFO ] [REMOTE ] RYAN: Full fetch complete (63596 records). [2025-09-24T21:06:29.369869] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-24T21:06:29.627517] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-24T21:06:29.773953] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-24T21:06:29.774035] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-24T21:06:29.775063] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-24T21:06:29.775184] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-24T21:06:29.776494] [DEBUG] [LOCAL ] RYAN: Trimmed 63596 records to 44204 (keeping 200 days of data) [2025-09-24T21:06:30.060154] [DEBUG] [LOCAL ] RYAN: Primary data saved (44204 records). [2025-09-24T21:06:30.060333] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-24T21:06:30.060453] [INFO ] [MAIN ] Update Progress: 1854/2373 symbols completed. RYAN took 32.4s. Estimated remaining: 1h 8m 59s. Rate: 7.5 symbols/min [2025-09-24T21:06:30.234362] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:30.242977] [DEBUG] [LOCAL ] RZB: Loaded 6275 existing records from primary storage. [2025-09-24T21:06:30.243134] [INFO ] [MAIN ] RZB: Loaded 6275 existing records. [2025-09-24T21:06:30.426184] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-24T21:06:30.434110] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:30.436115] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-24T21:06:30.436206] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-24T21:06:30.436707] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-24T21:06:30.436775] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-24T21:06:30.862336] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:30.869915] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T21:06:30.934167] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T21:06:31.216137] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-24T21:06:32.002250] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T21:06:32.016105] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-24T21:06:32.701539] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T21:06:32.709821] [INFO ] [REMOTE ] RY: Full fetch complete (68565 records). [2025-09-24T21:06:32.709945] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-24T21:06:32.821375] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-24T21:06:33.124951] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-24T21:06:33.125211] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-24T21:06:33.126738] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-24T21:06:33.127581] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-24T21:06:33.127514] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T21:06:33.134375] [DEBUG] [LOCAL ] RY: Trimmed 68565 records to 47905 (keeping 200 days of data) [2025-09-24T21:06:33.438215] [DEBUG] [LOCAL ] RY: Primary data saved (47905 records). [2025-09-24T21:06:33.438359] [INFO ] [MAIN ] RY: Full history saved. [2025-09-24T21:06:33.438463] [INFO ] [MAIN ] Update Progress: 1855/2373 symbols completed. RY took 38.9s. Estimated remaining: 1h 8m 50s. Rate: 7.5 symbols/min [2025-09-24T21:06:33.612321] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:33.616929] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-24T21:06:33.621819] [DEBUG] [LOCAL ] RZC: Loaded 6778 existing records from primary storage. [2025-09-24T21:06:33.622029] [INFO ] [MAIN ] RZC: Loaded 6778 existing records. [2025-09-24T21:06:33.805122] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:33.805395] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-24T21:06:33.805501] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-24T21:06:33.805864] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-24T21:06:33.805925] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-24T21:06:34.160838] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:34.415580] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T21:06:34.427323] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-24T21:06:34.841590] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T21:06:35.149961] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T21:06:35.216114] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-24T21:06:36.016121] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-24T21:06:36.138620] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T21:06:36.816158] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-24T21:06:37.606490] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T21:06:37.621186] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-24T21:06:37.638427] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T21:06:38.314612] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T21:06:38.416123] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-24T21:06:38.950793] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T21:06:39.216121] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-24T21:06:40.016086] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-24T21:06:40.500549] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T21:06:40.816129] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-24T21:06:41.596770] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T21:06:41.616046] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-24T21:06:42.057535] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T21:06:42.396864] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T21:06:42.416065] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-24T21:06:43.216121] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-24T21:06:43.279208] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T21:06:44.016090] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-24T21:06:44.169504] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-24T21:06:44.177334] [INFO ] [REMOTE ] RYI: Full fetch complete (32365 records). [2025-09-24T21:06:44.177626] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-24T21:06:44.605560] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-24T21:06:44.605710] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-24T21:06:44.606757] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-24T21:06:44.606826] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-24T21:06:44.608072] [DEBUG] [LOCAL ] RYI: Trimmed 32365 records to 21528 (keeping 200 days of data) [2025-09-24T21:06:44.712113] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-24T21:06:44.759891] [DEBUG] [LOCAL ] RYI: Primary data saved (21528 records). [2025-09-24T21:06:44.760073] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-24T21:06:44.760247] [INFO ] [MAIN ] Update Progress: 1856/2373 symbols completed. RYI took 28.0s. Estimated remaining: 1h 8m 43s. Rate: 7.5 symbols/min [2025-09-24T21:06:44.824323] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-24T21:06:44.941884] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:45.007565] [DEBUG] [LOCAL ] S: Loaded 53545 existing records from primary storage. [2025-09-24T21:06:45.007849] [INFO ] [MAIN ] S: Loaded 53545 existing records. [2025-09-24T21:06:45.223770] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:45.224247] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-24T21:06:45.224311] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-24T21:06:45.226261] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-24T21:06:45.226512] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-24T21:06:45.583444] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:45.594230] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T21:06:45.616057] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-24T21:06:46.196118] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T21:06:46.416096] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-24T21:06:47.075393] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T21:06:47.216096] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-24T21:06:47.916138] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T21:06:48.016103] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-24T21:06:48.701404] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T21:06:48.816093] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-24T21:06:49.616080] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-24T21:06:49.779663] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T21:06:50.416130] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-24T21:06:50.746243] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:06:50.881370] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:06:51.216093] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-24T21:06:51.878311] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T21:06:52.016143] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-24T21:06:52.816170] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-24T21:06:53.616142] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-24T21:06:53.677307] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T21:06:53.717111] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T21:06:54.329670] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T21:06:54.331445] [INFO ] [REMOTE ] RZC: Full fetch complete (9903 records). [2025-09-24T21:06:54.331515] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-24T21:06:54.421330] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-24T21:06:54.697344] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-24T21:06:54.697435] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-24T21:06:54.697736] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-24T21:06:54.697844] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-24T21:06:54.698313] [DEBUG] [LOCAL ] RZC: Trimmed 9903 records to 6773 (keeping 200 days of data) [2025-09-24T21:06:54.740810] [DEBUG] [LOCAL ] RZC: Primary data saved (6773 records). [2025-09-24T21:06:54.740966] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-24T21:06:54.741062] [INFO ] [MAIN ] Update Progress: 1857/2373 symbols completed. RZC took 21.3s. Estimated remaining: 1h 8m 36s. Rate: 7.5 symbols/min [2025-09-24T21:06:54.912129] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:54.953833] [DEBUG] [LOCAL ] SA: Loaded 43119 existing records from primary storage. [2025-09-24T21:06:54.953981] [INFO ] [MAIN ] SA: Loaded 43119 existing records. [2025-09-24T21:06:55.129026] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:55.129302] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-24T21:06:55.129351] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-24T21:06:55.130266] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-24T21:06:55.130327] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-24T21:06:55.225592] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-24T21:06:55.483021] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:55.888720] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T21:06:55.890556] [INFO ] [REMOTE ] RZB: Full fetch complete (8795 records). [2025-09-24T21:06:55.890664] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-24T21:06:56.021309] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-24T21:06:56.277538] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-24T21:06:56.277670] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-24T21:06:56.278080] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-24T21:06:56.278131] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-24T21:06:56.278703] [DEBUG] [LOCAL ] RZB: Trimmed 8795 records to 6246 (keeping 200 days of data) [2025-09-24T21:06:56.323067] [DEBUG] [LOCAL ] RZB: Primary data saved (6246 records). [2025-09-24T21:06:56.323295] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-24T21:06:56.323413] [INFO ] [MAIN ] Update Progress: 1858/2373 symbols completed. RZB took 26.3s. Estimated remaining: 1h 8m 26s. Rate: 7.5 symbols/min [2025-09-24T21:06:56.535682] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:06:56.548005] [DEBUG] [LOCAL ] SABA: Loaded 9229 existing records from primary storage. [2025-09-24T21:06:56.548178] [INFO ] [MAIN ] SABA: Loaded 9229 existing records. [2025-09-24T21:06:56.736510] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:06:56.736982] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-24T21:06:56.737056] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-24T21:06:56.737591] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-24T21:06:56.737691] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-24T21:06:56.818427] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-24T21:06:57.155397] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:06:57.157495] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-24T21:06:57.616304] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-24T21:06:57.621363] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T21:06:58.416079] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-24T21:06:58.493180] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:06:58.974927] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-24T21:06:59.216058] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-24T21:06:59.748251] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-24T21:07:00.016155] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-24T21:07:00.604674] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T21:07:00.816079] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-24T21:07:01.514587] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T21:07:01.616137] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-24T21:07:02.416096] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-24T21:07:02.640958] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T21:07:03.216068] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-24T21:07:03.700028] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T21:07:03.738379] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T21:07:04.016115] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-24T21:07:04.783753] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-24T21:07:04.791848] [INFO ] [REMOTE ] RYN: Full fetch complete (64611 records). [2025-09-24T21:07:04.791994] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-24T21:07:04.825179] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-24T21:07:05.203737] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-24T21:07:05.203835] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-24T21:07:05.204965] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-24T21:07:05.205031] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-24T21:07:05.206503] [DEBUG] [LOCAL ] RYN: Trimmed 64611 records to 45655 (keeping 200 days of data) [2025-09-24T21:07:05.328788] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T21:07:05.520243] [DEBUG] [LOCAL ] RYN: Primary data saved (45655 records). [2025-09-24T21:07:05.520441] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-24T21:07:05.520616] [INFO ] [MAIN ] Update Progress: 1859/2373 symbols completed. RYN took 39.7s. Estimated remaining: 1h 8m 18s. Rate: 7.5 symbols/min [2025-09-24T21:07:05.621281] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-24T21:07:05.711928] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:05.755286] [DEBUG] [LOCAL ] SAFE: Loaded 30333 existing records from primary storage. [2025-09-24T21:07:05.755502] [INFO ] [MAIN ] SAFE: Loaded 30333 existing records. [2025-09-24T21:07:05.971257] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:05.971745] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-24T21:07:05.971813] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-24T21:07:05.972826] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-24T21:07:05.973029] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-24T21:07:06.375964] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:06.416117] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-24T21:07:07.008694] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-24T21:07:07.209840] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T21:07:07.218279] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-24T21:07:07.249444] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T21:07:08.016114] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-24T21:07:08.504999] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T21:07:08.820179] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-24T21:07:08.821006] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T21:07:09.616088] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-24T21:07:10.416117] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-24T21:07:10.783087] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T21:07:11.216075] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-24T21:07:11.244844] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T21:07:11.285304] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T21:07:12.016103] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-24T21:07:12.295111] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T21:07:12.721759] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T21:07:12.816091] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-24T21:07:13.616104] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-24T21:07:14.416090] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-24T21:07:14.737278] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-24T21:07:14.878102] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-24T21:07:15.216086] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-24T21:07:15.268325] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T21:07:16.016117] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-24T21:07:16.816066] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-24T21:07:16.878064] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T21:07:17.384233] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T21:07:17.616165] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-24T21:07:18.416160] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-24T21:07:18.615413] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:07:18.819818] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T21:07:19.216164] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-24T21:07:19.328772] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T21:07:20.016119] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-24T21:07:20.665504] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T21:07:20.816127] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-24T21:07:21.616125] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-24T21:07:21.815774] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-24T21:07:22.411187] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-24T21:07:22.422018] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-24T21:07:22.947402] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T21:07:23.216105] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-24T21:07:23.337286] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T21:07:24.016107] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-24T21:07:24.696813] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:07:24.816085] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-24T21:07:25.616142] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-24T21:07:26.263915] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T21:07:26.416096] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-24T21:07:26.459878] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T21:07:26.468741] [INFO ] [REMOTE ] SA: Full fetch complete (61901 records). [2025-09-24T21:07:26.468865] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-24T21:07:26.579100] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T21:07:26.587385] [INFO ] [REMOTE ] SABA: Full fetch complete (15493 records). [2025-09-24T21:07:26.603158] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-24T21:07:27.227704] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-24T21:07:27.250266] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-24T21:07:27.268790] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-24T21:07:27.302273] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-24T21:07:27.314078] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-24T21:07:27.355051] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-24T21:07:27.355166] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-24T21:07:27.355412] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-24T21:07:27.355948] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-24T21:07:27.357715] [DEBUG] [LOCAL ] SABA: Trimmed 15493 records to 9195 (keeping 200 days of data) [2025-09-24T21:07:27.357960] [DEBUG] [LOCAL ] SA: Trimmed 61901 records to 43111 (keeping 200 days of data) [2025-09-24T21:07:27.533088] [DEBUG] [LOCAL ] SABA: Primary data saved (9195 records). [2025-09-24T21:07:27.534265] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-24T21:07:27.534722] [INFO ] [MAIN ] Update Progress: 1860/2373 symbols completed. SABA took 31.2s. Estimated remaining: 1h 8m 14s. Rate: 7.5 symbols/min [2025-09-24T21:07:27.759170] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:27.874147] [DEBUG] [LOCAL ] SAH: Loaded 22127 existing records from primary storage. [2025-09-24T21:07:27.875512] [INFO ] [MAIN ] SAH: Loaded 22127 existing records. [2025-09-24T21:07:28.127537] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:28.129847] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-24T21:07:28.130221] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-24T21:07:28.131822] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-24T21:07:28.131899] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-24T21:07:28.572776] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:28.574572] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-24T21:07:28.579838] [DEBUG] [LOCAL ] SA: Primary data saved (43111 records). [2025-09-24T21:07:28.580417] [INFO ] [MAIN ] SA: Full history saved. [2025-09-24T21:07:28.587898] [INFO ] [MAIN ] Update Progress: 1861/2373 symbols completed. SA took 33.8s. Estimated remaining: 1h 8m 4s. Rate: 7.5 symbols/min [2025-09-24T21:07:28.642921] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:07:28.757212] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T21:07:28.811946] [INFO ] [REMOTE ] S: Full fetch complete (77555 records). [2025-09-24T21:07:28.847252] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-24T21:07:28.820592] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-24T21:07:28.847098] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:28.848851] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-24T21:07:28.849062] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-24T21:07:28.849235] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-24T21:07:28.849281] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-24T21:07:28.849325] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-24T21:07:28.849363] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-24T21:07:29.618337] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:29.635707] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-24T21:07:29.710142] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-24T21:07:29.712623] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-24T21:07:29.714784] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-24T21:07:29.715820] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-24T21:07:29.717071] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:07:29.722166] [DEBUG] [LOCAL ] S: Trimmed 77555 records to 53544 (keeping 200 days of data) [2025-09-24T21:07:30.090172] [DEBUG] [LOCAL ] S: Primary data saved (53544 records). [2025-09-24T21:07:30.090400] [INFO ] [MAIN ] S: Full history saved. [2025-09-24T21:07:30.090512] [INFO ] [MAIN ] Update Progress: 1862/2373 symbols completed. S took 45.3s. Estimated remaining: 1h 7m 54s. Rate: 7.5 symbols/min [2025-09-24T21:07:30.157340] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-24T21:07:30.228604] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T21:07:30.327488] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:30.353239] [DEBUG] [LOCAL ] SAM: Loaded 21593 existing records from primary storage. [2025-09-24T21:07:30.353494] [INFO ] [MAIN ] SAM: Loaded 21593 existing records. [2025-09-24T21:07:30.421479] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-24T21:07:30.554060] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:30.554714] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-24T21:07:30.554777] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-24T21:07:30.556158] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-24T21:07:30.556222] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-24T21:07:30.927200] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-24T21:07:30.956440] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:31.216118] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-24T21:07:32.016105] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-24T21:07:32.280703] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T21:07:32.560514] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T21:07:32.816130] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-24T21:07:33.616113] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-24T21:07:33.891071] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T21:07:33.981783] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-24T21:07:34.416100] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-24T21:07:35.216104] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-24T21:07:35.717370] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T21:07:36.016522] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-24T21:07:36.116279] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T21:07:36.816127] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-24T21:07:37.196087] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-24T21:07:37.491427] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T21:07:37.616090] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-24T21:07:38.016201] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-24T21:07:38.416120] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-24T21:07:39.216231] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-24T21:07:39.569064] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T21:07:40.016126] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-24T21:07:40.406546] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T21:07:40.816047] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-24T21:07:40.899914] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-24T21:07:41.616165] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-24T21:07:41.912956] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T21:07:42.416135] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-24T21:07:42.513516] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T21:07:43.216138] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-24T21:07:43.668308] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T21:07:43.675079] [INFO ] [REMOTE ] SAFE: Full fetch complete (45100 records). [2025-09-24T21:07:43.675312] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-24T21:07:44.016977] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-24T21:07:44.100004] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-24T21:07:44.100096] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-24T21:07:44.101020] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-24T21:07:44.101086] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-24T21:07:44.102122] [DEBUG] [LOCAL ] SAFE: Trimmed 45100 records to 30372 (keeping 200 days of data) [2025-09-24T21:07:44.288956] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T21:07:44.308547] [DEBUG] [LOCAL ] SAFE: Primary data saved (30372 records). [2025-09-24T21:07:44.308749] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-24T21:07:44.308881] [INFO ] [MAIN ] Update Progress: 1863/2373 symbols completed. SAFE took 38.8s. Estimated remaining: 1h 7m 48s. Rate: 7.5 symbols/min [2025-09-24T21:07:44.493161] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:44.556787] [DEBUG] [LOCAL ] SAN: Loaded 53020 existing records from primary storage. [2025-09-24T21:07:44.556950] [INFO ] [MAIN ] SAN: Loaded 53020 existing records. [2025-09-24T21:07:44.756931] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:44.757245] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-24T21:07:44.757301] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-24T21:07:44.758523] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-24T21:07:44.758600] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-24T21:07:44.821272] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-24T21:07:45.152712] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:45.413412] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T21:07:45.616183] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-24T21:07:46.105082] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T21:07:46.416125] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-24T21:07:46.688118] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T21:07:47.216105] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-24T21:07:47.614314] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T21:07:48.016097] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-24T21:07:48.305829] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T21:07:48.742855] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T21:07:48.816095] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-24T21:07:49.616058] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-24T21:07:50.009114] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:07:50.416134] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-24T21:07:51.216186] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-24T21:07:51.464323] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T21:07:51.638131] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T21:07:51.655762] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T21:07:51.660784] [INFO ] [REMOTE ] SAM: Full fetch complete (30359 records). [2025-09-24T21:07:51.661003] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-24T21:07:52.019562] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-24T21:07:52.064592] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-24T21:07:52.064888] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-24T21:07:52.065933] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-24T21:07:52.066061] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-24T21:07:52.068250] [DEBUG] [LOCAL ] SAM: Trimmed 30359 records to 21523 (keeping 200 days of data) [2025-09-24T21:07:52.219876] [DEBUG] [LOCAL ] SAM: Primary data saved (21523 records). [2025-09-24T21:07:52.220090] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-24T21:07:52.220332] [INFO ] [MAIN ] Update Progress: 1864/2373 symbols completed. SAM took 22.1s. Estimated remaining: 1h 7m 40s. Rate: 7.5 symbols/min [2025-09-24T21:07:52.403730] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:52.470317] [DEBUG] [LOCAL ] SAND: Loaded 51790 existing records from primary storage. [2025-09-24T21:07:52.470535] [INFO ] [MAIN ] SAND: Loaded 51790 existing records. [2025-09-24T21:07:52.670964] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:52.671310] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-24T21:07:52.671375] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-24T21:07:52.672984] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-24T21:07:52.673053] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-24T21:07:52.821343] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-24T21:07:53.071901] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:53.323785] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T21:07:53.616214] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-24T21:07:54.000845] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-24T21:07:54.002293] [INFO ] [REMOTE ] SAJ: Full fetch complete (920 records). [2025-09-24T21:07:54.002497] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-24T21:07:54.241306] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-24T21:07:54.267226] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-24T21:07:54.265425] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:07:54.278053] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:07:54.278981] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-24T21:07:54.279626] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-24T21:07:54.279746] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-24T21:07:54.279856] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-24T21:07:54.280028] [INFO ] [MAIN ] Update Progress: 1865/2373 symbols completed. SAJ took 25.7s. Estimated remaining: 1h 7m 31s. Rate: 7.5 symbols/min [2025-09-24T21:07:54.421349] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-24T21:07:54.483749] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:07:54.566669] [DEBUG] [LOCAL ] SAP: Loaded 50089 existing records from primary storage. [2025-09-24T21:07:54.566946] [INFO ] [MAIN ] SAP: Loaded 50089 existing records. [2025-09-24T21:07:54.765988] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:07:54.766334] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-24T21:07:54.766389] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-24T21:07:54.768170] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-24T21:07:54.768236] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-24T21:07:55.147190] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:07:55.216160] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-24T21:07:55.853427] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T21:07:56.016145] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-24T21:07:56.817267] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-24T21:07:56.828200] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:07:57.616113] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-24T21:07:57.908692] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T21:07:58.401105] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-24T21:07:58.416039] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-24T21:07:58.817499] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T21:07:59.216073] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-24T21:07:59.474492] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T21:07:59.480098] [INFO ] [REMOTE ] SAH: Full fetch complete (30295 records). [2025-09-24T21:07:59.480272] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-24T21:07:59.898714] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-24T21:07:59.898848] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-24T21:07:59.899824] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-24T21:07:59.899927] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-24T21:07:59.901289] [DEBUG] [LOCAL ] SAH: Trimmed 30295 records to 22081 (keeping 200 days of data) [2025-09-24T21:08:00.016707] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-24T21:08:00.075592] [DEBUG] [LOCAL ] SAH: Primary data saved (22081 records). [2025-09-24T21:08:00.075921] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-24T21:08:00.076139] [INFO ] [MAIN ] Update Progress: 1866/2373 symbols completed. SAH took 32.5s. Estimated remaining: 1h 7m 22s. Rate: 7.5 symbols/min [2025-09-24T21:08:00.289131] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:00.318696] [DEBUG] [LOCAL ] SAR: Loaded 16084 existing records from primary storage. [2025-09-24T21:08:00.318904] [INFO ] [MAIN ] SAR: Loaded 16084 existing records. [2025-09-24T21:08:00.528888] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:08:00.529239] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-24T21:08:00.529307] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-24T21:08:00.530028] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-24T21:08:00.530102] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-24T21:08:00.829502] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-24T21:08:00.913914] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:01.242145] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T21:08:01.616101] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-24T21:08:02.104780] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-24T21:08:02.416103] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-24T21:08:02.801490] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T21:08:03.216100] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-24T21:08:03.654673] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T21:08:04.016214] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-24T21:08:04.273772] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T21:08:04.816104] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-24T21:08:05.280061] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-24T21:08:05.616074] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-24T21:08:05.811430] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T21:08:05.840763] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T21:08:06.416107] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-24T21:08:07.216121] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-24T21:08:07.263030] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T21:08:07.436451] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T21:08:08.016129] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-24T21:08:08.816079] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-24T21:08:09.100888] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T21:08:09.140565] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-24T21:08:09.616114] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-24T21:08:10.416073] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-24T21:08:10.489289] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:08:10.746540] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T21:08:11.216106] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-24T21:08:12.016083] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-24T21:08:12.433793] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T21:08:12.730297] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T21:08:12.816085] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-24T21:08:13.616092] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-24T21:08:14.149431] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-24T21:08:14.322555] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T21:08:14.332575] [INFO ] [REMOTE ] SAN: Full fetch complete (76199 records). [2025-09-24T21:08:14.332845] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-24T21:08:14.417165] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-24T21:08:14.626665] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T21:08:14.809408] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-24T21:08:14.809569] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-24T21:08:14.811445] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-24T21:08:14.811529] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-24T21:08:14.813808] [DEBUG] [LOCAL ] SAN: Trimmed 76199 records to 53018 (keeping 200 days of data) [2025-09-24T21:08:15.176487] [DEBUG] [LOCAL ] SAN: Primary data saved (53018 records). [2025-09-24T21:08:15.176719] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-24T21:08:15.176950] [INFO ] [MAIN ] Update Progress: 1867/2373 symbols completed. SAN took 30.9s. Estimated remaining: 1h 7m 16s. Rate: 7.5 symbols/min [2025-09-24T21:08:15.225719] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-24T21:08:15.364830] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:15.417618] [DEBUG] [LOCAL ] SARO: Loaded 48800 existing records from primary storage. [2025-09-24T21:08:15.417861] [INFO ] [MAIN ] SARO: Loaded 48800 existing records. [2025-09-24T21:08:15.606609] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:08:15.607063] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-24T21:08:15.607125] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-24T21:08:15.608673] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-24T21:08:15.608739] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-24T21:08:15.991158] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:16.016084] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-24T21:08:16.062500] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T21:08:16.397564] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-24T21:08:16.816103] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-24T21:08:17.330969] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T21:08:17.616096] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-24T21:08:18.416122] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-24T21:08:18.459944] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T21:08:19.216069] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-24T21:08:19.331837] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T21:08:19.557418] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-24T21:08:20.016150] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-24T21:08:20.816077] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-24T21:08:21.074567] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T21:08:21.545673] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T21:08:21.616112] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-24T21:08:21.900678] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T21:08:22.416152] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-24T21:08:23.048075] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T21:08:23.216165] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-24T21:08:24.016105] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-24T21:08:24.070787] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T21:08:24.074803] [INFO ] [REMOTE ] SAR: Full fetch complete (22428 records). [2025-09-24T21:08:24.074920] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-24T21:08:24.510411] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-24T21:08:24.510522] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-24T21:08:24.511333] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-24T21:08:24.511401] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-24T21:08:24.512252] [DEBUG] [LOCAL ] SAR: Trimmed 22428 records to 16123 (keeping 200 days of data) [2025-09-24T21:08:24.620839] [DEBUG] [LOCAL ] SAR: Primary data saved (16123 records). [2025-09-24T21:08:24.621136] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-24T21:08:24.621291] [INFO ] [MAIN ] Update Progress: 1868/2373 symbols completed. SAR took 24.5s. Estimated remaining: 1h 7m 8s. Rate: 7.5 symbols/min [2025-09-24T21:08:24.769625] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T21:08:24.840000] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-24T21:08:24.869277] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:24.869719] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-24T21:08:24.869777] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-24T21:08:24.869952] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-24T21:08:24.870005] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-24T21:08:24.870048] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-24T21:08:24.870080] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-24T21:08:25.245871] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:25.616104] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-24T21:08:25.987787] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:08:26.212323] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-24T21:08:26.416084] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-24T21:08:26.729803] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T21:08:27.216132] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-24T21:08:28.016148] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-24T21:08:28.196281] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T21:08:28.477691] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T21:08:28.816107] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-24T21:08:28.894443] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:08:28.904516] [INFO ] [REMOTE ] SAND: Full fetch complete (74325 records). [2025-09-24T21:08:28.904804] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-24T21:08:29.323734] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-24T21:08:29.323865] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-24T21:08:29.325394] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-24T21:08:29.325465] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-24T21:08:29.327450] [DEBUG] [LOCAL ] SAND: Trimmed 74325 records to 51770 (keeping 200 days of data) [2025-09-24T21:08:29.616181] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-24T21:08:29.707436] [DEBUG] [LOCAL ] SAND: Primary data saved (51770 records). [2025-09-24T21:08:29.707675] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-24T21:08:29.707819] [INFO ] [MAIN ] Update Progress: 1869/2373 symbols completed. SAND took 37.5s. Estimated remaining: 1h 6m 60s. Rate: 7.5 symbols/min [2025-09-24T21:08:29.886313] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:29.886596] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-24T21:08:29.886636] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-24T21:08:29.886832] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-24T21:08:29.886877] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-24T21:08:29.886919] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-24T21:08:29.886955] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-24T21:08:30.273395] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:30.416218] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-24T21:08:30.852091] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-24T21:08:30.974868] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-24T21:08:31.216151] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-24T21:08:31.458066] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T21:08:31.629401] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-24T21:08:32.016108] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-24T21:08:32.816117] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-24T21:08:33.279622] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T21:08:33.616164] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-24T21:08:33.976467] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-24T21:08:34.066514] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T21:08:34.416132] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-24T21:08:34.806350] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-24T21:08:35.216110] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-24T21:08:35.699394] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T21:08:36.016106] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-24T21:08:36.460902] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-24T21:08:36.816157] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-24T21:08:37.616109] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-24T21:08:38.098017] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T21:08:38.416144] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-24T21:08:38.488208] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:08:38.908595] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T21:08:39.216112] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-24T21:08:39.690228] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T21:08:40.016082] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-24T21:08:40.408932] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-24T21:08:40.816139] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-24T21:08:41.616160] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-24T21:08:42.121157] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-24T21:08:42.378074] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T21:08:42.416081] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-24T21:08:43.216122] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-24T21:08:43.615590] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-24T21:08:43.975927] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T21:08:43.984052] [INFO ] [REMOTE ] SARO: Full fetch complete (69106 records). [2025-09-24T21:08:43.984169] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-24T21:08:44.021165] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-24T21:08:44.395472] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-24T21:08:44.395560] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-24T21:08:44.396676] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-24T21:08:44.396748] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-24T21:08:44.398221] [DEBUG] [LOCAL ] SARO: Trimmed 69106 records to 48764 (keeping 200 days of data) [2025-09-24T21:08:44.508347] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T21:08:44.692547] [DEBUG] [LOCAL ] SARO: Primary data saved (48764 records). [2025-09-24T21:08:44.692713] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-24T21:08:44.692812] [INFO ] [MAIN ] Update Progress: 1870/2373 symbols completed. SARO took 29.5s. Estimated remaining: 1h 6m 54s. Rate: 7.5 symbols/min [2025-09-24T21:08:44.821252] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-24T21:08:44.869003] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:44.869146] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-24T21:08:44.869184] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-24T21:08:44.869325] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-24T21:08:44.869367] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-24T21:08:44.869408] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-24T21:08:44.869441] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-24T21:08:45.249067] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:45.356012] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-24T21:08:45.616128] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-24T21:08:46.051263] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T21:08:46.052222] [INFO ] [REMOTE ] SAY: Full fetch complete (1439 records). [2025-09-24T21:08:46.052299] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-24T21:08:46.242032] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-24T21:08:46.242332] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:08:46.242383] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:08:46.242426] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-24T21:08:46.242493] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-24T21:08:46.242533] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-24T21:08:46.242722] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-24T21:08:46.242820] [INFO ] [MAIN ] Update Progress: 1871/2373 symbols completed. SAY took 16.5s. Estimated remaining: 1h 6m 44s. Rate: 7.5 symbols/min [2025-09-24T21:08:46.421301] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-24T21:08:46.424667] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:46.466152] [DEBUG] [LOCAL ] SB: Loaded 33273 existing records from primary storage. [2025-09-24T21:08:46.466407] [INFO ] [MAIN ] SB: Loaded 33273 existing records. [2025-09-24T21:08:46.655927] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:08:46.656282] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-24T21:08:46.656336] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-24T21:08:46.657477] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-24T21:08:46.657545] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-24T21:08:46.955423] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T21:08:47.051390] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:47.216120] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-24T21:08:48.016119] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-24T21:08:48.823756] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-24T21:08:48.842852] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T21:08:49.246374] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-24T21:08:49.616118] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-24T21:08:50.005685] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-24T21:08:50.006611] [INFO ] [REMOTE ] SAT: Full fetch complete (1603 records). [2025-09-24T21:08:50.006827] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-24T21:08:50.220330] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-24T21:08:50.223590] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:08:50.223755] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:08:50.224133] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-24T21:08:50.226720] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-24T21:08:50.224840] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-24T21:08:50.227005] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-24T21:08:50.242753] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-24T21:08:50.242874] [INFO ] [MAIN ] Update Progress: 1872/2373 symbols completed. SAT took 25.6s. Estimated remaining: 1h 6m 35s. Rate: 7.5 symbols/min [2025-09-24T21:08:50.421999] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:50.420202] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-24T21:08:50.423179] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-24T21:08:50.423255] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-24T21:08:50.423463] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-24T21:08:50.423519] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-24T21:08:50.423565] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-24T21:08:50.423600] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-24T21:08:50.788476] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:50.939292] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T21:08:51.216079] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-24T21:08:51.668129] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T21:08:52.016147] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-24T21:08:52.298062] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:08:52.298395] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-24T21:08:52.816141] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-24T21:08:53.352099] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T21:08:53.616086] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-24T21:08:54.416108] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-24T21:08:54.917969] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T21:08:55.216121] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-24T21:08:55.655975] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-24T21:08:55.720631] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-24T21:08:56.016178] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-24T21:08:56.816197] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-24T21:08:57.078365] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:08:57.079024] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-24T21:08:57.616122] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-24T21:08:57.923953] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:08:57.924431] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-24T21:08:58.007804] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-24T21:08:58.018323] [INFO ] [REMOTE ] SAP: Full fetch complete (71640 records). [2025-09-24T21:08:58.018599] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-24T21:08:58.418585] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-24T21:08:58.420456] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-24T21:08:58.420590] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-24T21:08:58.421980] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-24T21:08:58.422133] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-24T21:08:58.424888] [DEBUG] [LOCAL ] SAP: Trimmed 71640 records to 50074 (keeping 200 days of data) [2025-09-24T21:08:58.762609] [DEBUG] [LOCAL ] SAP: Primary data saved (50074 records). [2025-09-24T21:08:58.762774] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-24T21:08:58.762864] [INFO ] [MAIN ] Update Progress: 1873/2373 symbols completed. SAP took 1m 4s. Estimated remaining: 1h 6m 27s. Rate: 7.5 symbols/min [2025-09-24T21:08:58.879890] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T21:08:58.960992] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:08:59.015746] [DEBUG] [LOCAL ] SBH: Loaded 49832 existing records from primary storage. [2025-09-24T21:08:59.015963] [INFO ] [MAIN ] SBH: Loaded 49832 existing records. [2025-09-24T21:08:59.216915] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-24T21:08:59.220963] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:08:59.222369] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-24T21:08:59.222423] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-24T21:08:59.223742] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-24T21:08:59.223812] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-24T21:08:59.592320] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:08:59.635276] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:08:59.635434] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-24T21:09:00.016136] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-24T21:09:00.451991] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T21:09:00.816100] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-24T21:09:01.120555] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:09:01.120956] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-24T21:09:01.616099] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-24T21:09:02.416106] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-24T21:09:02.855867] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T21:09:03.216102] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-24T21:09:03.513673] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:09:03.514065] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-24T21:09:04.016105] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-24T21:09:04.816100] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-24T21:09:05.092702] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:09:05.093045] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-24T21:09:05.440939] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-24T21:09:05.613607] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T21:09:05.621234] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-24T21:09:06.052961] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T21:09:06.053827] [INFO ] [REMOTE ] SAZ: Full fetch complete (1813 records). [2025-09-24T21:09:06.053899] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-24T21:09:06.239591] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T21:09:06.239807] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:09:06.239866] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:09:06.239933] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-24T21:09:06.240000] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-24T21:09:06.240070] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-24T21:09:06.240152] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-24T21:09:06.240236] [INFO ] [MAIN ] Update Progress: 1874/2373 symbols completed. SAZ took 21.5s. Estimated remaining: 1h 6m 19s. Rate: 7.5 symbols/min [2025-09-24T21:09:06.427816] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:06.423349] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-24T21:09:06.438629] [DEBUG] [LOCAL ] SBI: Loaded 7771 existing records from primary storage. [2025-09-24T21:09:06.438788] [INFO ] [MAIN ] SBI: Loaded 7771 existing records. [2025-09-24T21:09:06.628292] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:06.628546] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-24T21:09:06.628598] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-24T21:09:06.629005] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-24T21:09:06.629068] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-24T21:09:06.917713] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T21:09:07.003955] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:07.216110] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-24T21:09:08.016159] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-24T21:09:08.656957] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T21:09:08.816136] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-24T21:09:09.034508] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T21:09:09.512776] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T21:09:09.514094] [INFO ] [REMOTE ] SBDS: Full fetch complete (1112 records). [2025-09-24T21:09:09.514163] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-24T21:09:09.617970] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-24T21:09:09.701060] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-24T21:09:09.701228] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:09:09.701274] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:09:09.701353] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-24T21:09:09.701415] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-24T21:09:09.701450] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-24T21:09:09.701489] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-24T21:09:09.701543] [INFO ] [MAIN ] Update Progress: 1875/2373 symbols completed. SBDS took 19.5s. Estimated remaining: 1h 6m 10s. Rate: 7.5 symbols/min [2025-09-24T21:09:09.870356] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:09.879566] [DEBUG] [LOCAL ] SBR: Loaded 7181 existing records from primary storage. [2025-09-24T21:09:09.879712] [INFO ] [MAIN ] SBR: Loaded 7181 existing records. [2025-09-24T21:09:10.054140] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:10.054373] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-24T21:09:10.054428] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-24T21:09:10.054821] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-24T21:09:10.054882] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-24T21:09:10.427191] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-24T21:09:10.434239] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:11.216167] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-24T21:09:11.295978] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T21:09:11.987927] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T21:09:12.009094] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T21:09:12.016039] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-24T21:09:12.816122] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-24T21:09:13.616153] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-24T21:09:13.879422] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T21:09:14.416103] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-24T21:09:14.802765] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T21:09:14.985791] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-24T21:09:15.216095] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-24T21:09:16.016111] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-24T21:09:16.131998] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T21:09:16.816083] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-24T21:09:17.258999] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-24T21:09:17.576326] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T21:09:17.616074] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-24T21:09:17.654995] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T21:09:18.326540] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T21:09:18.416106] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-24T21:09:19.216118] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-24T21:09:19.226872] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T21:09:20.016101] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-24T21:09:20.821245] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-24T21:09:20.836475] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T21:09:21.468425] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:09:21.616060] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-24T21:09:21.688935] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T21:09:22.416100] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-24T21:09:23.174311] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T21:09:23.204885] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T21:09:23.216035] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-24T21:09:24.016094] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-24T21:09:24.816160] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-24T21:09:24.948376] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T21:09:25.199762] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T21:09:25.455912] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T21:09:25.616092] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-24T21:09:26.416176] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-24T21:09:26.437169] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T21:09:27.216146] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-24T21:09:27.871426] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T21:09:28.016124] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-24T21:09:28.057998] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T21:09:28.816045] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-24T21:09:28.968345] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T21:09:29.609545] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T21:09:29.616042] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-24T21:09:30.285459] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T21:09:30.287238] [INFO ] [REMOTE ] SBI: Full fetch complete (10701 records). [2025-09-24T21:09:30.287326] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-24T21:09:30.421176] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-24T21:09:30.697843] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-24T21:09:30.697926] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-24T21:09:30.698251] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-24T21:09:30.698290] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-24T21:09:30.698765] [DEBUG] [LOCAL ] SBI: Trimmed 10701 records to 7787 (keeping 200 days of data) [2025-09-24T21:09:30.744542] [DEBUG] [LOCAL ] SBI: Primary data saved (7787 records). [2025-09-24T21:09:30.744698] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-24T21:09:30.744813] [INFO ] [MAIN ] Update Progress: 1876/2373 symbols completed. SBI took 24.5s. Estimated remaining: 1h 6m 5s. Rate: 7.5 symbols/min [2025-09-24T21:09:30.917908] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:30.967982] [DEBUG] [LOCAL ] SBS: Loaded 49477 existing records from primary storage. [2025-09-24T21:09:30.968145] [INFO ] [MAIN ] SBS: Loaded 49477 existing records. [2025-09-24T21:09:31.150354] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:31.150619] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-24T21:09:31.150698] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-24T21:09:31.151783] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-24T21:09:31.151844] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-24T21:09:31.221284] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-24T21:09:31.512585] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:31.898054] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T21:09:31.911752] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T21:09:32.016156] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-24T21:09:32.816170] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-24T21:09:33.282926] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T21:09:33.616142] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-24T21:09:34.416207] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-24T21:09:34.476771] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:09:35.035445] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:09:35.216315] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-24T21:09:35.216694] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T21:09:36.016139] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-24T21:09:36.778402] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T21:09:36.816103] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-24T21:09:36.975538] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T21:09:36.981058] [INFO ] [REMOTE ] SB: Full fetch complete (50577 records). [2025-09-24T21:09:36.981165] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-24T21:09:37.428446] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-24T21:09:37.428529] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-24T21:09:37.429522] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-24T21:09:37.429589] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-24T21:09:37.430732] [DEBUG] [LOCAL ] SB: Trimmed 50577 records to 33316 (keeping 200 days of data) [2025-09-24T21:09:37.616278] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-24T21:09:37.633951] [DEBUG] [LOCAL ] SB: Primary data saved (33316 records). [2025-09-24T21:09:37.634102] [INFO ] [MAIN ] SB: Full history saved. [2025-09-24T21:09:37.634192] [INFO ] [MAIN ] Update Progress: 1877/2373 symbols completed. SB took 51.4s. Estimated remaining: 1h 5m 57s. Rate: 7.5 symbols/min [2025-09-24T21:09:38.413967] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:09:38.422478] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-24T21:09:38.995483] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T21:09:39.005052] [INFO ] [REMOTE ] SBH: Full fetch complete (72806 records). [2025-09-24T21:09:39.005201] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-24T21:09:39.216322] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-24T21:09:39.216942] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T21:09:39.415006] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-24T21:09:39.415095] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-24T21:09:39.416294] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-24T21:09:39.416360] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-24T21:09:39.417919] [DEBUG] [LOCAL ] SBH: Trimmed 72806 records to 49829 (keeping 200 days of data) [2025-09-24T21:09:39.712853] [DEBUG] [LOCAL ] SBH: Primary data saved (49829 records). [2025-09-24T21:09:39.712999] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-24T21:09:39.713141] [INFO ] [MAIN ] Update Progress: 1878/2373 symbols completed. SBH took 41.0s. Estimated remaining: 1h 5m 47s. Rate: 7.5 symbols/min [2025-09-24T21:09:40.016174] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-24T21:09:40.882843] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T21:09:40.885862] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-24T21:09:41.104976] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T21:09:41.616146] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-24T21:09:41.705671] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T21:09:41.707950] [INFO ] [REMOTE ] SBR: Full fetch complete (11028 records). [2025-09-24T21:09:41.708029] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-24T21:09:42.103436] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-24T21:09:42.103635] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-24T21:09:42.104051] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-24T21:09:42.104101] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-24T21:09:42.105021] [DEBUG] [LOCAL ] SBR: Trimmed 11028 records to 7179 (keeping 200 days of data) [2025-09-24T21:09:42.160072] [DEBUG] [LOCAL ] SBR: Primary data saved (7179 records). [2025-09-24T21:09:42.160300] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-24T21:09:42.160425] [INFO ] [MAIN ] Update Progress: 1879/2373 symbols completed. SBR took 32.5s. Estimated remaining: 1h 5m 38s. Rate: 7.5 symbols/min [2025-09-24T21:09:43.581084] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T21:09:43.592677] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-24T21:09:45.151225] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T21:09:45.162332] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-24T21:09:46.864978] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T21:09:46.874912] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-24T21:09:48.586173] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T21:09:48.597571] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-24T21:09:50.325049] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T21:09:50.337222] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-24T21:09:51.982372] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T21:09:51.992250] [INFO ] [REMOTE ] SBS: Full fetch complete (70147 records). [2025-09-24T21:09:51.992413] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-24T21:09:52.432991] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-24T21:09:52.433116] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-24T21:09:52.434340] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-24T21:09:52.434413] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-24T21:09:52.438560] [DEBUG] [LOCAL ] SBS: Trimmed 70147 records to 49512 (keeping 200 days of data) [2025-09-24T21:09:52.749380] [DEBUG] [LOCAL ] SBS: Primary data saved (49512 records). [2025-09-24T21:09:52.749524] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-24T21:09:52.749615] [INFO ] [MAIN ] Update Progress: 1880/2373 symbols completed. SBS took 22.0s. Estimated remaining: 1h 5m 31s. Rate: 7.5 symbols/min [2025-09-24T21:09:53.319264] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:53.409613] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:53.432552] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-24T21:09:53.455699] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-24T21:09:53.519021] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:53.497452] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:09:53.519497] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-24T21:09:53.520454] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-24T21:09:53.520674] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-24T21:09:53.521496] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-24T21:09:53.699099] [DEBUG] [LOCAL ] SBSI: Loaded 14715 existing records from primary storage. [2025-09-24T21:09:53.704414] [INFO ] [MAIN ] SBSI: Loaded 14715 existing records. [2025-09-24T21:09:53.940232] [DEBUG] [LOCAL ] SBSW: Loaded 52951 existing records from primary storage. [2025-09-24T21:09:54.010193] [INFO ] [MAIN ] SBSW: Loaded 52951 existing records. [2025-09-24T21:09:54.057098] [DEBUG] [LOCAL ] SCCO: Loaded 49382 existing records from primary storage. [2025-09-24T21:09:54.070296] [INFO ] [MAIN ] SCCO: Loaded 49382 existing records. [2025-09-24T21:09:54.441682] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:54.421339] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:54.478124] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-24T21:09:54.511497] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-24T21:09:54.518357] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-24T21:09:54.602418] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-24T21:09:54.602616] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-24T21:09:54.579436] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:54.631215] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:09:54.655172] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-24T21:09:54.668367] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-24T21:09:54.689915] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-24T21:09:54.690012] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-24T21:09:54.700472] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-24T21:09:54.700547] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-24T21:09:54.730736] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-24T21:09:54.755745] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-24T21:09:55.023998] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-24T21:09:55.073127] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-24T21:09:55.554054] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T21:09:55.599885] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-24T21:09:55.668179] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:55.692190] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-24T21:09:55.797258] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:55.845591] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-24T21:09:55.853179] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:09:55.853609] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-24T21:09:56.154522] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T21:09:56.155436] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-24T21:09:56.461006] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-24T21:09:56.461989] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-24T21:09:56.810123] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-24T21:09:56.811252] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-24T21:09:56.881224] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T21:09:56.884858] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-24T21:09:57.241022] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T21:09:57.242038] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-24T21:09:57.565259] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:09:57.575119] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-24T21:09:57.744944] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T21:09:57.755624] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-24T21:09:57.776291] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T21:09:57.780061] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-24T21:09:58.142328] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T21:09:58.145327] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-24T21:09:58.679282] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T21:09:58.683673] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-24T21:09:58.720029] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T21:09:59.216092] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-24T21:09:59.293050] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T21:09:59.608449] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T21:09:59.642848] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T21:09:59.736333] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T21:10:00.016150] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-24T21:10:00.816107] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-24T21:10:01.335429] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T21:10:01.336334] [INFO ] [REMOTE ] SBXD: Full fetch complete (3082 records). [2025-09-24T21:10:01.336404] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-24T21:10:01.546787] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-24T21:10:01.547040] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:10:01.547112] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:10:01.547184] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-24T21:10:01.547252] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-24T21:10:01.547289] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-24T21:10:01.547344] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-24T21:10:01.547442] [INFO ] [MAIN ] Update Progress: 1881/2373 symbols completed. SBXD took 8.8s. Estimated remaining: 1h 5m 23s. Rate: 7.5 symbols/min [2025-09-24T21:10:01.621277] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-24T21:10:01.743188] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:01.762717] [DEBUG] [LOCAL ] SCD: Loaded 12580 existing records from primary storage. [2025-09-24T21:10:01.762889] [INFO ] [MAIN ] SCD: Loaded 12580 existing records. [2025-09-24T21:10:01.970216] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:01.970961] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-24T21:10:01.971041] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-24T21:10:01.972024] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-24T21:10:01.972190] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-24T21:10:02.332336] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-24T21:10:02.423747] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-24T21:10:02.454987] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:02.474072] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T21:10:03.216094] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-24T21:10:04.016114] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-24T21:10:04.084551] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T21:10:04.335162] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:10:04.816139] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-24T21:10:04.927301] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T21:10:05.616106] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-24T21:10:06.416132] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-24T21:10:06.769753] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T21:10:07.216074] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-24T21:10:07.537130] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T21:10:07.545848] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-24T21:10:08.016105] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-24T21:10:08.740624] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:10:08.816131] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-24T21:10:09.169531] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T21:10:09.323179] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T21:10:09.616111] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-24T21:10:10.416138] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-24T21:10:11.216077] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-24T21:10:11.267758] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-24T21:10:11.525849] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:10:12.016103] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-24T21:10:12.182962] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T21:10:12.816087] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-24T21:10:13.616079] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-24T21:10:13.853777] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T21:10:13.852183] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T21:10:14.416172] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-24T21:10:15.216152] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-24T21:10:15.970875] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T21:10:16.016151] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-24T21:10:16.118595] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T21:10:16.364920] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T21:10:16.816082] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-24T21:10:17.616145] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-24T21:10:18.128532] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-24T21:10:18.416148] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-24T21:10:18.581699] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T21:10:18.600857] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T21:10:18.605331] [INFO ] [REMOTE ] SBSI: Full fetch complete (21134 records). [2025-09-24T21:10:18.605528] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-24T21:10:18.996015] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-24T21:10:18.996134] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-24T21:10:18.996984] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-24T21:10:18.997089] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-24T21:10:18.998508] [DEBUG] [LOCAL ] SBSI: Trimmed 21134 records to 14749 (keeping 200 days of data) [2025-09-24T21:10:19.098363] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T21:10:19.115839] [DEBUG] [LOCAL ] SBSI: Primary data saved (14749 records). [2025-09-24T21:10:19.115978] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-24T21:10:19.116229] [INFO ] [MAIN ] Update Progress: 1882/2373 symbols completed. SBSI took 26.4s. Estimated remaining: 1h 5m 17s. Rate: 7.5 symbols/min [2025-09-24T21:10:19.216848] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-24T21:10:19.293237] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:19.293413] [DEBUG] [LOCAL ] SCHW: No existing data file found in primary storage. [2025-09-24T21:10:19.293452] [WARN ] [MAIN ] SCHW: No existing data found, performing full refresh instead. [2025-09-24T21:10:19.293639] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-24T21:10:19.293739] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-24T21:10:19.293811] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-09-24T21:10:19.293858] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-24T21:10:19.658497] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:20.016120] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-24T21:10:20.816063] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-24T21:10:21.196926] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T21:10:21.236285] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-24T21:10:21.616094] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-24T21:10:22.416113] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-24T21:10:22.576289] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T21:10:22.593404] [INFO ] [REMOTE ] SCCO: Full fetch complete (70765 records). [2025-09-24T21:10:22.593595] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-24T21:10:23.030084] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-24T21:10:23.030210] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-24T21:10:23.031465] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-24T21:10:23.031558] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-24T21:10:23.033767] [DEBUG] [LOCAL ] SCCO: Trimmed 70765 records to 49388 (keeping 200 days of data) [2025-09-24T21:10:23.246219] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-24T21:10:23.384360] [DEBUG] [LOCAL ] SCCO: Primary data saved (49388 records). [2025-09-24T21:10:23.384504] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-24T21:10:23.384628] [INFO ] [MAIN ] Update Progress: 1883/2373 symbols completed. SCCO took 30.6s. Estimated remaining: 1h 5m 8s. Rate: 7.5 symbols/min [2025-09-24T21:10:23.586587] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:23.632448] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-24T21:10:23.684274] [DEBUG] [LOCAL ] SCI: Loaded 46696 existing records from primary storage. [2025-09-24T21:10:23.684424] [INFO ] [MAIN ] SCI: Loaded 46696 existing records. [2025-09-24T21:10:23.862129] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:23.862426] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-24T21:10:23.862489] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-24T21:10:23.863872] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-24T21:10:23.863975] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-24T21:10:24.021179] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-24T21:10:24.260758] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:24.278035] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T21:10:24.494138] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-24T21:10:24.816091] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-24T21:10:25.616116] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-24T21:10:25.797514] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T21:10:26.043362] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-24T21:10:26.416142] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-24T21:10:27.216172] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-24T21:10:27.421624] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T21:10:28.016078] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-24T21:10:28.354031] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-24T21:10:28.426946] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T21:10:28.816107] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-24T21:10:29.616170] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-24T21:10:30.054695] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T21:10:30.065807] [INFO ] [REMOTE ] SBSW: Full fetch complete (76483 records). [2025-09-24T21:10:30.066026] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-24T21:10:30.424200] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-24T21:10:30.489821] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-24T21:10:30.490070] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-24T21:10:30.491542] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-24T21:10:30.491633] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-24T21:10:30.504978] [DEBUG] [LOCAL ] SBSW: Trimmed 76483 records to 52965 (keeping 200 days of data) [2025-09-24T21:10:30.532742] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T21:10:30.894005] [DEBUG] [LOCAL ] SBSW: Primary data saved (52965 records). [2025-09-24T21:10:30.894743] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-24T21:10:30.895068] [INFO ] [MAIN ] Update Progress: 1884/2373 symbols completed. SBSW took 38.1s. Estimated remaining: 1h 5m 0s. Rate: 7.5 symbols/min [2025-09-24T21:10:31.080180] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:31.097533] [DEBUG] [LOCAL ] SCL: Loaded 14790 existing records from primary storage. [2025-09-24T21:10:31.097714] [INFO ] [MAIN ] SCL: Loaded 14790 existing records. [2025-09-24T21:10:31.216999] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-24T21:10:31.293936] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:31.294273] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-24T21:10:31.294335] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-24T21:10:31.295256] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-24T21:10:31.295321] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-24T21:10:31.568674] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:10:31.600500] [INFO ] [REMOTE ] SCD: Full fetch complete (16216 records). [2025-09-24T21:10:31.628931] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-24T21:10:31.746768] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-24T21:10:31.753974] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:32.027532] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-24T21:10:32.210328] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-24T21:10:32.210420] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-24T21:10:32.210834] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-24T21:10:32.210894] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-24T21:10:32.212167] [DEBUG] [LOCAL ] SCD: Trimmed 16216 records to 12596 (keeping 200 days of data) [2025-09-24T21:10:32.299795] [DEBUG] [LOCAL ] SCD: Primary data saved (12596 records). [2025-09-24T21:10:32.299937] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-24T21:10:32.300046] [INFO ] [MAIN ] Update Progress: 1885/2373 symbols completed. SCD took 30.8s. Estimated remaining: 1h 4m 51s. Rate: 7.5 symbols/min [2025-09-24T21:10:32.476502] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:32.501555] [DEBUG] [LOCAL ] SCM: Loaded 19814 existing records from primary storage. [2025-09-24T21:10:32.501718] [INFO ] [MAIN ] SCM: Loaded 19814 existing records. [2025-09-24T21:10:32.694220] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:32.695490] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-24T21:10:32.695548] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-24T21:10:32.696790] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-24T21:10:32.696852] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-24T21:10:32.818483] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-24T21:10:33.089781] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:33.102099] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T21:10:33.616077] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-24T21:10:33.703228] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:10:33.808373] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T21:10:34.416102] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-24T21:10:35.216149] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-24T21:10:35.456228] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T21:10:35.504397] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-24T21:10:36.016147] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-24T21:10:36.347750] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T21:10:36.816110] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-24T21:10:36.964494] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T21:10:37.616117] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-24T21:10:38.416144] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-24T21:10:38.604312] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T21:10:38.786101] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T21:10:39.216098] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-24T21:10:40.016083] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-24T21:10:40.306432] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T21:10:40.816076] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-24T21:10:41.084694] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T21:10:41.157549] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T21:10:41.616122] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-24T21:10:42.416187] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-24T21:10:42.664583] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T21:10:43.172374] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-24T21:10:43.216144] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-24T21:10:43.926916] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-24T21:10:44.016107] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-24T21:10:44.556334] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-24T21:10:44.616017] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T21:10:44.816088] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-24T21:10:45.616118] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-24T21:10:45.941053] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T21:10:46.416583] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-24T21:10:46.884424] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T21:10:47.126875] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T21:10:47.216100] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-24T21:10:48.016113] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-24T21:10:48.151735] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-24T21:10:48.163532] [INFO ] [REMOTE ] SCHW: Full fetch complete (77702 records). [2025-09-24T21:10:48.163714] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-24T21:10:48.598043] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-24T21:10:48.598146] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-24T21:10:48.599406] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-24T21:10:48.599474] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-24T21:10:48.604397] [DEBUG] [LOCAL ] SCHW: Trimmed 77702 records to 53685 (keeping 200 days of data) [2025-09-24T21:10:48.829820] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-24T21:10:48.957710] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-09-24T21:10:48.957875] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-24T21:10:48.957992] [INFO ] [MAIN ] Update Progress: 1886/2373 symbols completed. SCHW took 29.8s. Estimated remaining: 1h 4m 45s. Rate: 7.5 symbols/min [2025-09-24T21:10:49.130223] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:49.175742] [DEBUG] [LOCAL ] SCS: Loaded 43081 existing records from primary storage. [2025-09-24T21:10:49.175897] [INFO ] [MAIN ] SCS: Loaded 43081 existing records. [2025-09-24T21:10:49.363313] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:49.363571] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-24T21:10:49.363626] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-24T21:10:49.364883] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-24T21:10:49.364944] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-24T21:10:49.624013] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-24T21:10:49.741135] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:49.770965] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:10:50.069067] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T21:10:50.416150] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-24T21:10:50.731498] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T21:10:51.216087] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-24T21:10:51.599271] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T21:10:52.016048] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-24T21:10:52.334319] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T21:10:52.816115] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-24T21:10:53.150698] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T21:10:53.616090] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-24T21:10:54.016389] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T21:10:54.020561] [INFO ] [REMOTE ] SCL: Full fetch complete (21042 records). [2025-09-24T21:10:54.020688] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-24T21:10:54.403847] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-24T21:10:54.403945] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-24T21:10:54.404426] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-24T21:10:54.404467] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-24T21:10:54.405360] [DEBUG] [LOCAL ] SCL: Trimmed 21042 records to 14862 (keeping 200 days of data) [2025-09-24T21:10:54.445771] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-24T21:10:54.504495] [DEBUG] [LOCAL ] SCL: Primary data saved (14862 records). [2025-09-24T21:10:54.504667] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-24T21:10:54.504782] [INFO ] [MAIN ] Update Progress: 1887/2373 symbols completed. SCL took 23.6s. Estimated remaining: 1h 4m 36s. Rate: 7.5 symbols/min [2025-09-24T21:10:54.666233] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T21:10:54.693937] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:54.734271] [DEBUG] [LOCAL ] SD: Loaded 29043 existing records from primary storage. [2025-09-24T21:10:54.734440] [INFO ] [MAIN ] SD: Loaded 29043 existing records. [2025-09-24T21:10:54.915153] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:10:54.915424] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-24T21:10:54.915485] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-24T21:10:54.916509] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-24T21:10:54.916570] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-24T21:10:55.221147] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-24T21:10:55.283230] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:10:55.942296] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:10:56.016032] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-24T21:10:56.816093] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-24T21:10:56.988027] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T21:10:57.483769] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T21:10:57.616077] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-24T21:10:57.689852] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T21:10:58.416147] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-24T21:10:58.956779] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T21:10:58.964540] [INFO ] [REMOTE ] SCI: Full fetch complete (67207 records). [2025-09-24T21:10:58.964736] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-24T21:10:59.223323] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-24T21:10:59.368415] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-24T21:10:59.368517] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-24T21:10:59.369762] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-24T21:10:59.369835] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-24T21:10:59.371319] [DEBUG] [LOCAL ] SCI: Trimmed 67207 records to 46671 (keeping 200 days of data) [2025-09-24T21:10:59.684204] [DEBUG] [LOCAL ] SCI: Primary data saved (46671 records). [2025-09-24T21:10:59.684350] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-24T21:10:59.684444] [INFO ] [MAIN ] Update Progress: 1888/2373 symbols completed. SCI took 36.3s. Estimated remaining: 1h 4m 28s. Rate: 7.5 symbols/min [2025-09-24T21:10:59.866949] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:10:59.897081] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:10:59.919137] [DEBUG] [LOCAL ] SDHC: Loaded 10495 existing records from primary storage. [2025-09-24T21:10:59.919305] [INFO ] [MAIN ] SDHC: Loaded 10495 existing records. [2025-09-24T21:11:00.022281] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-24T21:11:00.114138] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:00.114436] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-24T21:11:00.114488] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-24T21:11:00.114906] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-24T21:11:00.114968] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-24T21:11:00.506745] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T21:11:00.525255] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:00.816085] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-24T21:11:01.281971] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T21:11:01.616117] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-24T21:11:01.728304] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T21:11:01.732700] [INFO ] [REMOTE ] SCM: Full fetch complete (28354 records). [2025-09-24T21:11:01.732883] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-24T21:11:02.130261] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-24T21:11:02.130345] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-24T21:11:02.131010] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-24T21:11:02.131070] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-24T21:11:02.131831] [DEBUG] [LOCAL ] SCM: Trimmed 28354 records to 19803 (keeping 200 days of data) [2025-09-24T21:11:02.270778] [DEBUG] [LOCAL ] SCM: Primary data saved (19803 records). [2025-09-24T21:11:02.270965] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-24T21:11:02.271064] [INFO ] [MAIN ] Update Progress: 1889/2373 symbols completed. SCM took 30.0s. Estimated remaining: 1h 4m 18s. Rate: 7.5 symbols/min [2025-09-24T21:11:02.417807] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-24T21:11:02.448168] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:02.462481] [DEBUG] [LOCAL ] SDHY: Loaded 10534 existing records from primary storage. [2025-09-24T21:11:02.462850] [INFO ] [MAIN ] SDHY: Loaded 10534 existing records. [2025-09-24T21:11:02.643555] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:02.655426] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-24T21:11:02.655500] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-24T21:11:02.657676] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-24T21:11:02.657771] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-24T21:11:02.657561] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:11:03.018022] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:03.216119] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-24T21:11:04.016092] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-24T21:11:04.169916] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T21:11:04.238138] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T21:11:04.816100] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-24T21:11:05.344551] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T21:11:05.616115] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-24T21:11:06.396453] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T21:11:06.416041] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-24T21:11:06.496759] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T21:11:06.976556] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T21:11:07.216141] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-24T21:11:08.016082] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-24T21:11:08.243445] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T21:11:08.816100] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-24T21:11:08.890570] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T21:11:09.616141] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-24T21:11:09.967181] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T21:11:10.416124] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-24T21:11:10.531501] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T21:11:11.216132] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-24T21:11:11.903565] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T21:11:12.016074] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-24T21:11:12.295760] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T21:11:12.816088] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-24T21:11:13.525099] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:11:13.616113] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-24T21:11:14.279448] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T21:11:14.392709] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T21:11:14.416082] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-24T21:11:15.216125] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-24T21:11:16.016089] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-24T21:11:16.134990] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T21:11:16.185895] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T21:11:16.797891] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T21:11:16.816073] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-24T21:11:17.591068] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-24T21:11:17.616069] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-24T21:11:18.416101] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-24T21:11:18.605436] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T21:11:19.216105] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-24T21:11:19.742274] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T21:11:19.952530] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T21:11:20.016148] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-24T21:11:20.816164] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-24T21:11:21.343712] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T21:11:21.414484] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T21:11:21.616111] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-24T21:11:22.416137] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-24T21:11:22.941604] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T21:11:23.216053] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-24T21:11:23.268160] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T21:11:24.016115] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-24T21:11:24.331728] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T21:11:24.816114] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-24T21:11:24.909732] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-24T21:11:25.616211] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-24T21:11:26.421961] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-24T21:11:26.433933] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T21:11:26.454874] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-24T21:11:27.216087] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-24T21:11:27.673243] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T21:11:27.678489] [INFO ] [REMOTE ] SD: Full fetch complete (41103 records). [2025-09-24T21:11:27.678603] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-24T21:11:27.893279] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-24T21:11:27.977548] [INFO ] [REMOTE ] SDHC: Full fetch complete (17011 records). [2025-09-24T21:11:27.988626] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-24T21:11:28.021272] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-24T21:11:28.235029] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-24T21:11:28.240275] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-24T21:11:28.246454] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-24T21:11:28.251688] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-24T21:11:28.348452] [DEBUG] [LOCAL ] SD: Trimmed 41103 records to 28979 (keeping 200 days of data) [2025-09-24T21:11:28.636856] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-24T21:11:28.641350] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-24T21:11:28.643130] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-24T21:11:28.643856] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-24T21:11:28.660196] [DEBUG] [LOCAL ] SDHC: Trimmed 17011 records to 10459 (keeping 200 days of data) [2025-09-24T21:11:28.775480] [DEBUG] [LOCAL ] SDHC: Primary data saved (10459 records). [2025-09-24T21:11:28.781715] [DEBUG] [LOCAL ] SD: Primary data saved (28979 records). [2025-09-24T21:11:28.782321] [INFO ] [MAIN ] SD: Full history saved. [2025-09-24T21:11:28.782097] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-24T21:11:28.782523] [INFO ] [MAIN ] Update Progress: 1890/2373 symbols completed. SDHC took 29.1s. Estimated remaining: 1h 4m 15s. Rate: 7.5 symbols/min [2025-09-24T21:11:28.783017] [INFO ] [MAIN ] Update Progress: 1891/2373 symbols completed. SD took 34.3s. Estimated remaining: 1h 4m 5s. Rate: 7.5 symbols/min [2025-09-24T21:11:28.817494] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-24T21:11:29.100284] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:29.165816] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:29.166380] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-24T21:11:29.166427] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-24T21:11:29.166604] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-24T21:11:29.166690] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-24T21:11:29.166759] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-24T21:11:29.166821] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-24T21:11:29.479115] [DEBUG] [LOCAL ] SDRL: Loaded 41969 existing records from primary storage. [2025-09-24T21:11:29.491928] [INFO ] [MAIN ] SDRL: Loaded 41969 existing records. [2025-09-24T21:11:29.713242] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:29.714052] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-24T21:11:29.798939] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:29.799436] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-24T21:11:29.806538] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-24T21:11:29.807510] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T21:11:29.810468] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-24T21:11:29.810779] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-24T21:11:29.810878] [INFO ] [REMOTE ] SDHY: Full fetch complete (16021 records). [2025-09-24T21:11:29.853824] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-24T21:11:30.351443] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-24T21:11:30.489894] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:30.511159] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-24T21:11:30.625208] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-24T21:11:30.625294] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-24T21:11:30.625836] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-24T21:11:30.625899] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-24T21:11:30.626467] [DEBUG] [LOCAL ] SDHY: Trimmed 16021 records to 10565 (keeping 200 days of data) [2025-09-24T21:11:30.691306] [DEBUG] [LOCAL ] SDHY: Primary data saved (10565 records). [2025-09-24T21:11:30.691458] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-24T21:11:30.691550] [INFO ] [MAIN ] Update Progress: 1892/2373 symbols completed. SDHY took 28.4s. Estimated remaining: 1h 3m 56s. Rate: 7.5 symbols/min [2025-09-24T21:11:30.873286] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:30.923877] [DEBUG] [LOCAL ] SEE: Loaded 48350 existing records from primary storage. [2025-09-24T21:11:30.924062] [INFO ] [MAIN ] SEE: Loaded 48350 existing records. [2025-09-24T21:11:31.116108] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:31.116369] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-24T21:11:31.116418] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-24T21:11:31.117856] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-24T21:11:31.117918] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-24T21:11:31.220317] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-24T21:11:31.487965] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:31.771095] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-24T21:11:32.016071] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-24T21:11:32.265241] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:11:32.273806] [INFO ] [REMOTE ] SCS: Full fetch complete (60125 records). [2025-09-24T21:11:32.273921] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-24T21:11:32.674534] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-24T21:11:32.674769] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-24T21:11:32.675942] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-24T21:11:32.676067] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-24T21:11:32.678070] [DEBUG] [LOCAL ] SCS: Trimmed 60125 records to 43120 (keeping 200 days of data) [2025-09-24T21:11:32.797990] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T21:11:32.818800] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-24T21:11:32.982676] [DEBUG] [LOCAL ] SCS: Primary data saved (43120 records). [2025-09-24T21:11:32.982822] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-24T21:11:32.982915] [INFO ] [MAIN ] Update Progress: 1893/2373 symbols completed. SCS took 44.0s. Estimated remaining: 1h 3m 46s. Rate: 7.5 symbols/min [2025-09-24T21:11:33.157459] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:33.172665] [DEBUG] [LOCAL ] SEG: Loaded 13771 existing records from primary storage. [2025-09-24T21:11:33.172783] [INFO ] [MAIN ] SEG: Loaded 13771 existing records. [2025-09-24T21:11:33.393368] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:33.393888] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-24T21:11:33.393945] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-24T21:11:33.394404] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-24T21:11:33.394466] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-24T21:11:33.624959] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-24T21:11:33.782096] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:33.795136] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T21:11:34.357443] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:11:34.416096] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-24T21:11:35.216308] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-24T21:11:35.683565] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T21:11:35.770629] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T21:11:36.016150] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-24T21:11:36.816138] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-24T21:11:36.899117] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T21:11:37.616128] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-24T21:11:37.694754] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:11:37.846398] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T21:11:38.416166] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-24T21:11:39.218399] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-24T21:11:39.224448] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:11:39.325283] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T21:11:40.016096] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-24T21:11:40.690378] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T21:11:40.816105] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-24T21:11:41.616064] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-24T21:11:41.805948] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T21:11:41.874746] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T21:11:42.416123] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-24T21:11:43.216107] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-24T21:11:43.869784] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-24T21:11:44.016109] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-24T21:11:44.354474] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T21:11:44.385200] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:11:44.816116] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-24T21:11:45.616097] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-24T21:11:46.188712] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-24T21:11:46.230879] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T21:11:46.416207] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-24T21:11:47.216125] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-24T21:11:47.396814] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T21:11:48.016095] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-24T21:11:48.227065] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T21:11:48.631180] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-24T21:11:48.816088] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-24T21:11:49.616070] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-24T21:11:49.853873] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T21:11:49.854936] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-24T21:11:50.416146] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-24T21:11:51.216068] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-24T21:11:51.401535] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T21:11:51.870356] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T21:11:51.906907] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T21:11:52.016139] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-24T21:11:52.730766] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-24T21:11:52.816094] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-24T21:11:53.616099] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-24T21:11:54.354239] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T21:11:54.376933] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T21:11:54.416140] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-24T21:11:55.216097] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-24T21:11:56.016124] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-24T21:11:56.555419] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-24T21:11:56.816384] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-24T21:11:56.825452] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-24T21:11:56.834430] [INFO ] [REMOTE ] SDRL: Full fetch complete (61899 records). [2025-09-24T21:11:56.834562] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-24T21:11:57.239132] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-24T21:11:57.239220] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-24T21:11:57.240292] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-24T21:11:57.240360] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-24T21:11:57.241725] [DEBUG] [LOCAL ] SDRL: Trimmed 61899 records to 41884 (keeping 200 days of data) [2025-09-24T21:11:57.497062] [DEBUG] [LOCAL ] SDRL: Primary data saved (41884 records). [2025-09-24T21:11:57.497220] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-24T21:11:57.497349] [INFO ] [MAIN ] Update Progress: 1894/2373 symbols completed. SDRL took 28.7s. Estimated remaining: 1h 3m 42s. Rate: 7.5 symbols/min [2025-09-24T21:11:57.619709] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-24T21:11:57.671902] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T21:11:57.700780] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:57.701085] [INFO ] [REMOTE ] SEG: Full fetch complete (19775 records). [2025-09-24T21:11:57.702443] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-24T21:11:57.862103] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T21:11:58.142724] [DEBUG] [LOCAL ] SEI: Loaded 49651 existing records from primary storage. [2025-09-24T21:11:58.153248] [INFO ] [MAIN ] SEI: Loaded 49651 existing records. [2025-09-24T21:11:58.352635] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-24T21:11:58.363164] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-24T21:11:58.383854] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-24T21:11:58.383984] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-24T21:11:58.418672] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-24T21:11:58.426211] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:58.427409] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-24T21:11:58.427140] [DEBUG] [LOCAL ] SEG: Trimmed 19775 records to 13754 (keeping 200 days of data) [2025-09-24T21:11:58.427680] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-24T21:11:58.429753] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-24T21:11:58.429832] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-24T21:11:58.642886] [DEBUG] [LOCAL ] SEG: Primary data saved (13754 records). [2025-09-24T21:11:58.653319] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-24T21:11:58.664699] [INFO ] [MAIN ] Update Progress: 1895/2373 symbols completed. SEG took 25.7s. Estimated remaining: 1h 3m 33s. Rate: 7.5 symbols/min [2025-09-24T21:11:59.053534] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:11:59.098486] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:59.142731] [DEBUG] [LOCAL ] SEM: Loaded 42958 existing records from primary storage. [2025-09-24T21:11:59.142901] [INFO ] [MAIN ] SEM: Loaded 42958 existing records. [2025-09-24T21:11:59.221579] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-24T21:11:59.342008] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:11:59.342274] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-24T21:11:59.342325] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-24T21:11:59.343449] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-24T21:11:59.343515] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-24T21:11:59.747773] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:11:59.808574] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T21:12:00.016098] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-24T21:12:00.132427] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T21:12:00.816086] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-24T21:12:01.007453] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T21:12:01.616062] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-24T21:12:01.954575] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T21:12:02.416147] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-24T21:12:03.216181] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-24T21:12:03.512130] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-24T21:12:04.016111] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-24T21:12:04.484865] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-24T21:12:04.769297] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-24T21:12:04.816115] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-24T21:12:05.616076] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-24T21:12:05.762840] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:12:05.771468] [INFO ] [REMOTE ] SEE: Full fetch complete (69572 records). [2025-09-24T21:12:05.771597] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-24T21:12:06.201095] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-24T21:12:06.201373] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-24T21:12:06.202635] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-24T21:12:06.202749] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-24T21:12:06.204716] [DEBUG] [LOCAL ] SEE: Trimmed 69572 records to 48341 (keeping 200 days of data) [2025-09-24T21:12:06.334709] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-24T21:12:06.440587] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-24T21:12:06.523677] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T21:12:06.600794] [DEBUG] [LOCAL ] SEE: Primary data saved (48341 records). [2025-09-24T21:12:06.600965] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-24T21:12:06.601063] [INFO ] [MAIN ] Update Progress: 1896/2373 symbols completed. SEE took 35.9s. Estimated remaining: 1h 3m 25s. Rate: 7.5 symbols/min [2025-09-24T21:12:06.778203] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:06.818452] [DEBUG] [LOCAL ] SEMR: Loaded 41612 existing records from primary storage. [2025-09-24T21:12:06.818590] [INFO ] [MAIN ] SEMR: Loaded 41612 existing records. [2025-09-24T21:12:07.023230] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:07.023674] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-24T21:12:07.023741] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-24T21:12:07.024996] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-24T21:12:07.025061] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-24T21:12:07.218663] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-24T21:12:07.417408] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:07.463385] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:12:07.476488] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-24T21:12:07.476676] [INFO ] [REMOTE ] SE: Full fetch complete (76681 records). [2025-09-24T21:12:07.479983] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-24T21:12:07.486340] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T21:12:07.486449] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:12:07.486493] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:12:07.486560] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-24T21:12:07.486627] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-24T21:12:07.486705] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-24T21:12:07.486785] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-09-24T21:12:07.486868] [INFO ] [MAIN ] Update Progress: 1897/2373 symbols completed. SE took 38.7s. Estimated remaining: 1h 3m 15s. Rate: 7.5 symbols/min [2025-09-24T21:12:07.658825] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:07.659077] [DEBUG] [LOCAL ] SES: No existing data file found in primary storage. [2025-09-24T21:12:07.659119] [WARN ] [MAIN ] SES: No existing data found, performing full refresh instead. [2025-09-24T21:12:07.659264] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-24T21:12:07.659306] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-24T21:12:07.659345] [DEBUG] [LOCAL ] SES: No primary data file found to delete. [2025-09-24T21:12:07.659377] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-24T21:12:08.029240] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-24T21:12:08.035527] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:08.821268] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-24T21:12:08.846790] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T21:12:09.478536] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T21:12:09.616102] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-24T21:12:10.416127] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-24T21:12:10.735005] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:12:11.216121] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-24T21:12:11.300560] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T21:12:12.016143] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-24T21:12:12.358498] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T21:12:12.816060] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-24T21:12:13.010993] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T21:12:13.616125] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-24T21:12:13.790782] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T21:12:14.416145] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-24T21:12:15.216194] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-24T21:12:15.368834] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T21:12:15.418362] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-24T21:12:16.016240] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-24T21:12:16.275079] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T21:12:16.816141] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-24T21:12:17.616161] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-24T21:12:17.768717] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-24T21:12:18.416205] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-24T21:12:18.965380] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T21:12:19.216137] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-24T21:12:19.253127] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-24T21:12:19.355252] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (3.34 seconds). [2025-09-24T21:12:19.761205] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T21:12:20.016191] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-24T21:12:20.816186] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-24T21:12:20.862141] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T21:12:21.587949] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T21:12:21.616050] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-24T21:12:22.416069] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-24T21:12:22.561855] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:12:22.751800] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:12:22.759253] [INFO ] [REMOTE ] SEM: Full fetch complete (61670 records). [2025-09-24T21:12:22.759391] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-24T21:12:23.167800] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-24T21:12:23.167920] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-24T21:12:23.168987] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-24T21:12:23.169069] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-24T21:12:23.170628] [DEBUG] [LOCAL ] SEM: Trimmed 61670 records to 42940 (keeping 200 days of data) [2025-09-24T21:12:23.227117] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-24T21:12:23.458820] [DEBUG] [LOCAL ] SEM: Primary data saved (42940 records). [2025-09-24T21:12:23.459191] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-24T21:12:23.459454] [INFO ] [MAIN ] Update Progress: 1898/2373 symbols completed. SEM took 24.8s. Estimated remaining: 1h 3m 9s. Rate: 7.5 symbols/min [2025-09-24T21:12:23.652486] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:23.700770] [DEBUG] [LOCAL ] SF: Loaded 41832 existing records from primary storage. [2025-09-24T21:12:23.700979] [INFO ] [MAIN ] SF: Loaded 41832 existing records. [2025-09-24T21:12:23.927908] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:23.930157] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:12:23.939047] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-24T21:12:23.939469] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-24T21:12:23.940808] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-24T21:12:23.940890] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-24T21:12:24.021186] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-24T21:12:24.323637] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:24.816052] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-24T21:12:24.905006] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T21:12:25.612323] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T21:12:25.624047] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-24T21:12:26.416143] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-24T21:12:27.167762] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T21:12:27.216055] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-24T21:12:27.296279] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-24T21:12:27.951247] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T21:12:28.016053] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-24T21:12:28.739447] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T21:12:28.748720] [INFO ] [REMOTE ] SEI: Full fetch complete (69662 records). [2025-09-24T21:12:28.748979] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-24T21:12:28.821417] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-24T21:12:29.179364] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-24T21:12:29.179468] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-24T21:12:29.180698] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-24T21:12:29.180788] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-24T21:12:29.184622] [DEBUG] [LOCAL ] SEI: Trimmed 69662 records to 49645 (keeping 200 days of data) [2025-09-24T21:12:29.542389] [DEBUG] [LOCAL ] SEI: Primary data saved (49645 records). [2025-09-24T21:12:29.542624] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-24T21:12:29.542899] [INFO ] [MAIN ] Update Progress: 1899/2373 symbols completed. SEI took 32.0s. Estimated remaining: 1h 3m 0s. Rate: 7.5 symbols/min [2025-09-24T21:12:29.617469] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-24T21:12:29.740607] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:29.773509] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:12:29.776741] [DEBUG] [LOCAL ] SFB: Loaded 4017 existing records from primary storage. [2025-09-24T21:12:29.777066] [INFO ] [MAIN ] SFB: Loaded 4017 existing records. [2025-09-24T21:12:29.974660] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:29.974966] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-24T21:12:29.975017] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-24T21:12:29.975296] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-24T21:12:29.975368] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-24T21:12:30.350302] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:30.416051] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-24T21:12:30.569332] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T21:12:31.112553] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T21:12:31.216121] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-24T21:12:32.021234] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-24T21:12:32.049369] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-24T21:12:32.099781] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-24T21:12:32.816089] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-24T21:12:33.421151] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-24T21:12:33.616098] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-24T21:12:34.224181] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-24T21:12:34.417302] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-24T21:12:34.418290] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T21:12:35.216095] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-24T21:12:36.016076] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-24T21:12:36.124504] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T21:12:36.816075] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-24T21:12:36.946770] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T21:12:37.616120] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-24T21:12:37.706450] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-24T21:12:38.267919] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-24T21:12:38.278575] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T21:12:38.416106] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-24T21:12:39.216087] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-24T21:12:40.016075] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-24T21:12:40.085550] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T21:12:40.094304] [INFO ] [REMOTE ] SEMR: Full fetch complete (58924 records). [2025-09-24T21:12:40.094424] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-24T21:12:40.484925] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-24T21:12:40.485011] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-24T21:12:40.486004] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-24T21:12:40.486091] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-24T21:12:40.487289] [DEBUG] [LOCAL ] SEMR: Trimmed 58924 records to 41586 (keeping 200 days of data) [2025-09-24T21:12:40.740969] [DEBUG] [LOCAL ] SEMR: Primary data saved (41586 records). [2025-09-24T21:12:40.741109] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-24T21:12:40.741231] [INFO ] [MAIN ] Update Progress: 1900/2373 symbols completed. SEMR took 34.1s. Estimated remaining: 1h 2m 53s. Rate: 7.5 symbols/min [2025-09-24T21:12:40.821272] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-24T21:12:40.927193] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:40.955860] [DEBUG] [LOCAL ] SFBS: Loaded 21335 existing records from primary storage. [2025-09-24T21:12:40.956013] [INFO ] [MAIN ] SFBS: Loaded 21335 existing records. [2025-09-24T21:12:41.132305] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:41.132586] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-24T21:12:41.132665] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-24T21:12:41.133371] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-24T21:12:41.133441] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-24T21:12:41.498960] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:41.532181] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-24T21:12:41.616077] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-24T21:12:41.684377] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T21:12:41.729201] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:12:42.416093] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-24T21:12:43.214280] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T21:12:43.216181] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-24T21:12:43.924946] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-24T21:12:43.948552] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T21:12:44.016102] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-24T21:12:44.605601] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T21:12:44.816085] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-24T21:12:45.616148] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-24T21:12:46.421320] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-24T21:12:46.436082] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:12:47.216112] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-24T21:12:47.566741] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T21:12:48.016062] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-24T21:12:48.061508] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-24T21:12:48.822179] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-24T21:12:48.847883] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T21:12:49.258765] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T21:12:49.327250] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T21:12:49.328606] [INFO ] [REMOTE ] SFB: Full fetch complete (5724 records). [2025-09-24T21:12:49.328736] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-24T21:12:49.621304] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-24T21:12:49.704576] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-24T21:12:49.704734] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-24T21:12:49.705040] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-24T21:12:49.705087] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-24T21:12:49.706048] [DEBUG] [LOCAL ] SFB: Trimmed 5724 records to 3999 (keeping 200 days of data) [2025-09-24T21:12:49.731485] [DEBUG] [LOCAL ] SFB: Primary data saved (3999 records). [2025-09-24T21:12:49.731663] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-24T21:12:49.731870] [INFO ] [MAIN ] Update Progress: 1901/2373 symbols completed. SFB took 20.2s. Estimated remaining: 1h 2m 46s. Rate: 7.5 symbols/min [2025-09-24T21:12:49.918906] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:49.971995] [DEBUG] [LOCAL ] SFL: Loaded 45358 existing records from primary storage. [2025-09-24T21:12:49.972176] [INFO ] [MAIN ] SFL: Loaded 45358 existing records. [2025-09-24T21:12:50.242424] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:50.242736] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-24T21:12:50.242793] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-24T21:12:50.243994] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-24T21:12:50.244055] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-24T21:12:50.425527] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-24T21:12:50.611191] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:50.811124] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T21:12:51.216101] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-24T21:12:51.839429] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T21:12:51.849728] [INFO ] [REMOTE ] SES: Full fetch complete (74720 records). [2025-09-24T21:12:51.849882] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-24T21:12:52.025312] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-24T21:12:52.097914] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T21:12:52.283191] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-24T21:12:52.283272] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-24T21:12:52.285167] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-24T21:12:52.285233] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-24T21:12:52.286912] [DEBUG] [LOCAL ] SES: Trimmed 74720 records to 51552 (keeping 200 days of data) [2025-09-24T21:12:52.605137] [DEBUG] [LOCAL ] SES: Primary data saved (51552 records). [2025-09-24T21:12:52.605298] [INFO ] [MAIN ] SES: Full history saved. [2025-09-24T21:12:52.605377] [INFO ] [MAIN ] Update Progress: 1902/2373 symbols completed. SES took 45.1s. Estimated remaining: 1h 2m 36s. Rate: 7.5 symbols/min [2025-09-24T21:12:52.787136] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:52.823038] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-24T21:12:52.846248] [DEBUG] [LOCAL ] SG: Loaded 53454 existing records from primary storage. [2025-09-24T21:12:52.846418] [INFO ] [MAIN ] SG: Loaded 53454 existing records. [2025-09-24T21:12:53.062908] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:53.063241] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-24T21:12:53.063297] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-24T21:12:53.064883] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-24T21:12:53.064944] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-24T21:12:53.419913] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:53.616078] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-24T21:12:53.713157] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:12:54.072764] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T21:12:54.079949] [INFO ] [REMOTE ] SF: Full fetch complete (59492 records). [2025-09-24T21:12:54.080114] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-24T21:12:54.426158] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-24T21:12:54.473511] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-24T21:12:54.473588] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-24T21:12:54.474715] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-24T21:12:54.474784] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-24T21:12:54.478424] [DEBUG] [LOCAL ] SF: Trimmed 59492 records to 41759 (keeping 200 days of data) [2025-09-24T21:12:54.755962] [DEBUG] [LOCAL ] SF: Primary data saved (41759 records). [2025-09-24T21:12:54.756116] [INFO ] [MAIN ] SF: Full history saved. [2025-09-24T21:12:54.756220] [INFO ] [MAIN ] Update Progress: 1903/2373 symbols completed. SF took 31.3s. Estimated remaining: 1h 2m 27s. Rate: 7.5 symbols/min [2025-09-24T21:12:54.929197] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:12:54.982065] [DEBUG] [LOCAL ] SGHC: Loaded 45684 existing records from primary storage. [2025-09-24T21:12:54.982210] [INFO ] [MAIN ] SGHC: Loaded 45684 existing records. [2025-09-24T21:12:55.161217] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:12:55.161495] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-24T21:12:55.161551] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-24T21:12:55.162552] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-24T21:12:55.162613] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-24T21:12:55.226982] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-24T21:12:55.529923] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:12:55.725265] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-24T21:12:55.896466] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T21:12:56.016043] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-24T21:12:56.816128] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-24T21:12:56.955056] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T21:12:57.616079] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-24T21:12:58.100186] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-24T21:12:58.416063] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-24T21:12:58.586333] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T21:12:58.935206] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T21:12:59.216116] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-24T21:13:00.016061] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-24T21:13:00.409935] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T21:13:00.499876] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T21:13:00.816122] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-24T21:13:01.262480] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T21:13:01.616109] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-24T21:13:02.177767] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:13:02.416126] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-24T21:13:02.664882] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T21:13:03.216134] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-24T21:13:04.016131] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-24T21:13:04.277584] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T21:13:04.468205] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T21:13:04.816090] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-24T21:13:05.621192] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-24T21:13:05.629550] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T21:13:05.897548] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T21:13:06.416085] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-24T21:13:07.216083] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-24T21:13:07.456622] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:13:08.016067] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-24T21:13:08.272316] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T21:13:08.710467] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T21:13:08.816066] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-24T21:13:09.616118] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-24T21:13:09.656607] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T21:13:09.941446] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T21:13:09.946041] [INFO ] [REMOTE ] SFBS: Full fetch complete (30248 records). [2025-09-24T21:13:09.946185] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-24T21:13:10.361689] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-24T21:13:10.361816] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-24T21:13:10.362636] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-24T21:13:10.362725] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-24T21:13:10.363902] [DEBUG] [LOCAL ] SFBS: Trimmed 30248 records to 21272 (keeping 200 days of data) [2025-09-24T21:13:10.417516] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-24T21:13:10.501222] [DEBUG] [LOCAL ] SFBS: Primary data saved (21272 records). [2025-09-24T21:13:10.501394] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-24T21:13:10.501533] [INFO ] [MAIN ] Update Progress: 1904/2373 symbols completed. SFBS took 29.8s. Estimated remaining: 1h 2m 21s. Rate: 7.5 symbols/min [2025-09-24T21:13:10.681016] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:10.681233] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-24T21:13:10.681277] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-24T21:13:10.681418] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-24T21:13:10.681460] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-24T21:13:10.681501] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-24T21:13:10.681533] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-24T21:13:11.035667] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:11.216087] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-24T21:13:11.640227] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T21:13:11.656464] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:13:11.656812] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-24T21:13:11.765563] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:13:12.016119] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-24T21:13:12.816110] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-24T21:13:13.171286] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:13:13.171612] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-24T21:13:13.616122] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-24T21:13:13.704541] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T21:13:14.416143] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-24T21:13:15.216118] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-24T21:13:15.748876] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T21:13:16.016151] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-24T21:13:16.094841] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:13:16.563372] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T21:13:16.816113] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-24T21:13:17.063966] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:13:17.616124] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-24T21:13:18.416057] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-24T21:13:18.961992] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-24T21:13:19.201549] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:13:19.216050] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-24T21:13:19.892636] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T21:13:20.016105] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-24T21:13:20.634114] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:13:20.816096] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-24T21:13:21.242155] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T21:13:21.616146] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-24T21:13:22.416066] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-24T21:13:22.481934] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T21:13:22.490080] [INFO ] [REMOTE ] SFL: Full fetch complete (65394 records). [2025-09-24T21:13:22.490203] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-24T21:13:22.912672] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-24T21:13:22.912963] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-24T21:13:22.914686] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-24T21:13:22.914798] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-24T21:13:22.917174] [DEBUG] [LOCAL ] SFL: Trimmed 65394 records to 45305 (keeping 200 days of data) [2025-09-24T21:13:23.086061] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T21:13:23.216394] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-24T21:13:23.252240] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:13:23.332636] [DEBUG] [LOCAL ] SFL: Primary data saved (45305 records). [2025-09-24T21:13:23.332877] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-24T21:13:23.332993] [INFO ] [MAIN ] Update Progress: 1905/2373 symbols completed. SFL took 33.6s. Estimated remaining: 1h 2m 14s. Rate: 7.5 symbols/min [2025-09-24T21:13:23.510875] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:23.521587] [DEBUG] [LOCAL ] SGU: Loaded 6650 existing records from primary storage. [2025-09-24T21:13:23.521806] [INFO ] [MAIN ] SGU: Loaded 6650 existing records. [2025-09-24T21:13:23.754137] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:23.754581] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-24T21:13:23.754669] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-24T21:13:23.755212] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-24T21:13:23.755315] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-24T21:13:24.022473] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-24T21:13:24.218550] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:24.816106] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-24T21:13:25.258973] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-24T21:13:25.269391] [INFO ] [REMOTE ] SG: Full fetch complete (77244 records). [2025-09-24T21:13:25.269576] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-24T21:13:25.628359] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-24T21:13:25.690498] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-24T21:13:25.691559] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-24T21:13:25.692892] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-24T21:13:25.692976] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-24T21:13:25.694764] [DEBUG] [LOCAL ] SG: Trimmed 77244 records to 53448 (keeping 200 days of data) [2025-09-24T21:13:25.942002] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T21:13:26.064847] [DEBUG] [LOCAL ] SG: Primary data saved (53448 records). [2025-09-24T21:13:26.065001] [INFO ] [MAIN ] SG: Full history saved. [2025-09-24T21:13:26.065090] [INFO ] [MAIN ] Update Progress: 1906/2373 symbols completed. SG took 33.5s. Estimated remaining: 1h 2m 5s. Rate: 7.5 symbols/min [2025-09-24T21:13:26.241550] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:26.288928] [DEBUG] [LOCAL ] SHAK: Loaded 49171 existing records from primary storage. [2025-09-24T21:13:26.289082] [INFO ] [MAIN ] SHAK: Loaded 49171 existing records. [2025-09-24T21:13:26.424425] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-24T21:13:26.503149] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:26.483567] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-24T21:13:26.507837] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-24T21:13:26.507943] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-24T21:13:26.521348] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-24T21:13:26.526771] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-24T21:13:26.624061] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T21:13:26.930802] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:27.216095] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-24T21:13:28.016141] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-24T21:13:28.330631] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T21:13:28.340100] [INFO ] [REMOTE ] SGHC: Full fetch complete (63292 records). [2025-09-24T21:13:28.340260] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-24T21:13:28.759730] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-24T21:13:28.760105] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-24T21:13:28.761885] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-24T21:13:28.762006] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-24T21:13:28.763970] [DEBUG] [LOCAL ] SGHC: Trimmed 63292 records to 45708 (keeping 200 days of data) [2025-09-24T21:13:28.818346] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-24T21:13:28.961990] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T21:13:29.115962] [DEBUG] [LOCAL ] SGHC: Primary data saved (45708 records). [2025-09-24T21:13:29.116306] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-24T21:13:29.116477] [INFO ] [MAIN ] Update Progress: 1907/2373 symbols completed. SGHC took 34.4s. Estimated remaining: 1h 1m 56s. Rate: 7.5 symbols/min [2025-09-24T21:13:29.168828] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T21:13:29.338114] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:29.367083] [DEBUG] [LOCAL ] SHCO: Loaded 26193 existing records from primary storage. [2025-09-24T21:13:29.367268] [INFO ] [MAIN ] SHCO: Loaded 26193 existing records. [2025-09-24T21:13:29.571824] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:29.572133] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-24T21:13:29.572189] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-24T21:13:29.572855] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-24T21:13:29.572915] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-24T21:13:29.621303] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-24T21:13:29.953865] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:30.416178] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-24T21:13:30.795512] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-24T21:13:31.216118] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-24T21:13:31.261218] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:13:31.734129] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:13:31.744416] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T21:13:32.016103] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-24T21:13:32.816129] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-24T21:13:33.055225] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T21:13:33.616101] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-24T21:13:34.416073] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-24T21:13:34.470297] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T21:13:34.815720] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-24T21:13:35.107800] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T21:13:35.216092] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-24T21:13:36.017248] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-24T21:13:36.019314] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-24T21:13:36.816141] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-24T21:13:37.483920] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-24T21:13:37.616101] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-24T21:13:37.810093] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:13:38.367102] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T21:13:38.416214] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-24T21:13:39.216231] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-24T21:13:39.267747] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T21:13:40.016095] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-24T21:13:40.816161] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-24T21:13:41.137883] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T21:13:41.360263] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T21:13:41.616109] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-24T21:13:41.710802] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-24T21:13:42.416124] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-24T21:13:42.494995] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T21:13:43.216101] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-24T21:13:44.016068] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-24T21:13:44.337391] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T21:13:44.825209] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-24T21:13:44.845731] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T21:13:45.045710] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T21:13:45.616130] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-24T21:13:46.330746] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T21:13:46.332779] [INFO ] [REMOTE ] SGU: Full fetch complete (8925 records). [2025-09-24T21:13:46.332859] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-24T21:13:46.422846] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-24T21:13:46.731564] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-24T21:13:46.731776] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-24T21:13:46.732215] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-24T21:13:46.732296] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-24T21:13:46.733061] [DEBUG] [LOCAL ] SGU: Trimmed 8925 records to 6649 (keeping 200 days of data) [2025-09-24T21:13:46.795438] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-24T21:13:46.817660] [DEBUG] [LOCAL ] SGU: Primary data saved (6649 records). [2025-09-24T21:13:46.817885] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-24T21:13:46.818038] [INFO ] [MAIN ] Update Progress: 1908/2373 symbols completed. SGU took 23.5s. Estimated remaining: 1h 1m 50s. Rate: 7.5 symbols/min [2025-09-24T21:13:46.991970] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:47.047881] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-24T21:13:47.048063] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-09-24T21:13:47.227900] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-24T21:13:47.235343] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:47.236278] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-24T21:13:47.236349] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-24T21:13:47.238151] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-24T21:13:47.238220] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-24T21:13:47.641715] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:48.016062] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-24T21:13:48.233230] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T21:13:48.816059] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-24T21:13:49.157200] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T21:13:49.616108] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-24T21:13:50.243438] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-24T21:13:50.416102] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-24T21:13:50.652924] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T21:13:50.661888] [INFO ] [REMOTE ] SGI: Full fetch complete (57501 records). [2025-09-24T21:13:50.662008] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-24T21:13:50.798811] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T21:13:50.876431] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-24T21:13:50.877096] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:13:50.877172] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:13:50.877248] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-24T21:13:50.877320] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-24T21:13:50.877358] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-24T21:13:50.877420] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-24T21:13:50.877542] [INFO ] [MAIN ] Update Progress: 1909/2373 symbols completed. SGI took 40.4s. Estimated remaining: 1h 1m 41s. Rate: 7.5 symbols/min [2025-09-24T21:13:51.050533] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:51.082850] [DEBUG] [LOCAL ] SHG: Loaded 27061 existing records from primary storage. [2025-09-24T21:13:51.083058] [INFO ] [MAIN ] SHG: Loaded 27061 existing records. [2025-09-24T21:13:51.222326] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-24T21:13:51.264558] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:51.264846] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-24T21:13:51.264903] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-24T21:13:51.265704] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-24T21:13:51.265765] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-24T21:13:51.617220] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:13:52.016064] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-24T21:13:52.140867] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T21:13:52.173680] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T21:13:52.816103] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-24T21:13:53.387627] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T21:13:53.616130] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-24T21:13:54.178201] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T21:13:54.416116] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-24T21:13:55.216099] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-24T21:13:55.606048] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-24T21:13:55.832146] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:13:56.016123] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-24T21:13:56.646515] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T21:13:56.816088] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-24T21:13:57.376202] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T21:13:57.384801] [INFO ] [REMOTE ] SHAK: Full fetch complete (70052 records). [2025-09-24T21:13:57.384930] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-24T21:13:57.621366] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-24T21:13:57.794067] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-24T21:13:57.802636] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-24T21:13:57.804960] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T21:13:57.804437] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-24T21:13:57.810261] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-24T21:13:57.810770] [INFO ] [REMOTE ] SHCO: Full fetch complete (37427 records). [2025-09-24T21:13:57.810848] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-24T21:13:57.914016] [DEBUG] [LOCAL ] SHAK: Trimmed 70052 records to 49120 (keeping 200 days of data) [2025-09-24T21:13:58.436723] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-24T21:13:58.450661] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-24T21:13:58.451907] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-24T21:13:58.452942] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-24T21:13:58.453026] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-24T21:13:58.459324] [DEBUG] [LOCAL ] SHCO: Trimmed 37427 records to 26028 (keeping 200 days of data) [2025-09-24T21:13:58.678740] [DEBUG] [LOCAL ] SHCO: Primary data saved (26028 records). [2025-09-24T21:13:58.679474] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-24T21:13:58.679873] [INFO ] [MAIN ] Update Progress: 1910/2373 symbols completed. SHCO took 29.6s. Estimated remaining: 1h 1m 33s. Rate: 7.5 symbols/min [2025-09-24T21:13:58.816598] [DEBUG] [LOCAL ] SHAK: Primary data saved (49120 records). [2025-09-24T21:13:58.835896] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-24T21:13:58.842383] [INFO ] [MAIN ] Update Progress: 1911/2373 symbols completed. SHAK took 32.8s. Estimated remaining: 1h 1m 23s. Rate: 7.5 symbols/min [2025-09-24T21:13:58.926260] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:59.078129] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:13:59.096416] [DEBUG] [LOCAL ] SHOC: Loaded 3779 existing records from primary storage. [2025-09-24T21:13:59.096713] [INFO ] [MAIN ] SHOC: Loaded 3779 existing records. [2025-09-24T21:13:59.244280] [DEBUG] [LOCAL ] SHO: Loaded 49816 existing records from primary storage. [2025-09-24T21:13:59.254750] [INFO ] [MAIN ] SHO: Loaded 49816 existing records. [2025-09-24T21:13:59.395679] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:59.420936] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-24T21:13:59.440469] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-24T21:13:59.478686] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-24T21:13:59.502969] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-24T21:13:59.516510] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:13:59.529509] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-24T21:13:59.534784] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-24T21:13:59.547105] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-24T21:13:59.547329] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-24T21:14:00.167684] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-24T21:14:00.303703] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T21:14:00.333967] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:00.338817] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-24T21:14:00.336685] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-24T21:14:00.366412] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:00.816129] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-24T21:14:01.616145] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-24T21:14:02.089730] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:14:02.318152] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T21:14:02.416094] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-24T21:14:02.548891] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-24T21:14:02.584882] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-24T21:14:03.216129] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-24T21:14:03.928567] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:14:04.016063] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-24T21:14:04.034334] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T21:14:04.816128] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-24T21:14:05.489508] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-24T21:14:05.602012] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T21:14:05.616044] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-24T21:14:06.416090] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-24T21:14:07.118185] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T21:14:07.216093] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-24T21:14:08.016077] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-24T21:14:08.753235] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-24T21:14:08.816073] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-24T21:14:09.022677] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T21:14:09.124290] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T21:14:09.616095] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-24T21:14:10.416047] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-24T21:14:10.474373] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:14:10.702232] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T21:14:11.216099] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-24T21:14:11.870475] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:14:11.902830] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T21:14:12.016108] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-24T21:14:12.598149] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T21:14:12.816094] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-24T21:14:13.367733] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T21:14:13.616104] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-24T21:14:14.416101] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-24T21:14:15.057051] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T21:14:15.216088] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-24T21:14:15.680841] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-24T21:14:16.016090] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-24T21:14:16.539128] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T21:14:16.816094] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-24T21:14:17.487975] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T21:14:17.616106] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-24T21:14:18.416182] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-24T21:14:18.984984] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:14:19.201924] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T21:14:19.216056] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-24T21:14:20.023986] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-24T21:14:20.044017] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T21:14:20.608220] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T21:14:20.816105] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-24T21:14:21.109128] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T21:14:21.616136] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-24T21:14:22.178601] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T21:14:22.179861] [INFO ] [REMOTE ] SHOC: Full fetch complete (7480 records). [2025-09-24T21:14:22.179934] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-24T21:14:22.425430] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-24T21:14:22.606424] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:14:22.623324] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-24T21:14:22.623561] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-24T21:14:22.623904] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-24T21:14:22.623981] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-24T21:14:22.624947] [DEBUG] [LOCAL ] SHOC: Trimmed 7480 records to 3716 (keeping 200 days of data) [2025-09-24T21:14:22.647610] [DEBUG] [LOCAL ] SHOC: Primary data saved (3716 records). [2025-09-24T21:14:22.647714] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-24T21:14:22.647803] [INFO ] [MAIN ] Update Progress: 1912/2373 symbols completed. SHOC took 23.8s. Estimated remaining: 1h 1m 19s. Rate: 7.5 symbols/min [2025-09-24T21:14:22.820828] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:14:22.873531] [DEBUG] [LOCAL ] SHW: Loaded 50480 existing records from primary storage. [2025-09-24T21:14:22.873709] [INFO ] [MAIN ] SHW: Loaded 50480 existing records. [2025-09-24T21:14:23.056117] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:14:23.056424] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-24T21:14:23.056473] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-24T21:14:23.057983] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-24T21:14:23.058047] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-24T21:14:23.224724] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-24T21:14:23.439688] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:23.943800] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T21:14:24.016123] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-24T21:14:24.816104] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-24T21:14:25.163731] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:14:25.430526] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-24T21:14:25.441534] [INFO ] [REMOTE ] SHEL: Full fetch complete (77690 records). [2025-09-24T21:14:25.441744] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-24T21:14:25.621594] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-24T21:14:25.844065] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-24T21:14:25.844147] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-24T21:14:25.845280] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-24T21:14:25.845345] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-24T21:14:25.846903] [DEBUG] [LOCAL ] SHEL: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-24T21:14:26.216841] [DEBUG] [LOCAL ] SHEL: Primary data saved (53671 records). [2025-09-24T21:14:26.217074] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-24T21:14:26.217233] [INFO ] [MAIN ] Update Progress: 1913/2373 symbols completed. SHEL took 39.4s. Estimated remaining: 1h 1m 10s. Rate: 7.5 symbols/min [2025-09-24T21:14:26.412231] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:14:26.412466] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-24T21:14:26.412634] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-24T21:14:26.412852] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-24T21:14:26.413113] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-24T21:14:26.413276] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-24T21:14:26.413335] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-24T21:14:26.418638] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-24T21:14:26.731127] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T21:14:26.836093] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T21:14:26.887705] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:26.887857] [INFO ] [REMOTE ] SHG: Full fetch complete (41473 records). [2025-09-24T21:14:26.888349] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-24T21:14:27.221229] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-24T21:14:27.298544] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-24T21:14:27.298626] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-24T21:14:27.299502] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-24T21:14:27.299552] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-24T21:14:27.300539] [DEBUG] [LOCAL ] SHG: Trimmed 41473 records to 26963 (keeping 200 days of data) [2025-09-24T21:14:27.468118] [DEBUG] [LOCAL ] SHG: Primary data saved (26963 records). [2025-09-24T21:14:27.468268] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-24T21:14:27.468358] [INFO ] [MAIN ] Update Progress: 1914/2373 symbols completed. SHG took 36.6s. Estimated remaining: 1h 1m 0s. Rate: 7.5 symbols/min [2025-09-24T21:14:27.642283] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:14:27.688568] [DEBUG] [LOCAL ] SID: Loaded 42227 existing records from primary storage. [2025-09-24T21:14:27.688808] [INFO ] [MAIN ] SID: Loaded 42227 existing records. [2025-09-24T21:14:27.741154] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:27.773239] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-24T21:14:27.878502] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:14:27.878813] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-24T21:14:27.878963] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-24T21:14:27.880037] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-24T21:14:27.880100] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-24T21:14:28.026704] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-24T21:14:28.099536] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:14:28.179541] [INFO ] [REMOTE ] SHO: Full fetch complete (71124 records). [2025-09-24T21:14:28.191185] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-24T21:14:28.440955] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:28.710230] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-24T21:14:28.710325] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-24T21:14:28.711456] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-24T21:14:28.711528] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-24T21:14:28.713106] [DEBUG] [LOCAL ] SHO: Trimmed 71124 records to 49825 (keeping 200 days of data) [2025-09-24T21:14:28.816578] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-24T21:14:29.017137] [DEBUG] [LOCAL ] SHO: Primary data saved (49825 records). [2025-09-24T21:14:29.017289] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-24T21:14:29.017399] [INFO ] [MAIN ] Update Progress: 1915/2373 symbols completed. SHO took 30.3s. Estimated remaining: 1h 0m 51s. Rate: 7.5 symbols/min [2025-09-24T21:14:29.136890] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:29.163742] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-24T21:14:29.192813] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:14:29.238408] [DEBUG] [LOCAL ] SIG: Loaded 46565 existing records from primary storage. [2025-09-24T21:14:29.238562] [INFO ] [MAIN ] SIG: Loaded 46565 existing records. [2025-09-24T21:14:29.420144] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:14:29.420411] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-24T21:14:29.420459] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-24T21:14:29.421477] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-24T21:14:29.421538] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-24T21:14:29.624420] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-24T21:14:29.791374] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:30.039507] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-24T21:14:30.416100] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-24T21:14:31.216158] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-24T21:14:31.377789] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:14:32.016263] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-24T21:14:32.207912] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T21:14:32.816143] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-24T21:14:32.880507] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:14:33.616113] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-24T21:14:33.686684] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T21:14:34.416111] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-24T21:14:34.692744] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:34.693086] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-24T21:14:34.814800] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T21:14:35.216086] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-24T21:14:35.301751] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T21:14:35.495901] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:35.496274] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-24T21:14:36.016115] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-24T21:14:36.816102] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-24T21:14:37.485842] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T21:14:37.616113] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-24T21:14:37.862866] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:37.863249] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-24T21:14:38.416081] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-24T21:14:38.597357] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T21:14:38.688001] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:38.688491] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-24T21:14:39.216114] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-24T21:14:40.016137] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-24T21:14:40.733442] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T21:14:40.816044] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-24T21:14:41.566992] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:14:41.616105] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-24T21:14:42.304066] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T21:14:42.416130] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-24T21:14:43.216115] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-24T21:14:43.430148] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T21:14:43.552824] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:14:43.553226] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-24T21:14:44.016094] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-24T21:14:44.463553] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T21:14:44.816114] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-24T21:14:45.616092] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-24T21:14:45.743014] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T21:14:46.416148] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-24T21:14:46.662258] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T21:14:46.931478] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-24T21:14:47.216084] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-24T21:14:47.336639] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T21:14:48.016102] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-24T21:14:48.816146] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-24T21:14:48.971335] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T21:14:49.105185] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T21:14:49.616122] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-24T21:14:50.416088] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-24T21:14:50.468571] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:14:51.216057] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-24T21:14:51.456756] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T21:14:51.460524] [INFO ] [REMOTE ] SI: Full fetch complete (5777 records). [2025-09-24T21:14:51.460764] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-24T21:14:51.656784] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-24T21:14:51.657108] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:14:51.657204] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:14:51.657297] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-24T21:14:51.657772] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-24T21:14:51.657840] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-24T21:14:51.657993] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-24T21:14:51.658125] [INFO ] [MAIN ] Update Progress: 1916/2373 symbols completed. SI took 25.4s. Estimated remaining: 1h 0m 46s. Rate: 7.5 symbols/min [2025-09-24T21:14:51.812974] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T21:14:51.902012] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:14:51.930002] [DEBUG] [LOCAL ] SII: Loaded 23252 existing records from primary storage. [2025-09-24T21:14:51.930213] [INFO ] [MAIN ] SII: Loaded 23252 existing records. [2025-09-24T21:14:52.017708] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-24T21:14:52.122129] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:14:52.122542] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-24T21:14:52.122610] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-24T21:14:52.123519] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-24T21:14:52.123599] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-24T21:14:52.489680] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:14:52.729391] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T21:14:52.816078] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-24T21:14:52.957952] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T21:14:53.616125] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-24T21:14:54.416155] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-24T21:14:54.446554] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T21:14:55.105319] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T21:14:55.216092] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-24T21:14:55.570213] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T21:14:56.016084] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-24T21:14:56.816214] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-24T21:14:56.931487] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T21:14:56.940696] [INFO ] [REMOTE ] SHW: Full fetch complete (73023 records). [2025-09-24T21:14:56.940833] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-24T21:14:57.354151] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-24T21:14:57.354245] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-24T21:14:57.355501] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-24T21:14:57.355599] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-24T21:14:57.361490] [DEBUG] [LOCAL ] SHW: Trimmed 73023 records to 50451 (keeping 200 days of data) [2025-09-24T21:14:57.619240] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-24T21:14:57.703968] [DEBUG] [LOCAL ] SHW: Primary data saved (50451 records). [2025-09-24T21:14:57.704127] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-24T21:14:57.704284] [INFO ] [MAIN ] Update Progress: 1917/2373 symbols completed. SHW took 35.1s. Estimated remaining: 1h 0m 38s. Rate: 7.5 symbols/min [2025-09-24T21:14:57.848536] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T21:14:58.416054] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-24T21:14:58.550392] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T21:14:58.561039] [INFO ] [REMOTE ] SIG: Full fetch complete (68276 records). [2025-09-24T21:14:58.561215] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-24T21:14:58.717827] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T21:14:58.992477] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-24T21:14:58.992685] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-24T21:14:58.996743] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-24T21:14:58.996829] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-24T21:14:59.000458] [DEBUG] [LOCAL ] SIG: Trimmed 68276 records to 46524 (keeping 200 days of data) [2025-09-24T21:14:59.238503] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-24T21:14:59.318784] [DEBUG] [LOCAL ] SIG: Primary data saved (46524 records). [2025-09-24T21:14:59.318936] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-24T21:14:59.319136] [INFO ] [MAIN ] Update Progress: 1918/2373 symbols completed. SIG took 30.3s. Estimated remaining: 1h 0m 29s. Rate: 7.5 symbols/min [2025-09-24T21:15:00.255130] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T21:15:00.267190] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-24T21:15:00.288737] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:15:00.816096] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-24T21:15:02.093514] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T21:15:02.105085] [INFO ] [REMOTE ] SID: Full fetch complete (60780 records). [2025-09-24T21:15:02.105296] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-24T21:15:02.315856] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T21:15:02.366321] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-24T21:15:02.590543] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-24T21:15:02.590672] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-24T21:15:02.591757] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-24T21:15:02.591825] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-24T21:15:02.593260] [DEBUG] [LOCAL ] SID: Trimmed 60780 records to 42217 (keeping 200 days of data) [2025-09-24T21:15:02.846386] [DEBUG] [LOCAL ] SID: Primary data saved (42217 records). [2025-09-24T21:15:02.846530] [INFO ] [MAIN ] SID: Full history saved. [2025-09-24T21:15:02.846671] [INFO ] [MAIN ] Update Progress: 1919/2373 symbols completed. SID took 35.4s. Estimated remaining: 1h 0m 20s. Rate: 7.5 symbols/min [2025-09-24T21:15:04.971608] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-24T21:15:04.977806] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-24T21:15:06.282460] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:15:06.287887] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-24T21:15:07.657429] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:15:07.662849] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-24T21:15:08.949880] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T21:15:08.956017] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-24T21:15:10.102693] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:15:10.107798] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-24T21:15:11.242009] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T21:15:11.248606] [INFO ] [REMOTE ] SII: Full fetch complete (29750 records). [2025-09-24T21:15:11.248769] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-24T21:15:11.629800] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-24T21:15:11.629881] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-24T21:15:11.630518] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-24T21:15:11.630557] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-24T21:15:11.631328] [DEBUG] [LOCAL ] SII: Trimmed 29750 records to 23247 (keeping 200 days of data) [2025-09-24T21:15:11.795315] [DEBUG] [LOCAL ] SII: Primary data saved (23247 records). [2025-09-24T21:15:11.795847] [INFO ] [MAIN ] SII: Full history saved. [2025-09-24T21:15:11.796158] [INFO ] [MAIN ] Update Progress: 1920/2373 symbols completed. SII took 20.1s. Estimated remaining: 1h 0m 12s. Rate: 7.5 symbols/min [2025-09-24T21:15:12.444332] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:12.504604] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:12.538472] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:12.518606] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:12.636561] [DEBUG] [LOCAL ] SITC: Loaded 41556 existing records from primary storage. [2025-09-24T21:15:12.635513] [DEBUG] [LOCAL ] SILA: Loaded 31402 existing records from primary storage. [2025-09-24T21:15:12.637014] [INFO ] [MAIN ] SITC: Loaded 41556 existing records. [2025-09-24T21:15:12.636964] [INFO ] [MAIN ] SILA: Loaded 31402 existing records. [2025-09-24T21:15:12.835477] [DEBUG] [LOCAL ] SITE: Loaded 35140 existing records from primary storage. [2025-09-24T21:15:12.881843] [INFO ] [MAIN ] SITE: Loaded 35140 existing records. [2025-09-24T21:15:12.866262] [DEBUG] [LOCAL ] SJM: Loaded 50145 existing records from primary storage. [2025-09-24T21:15:12.935200] [INFO ] [MAIN ] SJM: Loaded 50145 existing records. [2025-09-24T21:15:13.017465] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:13.242693] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-24T21:15:13.246855] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:13.251047] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-24T21:15:13.272087] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-24T21:15:13.307241] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-24T21:15:13.317586] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-24T21:15:13.364469] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-24T21:15:13.482197] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:13.487578] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:13.493432] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-24T21:15:13.509141] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-24T21:15:13.520148] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-24T21:15:13.523454] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-24T21:15:13.514520] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-24T21:15:13.534525] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-24T21:15:13.534442] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-24T21:15:13.534702] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-24T21:15:13.540553] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-24T21:15:13.551657] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-24T21:15:14.597670] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:14.669151] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-24T21:15:14.746954] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:14.781435] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-24T21:15:14.811404] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:14.850987] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-24T21:15:14.956840] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:14.957130] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-24T21:15:16.773426] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-24T21:15:16.779411] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-24T21:15:17.058021] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-24T21:15:17.064971] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-24T21:15:17.491166] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-24T21:15:17.501125] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-24T21:15:17.881791] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (3.21 seconds). [2025-09-24T21:15:17.897960] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T21:15:17.899099] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-24T21:15:17.910458] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-24T21:15:18.059812] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T21:15:18.066958] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-24T21:15:19.228195] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T21:15:19.236123] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-24T21:15:19.300381] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T21:15:19.312378] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-24T21:15:19.563343] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T21:15:19.570222] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-24T21:15:19.683872] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T21:15:19.693320] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-24T21:15:20.452124] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T21:15:20.460097] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-24T21:15:21.045765] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T21:15:21.069272] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-24T21:15:21.070984] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T21:15:21.079952] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-24T21:15:21.125718] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T21:15:21.133946] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-24T21:15:22.111054] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T21:15:22.119836] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-24T21:15:22.603587] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T21:15:22.610890] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-24T21:15:22.771682] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T21:15:22.781264] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-24T21:15:22.938461] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T21:15:23.216087] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-24T21:15:23.647805] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T21:15:24.016229] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-24T21:15:24.137373] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T21:15:24.658741] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T21:15:24.823914] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-24T21:15:24.836383] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T21:15:25.362997] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:15:25.616073] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-24T21:15:26.416094] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-24T21:15:26.599083] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-24T21:15:27.216097] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-24T21:15:28.016143] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-24T21:15:28.667974] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-24T21:15:28.746613] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T21:15:28.816108] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-24T21:15:29.248071] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T21:15:29.621474] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-24T21:15:29.638892] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:15:29.919430] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T21:15:30.416125] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-24T21:15:30.724607] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T21:15:31.216130] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-24T21:15:32.016117] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-24T21:15:32.061769] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:15:32.118331] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-24T21:15:32.816102] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-24T21:15:33.549317] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-24T21:15:33.556342] [INFO ] [REMOTE ] SITE: Full fetch complete (49266 records). [2025-09-24T21:15:33.556512] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-24T21:15:33.629084] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-24T21:15:34.010315] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T21:15:34.019708] [INFO ] [REMOTE ] SILA: Full fetch complete (45218 records). [2025-09-24T21:15:34.019524] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-24T21:15:34.019846] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-24T21:15:34.020938] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-24T21:15:34.021021] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-24T21:15:34.021230] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-24T21:15:34.093490] [DEBUG] [LOCAL ] SITE: Trimmed 49266 records to 35058 (keeping 200 days of data) [2025-09-24T21:15:34.424504] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-24T21:15:34.648806] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-24T21:15:34.651992] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-24T21:15:34.653298] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-24T21:15:34.653385] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-24T21:15:34.662406] [DEBUG] [LOCAL ] SILA: Trimmed 45218 records to 31333 (keeping 200 days of data) [2025-09-24T21:15:34.680089] [DEBUG] [LOCAL ] SITE: Primary data saved (35058 records). [2025-09-24T21:15:34.680258] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-24T21:15:34.680352] [INFO ] [MAIN ] Update Progress: 1921/2373 symbols completed. SITE took 22.9s. Estimated remaining: 1h 0m 7s. Rate: 7.5 symbols/min [2025-09-24T21:15:35.024397] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:35.074912] [DEBUG] [LOCAL ] SILA: Primary data saved (31333 records). [2025-09-24T21:15:35.081226] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-24T21:15:35.082264] [INFO ] [MAIN ] Update Progress: 1922/2373 symbols completed. SILA took 23.3s. Estimated remaining: 59m 58s. Rate: 7.5 symbols/min [2025-09-24T21:15:35.082795] [DEBUG] [LOCAL ] SJT: Loaded 22089 existing records from primary storage. [2025-09-24T21:15:35.082965] [INFO ] [MAIN ] SJT: Loaded 22089 existing records. [2025-09-24T21:15:35.446821] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:35.443335] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:35.447400] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-24T21:15:35.447509] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-24T21:15:35.448272] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-24T21:15:35.448352] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-24T21:15:35.874776] [DEBUG] [LOCAL ] SKE: Loaded 35554 existing records from primary storage. [2025-09-24T21:15:35.875152] [INFO ] [MAIN ] SKE: Loaded 35554 existing records. [2025-09-24T21:15:35.924606] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:35.958789] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-24T21:15:36.127041] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-24T21:15:36.125328] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:36.139169] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-24T21:15:36.139303] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-24T21:15:36.139754] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-24T21:15:36.141448] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-24T21:15:36.163239] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-24T21:15:36.206640] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T21:15:36.558826] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:36.816079] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-24T21:15:37.166907] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T21:15:37.616063] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-24T21:15:38.014240] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T21:15:38.073825] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-24T21:15:38.416111] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-24T21:15:39.073368] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T21:15:39.216095] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-24T21:15:39.791115] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T21:15:40.016145] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-24T21:15:40.327750] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T21:15:40.816108] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-24T21:15:41.521167] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T21:15:41.530572] [INFO ] [REMOTE ] SJM: Full fetch complete (72025 records). [2025-09-24T21:15:41.530749] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-24T21:15:41.626009] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-24T21:15:41.934730] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-24T21:15:41.934855] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-24T21:15:41.935984] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-24T21:15:41.936054] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-24T21:15:41.937558] [DEBUG] [LOCAL ] SJM: Trimmed 72025 records to 50133 (keeping 200 days of data) [2025-09-24T21:15:42.273795] [DEBUG] [LOCAL ] SJM: Primary data saved (50133 records). [2025-09-24T21:15:42.273960] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-24T21:15:42.274055] [INFO ] [MAIN ] Update Progress: 1923/2373 symbols completed. SJM took 30.5s. Estimated remaining: 59m 49s. Rate: 7.5 symbols/min [2025-09-24T21:15:42.420839] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-24T21:15:42.456433] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:42.495617] [DEBUG] [LOCAL ] SKIL: Loaded 6390 existing records from primary storage. [2025-09-24T21:15:42.496752] [INFO ] [MAIN ] SKIL: Loaded 6390 existing records. [2025-09-24T21:15:42.498494] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:15:42.593540] [INFO ] [REMOTE ] SITC: Full fetch complete (60903 records). [2025-09-24T21:15:42.618028] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-24T21:15:42.765325] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:42.813805] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-24T21:15:42.814220] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-24T21:15:42.840110] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-24T21:15:42.853938] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-24T21:15:43.179450] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T21:15:43.242025] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-24T21:15:43.420316] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-24T21:15:43.426189] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-24T21:15:43.437601] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-24T21:15:43.442841] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-24T21:15:43.507760] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:43.508944] [DEBUG] [LOCAL ] SITC: Trimmed 60903 records to 41572 (keeping 200 days of data) [2025-09-24T21:15:43.761211] [DEBUG] [LOCAL ] SITC: Primary data saved (41572 records). [2025-09-24T21:15:43.761355] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-24T21:15:43.761444] [INFO ] [MAIN ] Update Progress: 1924/2373 symbols completed. SITC took 32.0s. Estimated remaining: 59m 40s. Rate: 7.5 symbols/min [2025-09-24T21:15:43.948201] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:15:43.956128] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T21:15:43.973547] [DEBUG] [LOCAL ] SKLZ: Loaded 11978 existing records from primary storage. [2025-09-24T21:15:43.973688] [INFO ] [MAIN ] SKLZ: Loaded 11978 existing records. [2025-09-24T21:15:44.027187] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-24T21:15:44.159036] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:15:44.159265] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-24T21:15:44.159314] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-24T21:15:44.159783] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-24T21:15:44.159872] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-24T21:15:44.558544] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-24T21:15:44.563059] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:15:44.744099] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-24T21:15:44.816077] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-24T21:15:45.616091] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-24T21:15:45.697232] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:15:46.278465] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T21:15:46.416078] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-24T21:15:47.216064] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-24T21:15:47.282956] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:15:48.016082] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-24T21:15:48.444785] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T21:15:48.816112] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-24T21:15:49.227151] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T21:15:49.616096] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-24T21:15:49.987204] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T21:15:50.416102] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-24T21:15:50.669277] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:15:51.216132] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-24T21:15:51.670343] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T21:15:51.933040] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T21:15:52.016150] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-24T21:15:52.801781] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T21:15:52.816035] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-24T21:15:53.313214] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T21:15:53.616260] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-24T21:15:54.273307] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T21:15:54.416145] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-24T21:15:55.216059] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-24T21:15:55.515492] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T21:15:56.016121] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-24T21:15:56.290465] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T21:15:56.816065] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-24T21:15:57.033002] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T21:15:57.616053] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-24T21:15:57.699456] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-24T21:15:58.416112] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-24T21:15:59.221188] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-24T21:15:59.235302] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T21:15:59.250802] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T21:16:00.016101] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-24T21:16:00.139198] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T21:16:00.816086] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-24T21:16:01.518236] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T21:16:01.518638] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T21:16:01.616123] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-24T21:16:02.416112] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-24T21:16:02.523604] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T21:16:03.216150] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-24T21:16:03.637673] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T21:16:03.743773] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-24T21:16:03.745988] [INFO ] [REMOTE ] SKIL: Full fetch complete (10083 records). [2025-09-24T21:16:03.746081] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-24T21:16:04.021322] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-24T21:16:04.156151] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-24T21:16:04.156255] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-24T21:16:04.156536] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-24T21:16:04.156585] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-24T21:16:04.157142] [DEBUG] [LOCAL ] SKIL: Trimmed 10083 records to 6336 (keeping 200 days of data) [2025-09-24T21:16:04.193814] [DEBUG] [LOCAL ] SKIL: Primary data saved (6336 records). [2025-09-24T21:16:04.193954] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-24T21:16:04.194057] [INFO ] [MAIN ] Update Progress: 1925/2373 symbols completed. SKIL took 21.9s. Estimated remaining: 59m 35s. Rate: 7.5 symbols/min [2025-09-24T21:16:04.370941] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:04.406790] [DEBUG] [LOCAL ] SKM: Loaded 35200 existing records from primary storage. [2025-09-24T21:16:04.406939] [INFO ] [MAIN ] SKM: Loaded 35200 existing records. [2025-09-24T21:16:04.592581] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:04.592861] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-24T21:16:04.592912] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-24T21:16:04.593807] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-24T21:16:04.593868] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-24T21:16:04.821336] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-24T21:16:04.962469] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:05.576599] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T21:16:05.616044] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-24T21:16:05.940250] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T21:16:06.416110] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-24T21:16:06.922419] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T21:16:07.216139] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-24T21:16:07.302223] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-24T21:16:08.016129] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-24T21:16:08.420318] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T21:16:08.816130] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-24T21:16:09.609024] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:16:09.620221] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-24T21:16:09.622127] [INFO ] [REMOTE ] SKE: Full fetch complete (50332 records). [2025-09-24T21:16:09.622370] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-24T21:16:10.030269] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-24T21:16:10.030371] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-24T21:16:10.031516] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-24T21:16:10.031585] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-24T21:16:10.033055] [DEBUG] [LOCAL ] SKE: Trimmed 50332 records to 35654 (keeping 200 days of data) [2025-09-24T21:16:10.247837] [DEBUG] [LOCAL ] SKE: Primary data saved (35654 records). [2025-09-24T21:16:10.247995] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-24T21:16:10.248088] [INFO ] [MAIN ] Update Progress: 1926/2373 symbols completed. SKE took 35.2s. Estimated remaining: 59m 26s. Rate: 7.5 symbols/min [2025-09-24T21:16:10.421746] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-24T21:16:10.425569] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:10.446121] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:16:10.492362] [DEBUG] [LOCAL ] SKT: Loaded 42618 existing records from primary storage. [2025-09-24T21:16:10.492523] [INFO ] [MAIN ] SKT: Loaded 42618 existing records. [2025-09-24T21:16:10.658800] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T21:16:10.698475] [INFO ] [REMOTE ] SJT: Full fetch complete (32271 records). [2025-09-24T21:16:10.702946] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-24T21:16:10.702851] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:10.703401] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-24T21:16:10.703508] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-24T21:16:10.769843] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-24T21:16:10.769979] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-24T21:16:11.218146] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-24T21:16:11.466521] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T21:16:11.479843] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-24T21:16:11.509593] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-24T21:16:11.509509] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:11.510598] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-24T21:16:11.510939] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-24T21:16:11.511774] [DEBUG] [LOCAL ] SJT: Trimmed 32271 records to 22145 (keeping 200 days of data) [2025-09-24T21:16:11.638937] [DEBUG] [LOCAL ] SJT: Primary data saved (22145 records). [2025-09-24T21:16:11.639079] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-24T21:16:11.639168] [INFO ] [MAIN ] Update Progress: 1927/2373 symbols completed. SJT took 37.0s. Estimated remaining: 59m 17s. Rate: 7.5 symbols/min [2025-09-24T21:16:11.813893] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:11.857020] [DEBUG] [LOCAL ] SKY: Loaded 37730 existing records from primary storage. [2025-09-24T21:16:11.857211] [INFO ] [MAIN ] SKY: Loaded 37730 existing records. [2025-09-24T21:16:12.037783] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-24T21:16:12.043732] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:12.045017] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-24T21:16:12.045109] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-24T21:16:12.046627] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-24T21:16:12.046727] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-24T21:16:12.416185] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:12.434117] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T21:16:12.681752] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T21:16:12.685817] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19074 records). [2025-09-24T21:16:12.686103] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-24T21:16:12.821373] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-24T21:16:13.101879] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-24T21:16:13.101993] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-24T21:16:13.102729] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-24T21:16:13.102849] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-24T21:16:13.103764] [DEBUG] [LOCAL ] SKLZ: Trimmed 19074 records to 11946 (keeping 200 days of data) [2025-09-24T21:16:13.211785] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11946 records). [2025-09-24T21:16:13.212006] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-24T21:16:13.212141] [INFO ] [MAIN ] Update Progress: 1928/2373 symbols completed. SKLZ took 29.5s. Estimated remaining: 59m 7s. Rate: 7.5 symbols/min [2025-09-24T21:16:13.388032] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:13.388285] [DEBUG] [LOCAL ] SKYH: No existing data file found in primary storage. [2025-09-24T21:16:13.388323] [WARN ] [MAIN ] SKYH: No existing data found, performing full refresh instead. [2025-09-24T21:16:13.388488] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-24T21:16:13.388532] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-24T21:16:13.388572] [DEBUG] [LOCAL ] SKYH: No primary data file found to delete. [2025-09-24T21:16:13.388606] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-24T21:16:13.623391] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-24T21:16:13.799577] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:14.416104] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-24T21:16:14.532775] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:16:15.216054] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-24T21:16:15.280905] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:16:16.014765] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:16:16.022610] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-24T21:16:16.409618] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T21:16:16.816102] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-24T21:16:17.409093] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T21:16:17.493587] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-24T21:16:17.616130] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-24T21:16:18.416114] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-24T21:16:18.957756] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T21:16:19.216123] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-24T21:16:19.771540] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T21:16:20.016096] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-24T21:16:20.816091] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-24T21:16:20.887052] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T21:16:21.434609] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T21:16:21.616141] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-24T21:16:22.191115] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T21:16:22.416098] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-24T21:16:23.201417] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T21:16:23.216134] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-24T21:16:23.339948] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T21:16:24.016102] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-24T21:16:24.750304] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T21:16:24.816117] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-24T21:16:25.616051] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-24T21:16:25.712873] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T21:16:25.713629] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T21:16:26.416097] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-24T21:16:27.183254] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:16:27.216110] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-24T21:16:27.967658] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T21:16:28.016054] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-24T21:16:28.397097] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T21:16:28.816150] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-24T21:16:29.616132] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-24T21:16:29.664722] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T21:16:29.717691] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T21:16:30.416153] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-24T21:16:30.522966] [DEBUG] [REMOTE ] SKY: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-24T21:16:30.523279] [WARN ] [REMOTE ] SKY: No data returned for month 2025-05 [2025-09-24T21:16:31.108693] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:16:31.216091] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-24T21:16:32.016096] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-24T21:16:32.569528] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T21:16:32.575830] [INFO ] [REMOTE ] SKM: Full fetch complete (47978 records). [2025-09-24T21:16:32.575983] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-24T21:16:32.826731] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-24T21:16:32.984978] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-24T21:16:32.985066] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-24T21:16:32.986002] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-24T21:16:32.986067] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-24T21:16:32.987097] [DEBUG] [LOCAL ] SKM: Trimmed 47978 records to 35139 (keeping 200 days of data) [2025-09-24T21:16:33.241316] [DEBUG] [LOCAL ] SKM: Primary data saved (35139 records). [2025-09-24T21:16:33.241511] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-24T21:16:33.241629] [INFO ] [MAIN ] Update Progress: 1929/2373 symbols completed. SKM took 29.0s. Estimated remaining: 59m 2s. Rate: 7.5 symbols/min [2025-09-24T21:16:33.420018] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:33.481801] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-24T21:16:33.481996] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-24T21:16:33.626605] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-24T21:16:33.671133] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:33.672108] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-24T21:16:33.672335] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-24T21:16:33.681541] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-24T21:16:33.695052] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-24T21:16:33.748844] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T21:16:33.838748] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T21:16:34.099092] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:34.416132] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-24T21:16:35.108736] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T21:16:35.216123] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-24T21:16:36.016168] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-24T21:16:36.694827] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T21:16:36.783713] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T21:16:36.816037] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-24T21:16:37.088053] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T21:16:37.616120] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-24T21:16:38.269595] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T21:16:38.416094] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-24T21:16:39.185401] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T21:16:39.216092] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-24T21:16:39.858173] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T21:16:39.865855] [INFO ] [REMOTE ] SKT: Full fetch complete (60090 records). [2025-09-24T21:16:39.865955] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-24T21:16:40.021714] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-24T21:16:40.273434] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-24T21:16:40.273697] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-24T21:16:40.274877] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-24T21:16:40.274940] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-24T21:16:40.276423] [DEBUG] [LOCAL ] SKT: Trimmed 60090 records to 42650 (keeping 200 days of data) [2025-09-24T21:16:40.564608] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:16:40.582191] [DEBUG] [LOCAL ] SKT: Primary data saved (42650 records). [2025-09-24T21:16:40.582455] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-24T21:16:40.582580] [INFO ] [MAIN ] Update Progress: 1930/2373 symbols completed. SKT took 30.3s. Estimated remaining: 58m 54s. Rate: 7.5 symbols/min [2025-09-24T21:16:40.763505] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:40.803288] [DEBUG] [LOCAL ] SLF: Loaded 39010 existing records from primary storage. [2025-09-24T21:16:40.803434] [INFO ] [MAIN ] SLF: Loaded 39010 existing records. [2025-09-24T21:16:40.824490] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-24T21:16:40.999399] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:40.999741] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-24T21:16:40.999801] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-24T21:16:41.000848] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-24T21:16:41.000911] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-24T21:16:41.376206] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:41.616091] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-24T21:16:41.789159] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T21:16:41.989796] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T21:16:42.416284] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-24T21:16:43.098461] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T21:16:43.216099] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-24T21:16:43.817327] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-24T21:16:43.825831] [INFO ] [REMOTE ] SKY: Full fetch complete (49513 records). [2025-09-24T21:16:43.826042] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-24T21:16:44.019243] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-24T21:16:44.046345] [WARN ] [VALIDATOR ] SKY: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T21:16:44.048299] [FATAL] [MAIN ] SKY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:16:44.048382] [WARN ] [MAIN ] SKY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:16:44.048434] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-24T21:16:44.048512] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-09-24T21:16:44.048583] [INFO ] [LOCAL ] SKY: Starting deletion of derivative data. [2025-09-24T21:16:44.049106] [DEBUG] [LOCAL ] SKY: Deleted derivative data file. [2025-09-24T21:16:44.049231] [INFO ] [MAIN ] Update Progress: 1931/2373 symbols completed. SKY took 32.4s. Estimated remaining: 58m 45s. Rate: 7.5 symbols/min [2025-09-24T21:16:44.253468] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:44.298891] [DEBUG] [LOCAL ] SLG: Loaded 45568 existing records from primary storage. [2025-09-24T21:16:44.299048] [INFO ] [MAIN ] SLG: Loaded 45568 existing records. [2025-09-24T21:16:44.503953] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:44.518536] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-24T21:16:44.519220] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T21:16:44.524405] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-24T21:16:44.526378] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-24T21:16:44.526474] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-24T21:16:44.821169] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-24T21:16:44.924800] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:45.512215] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T21:16:45.515185] [INFO ] [REMOTE ] SKYH: Full fetch complete (22692 records). [2025-09-24T21:16:45.515261] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-24T21:16:45.616044] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-24T21:16:45.894284] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-24T21:16:45.894546] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-24T21:16:45.895188] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-24T21:16:45.895327] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-24T21:16:45.896582] [DEBUG] [LOCAL ] SKYH: Trimmed 22692 records to 16626 (keeping 200 days of data) [2025-09-24T21:16:46.015692] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-24T21:16:46.039082] [DEBUG] [LOCAL ] SKYH: Primary data saved (16626 records). [2025-09-24T21:16:46.039254] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-24T21:16:46.039339] [INFO ] [MAIN ] Update Progress: 1932/2373 symbols completed. SKYH took 32.8s. Estimated remaining: 58m 36s. Rate: 7.5 symbols/min [2025-09-24T21:16:46.207484] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:16:46.248115] [DEBUG] [LOCAL ] SLGN: Loaded 40325 existing records from primary storage. [2025-09-24T21:16:46.248328] [INFO ] [MAIN ] SLGN: Loaded 40325 existing records. [2025-09-24T21:16:46.427959] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:16:46.422128] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-24T21:16:46.429034] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-24T21:16:46.429091] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-24T21:16:46.430166] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-24T21:16:46.430229] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-24T21:16:46.801960] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:16:46.870238] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T21:16:47.216127] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-24T21:16:48.016104] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-24T21:16:48.380332] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T21:16:48.590445] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T21:16:48.816156] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-24T21:16:49.616063] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-24T21:16:49.728257] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:16:50.175627] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:16:50.416098] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-24T21:16:51.216166] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-24T21:16:51.588237] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:16:51.999889] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T21:16:52.016041] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-24T21:16:52.659287] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T21:16:52.816133] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-24T21:16:53.375269] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T21:16:53.616089] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-24T21:16:54.422623] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-24T21:16:54.426063] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-24T21:16:55.216079] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-24T21:16:55.274087] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T21:16:55.745380] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T21:16:56.016097] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-24T21:16:56.565801] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T21:16:56.816080] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-24T21:16:57.616069] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-24T21:16:57.643560] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T21:16:58.416116] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-24T21:16:58.992911] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-24T21:16:59.216058] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-24T21:16:59.278084] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T21:16:59.681690] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T21:17:00.016140] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-24T21:17:00.816123] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-24T21:17:01.303892] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-24T21:17:01.616158] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-24T21:17:01.658168] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:17:01.994509] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T21:17:02.416080] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-24T21:17:03.216088] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-24T21:17:03.902424] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-24T21:17:04.016088] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-24T21:17:04.052197] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:17:04.655721] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T21:17:04.816061] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-24T21:17:04.959371] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-24T21:17:05.616131] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-24T21:17:06.416129] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-24T21:17:06.610263] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T21:17:07.216108] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-24T21:17:07.585025] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T21:17:07.594921] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-24T21:17:07.595096] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-24T21:17:08.027340] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-24T21:17:08.034227] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T21:17:08.034399] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-24T21:17:08.046965] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-24T21:17:08.048802] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-24T21:17:08.049043] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-24T21:17:08.050753] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-09-24T21:17:08.396407] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-24T21:17:08.396561] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-24T21:17:08.396672] [INFO ] [MAIN ] Update Progress: 1933/2373 symbols completed. SLB took 35.2s. Estimated remaining: 58m 31s. Rate: 7.5 symbols/min [2025-09-24T21:17:08.604900] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:08.605445] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-24T21:17:08.605557] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-24T21:17:08.605915] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-24T21:17:08.606015] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-24T21:17:08.606085] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-24T21:17:08.606137] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-24T21:17:08.823825] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-24T21:17:08.982238] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:09.013395] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-24T21:17:09.454488] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T21:17:09.616140] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-24T21:17:10.416071] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-24T21:17:10.568501] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T21:17:11.128676] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T21:17:11.216095] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-24T21:17:12.016119] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-24T21:17:12.078975] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T21:17:12.087123] [INFO ] [REMOTE ] SLGN: Full fetch complete (58137 records). [2025-09-24T21:17:12.087261] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-24T21:17:12.498494] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-24T21:17:12.498683] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-24T21:17:12.499915] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-24T21:17:12.500102] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-24T21:17:12.501535] [DEBUG] [LOCAL ] SLGN: Trimmed 58137 records to 40337 (keeping 200 days of data) [2025-09-24T21:17:12.573832] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-24T21:17:12.664443] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T21:17:12.775135] [INFO ] [REMOTE ] SLG: Full fetch complete (65296 records). [2025-09-24T21:17:12.777725] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-24T21:17:12.817032] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-24T21:17:13.245689] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-24T21:17:13.245940] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-24T21:17:13.247274] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-24T21:17:13.247378] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-24T21:17:13.245846] [DEBUG] [LOCAL ] SLGN: Primary data saved (40337 records). [2025-09-24T21:17:13.247764] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-24T21:17:13.247912] [INFO ] [MAIN ] Update Progress: 1934/2373 symbols completed. SLGN took 27.2s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-24T21:17:13.341555] [DEBUG] [LOCAL ] SLG: Trimmed 65296 records to 45524 (keeping 200 days of data) [2025-09-24T21:17:13.522278] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:13.571313] [DEBUG] [LOCAL ] SLQT: Loaded 43976 existing records from primary storage. [2025-09-24T21:17:13.572591] [INFO ] [MAIN ] SLQT: Loaded 43976 existing records. [2025-09-24T21:17:13.617281] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-24T21:17:13.799098] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:13.804930] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-24T21:17:13.805028] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-24T21:17:13.806794] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-24T21:17:13.806878] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-24T21:17:14.073297] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-24T21:17:14.327136] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:14.398812] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:17:14.413438] [DEBUG] [LOCAL ] SLG: Primary data saved (45524 records). [2025-09-24T21:17:14.413618] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-24T21:17:14.413809] [INFO ] [MAIN ] Update Progress: 1935/2373 symbols completed. SLG took 30.4s. Estimated remaining: 58m 13s. Rate: 7.5 symbols/min [2025-09-24T21:17:14.425344] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-24T21:17:14.592419] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:14.623586] [DEBUG] [LOCAL ] SLVM: Loaded 27970 existing records from primary storage. [2025-09-24T21:17:14.623788] [INFO ] [MAIN ] SLVM: Loaded 27970 existing records. [2025-09-24T21:17:14.802108] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:14.802405] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-24T21:17:14.802455] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-24T21:17:14.803217] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-24T21:17:14.803278] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-24T21:17:15.165768] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:15.216047] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-24T21:17:15.856207] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T21:17:16.016095] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-24T21:17:16.575061] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T21:17:16.816091] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-24T21:17:17.545590] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T21:17:17.616078] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-24T21:17:18.030088] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T21:17:18.416085] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-24T21:17:18.767436] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-24T21:17:19.216067] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-24T21:17:19.421419] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T21:17:19.845263] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-24T21:17:20.016101] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-24T21:17:20.816137] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-24T21:17:21.228875] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-24T21:17:21.317152] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T21:17:21.616096] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-24T21:17:22.416151] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-24T21:17:23.119499] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T21:17:23.154054] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T21:17:23.216096] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-24T21:17:24.016084] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-24T21:17:24.674599] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T21:17:24.816108] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-24T21:17:25.616151] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-24T21:17:25.763005] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T21:17:25.898071] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T21:17:25.905900] [INFO ] [REMOTE ] SLF: Full fetch complete (56475 records). [2025-09-24T21:17:25.906203] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-24T21:17:26.329572] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-24T21:17:26.329695] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-24T21:17:26.330879] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-24T21:17:26.330979] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-24T21:17:26.334767] [DEBUG] [LOCAL ] SLF: Trimmed 56475 records to 38957 (keeping 200 days of data) [2025-09-24T21:17:26.442490] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-24T21:17:26.614273] [DEBUG] [LOCAL ] SLF: Primary data saved (38957 records). [2025-09-24T21:17:26.614686] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-24T21:17:26.614954] [INFO ] [MAIN ] Update Progress: 1936/2373 symbols completed. SLF took 46.0s. Estimated remaining: 58m 6s. Rate: 7.5 symbols/min [2025-09-24T21:17:26.800874] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T21:17:26.834253] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:26.895177] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-09-24T21:17:26.895439] [INFO ] [MAIN ] SM: Loaded 52323 existing records. [2025-09-24T21:17:26.987801] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T21:17:27.097185] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:27.097519] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-24T21:17:27.097588] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-24T21:17:27.099229] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-24T21:17:27.099309] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-24T21:17:27.221251] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-24T21:17:27.491434] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:28.016152] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-24T21:17:28.603043] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:17:28.816223] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-24T21:17:29.616165] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-24T21:17:29.904277] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T21:17:30.057330] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T21:17:30.059045] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T21:17:30.416153] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-24T21:17:31.216159] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-24T21:17:32.004708] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T21:17:32.016036] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-24T21:17:32.816086] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-24T21:17:33.176364] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T21:17:33.616077] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-24T21:17:33.779251] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:17:34.133482] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T21:17:34.416133] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-24T21:17:34.970191] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T21:17:35.205209] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T21:17:35.216047] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-24T21:17:35.566292] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-24T21:17:36.016099] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-24T21:17:36.473614] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T21:17:36.474405] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1064 records). [2025-09-24T21:17:36.474478] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-24T21:17:36.672079] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-24T21:17:36.672308] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:17:36.672373] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:17:36.672452] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-24T21:17:36.672520] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-24T21:17:36.672571] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-24T21:17:36.672720] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-24T21:17:36.672808] [INFO ] [MAIN ] Update Progress: 1937/2373 symbols completed. SLNZ took 28.3s. Estimated remaining: 57m 58s. Rate: 7.5 symbols/min [2025-09-24T21:17:36.827213] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-24T21:17:36.862698] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:36.862894] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-24T21:17:36.862957] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-24T21:17:36.863124] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-24T21:17:36.863172] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-24T21:17:36.863222] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-24T21:17:36.863302] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-24T21:17:37.264496] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:37.616101] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-24T21:17:38.217600] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:17:38.217970] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-24T21:17:38.236327] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T21:17:38.241918] [INFO ] [REMOTE ] SLVM: Full fetch complete (39555 records). [2025-09-24T21:17:38.242066] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-24T21:17:38.425068] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-24T21:17:38.652313] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-24T21:17:38.652413] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-24T21:17:38.653475] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-24T21:17:38.653539] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-24T21:17:38.656116] [DEBUG] [LOCAL ] SLVM: Trimmed 39555 records to 27971 (keeping 200 days of data) [2025-09-24T21:17:38.848200] [DEBUG] [LOCAL ] SLVM: Primary data saved (27971 records). [2025-09-24T21:17:38.848597] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-24T21:17:38.848747] [INFO ] [MAIN ] Update Progress: 1938/2373 symbols completed. SLVM took 24.4s. Estimated remaining: 57m 49s. Rate: 7.5 symbols/min [2025-09-24T21:17:39.016535] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:39.027789] [DEBUG] [LOCAL ] SMBK: Loaded 8249 existing records from primary storage. [2025-09-24T21:17:39.027925] [INFO ] [MAIN ] SMBK: Loaded 8249 existing records. [2025-09-24T21:17:39.202746] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:39.203042] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-24T21:17:39.203091] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-24T21:17:39.203811] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-24T21:17:39.203874] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-24T21:17:39.224043] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-24T21:17:39.568568] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:39.595708] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:17:39.596111] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-24T21:17:40.016090] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-24T21:17:40.097497] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:17:40.312897] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:17:40.313232] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-24T21:17:40.816073] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-24T21:17:41.110494] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:17:41.110870] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-24T21:17:41.616076] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-24T21:17:42.416135] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-24T21:17:43.216102] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-24T21:17:43.274791] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-24T21:17:44.016087] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-24T21:17:44.438303] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-24T21:17:44.702240] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T21:17:44.816047] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-24T21:17:45.616066] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-24T21:17:45.844469] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:17:46.416104] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-24T21:17:46.866752] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T21:17:47.216133] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-24T21:17:48.016086] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-24T21:17:49.098263] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-24T21:17:49.110239] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T21:17:49.114015] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-24T21:17:49.549844] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-24T21:17:49.556962] [INFO ] [REMOTE ] SLQT: Full fetch complete (63627 records). [2025-09-24T21:17:49.557102] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-24T21:17:49.622997] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-24T21:17:49.966174] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-24T21:17:49.966336] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-24T21:17:49.967545] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-24T21:17:49.967632] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-24T21:17:49.972182] [DEBUG] [LOCAL ] SLQT: Trimmed 63627 records to 43866 (keeping 200 days of data) [2025-09-24T21:17:50.087012] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-24T21:17:50.119931] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T21:17:50.289574] [DEBUG] [LOCAL ] SLQT: Primary data saved (43866 records). [2025-09-24T21:17:50.289746] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-24T21:17:50.289888] [INFO ] [MAIN ] Update Progress: 1939/2373 symbols completed. SLQT took 37.0s. Estimated remaining: 57m 42s. Rate: 7.5 symbols/min [2025-09-24T21:17:50.421320] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-24T21:17:50.563220] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:50.575905] [DEBUG] [LOCAL ] SMC: Loaded 11481 existing records from primary storage. [2025-09-24T21:17:50.576068] [INFO ] [MAIN ] SMC: Loaded 11481 existing records. [2025-09-24T21:17:50.757194] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:50.757481] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-24T21:17:50.757530] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-24T21:17:50.757947] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-24T21:17:50.758007] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-24T21:17:51.112554] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T21:17:51.155823] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:51.216061] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-24T21:17:51.711746] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-24T21:17:52.016147] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-24T21:17:52.797487] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:17:52.816053] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-24T21:17:53.616162] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-24T21:17:53.852759] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T21:17:54.375209] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T21:17:54.416084] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-24T21:17:54.443611] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T21:17:55.216129] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-24T21:17:55.899758] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:17:55.905263] [INFO ] [REMOTE ] SMA: Full fetch complete (29444 records). [2025-09-24T21:17:55.905392] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-24T21:17:56.021274] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-24T21:17:56.113939] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 121 unique days, need 200 days [2025-09-24T21:17:56.114570] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:17:56.114677] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:17:56.114756] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-24T21:17:56.114857] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-24T21:17:56.114911] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-24T21:17:56.114954] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-24T21:17:56.115049] [INFO ] [MAIN ] Update Progress: 1940/2373 symbols completed. SMA took 19.4s. Estimated remaining: 57m 33s. Rate: 7.5 symbols/min [2025-09-24T21:17:56.236190] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-24T21:17:56.316702] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:17:56.381478] [DEBUG] [LOCAL ] SMFG: Loaded 48120 existing records from primary storage. [2025-09-24T21:17:56.381748] [INFO ] [MAIN ] SMFG: Loaded 48120 existing records. [2025-09-24T21:17:56.574318] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:17:56.574725] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-24T21:17:56.574788] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-24T21:17:56.576163] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-24T21:17:56.576230] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-24T21:17:56.827072] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-24T21:17:56.962687] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:17:57.616058] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-24T21:17:57.921412] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T21:17:58.416052] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-24T21:17:58.525190] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-24T21:17:59.216081] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-24T21:18:00.016163] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-24T21:18:00.088258] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-24T21:18:00.130921] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T21:18:00.816057] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-24T21:18:01.121392] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T21:18:01.157370] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T21:18:01.616089] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-24T21:18:02.416154] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-24T21:18:02.641088] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:18:02.875938] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T21:18:03.216094] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-24T21:18:04.016059] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-24T21:18:04.066605] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T21:18:04.303855] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T21:18:04.313441] [INFO ] [REMOTE ] SM: Full fetch complete (75194 records). [2025-09-24T21:18:04.313625] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-24T21:18:04.743814] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-24T21:18:04.743915] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-24T21:18:04.745055] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-24T21:18:04.745137] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-24T21:18:04.746929] [DEBUG] [LOCAL ] SM: Trimmed 75194 records to 52313 (keeping 200 days of data) [2025-09-24T21:18:04.840992] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-24T21:18:05.080420] [DEBUG] [LOCAL ] SM: Primary data saved (52313 records). [2025-09-24T21:18:05.080611] [INFO ] [MAIN ] SM: Full history saved. [2025-09-24T21:18:05.080759] [INFO ] [MAIN ] Update Progress: 1941/2373 symbols completed. SM took 38.5s. Estimated remaining: 57m 26s. Rate: 7.5 symbols/min [2025-09-24T21:18:05.268068] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:05.312610] [DEBUG] [LOCAL ] SMG: Loaded 43981 existing records from primary storage. [2025-09-24T21:18:05.312787] [INFO ] [MAIN ] SMG: Loaded 43981 existing records. [2025-09-24T21:18:05.513103] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:05.513524] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-24T21:18:05.513635] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-24T21:18:05.515045] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-24T21:18:05.515113] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-24T21:18:05.622918] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-24T21:18:05.717002] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:18:05.860060] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T21:18:05.944749] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:06.416092] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-24T21:18:06.784233] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T21:18:07.216095] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-24T21:18:08.016118] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-24T21:18:08.106519] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T21:18:08.106204] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T21:18:08.816119] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-24T21:18:09.616118] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-24T21:18:09.662260] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T21:18:09.805453] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T21:18:10.192967] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T21:18:10.416116] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-24T21:18:11.216155] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-24T21:18:11.994638] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T21:18:12.016037] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-24T21:18:12.148930] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T21:18:12.816123] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-24T21:18:13.616413] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-24T21:18:13.620221] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:18:13.637894] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T21:18:14.416108] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-24T21:18:14.636251] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:18:14.638574] [INFO ] [REMOTE ] SMBK: Full fetch complete (11837 records). [2025-09-24T21:18:14.638728] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-24T21:18:15.037780] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-24T21:18:15.037953] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-24T21:18:15.038520] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-24T21:18:15.038587] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-24T21:18:15.039489] [DEBUG] [LOCAL ] SMBK: Trimmed 11837 records to 8254 (keeping 200 days of data) [2025-09-24T21:18:15.098278] [DEBUG] [LOCAL ] SMBK: Primary data saved (8254 records). [2025-09-24T21:18:15.098511] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-24T21:18:15.098629] [INFO ] [MAIN ] Update Progress: 1942/2373 symbols completed. SMBK took 36.2s. Estimated remaining: 57m 18s. Rate: 7.5 symbols/min [2025-09-24T21:18:15.221322] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-24T21:18:15.292044] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:15.310479] [DEBUG] [LOCAL ] SMHI: Loaded 13940 existing records from primary storage. [2025-09-24T21:18:15.310705] [INFO ] [MAIN ] SMHI: Loaded 13940 existing records. [2025-09-24T21:18:15.501748] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:15.502130] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-24T21:18:15.502190] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-24T21:18:15.502837] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-24T21:18:15.502901] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-24T21:18:15.886026] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:16.016120] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-24T21:18:16.816160] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-24T21:18:16.935956] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-24T21:18:17.616083] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-24T21:18:18.789859] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (3.57 seconds). [2025-09-24T21:18:18.807381] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-24T21:18:18.809667] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T21:18:18.812570] [INFO ] [REMOTE ] SMC: Full fetch complete (16868 records). [2025-09-24T21:18:18.812672] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-24T21:18:19.189676] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-24T21:18:19.189858] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-24T21:18:19.190377] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-24T21:18:19.196475] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-24T21:18:19.214341] [DEBUG] [LOCAL ] SMC: Trimmed 16868 records to 11512 (keeping 200 days of data) [2025-09-24T21:18:19.218075] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-24T21:18:19.252476] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-24T21:18:19.296915] [DEBUG] [LOCAL ] SMC: Primary data saved (11512 records). [2025-09-24T21:18:19.297079] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-24T21:18:19.297185] [INFO ] [MAIN ] Update Progress: 1943/2373 symbols completed. SMC took 29.0s. Estimated remaining: 57m 9s. Rate: 7.5 symbols/min [2025-09-24T21:18:19.470056] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:19.490856] [DEBUG] [LOCAL ] SMP: Loaded 19834 existing records from primary storage. [2025-09-24T21:18:19.491014] [INFO ] [MAIN ] SMP: Loaded 19834 existing records. [2025-09-24T21:18:19.699686] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (3.68 seconds). [2025-09-24T21:18:19.715050] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:19.727468] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-24T21:18:19.727758] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-24T21:18:19.728505] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-24T21:18:19.728570] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-24T21:18:20.020924] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-24T21:18:20.104040] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:20.241547] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T21:18:20.646552] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:18:20.816176] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-24T21:18:21.616136] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-24T21:18:21.773755] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:18:22.006350] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-24T21:18:22.416101] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-24T21:18:23.221526] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-24T21:18:23.241341] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T21:18:23.283732] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:18:24.016055] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-24T21:18:24.093724] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-24T21:18:24.816137] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-24T21:18:25.153142] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T21:18:25.616104] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-24T21:18:25.900420] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T21:18:26.416088] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-24T21:18:27.216069] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-24T21:18:27.485158] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T21:18:27.565601] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T21:18:28.016127] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-24T21:18:28.179971] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T21:18:28.816089] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-24T21:18:29.439357] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:18:29.616096] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-24T21:18:29.751924] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-24T21:18:30.416097] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-24T21:18:31.136960] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T21:18:31.216102] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-24T21:18:32.018911] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-24T21:18:32.024227] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T21:18:32.389588] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T21:18:32.816123] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-24T21:18:33.616103] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-24T21:18:33.944571] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-24T21:18:34.199421] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:18:34.416108] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-24T21:18:34.746754] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:18:35.216105] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-24T21:18:36.016063] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-24T21:18:36.077294] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-24T21:18:36.085571] [INFO ] [REMOTE ] SMFG: Full fetch complete (68851 records). [2025-09-24T21:18:36.085730] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-24T21:18:36.520692] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-24T21:18:36.520801] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-24T21:18:36.521880] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-24T21:18:36.521945] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-24T21:18:36.524199] [DEBUG] [LOCAL ] SMFG: Trimmed 68851 records to 48090 (keeping 200 days of data) [2025-09-24T21:18:36.764338] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T21:18:36.826681] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-24T21:18:36.860076] [DEBUG] [LOCAL ] SMFG: Primary data saved (48090 records). [2025-09-24T21:18:36.860273] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-24T21:18:36.860404] [INFO ] [MAIN ] Update Progress: 1944/2373 symbols completed. SMFG took 40.7s. Estimated remaining: 57m 3s. Rate: 7.5 symbols/min [2025-09-24T21:18:37.020203] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T21:18:37.056758] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:37.057143] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-24T21:18:37.057187] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-24T21:18:37.057331] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-24T21:18:37.057374] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-24T21:18:37.057418] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-24T21:18:37.057452] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-24T21:18:37.424089] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:37.616085] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-24T21:18:38.016394] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:18:38.235939] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T21:18:38.416074] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-24T21:18:39.216080] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-24T21:18:39.989512] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-24T21:18:40.016025] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-24T21:18:40.233294] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:18:40.236784] [INFO ] [REMOTE ] SMP: Full fetch complete (26126 records). [2025-09-24T21:18:40.236874] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-24T21:18:40.637323] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-24T21:18:40.637403] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-24T21:18:40.638005] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-24T21:18:40.638067] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-24T21:18:40.638732] [DEBUG] [LOCAL ] SMP: Trimmed 26126 records to 19784 (keeping 200 days of data) [2025-09-24T21:18:40.760307] [DEBUG] [LOCAL ] SMP: Primary data saved (19784 records). [2025-09-24T21:18:40.760448] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-24T21:18:40.760545] [INFO ] [MAIN ] Update Progress: 1945/2373 symbols completed. SMP took 21.5s. Estimated remaining: 56m 55s. Rate: 7.5 symbols/min [2025-09-24T21:18:40.823627] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-24T21:18:40.935980] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:40.979962] [DEBUG] [LOCAL ] SMRT: Loaded 44255 existing records from primary storage. [2025-09-24T21:18:40.980245] [INFO ] [MAIN ] SMRT: Loaded 44255 existing records. [2025-09-24T21:18:41.157735] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:41.157962] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-24T21:18:41.158010] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-24T21:18:41.159102] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-24T21:18:41.159162] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-24T21:18:41.516189] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:41.609674] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:18:41.616408] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-24T21:18:41.618621] [INFO ] [REMOTE ] SMG: Full fetch complete (62653 records). [2025-09-24T21:18:41.618771] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-24T21:18:42.050012] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-24T21:18:42.050139] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-24T21:18:42.051311] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-24T21:18:42.051378] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-24T21:18:42.053150] [DEBUG] [LOCAL ] SMG: Trimmed 62653 records to 43911 (keeping 200 days of data) [2025-09-24T21:18:42.332235] [DEBUG] [LOCAL ] SMG: Primary data saved (43911 records). [2025-09-24T21:18:42.332387] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-24T21:18:42.332477] [INFO ] [MAIN ] Update Progress: 1946/2373 symbols completed. SMG took 37.3s. Estimated remaining: 56m 45s. Rate: 7.5 symbols/min [2025-09-24T21:18:42.423629] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-24T21:18:42.513773] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:42.545904] [DEBUG] [LOCAL ] SMWB: Loaded 32980 existing records from primary storage. [2025-09-24T21:18:42.546086] [INFO ] [MAIN ] SMWB: Loaded 32980 existing records. [2025-09-24T21:18:42.737472] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:42.746270] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-24T21:18:42.746939] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-24T21:18:42.747309] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T21:18:42.750466] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-24T21:18:42.750600] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-24T21:18:43.148501] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:43.216123] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-24T21:18:43.677115] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-24T21:18:43.918726] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:18:44.016095] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-24T21:18:44.060753] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T21:18:44.063102] [INFO ] [REMOTE ] SMHI: Full fetch complete (24238 records). [2025-09-24T21:18:44.063276] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-24T21:18:44.430093] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-24T21:18:44.430178] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-24T21:18:44.430742] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-24T21:18:44.430803] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-24T21:18:44.431398] [DEBUG] [LOCAL ] SMHI: Trimmed 24238 records to 13809 (keeping 200 days of data) [2025-09-24T21:18:44.514025] [DEBUG] [LOCAL ] SMHI: Primary data saved (13809 records). [2025-09-24T21:18:44.514169] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-24T21:18:44.514255] [INFO ] [MAIN ] Update Progress: 1947/2373 symbols completed. SMHI took 29.4s. Estimated remaining: 56m 36s. Rate: 7.5 symbols/min [2025-09-24T21:18:44.683283] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:18:44.735155] [DEBUG] [LOCAL ] SN: Loaded 49836 existing records from primary storage. [2025-09-24T21:18:44.735299] [INFO ] [MAIN ] SN: Loaded 49836 existing records. [2025-09-24T21:18:44.825554] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-24T21:18:44.917739] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:18:44.917983] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-24T21:18:44.918030] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-24T21:18:44.919343] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-24T21:18:44.919403] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-24T21:18:45.286610] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:18:45.616131] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-24T21:18:46.073780] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T21:18:46.426307] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-24T21:18:46.453576] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-24T21:18:47.216053] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-24T21:18:47.324089] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:18:47.892693] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T21:18:48.016038] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-24T21:18:48.688543] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-24T21:18:48.816077] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-24T21:18:49.517511] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T21:18:49.616083] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-24T21:18:50.120445] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T21:18:50.416146] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-24T21:18:51.011973] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T21:18:51.216086] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-24T21:18:52.016087] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-24T21:18:52.697868] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-24T21:18:52.786556] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-24T21:18:52.816073] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-24T21:18:53.364855] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:18:53.616276] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-24T21:18:54.416145] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-24T21:18:54.634971] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T21:18:55.164704] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:18:55.216042] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-24T21:18:56.016093] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-24T21:18:56.607366] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T21:18:56.816119] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-24T21:18:57.158840] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-24T21:18:57.616060] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-24T21:18:57.833821] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T21:18:57.928432] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T21:18:58.416104] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-24T21:18:59.216149] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-24T21:18:59.368782] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T21:18:59.887199] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T21:19:00.016140] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-24T21:19:00.816173] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-24T21:19:01.616192] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-24T21:19:01.882998] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-24T21:19:02.027789] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-24T21:19:02.416208] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-24T21:19:02.805068] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T21:19:02.843721] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-24T21:19:03.216090] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-24T21:19:04.016112] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-24T21:19:04.816049] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-24T21:19:04.838919] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T21:19:05.064100] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T21:19:05.111850] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-24T21:19:05.616080] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-24T21:19:06.416076] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-24T21:19:06.528832] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T21:19:06.984616] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T21:19:06.989999] [INFO ] [REMOTE ] SMWB: Full fetch complete (50083 records). [2025-09-24T21:19:06.990101] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-24T21:19:07.224127] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-24T21:19:07.418403] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-24T21:19:07.418576] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-24T21:19:07.420745] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-24T21:19:07.420900] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-24T21:19:07.422773] [DEBUG] [LOCAL ] SMWB: Trimmed 50083 records to 32775 (keeping 200 days of data) [2025-09-24T21:19:07.634118] [DEBUG] [LOCAL ] SMWB: Primary data saved (32775 records). [2025-09-24T21:19:07.634350] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-24T21:19:07.634530] [INFO ] [MAIN ] Update Progress: 1948/2373 symbols completed. SMWB took 25.3s. Estimated remaining: 56m 31s. Rate: 7.5 symbols/min [2025-09-24T21:19:07.810105] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:07.845776] [DEBUG] [LOCAL ] SNA: Loaded 26430 existing records from primary storage. [2025-09-24T21:19:07.846006] [INFO ] [MAIN ] SNA: Loaded 26430 existing records. [2025-09-24T21:19:08.028557] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-24T21:19:08.037335] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:08.039312] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-24T21:19:08.039417] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-24T21:19:08.040219] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-24T21:19:08.040295] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-24T21:19:08.395719] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:08.816151] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-24T21:19:09.057992] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-24T21:19:09.165421] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T21:19:09.554478] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T21:19:09.616109] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-24T21:19:09.819621] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T21:19:10.416109] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-24T21:19:11.216159] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-24T21:19:12.016084] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-24T21:19:12.324835] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T21:19:12.528037] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-24T21:19:12.566910] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:19:12.816097] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-24T21:19:13.247137] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T21:19:13.616105] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-24T21:19:14.305074] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T21:19:14.316865] [INFO ] [REMOTE ] SMRT: Full fetch complete (62278 records). [2025-09-24T21:19:14.317120] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-24T21:19:14.432150] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-24T21:19:14.880954] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-24T21:19:14.881062] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-24T21:19:14.882557] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-24T21:19:14.882867] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-24T21:19:14.887805] [DEBUG] [LOCAL ] SMRT: Trimmed 62278 records to 44219 (keeping 200 days of data) [2025-09-24T21:19:15.048618] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T21:19:15.059962] [INFO ] [REMOTE ] SN: Full fetch complete (70835 records). [2025-09-24T21:19:15.061702] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-24T21:19:15.239421] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-24T21:19:15.584957] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-24T21:19:15.585622] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-24T21:19:15.587168] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-24T21:19:15.587542] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-24T21:19:15.593736] [DEBUG] [LOCAL ] SN: Trimmed 70835 records to 49791 (keeping 200 days of data) [2025-09-24T21:19:15.726956] [DEBUG] [LOCAL ] SMRT: Primary data saved (44219 records). [2025-09-24T21:19:15.728147] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-24T21:19:15.728673] [INFO ] [MAIN ] Update Progress: 1949/2373 symbols completed. SMRT took 35.0s. Estimated remaining: 56m 23s. Rate: 7.5 symbols/min [2025-09-24T21:19:15.913248] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:15.938158] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T21:19:16.026459] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-24T21:19:16.084591] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-24T21:19:16.085881] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-24T21:19:16.286542] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:16.289775] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-24T21:19:16.289859] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-24T21:19:16.291630] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-24T21:19:16.292030] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-24T21:19:16.735133] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:16.745396] [DEBUG] [LOCAL ] SN: Primary data saved (49791 records). [2025-09-24T21:19:16.745483] [INFO ] [MAIN ] SN: Full history saved. [2025-09-24T21:19:16.745589] [INFO ] [MAIN ] Update Progress: 1950/2373 symbols completed. SN took 32.2s. Estimated remaining: 56m 14s. Rate: 7.5 symbols/min [2025-09-24T21:19:16.821151] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-24T21:19:16.919764] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:16.928002] [DEBUG] [LOCAL ] SNDA: Loaded 4700 existing records from primary storage. [2025-09-24T21:19:16.928144] [INFO ] [MAIN ] SNDA: Loaded 4700 existing records. [2025-09-24T21:19:17.114697] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:17.114971] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-24T21:19:17.115022] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-24T21:19:17.115325] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-24T21:19:17.115387] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-24T21:19:17.505864] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:17.616064] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-24T21:19:17.702511] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T21:19:18.080786] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-24T21:19:18.416112] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-24T21:19:18.524005] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T21:19:19.216045] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-24T21:19:19.260570] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T21:19:19.298978] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-24T21:19:19.299217] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-24T21:19:19.302114] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-24T21:19:19.302951] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T21:19:19.313893] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:19:19.314477] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:19:19.314553] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-24T21:19:19.314621] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-24T21:19:19.314709] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-24T21:19:19.314791] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-09-24T21:19:19.314871] [INFO ] [MAIN ] Update Progress: 1951/2373 symbols completed. SMR took 42.5s. Estimated remaining: 56m 5s. Rate: 7.5 symbols/min [2025-09-24T21:19:19.493439] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:19.543324] [DEBUG] [LOCAL ] SNDR: Loaded 40672 existing records from primary storage. [2025-09-24T21:19:19.543479] [INFO ] [MAIN ] SNDR: Loaded 40672 existing records. [2025-09-24T21:19:19.727601] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:19.727973] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-24T21:19:19.728047] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-24T21:19:19.729087] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-24T21:19:19.729153] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-24T21:19:19.897446] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T21:19:20.021194] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-24T21:19:20.156244] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:20.637430] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T21:19:20.816074] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-24T21:19:21.616111] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-24T21:19:22.324399] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T21:19:22.384711] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:19:22.416056] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-24T21:19:23.216097] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-24T21:19:23.740527] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T21:19:23.789116] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-24T21:19:24.016097] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-24T21:19:24.816091] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-24T21:19:25.309936] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T21:19:25.608272] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T21:19:25.616028] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-24T21:19:26.243627] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T21:19:26.416177] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-24T21:19:27.216193] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-24T21:19:28.016120] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-24T21:19:28.541952] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T21:19:28.816082] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-24T21:19:28.923327] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-24T21:19:29.395489] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-24T21:19:29.472379] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-24T21:19:29.616150] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-24T21:19:30.416092] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-24T21:19:31.044412] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T21:19:31.216117] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-24T21:19:31.290983] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T21:19:31.894432] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T21:19:32.016079] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-24T21:19:32.816119] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-24T21:19:33.211193] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T21:19:33.216076] [INFO ] [REMOTE ] SNA: Full fetch complete (39181 records). [2025-09-24T21:19:33.216204] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-24T21:19:33.515624] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T21:19:33.519851] [INFO ] [REMOTE ] SNDA: Full fetch complete (8549 records). [2025-09-24T21:19:33.540619] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-24T21:19:33.629062] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-24T21:19:33.710025] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-24T21:19:33.722750] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-24T21:19:33.723940] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-24T21:19:33.724045] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-24T21:19:33.788564] [DEBUG] [LOCAL ] SNA: Trimmed 39181 records to 26318 (keeping 200 days of data) [2025-09-24T21:19:34.128223] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-24T21:19:34.128823] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-24T21:19:34.129947] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-24T21:19:34.130310] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-24T21:19:34.132128] [DEBUG] [LOCAL ] SNDA: Trimmed 8549 records to 4672 (keeping 200 days of data) [2025-09-24T21:19:34.177120] [DEBUG] [LOCAL ] SNDA: Primary data saved (4672 records). [2025-09-24T21:19:34.178227] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-24T21:19:34.179336] [INFO ] [MAIN ] Update Progress: 1952/2373 symbols completed. SNDA took 17.4s. Estimated remaining: 55m 58s. Rate: 7.5 symbols/min [2025-09-24T21:19:34.414275] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:34.417461] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-24T21:19:34.465926] [DEBUG] [LOCAL ] SNA: Primary data saved (26318 records). [2025-09-24T21:19:34.466142] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-24T21:19:34.466310] [INFO ] [MAIN ] Update Progress: 1953/2373 symbols completed. SNA took 26.8s. Estimated remaining: 55m 49s. Rate: 7.5 symbols/min [2025-09-24T21:19:34.665131] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:34.666162] [DEBUG] [LOCAL ] SNN: Loaded 44348 existing records from primary storage. [2025-09-24T21:19:34.666287] [INFO ] [MAIN ] SNN: Loaded 44348 existing records. [2025-09-24T21:19:34.666362] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-24T21:19:34.666434] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-24T21:19:34.741035] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-24T21:19:34.746240] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-24T21:19:34.764919] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-24T21:19:34.767344] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-24T21:19:34.995710] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:35.066943] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-24T21:19:35.093185] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-24T21:19:35.114486] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-24T21:19:35.124775] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-24T21:19:35.352467] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:35.355981] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-24T21:19:35.651837] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:35.711370] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T21:19:36.005838] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T21:19:36.016021] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-24T21:19:36.816087] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-24T21:19:37.616059] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-24T21:19:37.646283] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T21:19:38.062825] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-24T21:19:38.416088] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-24T21:19:38.992416] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-24T21:19:39.216085] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-24T21:19:39.319736] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:19:39.626166] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T21:19:40.016092] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-24T21:19:40.816104] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-24T21:19:41.520105] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-24T21:19:41.616054] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-24T21:19:41.736838] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T21:19:42.416098] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-24T21:19:43.216114] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-24T21:19:43.272615] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-24T21:19:43.691237] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T21:19:44.024675] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-24T21:19:44.048009] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-24T21:19:44.747397] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T21:19:44.816120] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-24T21:19:45.616090] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-24T21:19:46.401439] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-24T21:19:46.416028] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-24T21:19:46.824333] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-24T21:19:47.088997] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T21:19:47.216075] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-24T21:19:48.016155] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-24T21:19:48.821188] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-24T21:19:48.848928] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-24T21:19:48.897300] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T21:19:49.616072] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-24T21:19:49.853442] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:19:50.416189] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-24T21:19:51.116875] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-24T21:19:51.158671] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T21:19:51.216073] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-24T21:19:52.016112] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-24T21:19:52.616283] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-24T21:19:52.821281] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-24T21:19:52.848297] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T21:19:52.859520] [INFO ] [REMOTE ] SNDR: Full fetch complete (58922 records). [2025-09-24T21:19:52.859729] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-24T21:19:53.253374] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-24T21:19:53.253474] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-24T21:19:53.254464] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-24T21:19:53.254530] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-24T21:19:53.255807] [DEBUG] [LOCAL ] SNDR: Trimmed 58922 records to 40714 (keeping 200 days of data) [2025-09-24T21:19:53.515724] [DEBUG] [LOCAL ] SNDR: Primary data saved (40714 records). [2025-09-24T21:19:53.515865] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-24T21:19:53.516004] [INFO ] [MAIN ] Update Progress: 1954/2373 symbols completed. SNDR took 34.2s. Estimated remaining: 55m 43s. Rate: 7.5 symbols/min [2025-09-24T21:19:53.618463] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-24T21:19:53.689328] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:19:53.738325] [DEBUG] [LOCAL ] SNV: Loaded 48909 existing records from primary storage. [2025-09-24T21:19:53.738525] [INFO ] [MAIN ] SNV: Loaded 48909 existing records. [2025-09-24T21:19:53.914257] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:19:53.914621] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-24T21:19:53.914704] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-24T21:19:53.917110] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-24T21:19:53.917173] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-24T21:19:54.269015] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:19:54.416043] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-24T21:19:54.596227] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-24T21:19:54.986915] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T21:19:55.216093] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-24T21:19:55.520450] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-24T21:19:56.016108] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-24T21:19:56.113622] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:19:56.184463] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:19:56.816118] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-24T21:19:57.616119] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-24T21:19:58.358387] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-24T21:19:58.416038] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-24T21:19:59.225580] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-24T21:19:59.229027] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-24T21:19:59.239199] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-24T21:19:59.239359] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-24T21:19:59.624708] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T21:19:59.689824] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-24T21:19:59.689968] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-24T21:19:59.691237] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-24T21:19:59.691326] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-24T21:19:59.693440] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 53796 (keeping 200 days of data) [2025-09-24T21:20:00.012608] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-24T21:20:00.012840] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-24T21:20:00.013018] [INFO ] [MAIN ] Update Progress: 1955/2373 symbols completed. SNAP took 44.3s. Estimated remaining: 55m 35s. Rate: 7.5 symbols/min [2025-09-24T21:20:00.018575] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-24T21:20:00.218353] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:00.260767] [DEBUG] [LOCAL ] SNX: Loaded 39757 existing records from primary storage. [2025-09-24T21:20:00.260920] [INFO ] [MAIN ] SNX: Loaded 39757 existing records. [2025-09-24T21:20:00.444959] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:00.445239] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-24T21:20:00.445341] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-24T21:20:00.446286] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-24T21:20:00.446348] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-24T21:20:00.818094] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:00.818807] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-24T21:20:00.951531] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-24T21:20:01.113128] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T21:20:01.616116] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-24T21:20:01.884334] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T21:20:02.416142] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-24T21:20:02.757388] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T21:20:03.216132] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-24T21:20:03.913262] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-24T21:20:04.016043] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-24T21:20:04.207364] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:20:04.517775] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T21:20:04.527086] [INFO ] [REMOTE ] SNOW: Full fetch complete (77265 records). [2025-09-24T21:20:04.527244] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-24T21:20:04.528182] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T21:20:04.528293] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:20:04.528368] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:20:04.528467] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-24T21:20:04.528550] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-24T21:20:04.528620] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-24T21:20:04.528749] [DEBUG] [LOCAL ] SNOW: No derivative data file found to delete. [2025-09-24T21:20:04.528880] [INFO ] [MAIN ] Update Progress: 1956/2373 symbols completed. SNOW took 30.1s. Estimated remaining: 55m 26s. Rate: 7.5 symbols/min [2025-09-24T21:20:04.778661] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:04.778909] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-24T21:20:04.779074] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-24T21:20:04.779528] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-24T21:20:04.779680] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-24T21:20:04.779768] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-24T21:20:04.780003] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-24T21:20:04.821207] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-24T21:20:05.125171] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T21:20:05.212555] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:05.616115] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-24T21:20:06.416116] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-24T21:20:06.775133] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-24T21:20:07.216056] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-24T21:20:07.291542] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T21:20:08.016106] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-24T21:20:08.543187] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T21:20:08.816141] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-24T21:20:09.085462] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T21:20:09.094343] [INFO ] [REMOTE ] SNN: Full fetch complete (63034 records). [2025-09-24T21:20:09.094573] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-24T21:20:09.513615] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-24T21:20:09.513934] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-24T21:20:09.515282] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-24T21:20:09.515411] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-24T21:20:09.517246] [DEBUG] [LOCAL ] SNN: Trimmed 63034 records to 44392 (keeping 200 days of data) [2025-09-24T21:20:09.648871] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-24T21:20:09.732171] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T21:20:09.846391] [DEBUG] [LOCAL ] SNN: Primary data saved (44392 records). [2025-09-24T21:20:09.846545] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-24T21:20:09.846639] [INFO ] [MAIN ] Update Progress: 1957/2373 symbols completed. SNN took 35.7s. Estimated remaining: 55m 17s. Rate: 7.5 symbols/min [2025-09-24T21:20:10.416208] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-24T21:20:10.693277] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-24T21:20:10.916479] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T21:20:11.216156] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-24T21:20:12.016129] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-24T21:20:12.185341] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T21:20:12.816124] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-24T21:20:12.958639] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T21:20:13.616055] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-24T21:20:13.782842] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T21:20:14.099159] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T21:20:14.416085] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-24T21:20:15.221181] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-24T21:20:15.241234] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T21:20:16.018340] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-24T21:20:16.021495] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T21:20:16.816060] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-24T21:20:17.292148] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T21:20:17.586490] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T21:20:17.616040] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-24T21:20:18.416099] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-24T21:20:18.516541] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T21:20:19.216217] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-24T21:20:19.416933] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:20:20.016075] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-24T21:20:20.096947] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T21:20:20.718063] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:20:20.727141] [INFO ] [REMOTE ] SNV: Full fetch complete (71130 records). [2025-09-24T21:20:20.727343] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-24T21:20:20.824015] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-24T21:20:21.130032] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-24T21:20:21.130122] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-24T21:20:21.131224] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-24T21:20:21.131292] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-24T21:20:21.132772] [DEBUG] [LOCAL ] SNV: Trimmed 71130 records to 48908 (keeping 200 days of data) [2025-09-24T21:20:21.464044] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T21:20:21.481437] [DEBUG] [LOCAL ] SNV: Primary data saved (48908 records). [2025-09-24T21:20:21.481622] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-24T21:20:21.481766] [INFO ] [MAIN ] Update Progress: 1958/2373 symbols completed. SNV took 28.0s. Estimated remaining: 55m 10s. Rate: 7.5 symbols/min [2025-09-24T21:20:21.616076] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-24T21:20:22.899638] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T21:20:22.911328] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-24T21:20:23.192822] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T21:20:23.216058] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-24T21:20:24.666999] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T21:20:24.668696] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T21:20:24.688339] [INFO ] [REMOTE ] SNX: Full fetch complete (56590 records). [2025-09-24T21:20:24.688730] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-24T21:20:24.689425] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-24T21:20:25.089746] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-24T21:20:25.089851] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-24T21:20:25.090842] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-24T21:20:25.090907] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-24T21:20:25.092234] [DEBUG] [LOCAL ] SNX: Trimmed 56590 records to 39794 (keeping 200 days of data) [2025-09-24T21:20:25.346315] [DEBUG] [LOCAL ] SNX: Primary data saved (39794 records). [2025-09-24T21:20:25.346478] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-24T21:20:25.346581] [INFO ] [MAIN ] Update Progress: 1959/2373 symbols completed. SNX took 25.3s. Estimated remaining: 55m 1s. Rate: 7.5 symbols/min [2025-09-24T21:20:26.919675] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-24T21:20:26.939608] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-24T21:20:27.649053] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T21:20:27.668389] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-24T21:20:28.515040] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T21:20:28.525946] [INFO ] [REMOTE ] SO: Full fetch complete (77196 records). [2025-09-24T21:20:28.526288] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-24T21:20:28.527637] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-24). Symbol may be delisted or halted. [2025-09-24T21:20:28.527789] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:20:28.527836] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:20:28.527878] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-24T21:20:28.528265] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-24T21:20:28.528451] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-24T21:20:28.528504] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-24T21:20:28.528696] [INFO ] [MAIN ] Update Progress: 1960/2373 symbols completed. SO took 24.0s. Estimated remaining: 54m 52s. Rate: 7.5 symbols/min [2025-09-24T21:20:29.252904] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:29.201845] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:29.278762] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:29.297420] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:29.304265] [DEBUG] [LOCAL ] SOJC: Loaded 5072 existing records from primary storage. [2025-09-24T21:20:29.304422] [INFO ] [MAIN ] SOJC: Loaded 5072 existing records. [2025-09-24T21:20:29.433156] [DEBUG] [LOCAL ] SOJD: Loaded 12955 existing records from primary storage. [2025-09-24T21:20:29.450018] [INFO ] [MAIN ] SOJD: Loaded 12955 existing records. [2025-09-24T21:20:29.633298] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:29.640745] [DEBUG] [LOCAL ] SOBO: Loaded 39661 existing records from primary storage. [2025-09-24T21:20:29.652322] [INFO ] [MAIN ] SOBO: Loaded 39661 existing records. [2025-09-24T21:20:29.657686] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-24T21:20:29.718435] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-24T21:20:29.724235] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-24T21:20:29.751387] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-24T21:20:29.741048] [DEBUG] [LOCAL ] SOC: Loaded 50247 existing records from primary storage. [2025-09-24T21:20:29.761918] [INFO ] [MAIN ] SOC: Loaded 50247 existing records. [2025-09-24T21:20:30.012819] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:30.119546] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-24T21:20:30.181836] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:30.181629] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-24T21:20:30.234211] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-24T21:20:30.223786] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-24T21:20:30.265482] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-24T21:20:30.304109] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-24T21:20:30.304030] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-24T21:20:30.342714] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-24T21:20:30.342568] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:30.573859] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-24T21:20:30.647104] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-24T21:20:30.686700] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-24T21:20:30.697738] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-24T21:20:30.968383] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:31.069425] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-24T21:20:31.420578] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:31.446824] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-24T21:20:31.598702] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:31.609226] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-24T21:20:31.704670] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:31.705147] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-24T21:20:32.254734] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T21:20:32.257438] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-24T21:20:32.777900] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T21:20:32.782960] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-24T21:20:32.945797] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-24T21:20:32.948625] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-24T21:20:33.086269] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T21:20:33.096402] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-24T21:20:33.122774] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T21:20:33.132536] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-24T21:20:33.405244] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-24T21:20:33.492292] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-24T21:20:33.616180] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-24T21:20:34.189130] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-24T21:20:34.416074] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-24T21:20:34.640464] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:20:34.729688] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:20:35.208961] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T21:20:35.216026] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-24T21:20:35.894837] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T21:20:36.016130] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-24T21:20:36.816146] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-24T21:20:37.547756] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-24T21:20:37.616060] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-24T21:20:37.805238] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T21:20:38.416162] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-24T21:20:38.987777] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T21:20:39.216119] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-24T21:20:39.387803] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T21:20:40.016101] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-24T21:20:40.816118] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-24T21:20:40.897225] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T21:20:41.496365] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T21:20:41.582751] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T21:20:41.616033] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-24T21:20:42.416105] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-24T21:20:42.989356] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-24T21:20:43.216054] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-24T21:20:43.453585] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:20:44.016106] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-24T21:20:44.080504] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:20:44.816150] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-24T21:20:45.616061] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-24T21:20:45.762635] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T21:20:45.881046] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T21:20:46.416134] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-24T21:20:47.043428] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T21:20:47.063456] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T21:20:47.065180] [INFO ] [REMOTE ] SOJC: Full fetch complete (7899 records). [2025-09-24T21:20:47.065253] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-24T21:20:47.223249] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-24T21:20:47.427328] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-24T21:20:47.427410] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-24T21:20:47.427629] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-24T21:20:47.427719] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-24T21:20:47.428116] [DEBUG] [LOCAL ] SOJC: Trimmed 7899 records to 5058 (keeping 200 days of data) [2025-09-24T21:20:47.458624] [DEBUG] [LOCAL ] SOJC: Primary data saved (5058 records). [2025-09-24T21:20:47.458756] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-24T21:20:47.458841] [INFO ] [MAIN ] Update Progress: 1961/2373 symbols completed. SOJC took 18.9s. Estimated remaining: 54m 47s. Rate: 7.5 symbols/min [2025-09-24T21:20:47.627562] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:47.639050] [DEBUG] [LOCAL ] SOJE: Loaded 9323 existing records from primary storage. [2025-09-24T21:20:47.639143] [INFO ] [MAIN ] SOJE: Loaded 9323 existing records. [2025-09-24T21:20:47.822059] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:20:47.822343] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-24T21:20:47.822391] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-24T21:20:47.822827] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-24T21:20:47.822888] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-24T21:20:48.028346] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-24T21:20:48.181534] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:48.631862] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T21:20:48.816068] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-24T21:20:49.005370] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T21:20:49.616068] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-24T21:20:49.693521] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:20:50.416090] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-24T21:20:50.485383] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T21:20:51.216096] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-24T21:20:52.016154] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-24T21:20:52.096348] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:20:52.127099] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T21:20:52.816101] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-24T21:20:52.873181] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T21:20:53.616084] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-24T21:20:54.367824] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T21:20:54.416045] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-24T21:20:55.216134] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-24T21:20:55.474417] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T21:20:55.684181] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T21:20:55.980409] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T21:20:56.016113] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-24T21:20:56.804874] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-24T21:20:56.816019] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-24T21:20:57.595347] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T21:20:57.597824] [INFO ] [REMOTE ] SOJD: Full fetch complete (20152 records). [2025-09-24T21:20:57.597900] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-24T21:20:57.621159] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-24T21:20:57.969820] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-24T21:20:57.969905] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-24T21:20:57.970344] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-24T21:20:57.970382] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-24T21:20:57.970986] [DEBUG] [LOCAL ] SOJD: Trimmed 20152 records to 12935 (keeping 200 days of data) [2025-09-24T21:20:58.049886] [DEBUG] [LOCAL ] SOJD: Primary data saved (12935 records). [2025-09-24T21:20:58.050031] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-24T21:20:58.050118] [INFO ] [MAIN ] Update Progress: 1962/2373 symbols completed. SOJD took 29.5s. Estimated remaining: 54m 39s. Rate: 7.5 symbols/min [2025-09-24T21:20:58.223305] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:20:58.223519] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-24T21:20:58.223575] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-24T21:20:58.223746] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-24T21:20:58.223802] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-24T21:20:58.223878] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-24T21:20:58.223932] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-24T21:20:58.421608] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-24T21:20:58.589393] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:20:59.216062] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-24T21:20:59.442873] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T21:20:59.737933] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T21:20:59.890357] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T21:21:00.016133] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-24T21:21:00.816097] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-24T21:21:01.087632] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:21:01.088057] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-24T21:21:01.285853] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T21:21:01.292863] [INFO ] [REMOTE ] SOBO: Full fetch complete (58496 records). [2025-09-24T21:21:01.293005] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-24T21:21:01.621174] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-24T21:21:01.762428] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-24T21:21:01.762529] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-24T21:21:01.763809] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-24T21:21:01.763910] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-24T21:21:01.765545] [DEBUG] [LOCAL ] SOBO: Trimmed 58496 records to 39598 (keeping 200 days of data) [2025-09-24T21:21:02.013087] [DEBUG] [LOCAL ] SOBO: Primary data saved (39598 records). [2025-09-24T21:21:02.013246] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-24T21:21:02.013335] [INFO ] [MAIN ] Update Progress: 1963/2373 symbols completed. SOBO took 33.5s. Estimated remaining: 54m 30s. Rate: 7.5 symbols/min [2025-09-24T21:21:02.187601] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:02.203822] [DEBUG] [LOCAL ] SOL: Loaded 13538 existing records from primary storage. [2025-09-24T21:21:02.203970] [INFO ] [MAIN ] SOL: Loaded 13538 existing records. [2025-09-24T21:21:02.387560] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:02.387869] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-24T21:21:02.387922] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-24T21:21:02.388463] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-24T21:21:02.388525] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-24T21:21:02.421208] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-24T21:21:02.779324] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:03.216097] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-24T21:21:03.858291] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T21:21:04.016066] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-24T21:21:04.351683] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-24T21:21:04.816142] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-24T21:21:04.990985] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T21:21:05.001638] [INFO ] [REMOTE ] SOC: Full fetch complete (71311 records). [2025-09-24T21:21:05.001928] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-24T21:21:05.437620] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T21:21:05.466641] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-24T21:21:05.466828] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-24T21:21:05.468753] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-24T21:21:05.468944] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-24T21:21:05.471505] [DEBUG] [LOCAL ] SOC: Trimmed 71311 records to 50261 (keeping 200 days of data) [2025-09-24T21:21:05.644391] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-24T21:21:05.692614] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-24T21:21:05.792333] [DEBUG] [LOCAL ] SOC: Primary data saved (50261 records). [2025-09-24T21:21:05.792493] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-24T21:21:05.792619] [INFO ] [MAIN ] Update Progress: 1964/2373 symbols completed. SOC took 37.3s. Estimated remaining: 54m 22s. Rate: 7.5 symbols/min [2025-09-24T21:21:05.968022] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:06.012286] [DEBUG] [LOCAL ] SOLV: Loaded 44106 existing records from primary storage. [2025-09-24T21:21:06.012440] [INFO ] [MAIN ] SOLV: Loaded 44106 existing records. [2025-09-24T21:21:06.190545] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:06.190827] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-24T21:21:06.190884] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-24T21:21:06.191956] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-24T21:21:06.192018] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-24T21:21:06.425239] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-24T21:21:06.555358] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:06.827922] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T21:21:07.216106] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-24T21:21:07.482810] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T21:21:08.016115] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-24T21:21:08.479496] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T21:21:08.817246] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-24T21:21:08.821934] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:21:09.616077] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-24T21:21:09.745401] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T21:21:10.365690] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T21:21:10.416052] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-24T21:21:11.216117] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-24T21:21:11.991984] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T21:21:12.016043] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-24T21:21:12.550699] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T21:21:12.816094] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-24T21:21:13.616106] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-24T21:21:14.416109] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-24T21:21:14.677301] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T21:21:14.784695] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:21:14.784384] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-24T21:21:14.907328] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T21:21:15.216160] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-24T21:21:16.016585] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T21:21:16.016230] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-24T21:21:16.816061] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-24T21:21:16.889052] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T21:21:17.616085] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-24T21:21:18.370898] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:21:18.394965] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T21:21:18.416036] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-24T21:21:19.216150] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-24T21:21:20.016150] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-24T21:21:20.210737] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T21:21:20.207733] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T21:21:20.407984] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-24T21:21:20.816086] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-24T21:21:21.503465] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T21:21:21.616076] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-24T21:21:22.416104] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-24T21:21:23.029342] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T21:21:23.216100] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-24T21:21:23.233977] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-24T21:21:24.016090] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-24T21:21:24.702794] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T21:21:24.704758] [INFO ] [REMOTE ] SOJE: Full fetch complete (14594 records). [2025-09-24T21:21:24.704835] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-24T21:21:24.816210] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-24T21:21:25.047143] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T21:21:25.137349] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-24T21:21:25.137449] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-24T21:21:25.137815] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-24T21:21:25.137875] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-24T21:21:25.138370] [DEBUG] [LOCAL ] SOJE: Trimmed 14594 records to 9259 (keeping 200 days of data) [2025-09-24T21:21:25.197374] [DEBUG] [LOCAL ] SOJE: Primary data saved (9259 records). [2025-09-24T21:21:25.197506] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-24T21:21:25.197594] [INFO ] [MAIN ] Update Progress: 1965/2373 symbols completed. SOJE took 37.7s. Estimated remaining: 54m 16s. Rate: 7.5 symbols/min [2025-09-24T21:21:25.368636] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:25.412956] [DEBUG] [LOCAL ] SON: Loaded 42880 existing records from primary storage. [2025-09-24T21:21:25.413136] [INFO ] [MAIN ] SON: Loaded 42880 existing records. [2025-09-24T21:21:25.597281] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:25.597604] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-24T21:21:25.597709] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-24T21:21:25.599499] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-24T21:21:25.599563] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-24T21:21:25.621170] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-24T21:21:25.726966] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T21:21:25.976614] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:26.391490] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T21:21:26.416040] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-24T21:21:27.017734] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-24T21:21:27.019998] [INFO ] [REMOTE ] SOJF: Full fetch complete (13149 records). [2025-09-24T21:21:27.020074] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-24T21:21:27.201127] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-24T21:21:27.201397] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:21:27.201465] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:21:27.201533] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-24T21:21:27.201597] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-24T21:21:27.201635] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-24T21:21:27.201749] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-24T21:21:27.201845] [INFO ] [MAIN ] Update Progress: 1966/2373 symbols completed. SOJF took 29.2s. Estimated remaining: 54m 7s. Rate: 7.5 symbols/min [2025-09-24T21:21:27.221824] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-24T21:21:27.372429] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:27.430730] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-24T21:21:27.430883] [INFO ] [MAIN ] SONY: Loaded 53357 existing records. [2025-09-24T21:21:27.607266] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:27.607551] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-24T21:21:27.607605] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-24T21:21:27.609137] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-24T21:21:27.609201] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-24T21:21:27.984312] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:28.016090] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-24T21:21:28.085802] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T21:21:28.088871] [INFO ] [REMOTE ] SOL: Full fetch complete (21852 records). [2025-09-24T21:21:28.088964] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-24T21:21:28.484021] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-24T21:21:28.484117] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-24T21:21:28.484759] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-24T21:21:28.484824] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-24T21:21:28.485665] [DEBUG] [LOCAL ] SOL: Trimmed 21852 records to 13541 (keeping 200 days of data) [2025-09-24T21:21:28.573580] [DEBUG] [LOCAL ] SOL: Primary data saved (13541 records). [2025-09-24T21:21:28.573824] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-24T21:21:28.574039] [INFO ] [MAIN ] Update Progress: 1967/2373 symbols completed. SOL took 26.6s. Estimated remaining: 53m 57s. Rate: 7.5 symbols/min [2025-09-24T21:21:28.760128] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:28.766102] [DEBUG] [LOCAL ] SOR: Loaded 2927 existing records from primary storage. [2025-09-24T21:21:28.766211] [INFO ] [MAIN ] SOR: Loaded 2927 existing records. [2025-09-24T21:21:28.822757] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-24T21:21:28.956957] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:28.957219] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-24T21:21:28.957267] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-24T21:21:28.957546] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-24T21:21:28.957608] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-24T21:21:29.335761] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:29.531531] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T21:21:29.616045] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-24T21:21:30.114847] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-24T21:21:30.243934] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T21:21:30.416074] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-24T21:21:30.862628] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T21:21:31.216077] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-24T21:21:32.016089] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-24T21:21:32.816097] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-24T21:21:33.031847] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:21:33.543372] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T21:21:33.616082] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-24T21:21:34.416258] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-24T21:21:34.476181] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T21:21:35.216079] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-24T21:21:35.674985] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-24T21:21:35.716460] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-24T21:21:35.957593] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T21:21:36.016067] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-24T21:21:36.816096] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-24T21:21:37.616065] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-24T21:21:38.090495] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-24T21:21:38.137847] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-24T21:21:38.416106] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-24T21:21:38.552506] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T21:21:38.560865] [INFO ] [REMOTE ] SOLV: Full fetch complete (63167 records). [2025-09-24T21:21:38.561027] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-24T21:21:38.951240] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-24T21:21:38.951390] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-24T21:21:38.952455] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-24T21:21:38.953960] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-24T21:21:38.956519] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-24T21:21:38.958812] [DEBUG] [LOCAL ] SOLV: Trimmed 63167 records to 44090 (keeping 200 days of data) [2025-09-24T21:21:39.216413] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-24T21:21:39.249739] [DEBUG] [LOCAL ] SOLV: Primary data saved (44090 records). [2025-09-24T21:21:39.249935] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-24T21:21:39.250104] [INFO ] [MAIN ] Update Progress: 1968/2373 symbols completed. SOLV took 33.5s. Estimated remaining: 53m 50s. Rate: 7.5 symbols/min [2025-09-24T21:21:39.433366] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:39.444081] [DEBUG] [LOCAL ] SOS: Loaded 7951 existing records from primary storage. [2025-09-24T21:21:39.444230] [INFO ] [MAIN ] SOS: Loaded 7951 existing records. [2025-09-24T21:21:39.635220] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:39.635521] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-24T21:21:39.635584] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-24T21:21:39.635992] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-24T21:21:39.636056] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-24T21:21:39.918969] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T21:21:40.021264] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-24T21:21:40.063049] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:40.816111] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-24T21:21:41.616065] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-24T21:21:42.072548] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T21:21:42.090546] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T21:21:42.150510] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T21:21:42.416266] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-24T21:21:43.216088] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-24T21:21:44.016047] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-24T21:21:44.530781] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T21:21:44.744258] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T21:21:44.752258] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-24T21:21:44.816092] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-24T21:21:45.616113] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-24T21:21:46.172969] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T21:21:46.401392] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T21:21:46.416029] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-24T21:21:47.216093] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-24T21:21:48.007028] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T21:21:48.016243] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-24T21:21:48.816046] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-24T21:21:48.978316] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:21:49.162274] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-24T21:21:49.379812] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T21:21:49.616088] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-24T21:21:50.416123] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-24T21:21:50.860299] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-24T21:21:51.216115] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-24T21:21:51.407227] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T21:21:51.786108] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-24T21:21:52.016094] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-24T21:21:52.680330] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-24T21:21:52.816090] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-24T21:21:53.616121] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-24T21:21:54.121042] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T21:21:54.416071] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-24T21:21:54.449752] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T21:21:55.216105] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-24T21:21:55.331831] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T21:21:56.016364] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-24T21:21:56.480706] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T21:21:56.816087] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-24T21:21:57.156982] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T21:21:57.616059] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-24T21:21:57.844363] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-24T21:21:58.053587] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-24T21:21:58.054760] [INFO ] [REMOTE ] SOR: Full fetch complete (4352 records). [2025-09-24T21:21:58.054869] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-24T21:21:58.423411] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-24T21:21:58.423541] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-24T21:21:58.425234] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-24T21:21:58.425411] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-24T21:21:58.425493] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-24T21:21:58.425994] [DEBUG] [LOCAL ] SOR: Trimmed 4352 records to 2920 (keeping 200 days of data) [2025-09-24T21:21:58.447213] [DEBUG] [LOCAL ] SOR: Primary data saved (2920 records). [2025-09-24T21:21:58.447311] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-24T21:21:58.447436] [INFO ] [MAIN ] Update Progress: 1969/2373 symbols completed. SOR took 29.9s. Estimated remaining: 53m 44s. Rate: 7.5 symbols/min [2025-09-24T21:21:58.630769] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:21:58.682102] [DEBUG] [LOCAL ] SPB: Loaded 34262 existing records from primary storage. [2025-09-24T21:21:58.682278] [INFO ] [MAIN ] SPB: Loaded 34262 existing records. [2025-09-24T21:21:58.867014] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:21:58.867484] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-24T21:21:58.867553] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-24T21:21:58.868741] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-24T21:21:58.868842] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-24T21:21:59.227444] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-24T21:21:59.269884] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:21:59.749220] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-24T21:22:00.016100] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-24T21:22:00.479042] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-24T21:22:00.484965] [INFO ] [REMOTE ] SOS: Full fetch complete (11056 records). [2025-09-24T21:22:00.485090] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-24T21:22:00.817068] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-24T21:22:00.868902] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-24T21:22:00.869002] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-24T21:22:00.869517] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-24T21:22:00.869601] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-24T21:22:00.870354] [DEBUG] [LOCAL ] SOS: Trimmed 11056 records to 8068 (keeping 200 days of data) [2025-09-24T21:22:00.923538] [DEBUG] [LOCAL ] SOS: Primary data saved (8068 records). [2025-09-24T21:22:00.923735] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-24T21:22:00.923931] [INFO ] [MAIN ] Update Progress: 1970/2373 symbols completed. SOS took 21.7s. Estimated remaining: 53m 35s. Rate: 7.5 symbols/min [2025-09-24T21:22:01.099426] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:01.159006] [DEBUG] [LOCAL ] SPCE: Loaded 49829 existing records from primary storage. [2025-09-24T21:22:01.159198] [INFO ] [MAIN ] SPCE: Loaded 49829 existing records. [2025-09-24T21:22:01.339481] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:01.339772] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-24T21:22:01.339855] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-24T21:22:01.341097] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-24T21:22:01.341173] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-24T21:22:01.626845] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-24T21:22:01.716054] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:02.060790] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T21:22:02.108056] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-24T21:22:02.416140] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-24T21:22:03.002250] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T21:22:03.011917] [INFO ] [REMOTE ] SON: Full fetch complete (62057 records). [2025-09-24T21:22:03.012070] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-24T21:22:03.223769] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-24T21:22:03.399883] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-24T21:22:03.399970] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-24T21:22:03.400984] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-24T21:22:03.401056] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-24T21:22:03.404636] [DEBUG] [LOCAL ] SON: Trimmed 62057 records to 42894 (keeping 200 days of data) [2025-09-24T21:22:03.689636] [DEBUG] [LOCAL ] SON: Primary data saved (42894 records). [2025-09-24T21:22:03.690147] [INFO ] [MAIN ] SON: Full history saved. [2025-09-24T21:22:03.690377] [INFO ] [MAIN ] Update Progress: 1971/2373 symbols completed. SON took 38.5s. Estimated remaining: 53m 26s. Rate: 7.5 symbols/min [2025-09-24T21:22:03.861143] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:03.869682] [DEBUG] [LOCAL ] SPE: Loaded 6367 existing records from primary storage. [2025-09-24T21:22:03.869775] [INFO ] [MAIN ] SPE: Loaded 6367 existing records. [2025-09-24T21:22:04.027699] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-24T21:22:04.052280] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:04.053500] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-24T21:22:04.053591] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-24T21:22:04.054070] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-24T21:22:04.054134] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-24T21:22:04.459384] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:04.536412] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-24T21:22:04.816092] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-24T21:22:05.057245] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T21:22:05.066704] [INFO ] [REMOTE ] SONY: Full fetch complete (77218 records). [2025-09-24T21:22:05.066842] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-24T21:22:05.192516] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T21:22:05.447347] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T21:22:05.509952] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-24T21:22:05.510101] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-24T21:22:05.511386] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-24T21:22:05.511458] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-24T21:22:05.514034] [DEBUG] [LOCAL ] SONY: Trimmed 77218 records to 53357 (keeping 200 days of data) [2025-09-24T21:22:05.628162] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-24T21:22:05.883302] [DEBUG] [LOCAL ] SONY: Primary data saved (53357 records). [2025-09-24T21:22:05.883684] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-24T21:22:05.883837] [INFO ] [MAIN ] Update Progress: 1972/2373 symbols completed. SONY took 38.7s. Estimated remaining: 53m 17s. Rate: 7.5 symbols/min [2025-09-24T21:22:06.052913] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:06.112756] [DEBUG] [LOCAL ] SPG: Loaded 50439 existing records from primary storage. [2025-09-24T21:22:06.112910] [INFO ] [MAIN ] SPG: Loaded 50439 existing records. [2025-09-24T21:22:06.294355] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:06.294724] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-24T21:22:06.294779] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-24T21:22:06.296345] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-24T21:22:06.296408] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-24T21:22:06.392830] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-24T21:22:06.421251] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-24T21:22:06.667472] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:07.216093] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-24T21:22:07.983824] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T21:22:08.016045] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-24T21:22:08.417284] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T21:22:08.742028] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-24T21:22:08.816105] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-24T21:22:09.468539] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T21:22:09.616118] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-24T21:22:10.416076] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-24T21:22:11.216092] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-24T21:22:11.524850] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-24T21:22:12.016167] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-24T21:22:12.310382] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-24T21:22:12.396333] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-24T21:22:12.816142] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-24T21:22:13.616094] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-24T21:22:14.012480] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T21:22:14.245544] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T21:22:14.416067] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-24T21:22:14.652594] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T21:22:14.815742] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T21:22:15.216090] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-24T21:22:16.016099] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-24T21:22:16.816100] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-24T21:22:17.168598] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T21:22:17.407053] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-24T21:22:17.616070] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-24T21:22:17.775152] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T21:22:18.416084] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-24T21:22:18.592886] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T21:22:18.892418] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-24T21:22:19.216088] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-24T21:22:20.016077] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-24T21:22:20.816053] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-24T21:22:21.269030] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T21:22:21.570391] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T21:22:21.572452] [INFO ] [REMOTE ] SPE: Full fetch complete (10168 records). [2025-09-24T21:22:21.572523] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-24T21:22:21.626848] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-24T21:22:22.012482] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-24T21:22:22.012736] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-24T21:22:22.013081] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-24T21:22:22.013361] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-24T21:22:22.014101] [DEBUG] [LOCAL ] SPE: Trimmed 10168 records to 6374 (keeping 200 days of data) [2025-09-24T21:22:22.074556] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T21:22:22.097010] [DEBUG] [LOCAL ] SPE: Primary data saved (6374 records). [2025-09-24T21:22:22.097167] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-24T21:22:22.097267] [INFO ] [MAIN ] Update Progress: 1973/2373 symbols completed. SPE took 18.4s. Estimated remaining: 53m 11s. Rate: 7.5 symbols/min [2025-09-24T21:22:22.300840] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:22.355230] [DEBUG] [LOCAL ] SPGI: Loaded 45815 existing records from primary storage. [2025-09-24T21:22:22.355432] [INFO ] [MAIN ] SPGI: Loaded 45815 existing records. [2025-09-24T21:22:22.423340] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-24T21:22:22.561893] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:22.562199] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-24T21:22:22.562263] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-24T21:22:22.563661] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-24T21:22:22.563728] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-24T21:22:22.944764] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:23.137862] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:22:23.216072] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-24T21:22:24.016088] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-24T21:22:24.520289] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-24T21:22:24.593714] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:22:24.816073] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-24T21:22:25.616095] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-24T21:22:25.976535] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T21:22:26.416134] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-24T21:22:27.019821] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-24T21:22:27.120498] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:22:27.216055] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-24T21:22:28.016106] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-24T21:22:28.224680] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T21:22:28.600718] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T21:22:28.816115] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-24T21:22:29.498366] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T21:22:29.616089] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-24T21:22:30.416133] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-24T21:22:30.653815] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T21:22:30.795182] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T21:22:31.216133] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-24T21:22:32.016061] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-24T21:22:32.327315] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-24T21:22:32.707085] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:22:32.816090] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-24T21:22:32.916218] [DEBUG] [REMOTE ] SPCE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-24T21:22:32.916580] [WARN ] [REMOTE ] SPCE: No data returned for month 2025-08 [2025-09-24T21:22:33.616057] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-24T21:22:33.960373] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T21:22:34.416119] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-24T21:22:35.216062] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-24T21:22:35.481723] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T21:22:35.488082] [INFO ] [REMOTE ] SPB: Full fetch complete (47480 records). [2025-09-24T21:22:35.488241] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-24T21:22:35.809354] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-24T21:22:35.867069] [INFO ] [REMOTE ] SPCE: Full fetch complete (64842 records). [2025-09-24T21:22:35.877503] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-24T21:22:36.121436] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-24T21:22:36.049929] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-24T21:22:36.137068] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-24T21:22:36.149310] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-24T21:22:36.162367] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-24T21:22:36.226438] [WARN ] [VALIDATOR ] SPCE: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-24T21:22:36.227556] [FATAL] [MAIN ] SPCE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:22:36.227752] [WARN ] [MAIN ] SPCE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:22:36.227960] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-24T21:22:36.228046] [DEBUG] [LOCAL ] SPCE: No primary data file found to delete. [2025-09-24T21:22:36.228097] [INFO ] [LOCAL ] SPCE: Starting deletion of derivative data. [2025-09-24T21:22:36.228248] [DEBUG] [LOCAL ] SPB: Trimmed 47480 records to 34229 (keeping 200 days of data) [2025-09-24T21:22:36.228796] [DEBUG] [LOCAL ] SPCE: Deleted derivative data file. [2025-09-24T21:22:36.229151] [INFO ] [MAIN ] Update Progress: 1974/2373 symbols completed. SPCE took 35.3s. Estimated remaining: 53m 4s. Rate: 7.5 symbols/min [2025-09-24T21:22:36.547547] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:36.652412] [DEBUG] [LOCAL ] SPH: Loaded 18217 existing records from primary storage. [2025-09-24T21:22:36.654693] [INFO ] [MAIN ] SPH: Loaded 18217 existing records. [2025-09-24T21:22:36.845571] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:36.849159] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-24T21:22:36.849858] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-24T21:22:36.855936] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-24T21:22:36.858393] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-24T21:22:36.925103] [DEBUG] [LOCAL ] SPB: Primary data saved (34229 records). [2025-09-24T21:22:36.949795] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-24T21:22:36.964153] [INFO ] [MAIN ] Update Progress: 1975/2373 symbols completed. SPB took 38.5s. Estimated remaining: 52m 55s. Rate: 7.5 symbols/min [2025-09-24T21:22:37.363265] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:37.445074] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:37.445554] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-24T21:22:37.475754] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-24T21:22:37.519099] [DEBUG] [LOCAL ] SPHR: Loaded 40190 existing records from primary storage. [2025-09-24T21:22:37.519262] [INFO ] [MAIN ] SPHR: Loaded 40190 existing records. [2025-09-24T21:22:37.622309] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-24T21:22:37.708112] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:37.708395] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-24T21:22:37.708586] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-24T21:22:37.709696] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-24T21:22:37.709761] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-24T21:22:38.080392] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:38.114729] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-24T21:22:38.416083] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-24T21:22:38.479345] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T21:22:39.216113] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-24T21:22:39.543727] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T21:22:40.016104] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-24T21:22:40.172514] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:22:40.819573] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-24T21:22:40.822449] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:22:41.184009] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T21:22:41.616089] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-24T21:22:42.396434] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T21:22:42.405493] [INFO ] [REMOTE ] SPG: Full fetch complete (72063 records). [2025-09-24T21:22:42.405668] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-24T21:22:42.421311] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-24T21:22:42.815502] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-24T21:22:42.815604] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-24T21:22:42.816890] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-24T21:22:42.816957] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-24T21:22:42.818638] [DEBUG] [LOCAL ] SPG: Trimmed 72063 records to 50420 (keeping 200 days of data) [2025-09-24T21:22:43.154849] [DEBUG] [LOCAL ] SPG: Primary data saved (50420 records). [2025-09-24T21:22:43.155025] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-24T21:22:43.155148] [INFO ] [MAIN ] Update Progress: 1976/2373 symbols completed. SPG took 37.3s. Estimated remaining: 52m 46s. Rate: 7.5 symbols/min [2025-09-24T21:22:43.217957] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-24T21:22:43.380450] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:43.382425] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T21:22:43.430487] [DEBUG] [LOCAL ] SPIR: Loaded 37472 existing records from primary storage. [2025-09-24T21:22:43.430675] [INFO ] [MAIN ] SPIR: Loaded 37472 existing records. [2025-09-24T21:22:43.633996] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:43.654399] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-24T21:22:43.657459] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-24T21:22:43.660910] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-24T21:22:43.661001] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-24T21:22:43.660824] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T21:22:44.021260] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-24T21:22:44.067041] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:44.786477] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T21:22:44.816054] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-24T21:22:45.231125] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T21:22:45.616098] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-24T21:22:46.147085] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-24T21:22:46.416115] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-24T21:22:47.216071] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-24T21:22:47.288042] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:22:47.321681] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T21:22:48.016107] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-24T21:22:48.490835] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T21:22:48.816116] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-24T21:22:49.616095] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-24T21:22:49.745453] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T21:22:50.416069] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-24T21:22:50.458778] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T21:22:50.507762] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T21:22:51.216081] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-24T21:22:52.016155] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-24T21:22:52.216490] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T21:22:52.224969] [INFO ] [REMOTE ] SPGI: Full fetch complete (66539 records). [2025-09-24T21:22:52.225154] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-24T21:22:52.625967] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-24T21:22:52.626083] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-24T21:22:52.627220] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-24T21:22:52.627285] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-24T21:22:52.628619] [DEBUG] [LOCAL ] SPGI: Trimmed 66539 records to 45813 (keeping 200 days of data) [2025-09-24T21:22:52.821897] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-24T21:22:52.923791] [DEBUG] [LOCAL ] SPGI: Primary data saved (45813 records). [2025-09-24T21:22:52.923938] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-24T21:22:52.924025] [INFO ] [MAIN ] Update Progress: 1977/2373 symbols completed. SPGI took 30.8s. Estimated remaining: 52m 39s. Rate: 7.5 symbols/min [2025-09-24T21:22:53.106679] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:22:53.113817] [DEBUG] [LOCAL ] SPMC: Loaded 5600 existing records from primary storage. [2025-09-24T21:22:53.113904] [INFO ] [MAIN ] SPMC: Loaded 5600 existing records. [2025-09-24T21:22:53.309135] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:22:53.309439] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-24T21:22:53.309487] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-24T21:22:53.309843] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-24T21:22:53.309903] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-24T21:22:53.684269] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:22:53.684638] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-24T21:23:05.126309] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (11.44 seconds). [2025-09-24T21:23:05.128078] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-24T21:23:05.397291] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (12.58 seconds). [2025-09-24T21:23:05.402569] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-24T21:23:05.816631] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (14.60 seconds). [2025-09-24T21:23:05.826906] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-24T21:23:05.848127] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (13.83 seconds). [2025-09-24T21:23:05.855372] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-24T21:23:05.982478] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-24T21:23:05.989968] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-24T21:23:05.990603] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T21:23:05.993175] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-24T21:23:06.691511] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T21:23:06.696324] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-24T21:23:06.843540] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T21:23:06.845870] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-24T21:23:07.099596] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T21:23:07.107875] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-24T21:23:07.235328] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T21:23:07.242176] [INFO ] [REMOTE ] SPH: Full fetch complete (28534 records). [2025-09-24T21:23:07.242331] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-24T21:23:07.614626] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T21:23:07.645155] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-24T21:23:07.725694] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-24T21:23:07.730321] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-24T21:23:07.730480] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-24T21:23:07.731369] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-24T21:23:07.732120] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-24T21:23:07.732296] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-24T21:23:07.733269] [DEBUG] [LOCAL ] SPH: Trimmed 28534 records to 18057 (keeping 200 days of data) [2025-09-24T21:23:07.851178] [DEBUG] [LOCAL ] SPH: Primary data saved (18057 records). [2025-09-24T21:23:07.851350] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-24T21:23:07.851465] [INFO ] [MAIN ] Update Progress: 1978/2373 symbols completed. SPH took 31.6s. Estimated remaining: 52m 32s. Rate: 7.5 symbols/min [2025-09-24T21:23:08.035296] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:08.035514] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-24T21:23:08.035552] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-24T21:23:08.035737] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-24T21:23:08.035791] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-24T21:23:08.035835] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-24T21:23:08.035868] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-24T21:23:08.429360] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:08.429895] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-24T21:23:08.454829] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:23:08.463351] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-24T21:23:08.677636] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:08.678058] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-24T21:23:08.678504] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-24T21:23:08.744391] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T21:23:08.746933] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-24T21:23:08.983539] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:08.983922] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-24T21:23:08.984389] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-24T21:23:09.017269] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:23:09.025892] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-24T21:23:09.185211] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:09.185690] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-24T21:23:09.186386] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-24T21:23:09.404093] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:09.404568] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-24T21:23:09.405139] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-24T21:23:09.444917] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T21:23:09.616107] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-24T21:23:09.646964] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T21:23:09.683593] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:09.684084] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-24T21:23:10.174235] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-24T21:23:10.416056] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-24T21:23:10.570200] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T21:23:11.216291] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-24T21:23:11.819276] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T21:23:11.873456] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T21:23:12.016119] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-24T21:23:12.780828] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T21:23:12.816090] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-24T21:23:13.431708] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T21:23:13.433197] [INFO ] [REMOTE ] SPMC: Full fetch complete (8171 records). [2025-09-24T21:23:13.433274] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-24T21:23:13.624067] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-24T21:23:13.849770] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-24T21:23:13.849865] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-24T21:23:13.850109] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-24T21:23:13.850222] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-24T21:23:13.850694] [DEBUG] [LOCAL ] SPMC: Trimmed 8171 records to 5572 (keeping 200 days of data) [2025-09-24T21:23:13.887526] [DEBUG] [LOCAL ] SPMC: Primary data saved (5572 records). [2025-09-24T21:23:13.887713] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-24T21:23:13.887836] [INFO ] [MAIN ] Update Progress: 1979/2373 symbols completed. SPMC took 21.0s. Estimated remaining: 52m 24s. Rate: 7.5 symbols/min [2025-09-24T21:23:13.960330] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:13.983118] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-24T21:23:14.066487] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:14.102777] [DEBUG] [LOCAL ] SPNT: Loaded 34862 existing records from primary storage. [2025-09-24T21:23:14.102943] [INFO ] [MAIN ] SPNT: Loaded 34862 existing records. [2025-09-24T21:23:14.286252] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:14.286544] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-24T21:23:14.286593] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-24T21:23:14.287479] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-24T21:23:14.287559] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-24T21:23:14.431860] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-24T21:23:14.680526] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:15.216118] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-24T21:23:16.008469] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T21:23:16.016492] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-24T21:23:16.211211] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:23:16.211554] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-24T21:23:16.819550] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-24T21:23:16.825960] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T21:23:17.616099] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-24T21:23:18.358503] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:23:18.366897] [INFO ] [REMOTE ] SPHR: Full fetch complete (57591 records). [2025-09-24T21:23:18.367029] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-24T21:23:18.421850] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-24T21:23:18.765900] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-24T21:23:18.766108] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-24T21:23:18.767155] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-24T21:23:18.767301] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-24T21:23:18.799565] [DEBUG] [LOCAL ] SPHR: Trimmed 57591 records to 40141 (keeping 200 days of data) [2025-09-24T21:23:18.801800] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T21:23:19.046791] [DEBUG] [LOCAL ] SPHR: Primary data saved (40141 records). [2025-09-24T21:23:19.046926] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-24T21:23:19.047008] [INFO ] [MAIN ] Update Progress: 1980/2373 symbols completed. SPHR took 42.1s. Estimated remaining: 52m 15s. Rate: 7.5 symbols/min [2025-09-24T21:23:19.219017] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:19.217332] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-24T21:23:19.271256] [DEBUG] [LOCAL ] SPOT: Loaded 50860 existing records from primary storage. [2025-09-24T21:23:19.271417] [INFO ] [MAIN ] SPOT: Loaded 50860 existing records. [2025-09-24T21:23:19.453200] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:19.453459] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-24T21:23:19.453509] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-24T21:23:19.454712] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-24T21:23:19.454791] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-24T21:23:19.827749] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:19.938552] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T21:23:20.016079] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-24T21:23:20.296471] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T21:23:20.816125] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-24T21:23:21.136706] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-24T21:23:21.616127] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-24T21:23:22.026477] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T21:23:22.416090] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-24T21:23:22.752715] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T21:23:23.216126] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-24T21:23:23.624268] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T21:23:24.016097] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-24T21:23:24.816080] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-24T21:23:25.153116] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T21:23:25.192274] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T21:23:25.199561] [INFO ] [REMOTE ] SPIR: Full fetch complete (52302 records). [2025-09-24T21:23:25.199794] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-24T21:23:25.283170] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:23:25.621422] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-24T21:23:25.646895] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-24T21:23:25.646993] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-24T21:23:25.648057] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-24T21:23:25.648125] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-24T21:23:25.650070] [DEBUG] [LOCAL ] SPIR: Trimmed 52302 records to 37442 (keeping 200 days of data) [2025-09-24T21:23:25.874316] [DEBUG] [LOCAL ] SPIR: Primary data saved (37442 records). [2025-09-24T21:23:25.874483] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-24T21:23:25.874592] [INFO ] [MAIN ] Update Progress: 1981/2373 symbols completed. SPIR took 42.7s. Estimated remaining: 52m 7s. Rate: 7.5 symbols/min [2025-09-24T21:23:26.066738] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T21:23:26.069382] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:26.070453] [INFO ] [REMOTE ] SPME: Full fetch complete (660 records). [2025-09-24T21:23:26.070907] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-24T21:23:26.275718] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 48 unique days, need 200 days [2025-09-24T21:23:26.286320] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:23:26.286453] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:23:26.286519] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-24T21:23:26.286604] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-24T21:23:26.286687] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-24T21:23:26.286795] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-24T21:23:26.286913] [INFO ] [MAIN ] Update Progress: 1982/2373 symbols completed. SPME took 18.4s. Estimated remaining: 51m 57s. Rate: 7.5 symbols/min [2025-09-24T21:23:26.427385] [DEBUG] [LOCAL ] SPR: Loaded 41283 existing records from primary storage. [2025-09-24T21:23:26.421159] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-24T21:23:26.437754] [INFO ] [MAIN ] SPR: Loaded 41283 existing records. [2025-09-24T21:23:26.538901] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:26.680136] [DEBUG] [LOCAL ] SPRU: Loaded 8448 existing records from primary storage. [2025-09-24T21:23:26.704603] [INFO ] [MAIN ] SPRU: Loaded 8448 existing records. [2025-09-24T21:23:26.704747] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:26.775459] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-24T21:23:26.787669] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-24T21:23:26.819338] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-24T21:23:26.819554] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-24T21:23:27.035069] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:27.065818] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-24T21:23:27.080203] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-24T21:23:27.107802] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-24T21:23:27.163216] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-24T21:23:27.235379] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-24T21:23:27.466823] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:27.675348] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:28.016107] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-24T21:23:28.513501] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T21:23:28.659589] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-24T21:23:28.816055] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-24T21:23:28.856359] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T21:23:29.616078] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-24T21:23:29.994232] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T21:23:30.339684] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:23:30.416113] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-24T21:23:30.977438] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T21:23:31.216084] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-24T21:23:32.016121] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-24T21:23:32.539757] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:23:32.816121] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-24T21:23:33.401781] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T21:23:33.616077] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-24T21:23:34.339325] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T21:23:34.416080] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-24T21:23:34.945187] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T21:23:35.003466] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-24T21:23:35.216089] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-24T21:23:35.965929] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-24T21:23:36.016084] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-24T21:23:36.766111] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T21:23:36.816073] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-24T21:23:37.367208] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T21:23:37.616073] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-24T21:23:38.416116] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-24T21:23:39.216078] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-24T21:23:39.246369] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T21:23:39.872526] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-24T21:23:40.016108] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-24T21:23:40.385998] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T21:23:40.816060] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-24T21:23:41.099840] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T21:23:41.616113] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-24T21:23:42.242577] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T21:23:42.416092] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-24T21:23:43.031604] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T21:23:43.216088] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-24T21:23:43.767284] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T21:23:43.769480] [INFO ] [REMOTE ] SPRU: Full fetch complete (11273 records). [2025-09-24T21:23:43.769554] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-24T21:23:44.021221] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-24T21:23:44.147542] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-24T21:23:44.147637] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-24T21:23:44.147970] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-24T21:23:44.148033] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-24T21:23:44.148500] [DEBUG] [LOCAL ] SPRU: Trimmed 11273 records to 8468 (keeping 200 days of data) [2025-09-24T21:23:44.196464] [DEBUG] [LOCAL ] SPRU: Primary data saved (8468 records). [2025-09-24T21:23:44.196601] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-24T21:23:44.196711] [INFO ] [MAIN ] Update Progress: 1983/2373 symbols completed. SPRU took 17.9s. Estimated remaining: 51m 51s. Rate: 7.5 symbols/min [2025-09-24T21:23:44.383417] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:44.412872] [DEBUG] [LOCAL ] SPXC: Loaded 23425 existing records from primary storage. [2025-09-24T21:23:44.413019] [INFO ] [MAIN ] SPXC: Loaded 23425 existing records. [2025-09-24T21:23:44.599089] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:44.599553] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-24T21:23:44.599734] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-24T21:23:44.601438] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-24T21:23:44.601517] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-24T21:23:44.834768] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-24T21:23:44.917694] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-24T21:23:45.007129] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:45.619134] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-24T21:23:45.625577] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:23:45.865349] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T21:23:45.872061] [INFO ] [REMOTE ] SPNT: Full fetch complete (48793 records). [2025-09-24T21:23:45.872170] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-24T21:23:46.246254] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-24T21:23:46.246340] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-24T21:23:46.247265] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-24T21:23:46.247327] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-24T21:23:46.248397] [DEBUG] [LOCAL ] SPNT: Trimmed 48793 records to 34851 (keeping 200 days of data) [2025-09-24T21:23:46.428626] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-24T21:23:46.457272] [DEBUG] [LOCAL ] SPNT: Primary data saved (34851 records). [2025-09-24T21:23:46.457404] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-24T21:23:46.457513] [INFO ] [MAIN ] Update Progress: 1984/2373 symbols completed. SPNT took 32.6s. Estimated remaining: 51m 42s. Rate: 7.5 symbols/min [2025-09-24T21:23:46.649159] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:23:46.665619] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T21:23:46.679691] [DEBUG] [LOCAL ] SPXX: Loaded 8932 existing records from primary storage. [2025-09-24T21:23:46.679821] [INFO ] [MAIN ] SPXX: Loaded 8932 existing records. [2025-09-24T21:23:46.869728] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:23:46.870103] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-24T21:23:46.870184] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-24T21:23:46.870743] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-24T21:23:46.870832] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-24T21:23:47.220028] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-24T21:23:47.245332] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:23:48.016100] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-24T21:23:48.785299] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-24T21:23:48.816047] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-24T21:23:48.959867] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T21:23:49.284107] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T21:23:49.616136] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-24T21:23:50.416076] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-24T21:23:50.734304] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-24T21:23:50.946536] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T21:23:51.050108] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T21:23:51.216116] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-24T21:23:52.016085] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-24T21:23:52.518335] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:23:52.816090] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-24T21:23:53.495465] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T21:23:53.616066] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-24T21:23:54.416961] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-24T21:23:54.422563] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-24T21:23:55.028417] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T21:23:55.158714] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-24T21:23:55.216140] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-24T21:23:55.877413] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-24T21:23:56.016143] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-24T21:23:56.816111] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-24T21:23:57.616967] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-24T21:23:57.616898] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:23:58.254066] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-24T21:23:58.416087] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-24T21:23:58.839031] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-24T21:23:59.216152] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-24T21:23:59.908162] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:23:59.924771] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T21:24:00.016112] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-24T21:24:00.816130] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-24T21:24:01.464741] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T21:24:01.472960] [INFO ] [REMOTE ] SPR: Full fetch complete (60001 records). [2025-09-24T21:24:01.473220] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-24T21:24:01.661830] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-24T21:24:01.681547] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T21:24:01.985614] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-24T21:24:01.985752] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-24T21:24:01.987320] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-24T21:24:01.987614] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-24T21:24:01.994412] [DEBUG] [LOCAL ] SPR: Trimmed 60001 records to 41233 (keeping 200 days of data) [2025-09-24T21:24:02.252748] [DEBUG] [LOCAL ] SPR: Primary data saved (41233 records). [2025-09-24T21:24:02.252888] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-24T21:24:02.252973] [INFO ] [MAIN ] Update Progress: 1985/2373 symbols completed. SPR took 36.4s. Estimated remaining: 51m 36s. Rate: 7.5 symbols/min [2025-09-24T21:24:02.421832] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-24T21:24:02.425318] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:02.485925] [DEBUG] [LOCAL ] SQM: Loaded 48546 existing records from primary storage. [2025-09-24T21:24:02.486130] [INFO ] [MAIN ] SQM: Loaded 48546 existing records. [2025-09-24T21:24:02.685125] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:02.685491] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-24T21:24:02.685564] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-24T21:24:02.686753] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-24T21:24:02.686822] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-24T21:24:03.088879] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:03.216050] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-24T21:24:03.317802] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T21:24:03.644922] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-24T21:24:03.657745] [INFO ] [REMOTE ] SPOT: Full fetch complete (73998 records). [2025-09-24T21:24:03.657937] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-24T21:24:04.021162] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-24T21:24:04.083918] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-24T21:24:04.084045] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-24T21:24:04.086933] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-24T21:24:04.087005] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-24T21:24:04.094933] [DEBUG] [LOCAL ] SPOT: Trimmed 73998 records to 50841 (keeping 200 days of data) [2025-09-24T21:24:04.448863] [DEBUG] [LOCAL ] SPOT: Primary data saved (50841 records). [2025-09-24T21:24:04.449013] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-24T21:24:04.449160] [INFO ] [MAIN ] Update Progress: 1986/2373 symbols completed. SPOT took 45.4s. Estimated remaining: 51m 27s. Rate: 7.5 symbols/min [2025-09-24T21:24:04.649350] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:04.690009] [DEBUG] [LOCAL ] SQNS: Loaded 25885 existing records from primary storage. [2025-09-24T21:24:04.690541] [INFO ] [MAIN ] SQNS: Loaded 25885 existing records. [2025-09-24T21:24:04.824046] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-24T21:24:04.831149] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T21:24:04.940190] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T21:24:04.939356] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:04.943668] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-24T21:24:04.943945] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-24T21:24:04.945350] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-24T21:24:04.945453] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-24T21:24:05.321602] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:05.616131] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-24T21:24:06.053518] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T21:24:06.378971] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T21:24:06.381877] [INFO ] [REMOTE ] SPXX: Full fetch complete (12426 records). [2025-09-24T21:24:06.381980] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-24T21:24:06.421270] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-24T21:24:06.780127] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-24T21:24:06.780326] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-24T21:24:06.780701] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-24T21:24:06.780764] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-24T21:24:06.782020] [DEBUG] [LOCAL ] SPXX: Trimmed 12426 records to 8956 (keeping 200 days of data) [2025-09-24T21:24:06.858102] [DEBUG] [LOCAL ] SPXX: Primary data saved (8956 records). [2025-09-24T21:24:06.858350] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-24T21:24:06.858631] [INFO ] [MAIN ] Update Progress: 1987/2373 symbols completed. SPXX took 20.4s. Estimated remaining: 51m 18s. Rate: 7.5 symbols/min [2025-09-24T21:24:07.044015] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:07.108430] [DEBUG] [LOCAL ] SR: Loaded 32853 existing records from primary storage. [2025-09-24T21:24:07.108742] [INFO ] [MAIN ] SR: Loaded 32853 existing records. [2025-09-24T21:24:07.221549] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-24T21:24:07.313755] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:07.314139] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-24T21:24:07.314196] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-24T21:24:07.316707] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-24T21:24:07.316781] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-24T21:24:07.733184] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:07.760854] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:24:08.016103] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-24T21:24:08.816061] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-24T21:24:08.986234] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T21:24:09.303391] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T21:24:09.616093] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-24T21:24:09.792103] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T21:24:10.416113] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-24T21:24:10.453542] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T21:24:11.216103] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-24T21:24:11.775621] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:24:12.016153] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-24T21:24:12.397083] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T21:24:12.816106] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-24T21:24:13.563885] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T21:24:13.616986] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-24T21:24:13.616896] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:24:14.416109] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-24T21:24:15.015336] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T21:24:15.216126] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-24T21:24:15.789229] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T21:24:16.016153] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-24T21:24:16.518639] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-24T21:24:16.816095] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-24T21:24:16.885990] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:24:17.616120] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-24T21:24:18.303464] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T21:24:18.416066] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-24T21:24:18.458628] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:24:19.216087] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-24T21:24:20.021220] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-24T21:24:20.036710] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:24:20.671699] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T21:24:20.680021] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T21:24:20.816099] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-24T21:24:21.616092] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-24T21:24:21.699698] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T21:24:21.704014] [INFO ] [REMOTE ] SPXC: Full fetch complete (33997 records). [2025-09-24T21:24:21.704100] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-24T21:24:22.092844] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-24T21:24:22.093167] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-24T21:24:22.093951] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-24T21:24:22.094013] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-24T21:24:22.095090] [DEBUG] [LOCAL ] SPXC: Trimmed 33997 records to 23370 (keeping 200 days of data) [2025-09-24T21:24:22.256822] [DEBUG] [LOCAL ] SPXC: Primary data saved (23370 records). [2025-09-24T21:24:22.256961] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-24T21:24:22.257077] [INFO ] [MAIN ] Update Progress: 1988/2373 symbols completed. SPXC took 38.1s. Estimated remaining: 51m 11s. Rate: 7.5 symbols/min [2025-09-24T21:24:22.421435] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-24T21:24:22.500126] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:22.564141] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-24T21:24:22.564334] [INFO ] [MAIN ] SRE: Loaded 53426 existing records. [2025-09-24T21:24:22.765795] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:22.766243] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-24T21:24:22.766297] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-24T21:24:22.768041] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-24T21:24:22.768107] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-24T21:24:23.180297] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:23.216035] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-24T21:24:23.262666] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T21:24:23.288183] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T21:24:24.016073] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-24T21:24:24.779504] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-24T21:24:24.816107] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-24T21:24:25.045827] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T21:24:25.616090] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-24T21:24:26.093302] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T21:24:26.416108] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-24T21:24:27.208708] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T21:24:27.219225] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-24T21:24:28.016128] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-24T21:24:28.750926] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T21:24:28.808385] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T21:24:28.816133] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-24T21:24:29.628603] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-24T21:24:29.637627] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:24:29.880019] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T21:24:30.416090] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-24T21:24:30.963301] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T21:24:31.216091] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-24T21:24:32.016221] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-24T21:24:32.349082] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T21:24:32.816057] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-24T21:24:33.080959] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T21:24:33.504628] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T21:24:33.616082] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-24T21:24:34.416065] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-24T21:24:34.625413] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T21:24:35.067790] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T21:24:35.216111] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-24T21:24:35.795738] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T21:24:35.803146] [INFO ] [REMOTE ] SQNS: Full fetch complete (31837 records). [2025-09-24T21:24:35.803284] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-24T21:24:36.024780] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-24T21:24:36.183560] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-24T21:24:36.183664] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-24T21:24:36.184351] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-24T21:24:36.184393] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-24T21:24:36.185160] [DEBUG] [LOCAL ] SQNS: Trimmed 31837 records to 26021 (keeping 200 days of data) [2025-09-24T21:24:36.338379] [DEBUG] [LOCAL ] SQNS: Primary data saved (26021 records). [2025-09-24T21:24:36.338515] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-24T21:24:36.338605] [INFO ] [MAIN ] Update Progress: 1989/2373 symbols completed. SQNS took 31.9s. Estimated remaining: 51m 4s. Rate: 7.5 symbols/min [2025-09-24T21:24:36.520803] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:36.532941] [DEBUG] [LOCAL ] SREA: Loaded 10410 existing records from primary storage. [2025-09-24T21:24:36.533087] [INFO ] [MAIN ] SREA: Loaded 10410 existing records. [2025-09-24T21:24:36.729233] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:36.729562] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-24T21:24:36.729613] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-24T21:24:36.729991] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-24T21:24:36.730051] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-24T21:24:36.823699] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-24T21:24:37.100217] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:37.167247] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T21:24:37.510992] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:24:37.616089] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-24T21:24:38.416051] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-24T21:24:38.491295] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T21:24:38.843494] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:24:38.850130] [INFO ] [REMOTE ] SR: Full fetch complete (46002 records). [2025-09-24T21:24:38.850237] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-24T21:24:39.223003] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-24T21:24:39.241856] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-24T21:24:39.241963] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-24T21:24:39.243054] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-24T21:24:39.243260] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-24T21:24:39.244955] [DEBUG] [LOCAL ] SR: Trimmed 46002 records to 32905 (keeping 200 days of data) [2025-09-24T21:24:39.468812] [DEBUG] [LOCAL ] SR: Primary data saved (32905 records). [2025-09-24T21:24:39.468958] [INFO ] [MAIN ] SR: Full history saved. [2025-09-24T21:24:39.469046] [INFO ] [MAIN ] Update Progress: 1990/2373 symbols completed. SR took 32.6s. Estimated remaining: 50m 55s. Rate: 7.5 symbols/min [2025-09-24T21:24:39.640614] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:39.675285] [DEBUG] [LOCAL ] SRFM: Loaded 35552 existing records from primary storage. [2025-09-24T21:24:39.675436] [INFO ] [MAIN ] SRFM: Loaded 35552 existing records. [2025-09-24T21:24:39.857759] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:39.858093] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-24T21:24:39.858146] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-24T21:24:39.859141] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-24T21:24:39.859205] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-24T21:24:40.038768] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-24T21:24:40.246274] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:40.261416] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:24:40.301963] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T21:24:40.816093] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-24T21:24:41.577936] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:24:41.586737] [INFO ] [REMOTE ] SQM: Full fetch complete (68863 records). [2025-09-24T21:24:41.586910] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-24T21:24:41.621231] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-24T21:24:41.992340] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-24T21:24:41.992452] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-24T21:24:41.994110] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-24T21:24:41.994200] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-24T21:24:41.996502] [DEBUG] [LOCAL ] SQM: Trimmed 68863 records to 48535 (keeping 200 days of data) [2025-09-24T21:24:42.299118] [DEBUG] [LOCAL ] SQM: Primary data saved (48535 records). [2025-09-24T21:24:42.299269] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-24T21:24:42.299359] [INFO ] [MAIN ] Update Progress: 1991/2373 symbols completed. SQM took 40.0s. Estimated remaining: 50m 47s. Rate: 7.5 symbols/min [2025-09-24T21:24:42.421242] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-24T21:24:42.474425] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:42.492363] [DEBUG] [LOCAL ] SRG: Loaded 15799 existing records from primary storage. [2025-09-24T21:24:42.492496] [INFO ] [MAIN ] SRG: Loaded 15799 existing records. [2025-09-24T21:24:42.606991] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T21:24:42.693966] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:42.694445] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-24T21:24:42.694518] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-24T21:24:42.695119] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-24T21:24:42.695255] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-24T21:24:42.911198] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-24T21:24:43.109723] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:43.216036] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-24T21:24:44.016086] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-24T21:24:44.107359] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:24:44.175115] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:24:44.510884] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T21:24:44.816118] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-24T21:24:45.616150] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-24T21:24:46.191056] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T21:24:46.416081] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-24T21:24:46.524757] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T21:24:47.216150] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-24T21:24:47.700923] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T21:24:47.984747] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T21:24:48.016028] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-24T21:24:48.754415] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-24T21:24:48.816033] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-24T21:24:49.616080] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-24T21:24:49.676305] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-24T21:24:50.416084] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-24T21:24:50.575056] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T21:24:51.195638] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-24T21:24:51.216032] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-24T21:24:51.997306] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T21:24:52.016044] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-24T21:24:52.762740] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T21:24:52.816058] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-24T21:24:53.459739] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-24T21:24:53.461617] [INFO ] [REMOTE ] SREA: Full fetch complete (15928 records). [2025-09-24T21:24:53.461724] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-24T21:24:53.626983] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-24T21:24:53.897905] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-24T21:24:53.898000] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-24T21:24:53.898377] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-24T21:24:53.898416] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-24T21:24:53.899103] [DEBUG] [LOCAL ] SREA: Trimmed 15928 records to 10415 (keeping 200 days of data) [2025-09-24T21:24:53.971234] [DEBUG] [LOCAL ] SREA: Primary data saved (10415 records). [2025-09-24T21:24:53.971437] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-24T21:24:53.971580] [INFO ] [MAIN ] Update Progress: 1992/2373 symbols completed. SREA took 17.6s. Estimated remaining: 50m 39s. Rate: 7.5 symbols/min [2025-09-24T21:24:54.165310] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:54.194453] [DEBUG] [LOCAL ] SRI: Loaded 27526 existing records from primary storage. [2025-09-24T21:24:54.194609] [INFO ] [MAIN ] SRI: Loaded 27526 existing records. [2025-09-24T21:24:54.388564] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:24:54.388864] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-24T21:24:54.388920] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-24T21:24:54.389798] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-24T21:24:54.389860] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-24T21:24:54.421193] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-24T21:24:54.756465] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:55.216090] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-24T21:24:55.321156] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:24:55.330566] [INFO ] [REMOTE ] SRE: Full fetch complete (77283 records). [2025-09-24T21:24:55.330736] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-24T21:24:55.483527] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T21:24:55.740782] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-24T21:24:55.740877] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-24T21:24:55.742059] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-24T21:24:55.742128] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-24T21:24:55.743723] [DEBUG] [LOCAL ] SRE: Trimmed 77283 records to 53426 (keeping 200 days of data) [2025-09-24T21:24:56.030171] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-24T21:24:56.089833] [DEBUG] [LOCAL ] SRE: Primary data saved (53426 records). [2025-09-24T21:24:56.090328] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-24T21:24:56.090563] [INFO ] [MAIN ] Update Progress: 1993/2373 symbols completed. SRE took 33.8s. Estimated remaining: 50m 30s. Rate: 7.5 symbols/min [2025-09-24T21:24:56.301270] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T21:24:56.305958] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:24:56.311901] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-24T21:24:56.312567] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-24T21:24:56.313419] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-24T21:24:56.313502] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-24T21:24:56.313556] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-24T21:24:56.313591] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-24T21:24:56.694590] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:24:56.816087] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-24T21:24:57.251022] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T21:24:57.423325] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T21:24:57.616099] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-24T21:24:58.416108] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-24T21:24:58.625866] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T21:24:59.197067] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T21:24:59.216028] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-24T21:25:00.016133] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-24T21:25:00.127491] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-24T21:25:00.816163] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-24T21:25:01.484051] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T21:25:01.503201] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T21:25:01.616127] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-24T21:25:02.416121] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-24T21:25:02.750557] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T21:25:03.216080] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-24T21:25:03.312153] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T21:25:04.016122] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-24T21:25:04.306064] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T21:25:04.514451] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T21:25:04.816104] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-24T21:25:05.616049] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-24T21:25:06.080418] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T21:25:06.416096] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-24T21:25:06.494090] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-24T21:25:06.948932] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T21:25:07.216121] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-24T21:25:08.016140] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-24T21:25:08.380550] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-24T21:25:08.816131] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-24T21:25:09.014044] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:25:09.616118] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-24T21:25:09.637460] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T21:25:09.641356] [INFO ] [REMOTE ] SRG: Full fetch complete (25249 records). [2025-09-24T21:25:09.641490] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-24T21:25:10.049235] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-24T21:25:10.049328] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-24T21:25:10.049899] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-24T21:25:10.049962] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-24T21:25:10.050627] [DEBUG] [LOCAL ] SRG: Trimmed 25249 records to 15666 (keeping 200 days of data) [2025-09-24T21:25:10.152176] [DEBUG] [LOCAL ] SRG: Primary data saved (15666 records). [2025-09-24T21:25:10.152425] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-24T21:25:10.152549] [INFO ] [MAIN ] Update Progress: 1994/2373 symbols completed. SRG took 27.9s. Estimated remaining: 50m 23s. Rate: 7.5 symbols/min [2025-09-24T21:25:10.341435] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:10.352327] [DEBUG] [LOCAL ] SRV: Loaded 7620 existing records from primary storage. [2025-09-24T21:25:10.352509] [INFO ] [MAIN ] SRV: Loaded 7620 existing records. [2025-09-24T21:25:10.421353] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-24T21:25:10.547699] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:10.548100] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-24T21:25:10.548179] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-24T21:25:10.548630] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-24T21:25:10.548739] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-24T21:25:10.875437] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T21:25:10.963684] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:11.079827] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T21:25:11.216095] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-24T21:25:12.016096] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-24T21:25:12.423318] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-24T21:25:12.816058] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-24T21:25:12.828351] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T21:25:13.616092] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-24T21:25:13.986616] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-24T21:25:14.040869] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T21:25:14.416089] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-24T21:25:14.775273] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-24T21:25:15.216120] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-24T21:25:16.016091] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-24T21:25:16.439224] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T21:25:16.443083] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T21:25:16.816075] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-24T21:25:17.616078] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-24T21:25:18.009725] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-24T21:25:18.220901] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T21:25:18.416092] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-24T21:25:19.216105] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-24T21:25:19.231360] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T21:25:19.580435] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-24T21:25:19.581299] [INFO ] [REMOTE ] SRL: Full fetch complete (1973 records). [2025-09-24T21:25:19.581369] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-24T21:25:19.768328] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-24T21:25:19.768525] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:25:19.768595] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:25:19.768693] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-24T21:25:19.768765] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-24T21:25:19.768806] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-24T21:25:19.768865] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-24T21:25:19.768992] [INFO ] [MAIN ] Update Progress: 1995/2373 symbols completed. SRL took 23.7s. Estimated remaining: 50m 16s. Rate: 7.5 symbols/min [2025-09-24T21:25:19.944997] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:19.989278] [DEBUG] [LOCAL ] SSB: Loaded 42927 existing records from primary storage. [2025-09-24T21:25:19.989430] [INFO ] [MAIN ] SSB: Loaded 42927 existing records. [2025-09-24T21:25:20.021235] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-24T21:25:20.183197] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:20.183520] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-24T21:25:20.183571] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-24T21:25:20.185032] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-24T21:25:20.185291] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-24T21:25:20.577540] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:20.816092] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-24T21:25:21.142532] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T21:25:21.616139] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-24T21:25:22.311368] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:25:22.416077] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-24T21:25:22.664622] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T21:25:22.669120] [INFO ] [REMOTE ] SRI: Full fetch complete (41734 records). [2025-09-24T21:25:22.669265] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-24T21:25:23.047446] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-24T21:25:23.047533] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-24T21:25:23.048417] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-24T21:25:23.048479] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-24T21:25:23.049403] [DEBUG] [LOCAL ] SRI: Trimmed 41734 records to 27500 (keeping 200 days of data) [2025-09-24T21:25:23.210255] [DEBUG] [LOCAL ] SRI: Primary data saved (27500 records). [2025-09-24T21:25:23.210471] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-24T21:25:23.210579] [INFO ] [MAIN ] Update Progress: 1996/2373 symbols completed. SRI took 29.2s. Estimated remaining: 50m 7s. Rate: 7.5 symbols/min [2025-09-24T21:25:23.222339] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-24T21:25:23.395557] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:23.420291] [DEBUG] [LOCAL ] SSD: Loaded 22321 existing records from primary storage. [2025-09-24T21:25:23.420436] [INFO ] [MAIN ] SSD: Loaded 22321 existing records. [2025-09-24T21:25:23.607753] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:23.608040] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-24T21:25:23.608093] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-24T21:25:23.608755] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-24T21:25:23.608817] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-24T21:25:23.941811] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T21:25:24.021529] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-24T21:25:24.027950] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:24.161515] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T21:25:24.640574] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T21:25:24.816130] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-24T21:25:25.616103] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-24T21:25:26.304846] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T21:25:26.416090] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-24T21:25:27.216100] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-24T21:25:27.710672] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T21:25:27.950024] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-24T21:25:28.016030] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-24T21:25:28.610763] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T21:25:28.816115] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-24T21:25:29.616122] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-24T21:25:29.827692] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T21:25:29.850862] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T21:25:30.179811] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T21:25:30.416139] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-24T21:25:31.170616] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T21:25:31.216081] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-24T21:25:31.832033] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T21:25:32.016072] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-24T21:25:32.816087] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-24T21:25:33.621159] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-24T21:25:33.633897] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T21:25:33.642778] [INFO ] [REMOTE ] SRFM: Full fetch complete (48923 records). [2025-09-24T21:25:33.642936] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-24T21:25:34.070538] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-24T21:25:34.070385] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T21:25:34.070800] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-24T21:25:34.077167] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-24T21:25:34.077240] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-24T21:25:34.078429] [DEBUG] [LOCAL ] SRFM: Trimmed 48923 records to 35731 (keeping 200 days of data) [2025-09-24T21:25:34.303537] [DEBUG] [LOCAL ] SRFM: Primary data saved (35731 records). [2025-09-24T21:25:34.303725] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-24T21:25:34.303824] [INFO ] [MAIN ] Update Progress: 1997/2373 symbols completed. SRFM took 54.8s. Estimated remaining: 49m 59s. Rate: 7.5 symbols/min [2025-09-24T21:25:34.415843] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T21:25:34.416081] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-24T21:25:35.216108] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-24T21:25:35.280055] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:25:35.982297] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T21:25:36.016096] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-24T21:25:36.816153] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-24T21:25:37.154259] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T21:25:37.616086] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-24T21:25:38.416074] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-24T21:25:38.520225] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T21:25:38.745784] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-24T21:25:39.021330] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T21:25:39.023259] [INFO ] [REMOTE ] SRV: Full fetch complete (11552 records). [2025-09-24T21:25:39.023333] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-24T21:25:39.221331] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-24T21:25:39.432479] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-24T21:25:39.432571] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-24T21:25:39.432920] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-24T21:25:39.432984] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-24T21:25:39.433477] [DEBUG] [LOCAL ] SRV: Trimmed 11552 records to 7538 (keeping 200 days of data) [2025-09-24T21:25:39.483885] [DEBUG] [LOCAL ] SRV: Primary data saved (7538 records). [2025-09-24T21:25:39.484049] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-24T21:25:39.484147] [INFO ] [MAIN ] Update Progress: 1998/2373 symbols completed. SRV took 29.3s. Estimated remaining: 49m 51s. Rate: 7.5 symbols/min [2025-09-24T21:25:40.016137] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-24T21:25:40.892351] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T21:25:40.901832] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-24T21:25:41.149340] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:25:41.616106] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-24T21:25:42.442731] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T21:25:42.451843] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-24T21:25:42.581114] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T21:25:43.216141] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-24T21:25:44.096767] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:25:44.107508] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-24T21:25:44.403283] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:25:44.816093] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-24T21:25:45.393222] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T21:25:45.616129] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-24T21:25:45.952918] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:25:45.957268] [INFO ] [REMOTE ] SSD: Full fetch complete (32370 records). [2025-09-24T21:25:45.957361] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-24T21:25:46.343828] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-24T21:25:46.343979] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-24T21:25:46.344711] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-24T21:25:46.344774] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-24T21:25:46.345554] [DEBUG] [LOCAL ] SSD: Trimmed 32370 records to 22290 (keeping 200 days of data) [2025-09-24T21:25:46.488622] [DEBUG] [LOCAL ] SSD: Primary data saved (22290 records). [2025-09-24T21:25:46.488789] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-24T21:25:46.488879] [INFO ] [MAIN ] Update Progress: 1999/2373 symbols completed. SSD took 23.3s. Estimated remaining: 49m 43s. Rate: 7.5 symbols/min [2025-09-24T21:25:47.107025] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T21:25:47.115213] [INFO ] [REMOTE ] SSB: Full fetch complete (61088 records). [2025-09-24T21:25:47.115359] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-24T21:25:47.569694] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-24T21:25:47.569819] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-24T21:25:47.570876] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-24T21:25:47.570940] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-24T21:25:47.574728] [DEBUG] [LOCAL ] SSB: Trimmed 61088 records to 42863 (keeping 200 days of data) [2025-09-24T21:25:47.843411] [DEBUG] [LOCAL ] SSB: Primary data saved (42863 records). [2025-09-24T21:25:47.843550] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-24T21:25:47.843638] [INFO ] [MAIN ] Update Progress: 2000/2373 symbols completed. SSB took 28.1s. Estimated remaining: 49m 34s. Rate: 7.5 symbols/min [2025-09-24T21:25:48.387353] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:48.533452] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:48.552278] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:48.554735] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:25:48.571020] [DEBUG] [LOCAL ] SST: Loaded 12201 existing records from primary storage. [2025-09-24T21:25:48.571158] [INFO ] [MAIN ] SST: Loaded 12201 existing records. [2025-09-24T21:25:48.718842] [DEBUG] [LOCAL ] SSTK: Loaded 26629 existing records from primary storage. [2025-09-24T21:25:48.751810] [INFO ] [MAIN ] SSTK: Loaded 26629 existing records. [2025-09-24T21:25:48.856073] [DEBUG] [LOCAL ] SSL: Loaded 41199 existing records from primary storage. [2025-09-24T21:25:48.840211] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:48.861502] [INFO ] [MAIN ] SSL: Loaded 41199 existing records. [2025-09-24T21:25:48.884297] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-24T21:25:48.910561] [DEBUG] [LOCAL ] ST: Loaded 49825 existing records from primary storage. [2025-09-24T21:25:48.924753] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-24T21:25:48.940319] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-24T21:25:48.954521] [INFO ] [MAIN ] ST: Loaded 49825 existing records. [2025-09-24T21:25:48.968411] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-24T21:25:49.401586] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:49.385724] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:49.402076] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-24T21:25:49.402982] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-24T21:25:49.444349] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-24T21:25:49.449521] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-24T21:25:49.486234] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-24T21:25:49.479602] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-24T21:25:49.535952] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-24T21:25:49.580282] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-24T21:25:49.575024] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:25:49.725544] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-24T21:25:49.776916] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-24T21:25:49.901143] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-24T21:25:49.904672] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-24T21:25:50.260587] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:50.334115] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-24T21:25:50.750145] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:50.820362] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-24T21:25:50.819710] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:50.844794] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-24T21:25:50.936961] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:25:50.937238] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-24T21:25:51.237110] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T21:25:51.240194] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-24T21:25:51.921554] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T21:25:51.928198] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-24T21:25:52.138925] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:25:52.148020] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-24T21:25:52.363063] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T21:25:52.368121] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-24T21:25:52.537411] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T21:25:52.816127] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-24T21:25:53.044396] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T21:25:53.088007] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T21:25:53.433881] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-24T21:25:53.616083] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-24T21:25:54.421192] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-24T21:25:54.437961] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T21:25:55.216067] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-24T21:25:55.350313] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T21:25:55.669158] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T21:25:56.016095] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-24T21:25:56.077071] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:25:56.816126] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-24T21:25:57.534953] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T21:25:57.616070] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-24T21:25:57.629511] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T21:25:58.416084] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-24T21:25:59.095098] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T21:25:59.216106] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-24T21:25:59.244415] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-24T21:26:00.016093] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-24T21:26:00.816076] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-24T21:26:01.073921] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T21:26:01.314928] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T21:26:01.616160] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-24T21:26:02.035982] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T21:26:02.416133] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-24T21:26:03.216104] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-24T21:26:03.435910] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T21:26:03.492191] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T21:26:04.016096] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-24T21:26:04.649459] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T21:26:04.816093] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-24T21:26:05.616074] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-24T21:26:05.754722] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-24T21:26:05.920907] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T21:26:06.416123] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-24T21:26:06.862695] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-24T21:26:07.193017] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T21:26:07.216062] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-24T21:26:08.016088] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-24T21:26:08.528106] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T21:26:08.816096] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-24T21:26:09.443147] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T21:26:09.616091] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-24T21:26:09.894737] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T21:26:10.416100] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-24T21:26:11.197003] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T21:26:11.216042] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-24T21:26:11.543956] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T21:26:11.548407] [INFO ] [REMOTE ] SSTK: Full fetch complete (42259 records). [2025-09-24T21:26:11.548527] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-24T21:26:11.927956] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-24T21:26:11.928050] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-24T21:26:11.928817] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-24T21:26:11.928896] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-24T21:26:11.929800] [DEBUG] [LOCAL ] SSTK: Trimmed 42259 records to 26511 (keeping 200 days of data) [2025-09-24T21:26:12.030424] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-24T21:26:12.104877] [DEBUG] [LOCAL ] SSTK: Primary data saved (26511 records). [2025-09-24T21:26:12.105027] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-24T21:26:12.105338] [INFO ] [MAIN ] Update Progress: 2001/2373 symbols completed. SSTK took 24.3s. Estimated remaining: 49m 29s. Rate: 7.5 symbols/min [2025-09-24T21:26:12.276961] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:12.329527] [DEBUG] [LOCAL ] STAG: Loaded 50045 existing records from primary storage. [2025-09-24T21:26:12.329722] [INFO ] [MAIN ] STAG: Loaded 50045 existing records. [2025-09-24T21:26:12.507861] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:12.508105] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-24T21:26:12.508165] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-24T21:26:12.509614] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-24T21:26:12.509718] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-24T21:26:12.821316] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-24T21:26:12.887100] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:12.917494] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T21:26:13.610267] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:26:13.619581] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-24T21:26:13.685887] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T21:26:14.416092] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-24T21:26:15.216084] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-24T21:26:16.016069] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-24T21:26:16.175256] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-24T21:26:16.816125] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-24T21:26:17.322946] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T21:26:17.325522] [INFO ] [REMOTE ] SST: Full fetch complete (19069 records). [2025-09-24T21:26:17.325616] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-24T21:26:17.551275] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-09-24T21:26:17.690015] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-24T21:26:17.767435] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-24T21:26:17.767576] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-24T21:26:17.768133] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-24T21:26:17.768237] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-24T21:26:17.770146] [DEBUG] [LOCAL ] SST: Trimmed 19069 records to 12121 (keeping 200 days of data) [2025-09-24T21:26:17.833242] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-24T21:26:17.879041] [DEBUG] [LOCAL ] SST: Primary data saved (12121 records). [2025-09-24T21:26:17.879200] [INFO ] [MAIN ] SST: Full history saved. [2025-09-24T21:26:17.879300] [INFO ] [MAIN ] Update Progress: 2002/2373 symbols completed. SST took 30.0s. Estimated remaining: 49m 20s. Rate: 7.5 symbols/min [2025-09-24T21:26:18.056861] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:18.093220] [DEBUG] [LOCAL ] STC: Loaded 17778 existing records from primary storage. [2025-09-24T21:26:18.093495] [INFO ] [MAIN ] STC: Loaded 17778 existing records. [2025-09-24T21:26:18.291279] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:18.291627] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-24T21:26:18.291710] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-24T21:26:18.292629] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-24T21:26:18.292727] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-24T21:26:18.419169] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-24T21:26:18.698704] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:18.702321] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T21:26:18.987216] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-24T21:26:18.997236] [INFO ] [REMOTE ] SSL: Full fetch complete (60346 records). [2025-09-24T21:26:18.997457] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-24T21:26:19.222063] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-24T21:26:19.408704] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-24T21:26:19.408829] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-24T21:26:19.410694] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-24T21:26:19.410787] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-24T21:26:19.416096] [DEBUG] [LOCAL ] SSL: Trimmed 60346 records to 41232 (keeping 200 days of data) [2025-09-24T21:26:19.663621] [DEBUG] [LOCAL ] SSL: Primary data saved (41232 records). [2025-09-24T21:26:19.663779] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-24T21:26:19.664005] [INFO ] [MAIN ] Update Progress: 2003/2373 symbols completed. SSL took 31.8s. Estimated remaining: 49m 11s. Rate: 7.5 symbols/min [2025-09-24T21:26:19.855115] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:19.896225] [DEBUG] [LOCAL ] STE: Loaded 35424 existing records from primary storage. [2025-09-24T21:26:19.896385] [INFO ] [MAIN ] STE: Loaded 35424 existing records. [2025-09-24T21:26:20.021245] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-24T21:26:20.097391] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:20.097969] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-24T21:26:20.098216] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-24T21:26:20.099617] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-24T21:26:20.099719] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-24T21:26:20.361238] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T21:26:20.527331] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:20.791573] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T21:26:20.816033] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-24T21:26:20.989339] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T21:26:20.999950] [INFO ] [REMOTE ] ST: Full fetch complete (71949 records). [2025-09-24T21:26:21.000175] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-24T21:26:21.427207] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-24T21:26:21.427294] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-24T21:26:21.428416] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-24T21:26:21.428480] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-24T21:26:21.429964] [DEBUG] [LOCAL ] ST: Trimmed 71949 records to 49776 (keeping 200 days of data) [2025-09-24T21:26:21.629077] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-24T21:26:21.761519] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T21:26:21.784190] [DEBUG] [LOCAL ] ST: Primary data saved (49776 records). [2025-09-24T21:26:21.784360] [INFO ] [MAIN ] ST: Full history saved. [2025-09-24T21:26:21.784507] [INFO ] [MAIN ] Update Progress: 2004/2373 symbols completed. ST took 33.9s. Estimated remaining: 49m 2s. Rate: 7.5 symbols/min [2025-09-24T21:26:21.956067] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:21.979960] [DEBUG] [LOCAL ] STEL: Loaded 23688 existing records from primary storage. [2025-09-24T21:26:21.980140] [INFO ] [MAIN ] STEL: Loaded 23688 existing records. [2025-09-24T21:26:22.158917] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:22.159212] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-24T21:26:22.159260] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-24T21:26:22.160046] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-24T21:26:22.160108] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-24T21:26:22.421257] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-24T21:26:22.525901] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:23.100330] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T21:26:23.216088] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-24T21:26:23.469909] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:26:24.016092] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-24T21:26:24.816056] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-24T21:26:25.013187] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T21:26:25.479897] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T21:26:25.507366] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T21:26:25.616072] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-24T21:26:26.416120] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-24T21:26:27.070030] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T21:26:27.216084] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-24T21:26:27.468914] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-24T21:26:28.016083] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-24T21:26:28.816096] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-24T21:26:29.616164] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-24T21:26:30.395240] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-24T21:26:30.416031] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-24T21:26:30.515337] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-24T21:26:30.755499] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-24T21:26:30.988034] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T21:26:31.216125] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-24T21:26:31.616894] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T21:26:31.884817] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T21:26:32.016097] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-24T21:26:32.816082] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-24T21:26:33.088110] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T21:26:33.616106] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-24T21:26:33.979914] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T21:26:34.416065] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-24T21:26:34.738833] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T21:26:35.216086] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-24T21:26:35.482491] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T21:26:36.016045] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-24T21:26:36.466972] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-24T21:26:36.816116] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-24T21:26:37.572547] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T21:26:37.616139] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-24T21:26:38.112835] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:26:38.416098] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-24T21:26:38.637960] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-24T21:26:39.216167] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-24T21:26:40.020534] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-24T21:26:40.037456] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:26:40.060257] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T21:26:40.063939] [INFO ] [REMOTE ] STC: Full fetch complete (26193 records). [2025-09-24T21:26:40.064031] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-24T21:26:40.452129] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-24T21:26:40.452334] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-24T21:26:40.453087] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-24T21:26:40.453152] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-24T21:26:40.454030] [DEBUG] [LOCAL ] STC: Trimmed 26193 records to 17713 (keeping 200 days of data) [2025-09-24T21:26:40.577122] [DEBUG] [LOCAL ] STC: Primary data saved (17713 records). [2025-09-24T21:26:40.577275] [INFO ] [MAIN ] STC: Full history saved. [2025-09-24T21:26:40.577399] [INFO ] [MAIN ] Update Progress: 2005/2373 symbols completed. STC took 22.7s. Estimated remaining: 48m 56s. Rate: 7.5 symbols/min [2025-09-24T21:26:40.749701] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:40.792942] [DEBUG] [LOCAL ] STEM: Loaded 39892 existing records from primary storage. [2025-09-24T21:26:40.793099] [INFO ] [MAIN ] STEM: Loaded 39892 existing records. [2025-09-24T21:26:40.824462] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-24T21:26:40.982566] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:40.982844] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-24T21:26:40.982895] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-24T21:26:40.984195] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-24T21:26:40.984259] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-24T21:26:41.374285] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:41.576065] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T21:26:41.616036] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-24T21:26:42.416070] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-24T21:26:42.881132] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T21:26:43.123212] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T21:26:43.216030] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-24T21:26:44.016087] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-24T21:26:44.238212] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:26:44.426479] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T21:26:44.816086] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-24T21:26:45.090791] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T21:26:45.616144] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-24T21:26:46.225881] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T21:26:46.416082] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-24T21:26:47.216079] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-24T21:26:47.385333] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-24T21:26:47.788772] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T21:26:47.795063] [INFO ] [REMOTE ] STE: Full fetch complete (50733 records). [2025-09-24T21:26:47.795182] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-24T21:26:48.018979] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-24T21:26:48.288362] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-24T21:26:48.289169] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-24T21:26:48.290420] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-24T21:26:48.291479] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-24T21:26:48.291366] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T21:26:48.298474] [DEBUG] [LOCAL ] STE: Trimmed 50733 records to 35406 (keeping 200 days of data) [2025-09-24T21:26:48.534338] [DEBUG] [LOCAL ] STE: Primary data saved (35406 records). [2025-09-24T21:26:48.534492] [INFO ] [MAIN ] STE: Full history saved. [2025-09-24T21:26:48.534581] [INFO ] [MAIN ] Update Progress: 2006/2373 symbols completed. STE took 28.9s. Estimated remaining: 48m 48s. Rate: 7.5 symbols/min [2025-09-24T21:26:48.702119] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:48.719497] [DEBUG] [LOCAL ] STEW: Loaded 16302 existing records from primary storage. [2025-09-24T21:26:48.719637] [INFO ] [MAIN ] STEW: Loaded 16302 existing records. [2025-09-24T21:26:48.822427] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-24T21:26:48.908249] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:48.908522] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-24T21:26:48.908574] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-24T21:26:48.909163] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-24T21:26:48.909229] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-24T21:26:49.287231] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:49.616136] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-24T21:26:49.993264] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T21:26:50.365176] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-24T21:26:50.400835] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T21:26:50.416051] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-24T21:26:51.215026] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T21:26:51.218119] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-24T21:26:52.016077] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-24T21:26:52.480989] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T21:26:52.763767] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-24T21:26:52.816080] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-24T21:26:53.616191] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-24T21:26:53.832995] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:26:54.416221] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-24T21:26:55.216127] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-24T21:26:55.266324] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T21:26:56.016118] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-24T21:26:56.052312] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T21:26:56.062464] [INFO ] [REMOTE ] STAG: Full fetch complete (71886 records). [2025-09-24T21:26:56.062696] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-24T21:26:56.367158] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T21:26:56.398388] [INFO ] [REMOTE ] STEL: Full fetch complete (32189 records). [2025-09-24T21:26:56.423142] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-24T21:26:56.590143] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-24T21:26:56.590559] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-24T21:26:56.591895] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-24T21:26:56.597389] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-24T21:26:56.668704] [DEBUG] [LOCAL ] STAG: Trimmed 71886 records to 50028 (keeping 200 days of data) [2025-09-24T21:26:56.823484] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-24T21:26:56.989190] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-24T21:26:56.989780] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-24T21:26:56.990578] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-24T21:26:56.991020] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-24T21:26:56.994685] [DEBUG] [LOCAL ] STEL: Trimmed 32189 records to 23631 (keeping 200 days of data) [2025-09-24T21:26:57.268749] [DEBUG] [LOCAL ] STEL: Primary data saved (23631 records). [2025-09-24T21:26:57.269439] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-24T21:26:57.270118] [INFO ] [MAIN ] Update Progress: 2007/2373 symbols completed. STEL took 35.5s. Estimated remaining: 48m 40s. Rate: 7.5 symbols/min [2025-09-24T21:26:57.524465] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:57.527709] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-24T21:26:57.529151] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-24T21:26:57.530139] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-24T21:26:57.531596] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-24T21:26:57.532278] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-24T21:26:57.532678] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-24T21:26:57.751336] [DEBUG] [LOCAL ] STAG: Primary data saved (50028 records). [2025-09-24T21:26:57.777665] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-24T21:26:57.804230] [INFO ] [MAIN ] Update Progress: 2008/2373 symbols completed. STAG took 45.7s. Estimated remaining: 48m 31s. Rate: 7.5 symbols/min [2025-09-24T21:26:58.017758] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:58.044191] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-24T21:26:58.089524] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:26:58.128395] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:26:58.140912] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-24T21:26:58.145080] [DEBUG] [LOCAL ] STK: Loaded 9417 existing records from primary storage. [2025-09-24T21:26:58.154446] [INFO ] [MAIN ] STK: Loaded 9417 existing records. [2025-09-24T21:26:58.331488] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:26:58.331768] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-24T21:26:58.331823] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-24T21:26:58.332204] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-24T21:26:58.332262] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-24T21:26:58.423163] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-24T21:26:58.494487] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-24T21:26:58.694992] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:26:59.216098] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-24T21:26:59.528488] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T21:27:00.016127] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-24T21:27:00.489148] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-24T21:27:00.816104] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-24T21:27:01.177189] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-24T21:27:01.206828] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T21:27:01.616098] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-24T21:27:02.352534] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T21:27:02.416113] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-24T21:27:03.216089] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-24T21:27:03.675756] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T21:27:04.016068] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-24T21:27:04.287022] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T21:27:04.470845] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-24T21:27:04.816114] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-24T21:27:05.616081] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-24T21:27:06.416119] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-24T21:27:06.547468] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T21:27:07.162331] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T21:27:07.216124] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-24T21:27:07.908199] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-24T21:27:08.016049] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-24T21:27:08.173908] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T21:27:08.816081] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-24T21:27:09.445297] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-24T21:27:09.616125] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-24T21:27:09.724724] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T21:27:10.416087] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-24T21:27:10.923025] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T21:27:11.196627] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T21:27:11.199151] [INFO ] [REMOTE ] STEW: Full fetch complete (21990 records). [2025-09-24T21:27:11.199224] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-24T21:27:11.221278] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-24T21:27:11.573181] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-24T21:27:11.573270] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-24T21:27:11.573786] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-24T21:27:11.573885] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-24T21:27:11.574593] [DEBUG] [LOCAL ] STEW: Trimmed 21990 records to 16186 (keeping 200 days of data) [2025-09-24T21:27:11.679088] [DEBUG] [LOCAL ] STEW: Primary data saved (16186 records). [2025-09-24T21:27:11.679248] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-24T21:27:11.679340] [INFO ] [MAIN ] Update Progress: 2009/2373 symbols completed. STEW took 23.1s. Estimated remaining: 48m 24s. Rate: 7.5 symbols/min [2025-09-24T21:27:11.850296] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:11.903537] [DEBUG] [LOCAL ] STLA: Loaded 53543 existing records from primary storage. [2025-09-24T21:27:11.903740] [INFO ] [MAIN ] STLA: Loaded 53543 existing records. [2025-09-24T21:27:12.021132] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-24T21:27:12.089637] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:12.090361] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-24T21:27:12.090438] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-24T21:27:12.091927] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-24T21:27:12.092008] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-24T21:27:12.219804] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-24T21:27:12.431108] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T21:27:12.535106] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:12.816082] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-24T21:27:13.616099] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-24T21:27:13.835164] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:27:13.840528] [INFO ] [REMOTE ] STEM: Full fetch complete (62749 records). [2025-09-24T21:27:13.840678] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-24T21:27:14.233068] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-24T21:27:14.233208] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-24T21:27:14.234489] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-24T21:27:14.234559] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-24T21:27:14.236111] [DEBUG] [LOCAL ] STEM: Trimmed 62749 records to 39861 (keeping 200 days of data) [2025-09-24T21:27:14.424901] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-24T21:27:14.473187] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:27:14.506237] [DEBUG] [LOCAL ] STEM: Primary data saved (39861 records). [2025-09-24T21:27:14.506434] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-24T21:27:14.506541] [INFO ] [MAIN ] Update Progress: 2010/2373 symbols completed. STEM took 33.9s. Estimated remaining: 48m 15s. Rate: 7.5 symbols/min [2025-09-24T21:27:14.679150] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:14.731333] [DEBUG] [LOCAL ] STM: Loaded 53587 existing records from primary storage. [2025-09-24T21:27:14.731507] [INFO ] [MAIN ] STM: Loaded 53587 existing records. [2025-09-24T21:27:14.915822] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:14.916145] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-24T21:27:14.916208] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-24T21:27:14.917629] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-24T21:27:14.917715] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-24T21:27:15.221160] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-24T21:27:15.298051] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:15.687459] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T21:27:16.016092] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-24T21:27:16.430661] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-24T21:27:16.816084] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-24T21:27:17.616122] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-24T21:27:18.416118] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-24T21:27:18.503258] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-24T21:27:18.574525] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:27:18.600713] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T21:27:19.216098] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-24T21:27:20.016130] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-24T21:27:20.502683] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-24T21:27:20.799447] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T21:27:20.816037] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-24T21:27:21.048932] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-24T21:27:21.616124] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-24T21:27:21.632611] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-24T21:27:22.416121] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-24T21:27:22.885477] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:27:23.216054] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-24T21:27:23.697911] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-24T21:27:23.963680] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T21:27:24.016153] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-24T21:27:24.715679] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T21:27:24.816144] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-24T21:27:25.616172] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-24T21:27:26.416120] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-24T21:27:27.000635] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-24T21:27:27.139882] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T21:27:27.190043] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T21:27:27.192793] [INFO ] [REMOTE ] STK: Full fetch complete (14047 records). [2025-09-24T21:27:27.192873] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-24T21:27:27.222176] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-24T21:27:27.563325] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-24T21:27:27.563400] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-24T21:27:27.563799] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-24T21:27:27.563861] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-24T21:27:27.564339] [DEBUG] [LOCAL ] STK: Trimmed 14047 records to 9399 (keeping 200 days of data) [2025-09-24T21:27:27.626535] [DEBUG] [LOCAL ] STK: Primary data saved (9399 records). [2025-09-24T21:27:27.626706] [INFO ] [MAIN ] STK: Full history saved. [2025-09-24T21:27:27.626805] [INFO ] [MAIN ] Update Progress: 2011/2373 symbols completed. STK took 29.8s. Estimated remaining: 48m 8s. Rate: 7.5 symbols/min [2025-09-24T21:27:27.796143] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:27.822992] [DEBUG] [LOCAL ] STN: Loaded 23107 existing records from primary storage. [2025-09-24T21:27:27.823175] [INFO ] [MAIN ] STN: Loaded 23107 existing records. [2025-09-24T21:27:28.005082] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:28.005361] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-24T21:27:28.005408] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-24T21:27:28.006554] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-24T21:27:28.006616] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-24T21:27:28.021265] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-24T21:27:28.386506] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:28.579896] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T21:27:28.580897] [INFO ] [REMOTE ] STG: Full fetch complete (2498 records). [2025-09-24T21:27:28.580969] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-24T21:27:28.758210] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-24T21:27:28.758440] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:27:28.758510] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:27:28.758579] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-24T21:27:28.758669] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-24T21:27:28.758728] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-24T21:27:28.758812] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-24T21:27:28.758897] [INFO ] [MAIN ] Update Progress: 2012/2373 symbols completed. STG took 31.5s. Estimated remaining: 47m 59s. Rate: 7.5 symbols/min [2025-09-24T21:27:28.821320] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-24T21:27:28.949802] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:28.996137] [DEBUG] [LOCAL ] STNG: Loaded 44048 existing records from primary storage. [2025-09-24T21:27:28.996328] [INFO ] [MAIN ] STNG: Loaded 44048 existing records. [2025-09-24T21:27:29.207636] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:29.208036] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-24T21:27:29.208094] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-24T21:27:29.209991] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-24T21:27:29.210241] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-24T21:27:29.618058] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-24T21:27:29.621961] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-24T21:27:29.621825] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:29.967730] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T21:27:30.416142] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-24T21:27:31.216151] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-24T21:27:31.975846] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T21:27:32.016090] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-24T21:27:32.065262] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T21:27:32.816163] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-24T21:27:33.177769] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T21:27:33.616072] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-24T21:27:34.125078] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-24T21:27:34.192963] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T21:27:34.416085] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-24T21:27:35.216056] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-24T21:27:35.321588] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:27:35.939291] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T21:27:36.016063] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-24T21:27:36.816082] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-24T21:27:37.326377] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T21:27:37.425109] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-24T21:27:37.616062] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-24T21:27:37.936205] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T21:27:38.416129] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-24T21:27:39.216138] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-24T21:27:39.569171] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T21:27:40.016092] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-24T21:27:40.160929] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-24T21:27:40.816070] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-24T21:27:40.875041] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T21:27:41.616056] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-24T21:27:41.667278] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:27:42.416099] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-24T21:27:42.800309] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T21:27:42.917600] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-24T21:27:43.216115] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-24T21:27:44.016088] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-24T21:27:44.576782] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T21:27:44.809278] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-24T21:27:44.817680] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-24T21:27:45.253370] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T21:27:45.616101] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-24T21:27:46.416055] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-24T21:27:46.595800] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T21:27:46.924116] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T21:27:46.933796] [INFO ] [REMOTE ] STLA: Full fetch complete (77530 records). [2025-09-24T21:27:46.933941] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-24T21:27:47.222483] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-24T21:27:47.365734] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-24T21:27:47.365866] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-24T21:27:47.367185] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-24T21:27:47.367253] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-24T21:27:47.368889] [DEBUG] [LOCAL ] STLA: Trimmed 77530 records to 53542 (keeping 200 days of data) [2025-09-24T21:27:47.695575] [DEBUG] [LOCAL ] STLA: Primary data saved (53542 records). [2025-09-24T21:27:47.695775] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-24T21:27:47.695868] [INFO ] [MAIN ] Update Progress: 2013/2373 symbols completed. STLA took 36.0s. Estimated remaining: 47m 53s. Rate: 7.5 symbols/min [2025-09-24T21:27:47.868618] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:47.880912] [DEBUG] [LOCAL ] STRV: Loaded 11626 existing records from primary storage. [2025-09-24T21:27:47.881042] [INFO ] [MAIN ] STRV: Loaded 11626 existing records. [2025-09-24T21:27:48.032214] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-24T21:27:48.062983] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:48.064132] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-24T21:27:48.064210] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-24T21:27:48.064781] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-24T21:27:48.064842] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-24T21:27:48.455047] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T21:27:48.493599] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:48.816061] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-24T21:27:49.302291] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-24T21:27:49.334474] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:27:49.527349] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-24T21:27:49.616059] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-24T21:27:50.416054] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-24T21:27:50.477325] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T21:27:51.216088] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-24T21:27:52.016055] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-24T21:27:52.059300] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T21:27:52.300542] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-24T21:27:52.816076] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-24T21:27:52.921565] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T21:27:53.616119] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-24T21:27:53.917829] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T21:27:54.416168] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-24T21:27:55.162378] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T21:27:55.172385] [INFO ] [REMOTE ] STNG: Full fetch complete (64415 records). [2025-09-24T21:27:55.172539] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-24T21:27:55.227056] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-24T21:27:55.577680] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-24T21:27:55.577822] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-24T21:27:55.579355] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-24T21:27:55.579491] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-24T21:27:55.598512] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-24T21:27:55.604723] [DEBUG] [LOCAL ] STNG: Trimmed 64415 records to 44045 (keeping 200 days of data) [2025-09-24T21:27:55.883020] [DEBUG] [LOCAL ] STNG: Primary data saved (44045 records). [2025-09-24T21:27:55.883293] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-24T21:27:55.883416] [INFO ] [MAIN ] Update Progress: 2014/2373 symbols completed. STNG took 27.1s. Estimated remaining: 47m 45s. Rate: 7.5 symbols/min [2025-09-24T21:27:56.022401] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-24T21:27:56.054846] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:56.111335] [DEBUG] [LOCAL ] STT: Loaded 51108 existing records from primary storage. [2025-09-24T21:27:56.111546] [INFO ] [MAIN ] STT: Loaded 51108 existing records. [2025-09-24T21:27:56.287668] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:27:56.287976] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-24T21:27:56.288025] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-24T21:27:56.289235] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-24T21:27:56.289296] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-24T21:27:56.677487] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:56.816054] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-24T21:27:56.975947] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T21:27:57.226252] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-24T21:27:57.236791] [INFO ] [REMOTE ] STM: Full fetch complete (77523 records). [2025-09-24T21:27:57.237006] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-24T21:27:57.620486] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-24T21:27:57.656370] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-24T21:27:57.656490] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-24T21:27:57.658059] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-24T21:27:57.658134] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-24T21:27:57.660787] [DEBUG] [LOCAL ] STM: Trimmed 77523 records to 53586 (keeping 200 days of data) [2025-09-24T21:27:58.037624] [DEBUG] [LOCAL ] STM: Primary data saved (53586 records). [2025-09-24T21:27:58.037805] [INFO ] [MAIN ] STM: Full history saved. [2025-09-24T21:27:58.037926] [INFO ] [MAIN ] Update Progress: 2015/2373 symbols completed. STM took 43.5s. Estimated remaining: 47m 36s. Rate: 7.5 symbols/min [2025-09-24T21:27:58.217692] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:27:58.217997] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-24T21:27:58.218043] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-24T21:27:58.218208] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-24T21:27:58.218252] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-24T21:27:58.218294] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-24T21:27:58.218329] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-24T21:27:58.418952] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-24T21:27:58.632074] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:27:58.680203] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T21:27:58.681011] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T21:27:59.216102] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-24T21:27:59.441730] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:27:59.446172] [INFO ] [REMOTE ] STN: Full fetch complete (32336 records). [2025-09-24T21:27:59.446284] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-24T21:27:59.868599] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-24T21:27:59.868725] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-24T21:27:59.869461] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-24T21:27:59.869503] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-24T21:27:59.870367] [DEBUG] [LOCAL ] STN: Trimmed 32336 records to 23138 (keeping 200 days of data) [2025-09-24T21:28:00.016239] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-24T21:28:00.022144] [DEBUG] [LOCAL ] STN: Primary data saved (23138 records). [2025-09-24T21:28:00.022374] [INFO ] [MAIN ] STN: Full history saved. [2025-09-24T21:28:00.022499] [INFO ] [MAIN ] Update Progress: 2016/2373 symbols completed. STN took 32.4s. Estimated remaining: 47m 27s. Rate: 7.5 symbols/min [2025-09-24T21:28:00.206955] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:00.239206] [DEBUG] [LOCAL ] STVN: Loaded 26321 existing records from primary storage. [2025-09-24T21:28:00.239414] [INFO ] [MAIN ] STVN: Loaded 26321 existing records. [2025-09-24T21:28:00.439820] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:00.440218] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-24T21:28:00.440277] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-24T21:28:00.441182] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-24T21:28:00.441247] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-24T21:28:00.820335] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:00.820435] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-24T21:28:00.947027] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T21:28:01.073174] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:01.073528] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-24T21:28:01.616607] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-24T21:28:01.623943] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-24T21:28:02.416080] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-24T21:28:02.937126] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:28:02.981690] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T21:28:03.216084] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-24T21:28:03.411496] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:03.411909] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-24T21:28:04.016066] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-24T21:28:04.816155] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-24T21:28:05.568344] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-24T21:28:05.616082] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-24T21:28:05.735863] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T21:28:06.416109] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-24T21:28:06.762286] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:06.762664] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-24T21:28:06.788446] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T21:28:07.216089] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-24T21:28:08.016098] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-24T21:28:08.242420] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:08.242808] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-24T21:28:08.286016] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T21:28:08.816088] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-24T21:28:09.058045] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:09.058412] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-24T21:28:09.616142] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-24T21:28:10.416093] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-24T21:28:11.216072] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-24T21:28:11.373193] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T21:28:11.461464] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:11.461855] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-24T21:28:11.597173] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T21:28:12.016074] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-24T21:28:12.816081] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-24T21:28:13.220593] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T21:28:13.616073] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-24T21:28:14.416049] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-24T21:28:14.426698] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T21:28:14.535618] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T21:28:15.216122] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-24T21:28:15.460591] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:15.460997] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-24T21:28:15.558722] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T21:28:16.016080] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-24T21:28:16.772570] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T21:28:16.774870] [INFO ] [REMOTE ] STRV: Full fetch complete (18607 records). [2025-09-24T21:28:16.774968] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-24T21:28:16.821269] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-24T21:28:17.181704] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-24T21:28:17.181848] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-24T21:28:17.182705] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-24T21:28:17.182782] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-24T21:28:17.183567] [DEBUG] [LOCAL ] STRV: Trimmed 18607 records to 11574 (keeping 200 days of data) [2025-09-24T21:28:17.266291] [DEBUG] [LOCAL ] STRV: Primary data saved (11574 records). [2025-09-24T21:28:17.266519] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-24T21:28:17.266712] [INFO ] [MAIN ] Update Progress: 2017/2373 symbols completed. STRV took 29.6s. Estimated remaining: 47m 21s. Rate: 7.5 symbols/min [2025-09-24T21:28:17.453902] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:17.522276] [DEBUG] [LOCAL ] STWD: Loaded 51900 existing records from primary storage. [2025-09-24T21:28:17.522533] [INFO ] [MAIN ] STWD: Loaded 51900 existing records. [2025-09-24T21:28:17.623179] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-24T21:28:17.735678] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:17.736188] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-24T21:28:17.736244] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-24T21:28:17.737692] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-24T21:28:17.737770] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-24T21:28:18.156472] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:18.174997] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:28:18.416125] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-24T21:28:19.216048] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-24T21:28:19.334315] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:28:19.463052] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:19.463433] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-24T21:28:19.587893] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T21:28:20.016112] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-24T21:28:20.816160] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-24T21:28:21.616108] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-24T21:28:21.693740] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:28:21.992225] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:28:21.992782] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-24T21:28:22.416129] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-24T21:28:22.911556] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-24T21:28:23.216176] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-24T21:28:24.016116] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-24T21:28:24.100088] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T21:28:24.816064] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-24T21:28:25.037345] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T21:28:25.042339] [INFO ] [REMOTE ] STUB: Full fetch complete (2175 records). [2025-09-24T21:28:25.042473] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-24T21:28:25.239898] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-24T21:28:25.240200] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:28:25.240277] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:28:25.240371] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-24T21:28:25.240491] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-24T21:28:25.240552] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-24T21:28:25.240616] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-24T21:28:25.240755] [INFO ] [MAIN ] Update Progress: 2018/2373 symbols completed. STUB took 27.2s. Estimated remaining: 47m 13s. Rate: 7.5 symbols/min [2025-09-24T21:28:25.417216] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:25.421998] [DEBUG] [LOCAL ] STXD: Loaded 1325 existing records from primary storage. [2025-09-24T21:28:25.422105] [INFO ] [MAIN ] STXD: Loaded 1325 existing records. [2025-09-24T21:28:25.614917] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:25.615236] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-24T21:28:25.615298] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-24T21:28:25.615752] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-24T21:28:25.615819] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-24T21:28:25.649456] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-24T21:28:26.018171] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:26.054170] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-24T21:28:26.189741] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T21:28:26.195804] [INFO ] [REMOTE ] STVN: Full fetch complete (39366 records). [2025-09-24T21:28:26.195935] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-24T21:28:26.426222] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-24T21:28:26.605286] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-24T21:28:26.605468] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-24T21:28:26.607043] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-24T21:28:26.607173] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-24T21:28:26.609401] [DEBUG] [LOCAL ] STVN: Trimmed 39366 records to 26260 (keeping 200 days of data) [2025-09-24T21:28:26.786058] [DEBUG] [LOCAL ] STVN: Primary data saved (26260 records). [2025-09-24T21:28:26.786274] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-24T21:28:26.786427] [INFO ] [MAIN ] Update Progress: 2019/2373 symbols completed. STVN took 26.8s. Estimated remaining: 47m 3s. Rate: 7.5 symbols/min [2025-09-24T21:28:26.976951] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:26.981756] [DEBUG] [LOCAL ] STXE: Loaded 2211 existing records from primary storage. [2025-09-24T21:28:26.981879] [INFO ] [MAIN ] STXE: Loaded 2211 existing records. [2025-09-24T21:28:27.111712] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-24T21:28:27.206103] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:27.206545] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-24T21:28:27.206630] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-24T21:28:27.206919] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-24T21:28:27.207000] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-24T21:28:27.221265] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-24T21:28:27.628067] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:27.666794] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T21:28:28.016134] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-24T21:28:28.816103] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-24T21:28:29.072406] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T21:28:29.329992] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-24T21:28:29.621283] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-24T21:28:29.636586] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:28:30.244548] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T21:28:30.416096] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-24T21:28:31.216137] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-24T21:28:32.016933] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-24T21:28:32.016855] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:28:32.494840] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T21:28:32.816055] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-24T21:28:32.848394] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-24T21:28:32.859251] [INFO ] [REMOTE ] STT: Full fetch complete (74555 records). [2025-09-24T21:28:32.859419] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-24T21:28:33.217788] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-24T21:28:33.312738] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-24T21:28:33.312852] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-24T21:28:33.314209] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-24T21:28:33.314310] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-24T21:28:33.318945] [DEBUG] [LOCAL ] STT: Trimmed 74555 records to 51071 (keeping 200 days of data) [2025-09-24T21:28:33.619819] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-24T21:28:33.662626] [DEBUG] [LOCAL ] STT: Primary data saved (51071 records). [2025-09-24T21:28:33.662805] [INFO ] [MAIN ] STT: Full history saved. [2025-09-24T21:28:33.662908] [INFO ] [MAIN ] Update Progress: 2020/2373 symbols completed. STT took 37.8s. Estimated remaining: 46m 55s. Rate: 7.5 symbols/min [2025-09-24T21:28:33.845272] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:33.853564] [DEBUG] [LOCAL ] STXG: Loaded 2595 existing records from primary storage. [2025-09-24T21:28:33.853726] [INFO ] [MAIN ] STXG: Loaded 2595 existing records. [2025-09-24T21:28:34.032666] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:34.032921] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-24T21:28:34.032971] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-24T21:28:34.033256] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-24T21:28:34.033315] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-24T21:28:34.421225] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-24T21:28:34.427404] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:35.063444] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T21:28:35.216092] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-24T21:28:35.552629] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T21:28:35.630522] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T21:28:36.016158] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-24T21:28:36.442530] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T21:28:36.816143] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-24T21:28:37.284405] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-24T21:28:37.616110] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-24T21:28:38.416113] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-24T21:28:39.216090] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-24T21:28:39.637895] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T21:28:39.746809] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-24T21:28:39.920270] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-24T21:28:40.016080] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-24T21:28:40.816092] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-24T21:28:41.218833] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-24T21:28:41.616077] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-24T21:28:41.761890] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-24T21:28:41.961190] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T21:28:42.416180] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-24T21:28:42.832895] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-24T21:28:43.216114] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-24T21:28:44.016117] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-24T21:28:44.495735] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-24T21:28:44.816104] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-24T21:28:44.893716] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T21:28:45.303337] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-24T21:28:45.616079] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-24T21:28:46.241888] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T21:28:46.416127] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-24T21:28:46.847637] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T21:28:47.216164] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-24T21:28:48.016089] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-24T21:28:48.458566] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T21:28:48.816137] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-24T21:28:49.036986] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-24T21:28:49.226954] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-24T21:28:49.227944] [INFO ] [REMOTE ] STXD: Full fetch complete (2062 records). [2025-09-24T21:28:49.228032] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-24T21:28:49.597353] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-24T21:28:49.597480] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-24T21:28:49.597617] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-24T21:28:49.597688] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-24T21:28:49.598071] [DEBUG] [LOCAL ] STXD: Trimmed 2062 records to 1320 (keeping 200 days of data) [2025-09-24T21:28:49.608187] [DEBUG] [LOCAL ] STXD: Primary data saved (1320 records). [2025-09-24T21:28:49.608252] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-24T21:28:49.608367] [INFO ] [MAIN ] Update Progress: 2021/2373 symbols completed. STXD took 24.4s. Estimated remaining: 46m 49s. Rate: 7.5 symbols/min [2025-09-24T21:28:49.621298] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-24T21:28:49.797420] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:49.801169] [DEBUG] [LOCAL ] STXK: Loaded 1513 existing records from primary storage. [2025-09-24T21:28:49.801259] [INFO ] [MAIN ] STXK: Loaded 1513 existing records. [2025-09-24T21:28:49.981260] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:49.981609] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-24T21:28:49.981702] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-24T21:28:49.981970] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-24T21:28:49.982065] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-24T21:28:50.255386] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-24T21:28:50.384149] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:50.416105] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-24T21:28:51.000541] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T21:28:51.216090] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-24T21:28:52.016080] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-24T21:28:52.460920] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T21:28:52.816110] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-24T21:28:52.854267] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T21:28:52.863748] [INFO ] [REMOTE ] STWD: Full fetch complete (74984 records). [2025-09-24T21:28:52.863889] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-24T21:28:53.260922] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-24T21:28:53.261081] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-24T21:28:53.262955] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-24T21:28:53.263036] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-24T21:28:53.265424] [DEBUG] [LOCAL ] STWD: Trimmed 74984 records to 51894 (keeping 200 days of data) [2025-09-24T21:28:53.381067] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T21:28:53.383003] [INFO ] [REMOTE ] STXE: Full fetch complete (3694 records). [2025-09-24T21:28:53.383103] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-24T21:28:53.621745] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-24T21:28:53.978507] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-24T21:28:53.978592] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-24T21:28:53.978771] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-24T21:28:53.978834] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-24T21:28:53.979376] [DEBUG] [LOCAL ] STXE: Trimmed 3694 records to 2199 (keeping 200 days of data) [2025-09-24T21:28:54.050129] [DEBUG] [LOCAL ] STXE: Primary data saved (2199 records). [2025-09-24T21:28:54.055624] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-24T21:28:54.057021] [INFO ] [MAIN ] Update Progress: 2022/2373 symbols completed. STXE took 27.3s. Estimated remaining: 46m 40s. Rate: 7.5 symbols/min [2025-09-24T21:28:54.252194] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:54.256188] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T21:28:54.258040] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-24T21:28:54.258956] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-24T21:28:54.259676] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-24T21:28:54.260134] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-24T21:28:54.261234] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-24T21:28:54.263575] [DEBUG] [LOCAL ] STWD: Primary data saved (51894 records). [2025-09-24T21:28:54.261552] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-24T21:28:54.307471] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-24T21:28:54.335007] [INFO ] [MAIN ] Update Progress: 2023/2373 symbols completed. STWD took 37.1s. Estimated remaining: 46m 31s. Rate: 7.5 symbols/min [2025-09-24T21:28:54.423344] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-24T21:28:54.736962] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:28:54.798381] [DEBUG] [LOCAL ] STXT: Loaded 2580 existing records from primary storage. [2025-09-24T21:28:54.817369] [INFO ] [MAIN ] STXT: Loaded 2580 existing records. [2025-09-24T21:28:54.823135] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:55.081298] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:28:55.082342] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-24T21:28:55.082400] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-24T21:28:55.083099] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-24T21:28:55.083166] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-24T21:28:55.195461] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-24T21:28:55.221144] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-24T21:28:55.454761] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:28:55.687400] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-24T21:28:56.016122] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-24T21:28:56.462357] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T21:28:56.816082] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-24T21:28:57.245372] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T21:28:57.616155] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-24T21:28:58.084361] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-24T21:28:58.416143] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-24T21:28:58.797896] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-24T21:28:59.216120] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-24T21:28:59.784352] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T21:29:00.016069] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-24T21:29:00.602380] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-24T21:29:00.816079] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-24T21:29:01.268898] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-24T21:29:01.616077] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-24T21:29:02.044081] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-24T21:29:02.416083] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-24T21:29:02.757777] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-24T21:29:03.216084] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-24T21:29:03.805205] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-24T21:29:04.016076] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-24T21:29:04.471816] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T21:29:04.816094] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-24T21:29:05.372759] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-24T21:29:05.616082] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-24T21:29:05.938736] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-24T21:29:06.416089] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-24T21:29:06.894458] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-24T21:29:07.216129] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-24T21:29:07.659496] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-24T21:29:08.016078] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-24T21:29:08.503464] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T21:29:08.816126] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-24T21:29:09.290030] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T21:29:09.616074] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-24T21:29:10.054859] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-24T21:29:10.416072] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-24T21:29:10.851865] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-24T21:29:11.216090] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-24T21:29:11.591704] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-24T21:29:12.016075] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-24T21:29:12.367886] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-24T21:29:12.816119] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-24T21:29:13.204322] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-24T21:29:13.616099] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-24T21:29:14.105472] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T21:29:14.416097] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-24T21:29:14.848313] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T21:29:15.216094] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-24T21:29:15.661279] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-24T21:29:16.016140] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-24T21:29:16.487454] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:29:16.816092] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-24T21:29:17.158289] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-24T21:29:17.616092] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-24T21:29:17.951233] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-24T21:29:18.416113] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-24T21:29:18.747705] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-24T21:29:18.748698] [INFO ] [REMOTE ] STXM: Full fetch complete (1443 records). [2025-09-24T21:29:18.748792] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-24T21:29:18.952472] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-24T21:29:18.952725] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:29:18.952804] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:29:18.952886] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-24T21:29:18.952963] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-24T21:29:18.953008] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-24T21:29:18.953074] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-24T21:29:18.953192] [INFO ] [MAIN ] Update Progress: 2024/2373 symbols completed. STXM took 24.9s. Estimated remaining: 46m 26s. Rate: 7.5 symbols/min [2025-09-24T21:29:19.150126] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:19.154257] [DEBUG] [LOCAL ] STXV: Loaded 1635 existing records from primary storage. [2025-09-24T21:29:19.154372] [INFO ] [MAIN ] STXV: Loaded 1635 existing records. [2025-09-24T21:29:19.221228] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-24T21:29:19.336356] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:19.336635] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-24T21:29:19.336747] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-24T21:29:19.336981] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-24T21:29:19.337041] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-24T21:29:19.707473] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-24T21:29:19.728267] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:20.016118] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-24T21:29:20.562507] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-24T21:29:20.563601] [INFO ] [REMOTE ] STXT: Full fetch complete (4013 records). [2025-09-24T21:29:20.563710] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-24T21:29:20.821295] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-24T21:29:20.930874] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-24T21:29:20.930954] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-24T21:29:20.931080] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-24T21:29:20.931117] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-24T21:29:20.931467] [DEBUG] [LOCAL ] STXT: Trimmed 4013 records to 2566 (keeping 200 days of data) [2025-09-24T21:29:20.947689] [DEBUG] [LOCAL ] STXT: Primary data saved (2566 records). [2025-09-24T21:29:20.947759] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-24T21:29:20.947828] [INFO ] [MAIN ] Update Progress: 2025/2373 symbols completed. STXT took 26.6s. Estimated remaining: 46m 17s. Rate: 7.5 symbols/min [2025-09-24T21:29:21.117077] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:21.177005] [DEBUG] [LOCAL ] STZ: Loaded 52274 existing records from primary storage. [2025-09-24T21:29:21.177188] [INFO ] [MAIN ] STZ: Loaded 52274 existing records. [2025-09-24T21:29:21.281463] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T21:29:21.288481] [INFO ] [REMOTE ] STXK: Full fetch complete (2428 records). [2025-09-24T21:29:21.303988] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-24T21:29:21.465710] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:21.471592] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-24T21:29:21.481897] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-24T21:29:21.517037] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-24T21:29:21.541012] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-24T21:29:21.626305] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-24T21:29:22.027303] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-24T21:29:22.039336] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-24T21:29:22.039677] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-24T21:29:22.039770] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-24T21:29:22.063938] [DEBUG] [LOCAL ] STXK: Trimmed 2428 records to 1513 (keeping 200 days of data) [2025-09-24T21:29:22.155983] [DEBUG] [LOCAL ] STXK: Primary data saved (1513 records). [2025-09-24T21:29:22.161529] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-24T21:29:22.161392] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:22.161764] [INFO ] [MAIN ] Update Progress: 2026/2373 symbols completed. STXK took 32.6s. Estimated remaining: 46m 8s. Rate: 7.5 symbols/min [2025-09-24T21:29:22.197442] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T21:29:22.260004] [INFO ] [REMOTE ] STXG: Full fetch complete (4185 records). [2025-09-24T21:29:22.270874] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-24T21:29:22.424800] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-24T21:29:22.452945] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:22.749028] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-24T21:29:22.749114] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-24T21:29:22.749337] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-24T21:29:22.749375] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-24T21:29:22.749838] [DEBUG] [LOCAL ] STXG: Trimmed 4185 records to 2586 (keeping 200 days of data) [2025-09-24T21:29:22.782239] [DEBUG] [LOCAL ] STXG: Primary data saved (2586 records). [2025-09-24T21:29:22.784599] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-24T21:29:22.784771] [INFO ] [MAIN ] Update Progress: 2027/2373 symbols completed. STXG took 49.1s. Estimated remaining: 45m 58s. Rate: 7.5 symbols/min [2025-09-24T21:29:22.831503] [DEBUG] [LOCAL ] SU: Loaded 53459 existing records from primary storage. [2025-09-24T21:29:22.881978] [INFO ] [MAIN ] SU: Loaded 53459 existing records. [2025-09-24T21:29:23.019480] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T21:29:23.095523] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:23.188167] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:23.188567] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-24T21:29:23.188692] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-24T21:29:23.190611] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-24T21:29:23.190711] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-24T21:29:23.221423] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-24T21:29:23.485705] [DEBUG] [LOCAL ] SUI: Loaded 42060 existing records from primary storage. [2025-09-24T21:29:23.502144] [INFO ] [MAIN ] SUI: Loaded 42060 existing records. [2025-09-24T21:29:23.750483] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:23.770372] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-24T21:29:23.828173] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:23.828438] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-24T21:29:23.828488] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-24T21:29:23.829586] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-24T21:29:23.829690] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-24T21:29:24.021367] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-24T21:29:24.193135] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:24.816118] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-24T21:29:25.616120] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-24T21:29:25.927059] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T21:29:26.416063] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-24T21:29:26.518026] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:29:27.216144] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-24T21:29:27.357732] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T21:29:27.657114] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-24T21:29:27.947428] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T21:29:28.016034] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-24T21:29:28.816129] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-24T21:29:29.271879] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T21:29:29.616111] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-24T21:29:30.154386] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-24T21:29:30.416159] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-24T21:29:31.195132] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T21:29:31.216026] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-24T21:29:32.016153] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-24T21:29:32.417385] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-24T21:29:32.471145] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T21:29:32.520620] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T21:29:32.816138] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-24T21:29:33.247698] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T21:29:33.616097] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-24T21:29:34.416140] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-24T21:29:35.216102] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-24T21:29:35.526885] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T21:29:35.567909] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-24T21:29:36.016053] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-24T21:29:36.121053] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T21:29:36.816137] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-24T21:29:37.465812] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T21:29:37.616099] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-24T21:29:38.316526] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-24T21:29:38.416110] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-24T21:29:38.846434] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T21:29:39.224884] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-24T21:29:39.233379] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T21:29:40.016098] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-24T21:29:40.816083] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-24T21:29:41.124225] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-24T21:29:41.265231] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T21:29:41.616125] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-24T21:29:41.642455] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T21:29:42.129042] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T21:29:42.130096] [INFO ] [REMOTE ] STXV: Full fetch complete (2623 records). [2025-09-24T21:29:42.130170] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-24T21:29:42.421381] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-24T21:29:42.544936] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-24T21:29:42.545177] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-24T21:29:42.545424] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-24T21:29:42.545474] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-24T21:29:42.546542] [DEBUG] [LOCAL ] STXV: Trimmed 2623 records to 1638 (keeping 200 days of data) [2025-09-24T21:29:42.557762] [DEBUG] [LOCAL ] STXV: Primary data saved (1638 records). [2025-09-24T21:29:42.557858] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-24T21:29:42.558011] [INFO ] [MAIN ] Update Progress: 2028/2373 symbols completed. STXV took 23.6s. Estimated remaining: 45m 52s. Rate: 7.5 symbols/min [2025-09-24T21:29:42.764741] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:42.824782] [DEBUG] [LOCAL ] SUN: Loaded 37359 existing records from primary storage. [2025-09-24T21:29:42.825011] [INFO ] [MAIN ] SUN: Loaded 37359 existing records. [2025-09-24T21:29:43.005387] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:43.005765] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-24T21:29:43.005825] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-24T21:29:43.007021] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-24T21:29:43.007086] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-24T21:29:43.221336] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-24T21:29:43.378373] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:44.016111] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-24T21:29:44.506920] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-24T21:29:44.816126] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-24T21:29:45.317847] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-24T21:29:45.564884] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T21:29:45.616103] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-24T21:29:46.416093] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-24T21:29:46.458685] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:29:47.216098] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-24T21:29:47.821793] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T21:29:47.923884] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-24T21:29:48.016088] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-24T21:29:48.816130] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-24T21:29:49.007405] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T21:29:49.616159] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-24T21:29:49.936315] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-24T21:29:49.996194] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T21:29:50.416138] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-24T21:29:51.216106] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-24T21:29:51.408745] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-24T21:29:51.690031] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T21:29:52.016134] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-24T21:29:52.816114] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-24T21:29:52.987252] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T21:29:53.474765] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T21:29:53.616157] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-24T21:29:53.873812] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T21:29:54.416148] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-24T21:29:55.217432] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:29:55.217624] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-24T21:29:56.016152] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-24T21:29:56.573301] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-24T21:29:56.583498] [INFO ] [REMOTE ] STZ: Full fetch complete (75761 records). [2025-09-24T21:29:56.583732] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-24T21:29:56.827532] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-24T21:29:56.955944] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T21:29:57.041772] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-24T21:29:57.041990] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-24T21:29:57.043981] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-24T21:29:57.044232] [INFO ] [REMOTE ] SUI: Full fetch complete (61100 records). [2025-09-24T21:29:57.044463] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-24T21:29:57.044802] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-24T21:29:57.124687] [DEBUG] [LOCAL ] STZ: Trimmed 75761 records to 52265 (keeping 200 days of data) [2025-09-24T21:29:57.346088] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T21:29:57.639882] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-24T21:29:57.850230] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-24T21:29:57.852119] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-24T21:29:57.853396] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-24T21:29:57.852026] [DEBUG] [LOCAL ] STZ: Primary data saved (52265 records). [2025-09-24T21:29:57.853503] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-24T21:29:57.853969] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-24T21:29:57.854093] [INFO ] [MAIN ] Update Progress: 2029/2373 symbols completed. STZ took 36.9s. Estimated remaining: 45m 46s. Rate: 7.5 symbols/min [2025-09-24T21:29:57.949528] [DEBUG] [LOCAL ] SUI: Trimmed 61100 records to 41980 (keeping 200 days of data) [2025-09-24T21:29:58.128982] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:58.189330] [DEBUG] [LOCAL ] SUPV: Loaded 47159 existing records from primary storage. [2025-09-24T21:29:58.190270] [INFO ] [MAIN ] SUPV: Loaded 47159 existing records. [2025-09-24T21:29:58.482204] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:58.485605] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-24T21:29:58.486221] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-24T21:29:58.489400] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-24T21:29:58.489906] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-24T21:29:58.876895] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T21:29:58.935373] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:29:58.937146] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-24T21:29:58.966788] [DEBUG] [LOCAL ] SUI: Primary data saved (41980 records). [2025-09-24T21:29:58.966920] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-24T21:29:58.967007] [INFO ] [MAIN ] Update Progress: 2030/2373 symbols completed. SUI took 36.2s. Estimated remaining: 45m 36s. Rate: 7.5 symbols/min [2025-09-24T21:29:59.138788] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:29:59.183490] [DEBUG] [LOCAL ] SUZ: Loaded 45817 existing records from primary storage. [2025-09-24T21:29:59.183674] [INFO ] [MAIN ] SUZ: Loaded 45817 existing records. [2025-09-24T21:29:59.221249] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-24T21:29:59.374023] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T21:29:59.417417] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:29:59.418170] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-24T21:29:59.418223] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-24T21:29:59.419268] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-24T21:29:59.419330] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-24T21:29:59.784874] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:00.016082] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-24T21:30:00.541973] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T21:30:00.816091] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-24T21:30:01.020149] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T21:30:01.030086] [INFO ] [REMOTE ] SU: Full fetch complete (77398 records). [2025-09-24T21:30:01.030247] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-24T21:30:01.517939] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-24T21:30:01.518165] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-24T21:30:01.519434] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-24T21:30:01.519502] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-24T21:30:01.521423] [DEBUG] [LOCAL ] SU: Trimmed 77398 records to 53457 (keeping 200 days of data) [2025-09-24T21:30:01.632050] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-24T21:30:01.663033] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:30:01.949779] [DEBUG] [LOCAL ] SU: Primary data saved (53457 records). [2025-09-24T21:30:01.950011] [INFO ] [MAIN ] SU: Full history saved. [2025-09-24T21:30:01.950125] [INFO ] [MAIN ] Update Progress: 2031/2373 symbols completed. SU took 39.8s. Estimated remaining: 45m 28s. Rate: 7.5 symbols/min [2025-09-24T21:30:02.171868] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:02.218114] [DEBUG] [LOCAL ] SVV: Loaded 39460 existing records from primary storage. [2025-09-24T21:30:02.218326] [INFO ] [MAIN ] SVV: Loaded 39460 existing records. [2025-09-24T21:30:02.409529] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:02.409886] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-24T21:30:02.409943] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-24T21:30:02.411019] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-24T21:30:02.411113] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-24T21:30:02.446363] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-24T21:30:02.838618] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:03.216165] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-24T21:30:03.553670] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-24T21:30:04.016096] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-24T21:30:04.079902] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-24T21:30:04.816082] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-24T21:30:06.363226] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (3.92 seconds). [2025-09-24T21:30:06.372180] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-24T21:30:06.728220] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-24T21:30:06.737691] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-24T21:30:07.215892] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-24T21:30:07.225849] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-24T21:30:07.288492] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (4.07 seconds). [2025-09-24T21:30:08.016117] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-24T21:30:08.074506] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T21:30:08.328808] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T21:30:08.484639] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T21:30:08.816072] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-24T21:30:09.451393] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T21:30:09.616111] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-24T21:30:10.416087] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-24T21:30:10.634120] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T21:30:10.773979] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T21:30:11.216093] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-24T21:30:11.855211] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T21:30:11.868249] [INFO ] [REMOTE ] SUN: Full fetch complete (54442 records). [2025-09-24T21:30:11.868484] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-24T21:30:12.021202] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-24T21:30:12.254503] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-24T21:30:12.254590] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-24T21:30:12.255593] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-24T21:30:12.255680] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-24T21:30:12.256963] [DEBUG] [LOCAL ] SUN: Trimmed 54442 records to 37364 (keeping 200 days of data) [2025-09-24T21:30:12.493993] [DEBUG] [LOCAL ] SUN: Primary data saved (37364 records). [2025-09-24T21:30:12.494146] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-24T21:30:12.494231] [INFO ] [MAIN ] Update Progress: 2032/2373 symbols completed. SUN took 29.9s. Estimated remaining: 45m 20s. Rate: 7.5 symbols/min [2025-09-24T21:30:12.663884] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:12.721350] [DEBUG] [LOCAL ] SW: Loaded 53163 existing records from primary storage. [2025-09-24T21:30:12.721553] [INFO ] [MAIN ] SW: Loaded 53163 existing records. [2025-09-24T21:30:12.818422] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-24T21:30:12.947738] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:12.948162] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-24T21:30:12.948338] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-24T21:30:12.957496] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-24T21:30:12.972363] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-24T21:30:13.039823] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T21:30:13.350860] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:13.616074] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-24T21:30:13.806433] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:30:14.416103] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-24T21:30:15.216045] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-24T21:30:15.541908] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-24T21:30:15.935636] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-24T21:30:15.983110] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:30:16.016050] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-24T21:30:16.817506] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-24T21:30:16.821445] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T21:30:17.391910] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:30:17.616159] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-24T21:30:18.416150] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-24T21:30:18.551932] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:30:19.188979] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T21:30:19.216041] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-24T21:30:19.854689] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T21:30:20.016114] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-24T21:30:20.816122] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-24T21:30:20.883321] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T21:30:21.616128] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-24T21:30:21.794082] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T21:30:21.996479] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T21:30:22.416089] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-24T21:30:23.171098] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T21:30:23.184704] [INFO ] [REMOTE ] SUPV: Full fetch complete (68178 records). [2025-09-24T21:30:23.184919] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-24T21:30:23.222492] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-24T21:30:23.626786] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-24T21:30:23.626888] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-24T21:30:23.628392] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-24T21:30:23.628459] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-24T21:30:23.629994] [DEBUG] [LOCAL ] SUPV: Trimmed 68178 records to 47192 (keeping 200 days of data) [2025-09-24T21:30:23.922269] [DEBUG] [LOCAL ] SUPV: Primary data saved (47192 records). [2025-09-24T21:30:23.922427] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-24T21:30:23.922517] [INFO ] [MAIN ] Update Progress: 2033/2373 symbols completed. SUPV took 26.1s. Estimated remaining: 45m 13s. Rate: 7.5 symbols/min [2025-09-24T21:30:24.020340] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-24T21:30:24.107367] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:24.136170] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T21:30:24.196477] [DEBUG] [LOCAL ] SWK: Loaded 52470 existing records from primary storage. [2025-09-24T21:30:24.196714] [INFO ] [MAIN ] SWK: Loaded 52470 existing records. [2025-09-24T21:30:24.379251] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:24.379542] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-24T21:30:24.379592] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-24T21:30:24.380836] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-24T21:30:24.380898] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-24T21:30:24.751968] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:24.816048] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-24T21:30:24.916162] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T21:30:25.616143] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-24T21:30:26.057178] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T21:30:26.415169] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:30:26.418938] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-24T21:30:27.100069] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:30:27.216087] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-24T21:30:28.016067] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-24T21:30:28.278152] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T21:30:28.816096] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-24T21:30:29.127869] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:30:29.616406] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-24T21:30:29.619397] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-24T21:30:30.273510] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T21:30:30.416133] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-24T21:30:31.034376] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T21:30:31.042760] [INFO ] [REMOTE ] SVV: Full fetch complete (55816 records). [2025-09-24T21:30:31.042926] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-24T21:30:31.233850] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-24T21:30:31.471228] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-24T21:30:31.471379] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-24T21:30:31.473057] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-24T21:30:31.473150] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-24T21:30:31.475741] [DEBUG] [LOCAL ] SVV: Trimmed 55816 records to 39502 (keeping 200 days of data) [2025-09-24T21:30:31.717930] [DEBUG] [LOCAL ] SVV: Primary data saved (39502 records). [2025-09-24T21:30:31.718093] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-24T21:30:31.718184] [INFO ] [MAIN ] Update Progress: 2034/2373 symbols completed. SVV took 29.8s. Estimated remaining: 45m 5s. Rate: 7.5 symbols/min [2025-09-24T21:30:31.905232] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:31.938207] [DEBUG] [LOCAL ] SWX: Loaded 31378 existing records from primary storage. [2025-09-24T21:30:31.938421] [INFO ] [MAIN ] SWX: Loaded 31378 existing records. [2025-09-24T21:30:32.018945] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-24T21:30:32.142139] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:32.142737] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-24T21:30:32.142933] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-24T21:30:32.143979] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-24T21:30:32.144048] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-24T21:30:32.425582] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T21:30:32.567926] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:32.816130] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-24T21:30:33.059442] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T21:30:33.556880] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:30:33.566387] [INFO ] [REMOTE ] SUZ: Full fetch complete (66965 records). [2025-09-24T21:30:33.566516] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-24T21:30:33.622570] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-24T21:30:33.982744] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T21:30:33.991282] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-24T21:30:33.991371] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-24T21:30:33.993080] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-24T21:30:33.993146] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-24T21:30:33.997370] [DEBUG] [LOCAL ] SUZ: Trimmed 66965 records to 45789 (keeping 200 days of data) [2025-09-24T21:30:34.261459] [DEBUG] [LOCAL ] SUZ: Primary data saved (45789 records). [2025-09-24T21:30:34.261700] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-24T21:30:34.261879] [INFO ] [MAIN ] Update Progress: 2035/2373 symbols completed. SUZ took 35.3s. Estimated remaining: 44m 56s. Rate: 7.5 symbols/min [2025-09-24T21:30:34.434142] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:34.429581] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-24T21:30:34.445684] [DEBUG] [LOCAL ] SWZ: Loaded 6034 existing records from primary storage. [2025-09-24T21:30:34.445823] [INFO ] [MAIN ] SWZ: Loaded 6034 existing records. [2025-09-24T21:30:34.628236] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:34.628508] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-24T21:30:34.628566] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-24T21:30:34.628914] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-24T21:30:34.628974] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-24T21:30:35.000828] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:35.216095] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-24T21:30:35.540211] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T21:30:35.784681] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:30:36.016128] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-24T21:30:36.763699] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:30:36.816048] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-24T21:30:37.454372] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T21:30:37.616088] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-24T21:30:38.155266] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T21:30:38.185718] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-24T21:30:38.416140] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-24T21:30:39.216132] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-24T21:30:39.644487] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-24T21:30:39.989342] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T21:30:40.016039] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-24T21:30:40.583414] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T21:30:40.816120] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-24T21:30:41.433378] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-24T21:30:41.616074] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-24T21:30:42.416105] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-24T21:30:43.216169] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-24T21:30:43.639148] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T21:30:43.779248] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T21:30:44.016160] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-24T21:30:44.089705] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T21:30:44.816179] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-24T21:30:45.505111] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T21:30:45.616135] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-24T21:30:45.918753] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-24T21:30:46.416151] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-24T21:30:47.216141] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-24T21:30:47.572928] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T21:30:48.016155] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-24T21:30:48.287378] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T21:30:48.506816] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-24T21:30:48.608972] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T21:30:48.816095] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-24T21:30:49.508088] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T21:30:49.616084] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-24T21:30:50.416127] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-24T21:30:51.164896] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T21:30:51.216142] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-24T21:30:51.460690] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T21:30:51.471041] [INFO ] [REMOTE ] SW: Full fetch complete (76745 records). [2025-09-24T21:30:51.471273] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-24T21:30:51.816951] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-24T21:30:51.830139] [INFO ] [REMOTE ] SWZ: Full fetch complete (8087 records). [2025-09-24T21:30:51.845834] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-24T21:30:52.018382] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-24T21:30:52.100604] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-24T21:30:52.112098] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-24T21:30:52.135600] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-24T21:30:52.147433] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-24T21:30:52.284738] [DEBUG] [LOCAL ] SW: Trimmed 76745 records to 53161 (keeping 200 days of data) [2025-09-24T21:30:52.515413] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-24T21:30:52.518141] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-24T21:30:52.522005] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-24T21:30:52.522459] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-24T21:30:52.523817] [DEBUG] [LOCAL ] SWZ: Trimmed 8087 records to 6023 (keeping 200 days of data) [2025-09-24T21:30:52.562718] [DEBUG] [LOCAL ] SWZ: Primary data saved (6023 records). [2025-09-24T21:30:52.563413] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-24T21:30:52.563923] [INFO ] [MAIN ] Update Progress: 2036/2373 symbols completed. SWZ took 18.3s. Estimated remaining: 44m 50s. Rate: 7.5 symbols/min [2025-09-24T21:30:52.759787] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:30:52.839958] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-24T21:30:52.927942] [DEBUG] [LOCAL ] SXC: Loaded 41626 existing records from primary storage. [2025-09-24T21:30:52.930375] [INFO ] [MAIN ] SXC: Loaded 41626 existing records. [2025-09-24T21:30:53.177210] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:30:53.184039] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-24T21:30:53.187221] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-24T21:30:53.190722] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-24T21:30:53.191133] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-24T21:30:53.551295] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T21:30:53.623825] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-24T21:30:53.759451] [DEBUG] [LOCAL ] SW: Primary data saved (53161 records). [2025-09-24T21:30:53.783428] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:30:53.783989] [INFO ] [MAIN ] SW: Full history saved. [2025-09-24T21:30:53.784179] [INFO ] [MAIN ] Update Progress: 2037/2373 symbols completed. SW took 41.3s. Estimated remaining: 44m 40s. Rate: 7.5 symbols/min [2025-09-24T21:30:54.416098] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-24T21:30:54.611183] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T21:30:54.678638] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T21:30:55.216099] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-24T21:30:55.622975] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T21:30:56.016094] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-24T21:30:56.371727] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T21:30:56.816083] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-24T21:30:57.616112] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-24T21:30:57.961144] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T21:30:58.012280] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T21:30:58.018339] [INFO ] [REMOTE ] SWX: Full fetch complete (43751 records). [2025-09-24T21:30:58.018438] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-24T21:30:58.423413] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-24T21:30:58.442352] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-24T21:30:58.442423] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-24T21:30:58.443447] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-24T21:30:58.443528] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-24T21:30:58.447768] [DEBUG] [LOCAL ] SWX: Trimmed 43751 records to 31294 (keeping 200 days of data) [2025-09-24T21:30:58.658714] [DEBUG] [LOCAL ] SWX: Primary data saved (31294 records). [2025-09-24T21:30:58.658862] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-24T21:30:58.658985] [INFO ] [MAIN ] Update Progress: 2038/2373 symbols completed. SWX took 26.9s. Estimated remaining: 44m 32s. Rate: 7.5 symbols/min [2025-09-24T21:30:59.007893] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T21:30:59.143334] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T21:30:59.216066] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-24T21:31:00.016131] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-24T21:31:00.959538] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T21:31:00.969836] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-24T21:31:01.755941] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T21:31:01.769474] [INFO ] [REMOTE ] SWK: Full fetch complete (75390 records). [2025-09-24T21:31:01.769673] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-24T21:31:02.190770] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-24T21:31:02.190908] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-24T21:31:02.192263] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-24T21:31:02.192355] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-24T21:31:02.194892] [DEBUG] [LOCAL ] SWK: Trimmed 75390 records to 52442 (keeping 200 days of data) [2025-09-24T21:31:02.595271] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T21:31:02.608840] [DEBUG] [LOCAL ] SWK: Primary data saved (52442 records). [2025-09-24T21:31:02.609777] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-24T21:31:02.609961] [INFO ] [MAIN ] Update Progress: 2039/2373 symbols completed. SWK took 38.7s. Estimated remaining: 44m 23s. Rate: 7.5 symbols/min [2025-09-24T21:31:02.610926] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-24T21:31:04.231055] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T21:31:04.240940] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-24T21:31:05.606946] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T21:31:05.615458] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-24T21:31:07.255098] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-24T21:31:07.276680] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-24T21:31:08.880355] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:31:08.890610] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-24T21:31:10.507926] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:31:10.518330] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-24T21:31:11.560821] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T21:31:11.569683] [INFO ] [REMOTE ] SXC: Full fetch complete (61249 records). [2025-09-24T21:31:11.569950] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-24T21:31:11.978108] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-24T21:31:11.978209] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-24T21:31:11.979423] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-24T21:31:11.979491] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-24T21:31:11.981008] [DEBUG] [LOCAL ] SXC: Trimmed 61249 records to 41571 (keeping 200 days of data) [2025-09-24T21:31:12.266846] [DEBUG] [LOCAL ] SXC: Primary data saved (41571 records). [2025-09-24T21:31:12.267077] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-24T21:31:12.267316] [INFO ] [MAIN ] Update Progress: 2040/2373 symbols completed. SXC took 19.7s. Estimated remaining: 44m 16s. Rate: 7.5 symbols/min [2025-09-24T21:31:12.808602] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:12.861898] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:12.975528] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:13.001350] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:13.036613] [DEBUG] [LOCAL ] SXI: Loaded 11511 existing records from primary storage. [2025-09-24T21:31:13.042596] [INFO ] [MAIN ] SXI: Loaded 11511 existing records. [2025-09-24T21:31:13.109181] [DEBUG] [LOCAL ] SXT: Loaded 29088 existing records from primary storage. [2025-09-24T21:31:13.135121] [INFO ] [MAIN ] SXT: Loaded 29088 existing records. [2025-09-24T21:31:13.380772] [DEBUG] [LOCAL ] SYK: Loaded 47075 existing records from primary storage. [2025-09-24T21:31:13.397279] [INFO ] [MAIN ] SYK: Loaded 47075 existing records. [2025-09-24T21:31:13.392865] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:13.549373] [DEBUG] [LOCAL ] SYF: Loaded 53457 existing records from primary storage. [2025-09-24T21:31:13.549551] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-24T21:31:13.572960] [INFO ] [MAIN ] SYF: Loaded 53457 existing records. [2025-09-24T21:31:13.579507] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:13.590022] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-24T21:31:13.649114] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-24T21:31:13.649323] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-24T21:31:13.649260] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-24T21:31:13.658071] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-24T21:31:13.697691] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-24T21:31:13.777561] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-24T21:31:14.057338] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:14.049143] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:14.106156] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-24T21:31:14.139810] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-24T21:31:14.139621] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-24T21:31:14.207615] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-24T21:31:14.232503] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-24T21:31:14.277454] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-24T21:31:14.307597] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-24T21:31:14.307486] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-24T21:31:14.795887] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:14.801862] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-24T21:31:15.158872] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:15.190885] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-24T21:31:15.346895] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:15.370666] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-24T21:31:15.399922] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:15.400275] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-24T21:31:15.760314] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:31:15.762052] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-24T21:31:16.496020] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T21:31:16.500328] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-24T21:31:16.598931] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T21:31:16.602731] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-24T21:31:16.958479] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T21:31:16.968392] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-24T21:31:17.101229] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:31:17.112969] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-24T21:31:17.121464] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-24T21:31:17.124452] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-24T21:31:17.530985] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T21:31:17.535783] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-24T21:31:17.938793] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T21:31:17.941788] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-24T21:31:18.569941] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T21:31:18.581248] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-24T21:31:18.614127] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T21:31:18.654200] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-24T21:31:18.662378] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T21:31:18.685509] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-24T21:31:18.687270] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-24T21:31:18.692944] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-24T21:31:19.561698] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-24T21:31:19.566268] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-24T21:31:19.940758] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T21:31:20.016118] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-24T21:31:20.119963] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T21:31:20.242977] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T21:31:20.535735] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T21:31:20.816145] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-24T21:31:21.479179] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T21:31:21.616107] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-24T21:31:22.416060] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-24T21:31:22.815039] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T21:31:23.216079] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-24T21:31:23.264350] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-24T21:31:23.580818] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T21:31:24.016151] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-24T21:31:24.599817] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:31:24.816180] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-24T21:31:25.548713] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T21:31:25.616114] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-24T21:31:26.416107] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-24T21:31:26.543142] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T21:31:26.848387] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T21:31:27.216109] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-24T21:31:27.359716] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T21:31:28.016169] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-24T21:31:28.816092] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-24T21:31:28.850807] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T21:31:29.409926] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T21:31:29.600036] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T21:31:29.602979] [INFO ] [REMOTE ] SXI: Full fetch complete (14575 records). [2025-09-24T21:31:29.603091] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-24T21:31:29.625718] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-24T21:31:29.983266] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-24T21:31:29.983372] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-24T21:31:29.983888] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-24T21:31:29.983955] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-24T21:31:29.985234] [DEBUG] [LOCAL ] SXI: Trimmed 14575 records to 11540 (keeping 200 days of data) [2025-09-24T21:31:30.070342] [DEBUG] [LOCAL ] SXI: Primary data saved (11540 records). [2025-09-24T21:31:30.070504] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-24T21:31:30.070624] [INFO ] [MAIN ] Update Progress: 2041/2373 symbols completed. SXI took 17.8s. Estimated remaining: 44m 9s. Rate: 7.5 symbols/min [2025-09-24T21:31:30.241441] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:30.301064] [DEBUG] [LOCAL ] SYY: Loaded 53237 existing records from primary storage. [2025-09-24T21:31:30.301234] [INFO ] [MAIN ] SYY: Loaded 53237 existing records. [2025-09-24T21:31:30.421276] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-24T21:31:30.486149] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:30.486464] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-24T21:31:30.486513] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-24T21:31:30.487960] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-24T21:31:30.488022] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-24T21:31:30.847068] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:31.216118] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-24T21:31:31.366455] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T21:31:32.016164] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-24T21:31:32.387900] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T21:31:32.586991] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T21:31:32.816156] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-24T21:31:33.289513] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-24T21:31:33.616139] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-24T21:31:34.416183] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-24T21:31:34.536926] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-24T21:31:35.128369] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T21:31:35.216117] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-24T21:31:36.016073] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-24T21:31:36.216089] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:31:36.816116] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-24T21:31:36.931532] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T21:31:37.251554] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T21:31:37.257590] [INFO ] [REMOTE ] SXT: Full fetch complete (37856 records). [2025-09-24T21:31:37.257748] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-24T21:31:37.618381] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-24T21:31:37.641115] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-24T21:31:37.641212] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-24T21:31:37.642223] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-24T21:31:37.642286] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-24T21:31:37.643236] [DEBUG] [LOCAL ] SXT: Trimmed 37856 records to 29113 (keeping 200 days of data) [2025-09-24T21:31:37.836764] [DEBUG] [LOCAL ] SXT: Primary data saved (29113 records). [2025-09-24T21:31:37.836950] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-24T21:31:37.837052] [INFO ] [MAIN ] Update Progress: 2042/2373 symbols completed. SXT took 25.6s. Estimated remaining: 44m 1s. Rate: 7.5 symbols/min [2025-09-24T21:31:38.031618] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:38.090526] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-24T21:31:38.090715] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-24T21:31:38.268594] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:38.268893] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-24T21:31:38.268946] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-24T21:31:38.270578] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-24T21:31:38.270664] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-24T21:31:38.421742] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-24T21:31:38.638408] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:38.806885] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T21:31:39.216121] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-24T21:31:39.357154] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T21:31:40.016076] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-24T21:31:40.227621] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T21:31:40.816086] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-24T21:31:41.616101] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-24T21:31:41.694231] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-24T21:31:41.875862] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T21:31:42.416116] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-24T21:31:42.458511] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T21:31:42.466870] [INFO ] [REMOTE ] SYK: Full fetch complete (68767 records). [2025-09-24T21:31:42.466987] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-24T21:31:42.866322] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-24T21:31:42.866439] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-24T21:31:42.867741] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-24T21:31:42.867824] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-24T21:31:42.869393] [DEBUG] [LOCAL ] SYK: Trimmed 68767 records to 47045 (keeping 200 days of data) [2025-09-24T21:31:43.188679] [DEBUG] [LOCAL ] SYK: Primary data saved (47045 records). [2025-09-24T21:31:43.188831] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-24T21:31:43.188949] [INFO ] [MAIN ] Update Progress: 2043/2373 symbols completed. SYK took 30.9s. Estimated remaining: 43m 53s. Rate: 7.5 symbols/min [2025-09-24T21:31:43.222156] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-24T21:31:43.378355] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:43.422278] [DEBUG] [LOCAL ] TAC: Loaded 42907 existing records from primary storage. [2025-09-24T21:31:43.422788] [INFO ] [MAIN ] TAC: Loaded 42907 existing records. [2025-09-24T21:31:43.627203] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-24T21:31:43.657419] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:43.657979] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-24T21:31:43.658154] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-24T21:31:43.659216] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-24T21:31:43.659279] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-24T21:31:44.023136] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:44.017134] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-24T21:31:44.364863] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-24T21:31:44.375522] [INFO ] [REMOTE ] SYF: Full fetch complete (77336 records). [2025-09-24T21:31:44.375707] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-24T21:31:44.777594] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-24T21:31:44.777707] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-24T21:31:44.779162] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-24T21:31:44.779227] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-24T21:31:44.780875] [DEBUG] [LOCAL ] SYF: Trimmed 77336 records to 53454 (keeping 200 days of data) [2025-09-24T21:31:44.837085] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-24T21:31:45.129826] [DEBUG] [LOCAL ] SYF: Primary data saved (53454 records). [2025-09-24T21:31:45.130016] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-24T21:31:45.130133] [INFO ] [MAIN ] Update Progress: 2044/2373 symbols completed. SYF took 32.9s. Estimated remaining: 43m 44s. Rate: 7.5 symbols/min [2025-09-24T21:31:45.304731] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:45.359613] [DEBUG] [LOCAL ] TAK: Loaded 49893 existing records from primary storage. [2025-09-24T21:31:45.359795] [INFO ] [MAIN ] TAK: Loaded 49893 existing records. [2025-09-24T21:31:45.554512] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:45.555100] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-24T21:31:45.555392] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-24T21:31:45.556856] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-24T21:31:45.556919] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-24T21:31:45.886381] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-24T21:31:45.949288] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-24T21:31:45.984053] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:31:46.015631] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-24T21:31:46.302914] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T21:31:46.416060] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-24T21:31:47.216131] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-24T21:31:47.967484] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-24T21:31:48.016028] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-24T21:31:48.050892] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:31:48.816063] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-24T21:31:48.914139] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:31:49.616089] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-24T21:31:50.216182] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-24T21:31:50.416080] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-24T21:31:50.683791] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T21:31:50.832459] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T21:31:51.216123] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-24T21:31:51.711367] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-24T21:31:52.016115] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-24T21:31:52.816059] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-24T21:31:53.111072] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T21:31:53.616092] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-24T21:31:53.700459] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T21:31:54.427463] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-24T21:31:54.435960] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:31:55.216159] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-24T21:31:55.460614] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T21:31:56.016099] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-24T21:31:56.769312] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:31:56.816078] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-24T21:31:56.883950] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-24T21:31:57.617599] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-24T21:31:57.617482] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T21:31:58.405345] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:31:58.414705] [INFO ] [REMOTE ] SYY: Full fetch complete (76970 records). [2025-09-24T21:31:58.414870] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-24T21:31:58.427144] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-24T21:31:58.863833] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-24T21:31:58.863966] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-24T21:31:58.865451] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-24T21:31:58.865536] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-24T21:31:58.867838] [DEBUG] [LOCAL ] SYY: Trimmed 76970 records to 53233 (keeping 200 days of data) [2025-09-24T21:31:59.217408] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-24T21:31:59.254632] [DEBUG] [LOCAL ] SYY: Primary data saved (53233 records). [2025-09-24T21:31:59.254981] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-24T21:31:59.255212] [INFO ] [MAIN ] Update Progress: 2045/2373 symbols completed. SYY took 29.2s. Estimated remaining: 43m 37s. Rate: 7.5 symbols/min [2025-09-24T21:31:59.440897] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:31:59.479847] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T21:31:59.549828] [DEBUG] [LOCAL ] TAL: Loaded 52110 existing records from primary storage. [2025-09-24T21:31:59.550036] [INFO ] [MAIN ] TAL: Loaded 52110 existing records. [2025-09-24T21:31:59.741627] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:31:59.741915] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-24T21:31:59.741971] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-24T21:31:59.743078] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-24T21:31:59.743143] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-24T21:32:00.024028] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-24T21:32:00.146321] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:00.433178] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T21:32:00.816059] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-24T21:32:00.901583] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-24T21:32:01.616144] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-24T21:32:01.719767] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T21:32:02.188371] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:32:02.416107] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-24T21:32:03.216078] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-24T21:32:03.309212] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:32:04.016156] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-24T21:32:04.524553] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T21:32:04.750285] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-24T21:32:04.816100] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-24T21:32:05.616115] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-24T21:32:05.929016] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T21:32:06.416127] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-24T21:32:07.041012] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:32:07.175289] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-24T21:32:07.216101] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-24T21:32:08.016090] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-24T21:32:08.199177] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T21:32:08.267861] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T21:32:08.275703] [INFO ] [REMOTE ] TAC: Full fetch complete (64256 records). [2025-09-24T21:32:08.275927] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-24T21:32:08.709485] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-24T21:32:08.709614] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-24T21:32:08.711195] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-24T21:32:08.711268] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-24T21:32:08.713117] [DEBUG] [LOCAL ] TAC: Trimmed 64256 records to 42852 (keeping 200 days of data) [2025-09-24T21:32:08.816953] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-24T21:32:08.996476] [DEBUG] [LOCAL ] TAC: Primary data saved (42852 records). [2025-09-24T21:32:08.996618] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-24T21:32:08.996751] [INFO ] [MAIN ] Update Progress: 2046/2373 symbols completed. TAC took 25.8s. Estimated remaining: 43m 29s. Rate: 7.5 symbols/min [2025-09-24T21:32:09.172548] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:09.226207] [DEBUG] [LOCAL ] TALO: Loaded 50828 existing records from primary storage. [2025-09-24T21:32:09.226378] [INFO ] [MAIN ] TALO: Loaded 50828 existing records. [2025-09-24T21:32:09.421216] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:09.421663] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-24T21:32:09.421762] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-24T21:32:09.432556] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-24T21:32:09.446517] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-24T21:32:09.511682] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T21:32:09.621189] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-24T21:32:09.848198] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:10.263917] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T21:32:10.416134] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-24T21:32:11.216133] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-24T21:32:11.514423] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T21:32:12.016064] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-24T21:32:12.183997] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T21:32:12.701427] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T21:32:12.816092] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-24T21:32:13.616050] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-24T21:32:13.803473] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:32:14.416131] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-24T21:32:14.960730] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T21:32:15.216104] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-24T21:32:15.582214] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T21:32:16.016124] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-24T21:32:16.091350] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:32:16.100518] [INFO ] [REMOTE ] TAK: Full fetch complete (71456 records). [2025-09-24T21:32:16.100741] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-24T21:32:16.537085] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-24T21:32:16.537426] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-24T21:32:16.538833] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-24T21:32:16.538901] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-24T21:32:16.540550] [DEBUG] [LOCAL ] TAK: Trimmed 71456 records to 49852 (keeping 200 days of data) [2025-09-24T21:32:16.842860] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-24T21:32:16.864888] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-24T21:32:16.906218] [DEBUG] [LOCAL ] TAK: Primary data saved (49852 records). [2025-09-24T21:32:16.923241] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-24T21:32:16.920156] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-24T21:32:16.923582] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-24T21:32:16.924011] [INFO ] [MAIN ] Update Progress: 2047/2373 symbols completed. TAK took 31.8s. Estimated remaining: 43m 21s. Rate: 7.5 symbols/min [2025-09-24T21:32:16.927485] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T21:32:17.304160] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:17.532426] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-24T21:32:17.532581] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-24T21:32:17.533913] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-24T21:32:17.533997] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-24T21:32:17.549324] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-09-24T21:32:17.620264] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-24T21:32:17.660304] [DEBUG] [LOCAL ] TAP: Loaded 52874 existing records from primary storage. [2025-09-24T21:32:17.660878] [INFO ] [MAIN ] TAP: Loaded 52874 existing records. [2025-09-24T21:32:17.864939] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:17.866000] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-24T21:32:17.866376] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-24T21:32:17.868971] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-24T21:32:17.869313] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-24T21:32:18.262409] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:18.424466] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-24T21:32:18.488690] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-24T21:32:18.488941] [INFO ] [MAIN ] T: Full history saved. [2025-09-24T21:32:18.489083] [INFO ] [MAIN ] Update Progress: 2048/2373 symbols completed. T took 40.7s. Estimated remaining: 43m 12s. Rate: 7.5 symbols/min [2025-09-24T21:32:18.667511] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:18.696829] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T21:32:18.715530] [DEBUG] [LOCAL ] TBB: Loaded 11701 existing records from primary storage. [2025-09-24T21:32:18.715702] [INFO ] [MAIN ] TBB: Loaded 11701 existing records. [2025-09-24T21:32:18.904191] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:18.904506] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-24T21:32:18.904567] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-24T21:32:18.905077] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-24T21:32:18.905140] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-24T21:32:19.222480] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-24T21:32:19.283222] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:19.310990] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T21:32:20.016055] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-24T21:32:20.175549] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:32:20.816052] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-24T21:32:21.041254] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-24T21:32:21.055723] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:32:21.616104] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-24T21:32:22.416057] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-24T21:32:22.452482] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:32:23.216066] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-24T21:32:23.306324] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T21:32:23.404762] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:32:24.016111] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-24T21:32:24.694903] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T21:32:24.816101] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-24T21:32:25.170679] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T21:32:25.588341] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T21:32:25.616054] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-24T21:32:26.416088] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-24T21:32:26.512779] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T21:32:27.216126] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-24T21:32:28.016063] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-24T21:32:28.075693] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T21:32:28.816048] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-24T21:32:28.905158] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:32:28.915581] [INFO ] [REMOTE ] TAL: Full fetch complete (75690 records). [2025-09-24T21:32:28.915758] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-24T21:32:29.033804] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T21:32:29.355219] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-24T21:32:29.355327] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-24T21:32:29.356609] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-24T21:32:29.356697] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-24T21:32:29.358250] [DEBUG] [LOCAL ] TAL: Trimmed 75690 records to 52104 (keeping 200 days of data) [2025-09-24T21:32:29.616813] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-24T21:32:29.738149] [DEBUG] [LOCAL ] TAL: Primary data saved (52104 records). [2025-09-24T21:32:29.738571] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-24T21:32:29.738845] [INFO ] [MAIN ] Update Progress: 2049/2373 symbols completed. TAL took 30.5s. Estimated remaining: 43m 5s. Rate: 7.5 symbols/min [2025-09-24T21:32:29.929467] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:29.968905] [DEBUG] [LOCAL ] TBBB: Loaded 35773 existing records from primary storage. [2025-09-24T21:32:29.969066] [INFO ] [MAIN ] TBBB: Loaded 35773 existing records. [2025-09-24T21:32:30.171508] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:30.171933] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-24T21:32:30.171988] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-24T21:32:30.172905] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-24T21:32:30.172980] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-24T21:32:30.418244] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-24T21:32:30.607579] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:30.643142] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T21:32:31.216102] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-24T21:32:31.268300] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T21:32:31.448153] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T21:32:32.016117] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-24T21:32:32.816582] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-24T21:32:32.816286] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-24T21:32:32.931806] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T21:32:33.616097] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-24T21:32:34.197359] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T21:32:34.394955] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T21:32:34.416049] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-24T21:32:35.200318] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T21:32:35.202913] [INFO ] [REMOTE ] TBB: Full fetch complete (17982 records). [2025-09-24T21:32:35.202998] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-24T21:32:35.224272] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-24T21:32:35.596871] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-24T21:32:35.596986] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-24T21:32:35.597487] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-24T21:32:35.597529] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-24T21:32:35.598229] [DEBUG] [LOCAL ] TBB: Trimmed 17982 records to 11717 (keeping 200 days of data) [2025-09-24T21:32:35.682452] [DEBUG] [LOCAL ] TBB: Primary data saved (11717 records). [2025-09-24T21:32:35.682623] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-24T21:32:35.682793] [INFO ] [MAIN ] Update Progress: 2050/2373 symbols completed. TBB took 17.2s. Estimated remaining: 42m 56s. Rate: 7.5 symbols/min [2025-09-24T21:32:35.867841] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:35.891008] [DEBUG] [LOCAL ] TBI: Loaded 22596 existing records from primary storage. [2025-09-24T21:32:35.891161] [INFO ] [MAIN ] TBI: Loaded 22596 existing records. [2025-09-24T21:32:36.022936] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-24T21:32:36.099329] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:36.099773] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-24T21:32:36.099872] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-24T21:32:36.100558] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-24T21:32:36.100634] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-24T21:32:36.471809] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:36.816077] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-24T21:32:36.898093] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T21:32:37.616065] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-24T21:32:37.780504] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T21:32:37.835833] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T21:32:38.416096] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-24T21:32:39.217085] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-24T21:32:39.217010] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T21:32:39.998360] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:32:40.016025] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-24T21:32:40.392581] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T21:32:40.816113] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-24T21:32:41.616126] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-24T21:32:41.846243] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:32:42.416065] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-24T21:32:42.496183] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T21:32:42.562109] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T21:32:43.216109] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-24T21:32:44.016145] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-24T21:32:44.172862] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T21:32:44.182160] [INFO ] [REMOTE ] TALO: Full fetch complete (73276 records). [2025-09-24T21:32:44.182322] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-24T21:32:44.544021] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T21:32:44.660620] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-24T21:32:44.660737] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-24T21:32:44.662122] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-24T21:32:44.662215] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-24T21:32:44.663972] [DEBUG] [LOCAL ] TALO: Trimmed 73276 records to 50834 (keeping 200 days of data) [2025-09-24T21:32:44.842814] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-24T21:32:44.986614] [DEBUG] [LOCAL ] TALO: Primary data saved (50834 records). [2025-09-24T21:32:44.986809] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-24T21:32:44.986981] [INFO ] [MAIN ] Update Progress: 2051/2373 symbols completed. TALO took 36.0s. Estimated remaining: 42m 49s. Rate: 7.5 symbols/min [2025-09-24T21:32:45.110205] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T21:32:45.187600] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:45.187808] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-24T21:32:45.187851] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-24T21:32:45.187997] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-24T21:32:45.188040] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-24T21:32:45.188081] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-24T21:32:45.188123] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-24T21:32:45.572574] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:45.616038] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-24T21:32:46.022450] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-24T21:32:46.238384] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T21:32:46.416108] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-24T21:32:46.813480] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-24T21:32:47.216081] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-24T21:32:48.016160] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-24T21:32:48.231724] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:32:48.352842] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-24T21:32:48.816137] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-24T21:32:49.616112] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-24T21:32:49.673400] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-24T21:32:50.416112] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-24T21:32:50.791288] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-24T21:32:51.216085] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-24T21:32:51.925083] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T21:32:51.939052] [INFO ] [REMOTE ] TAP: Full fetch complete (76142 records). [2025-09-24T21:32:51.939224] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-24T21:32:52.021225] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-24T21:32:52.388521] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-24T21:32:52.388687] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-24T21:32:52.390089] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-24T21:32:52.390259] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-24T21:32:52.392060] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T21:32:52.399296] [DEBUG] [LOCAL ] TAP: Trimmed 76142 records to 52874 (keeping 200 days of data) [2025-09-24T21:32:52.764358] [DEBUG] [LOCAL ] TAP: Primary data saved (52874 records). [2025-09-24T21:32:52.764584] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-24T21:32:52.764782] [INFO ] [MAIN ] Update Progress: 2052/2373 symbols completed. TAP took 35.8s. Estimated remaining: 42m 41s. Rate: 7.5 symbols/min [2025-09-24T21:32:52.821337] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-24T21:32:52.958623] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:32:52.965754] [DEBUG] [LOCAL ] TBN: Loaded 2967 existing records from primary storage. [2025-09-24T21:32:52.965866] [INFO ] [MAIN ] TBN: Loaded 2967 existing records. [2025-09-24T21:32:53.155689] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:32:53.156034] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-24T21:32:53.156089] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-24T21:32:53.156423] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-24T21:32:53.156484] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-24T21:32:53.529786] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:32:53.556432] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T21:32:53.616069] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-24T21:32:53.835195] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T21:32:54.416091] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-24T21:32:55.076211] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T21:32:55.216076] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-24T21:32:55.585701] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T21:32:56.016076] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-24T21:32:56.478770] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-24T21:32:56.576754] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-24T21:32:56.816125] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-24T21:32:57.400604] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T21:32:57.616105] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-24T21:32:57.950943] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-24T21:32:58.416133] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-24T21:32:58.744128] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-24T21:32:59.216113] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-24T21:33:00.016258] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-24T21:33:00.368975] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-24T21:33:00.632511] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:33:00.816134] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-24T21:33:01.616090] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-24T21:33:02.416064] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-24T21:33:02.578559] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:33:03.201881] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T21:33:03.216054] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-24T21:33:04.016098] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-24T21:33:04.200487] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T21:33:04.782972] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-24T21:33:04.816059] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-24T21:33:05.529773] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T21:33:05.616121] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-24T21:33:05.939372] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T21:33:05.945598] [INFO ] [REMOTE ] TBI: Full fetch complete (31760 records). [2025-09-24T21:33:05.945770] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-24T21:33:06.038595] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T21:33:06.387421] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-24T21:33:06.387618] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-24T21:33:06.388627] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-24T21:33:06.388716] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-24T21:33:06.391001] [DEBUG] [LOCAL ] TBI: Trimmed 31760 records to 22593 (keeping 200 days of data) [2025-09-24T21:33:06.452670] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-24T21:33:06.549587] [DEBUG] [LOCAL ] TBI: Primary data saved (22593 records). [2025-09-24T21:33:06.549803] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-24T21:33:06.549994] [INFO ] [MAIN ] Update Progress: 2053/2373 symbols completed. TBI took 30.9s. Estimated remaining: 42m 34s. Rate: 7.5 symbols/min [2025-09-24T21:33:06.734906] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:06.735137] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-24T21:33:06.735195] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-24T21:33:06.735413] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-24T21:33:06.735476] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-24T21:33:06.735545] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-24T21:33:06.735595] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-24T21:33:06.916490] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T21:33:07.137294] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:07.216093] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-24T21:33:07.509220] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:07.509750] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-24T21:33:08.016113] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-24T21:33:08.419701] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-24T21:33:08.816125] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-24T21:33:09.032360] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:09.032917] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-24T21:33:09.616141] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-24T21:33:09.895830] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:09.896325] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-24T21:33:10.416136] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-24T21:33:10.608634] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:10.609095] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-24T21:33:11.216129] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-24T21:33:11.418350] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:11.418843] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-24T21:33:12.016110] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-24T21:33:12.214189] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:12.214636] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-24T21:33:12.816142] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-24T21:33:13.181461] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-24T21:33:13.616158] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-24T21:33:13.814990] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:13.815352] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-24T21:33:14.416085] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-24T21:33:15.216084] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-24T21:33:16.016143] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-24T21:33:16.205385] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:33:16.205774] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-24T21:33:16.689694] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-24T21:33:16.696794] [INFO ] [REMOTE ] TBBB: Full fetch complete (51245 records). [2025-09-24T21:33:16.696991] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-24T21:33:16.748230] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-24T21:33:16.821286] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-24T21:33:17.122135] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-24T21:33:17.122252] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-24T21:33:17.123451] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-24T21:33:17.123519] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-24T21:33:17.124833] [DEBUG] [LOCAL ] TBBB: Trimmed 51245 records to 35683 (keeping 200 days of data) [2025-09-24T21:33:17.336620] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T21:33:17.338705] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-24T21:33:17.338804] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-24T21:33:17.549628] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T21:33:17.551294] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:33:17.552469] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:33:17.553320] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-24T21:33:17.553451] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-24T21:33:17.553957] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-24T21:33:17.554732] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-24T21:33:17.555204] [INFO ] [MAIN ] Update Progress: 2054/2373 symbols completed. TBLU took 32.6s. Estimated remaining: 42m 26s. Rate: 7.5 symbols/min [2025-09-24T21:33:17.621736] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-24T21:33:17.732382] [DEBUG] [LOCAL ] TBBB: Primary data saved (35683 records). [2025-09-24T21:33:17.754278] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:17.755362] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-24T21:33:17.756493] [INFO ] [MAIN ] Update Progress: 2055/2373 symbols completed. TBBB took 48.0s. Estimated remaining: 42m 17s. Rate: 7.5 symbols/min [2025-09-24T21:33:17.940425] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:17.987540] [DEBUG] [LOCAL ] TD: Loaded 52271 existing records from primary storage. [2025-09-24T21:33:17.987821] [INFO ] [MAIN ] TD: Loaded 52271 existing records. [2025-09-24T21:33:18.223307] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:18.229708] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-24T21:33:18.224926] [DEBUG] [LOCAL ] TDC: Loaded 46900 existing records from primary storage. [2025-09-24T21:33:18.229970] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T21:33:18.230090] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-24T21:33:18.232239] [INFO ] [MAIN ] TDC: Loaded 46900 existing records. [2025-09-24T21:33:18.264726] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-24T21:33:18.301470] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-24T21:33:18.420528] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-24T21:33:18.610572] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:18.664494] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-24T21:33:18.712246] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-24T21:33:18.763816] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-24T21:33:18.775413] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-24T21:33:19.121875] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:19.143344] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T21:33:19.166601] [INFO ] [REMOTE ] TCAI: Full fetch complete (995 records). [2025-09-24T21:33:19.178466] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-24T21:33:19.231596] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-24T21:33:19.572357] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-24T21:33:19.591399] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:19.591479] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:33:19.591878] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:33:19.591959] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-24T21:33:19.592025] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-24T21:33:19.592062] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-24T21:33:19.592117] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-24T21:33:19.592200] [INFO ] [MAIN ] Update Progress: 2056/2373 symbols completed. TCAI took 13.0s. Estimated remaining: 42m 8s. Rate: 7.5 symbols/min [2025-09-24T21:33:19.763750] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:19.774903] [DEBUG] [LOCAL ] TDF: Loaded 6459 existing records from primary storage. [2025-09-24T21:33:19.775040] [INFO ] [MAIN ] TDF: Loaded 6459 existing records. [2025-09-24T21:33:19.889188] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T21:33:19.959830] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:19.960109] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-24T21:33:19.960159] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-24T21:33:19.960580] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-24T21:33:19.960669] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-24T21:33:20.021324] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-24T21:33:20.320635] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:20.816095] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-24T21:33:21.441065] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T21:33:21.616140] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-24T21:33:22.421800] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-24T21:33:22.442883] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T21:33:22.840902] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T21:33:23.130798] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:33:23.216034] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-24T21:33:24.016084] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-24T21:33:24.638317] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T21:33:24.816056] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-24T21:33:24.862886] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T21:33:25.408509] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T21:33:25.616078] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-24T21:33:26.416084] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-24T21:33:27.077274] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T21:33:27.078972] [INFO ] [REMOTE ] TBN: Full fetch complete (4812 records). [2025-09-24T21:33:27.079045] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-24T21:33:27.229063] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-24T21:33:27.505668] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-24T21:33:27.505861] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-24T21:33:27.506213] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-24T21:33:27.506289] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-24T21:33:27.508344] [DEBUG] [LOCAL ] TBN: Trimmed 4812 records to 2982 (keeping 200 days of data) [2025-09-24T21:33:27.512225] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T21:33:27.541411] [DEBUG] [LOCAL ] TBN: Primary data saved (2982 records). [2025-09-24T21:33:27.541586] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-24T21:33:27.541712] [INFO ] [MAIN ] Update Progress: 2057/2373 symbols completed. TBN took 34.8s. Estimated remaining: 41m 60s. Rate: 7.5 symbols/min [2025-09-24T21:33:27.718934] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:27.746843] [DEBUG] [LOCAL ] TDG: Loaded 22145 existing records from primary storage. [2025-09-24T21:33:27.747008] [INFO ] [MAIN ] TDG: Loaded 22145 existing records. [2025-09-24T21:33:27.943757] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:27.944013] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-24T21:33:27.944063] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-24T21:33:27.944850] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-24T21:33:27.944912] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-24T21:33:28.020201] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-24T21:33:28.069597] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T21:33:28.324724] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:28.816091] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-24T21:33:29.555850] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T21:33:29.616160] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-24T21:33:30.053559] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-24T21:33:30.416138] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-24T21:33:31.154551] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T21:33:31.216060] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-24T21:33:32.016139] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-24T21:33:32.124920] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T21:33:32.597734] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T21:33:32.816072] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-24T21:33:33.121951] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T21:33:33.616135] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-24T21:33:34.149362] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-24T21:33:34.416098] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-24T21:33:34.540736] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-24T21:33:35.216145] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-24T21:33:35.862455] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:33:36.016048] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-24T21:33:36.049446] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T21:33:36.816147] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-24T21:33:37.360101] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T21:33:37.388793] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:33:37.616068] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-24T21:33:38.416091] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-24T21:33:39.210451] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:33:39.220041] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-24T21:33:39.939217] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T21:33:40.027378] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-24T21:33:40.040754] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T21:33:40.816168] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-24T21:33:41.616078] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-24T21:33:41.715999] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T21:33:42.380602] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-24T21:33:42.416075] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-24T21:33:42.580508] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T21:33:43.216094] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-24T21:33:44.016216] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-24T21:33:44.168236] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:33:44.176508] [INFO ] [REMOTE ] TDC: Full fetch complete (66743 records). [2025-09-24T21:33:44.176632] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-24T21:33:44.560052] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-24T21:33:44.560154] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-24T21:33:44.561358] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-24T21:33:44.561421] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-24T21:33:44.562811] [DEBUG] [LOCAL ] TDC: Trimmed 66743 records to 46847 (keeping 200 days of data) [2025-09-24T21:33:44.803814] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:33:44.816596] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-24T21:33:44.893608] [DEBUG] [LOCAL ] TDC: Primary data saved (46847 records). [2025-09-24T21:33:44.893787] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-24T21:33:44.893935] [INFO ] [MAIN ] Update Progress: 2058/2373 symbols completed. TDC took 27.1s. Estimated remaining: 41m 53s. Rate: 7.5 symbols/min [2025-09-24T21:33:45.062587] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:45.117886] [DEBUG] [LOCAL ] TDOC: Loaded 53347 existing records from primary storage. [2025-09-24T21:33:45.118047] [INFO ] [MAIN ] TDOC: Loaded 53347 existing records. [2025-09-24T21:33:45.300900] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:45.301433] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-24T21:33:45.301558] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-24T21:33:45.302871] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-24T21:33:45.302932] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-24T21:33:45.422839] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T21:33:45.616148] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-24T21:33:45.621297] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T21:33:45.708773] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:46.416082] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-24T21:33:46.825103] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T21:33:47.216091] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-24T21:33:47.806957] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T21:33:48.016084] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-24T21:33:48.699101] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-24T21:33:48.816062] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-24T21:33:49.035595] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T21:33:49.194233] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-24T21:33:49.616096] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-24T21:33:50.416056] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-24T21:33:50.672113] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T21:33:51.053104] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T21:33:51.216095] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-24T21:33:52.016083] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-24T21:33:52.259022] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T21:33:52.533639] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-24T21:33:52.535704] [INFO ] [REMOTE ] TDF: Full fetch complete (10688 records). [2025-09-24T21:33:52.535777] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-24T21:33:52.820481] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-24T21:33:52.905589] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-24T21:33:52.905698] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-24T21:33:52.906082] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-24T21:33:52.906143] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-24T21:33:52.906670] [DEBUG] [LOCAL ] TDF: Trimmed 10688 records to 6502 (keeping 200 days of data) [2025-09-24T21:33:52.946832] [DEBUG] [LOCAL ] TDF: Primary data saved (6502 records). [2025-09-24T21:33:52.946975] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-24T21:33:52.947065] [INFO ] [MAIN ] Update Progress: 2059/2373 symbols completed. TDF took 33.4s. Estimated remaining: 41m 45s. Rate: 7.5 symbols/min [2025-09-24T21:33:53.121031] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:53.164948] [DEBUG] [LOCAL ] TDS: Loaded 42808 existing records from primary storage. [2025-09-24T21:33:53.165120] [INFO ] [MAIN ] TDS: Loaded 42808 existing records. [2025-09-24T21:33:53.345809] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:53.346132] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-24T21:33:53.346192] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-24T21:33:53.347306] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-24T21:33:53.347368] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-24T21:33:53.623749] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-24T21:33:53.709224] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:54.084290] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T21:33:54.089180] [INFO ] [REMOTE ] TDG: Full fetch complete (32223 records). [2025-09-24T21:33:54.089294] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-24T21:33:54.421174] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-24T21:33:54.470592] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-24T21:33:54.470764] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-24T21:33:54.471603] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-24T21:33:54.471680] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-24T21:33:54.472602] [DEBUG] [LOCAL ] TDG: Trimmed 32223 records to 22048 (keeping 200 days of data) [2025-09-24T21:33:54.618227] [DEBUG] [LOCAL ] TDG: Primary data saved (22048 records). [2025-09-24T21:33:54.618371] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-24T21:33:54.618463] [INFO ] [MAIN ] Update Progress: 2060/2373 symbols completed. TDG took 27.1s. Estimated remaining: 41m 37s. Rate: 7.5 symbols/min [2025-09-24T21:33:54.794920] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:33:54.844367] [DEBUG] [LOCAL ] TDW: Loaded 45501 existing records from primary storage. [2025-09-24T21:33:54.844539] [INFO ] [MAIN ] TDW: Loaded 45501 existing records. [2025-09-24T21:33:55.026252] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:33:55.026543] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-24T21:33:55.026593] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-24T21:33:55.027811] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-24T21:33:55.027875] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-24T21:33:55.219483] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-24T21:33:55.411253] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:33:55.457620] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:33:56.016140] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-24T21:33:56.578974] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-24T21:33:56.818160] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-24T21:33:56.821783] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T21:33:57.608415] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T21:33:57.618272] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-24T21:33:58.416131] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-24T21:33:58.918584] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-24T21:33:59.110031] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-24T21:33:59.216131] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-24T21:33:59.847006] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T21:33:59.857744] [INFO ] [REMOTE ] TD: Full fetch complete (75795 records). [2025-09-24T21:33:59.858023] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-24T21:34:00.021335] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-24T21:34:00.312262] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-24T21:34:00.312407] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-24T21:34:00.313720] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-24T21:34:00.313796] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-24T21:34:00.316362] [DEBUG] [LOCAL ] TD: Trimmed 75795 records to 52269 (keeping 200 days of data) [2025-09-24T21:34:00.678114] [DEBUG] [LOCAL ] TD: Primary data saved (52269 records). [2025-09-24T21:34:00.678351] [INFO ] [MAIN ] TD: Full history saved. [2025-09-24T21:34:00.678471] [INFO ] [MAIN ] Update Progress: 2061/2373 symbols completed. TD took 43.1s. Estimated remaining: 41m 28s. Rate: 7.5 symbols/min [2025-09-24T21:34:00.830978] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-24T21:34:00.868593] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:00.896518] [DEBUG] [LOCAL ] TDY: Loaded 22718 existing records from primary storage. [2025-09-24T21:34:00.896795] [INFO ] [MAIN ] TDY: Loaded 22718 existing records. [2025-09-24T21:34:01.094820] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:01.095556] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-24T21:34:01.095629] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-24T21:34:01.096695] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-24T21:34:01.096767] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-24T21:34:01.320570] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T21:34:01.576898] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:01.616126] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-24T21:34:02.188959] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-24T21:34:02.421229] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-24T21:34:02.433363] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:34:02.804128] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-24T21:34:03.216128] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-24T21:34:03.850401] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T21:34:04.016118] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-24T21:34:04.816280] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-24T21:34:04.819551] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:34:05.616087] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-24T21:34:05.881439] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-24T21:34:06.041069] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T21:34:06.416189] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-24T21:34:07.216156] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-24T21:34:07.496902] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T21:34:07.696783] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T21:34:08.016099] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-24T21:34:08.816076] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-24T21:34:08.863223] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T21:34:09.616201] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-24T21:34:10.062358] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T21:34:10.098567] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-24T21:34:10.416158] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-24T21:34:10.961021] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:34:11.216105] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-24T21:34:12.016106] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-24T21:34:12.249516] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T21:34:12.414239] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T21:34:12.816154] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-24T21:34:13.616218] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-24T21:34:14.416182] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-24T21:34:15.038197] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T21:34:15.114379] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T21:34:15.216088] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-24T21:34:15.540749] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T21:34:16.016116] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-24T21:34:16.816214] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-24T21:34:17.144073] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (5.13 seconds). [2025-09-24T21:34:17.178120] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T21:34:17.404431] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-24T21:34:17.616136] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-24T21:34:18.086230] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T21:34:18.416103] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-24T21:34:19.216185] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-24T21:34:19.267612] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:34:20.016155] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-24T21:34:20.119127] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T21:34:20.171249] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T21:34:20.816140] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-24T21:34:21.621282] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-24T21:34:21.632922] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T21:34:21.967135] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:34:22.416088] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-24T21:34:23.216193] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-24T21:34:23.563842] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T21:34:23.573967] [INFO ] [REMOTE ] TDOC: Full fetch complete (77272 records). [2025-09-24T21:34:23.574193] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-24T21:34:24.005294] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-24T21:34:24.005515] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-24T21:34:24.007127] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-24T21:34:24.007321] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-24T21:34:24.010036] [DEBUG] [LOCAL ] TDOC: Trimmed 77272 records to 53345 (keeping 200 days of data) [2025-09-24T21:34:24.020951] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-24T21:34:24.047357] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T21:34:24.401984] [DEBUG] [LOCAL ] TDOC: Primary data saved (53345 records). [2025-09-24T21:34:24.402219] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-24T21:34:24.402332] [INFO ] [MAIN ] Update Progress: 2062/2373 symbols completed. TDOC took 39.5s. Estimated remaining: 41m 23s. Rate: 7.5 symbols/min [2025-09-24T21:34:24.594313] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:24.594697] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-24T21:34:24.594843] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-24T21:34:24.595010] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-24T21:34:24.595055] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-24T21:34:24.595099] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-24T21:34:24.595133] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-24T21:34:24.825598] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-24T21:34:24.969214] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T21:34:25.045586] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:25.121354] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T21:34:25.125142] [INFO ] [REMOTE ] TDY: Full fetch complete (32361 records). [2025-09-24T21:34:25.125287] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-24T21:34:25.490763] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-24T21:34:25.490856] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-24T21:34:25.491684] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-24T21:34:25.491749] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-24T21:34:25.492568] [DEBUG] [LOCAL ] TDY: Trimmed 32361 records to 22668 (keeping 200 days of data) [2025-09-24T21:34:25.618575] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-24T21:34:25.635366] [DEBUG] [LOCAL ] TDY: Primary data saved (22668 records). [2025-09-24T21:34:25.635446] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-24T21:34:25.635552] [INFO ] [MAIN ] Update Progress: 2063/2373 symbols completed. TDY took 25.0s. Estimated remaining: 41m 14s. Rate: 7.5 symbols/min [2025-09-24T21:34:25.806175] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:25.817217] [DEBUG] [LOCAL ] TEAF: Loaded 7325 existing records from primary storage. [2025-09-24T21:34:25.817367] [INFO ] [MAIN ] TEAF: Loaded 7325 existing records. [2025-09-24T21:34:25.920495] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:34:25.923935] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-24T21:34:26.011991] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:26.012388] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-24T21:34:26.012451] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-24T21:34:26.012939] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-24T21:34:26.013004] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-24T21:34:26.408944] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:26.416065] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-24T21:34:26.585077] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-24T21:34:26.592950] [INFO ] [REMOTE ] TDS: Full fetch complete (61494 records). [2025-09-24T21:34:26.593129] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-24T21:34:27.034678] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-24T21:34:27.034861] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-24T21:34:27.036529] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-24T21:34:27.036607] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-24T21:34:27.038285] [DEBUG] [LOCAL ] TDS: Trimmed 61494 records to 42796 (keeping 200 days of data) [2025-09-24T21:34:27.236117] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-24T21:34:27.329586] [DEBUG] [LOCAL ] TDS: Primary data saved (42796 records). [2025-09-24T21:34:27.329768] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-24T21:34:27.329883] [INFO ] [MAIN ] Update Progress: 2064/2373 symbols completed. TDS took 34.4s. Estimated remaining: 41m 5s. Rate: 7.5 symbols/min [2025-09-24T21:34:27.483867] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:34:27.495071] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-24T21:34:27.507322] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:27.563135] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-24T21:34:27.563306] [INFO ] [MAIN ] TECK: Loaded 53436 existing records. [2025-09-24T21:34:27.749810] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:27.750262] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-24T21:34:27.750378] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-24T21:34:27.752535] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-24T21:34:27.752603] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-24T21:34:28.038316] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-24T21:34:28.066600] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T21:34:28.101285] [INFO ] [REMOTE ] TDW: Full fetch complete (67187 records). [2025-09-24T21:34:28.135328] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-24T21:34:28.163726] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:28.325440] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:34:28.353043] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-24T21:34:28.585930] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-24T21:34:28.586037] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-24T21:34:28.587305] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-24T21:34:28.587373] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-24T21:34:28.588901] [DEBUG] [LOCAL ] TDW: Trimmed 67187 records to 45409 (keeping 200 days of data) [2025-09-24T21:34:28.816390] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-24T21:34:28.868762] [DEBUG] [LOCAL ] TDW: Primary data saved (45409 records). [2025-09-24T21:34:28.868903] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-24T21:34:28.869040] [INFO ] [MAIN ] Update Progress: 2065/2373 symbols completed. TDW took 34.3s. Estimated remaining: 40m 56s. Rate: 7.5 symbols/min [2025-09-24T21:34:29.038354] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:29.074548] [DEBUG] [LOCAL ] TEF: Loaded 37382 existing records from primary storage. [2025-09-24T21:34:29.074718] [INFO ] [MAIN ] TEF: Loaded 37382 existing records. [2025-09-24T21:34:29.253132] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:29.253480] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-24T21:34:29.253534] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-24T21:34:29.255020] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-24T21:34:29.255082] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-24T21:34:29.618729] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:29.618805] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-24T21:34:30.416096] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-24T21:34:30.557374] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T21:34:30.815946] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T21:34:31.216087] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-24T21:34:31.870548] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T21:34:32.016088] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-24T21:34:32.618329] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-24T21:34:32.806455] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T21:34:32.816923] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-24T21:34:33.616091] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-24T21:34:34.279574] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T21:34:34.423461] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-24T21:34:34.460905] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:34:35.216085] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-24T21:34:36.016063] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-24T21:34:36.048828] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T21:34:36.665930] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T21:34:36.816035] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-24T21:34:37.616094] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-24T21:34:37.712635] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:34:38.362446] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:34:38.416037] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-24T21:34:39.216059] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-24T21:34:39.317318] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T21:34:39.751529] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-24T21:34:39.958523] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T21:34:40.016095] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-24T21:34:40.816100] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-24T21:34:41.294307] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T21:34:41.616098] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-24T21:34:42.416102] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-24T21:34:42.771395] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T21:34:42.981246] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-24T21:34:43.151940] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T21:34:43.216107] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-24T21:34:44.016130] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-24T21:34:44.622428] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T21:34:44.816096] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-24T21:34:45.621285] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-24T21:34:45.650065] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T21:34:46.416090] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-24T21:34:46.781322] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:34:46.816155] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:34:47.216093] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-24T21:34:47.734089] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T21:34:48.016096] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-24T21:34:48.794606] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T21:34:48.816058] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-24T21:34:48.975225] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:34:49.413562] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-24T21:34:49.616099] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-24T21:34:50.416099] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-24T21:34:51.029824] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T21:34:51.036637] [INFO ] [REMOTE ] TEF: Full fetch complete (54530 records). [2025-09-24T21:34:51.036821] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-24T21:34:51.165480] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T21:34:51.221145] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-24T21:34:51.487440] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-24T21:34:51.487775] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-24T21:34:51.489023] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-24T21:34:51.489126] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-24T21:34:51.492500] [DEBUG] [LOCAL ] TEF: Trimmed 54530 records to 37326 (keeping 200 days of data) [2025-09-24T21:34:51.708389] [DEBUG] [LOCAL ] TEF: Primary data saved (37326 records). [2025-09-24T21:34:51.708556] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-24T21:34:51.708719] [INFO ] [MAIN ] Update Progress: 2066/2373 symbols completed. TEF took 22.8s. Estimated remaining: 40m 50s. Rate: 7.5 symbols/min [2025-09-24T21:34:51.877933] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:51.904882] [DEBUG] [LOCAL ] TEI: Loaded 20409 existing records from primary storage. [2025-09-24T21:34:51.905136] [INFO ] [MAIN ] TEI: Loaded 20409 existing records. [2025-09-24T21:34:52.021296] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-24T21:34:52.091368] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:52.091763] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-24T21:34:52.091872] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-24T21:34:52.092516] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-24T21:34:52.092587] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-24T21:34:52.446094] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:52.816129] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-24T21:34:52.941241] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T21:34:53.441469] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:34:53.616078] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-24T21:34:53.785109] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-24T21:34:54.416120] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-24T21:34:55.187069] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T21:34:55.216046] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-24T21:34:55.351620] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T21:34:55.736849] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T21:34:56.016138] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-24T21:34:56.679024] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T21:34:56.680886] [INFO ] [REMOTE ] TEAF: Full fetch complete (9863 records). [2025-09-24T21:34:56.680959] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-24T21:34:56.821175] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-24T21:34:57.080598] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-24T21:34:57.080715] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-24T21:34:57.081022] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-24T21:34:57.081065] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-24T21:34:57.081511] [DEBUG] [LOCAL ] TEAF: Trimmed 9863 records to 7370 (keeping 200 days of data) [2025-09-24T21:34:57.130352] [DEBUG] [LOCAL ] TEAF: Primary data saved (7370 records). [2025-09-24T21:34:57.130490] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-24T21:34:57.130604] [INFO ] [MAIN ] Update Progress: 2067/2373 symbols completed. TEAF took 31.5s. Estimated remaining: 40m 42s. Rate: 7.5 symbols/min [2025-09-24T21:34:57.320570] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:34:57.397334] [DEBUG] [LOCAL ] TEL: Loaded 51153 existing records from primary storage. [2025-09-24T21:34:57.397559] [INFO ] [MAIN ] TEL: Loaded 51153 existing records. [2025-09-24T21:34:57.592724] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:34:57.593087] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-24T21:34:57.593150] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-24T21:34:57.594407] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-24T21:34:57.594486] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-24T21:34:57.627038] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-24T21:34:57.997941] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:34:58.416071] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-24T21:34:58.694005] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T21:34:58.833844] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-24T21:34:59.216082] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-24T21:35:00.016127] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-24T21:35:00.071235] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:35:00.117440] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T21:35:00.816146] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-24T21:35:01.616067] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-24T21:35:01.957259] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T21:35:01.967336] [INFO ] [REMOTE ] TECK: Full fetch complete (77303 records). [2025-09-24T21:35:01.967548] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-24T21:35:02.426165] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-24T21:35:02.457037] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-24T21:35:02.457269] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-24T21:35:02.459826] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-24T21:35:02.460099] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-24T21:35:02.466440] [DEBUG] [LOCAL ] TECK: Trimmed 77303 records to 53436 (keeping 200 days of data) [2025-09-24T21:35:02.619014] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T21:35:02.631403] [INFO ] [REMOTE ] TE: Full fetch complete (46669 records). [2025-09-24T21:35:02.632198] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-24T21:35:02.874396] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-24T21:35:02.876361] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:35:02.878921] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:35:02.882232] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-24T21:35:02.884838] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-24T21:35:02.889901] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-24T21:35:02.892961] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-24T21:35:02.894736] [INFO ] [MAIN ] Update Progress: 2068/2373 symbols completed. TE took 38.5s. Estimated remaining: 40m 33s. Rate: 7.5 symbols/min [2025-09-24T21:35:03.123818] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:03.300906] [DEBUG] [LOCAL ] TEN: Loaded 31081 existing records from primary storage. [2025-09-24T21:35:03.304091] [INFO ] [MAIN ] TEN: Loaded 31081 existing records. [2025-09-24T21:35:03.645506] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:03.647899] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-24T21:35:03.649171] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-24T21:35:03.649326] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-24T21:35:03.668671] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-24T21:35:03.674194] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-24T21:35:03.722916] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-24T21:35:03.793750] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-24T21:35:03.884112] [DEBUG] [LOCAL ] TECK: Primary data saved (53436 records). [2025-09-24T21:35:03.903908] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-24T21:35:03.910805] [INFO ] [MAIN ] Update Progress: 2069/2373 symbols completed. TECK took 36.6s. Estimated remaining: 40m 24s. Rate: 7.5 symbols/min [2025-09-24T21:35:04.029745] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-24T21:35:04.397428] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:04.420625] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:04.451711] [DEBUG] [LOCAL ] TEO: Loaded 21923 existing records from primary storage. [2025-09-24T21:35:04.451911] [INFO ] [MAIN ] TEO: Loaded 21923 existing records. [2025-09-24T21:35:04.650710] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:04.652124] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-24T21:35:04.652238] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-24T21:35:04.653607] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-24T21:35:04.653725] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-24T21:35:04.818063] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-24T21:35:04.978990] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-24T21:35:05.057143] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:05.616130] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-24T21:35:05.926060] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-24T21:35:06.190898] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-24T21:35:06.416120] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-24T21:35:06.682927] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T21:35:07.216163] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-24T21:35:07.541315] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T21:35:08.016117] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-24T21:35:08.487010] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T21:35:08.816144] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-24T21:35:09.582249] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T21:35:09.616072] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-24T21:35:10.000733] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T21:35:10.416146] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-24T21:35:11.216139] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-24T21:35:11.563812] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T21:35:11.689989] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-24T21:35:12.016053] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-24T21:35:12.248426] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T21:35:12.816086] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-24T21:35:13.394285] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T21:35:13.616097] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-24T21:35:14.315946] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T21:35:14.416054] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-24T21:35:14.650959] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-24T21:35:15.163001] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-24T21:35:15.216071] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-24T21:35:16.016121] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-24T21:35:16.243562] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T21:35:16.816149] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-24T21:35:17.454784] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T21:35:17.616130] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-24T21:35:18.069440] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T21:35:18.416099] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-24T21:35:19.221253] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-24T21:35:19.245925] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T21:35:19.642387] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T21:35:20.016128] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-24T21:35:20.315980] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T21:35:20.320959] [INFO ] [REMOTE ] TEI: Full fetch complete (29937 records). [2025-09-24T21:35:20.321057] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-24T21:35:20.701109] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-24T21:35:20.701212] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-24T21:35:20.701976] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-24T21:35:20.702038] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-24T21:35:20.702831] [DEBUG] [LOCAL ] TEI: Trimmed 29937 records to 20526 (keeping 200 days of data) [2025-09-24T21:35:20.816268] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-24T21:35:20.844009] [DEBUG] [LOCAL ] TEI: Primary data saved (20526 records). [2025-09-24T21:35:20.844139] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-24T21:35:20.844263] [INFO ] [MAIN ] Update Progress: 2070/2373 symbols completed. TEI took 29.1s. Estimated remaining: 40m 18s. Rate: 7.5 symbols/min [2025-09-24T21:35:21.019846] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:21.088848] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-24T21:35:21.089017] [INFO ] [MAIN ] TEVA: Loaded 53633 existing records. [2025-09-24T21:35:21.291416] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:21.291726] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-24T21:35:21.291783] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-24T21:35:21.293320] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-24T21:35:21.293383] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-24T21:35:21.617835] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-24T21:35:21.661284] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:21.872134] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T21:35:21.919264] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T21:35:22.416112] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-24T21:35:22.959973] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T21:35:23.216142] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-24T21:35:24.016074] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-24T21:35:24.364425] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T21:35:24.816087] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-24T21:35:24.954633] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-24T21:35:24.993819] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T21:35:25.616096] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-24T21:35:26.416062] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-24T21:35:26.530921] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-24T21:35:26.754156] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-24T21:35:27.216100] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-24T21:35:28.016164] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-24T21:35:28.137211] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-24T21:35:28.146347] [INFO ] [REMOTE ] TEL: Full fetch complete (73309 records). [2025-09-24T21:35:28.146525] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-24T21:35:28.538611] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-24T21:35:28.538748] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-24T21:35:28.540049] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-24T21:35:28.540117] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-24T21:35:28.541734] [DEBUG] [LOCAL ] TEL: Trimmed 73309 records to 51151 (keeping 200 days of data) [2025-09-24T21:35:28.816738] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-24T21:35:28.915380] [DEBUG] [LOCAL ] TEL: Primary data saved (51151 records). [2025-09-24T21:35:28.915560] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-24T21:35:28.915703] [INFO ] [MAIN ] Update Progress: 2071/2373 symbols completed. TEL took 31.8s. Estimated remaining: 40m 10s. Rate: 7.5 symbols/min [2025-09-24T21:35:29.110713] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T21:35:29.114309] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:29.162314] [DEBUG] [LOCAL ] TEX: Loaded 44678 existing records from primary storage. [2025-09-24T21:35:29.162483] [INFO ] [MAIN ] TEX: Loaded 44678 existing records. [2025-09-24T21:35:29.384617] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-24T21:35:29.384812] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:29.395387] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-24T21:35:29.395469] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-24T21:35:29.396827] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-24T21:35:29.396899] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-24T21:35:29.621360] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-24T21:35:29.764587] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:30.134561] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T21:35:30.416131] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-24T21:35:30.533135] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T21:35:31.216101] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-24T21:35:31.655931] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-24T21:35:31.662083] [INFO ] [REMOTE ] TEN: Full fetch complete (44816 records). [2025-09-24T21:35:31.662191] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-24T21:35:32.021140] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-24T21:35:32.097628] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-24T21:35:32.097775] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-24T21:35:32.099086] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-24T21:35:32.099156] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-24T21:35:32.100410] [DEBUG] [LOCAL ] TEN: Trimmed 44816 records to 31027 (keeping 200 days of data) [2025-09-24T21:35:32.309534] [DEBUG] [LOCAL ] TEN: Primary data saved (31027 records). [2025-09-24T21:35:32.309726] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-24T21:35:32.309884] [INFO ] [MAIN ] Update Progress: 2072/2373 symbols completed. TEN took 29.4s. Estimated remaining: 40m 1s. Rate: 7.5 symbols/min [2025-09-24T21:35:32.495097] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:32.555053] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-24T21:35:32.555269] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-24T21:35:32.736431] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:32.736736] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-24T21:35:32.736795] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-24T21:35:32.738052] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-24T21:35:32.738126] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-24T21:35:32.821203] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-24T21:35:33.089341] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T21:35:33.167277] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:33.242298] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-24T21:35:33.616091] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-24T21:35:34.401350] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T21:35:34.416021] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-24T21:35:35.216105] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-24T21:35:35.695910] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-24T21:35:35.777281] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:35:36.016093] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-24T21:35:36.816082] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-24T21:35:37.037674] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:35:37.616109] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-24T21:35:38.157880] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-24T21:35:38.240793] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T21:35:38.416124] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-24T21:35:39.071163] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T21:35:39.216203] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-24T21:35:39.218796] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T21:35:39.225230] [INFO ] [REMOTE ] TEO: Full fetch complete (32799 records). [2025-09-24T21:35:39.225333] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-24T21:35:39.715930] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-24T21:35:39.716037] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-24T21:35:39.717045] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-24T21:35:39.717111] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-24T21:35:39.718075] [DEBUG] [LOCAL ] TEO: Trimmed 32799 records to 21995 (keeping 200 days of data) [2025-09-24T21:35:39.858370] [DEBUG] [LOCAL ] TEO: Primary data saved (21995 records). [2025-09-24T21:35:39.858528] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-24T21:35:39.858631] [INFO ] [MAIN ] Update Progress: 2073/2373 symbols completed. TEO took 35.9s. Estimated remaining: 39m 53s. Rate: 7.5 symbols/min [2025-09-24T21:35:40.016129] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-24T21:35:40.035531] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:40.071276] [DEBUG] [LOCAL ] TFII: Loaded 34320 existing records from primary storage. [2025-09-24T21:35:40.071442] [INFO ] [MAIN ] TFII: Loaded 34320 existing records. [2025-09-24T21:35:40.254325] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:40.254614] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-24T21:35:40.254694] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-24T21:35:40.255561] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-24T21:35:40.255623] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-24T21:35:40.620432] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:40.816089] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-24T21:35:40.919552] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-24T21:35:41.616139] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-24T21:35:41.784887] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T21:35:41.986465] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-24T21:35:42.416078] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-24T21:35:43.130622] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:35:43.216090] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-24T21:35:43.442173] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-24T21:35:44.016089] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-24T21:35:44.816091] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-24T21:35:45.222633] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-24T21:35:45.616149] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-24T21:35:45.732631] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T21:35:45.805348] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T21:35:46.416101] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-24T21:35:47.216115] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-24T21:35:47.795384] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-24T21:35:48.020317] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-24T21:35:48.031231] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T21:35:48.411226] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T21:35:48.816128] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-24T21:35:49.616093] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-24T21:35:49.666325] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T21:35:50.316459] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T21:35:50.416080] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-24T21:35:51.216128] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-24T21:35:51.291897] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T21:35:52.016151] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-24T21:35:52.370489] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T21:35:52.449587] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T21:35:52.816144] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-24T21:35:53.616101] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-24T21:35:53.888127] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T21:35:54.164165] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:35:54.416106] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-24T21:35:55.216071] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-24T21:35:55.540857] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T21:35:55.699663] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T21:35:56.016093] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-24T21:35:56.816064] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-24T21:35:57.156935] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-24T21:35:57.166470] [INFO ] [REMOTE ] TEVA: Full fetch complete (77673 records). [2025-09-24T21:35:57.166635] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-24T21:35:57.504284] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:35:57.614182] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-24T21:35:57.614303] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-24T21:35:57.615693] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-24T21:35:57.615764] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-24T21:35:57.616081] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-24T21:35:57.618396] [DEBUG] [LOCAL ] TEVA: Trimmed 77673 records to 53633 (keeping 200 days of data) [2025-09-24T21:35:57.953441] [DEBUG] [LOCAL ] TEVA: Primary data saved (53633 records). [2025-09-24T21:35:57.953598] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-24T21:35:57.953721] [INFO ] [MAIN ] Update Progress: 2074/2373 symbols completed. TEVA took 37.1s. Estimated remaining: 39m 47s. Rate: 7.5 symbols/min [2025-09-24T21:35:58.127373] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:58.151135] [DEBUG] [LOCAL ] TFIN: Loaded 23634 existing records from primary storage. [2025-09-24T21:35:58.151315] [INFO ] [MAIN ] TFIN: Loaded 23634 existing records. [2025-09-24T21:35:58.339122] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:58.339402] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-24T21:35:58.339463] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-24T21:35:58.340183] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-24T21:35:58.340246] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-24T21:35:58.418472] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-24T21:35:58.719302] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:35:58.751623] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T21:35:58.777091] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T21:35:58.782456] [INFO ] [REMOTE ] TFII: Full fetch complete (47627 records). [2025-09-24T21:35:58.782556] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-24T21:35:59.197677] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-24T21:35:59.197792] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-24T21:35:59.198882] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-24T21:35:59.198949] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-24T21:35:59.200284] [DEBUG] [LOCAL ] TFII: Trimmed 47627 records to 34270 (keeping 200 days of data) [2025-09-24T21:35:59.254602] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-24T21:35:59.426134] [DEBUG] [LOCAL ] TFII: Primary data saved (34270 records). [2025-09-24T21:35:59.426295] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-24T21:35:59.426388] [INFO ] [MAIN ] Update Progress: 2075/2373 symbols completed. TFII took 19.6s. Estimated remaining: 39m 38s. Rate: 7.5 symbols/min [2025-09-24T21:35:59.605231] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:35:59.642437] [DEBUG] [LOCAL ] TFPM: Loaded 37335 existing records from primary storage. [2025-09-24T21:35:59.642606] [INFO ] [MAIN ] TFPM: Loaded 37335 existing records. [2025-09-24T21:35:59.835807] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:35:59.836551] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-24T21:35:59.836777] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-24T21:35:59.838749] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-24T21:35:59.838986] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-24T21:36:00.044632] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-24T21:36:00.258302] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:00.275200] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T21:36:00.295827] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T21:36:00.816101] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-24T21:36:01.616096] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-24T21:36:02.416151] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-24T21:36:02.468400] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T21:36:02.694734] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-24T21:36:03.216092] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-24T21:36:04.016108] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-24T21:36:04.517239] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-09-24T21:36:04.816105] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-24T21:36:05.349073] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-24T21:36:05.498366] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-24T21:36:05.505917] [INFO ] [REMOTE ] TEX: Full fetch complete (64804 records). [2025-09-24T21:36:05.506035] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-24T21:36:05.621260] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-24T21:36:05.930872] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-24T21:36:05.930532] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T21:36:05.936152] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-24T21:36:05.938157] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-24T21:36:05.938270] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-24T21:36:05.940280] [DEBUG] [LOCAL ] TEX: Trimmed 64804 records to 44627 (keeping 200 days of data) [2025-09-24T21:36:06.069437] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T21:36:06.274118] [DEBUG] [LOCAL ] TEX: Primary data saved (44627 records). [2025-09-24T21:36:06.274268] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-24T21:36:06.274385] [INFO ] [MAIN ] Update Progress: 2076/2373 symbols completed. TEX took 37.4s. Estimated remaining: 39m 30s. Rate: 7.5 symbols/min [2025-09-24T21:36:06.431483] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-24T21:36:06.464535] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:06.509120] [DEBUG] [LOCAL ] TFX: Loaded 37421 existing records from primary storage. [2025-09-24T21:36:06.509287] [INFO ] [MAIN ] TFX: Loaded 37421 existing records. [2025-09-24T21:36:06.689825] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:06.690115] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-24T21:36:06.690174] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-24T21:36:06.691125] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-24T21:36:06.691185] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-24T21:36:07.059725] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:07.079469] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T21:36:07.216099] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-24T21:36:07.408301] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T21:36:08.016160] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-24T21:36:08.525247] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T21:36:08.816096] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-24T21:36:09.270350] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T21:36:09.616099] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-24T21:36:10.382981] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:36:10.416035] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-24T21:36:10.998151] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T21:36:11.216084] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-24T21:36:12.016129] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-24T21:36:12.816066] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-24T21:36:12.935728] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-24T21:36:13.616111] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-24T21:36:13.751724] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T21:36:13.775402] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-24T21:36:14.408277] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T21:36:14.417012] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-24T21:36:14.418798] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-24T21:36:14.418894] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-24T21:36:14.823359] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-24T21:36:14.823454] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-24T21:36:14.824926] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-24T21:36:14.824994] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-24T21:36:14.826554] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-09-24T21:36:15.175483] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T21:36:15.210137] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-24T21:36:15.210283] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-24T21:36:15.210387] [INFO ] [MAIN ] Update Progress: 2077/2373 symbols completed. TFC took 42.9s. Estimated remaining: 39m 22s. Rate: 7.5 symbols/min [2025-09-24T21:36:15.216046] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-24T21:36:16.016106] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-24T21:36:16.112589] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:36:16.707426] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T21:36:16.816088] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-24T21:36:17.021855] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T21:36:17.616136] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-24T21:36:18.416118] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-24T21:36:18.647133] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-24T21:36:18.711003] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T21:36:19.216076] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-24T21:36:19.756465] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T21:36:20.016104] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-24T21:36:20.816102] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-24T21:36:20.862525] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T21:36:21.614431] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T21:36:21.621634] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-24T21:36:21.623854] [INFO ] [REMOTE ] TFPM: Full fetch complete (50481 records). [2025-09-24T21:36:21.624052] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-24T21:36:22.078076] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-24T21:36:22.079455] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-24T21:36:22.079361] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T21:36:22.080944] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-24T21:36:22.081102] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-24T21:36:22.087954] [DEBUG] [LOCAL ] TFPM: Trimmed 50481 records to 37385 (keeping 200 days of data) [2025-09-24T21:36:22.316954] [DEBUG] [LOCAL ] TFPM: Primary data saved (37385 records). [2025-09-24T21:36:22.317112] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-24T21:36:22.317206] [INFO ] [MAIN ] Update Progress: 2078/2373 symbols completed. TFPM took 22.9s. Estimated remaining: 39m 14s. Rate: 7.5 symbols/min [2025-09-24T21:36:22.416220] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-24T21:36:23.277111] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T21:36:23.286422] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-24T21:36:23.610496] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T21:36:23.614835] [INFO ] [REMOTE ] TFIN: Full fetch complete (30925 records). [2025-09-24T21:36:23.614925] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-24T21:36:23.988880] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-24T21:36:23.988966] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-24T21:36:23.989718] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-24T21:36:23.989789] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-24T21:36:23.990533] [DEBUG] [LOCAL ] TFIN: Trimmed 30925 records to 23600 (keeping 200 days of data) [2025-09-24T21:36:24.130816] [DEBUG] [LOCAL ] TFIN: Primary data saved (23600 records). [2025-09-24T21:36:24.130950] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-24T21:36:24.131033] [INFO ] [MAIN ] Update Progress: 2079/2373 symbols completed. TFIN took 26.2s. Estimated remaining: 39m 5s. Rate: 7.5 symbols/min [2025-09-24T21:36:24.391876] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T21:36:24.398997] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-24T21:36:25.786609] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T21:36:25.795106] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-24T21:36:26.890012] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T21:36:26.898005] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-24T21:36:28.462746] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T21:36:28.470145] [INFO ] [REMOTE ] TFX: Full fetch complete (54139 records). [2025-09-24T21:36:28.470263] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-24T21:36:28.874857] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-24T21:36:28.874996] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-24T21:36:28.876219] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-24T21:36:28.876285] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-24T21:36:28.879493] [DEBUG] [LOCAL ] TFX: Trimmed 54139 records to 37291 (keeping 200 days of data) [2025-09-24T21:36:29.113557] [DEBUG] [LOCAL ] TFX: Primary data saved (37291 records). [2025-09-24T21:36:29.113732] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-24T21:36:29.113831] [INFO ] [MAIN ] Update Progress: 2080/2373 symbols completed. TFX took 22.8s. Estimated remaining: 38m 56s. Rate: 7.5 symbols/min [2025-09-24T21:36:29.739058] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:29.794362] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:29.846602] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:29.847235] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-24T21:36:29.850710] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:29.851502] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-24T21:36:29.852226] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-24T21:36:29.852320] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-24T21:36:29.852428] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-24T21:36:29.853826] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-24T21:36:29.948053] [DEBUG] [LOCAL ] TG: Loaded 10498 existing records from primary storage. [2025-09-24T21:36:29.971179] [INFO ] [MAIN ] TG: Loaded 10498 existing records. [2025-09-24T21:36:30.089109] [DEBUG] [LOCAL ] TGLS: Loaded 28378 existing records from primary storage. [2025-09-24T21:36:30.197521] [INFO ] [MAIN ] TGLS: Loaded 28378 existing records. [2025-09-24T21:36:30.491263] [DEBUG] [LOCAL ] TGNA: Loaded 48720 existing records from primary storage. [2025-09-24T21:36:30.522029] [INFO ] [MAIN ] TGNA: Loaded 48720 existing records. [2025-09-24T21:36:30.537740] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:30.709567] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-24T21:36:30.720285] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-24T21:36:30.729508] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-24T21:36:30.709505] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:30.745985] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-24T21:36:30.746206] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-24T21:36:30.784683] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-24T21:36:30.808727] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:30.837830] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-24T21:36:30.843360] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-24T21:36:30.843258] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-24T21:36:31.174183] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:31.179700] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-24T21:36:31.203911] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-24T21:36:31.266014] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-24T21:36:31.276010] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:31.323688] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-24T21:36:31.350864] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-24T21:36:31.416808] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-24T21:36:31.787267] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:31.790701] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:31.791424] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-24T21:36:31.808328] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-24T21:36:31.823762] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-24T21:36:32.001546] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:32.012013] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-24T21:36:32.091431] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:32.091803] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-24T21:36:32.125745] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:32.126204] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-24T21:36:32.126833] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-24T21:36:32.347511] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:32.347984] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-24T21:36:32.348543] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-24T21:36:32.623688] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:32.624064] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-24T21:36:32.804320] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T21:36:32.816037] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-24T21:36:32.963372] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T21:36:33.415558] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:36:33.612566] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-24T21:36:33.616018] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-24T21:36:34.339828] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T21:36:34.416091] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-24T21:36:35.207040] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T21:36:35.216027] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-24T21:36:36.016107] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-24T21:36:36.053583] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T21:36:36.816128] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-24T21:36:37.224323] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T21:36:37.616164] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-24T21:36:37.659361] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-24T21:36:37.829536] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:36:37.830044] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-24T21:36:38.416153] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-24T21:36:39.160051] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-24T21:36:39.216120] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-24T21:36:40.016124] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-24T21:36:40.754433] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:36:40.816055] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-24T21:36:41.160938] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T21:36:41.616095] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-24T21:36:42.416086] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-24T21:36:42.467227] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T21:36:42.582514] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T21:36:43.014727] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T21:36:43.216073] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-24T21:36:44.016103] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-24T21:36:44.816058] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-24T21:36:44.974618] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T21:36:45.311996] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:36:45.616081] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-24T21:36:46.239885] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T21:36:46.416199] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-24T21:36:47.117018] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T21:36:47.134904] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T21:36:47.216065] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-24T21:36:48.016096] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-24T21:36:48.637819] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T21:36:48.816072] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-24T21:36:48.916189] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-24T21:36:49.616112] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-24T21:36:50.107804] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T21:36:50.374776] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T21:36:50.416034] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-24T21:36:51.216091] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-24T21:36:51.246213] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T21:36:51.249002] [INFO ] [REMOTE ] TG: Full fetch complete (15263 records). [2025-09-24T21:36:51.249079] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-24T21:36:51.625941] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-24T21:36:51.626105] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-24T21:36:51.626623] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-24T21:36:51.626709] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-24T21:36:51.627449] [DEBUG] [LOCAL ] TG: Trimmed 15263 records to 10495 (keeping 200 days of data) [2025-09-24T21:36:51.692937] [DEBUG] [LOCAL ] TG: Primary data saved (10495 records). [2025-09-24T21:36:51.693109] [INFO ] [MAIN ] TG: Full history saved. [2025-09-24T21:36:51.693231] [INFO ] [MAIN ] Update Progress: 2081/2373 symbols completed. TG took 22.6s. Estimated remaining: 38m 50s. Rate: 7.5 symbols/min [2025-09-24T21:36:51.870542] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:51.909849] [DEBUG] [LOCAL ] TGS: Loaded 32502 existing records from primary storage. [2025-09-24T21:36:51.910029] [INFO ] [MAIN ] TGS: Loaded 32502 existing records. [2025-09-24T21:36:52.021179] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-24T21:36:52.091526] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:52.091793] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-24T21:36:52.091844] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-24T21:36:52.092707] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-24T21:36:52.092778] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-24T21:36:52.468660] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:52.491504] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T21:36:52.497438] [INFO ] [REMOTE ] TGE: Full fetch complete (8950 records). [2025-09-24T21:36:52.497579] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-24T21:36:52.700335] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-24T21:36:52.700629] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:36:52.700722] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:36:52.700811] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-24T21:36:52.700978] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-24T21:36:52.701036] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-24T21:36:52.701099] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-24T21:36:52.701201] [INFO ] [MAIN ] Update Progress: 2082/2373 symbols completed. TGE took 23.6s. Estimated remaining: 38m 41s. Rate: 7.5 symbols/min [2025-09-24T21:36:52.821275] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-24T21:36:52.875842] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:52.939922] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-24T21:36:52.940085] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-24T21:36:53.118987] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:53.119216] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-24T21:36:53.119267] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-24T21:36:53.120775] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-24T21:36:53.120837] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-24T21:36:53.504197] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:36:53.616099] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-24T21:36:53.727122] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T21:36:53.907012] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T21:36:54.416144] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-24T21:36:54.933312] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:36:55.174467] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T21:36:55.216036] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-24T21:36:56.016135] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-24T21:36:56.633369] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-24T21:36:56.816129] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-24T21:36:57.616098] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-24T21:36:58.066134] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-24T21:36:58.416082] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-24T21:36:58.562627] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:36:58.705495] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T21:36:58.713752] [INFO ] [REMOTE ] TGLS: Full fetch complete (40341 records). [2025-09-24T21:36:58.713951] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-24T21:36:59.127980] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-24T21:36:59.128119] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-24T21:36:59.129109] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-24T21:36:59.129212] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-24T21:36:59.130664] [DEBUG] [LOCAL ] TGLS: Trimmed 40341 records to 28289 (keeping 200 days of data) [2025-09-24T21:36:59.234818] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-24T21:36:59.337609] [DEBUG] [LOCAL ] TGLS: Primary data saved (28289 records). [2025-09-24T21:36:59.337806] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-24T21:36:59.337999] [INFO ] [MAIN ] Update Progress: 2083/2373 symbols completed. TGLS took 30.2s. Estimated remaining: 38m 33s. Rate: 7.5 symbols/min [2025-09-24T21:36:59.514118] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:36:59.565347] [DEBUG] [LOCAL ] THC: Loaded 48112 existing records from primary storage. [2025-09-24T21:36:59.565510] [INFO ] [MAIN ] THC: Loaded 48112 existing records. [2025-09-24T21:36:59.821152] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T21:36:59.821359] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:36:59.830057] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-24T21:36:59.830357] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-24T21:36:59.831858] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-24T21:36:59.831946] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-24T21:37:00.028697] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-24T21:37:00.216777] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:00.816086] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-24T21:37:01.386634] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T21:37:01.585411] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T21:37:01.616102] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-24T21:37:02.136280] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:37:02.416081] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-24T21:37:02.598771] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T21:37:03.216095] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-24T21:37:04.016112] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-24T21:37:04.116399] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T21:37:04.816084] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-24T21:37:05.357797] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:37:05.412319] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-24T21:37:05.616099] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-24T21:37:06.178785] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T21:37:06.416119] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-24T21:37:07.216111] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-24T21:37:07.425676] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T21:37:08.016119] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-24T21:37:08.453971] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-24T21:37:08.812101] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-24T21:37:08.822451] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-24T21:37:09.391983] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T21:37:09.403718] [INFO ] [REMOTE ] TGNA: Full fetch complete (69874 records). [2025-09-24T21:37:09.403849] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-24T21:37:09.626684] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-24T21:37:09.832333] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-24T21:37:09.832483] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-24T21:37:09.834841] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-24T21:37:09.834932] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-24T21:37:09.836640] [DEBUG] [LOCAL ] TGNA: Trimmed 69874 records to 48698 (keeping 200 days of data) [2025-09-24T21:37:10.176536] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:37:10.196686] [DEBUG] [LOCAL ] TGNA: Primary data saved (48698 records). [2025-09-24T21:37:10.196825] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-24T21:37:10.196949] [INFO ] [MAIN ] Update Progress: 2084/2373 symbols completed. TGNA took 41.1s. Estimated remaining: 38m 26s. Rate: 7.5 symbols/min [2025-09-24T21:37:10.374240] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:10.398811] [DEBUG] [LOCAL ] THG: Loaded 21862 existing records from primary storage. [2025-09-24T21:37:10.398965] [INFO ] [MAIN ] THG: Loaded 21862 existing records. [2025-09-24T21:37:10.421231] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-24T21:37:10.592916] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:10.593317] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-24T21:37:10.593386] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-24T21:37:10.594280] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-24T21:37:10.594354] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-24T21:37:10.967767] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:11.216084] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-24T21:37:11.373754] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T21:37:12.016181] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-24T21:37:12.528910] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T21:37:12.750631] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-24T21:37:12.812952] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-24T21:37:12.817068] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-24T21:37:13.616105] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-24T21:37:14.416144] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-24T21:37:14.674629] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T21:37:14.865022] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T21:37:15.216092] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-24T21:37:15.919007] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T21:37:16.016142] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-24T21:37:16.816146] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-24T21:37:17.337263] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-24T21:37:17.616076] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-24T21:37:17.693169] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T21:37:17.801580] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-24T21:37:18.416130] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-24T21:37:19.216088] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-24T21:37:19.606075] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T21:37:20.016175] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-24T21:37:20.153344] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-24T21:37:20.505794] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T21:37:20.816103] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-24T21:37:21.315042] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:37:21.616111] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-24T21:37:22.314475] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:37:22.322500] [INFO ] [REMOTE ] TGS: Full fetch complete (47417 records). [2025-09-24T21:37:22.322616] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-24T21:37:22.421248] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-24T21:37:22.741361] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-24T21:37:22.741465] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-24T21:37:22.742590] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-24T21:37:22.742680] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-24T21:37:22.744452] [DEBUG] [LOCAL ] TGS: Trimmed 47417 records to 32486 (keeping 200 days of data) [2025-09-24T21:37:22.974995] [DEBUG] [LOCAL ] TGS: Primary data saved (32486 records). [2025-09-24T21:37:22.975600] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-24T21:37:22.975753] [INFO ] [MAIN ] Update Progress: 2085/2373 symbols completed. TGS took 31.3s. Estimated remaining: 38m 18s. Rate: 7.5 symbols/min [2025-09-24T21:37:23.159334] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:23.164578] [DEBUG] [LOCAL ] THIR: Loaded 2172 existing records from primary storage. [2025-09-24T21:37:23.164688] [INFO ] [MAIN ] THIR: Loaded 2172 existing records. [2025-09-24T21:37:23.226359] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-24T21:37:23.355638] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:23.356126] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-24T21:37:23.356252] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-24T21:37:23.356976] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-24T21:37:23.357187] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-24T21:37:23.489637] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T21:37:23.765841] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:24.016066] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-24T21:37:24.329730] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T21:37:24.545093] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-24T21:37:24.816102] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-24T21:37:25.615299] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:37:25.626009] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-24T21:37:25.715055] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-24T21:37:26.416127] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-24T21:37:27.216129] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-24T21:37:27.537314] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-24T21:37:27.895619] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:37:27.930189] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-24T21:37:27.943784] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-24T21:37:27.943951] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-24T21:37:28.021164] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-24T21:37:28.358598] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-24T21:37:28.358721] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-24T21:37:28.360196] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-24T21:37:28.360260] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-24T21:37:28.362107] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-09-24T21:37:28.724856] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-24T21:37:28.724997] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-24T21:37:28.725097] [INFO ] [MAIN ] Update Progress: 2086/2373 symbols completed. TGT took 36.0s. Estimated remaining: 38m 10s. Rate: 7.5 symbols/min [2025-09-24T21:37:28.822744] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-24T21:37:28.898782] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:28.902228] [DEBUG] [LOCAL ] THLV: Loaded 1623 existing records from primary storage. [2025-09-24T21:37:28.902304] [INFO ] [MAIN ] THLV: Loaded 1623 existing records. [2025-09-24T21:37:29.080605] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:29.080927] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-24T21:37:29.080976] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-24T21:37:29.081177] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-24T21:37:29.081237] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-24T21:37:29.538986] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:29.598518] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T21:37:29.606930] [INFO ] [REMOTE ] THC: Full fetch complete (69499 records). [2025-09-24T21:37:29.607077] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-24T21:37:29.621272] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-24T21:37:30.068994] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-24T21:37:30.069238] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-24T21:37:30.070464] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-24T21:37:30.070530] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-24T21:37:30.071982] [DEBUG] [LOCAL ] THC: Trimmed 69499 records to 48021 (keeping 200 days of data) [2025-09-24T21:37:30.142010] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-24T21:37:30.189165] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T21:37:30.400839] [DEBUG] [LOCAL ] THC: Primary data saved (48021 records). [2025-09-24T21:37:30.400999] [INFO ] [MAIN ] THC: Full history saved. [2025-09-24T21:37:30.401089] [INFO ] [MAIN ] Update Progress: 2087/2373 symbols completed. THC took 31.1s. Estimated remaining: 38m 1s. Rate: 7.5 symbols/min [2025-09-24T21:37:30.421573] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-24T21:37:30.591585] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:30.642634] [DEBUG] [LOCAL ] THO: Loaded 42355 existing records from primary storage. [2025-09-24T21:37:30.642872] [INFO ] [MAIN ] THO: Loaded 42355 existing records. [2025-09-24T21:37:30.860731] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:30.861137] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-24T21:37:30.861212] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-24T21:37:30.862684] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-24T21:37:30.862762] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-24T21:37:31.221365] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-24T21:37:31.443092] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:31.559474] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T21:37:31.563384] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-24T21:37:32.016079] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-24T21:37:32.430786] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-24T21:37:32.816099] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-24T21:37:33.156997] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-24T21:37:33.616090] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-24T21:37:34.067120] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-24T21:37:34.416086] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-24T21:37:35.216069] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-24T21:37:35.284633] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T21:37:35.288378] [INFO ] [REMOTE ] THG: Full fetch complete (31065 records). [2025-09-24T21:37:35.288465] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-24T21:37:35.622832] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-24T21:37:35.671221] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-24T21:37:35.671318] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-24T21:37:35.672019] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-24T21:37:35.672082] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-24T21:37:35.672871] [DEBUG] [LOCAL ] THG: Trimmed 31065 records to 21781 (keeping 200 days of data) [2025-09-24T21:37:35.816450] [DEBUG] [LOCAL ] THG: Primary data saved (21781 records). [2025-09-24T21:37:35.816623] [INFO ] [MAIN ] THG: Full history saved. [2025-09-24T21:37:35.816790] [INFO ] [MAIN ] Update Progress: 2088/2373 symbols completed. THG took 25.6s. Estimated remaining: 37m 53s. Rate: 7.5 symbols/min [2025-09-24T21:37:35.992902] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:36.017990] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-24T21:37:36.018733] [DEBUG] [LOCAL ] THQ: Loaded 24507 existing records from primary storage. [2025-09-24T21:37:36.019892] [INFO ] [MAIN ] THQ: Loaded 24507 existing records. [2025-09-24T21:37:36.220383] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:36.220735] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-24T21:37:36.220797] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-24T21:37:36.221540] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-24T21:37:36.221602] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-24T21:37:36.586551] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:36.816098] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-24T21:37:37.277261] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-24T21:37:37.520948] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T21:37:37.616117] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-24T21:37:38.416134] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-24T21:37:38.815026] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-24T21:37:39.164112] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T21:37:39.216028] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-24T21:37:40.016087] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-24T21:37:40.614191] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-24T21:37:40.722316] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T21:37:40.816124] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-24T21:37:41.616098] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-24T21:37:41.897324] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-24T21:37:42.416115] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-24T21:37:43.091041] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T21:37:43.216087] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-24T21:37:43.681310] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T21:37:44.016087] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-24T21:37:44.797366] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T21:37:44.817520] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-24T21:37:44.822168] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T21:37:45.244540] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T21:37:45.616135] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-24T21:37:46.087211] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T21:37:46.416130] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-24T21:37:46.913548] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T21:37:47.216156] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-24T21:37:48.016111] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-24T21:37:48.702174] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-24T21:37:48.736051] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T21:37:48.816144] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-24T21:37:49.389128] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T21:37:49.616086] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-24T21:37:50.163941] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T21:37:50.416105] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-24T21:37:51.216124] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-24T21:37:51.677510] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-24T21:37:51.678748] [INFO ] [REMOTE ] THIR: Full fetch complete (2666 records). [2025-09-24T21:37:51.678827] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-24T21:37:52.018014] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-24T21:37:52.078108] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-24T21:37:52.078246] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-24T21:37:52.078540] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-24T21:37:52.078666] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-24T21:37:52.079114] [DEBUG] [LOCAL ] THIR: Trimmed 2666 records to 2202 (keeping 200 days of data) [2025-09-24T21:37:52.119638] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T21:37:52.132605] [DEBUG] [LOCAL ] THIR: Primary data saved (2202 records). [2025-09-24T21:37:52.133000] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-24T21:37:52.133121] [INFO ] [MAIN ] Update Progress: 2089/2373 symbols completed. THIR took 29.2s. Estimated remaining: 37m 46s. Rate: 7.5 symbols/min [2025-09-24T21:37:52.309926] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:37:52.334333] [DEBUG] [LOCAL ] THR: Loaded 19961 existing records from primary storage. [2025-09-24T21:37:52.334517] [INFO ] [MAIN ] THR: Loaded 19961 existing records. [2025-09-24T21:37:52.524246] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:37:52.524578] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-24T21:37:52.524635] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-24T21:37:52.525233] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-24T21:37:52.525294] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-24T21:37:52.816364] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-24T21:37:52.884037] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:37:53.130520] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T21:37:53.235904] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-24T21:37:53.616088] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-24T21:37:54.416100] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-24T21:37:54.910269] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T21:37:55.216095] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-24T21:37:55.462824] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T21:37:56.016127] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-24T21:37:56.309231] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T21:37:56.816116] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-24T21:37:57.056262] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-24T21:37:57.616104] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-24T21:37:58.118818] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T21:37:58.416123] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-24T21:37:58.766417] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T21:37:59.205352] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T21:37:59.216032] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-24T21:38:00.016135] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-24T21:38:00.496737] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T21:38:00.816058] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-24T21:38:00.979439] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-24T21:38:01.616082] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-24T21:38:01.799097] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T21:38:02.056984] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T21:38:02.416122] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-24T21:38:03.216065] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-24T21:38:03.432861] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T21:38:04.016131] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-24T21:38:04.370740] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-24T21:38:04.371599] [INFO ] [REMOTE ] THLV: Full fetch complete (2689 records). [2025-09-24T21:38:04.371694] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-24T21:38:04.743728] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-24T21:38:04.743875] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-24T21:38:04.744014] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-24T21:38:04.744154] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-24T21:38:04.744544] [DEBUG] [LOCAL ] THLV: Trimmed 2689 records to 1609 (keeping 200 days of data) [2025-09-24T21:38:04.754600] [DEBUG] [LOCAL ] THLV: Primary data saved (1609 records). [2025-09-24T21:38:04.754699] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-24T21:38:04.754792] [INFO ] [MAIN ] Update Progress: 2090/2373 symbols completed. THLV took 36.0s. Estimated remaining: 37m 39s. Rate: 7.5 symbols/min [2025-09-24T21:38:04.819458] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-24T21:38:04.940617] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T21:38:04.958404] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:05.005421] [DEBUG] [LOCAL ] THS: Loaded 37989 existing records from primary storage. [2025-09-24T21:38:05.005590] [INFO ] [MAIN ] THS: Loaded 37989 existing records. [2025-09-24T21:38:05.183201] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:05.183452] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-24T21:38:05.183502] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-24T21:38:05.184881] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-24T21:38:05.184947] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-24T21:38:05.550716] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:05.616067] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-24T21:38:05.925807] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-24T21:38:06.416135] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-24T21:38:06.667429] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T21:38:07.216072] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-24T21:38:07.546923] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T21:38:08.016121] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-24T21:38:08.621575] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T21:38:08.816126] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-24T21:38:09.560697] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:38:09.616081] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-24T21:38:10.149614] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-24T21:38:10.157775] [INFO ] [REMOTE ] THO: Full fetch complete (60201 records). [2025-09-24T21:38:10.157963] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-24T21:38:10.427275] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-24T21:38:10.572094] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-24T21:38:10.572223] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-24T21:38:10.573575] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-24T21:38:10.573687] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-24T21:38:10.575573] [DEBUG] [LOCAL ] THO: Trimmed 60201 records to 42345 (keeping 200 days of data) [2025-09-24T21:38:10.855192] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T21:38:10.886005] [DEBUG] [LOCAL ] THO: Primary data saved (42345 records). [2025-09-24T21:38:10.886212] [INFO ] [MAIN ] THO: Full history saved. [2025-09-24T21:38:10.886328] [INFO ] [MAIN ] Update Progress: 2091/2373 symbols completed. THO took 40.5s. Estimated remaining: 37m 30s. Rate: 7.5 symbols/min [2025-09-24T21:38:11.073110] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:11.099418] [DEBUG] [LOCAL ] THW: Loaded 19103 existing records from primary storage. [2025-09-24T21:38:11.099673] [INFO ] [MAIN ] THW: Loaded 19103 existing records. [2025-09-24T21:38:11.225590] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-24T21:38:11.350462] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:11.350823] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-24T21:38:11.350882] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-24T21:38:11.351584] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-24T21:38:11.351682] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-24T21:38:11.796029] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:11.798725] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T21:38:12.016096] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-24T21:38:12.386803] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T21:38:12.392486] [INFO ] [REMOTE ] THQ: Full fetch complete (34800 records). [2025-09-24T21:38:12.392639] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-24T21:38:12.808228] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-24T21:38:12.808329] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-24T21:38:12.809270] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-24T21:38:12.809362] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-24T21:38:12.810476] [DEBUG] [LOCAL ] THQ: Trimmed 34800 records to 24522 (keeping 200 days of data) [2025-09-24T21:38:12.865466] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-24T21:38:12.975359] [DEBUG] [LOCAL ] THQ: Primary data saved (24522 records). [2025-09-24T21:38:12.975493] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-24T21:38:12.975589] [INFO ] [MAIN ] Update Progress: 2092/2373 symbols completed. THQ took 37.2s. Estimated remaining: 37m 22s. Rate: 7.5 symbols/min [2025-09-24T21:38:13.150921] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:13.151173] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-24T21:38:13.151219] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-24T21:38:13.151367] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-24T21:38:13.151411] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-24T21:38:13.151455] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-24T21:38:13.151489] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-24T21:38:13.563710] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:13.565569] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:38:13.616031] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-24T21:38:13.813119] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:38:13.813445] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-24T21:38:14.013448] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T21:38:14.416082] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-24T21:38:15.216111] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-24T21:38:15.928366] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:38:16.016043] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-24T21:38:16.494922] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T21:38:16.816074] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-24T21:38:17.417252] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-24T21:38:17.616064] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-24T21:38:17.642933] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T21:38:17.647294] [INFO ] [REMOTE ] THR: Full fetch complete (28863 records). [2025-09-24T21:38:17.647392] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-24T21:38:17.892795] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:38:17.914868] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-24T21:38:18.023069] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-24T21:38:18.023164] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-24T21:38:18.023864] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-24T21:38:18.023928] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-24T21:38:18.024737] [DEBUG] [LOCAL ] THR: Trimmed 28863 records to 19903 (keeping 200 days of data) [2025-09-24T21:38:18.148505] [DEBUG] [LOCAL ] THR: Primary data saved (19903 records). [2025-09-24T21:38:18.148727] [INFO ] [MAIN ] THR: Full history saved. [2025-09-24T21:38:18.148860] [INFO ] [MAIN ] Update Progress: 2093/2373 symbols completed. THR took 26.0s. Estimated remaining: 37m 13s. Rate: 7.5 symbols/min [2025-09-24T21:38:18.319786] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:18.366381] [DEBUG] [LOCAL ] TIMB: Loaded 36746 existing records from primary storage. [2025-09-24T21:38:18.366529] [INFO ] [MAIN ] TIMB: Loaded 36746 existing records. [2025-09-24T21:38:18.421160] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-24T21:38:18.550577] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:18.550888] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-24T21:38:18.550948] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-24T21:38:18.551947] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-24T21:38:18.552024] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-24T21:38:18.915534] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:19.216085] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-24T21:38:19.868337] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T21:38:20.016064] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-24T21:38:20.764205] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T21:38:20.816082] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-24T21:38:20.926551] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T21:38:21.616096] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-24T21:38:22.321571] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:38:22.416050] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-24T21:38:23.161300] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T21:38:23.216268] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-24T21:38:23.721851] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T21:38:24.016168] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-24T21:38:24.669315] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T21:38:24.816114] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-24T21:38:25.598920] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T21:38:25.616028] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-24T21:38:25.772560] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T21:38:26.416121] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-24T21:38:26.823073] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-24T21:38:27.140738] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-24T21:38:27.216088] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-24T21:38:28.016106] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-24T21:38:28.664985] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:38:28.816150] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-24T21:38:29.513839] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:38:29.521581] [INFO ] [REMOTE ] THS: Full fetch complete (53649 records). [2025-09-24T21:38:29.521802] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-24T21:38:29.622341] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-24T21:38:29.915375] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-24T21:38:29.915589] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-24T21:38:29.916996] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-24T21:38:29.917066] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-24T21:38:29.918536] [DEBUG] [LOCAL ] THS: Trimmed 53649 records to 38007 (keeping 200 days of data) [2025-09-24T21:38:30.155750] [DEBUG] [LOCAL ] THS: Primary data saved (38007 records). [2025-09-24T21:38:30.156102] [INFO ] [MAIN ] THS: Full history saved. [2025-09-24T21:38:30.156233] [INFO ] [MAIN ] Update Progress: 2094/2373 symbols completed. THS took 25.4s. Estimated remaining: 37m 6s. Rate: 7.5 symbols/min [2025-09-24T21:38:30.366472] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:30.369627] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T21:38:30.384758] [DEBUG] [LOCAL ] TISI: Loaded 3847 existing records from primary storage. [2025-09-24T21:38:30.384923] [INFO ] [MAIN ] TISI: Loaded 3847 existing records. [2025-09-24T21:38:30.417038] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-24T21:38:30.572605] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:30.573204] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-24T21:38:30.578817] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-24T21:38:30.585249] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-24T21:38:30.585166] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T21:38:30.585522] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-24T21:38:30.977745] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:31.216125] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-24T21:38:31.512193] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T21:38:31.794263] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T21:38:32.016123] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-24T21:38:32.816138] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-24T21:38:33.360974] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T21:38:33.616047] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-24T21:38:33.825561] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-24T21:38:34.423092] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-24T21:38:34.425162] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-24T21:38:35.216146] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-24T21:38:35.628162] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-24T21:38:35.656721] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T21:38:36.016084] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-24T21:38:36.503422] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T21:38:36.816080] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-24T21:38:37.616077] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-24T21:38:38.093442] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T21:38:38.416083] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-24T21:38:39.138340] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-24T21:38:39.216054] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-24T21:38:39.638890] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-24T21:38:40.016078] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-24T21:38:40.125183] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-24T21:38:40.816094] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-24T21:38:41.367041] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:38:41.538576] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T21:38:41.616059] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-24T21:38:42.416107] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-24T21:38:42.591873] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T21:38:42.595402] [INFO ] [REMOTE ] THW: Full fetch complete (29357 records). [2025-09-24T21:38:42.595504] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-24T21:38:42.983943] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-24T21:38:42.984037] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-24T21:38:42.984705] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-24T21:38:42.984768] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-24T21:38:42.985445] [DEBUG] [LOCAL ] THW: Trimmed 29357 records to 19134 (keeping 200 days of data) [2025-09-24T21:38:43.107168] [DEBUG] [LOCAL ] THW: Primary data saved (19134 records). [2025-09-24T21:38:43.107330] [INFO ] [MAIN ] THW: Full history saved. [2025-09-24T21:38:43.107423] [INFO ] [MAIN ] Update Progress: 2095/2373 symbols completed. THW took 32.2s. Estimated remaining: 36m 59s. Rate: 7.5 symbols/min [2025-09-24T21:38:43.221241] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-24T21:38:43.287921] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:43.319175] [DEBUG] [LOCAL ] TIXT: Loaded 31392 existing records from primary storage. [2025-09-24T21:38:43.319337] [INFO ] [MAIN ] TIXT: Loaded 31392 existing records. [2025-09-24T21:38:43.501630] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:43.501957] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-24T21:38:43.502007] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-24T21:38:43.502870] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-24T21:38:43.502931] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-24T21:38:43.882945] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:43.913020] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T21:38:44.016125] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-24T21:38:44.490368] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T21:38:44.496308] [INFO ] [REMOTE ] TIMB: Full fetch complete (54813 records). [2025-09-24T21:38:44.496473] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-24T21:38:44.821199] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-24T21:38:44.906987] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-24T21:38:44.907081] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-24T21:38:44.908276] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-24T21:38:44.908401] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-24T21:38:44.909688] [DEBUG] [LOCAL ] TIMB: Trimmed 54813 records to 36658 (keeping 200 days of data) [2025-09-24T21:38:45.143832] [DEBUG] [LOCAL ] TIMB: Primary data saved (36658 records). [2025-09-24T21:38:45.143982] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-24T21:38:45.144075] [INFO ] [MAIN ] Update Progress: 2096/2373 symbols completed. TIMB took 27.0s. Estimated remaining: 36m 50s. Rate: 7.5 symbols/min [2025-09-24T21:38:45.328429] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:45.347979] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T21:38:45.373853] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T21:38:45.421635] [DEBUG] [LOCAL ] TJX: Loaded 53672 existing records from primary storage. [2025-09-24T21:38:45.421919] [INFO ] [MAIN ] TJX: Loaded 53672 existing records. [2025-09-24T21:38:45.619030] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-24T21:38:45.642090] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:45.642268] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-24T21:38:45.642318] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-24T21:38:45.643816] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-24T21:38:45.643880] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-24T21:38:46.017861] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:46.416082] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-24T21:38:47.015442] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T21:38:47.216175] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-24T21:38:48.016059] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-24T21:38:48.177374] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T21:38:48.365825] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T21:38:48.816116] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-24T21:38:49.365577] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T21:38:49.374038] [INFO ] [REMOTE ] TIC: Full fetch complete (38306 records). [2025-09-24T21:38:49.374153] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-24T21:38:49.565016] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-24T21:38:49.565515] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:38:49.565589] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:38:49.565687] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-24T21:38:49.565777] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-24T21:38:49.565835] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-24T21:38:49.565912] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-24T21:38:49.566010] [INFO ] [MAIN ] Update Progress: 2097/2373 symbols completed. TIC took 36.6s. Estimated remaining: 36m 41s. Rate: 7.5 symbols/min [2025-09-24T21:38:49.627960] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-24T21:38:49.738012] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:38:49.781199] [DEBUG] [LOCAL ] TK: Loaded 39804 existing records from primary storage. [2025-09-24T21:38:49.781393] [INFO ] [MAIN ] TK: Loaded 39804 existing records. [2025-09-24T21:38:49.963784] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:38:49.977760] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-24T21:38:49.978328] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-24T21:38:49.978834] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T21:38:49.984104] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-24T21:38:49.984592] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-24T21:38:50.350612] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:38:50.416085] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-24T21:38:51.149334] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T21:38:51.216099] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-24T21:38:51.401797] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T21:38:51.590090] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-24T21:38:52.016086] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-24T21:38:52.603128] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T21:38:52.816072] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-24T21:38:53.247907] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-24T21:38:53.616087] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-24T21:38:54.416113] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-24T21:38:54.675681] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T21:38:55.216137] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-24T21:38:56.016060] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-24T21:38:56.201918] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T21:38:56.336331] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T21:38:56.816086] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-24T21:38:57.285556] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T21:38:57.616141] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-24T21:38:58.123027] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T21:38:58.416088] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-24T21:38:59.216144] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-24T21:38:59.253502] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:38:59.698294] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-24T21:38:59.894148] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T21:39:00.016144] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-24T21:39:00.816100] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-24T21:39:01.616145] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-24T21:39:02.416096] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-24T21:39:02.709816] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-24T21:39:02.862176] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-24T21:39:03.216147] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-24T21:39:03.926068] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-24T21:39:03.927256] [INFO ] [REMOTE ] TISI: Full fetch complete (4963 records). [2025-09-24T21:39:03.927331] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-24T21:39:04.021490] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-24T21:39:04.320977] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-24T21:39:04.321182] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-24T21:39:04.321538] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-24T21:39:04.321633] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-24T21:39:04.322482] [DEBUG] [LOCAL ] TISI: Trimmed 4963 records to 3787 (keeping 200 days of data) [2025-09-24T21:39:04.348013] [DEBUG] [LOCAL ] TISI: Primary data saved (3787 records). [2025-09-24T21:39:04.348161] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-24T21:39:04.348285] [INFO ] [MAIN ] Update Progress: 2098/2373 symbols completed. TISI took 34.2s. Estimated remaining: 36m 34s. Rate: 7.5 symbols/min [2025-09-24T21:39:04.527187] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:04.574036] [DEBUG] [LOCAL ] TKC: Loaded 38265 existing records from primary storage. [2025-09-24T21:39:04.574210] [INFO ] [MAIN ] TKC: Loaded 38265 existing records. [2025-09-24T21:39:04.765427] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:04.765734] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-24T21:39:04.765803] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-24T21:39:04.766798] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-24T21:39:04.766860] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-24T21:39:05.162704] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-24T21:39:05.198409] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:05.204735] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-24T21:39:05.428704] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T21:39:05.616110] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-24T21:39:06.364922] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T21:39:06.402825] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-24T21:39:06.416030] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-24T21:39:07.159735] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-24T21:39:07.216107] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-24T21:39:08.016131] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-24T21:39:08.181387] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T21:39:08.797059] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T21:39:08.816104] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-24T21:39:09.459362] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T21:39:09.468483] [INFO ] [REMOTE ] TIXT: Full fetch complete (45682 records). [2025-09-24T21:39:09.468706] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-24T21:39:09.623450] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-24T21:39:09.861275] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-24T21:39:09.861408] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-24T21:39:09.862480] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-24T21:39:09.862597] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-24T21:39:09.863907] [DEBUG] [LOCAL ] TIXT: Trimmed 45682 records to 31483 (keeping 200 days of data) [2025-09-24T21:39:10.045421] [DEBUG] [LOCAL ] TIXT: Primary data saved (31483 records). [2025-09-24T21:39:10.045585] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-24T21:39:10.045747] [INFO ] [MAIN ] Update Progress: 2099/2373 symbols completed. TIXT took 26.9s. Estimated remaining: 36m 26s. Rate: 7.5 symbols/min [2025-09-24T21:39:10.231708] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:10.289730] [DEBUG] [LOCAL ] TKO: Loaded 44226 existing records from primary storage. [2025-09-24T21:39:10.289934] [INFO ] [MAIN ] TKO: Loaded 44226 existing records. [2025-09-24T21:39:10.432378] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-24T21:39:10.480116] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:10.480493] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-24T21:39:10.480569] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-24T21:39:10.481790] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-24T21:39:10.481870] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-24T21:39:10.873173] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:11.083264] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-24T21:39:11.216097] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-24T21:39:11.290359] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:39:11.673460] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T21:39:12.016129] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-24T21:39:12.816105] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-24T21:39:13.616108] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-24T21:39:14.639941] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (3.42 seconds). [2025-09-24T21:39:14.653546] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-24T21:39:14.859599] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-24T21:39:15.036765] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-24T21:39:15.138829] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T21:39:15.216053] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-24T21:39:16.016188] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-24T21:39:16.702917] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T21:39:16.781176] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T21:39:16.816048] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-24T21:39:17.223093] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-24T21:39:17.616093] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-24T21:39:18.416119] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-24T21:39:18.686496] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T21:39:19.114688] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T21:39:19.216114] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-24T21:39:19.621319] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T21:39:20.016094] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-24T21:39:20.661223] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:39:20.735084] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T21:39:20.747147] [INFO ] [REMOTE ] TJX: Full fetch complete (77677 records). [2025-09-24T21:39:20.747385] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-24T21:39:20.821217] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-24T21:39:21.167197] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-24T21:39:21.167304] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-24T21:39:21.168551] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-24T21:39:21.168668] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-24T21:39:21.171688] [DEBUG] [LOCAL ] TJX: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-24T21:39:21.548447] [DEBUG] [LOCAL ] TJX: Primary data saved (53669 records). [2025-09-24T21:39:21.548689] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-24T21:39:21.549029] [INFO ] [MAIN ] Update Progress: 2100/2373 symbols completed. TJX took 36.4s. Estimated remaining: 36m 19s. Rate: 7.5 symbols/min [2025-09-24T21:39:21.624776] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-24T21:39:21.739730] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:21.785910] [DEBUG] [LOCAL ] TKR: Loaded 40151 existing records from primary storage. [2025-09-24T21:39:21.786097] [INFO ] [MAIN ] TKR: Loaded 40151 existing records. [2025-09-24T21:39:21.997337] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:21.997714] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-24T21:39:21.997800] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-24T21:39:21.999147] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-24T21:39:21.999222] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-24T21:39:22.390197] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:22.416395] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-24T21:39:22.418041] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-24T21:39:23.216055] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-24T21:39:23.560241] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-24T21:39:23.911588] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:39:23.918590] [INFO ] [REMOTE ] TK: Full fetch complete (57021 records). [2025-09-24T21:39:23.918774] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-24T21:39:24.020418] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-24T21:39:24.325204] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-24T21:39:24.325334] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-24T21:39:24.326546] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-24T21:39:24.326768] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-24T21:39:24.328309] [DEBUG] [LOCAL ] TK: Trimmed 57021 records to 39711 (keeping 200 days of data) [2025-09-24T21:39:24.487131] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T21:39:24.615180] [DEBUG] [LOCAL ] TK: Primary data saved (39711 records). [2025-09-24T21:39:24.615339] [INFO ] [MAIN ] TK: Full history saved. [2025-09-24T21:39:24.615446] [INFO ] [MAIN ] Update Progress: 2101/2373 symbols completed. TK took 35.0s. Estimated remaining: 36m 10s. Rate: 7.5 symbols/min [2025-09-24T21:39:24.786631] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:24.816094] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-24T21:39:24.835127] [DEBUG] [LOCAL ] TLK: Loaded 39553 existing records from primary storage. [2025-09-24T21:39:24.835307] [INFO ] [MAIN ] TLK: Loaded 39553 existing records. [2025-09-24T21:39:25.030335] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:25.030698] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-24T21:39:25.030772] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-24T21:39:25.031835] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-24T21:39:25.031901] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-24T21:39:25.430868] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T21:39:25.492584] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:25.616089] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-24T21:39:25.955193] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T21:39:26.416130] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-24T21:39:26.829136] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T21:39:27.216082] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-24T21:39:28.016090] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-24T21:39:28.461505] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T21:39:28.676324] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T21:39:28.816055] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-24T21:39:29.494615] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:39:29.502519] [INFO ] [REMOTE ] TKC: Full fetch complete (51438 records). [2025-09-24T21:39:29.502695] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-24T21:39:29.621149] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-24T21:39:29.891967] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-24T21:39:29.892077] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-24T21:39:29.893108] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-24T21:39:29.893173] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-24T21:39:29.894479] [DEBUG] [LOCAL ] TKC: Trimmed 51438 records to 38381 (keeping 200 days of data) [2025-09-24T21:39:30.138195] [DEBUG] [LOCAL ] TKC: Primary data saved (38381 records). [2025-09-24T21:39:30.138355] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-24T21:39:30.138486] [INFO ] [MAIN ] Update Progress: 2102/2373 symbols completed. TKC took 25.8s. Estimated remaining: 36m 2s. Rate: 7.5 symbols/min [2025-09-24T21:39:30.321433] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:30.345120] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T21:39:30.369026] [DEBUG] [LOCAL ] TLYS: Loaded 16961 existing records from primary storage. [2025-09-24T21:39:30.369162] [INFO ] [MAIN ] TLYS: Loaded 16961 existing records. [2025-09-24T21:39:30.423257] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-24T21:39:30.549301] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:30.549557] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-24T21:39:30.549669] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-24T21:39:30.550211] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-24T21:39:30.550271] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-24T21:39:30.910486] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:31.216048] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-24T21:39:31.380278] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:39:31.603042] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T21:39:32.016055] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-24T21:39:32.051745] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T21:39:32.816097] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-24T21:39:33.565785] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T21:39:33.616037] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-24T21:39:33.804548] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T21:39:34.416089] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-24T21:39:34.969042] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:39:35.216099] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-24T21:39:35.961972] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T21:39:36.016125] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-24T21:39:36.788963] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T21:39:36.816069] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-24T21:39:36.885639] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T21:39:37.616062] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-24T21:39:37.682632] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-24T21:39:38.416091] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-24T21:39:39.106767] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T21:39:39.165158] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T21:39:39.216072] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-24T21:39:40.016140] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-24T21:39:40.673523] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-24T21:39:40.821858] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-24T21:39:40.838349] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T21:39:40.848028] [INFO ] [REMOTE ] TKO: Full fetch complete (64634 records). [2025-09-24T21:39:40.848245] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-24T21:39:41.261941] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-24T21:39:41.262045] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-24T21:39:41.263356] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-24T21:39:41.263425] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-24T21:39:41.267555] [DEBUG] [LOCAL ] TKO: Trimmed 64634 records to 44166 (keeping 200 days of data) [2025-09-24T21:39:41.565330] [DEBUG] [LOCAL ] TKO: Primary data saved (44166 records). [2025-09-24T21:39:41.565484] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-24T21:39:41.565610] [INFO ] [MAIN ] Update Progress: 2103/2373 symbols completed. TKO took 31.5s. Estimated remaining: 35m 54s. Rate: 7.5 symbols/min [2025-09-24T21:39:41.624106] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-24T21:39:41.750506] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:41.796130] [DEBUG] [LOCAL ] TM: Loaded 36620 existing records from primary storage. [2025-09-24T21:39:41.796296] [INFO ] [MAIN ] TM: Loaded 36620 existing records. [2025-09-24T21:39:41.999103] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:41.999396] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-24T21:39:41.999452] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-24T21:39:42.000479] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-24T21:39:42.000543] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-24T21:39:42.406571] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:42.421386] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-24T21:39:42.436500] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:39:42.807097] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T21:39:43.216114] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-24T21:39:43.510801] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T21:39:44.016092] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-24T21:39:44.816144] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-24T21:39:44.880095] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-24T21:39:45.616091] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-24T21:39:45.953990] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-24T21:39:46.025079] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-24T21:39:46.416091] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-24T21:39:47.178819] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T21:39:47.216050] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-24T21:39:47.458371] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-24T21:39:48.016109] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-24T21:39:48.402435] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:39:48.816086] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-24T21:39:49.433472] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T21:39:49.472062] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T21:39:49.616147] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-24T21:39:50.416071] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-24T21:39:50.615882] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T21:39:50.619198] [INFO ] [REMOTE ] TLYS: Full fetch complete (22016 records). [2025-09-24T21:39:50.619274] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-24T21:39:50.987824] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-24T21:39:50.987911] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-24T21:39:50.988432] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-24T21:39:50.988472] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-24T21:39:50.989134] [DEBUG] [LOCAL ] TLYS: Trimmed 22016 records to 16973 (keeping 200 days of data) [2025-09-24T21:39:51.089731] [DEBUG] [LOCAL ] TLYS: Primary data saved (16973 records). [2025-09-24T21:39:51.089904] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-24T21:39:51.090024] [INFO ] [MAIN ] Update Progress: 2104/2373 symbols completed. TLYS took 21.0s. Estimated remaining: 35m 46s. Rate: 7.5 symbols/min [2025-09-24T21:39:51.230689] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-24T21:39:51.272472] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:51.333971] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-24T21:39:51.334180] [INFO ] [MAIN ] TME: Loaded 53200 existing records. [2025-09-24T21:39:51.518850] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:51.519135] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-24T21:39:51.519183] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-24T21:39:51.520387] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-24T21:39:51.520449] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-24T21:39:51.982163] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:52.005633] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T21:39:52.016032] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-24T21:39:52.816068] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-24T21:39:52.900104] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T21:39:53.352731] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T21:39:53.616081] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-24T21:39:54.326607] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T21:39:54.335628] [INFO ] [REMOTE ] TKR: Full fetch complete (57714 records). [2025-09-24T21:39:54.335835] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-24T21:39:54.421303] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-24T21:39:54.734132] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-24T21:39:54.734228] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-24T21:39:54.735196] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-24T21:39:54.735259] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-24T21:39:54.736431] [DEBUG] [LOCAL ] TKR: Trimmed 57714 records to 40238 (keeping 200 days of data) [2025-09-24T21:39:54.995051] [DEBUG] [LOCAL ] TKR: Primary data saved (40238 records). [2025-09-24T21:39:54.995194] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-24T21:39:54.995294] [INFO ] [MAIN ] Update Progress: 2105/2373 symbols completed. TKR took 33.4s. Estimated remaining: 35m 38s. Rate: 7.5 symbols/min [2025-09-24T21:39:55.174539] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:39:55.205900] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T21:39:55.216024] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-24T21:39:55.258293] [DEBUG] [LOCAL ] TMHC: Loaded 45664 existing records from primary storage. [2025-09-24T21:39:55.258497] [INFO ] [MAIN ] TMHC: Loaded 45664 existing records. [2025-09-24T21:39:55.443909] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:39:55.444224] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-24T21:39:55.444279] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-24T21:39:55.445973] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-24T21:39:55.446148] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-24T21:39:55.832590] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:39:55.961170] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T21:39:56.016098] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-24T21:39:56.816069] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-24T21:39:56.932430] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T21:39:57.552988] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-24T21:39:57.616064] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-24T21:39:58.214972] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T21:39:58.416098] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-24T21:39:59.213623] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T21:39:59.222114] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-24T21:39:59.801163] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T21:40:00.016149] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-24T21:40:00.241183] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T21:40:00.816127] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-24T21:40:01.479076] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T21:40:01.616095] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-24T21:40:02.422470] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-24T21:40:02.425405] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T21:40:03.216056] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-24T21:40:03.437421] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-24T21:40:03.942005] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T21:40:04.016110] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-24T21:40:04.440564] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-24T21:40:04.447241] [INFO ] [REMOTE ] TLK: Full fetch complete (57353 records). [2025-09-24T21:40:04.447343] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-24T21:40:04.818611] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-24T21:40:04.861673] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-24T21:40:04.861780] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-24T21:40:04.862897] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-24T21:40:04.862964] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-24T21:40:04.864550] [DEBUG] [LOCAL ] TLK: Trimmed 57353 records to 39448 (keeping 200 days of data) [2025-09-24T21:40:05.116638] [DEBUG] [LOCAL ] TLK: Primary data saved (39448 records). [2025-09-24T21:40:05.116818] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-24T21:40:05.116910] [INFO ] [MAIN ] Update Progress: 2106/2373 symbols completed. TLK took 40.5s. Estimated remaining: 35m 30s. Rate: 7.5 symbols/min [2025-09-24T21:40:05.295565] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:05.352624] [DEBUG] [LOCAL ] TMO: Loaded 52331 existing records from primary storage. [2025-09-24T21:40:05.352833] [INFO ] [MAIN ] TMO: Loaded 52331 existing records. [2025-09-24T21:40:05.538466] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:05.538862] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-24T21:40:05.538971] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-24T21:40:05.540450] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-24T21:40:05.540513] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-24T21:40:05.616604] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-24T21:40:05.917941] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:05.945190] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T21:40:06.416102] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-24T21:40:06.550379] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T21:40:07.216220] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-24T21:40:07.495088] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T21:40:07.794562] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:40:08.016089] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-24T21:40:08.606432] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T21:40:08.816132] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-24T21:40:09.500000] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-24T21:40:09.616105] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-24T21:40:10.416102] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-24T21:40:10.538182] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-24T21:40:11.216169] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-24T21:40:11.472054] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T21:40:12.021192] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-24T21:40:12.038581] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:40:12.816074] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-24T21:40:13.153921] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T21:40:13.616056] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-24T21:40:13.709894] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-24T21:40:14.370175] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T21:40:14.416041] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-24T21:40:15.224573] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-24T21:40:15.229130] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-24T21:40:16.025001] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-24T21:40:16.046352] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T21:40:16.816081] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-24T21:40:16.988522] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-24T21:40:17.519211] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-24T21:40:17.616048] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-24T21:40:18.181322] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-24T21:40:18.187559] [INFO ] [REMOTE ] TM: Full fetch complete (53010 records). [2025-09-24T21:40:18.187868] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-24T21:40:18.421245] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-24T21:40:18.610550] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-24T21:40:18.610683] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-24T21:40:18.612049] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-24T21:40:18.612117] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-24T21:40:18.613423] [DEBUG] [LOCAL ] TM: Trimmed 53010 records to 36600 (keeping 200 days of data) [2025-09-24T21:40:18.874324] [DEBUG] [LOCAL ] TM: Primary data saved (36600 records). [2025-09-24T21:40:18.874489] [INFO ] [MAIN ] TM: Full history saved. [2025-09-24T21:40:18.874580] [INFO ] [MAIN ] Update Progress: 2107/2373 symbols completed. TM took 37.3s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-24T21:40:19.060016] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:19.077408] [DEBUG] [LOCAL ] TNC: Loaded 15269 existing records from primary storage. [2025-09-24T21:40:19.077636] [INFO ] [MAIN ] TNC: Loaded 15269 existing records. [2025-09-24T21:40:19.221262] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-24T21:40:19.275010] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:19.275331] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-24T21:40:19.275390] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-24T21:40:19.276000] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-24T21:40:19.276063] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-24T21:40:19.643253] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:19.772964] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T21:40:20.016060] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-24T21:40:20.237093] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T21:40:20.799516] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-24T21:40:20.808113] [INFO ] [REMOTE ] TMHC: Full fetch complete (65929 records). [2025-09-24T21:40:20.808247] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-24T21:40:20.821905] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-24T21:40:21.178183] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T21:40:21.273335] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-24T21:40:21.273442] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-24T21:40:21.274677] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-24T21:40:21.274748] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-24T21:40:21.276310] [DEBUG] [LOCAL ] TMHC: Trimmed 65929 records to 45628 (keeping 200 days of data) [2025-09-24T21:40:21.559332] [DEBUG] [LOCAL ] TMHC: Primary data saved (45628 records). [2025-09-24T21:40:21.559488] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-24T21:40:21.559578] [INFO ] [MAIN ] Update Progress: 2108/2373 symbols completed. TMHC took 26.6s. Estimated remaining: 35m 14s. Rate: 7.5 symbols/min [2025-09-24T21:40:21.625732] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-24T21:40:21.741562] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:21.773436] [DEBUG] [LOCAL ] TNET: Loaded 28910 existing records from primary storage. [2025-09-24T21:40:21.773679] [INFO ] [MAIN ] TNET: Loaded 28910 existing records. [2025-09-24T21:40:21.963597] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:21.963966] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-24T21:40:21.964022] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-24T21:40:21.965043] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-24T21:40:21.965106] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-24T21:40:22.326716] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:22.416041] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-24T21:40:22.681979] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T21:40:22.847239] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T21:40:23.216079] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-24T21:40:23.662078] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T21:40:24.016056] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-24T21:40:24.319159] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T21:40:24.816092] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-24T21:40:25.616070] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-24T21:40:25.681616] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T21:40:25.920439] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T21:40:26.416060] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-24T21:40:26.435478] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T21:40:27.216096] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-24T21:40:27.555041] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-24T21:40:28.016151] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-24T21:40:28.816161] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-24T21:40:29.077090] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T21:40:29.411937] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T21:40:29.616090] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-24T21:40:29.663671] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T21:40:30.416133] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-24T21:40:31.216091] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-24T21:40:31.465118] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-24T21:40:31.475626] [INFO ] [REMOTE ] TME: Full fetch complete (76928 records). [2025-09-24T21:40:31.475992] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-24T21:40:31.925480] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-24T21:40:31.925610] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-24T21:40:31.927808] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-24T21:40:31.927935] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-24T21:40:31.931077] [DEBUG] [LOCAL ] TME: Trimmed 76928 records to 53201 (keeping 200 days of data) [2025-09-24T21:40:32.026171] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-24T21:40:32.206271] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T21:40:32.344418] [DEBUG] [LOCAL ] TME: Primary data saved (53201 records). [2025-09-24T21:40:32.344674] [INFO ] [MAIN ] TME: Full history saved. [2025-09-24T21:40:32.344836] [INFO ] [MAIN ] Update Progress: 2109/2373 symbols completed. TME took 41.3s. Estimated remaining: 35m 7s. Rate: 7.5 symbols/min [2025-09-24T21:40:32.499123] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T21:40:32.581329] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:32.581602] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-24T21:40:32.581681] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-24T21:40:32.581837] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-24T21:40:32.581882] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-24T21:40:32.581924] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-24T21:40:32.581958] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-24T21:40:32.821276] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-24T21:40:32.950446] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:33.069430] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T21:40:33.616115] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-24T21:40:33.820434] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:33.820819] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-24T21:40:34.241528] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-24T21:40:34.416110] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-24T21:40:34.694477] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:34.694940] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-24T21:40:35.216083] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-24T21:40:35.432435] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:35.432836] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-24T21:40:36.016135] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-24T21:40:36.816084] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-24T21:40:37.616144] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-24T21:40:37.843544] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T21:40:37.938377] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:37.938809] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-24T21:40:38.153546] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-24T21:40:38.416192] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-24T21:40:39.216146] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-24T21:40:39.248877] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-24T21:40:40.016084] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-24T21:40:40.220527] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:40.221076] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-24T21:40:40.370333] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-24T21:40:40.816100] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-24T21:40:41.020492] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:40:41.020957] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-24T21:40:41.616099] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-24T21:40:42.416066] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-24T21:40:42.760489] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T21:40:42.880508] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-24T21:40:43.216122] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-24T21:40:44.016106] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-24T21:40:44.816054] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-24T21:40:45.179107] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-24T21:40:45.359849] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-24T21:40:45.616103] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-24T21:40:45.657188] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T21:40:45.660148] [INFO ] [REMOTE ] TNC: Full fetch complete (23193 records). [2025-09-24T21:40:45.660224] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-24T21:40:46.043155] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-24T21:40:46.043293] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-24T21:40:46.044053] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-24T21:40:46.044123] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-24T21:40:46.045175] [DEBUG] [LOCAL ] TNC: Trimmed 23193 records to 15142 (keeping 200 days of data) [2025-09-24T21:40:46.147563] [DEBUG] [LOCAL ] TNC: Primary data saved (15142 records). [2025-09-24T21:40:46.147773] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-24T21:40:46.147880] [INFO ] [MAIN ] Update Progress: 2110/2373 symbols completed. TNC took 27.3s. Estimated remaining: 34m 59s. Rate: 7.5 symbols/min [2025-09-24T21:40:46.325799] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:46.362895] [DEBUG] [LOCAL ] TNK: Loaded 35266 existing records from primary storage. [2025-09-24T21:40:46.363059] [INFO ] [MAIN ] TNK: Loaded 35266 existing records. [2025-09-24T21:40:46.427433] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-24T21:40:46.555781] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:46.556211] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-24T21:40:46.556295] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-24T21:40:46.557490] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-24T21:40:46.557559] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-24T21:40:46.940872] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:46.963875] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:40:47.150562] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T21:40:47.216106] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-24T21:40:47.916741] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T21:40:48.016112] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-24T21:40:48.732580] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T21:40:48.741892] [INFO ] [REMOTE ] TMO: Full fetch complete (75458 records). [2025-09-24T21:40:48.742037] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-24T21:40:48.821211] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-24T21:40:49.160737] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-24T21:40:49.160876] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-24T21:40:49.162506] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-24T21:40:49.162590] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-24T21:40:49.165202] [DEBUG] [LOCAL ] TMO: Trimmed 75458 records to 52330 (keeping 200 days of data) [2025-09-24T21:40:49.568151] [DEBUG] [LOCAL ] TMO: Primary data saved (52330 records). [2025-09-24T21:40:49.568370] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-24T21:40:49.568508] [INFO ] [MAIN ] Update Progress: 2111/2373 symbols completed. TMO took 44.5s. Estimated remaining: 34m 51s. Rate: 7.5 symbols/min [2025-09-24T21:40:49.621296] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-24T21:40:49.766030] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:49.817609] [DEBUG] [LOCAL ] TNL: Loaded 41949 existing records from primary storage. [2025-09-24T21:40:49.817836] [INFO ] [MAIN ] TNL: Loaded 41949 existing records. [2025-09-24T21:40:50.034785] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:50.054593] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-24T21:40:50.055406] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:40:50.055524] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-24T21:40:50.061666] [INFO ] [REMOTE ] TNET: Full fetch complete (41680 records). [2025-09-24T21:40:50.061807] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-24T21:40:50.067490] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-24T21:40:50.122835] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-24T21:40:50.416898] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-24T21:40:50.775634] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-24T21:40:50.811407] [INFO ] [REMOTE ] TNGY: Full fetch complete (3244 records). [2025-09-24T21:40:50.855529] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-24T21:40:51.029517] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:51.023626] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-24T21:40:51.053155] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-24T21:40:51.081320] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-24T21:40:51.092823] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-24T21:40:51.160718] [DEBUG] [LOCAL ] TNET: Trimmed 41680 records to 28809 (keeping 200 days of data) [2025-09-24T21:40:51.198507] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-24T21:40:51.198758] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:40:51.198833] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:40:51.198914] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-24T21:40:51.199037] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-24T21:40:51.199117] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-24T21:40:51.199197] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-24T21:40:51.199318] [INFO ] [MAIN ] Update Progress: 2112/2373 symbols completed. TNGY took 18.9s. Estimated remaining: 34m 42s. Rate: 7.5 symbols/min [2025-09-24T21:40:51.263173] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-24T21:40:51.502273] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:51.503906] [DEBUG] [LOCAL ] TOL: No existing data file found in primary storage. [2025-09-24T21:40:51.505038] [WARN ] [MAIN ] TOL: No existing data found, performing full refresh instead. [2025-09-24T21:40:51.509296] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-24T21:40:51.509355] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-24T21:40:51.509403] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-24T21:40:51.509438] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-24T21:40:51.707460] [DEBUG] [LOCAL ] TNET: Primary data saved (28809 records). [2025-09-24T21:40:51.745929] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-24T21:40:51.753277] [INFO ] [MAIN ] Update Progress: 2113/2373 symbols completed. TNET took 30.2s. Estimated remaining: 34m 33s. Rate: 7.5 symbols/min [2025-09-24T21:40:52.109199] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:40:52.106185] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:52.109911] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-24T21:40:52.130746] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:40:52.186474] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-24T21:40:52.186636] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-24T21:40:52.369588] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:40:52.369959] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-24T21:40:52.370033] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-24T21:40:52.371327] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-24T21:40:52.371390] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-24T21:40:52.722427] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-24T21:40:52.764865] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:40:52.816031] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-24T21:40:53.616049] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-24T21:40:53.873984] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-24T21:40:54.416104] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-24T21:40:54.727959] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T21:40:54.804462] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T21:40:55.216105] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-24T21:40:55.860088] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T21:40:56.016083] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-24T21:40:56.698603] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:40:56.816085] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-24T21:40:57.474947] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-24T21:40:57.616087] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-24T21:40:58.341475] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T21:40:58.416035] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-24T21:40:58.986732] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-24T21:40:59.216103] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-24T21:41:00.016071] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-24T21:41:00.051174] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:41:00.816125] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-24T21:41:01.085616] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-24T21:41:01.336956] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T21:41:01.616097] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-24T21:41:02.421702] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-24T21:41:02.452342] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T21:41:03.216059] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-24T21:41:03.419706] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T21:41:03.717490] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:41:04.016107] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-24T21:41:04.789200] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T21:41:04.816093] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-24T21:41:05.629081] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-24T21:41:05.636255] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T21:41:06.416139] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-24T21:41:06.470855] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T21:41:07.174049] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-24T21:41:07.216066] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-24T21:41:08.016061] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-24T21:41:08.393084] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-24T21:41:08.458340] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T21:41:08.816126] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-24T21:41:09.411426] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-24T21:41:09.616109] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-24T21:41:10.423425] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-24T21:41:10.428420] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:41:11.216052] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-24T21:41:11.418401] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T21:41:11.849025] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T21:41:11.857379] [INFO ] [REMOTE ] TNL: Full fetch complete (58771 records). [2025-09-24T21:41:11.857610] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-24T21:41:12.021289] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-24T21:41:12.306301] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-24T21:41:12.306535] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-24T21:41:12.308061] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-24T21:41:12.308132] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-24T21:41:12.311626] [DEBUG] [LOCAL ] TNL: Trimmed 58771 records to 41895 (keeping 200 days of data) [2025-09-24T21:41:12.600907] [DEBUG] [LOCAL ] TNL: Primary data saved (41895 records). [2025-09-24T21:41:12.601099] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-24T21:41:12.601223] [INFO ] [MAIN ] Update Progress: 2114/2373 symbols completed. TNL took 23.0s. Estimated remaining: 34m 27s. Rate: 7.5 symbols/min [2025-09-24T21:41:12.787065] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:12.817527] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-24T21:41:12.819362] [DEBUG] [LOCAL ] TPB: Loaded 24884 existing records from primary storage. [2025-09-24T21:41:12.819592] [INFO ] [MAIN ] TPB: Loaded 24884 existing records. [2025-09-24T21:41:13.037152] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:13.038207] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-24T21:41:13.038345] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-24T21:41:13.039276] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-24T21:41:13.039370] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-24T21:41:13.359304] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-24T21:41:13.517348] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:13.540783] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T21:41:13.616086] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-24T21:41:14.416120] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-24T21:41:14.667886] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T21:41:15.099115] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:41:15.105419] [INFO ] [REMOTE ] TNK: Full fetch complete (51855 records). [2025-09-24T21:41:15.105549] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-24T21:41:15.221266] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-24T21:41:15.514285] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-24T21:41:15.514428] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-24T21:41:15.515826] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-24T21:41:15.515929] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-24T21:41:15.517713] [DEBUG] [LOCAL ] TNK: Trimmed 51855 records to 35229 (keeping 200 days of data) [2025-09-24T21:41:15.767969] [DEBUG] [LOCAL ] TNK: Primary data saved (35229 records). [2025-09-24T21:41:15.768268] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-24T21:41:15.768577] [INFO ] [MAIN ] Update Progress: 2115/2373 symbols completed. TNK took 29.6s. Estimated remaining: 34m 18s. Rate: 7.5 symbols/min [2025-09-24T21:41:15.949207] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:15.989607] [DEBUG] [LOCAL ] TPC: Loaded 38834 existing records from primary storage. [2025-09-24T21:41:15.989827] [INFO ] [MAIN ] TPC: Loaded 38834 existing records. [2025-09-24T21:41:16.022618] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-24T21:41:16.180845] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:16.181356] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-24T21:41:16.181415] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-24T21:41:16.182295] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-24T21:41:16.182357] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-24T21:41:16.574432] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:16.580388] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-24T21:41:16.754545] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T21:41:16.816124] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-24T21:41:17.109067] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T21:41:17.616230] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-24T21:41:18.416096] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-24T21:41:18.784988] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-24T21:41:19.216118] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-24T21:41:19.690696] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-24T21:41:19.825178] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-24T21:41:20.016077] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-24T21:41:20.816137] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-24T21:41:20.963237] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-24T21:41:21.005030] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T21:41:21.616153] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-24T21:41:22.416055] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-24T21:41:22.686546] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-24T21:41:22.948387] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-24T21:41:23.216084] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-24T21:41:23.324542] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-24T21:41:24.016077] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-24T21:41:24.816078] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-24T21:41:24.945242] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T21:41:24.955217] [INFO ] [REMOTE ] TOL: Full fetch complete (73997 records). [2025-09-24T21:41:24.955359] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-24T21:41:25.371719] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-24T21:41:25.371862] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-24T21:41:25.373157] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-24T21:41:25.373264] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-24T21:41:25.378081] [DEBUG] [LOCAL ] TOL: Trimmed 73997 records to 51079 (keeping 200 days of data) [2025-09-24T21:41:25.508761] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T21:41:25.616222] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-24T21:41:25.752714] [DEBUG] [LOCAL ] TOL: Primary data saved (51079 records). [2025-09-24T21:41:25.752947] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-24T21:41:25.753066] [INFO ] [MAIN ] Update Progress: 2116/2373 symbols completed. TOL took 34.6s. Estimated remaining: 34m 10s. Rate: 7.5 symbols/min [2025-09-24T21:41:25.938627] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:25.963297] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T21:41:26.025177] [DEBUG] [LOCAL ] TPH: Loaded 45210 existing records from primary storage. [2025-09-24T21:41:26.025458] [INFO ] [MAIN ] TPH: Loaded 45210 existing records. [2025-09-24T21:41:26.226294] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:26.226698] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-24T21:41:26.226799] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-24T21:41:26.228216] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-24T21:41:26.228302] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-24T21:41:26.421598] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-24T21:41:26.627389] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:27.216093] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-24T21:41:27.329726] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-24T21:41:28.022713] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-24T21:41:28.043821] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T21:41:28.293923] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T21:41:28.816089] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-24T21:41:29.616115] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-24T21:41:29.999525] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-24T21:41:30.393093] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T21:41:30.416044] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-24T21:41:31.216075] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-24T21:41:31.297270] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T21:41:31.786423] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-24T21:41:32.016039] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-24T21:41:32.816099] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-24T21:41:32.908440] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:41:32.919908] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-24T21:41:32.920157] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-24T21:41:33.375050] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-24T21:41:33.375165] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-24T21:41:33.377064] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-24T21:41:33.377140] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-24T21:41:33.382428] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 53681 (keeping 200 days of data) [2025-09-24T21:41:33.637562] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-24T21:41:33.672905] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T21:41:33.806399] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T21:41:33.835121] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-24T21:41:33.835370] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-24T21:41:33.835612] [INFO ] [MAIN ] Update Progress: 2117/2373 symbols completed. TOST took 42.1s. Estimated remaining: 34m 2s. Rate: 7.5 symbols/min [2025-09-24T21:41:34.416091] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-24T21:41:35.101154] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T21:41:35.216077] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-24T21:41:36.001938] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-24T21:41:36.016028] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-24T21:41:36.344525] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:41:36.816115] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-24T21:41:37.607409] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T21:41:37.616155] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-24T21:41:38.229613] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T21:41:38.416129] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-24T21:41:38.708482] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T21:41:39.216093] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-24T21:41:39.977536] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-24T21:41:40.016034] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-24T21:41:40.771324] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T21:41:40.778530] [INFO ] [REMOTE ] TPC: Full fetch complete (54917 records). [2025-09-24T21:41:40.778714] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-24T21:41:40.822202] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-24T21:41:41.222483] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-24T21:41:41.222713] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-24T21:41:41.223835] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-24T21:41:41.223899] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-24T21:41:41.225247] [DEBUG] [LOCAL ] TPC: Trimmed 54917 records to 38817 (keeping 200 days of data) [2025-09-24T21:41:41.476626] [DEBUG] [LOCAL ] TPC: Primary data saved (38817 records). [2025-09-24T21:41:41.476909] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-24T21:41:41.477114] [INFO ] [MAIN ] Update Progress: 2118/2373 symbols completed. TPC took 25.7s. Estimated remaining: 33m 54s. Rate: 7.5 symbols/min [2025-09-24T21:41:41.507963] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T21:41:41.616059] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-24T21:41:41.873971] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T21:41:42.416150] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-24T21:41:43.184833] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T21:41:43.216040] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-24T21:41:43.493991] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T21:41:43.500573] [INFO ] [REMOTE ] TPB: Full fetch complete (34626 records). [2025-09-24T21:41:43.500754] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-24T21:41:43.978470] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-24T21:41:43.978567] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-24T21:41:43.979383] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-24T21:41:43.979450] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-24T21:41:43.980403] [DEBUG] [LOCAL ] TPB: Trimmed 34626 records to 24883 (keeping 200 days of data) [2025-09-24T21:41:44.145660] [DEBUG] [LOCAL ] TPB: Primary data saved (24883 records). [2025-09-24T21:41:44.145817] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-24T21:41:44.145963] [INFO ] [MAIN ] Update Progress: 2119/2373 symbols completed. TPB took 31.5s. Estimated remaining: 33m 46s. Rate: 7.5 symbols/min [2025-09-24T21:41:44.655684] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T21:41:44.664946] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-24T21:41:46.559787] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T21:41:46.570277] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-24T21:41:48.100339] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T21:41:48.111784] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-24T21:41:49.616392] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:41:49.624224] [INFO ] [REMOTE ] TPH: Full fetch complete (64951 records). [2025-09-24T21:41:49.624388] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-24T21:41:50.036516] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-24T21:41:50.036890] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-24T21:41:50.038059] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-24T21:41:50.038126] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-24T21:41:50.040977] [DEBUG] [LOCAL ] TPH: Trimmed 64951 records to 45185 (keeping 200 days of data) [2025-09-24T21:41:50.324306] [DEBUG] [LOCAL ] TPH: Primary data saved (45185 records). [2025-09-24T21:41:50.324454] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-24T21:41:50.324547] [INFO ] [MAIN ] Update Progress: 2120/2373 symbols completed. TPH took 24.6s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-24T21:41:50.966698] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:51.062684] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:51.106530] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:51.110921] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:41:51.123978] [DEBUG] [LOCAL ] TPYP: Loaded 7880 existing records from primary storage. [2025-09-24T21:41:51.124308] [INFO ] [MAIN ] TPYP: Loaded 7880 existing records. [2025-09-24T21:41:51.253000] [DEBUG] [LOCAL ] TPL: Loaded 12414 existing records from primary storage. [2025-09-24T21:41:51.258554] [INFO ] [MAIN ] TPL: Loaded 12414 existing records. [2025-09-24T21:41:51.422008] [DEBUG] [LOCAL ] TPVG: Loaded 26984 existing records from primary storage. [2025-09-24T21:41:51.479580] [INFO ] [MAIN ] TPVG: Loaded 26984 existing records. [2025-09-24T21:41:51.588841] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:51.708212] [DEBUG] [LOCAL ] TPR: Loaded 53483 existing records from primary storage. [2025-09-24T21:41:51.709293] [INFO ] [MAIN ] TPR: Loaded 53483 existing records. [2025-09-24T21:41:51.725995] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-24T21:41:51.749605] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-24T21:41:51.749472] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:51.810304] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-24T21:41:51.857217] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-24T21:41:51.920522] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-24T21:41:51.931040] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-24T21:41:51.970789] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-24T21:41:52.007791] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-24T21:41:52.049968] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:52.133605] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-24T21:41:52.206550] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-24T21:41:52.345027] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:41:52.341626] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-24T21:41:52.370047] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-24T21:41:52.405570] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-24T21:41:52.474760] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-24T21:41:52.649617] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-24T21:41:52.711276] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-24T21:41:52.978966] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:53.038814] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-24T21:41:53.326088] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:53.389536] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-24T21:41:53.587788] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:53.614863] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-24T21:41:53.649036] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:41:53.649405] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-24T21:41:53.918223] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:41:53.921560] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-24T21:41:54.587346] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T21:41:54.593726] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-24T21:41:54.647743] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T21:41:54.651209] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-24T21:41:54.923014] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-24T21:41:54.930829] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-24T21:41:55.360236] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T21:41:55.363297] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-24T21:41:55.465083] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:41:55.476421] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-24T21:41:55.533793] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T21:41:55.538889] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-24T21:41:56.111939] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-24T21:41:56.120799] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-24T21:41:56.180777] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T21:41:56.183216] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-24T21:41:56.490145] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T21:41:56.816114] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-24T21:41:56.983764] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-24T21:41:57.087619] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-24T21:41:57.148521] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T21:41:57.616149] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-24T21:41:57.872084] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T21:41:58.416087] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-24T21:41:58.752569] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-24T21:41:59.097158] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-24T21:41:59.216093] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-24T21:41:59.987323] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-24T21:42:00.016111] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-24T21:42:00.816067] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-24T21:42:00.824133] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T21:42:01.616165] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-24T21:42:02.195043] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-24T21:42:02.416120] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-24T21:42:03.216106] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-24T21:42:03.329094] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T21:42:04.016049] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-24T21:42:04.072897] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T21:42:04.816092] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-24T21:42:05.068931] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T21:42:05.070929] [INFO ] [REMOTE ] TPYP: Full fetch complete (12538 records). [2025-09-24T21:42:05.071004] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-24T21:42:05.455949] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-24T21:42:05.456071] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-24T21:42:05.456589] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-24T21:42:05.456714] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-24T21:42:05.457463] [DEBUG] [LOCAL ] TPYP: Trimmed 12538 records to 7880 (keeping 200 days of data) [2025-09-24T21:42:05.510178] [DEBUG] [LOCAL ] TPYP: Primary data saved (7880 records). [2025-09-24T21:42:05.510358] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-24T21:42:05.510496] [INFO ] [MAIN ] Update Progress: 2121/2373 symbols completed. TPYP took 15.2s. Estimated remaining: 33m 31s. Rate: 7.5 symbols/min [2025-09-24T21:42:05.621097] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-24T21:42:05.732863] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:05.740465] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-24T21:42:05.756896] [DEBUG] [LOCAL ] TPZ: Loaded 5169 existing records from primary storage. [2025-09-24T21:42:05.757034] [INFO ] [MAIN ] TPZ: Loaded 5169 existing records. [2025-09-24T21:42:05.870033] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T21:42:05.955707] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:05.956038] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-24T21:42:05.956094] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-24T21:42:05.956453] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-24T21:42:05.956515] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-24T21:42:06.314209] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:06.416034] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-24T21:42:07.027147] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T21:42:07.080360] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T21:42:07.216083] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-24T21:42:08.016085] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-24T21:42:08.816110] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-24T21:42:08.860483] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T21:42:09.076247] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T21:42:09.616099] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-24T21:42:10.118895] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:42:10.198665] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T21:42:10.416065] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-24T21:42:11.216072] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-24T21:42:11.697207] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-24T21:42:12.016124] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-24T21:42:12.374227] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T21:42:12.658012] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-24T21:42:12.816098] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-24T21:42:13.616175] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-24T21:42:14.416101] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-24T21:42:14.522961] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-24T21:42:14.525534] [INFO ] [REMOTE ] TPL: Full fetch complete (18261 records). [2025-09-24T21:42:14.525616] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-24T21:42:14.885741] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-24T21:42:15.021579] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-24T21:42:15.021849] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-24T21:42:15.022561] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-24T21:42:15.022612] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-24T21:42:15.023765] [DEBUG] [LOCAL ] TPL: Trimmed 18261 records to 12393 (keeping 200 days of data) [2025-09-24T21:42:15.106503] [DEBUG] [LOCAL ] TPL: Primary data saved (12393 records). [2025-09-24T21:42:15.106707] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-24T21:42:15.106836] [INFO ] [MAIN ] Update Progress: 2122/2373 symbols completed. TPL took 24.8s. Estimated remaining: 33m 23s. Rate: 7.5 symbols/min [2025-09-24T21:42:15.221310] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-24T21:42:15.299062] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:15.322332] [DEBUG] [LOCAL ] TR: Loaded 18319 existing records from primary storage. [2025-09-24T21:42:15.322562] [INFO ] [MAIN ] TR: Loaded 18319 existing records. [2025-09-24T21:42:15.435847] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:42:15.519639] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:15.519945] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-24T21:42:15.520000] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-24T21:42:15.520731] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-24T21:42:15.520795] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-24T21:42:15.877293] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:16.016126] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-24T21:42:16.556004] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-24T21:42:16.816098] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-24T21:42:16.857796] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T21:42:17.616112] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-24T21:42:17.983732] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T21:42:18.416211] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-24T21:42:18.501429] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T21:42:19.199216] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T21:42:19.216045] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-24T21:42:19.821972] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-24T21:42:20.016098] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-24T21:42:20.816301] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-24T21:42:21.616059] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-24T21:42:21.798325] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T21:42:21.839451] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T21:42:22.248734] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-24T21:42:22.416083] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-24T21:42:23.062371] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T21:42:23.216149] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-24T21:42:24.016082] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-24T21:42:24.425397] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T21:42:24.633165] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-24T21:42:24.816074] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-24T21:42:25.504721] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T21:42:25.616077] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-24T21:42:26.416082] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-24T21:42:26.597289] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T21:42:27.216069] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-24T21:42:28.016108] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-24T21:42:28.183496] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-24T21:42:28.189014] [INFO ] [REMOTE ] TPVG: Full fetch complete (40264 records). [2025-09-24T21:42:28.189175] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-24T21:42:28.607783] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-24T21:42:28.607887] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-24T21:42:28.609425] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-24T21:42:28.609497] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-24T21:42:28.610542] [DEBUG] [LOCAL ] TPVG: Trimmed 40264 records to 27022 (keeping 200 days of data) [2025-09-24T21:42:28.772145] [DEBUG] [LOCAL ] TPVG: Primary data saved (27022 records). [2025-09-24T21:42:28.772287] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-24T21:42:28.772374] [INFO ] [MAIN ] Update Progress: 2123/2373 symbols completed. TPVG took 38.4s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-24T21:42:28.836079] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-24T21:42:28.949758] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:28.962222] [DEBUG] [LOCAL ] TRAK: Loaded 9317 existing records from primary storage. [2025-09-24T21:42:28.962769] [INFO ] [MAIN ] TRAK: Loaded 9317 existing records. [2025-09-24T21:42:29.145683] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:29.145978] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-24T21:42:29.146035] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-24T21:42:29.146438] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-24T21:42:29.146499] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-24T21:42:29.329892] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-24T21:42:29.403795] [INFO ] [REMOTE ] TPZ: Full fetch complete (9240 records). [2025-09-24T21:42:29.425594] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-24T21:42:29.670945] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:29.700463] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-24T21:42:29.967955] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T21:42:30.009536] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-24T21:42:30.009688] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-24T21:42:30.010096] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-24T21:42:30.010223] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-24T21:42:30.010964] [DEBUG] [LOCAL ] TPZ: Trimmed 9240 records to 5035 (keeping 200 days of data) [2025-09-24T21:42:30.051848] [DEBUG] [LOCAL ] TPZ: Primary data saved (5035 records). [2025-09-24T21:42:30.052036] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-24T21:42:30.052165] [INFO ] [MAIN ] Update Progress: 2124/2373 symbols completed. TPZ took 24.5s. Estimated remaining: 33m 7s. Rate: 7.5 symbols/min [2025-09-24T21:42:30.227825] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:30.245478] [DEBUG] [LOCAL ] TRC: Loaded 16061 existing records from primary storage. [2025-09-24T21:42:30.245623] [INFO ] [MAIN ] TRC: Loaded 16061 existing records. [2025-09-24T21:42:30.422476] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-24T21:42:30.428347] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:30.429262] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-24T21:42:30.430411] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-24T21:42:30.431016] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-24T21:42:30.431125] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-24T21:42:30.715614] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T21:42:30.831553] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:30.923394] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (3.71 seconds). [2025-09-24T21:42:31.216121] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-24T21:42:31.526186] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T21:42:32.016152] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-24T21:42:32.809419] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T21:42:32.826022] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-24T21:42:32.848998] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T21:42:33.616094] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-24T21:42:33.664355] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T21:42:34.416080] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-24T21:42:34.589495] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-24T21:42:35.216138] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-24T21:42:36.016114] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-24T21:42:36.029891] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T21:42:36.230668] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-24T21:42:36.240127] [INFO ] [REMOTE ] TPR: Full fetch complete (77435 records). [2025-09-24T21:42:36.240273] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-24T21:42:36.671813] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-24T21:42:36.671919] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-24T21:42:36.673207] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-24T21:42:36.673281] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-24T21:42:36.674881] [DEBUG] [LOCAL ] TPR: Trimmed 77435 records to 53477 (keeping 200 days of data) [2025-09-24T21:42:36.816135] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-24T21:42:37.046828] [DEBUG] [LOCAL ] TPR: Primary data saved (53477 records). [2025-09-24T21:42:37.047002] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-24T21:42:37.047096] [INFO ] [MAIN ] Update Progress: 2125/2373 symbols completed. TPR took 46.7s. Estimated remaining: 32m 59s. Rate: 7.5 symbols/min [2025-09-24T21:42:37.247071] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:37.259116] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T21:42:37.313307] [DEBUG] [LOCAL ] TREX: Loaded 50009 existing records from primary storage. [2025-09-24T21:42:37.313491] [INFO ] [MAIN ] TREX: Loaded 50009 existing records. [2025-09-24T21:42:37.516609] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:37.516967] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-24T21:42:37.517035] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-24T21:42:37.518701] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-24T21:42:37.518776] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-24T21:42:37.621351] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-24T21:42:37.889151] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T21:42:37.936967] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:38.416075] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-24T21:42:38.695972] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T21:42:38.700884] [INFO ] [REMOTE ] TR: Full fetch complete (24858 records). [2025-09-24T21:42:38.701051] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-24T21:42:39.136287] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-24T21:42:39.136381] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-24T21:42:39.137038] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-24T21:42:39.137102] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-24T21:42:39.137785] [DEBUG] [LOCAL ] TR: Trimmed 24858 records to 18276 (keeping 200 days of data) [2025-09-24T21:42:39.220871] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-24T21:42:39.240450] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T21:42:39.281488] [DEBUG] [LOCAL ] TR: Primary data saved (18276 records). [2025-09-24T21:42:39.281710] [INFO ] [MAIN ] TR: Full history saved. [2025-09-24T21:42:39.281827] [INFO ] [MAIN ] Update Progress: 2126/2373 symbols completed. TR took 24.2s. Estimated remaining: 32m 50s. Rate: 7.5 symbols/min [2025-09-24T21:42:39.488932] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:39.549750] [DEBUG] [LOCAL ] TRGP: Loaded 50845 existing records from primary storage. [2025-09-24T21:42:39.549919] [INFO ] [MAIN ] TRGP: Loaded 50845 existing records. [2025-09-24T21:42:39.761829] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:39.762098] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-24T21:42:39.762163] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-24T21:42:39.764040] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-24T21:42:39.764105] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-24T21:42:40.021380] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-24T21:42:40.135545] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:40.653841] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T21:42:40.816078] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-24T21:42:40.993358] [DEBUG] [REMOTE ] TREX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-24T21:42:40.993725] [WARN ] [REMOTE ] TREX: No data returned for month 2025-01 [2025-09-24T21:42:41.207888] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-24T21:42:41.616110] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-24T21:42:42.416129] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-24T21:42:43.216203] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-24T21:42:43.923601] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T21:42:44.016110] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-24T21:42:44.381582] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T21:42:44.788590] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-24T21:42:44.816039] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-24T21:42:44.843142] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-24T21:42:45.616085] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-24T21:42:46.323493] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T21:42:46.416070] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-24T21:42:46.658625] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T21:42:47.216122] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-24T21:42:47.795708] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T21:42:48.016069] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-24T21:42:48.106679] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-24T21:42:48.816105] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-24T21:42:49.512286] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-24T21:42:49.538399] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T21:42:49.616121] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-24T21:42:50.416089] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-24T21:42:50.440311] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-24T21:42:51.216109] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-24T21:42:51.956247] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-24T21:42:52.016070] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-24T21:42:52.816115] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-24T21:42:53.079363] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T21:42:53.616090] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-24T21:42:53.679362] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T21:42:54.163767] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-24T21:42:54.416127] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-24T21:42:55.216205] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-24T21:42:56.016127] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-24T21:42:56.175826] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T21:42:56.360069] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-24T21:42:56.822348] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-24T21:42:56.830221] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-24T21:42:57.006960] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T21:42:57.323022] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T21:42:57.326962] [INFO ] [REMOTE ] TRAK: Full fetch complete (13405 records). [2025-09-24T21:42:57.327066] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-24T21:42:57.621366] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-24T21:42:57.744294] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-24T21:42:57.744394] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-24T21:42:57.745011] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-24T21:42:57.745080] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-24T21:42:57.745737] [DEBUG] [LOCAL ] TRAK: Trimmed 13405 records to 9304 (keeping 200 days of data) [2025-09-24T21:42:57.807144] [DEBUG] [LOCAL ] TRAK: Primary data saved (9304 records). [2025-09-24T21:42:57.807379] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-24T21:42:57.807530] [INFO ] [MAIN ] Update Progress: 2127/2373 symbols completed. TRAK took 29.0s. Estimated remaining: 32m 43s. Rate: 7.5 symbols/min [2025-09-24T21:42:57.994578] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:42:58.049616] [DEBUG] [LOCAL ] TRN: Loaded 37402 existing records from primary storage. [2025-09-24T21:42:58.049833] [INFO ] [MAIN ] TRN: Loaded 37402 existing records. [2025-09-24T21:42:58.240392] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:42:58.240774] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-24T21:42:58.240835] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-24T21:42:58.242035] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-24T21:42:58.242098] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-24T21:42:58.422791] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-24T21:42:58.584226] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-24T21:42:58.649606] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:42:59.216132] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-24T21:43:00.016131] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-24T21:43:00.069300] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T21:43:00.577085] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T21:43:00.816139] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-24T21:43:01.616115] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-24T21:43:01.842348] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-24T21:43:02.416075] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-24T21:43:02.487750] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-24T21:43:02.491897] [INFO ] [REMOTE ] TRC: Full fetch complete (22154 records). [2025-09-24T21:43:02.492054] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-24T21:43:02.921306] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-24T21:43:02.924694] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-24T21:43:02.927998] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-24T21:43:02.926343] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-24T21:43:02.938344] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-24T21:43:02.939980] [DEBUG] [LOCAL ] TRC: Trimmed 22154 records to 16028 (keeping 200 days of data) [2025-09-24T21:43:03.050498] [DEBUG] [LOCAL ] TRC: Primary data saved (16028 records). [2025-09-24T21:43:03.050739] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-24T21:43:03.050863] [INFO ] [MAIN ] Update Progress: 2128/2373 symbols completed. TRC took 33.0s. Estimated remaining: 32m 35s. Rate: 7.5 symbols/min [2025-09-24T21:43:03.221234] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-24T21:43:03.252229] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:03.314100] [DEBUG] [LOCAL ] TRNO: Loaded 44131 existing records from primary storage. [2025-09-24T21:43:03.314417] [INFO ] [MAIN ] TRNO: Loaded 44131 existing records. [2025-09-24T21:43:03.509053] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:03.509413] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-24T21:43:03.509468] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-24T21:43:03.510686] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-24T21:43:03.510749] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-24T21:43:03.907463] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:04.016135] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-24T21:43:04.109684] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T21:43:04.722633] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T21:43:04.816151] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-24T21:43:05.509447] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:43:05.616099] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-24T21:43:06.285072] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-24T21:43:06.416110] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-24T21:43:07.216103] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-24T21:43:07.369055] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:43:07.790398] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T21:43:08.016084] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-24T21:43:08.724223] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T21:43:08.816094] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-24T21:43:09.621164] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-24T21:43:09.634366] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T21:43:09.644690] [INFO ] [REMOTE ] TREX: Full fetch complete (64357 records). [2025-09-24T21:43:09.644885] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-24T21:43:09.847269] [WARN ] [VALIDATOR ] TREX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-24T21:43:09.848105] [FATAL] [MAIN ] TREX: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:43:09.848191] [WARN ] [MAIN ] TREX: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:43:09.848268] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-24T21:43:09.848361] [DEBUG] [LOCAL ] TREX: No primary data file found to delete. [2025-09-24T21:43:09.848420] [INFO ] [LOCAL ] TREX: Starting deletion of derivative data. [2025-09-24T21:43:09.849003] [DEBUG] [LOCAL ] TREX: Deleted derivative data file. [2025-09-24T21:43:09.849124] [INFO ] [MAIN ] Update Progress: 2129/2373 symbols completed. TREX took 32.8s. Estimated remaining: 32m 27s. Rate: 7.5 symbols/min [2025-09-24T21:43:10.045832] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:10.101926] [DEBUG] [LOCAL ] TROX: Loaded 51774 existing records from primary storage. [2025-09-24T21:43:10.102217] [INFO ] [MAIN ] TROX: Loaded 51774 existing records. [2025-09-24T21:43:10.363604] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T21:43:10.361511] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:10.379871] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-24T21:43:10.379990] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-24T21:43:10.381777] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-24T21:43:10.381853] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-24T21:43:10.421270] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-24T21:43:10.749725] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:11.191982] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T21:43:11.216038] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-24T21:43:12.025276] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-24T21:43:12.027832] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:43:12.715691] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T21:43:12.816087] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-24T21:43:13.540036] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T21:43:13.616099] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-24T21:43:14.420028] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-24T21:43:14.429248] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T21:43:14.925714] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T21:43:15.216075] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-24T21:43:16.016058] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-24T21:43:16.131609] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T21:43:16.140789] [INFO ] [REMOTE ] TRGP: Full fetch complete (73507 records). [2025-09-24T21:43:16.140962] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-24T21:43:16.561108] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-24T21:43:16.561233] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-24T21:43:16.562453] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-24T21:43:16.562624] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-24T21:43:16.564237] [DEBUG] [LOCAL ] TRGP: Trimmed 73507 records to 50808 (keeping 200 days of data) [2025-09-24T21:43:16.688556] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T21:43:16.829799] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-24T21:43:16.942771] [DEBUG] [LOCAL ] TRGP: Primary data saved (50808 records). [2025-09-24T21:43:16.942981] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-24T21:43:16.943231] [INFO ] [MAIN ] Update Progress: 2130/2373 symbols completed. TRGP took 37.7s. Estimated remaining: 32m 19s. Rate: 7.5 symbols/min [2025-09-24T21:43:17.136179] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:17.193034] [DEBUG] [LOCAL ] TRP: Loaded 52132 existing records from primary storage. [2025-09-24T21:43:17.193229] [INFO ] [MAIN ] TRP: Loaded 52132 existing records. [2025-09-24T21:43:17.403116] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:17.403609] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-24T21:43:17.403796] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-24T21:43:17.414550] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-24T21:43:17.430767] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-24T21:43:17.507847] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T21:43:17.629098] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-24T21:43:17.873790] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:18.080724] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T21:43:18.416097] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-24T21:43:19.093177] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T21:43:19.216077] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-24T21:43:20.016089] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-24T21:43:20.128742] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-24T21:43:20.788240] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T21:43:20.816072] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-24T21:43:21.564432] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T21:43:21.616087] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-24T21:43:22.416075] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-24T21:43:22.454636] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T21:43:23.038720] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T21:43:23.216091] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-24T21:43:24.016078] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-24T21:43:24.171514] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T21:43:24.384997] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-24T21:43:24.816075] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-24T21:43:25.227033] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-24T21:43:25.233930] [INFO ] [REMOTE ] TRN: Full fetch complete (52979 records). [2025-09-24T21:43:25.234161] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-24T21:43:25.621304] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-24T21:43:25.757635] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-24T21:43:25.757800] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-24T21:43:25.760086] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-24T21:43:25.760260] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-24T21:43:25.761880] [DEBUG] [LOCAL ] TRN: Trimmed 52979 records to 37380 (keeping 200 days of data) [2025-09-24T21:43:26.091891] [DEBUG] [LOCAL ] TRN: Primary data saved (37380 records). [2025-09-24T21:43:26.092133] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-24T21:43:26.092339] [INFO ] [MAIN ] Update Progress: 2131/2373 symbols completed. TRN took 28.3s. Estimated remaining: 32m 11s. Rate: 7.5 symbols/min [2025-09-24T21:43:26.341873] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:26.399730] [DEBUG] [LOCAL ] TRTX: Loaded 37337 existing records from primary storage. [2025-09-24T21:43:26.400075] [INFO ] [MAIN ] TRTX: Loaded 37337 existing records. [2025-09-24T21:43:26.418320] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-24T21:43:26.637405] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:26.651338] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-24T21:43:26.651516] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-24T21:43:26.655724] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-24T21:43:26.657462] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T21:43:26.657615] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-24T21:43:27.046069] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:27.216101] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-24T21:43:27.407883] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:43:28.016154] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-24T21:43:28.084936] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T21:43:28.816069] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-24T21:43:28.858457] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T21:43:29.363850] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T21:43:29.616080] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-24T21:43:30.416115] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-24T21:43:30.598130] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-24T21:43:31.216150] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-24T21:43:31.382950] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T21:43:31.458008] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:43:32.016130] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-24T21:43:32.816120] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-24T21:43:32.904181] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:43:32.912955] [INFO ] [REMOTE ] TRNO: Full fetch complete (64064 records). [2025-09-24T21:43:32.913184] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-24T21:43:33.360966] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T21:43:33.364726] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-24T21:43:33.371539] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-24T21:43:33.372876] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-24T21:43:33.373389] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-24T21:43:33.375045] [DEBUG] [LOCAL ] TRNO: Trimmed 64064 records to 44052 (keeping 200 days of data) [2025-09-24T21:43:33.618116] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-24T21:43:33.677197] [DEBUG] [LOCAL ] TRNO: Primary data saved (44052 records). [2025-09-24T21:43:33.677369] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-24T21:43:33.677544] [INFO ] [MAIN ] Update Progress: 2132/2373 symbols completed. TRNO took 30.6s. Estimated remaining: 32m 3s. Rate: 7.5 symbols/min [2025-09-24T21:43:33.874253] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:33.935565] [DEBUG] [LOCAL ] TRU: Loaded 51195 existing records from primary storage. [2025-09-24T21:43:33.935763] [INFO ] [MAIN ] TRU: Loaded 51195 existing records. [2025-09-24T21:43:34.145363] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:34.145751] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-24T21:43:34.145813] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-24T21:43:34.147201] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-24T21:43:34.147264] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-24T21:43:34.421373] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-24T21:43:34.550560] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:34.667198] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T21:43:35.216099] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-24T21:43:35.342215] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T21:43:35.809399] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T21:43:36.016120] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-24T21:43:36.821208] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-24T21:43:36.839066] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:43:37.616101] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-24T21:43:37.663023] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T21:43:38.416069] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-24T21:43:38.580040] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T21:43:39.179691] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T21:43:39.216039] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-24T21:43:39.806958] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T21:43:40.016089] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-24T21:43:40.826358] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-24T21:43:40.829632] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T21:43:41.616050] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-24T21:43:42.103148] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T21:43:42.416057] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-24T21:43:42.605423] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-24T21:43:43.216067] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-24T21:43:43.277883] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T21:43:44.016080] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-24T21:43:44.122193] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T21:43:44.816092] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-24T21:43:45.045757] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:43:45.306628] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T21:43:45.616118] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-24T21:43:46.416076] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-24T21:43:46.502351] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:43:46.511762] [INFO ] [REMOTE ] TRP: Full fetch complete (75553 records). [2025-09-24T21:43:46.511913] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-24T21:43:47.006404] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-24T21:43:47.006581] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-24T21:43:47.007889] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-24T21:43:47.007957] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-24T21:43:47.010621] [DEBUG] [LOCAL ] TRP: Trimmed 75553 records to 52118 (keeping 200 days of data) [2025-09-24T21:43:47.217849] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-24T21:43:47.403222] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T21:43:47.430032] [DEBUG] [LOCAL ] TRP: Primary data saved (52118 records). [2025-09-24T21:43:47.430202] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-24T21:43:47.430360] [INFO ] [MAIN ] Update Progress: 2133/2373 symbols completed. TRP took 30.5s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-24T21:43:47.600723] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:47.664243] [DEBUG] [LOCAL ] TRV: Loaded 48229 existing records from primary storage. [2025-09-24T21:43:47.664621] [INFO ] [MAIN ] TRV: Loaded 48229 existing records. [2025-09-24T21:43:47.854718] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:47.855266] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-24T21:43:47.855327] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-24T21:43:47.856743] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-24T21:43:47.856808] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-24T21:43:48.018294] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-24T21:43:48.275576] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:48.280851] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-24T21:43:48.290503] [INFO ] [REMOTE ] TROX: Full fetch complete (72631 records). [2025-09-24T21:43:48.290681] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-24T21:43:48.703789] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-24T21:43:48.703911] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-24T21:43:48.705177] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-24T21:43:48.705288] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-24T21:43:48.727449] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T21:43:48.735135] [DEBUG] [LOCAL ] TROX: Trimmed 72631 records to 51772 (keeping 200 days of data) [2025-09-24T21:43:48.832325] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-24T21:43:49.055013] [DEBUG] [LOCAL ] TROX: Primary data saved (51772 records). [2025-09-24T21:43:49.055166] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-24T21:43:49.055267] [INFO ] [MAIN ] Update Progress: 2134/2373 symbols completed. TROX took 39.2s. Estimated remaining: 31m 47s. Rate: 7.5 symbols/min [2025-09-24T21:43:49.225814] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:49.292050] [DEBUG] [LOCAL ] TS: Loaded 51665 existing records from primary storage. [2025-09-24T21:43:49.293474] [INFO ] [MAIN ] TS: Loaded 51665 existing records. [2025-09-24T21:43:49.473779] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:49.474158] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-24T21:43:49.474215] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-24T21:43:49.476234] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-24T21:43:49.476296] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-24T21:43:49.617381] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-24T21:43:49.915318] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:49.972066] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-24T21:43:50.237626] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T21:43:50.416092] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-24T21:43:51.216101] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-24T21:43:51.498673] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-24T21:43:51.563824] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:43:52.016102] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-24T21:43:52.530042] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T21:43:52.816142] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-24T21:43:53.616056] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-24T21:43:53.718184] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-24T21:43:54.416074] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-24T21:43:54.622858] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T21:43:55.216079] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-24T21:43:55.450402] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T21:43:55.703312] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T21:43:55.710339] [INFO ] [REMOTE ] TRTX: Full fetch complete (52948 records). [2025-09-24T21:43:55.710500] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-24T21:43:56.021164] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-24T21:43:56.102180] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-24T21:43:56.102264] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-24T21:43:56.103416] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-24T21:43:56.103484] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-24T21:43:56.104686] [DEBUG] [LOCAL ] TRTX: Trimmed 52948 records to 37423 (keeping 200 days of data) [2025-09-24T21:43:56.338709] [DEBUG] [LOCAL ] TRTX: Primary data saved (37423 records). [2025-09-24T21:43:56.338879] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-24T21:43:56.339024] [INFO ] [MAIN ] Update Progress: 2135/2373 symbols completed. TRTX took 30.2s. Estimated remaining: 31m 39s. Rate: 7.5 symbols/min [2025-09-24T21:43:56.545401] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:43:56.577278] [DEBUG] [LOCAL ] TSE: Loaded 28764 existing records from primary storage. [2025-09-24T21:43:56.577435] [INFO ] [MAIN ] TSE: Loaded 28764 existing records. [2025-09-24T21:43:56.822258] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-24T21:43:56.854591] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:43:56.854758] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:43:56.865420] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-24T21:43:56.865490] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-24T21:43:56.866620] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-24T21:43:56.866721] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-24T21:43:57.238809] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:43:57.616105] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-24T21:43:57.857690] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T21:43:58.424210] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-24T21:43:58.447169] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:43:58.654829] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:43:59.216099] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-24T21:44:00.016171] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-24T21:44:00.086279] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T21:44:00.816152] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-24T21:44:01.425038] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T21:44:01.471969] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-24T21:44:01.616176] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-24T21:44:02.416177] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-24T21:44:02.620377] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T21:44:02.854411] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T21:44:03.216111] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-24T21:44:04.016156] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-24T21:44:04.350049] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T21:44:04.386629] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T21:44:04.816139] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-24T21:44:05.616116] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-24T21:44:05.940435] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T21:44:06.116794] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:44:06.416104] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-24T21:44:07.216047] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-24T21:44:07.299912] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T21:44:07.798048] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T21:44:07.807340] [INFO ] [REMOTE ] TRU: Full fetch complete (73096 records). [2025-09-24T21:44:07.807477] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-24T21:44:08.024139] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-24T21:44:08.223956] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-24T21:44:08.224090] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-24T21:44:08.225353] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-24T21:44:08.225430] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-24T21:44:08.227228] [DEBUG] [LOCAL ] TRU: Trimmed 73096 records to 51194 (keeping 200 days of data) [2025-09-24T21:44:08.566869] [DEBUG] [LOCAL ] TRU: Primary data saved (51194 records). [2025-09-24T21:44:08.567036] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-24T21:44:08.567147] [INFO ] [MAIN ] Update Progress: 2136/2373 symbols completed. TRU took 34.9s. Estimated remaining: 31m 31s. Rate: 7.5 symbols/min [2025-09-24T21:44:08.691313] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T21:44:08.796589] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:08.811788] [DEBUG] [LOCAL ] TSI: Loaded 8206 existing records from primary storage. [2025-09-24T21:44:08.812010] [INFO ] [MAIN ] TSI: Loaded 8206 existing records. [2025-09-24T21:44:08.827468] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-24T21:44:09.030299] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:09.030610] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-24T21:44:09.030692] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-24T21:44:09.031092] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-24T21:44:09.031151] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-24T21:44:09.413973] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:09.621142] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-24T21:44:09.638514] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T21:44:10.069225] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T21:44:10.416141] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-24T21:44:10.930997] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-24T21:44:11.216073] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-24T21:44:11.530159] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T21:44:12.016114] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-24T21:44:12.638144] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T21:44:12.816107] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-24T21:44:13.088436] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T21:44:13.521954] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-24T21:44:13.616052] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-24T21:44:14.324763] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T21:44:14.416076] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-24T21:44:15.196357] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-24T21:44:15.216055] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-24T21:44:16.016119] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-24T21:44:16.677445] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T21:44:16.816100] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-24T21:44:17.616103] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-24T21:44:17.899622] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T21:44:18.181359] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T21:44:18.416080] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-24T21:44:18.485597] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:44:19.216119] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-24T21:44:19.567461] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:44:20.016122] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-24T21:44:20.723165] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T21:44:20.732118] [INFO ] [REMOTE ] TRV: Full fetch complete (70005 records). [2025-09-24T21:44:20.732271] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-24T21:44:20.821163] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-24T21:44:21.160798] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-24T21:44:21.160956] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-24T21:44:21.162353] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-24T21:44:21.162442] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-24T21:44:21.164606] [DEBUG] [LOCAL ] TRV: Trimmed 70005 records to 48131 (keeping 200 days of data) [2025-09-24T21:44:21.197038] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T21:44:21.475230] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T21:44:21.558403] [DEBUG] [LOCAL ] TRV: Primary data saved (48131 records). [2025-09-24T21:44:21.558557] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-24T21:44:21.558733] [INFO ] [MAIN ] Update Progress: 2137/2373 symbols completed. TRV took 34.1s. Estimated remaining: 31m 24s. Rate: 7.5 symbols/min [2025-09-24T21:44:21.623398] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-24T21:44:21.741931] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:21.782291] [DEBUG] [LOCAL ] TSLX: Loaded 35229 existing records from primary storage. [2025-09-24T21:44:21.782454] [INFO ] [MAIN ] TSLX: Loaded 35229 existing records. [2025-09-24T21:44:21.969986] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:21.970249] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-24T21:44:21.970298] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-24T21:44:21.971383] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-24T21:44:21.971443] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-24T21:44:22.341622] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:22.348018] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T21:44:22.416051] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-24T21:44:23.167247] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-24T21:44:23.216034] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-24T21:44:24.016127] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-24T21:44:24.199211] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T21:44:24.203720] [INFO ] [REMOTE ] TSE: Full fetch complete (41875 records). [2025-09-24T21:44:24.203870] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-24T21:44:24.585885] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-24T21:44:24.585981] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-24T21:44:24.586950] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-24T21:44:24.587014] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-24T21:44:24.588120] [DEBUG] [LOCAL ] TSE: Trimmed 41875 records to 28733 (keeping 200 days of data) [2025-09-24T21:44:24.764863] [DEBUG] [LOCAL ] TSE: Primary data saved (28733 records). [2025-09-24T21:44:24.765023] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-24T21:44:24.765139] [INFO ] [MAIN ] Update Progress: 2138/2373 symbols completed. TSE took 28.4s. Estimated remaining: 31m 15s. Rate: 7.5 symbols/min [2025-09-24T21:44:24.829758] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-24T21:44:24.944276] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:25.003872] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-24T21:44:25.004023] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-24T21:44:25.192457] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:25.193087] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-24T21:44:25.193171] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-24T21:44:25.195217] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-24T21:44:25.195287] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-24T21:44:25.364285] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T21:44:25.597879] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:25.616041] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-24T21:44:25.756923] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T21:44:25.759040] [INFO ] [REMOTE ] TSI: Full fetch complete (13302 records). [2025-09-24T21:44:25.759119] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-24T21:44:26.206023] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-24T21:44:26.206111] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-24T21:44:26.206475] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-24T21:44:26.206516] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-24T21:44:26.207113] [DEBUG] [LOCAL ] TSI: Trimmed 13302 records to 8034 (keeping 200 days of data) [2025-09-24T21:44:26.255562] [DEBUG] [LOCAL ] TSI: Primary data saved (8034 records). [2025-09-24T21:44:26.255746] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-24T21:44:26.255864] [INFO ] [MAIN ] Update Progress: 2139/2373 symbols completed. TSI took 17.7s. Estimated remaining: 31m 7s. Rate: 7.5 symbols/min [2025-09-24T21:44:26.421601] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-24T21:44:26.423843] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:26.480516] [DEBUG] [LOCAL ] TSN: Loaded 52872 existing records from primary storage. [2025-09-24T21:44:26.480713] [INFO ] [MAIN ] TSN: Loaded 52872 existing records. [2025-09-24T21:44:26.656959] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:26.657210] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-24T21:44:26.657259] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-24T21:44:26.658785] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-24T21:44:26.658847] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-24T21:44:27.077846] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:27.216096] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-24T21:44:27.555092] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-24T21:44:28.016084] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-24T21:44:28.133386] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-24T21:44:28.707718] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:44:28.816093] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-24T21:44:29.462369] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T21:44:29.616101] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-24T21:44:30.170416] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T21:44:30.416085] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-24T21:44:31.216059] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-24T21:44:31.360818] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T21:44:31.370482] [INFO ] [REMOTE ] TS: Full fetch complete (74455 records). [2025-09-24T21:44:31.370695] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-24T21:44:31.784273] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-24T21:44:31.784449] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-24T21:44:31.785836] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-24T21:44:31.785964] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-24T21:44:31.787985] [DEBUG] [LOCAL ] TS: Trimmed 74455 records to 51662 (keeping 200 days of data) [2025-09-24T21:44:31.908781] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T21:44:32.017912] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-24T21:44:32.156241] [DEBUG] [LOCAL ] TS: Primary data saved (51662 records). [2025-09-24T21:44:32.156408] [INFO ] [MAIN ] TS: Full history saved. [2025-09-24T21:44:32.156504] [INFO ] [MAIN ] Update Progress: 2140/2373 symbols completed. TS took 43.1s. Estimated remaining: 30m 58s. Rate: 7.5 symbols/min [2025-09-24T21:44:32.335032] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:32.347564] [DEBUG] [LOCAL ] TSQ: Loaded 12114 existing records from primary storage. [2025-09-24T21:44:32.347703] [INFO ] [MAIN ] TSQ: Loaded 12114 existing records. [2025-09-24T21:44:32.552063] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:32.552391] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-24T21:44:32.552455] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-24T21:44:32.552918] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-24T21:44:32.553011] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-24T21:44:32.825164] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-24T21:44:32.917813] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:33.616096] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-24T21:44:33.868958] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T21:44:33.919907] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-24T21:44:33.950290] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T21:44:34.420680] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-24T21:44:34.423667] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-24T21:44:35.216066] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-24T21:44:36.016085] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-24T21:44:36.224551] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T21:44:36.710592] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T21:44:36.816065] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-24T21:44:37.616094] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-24T21:44:38.251254] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T21:44:38.361107] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T21:44:38.416101] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-24T21:44:38.652590] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-24T21:44:39.216097] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-24T21:44:39.869306] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T21:44:40.016096] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-24T21:44:40.816151] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-24T21:44:41.458419] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T21:44:41.611546] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-24T21:44:41.616019] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-24T21:44:41.865889] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-24T21:44:42.408079] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-24T21:44:42.416033] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-24T21:44:43.216045] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-24T21:44:43.369344] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-24T21:44:44.016127] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-24T21:44:44.816063] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-24T21:44:44.969953] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-24T21:44:45.616121] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-24T21:44:45.868547] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-24T21:44:46.283967] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T21:44:46.416065] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-24T21:44:47.216083] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-24T21:44:47.506167] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T21:44:47.766425] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:44:48.016138] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-24T21:44:48.816159] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-24T21:44:49.096847] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T21:44:49.102618] [INFO ] [REMOTE ] TSLX: Full fetch complete (48991 records). [2025-09-24T21:44:49.102745] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-24T21:44:49.496560] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-24T21:44:49.496678] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-24T21:44:49.497706] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-24T21:44:49.497769] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-24T21:44:49.498812] [DEBUG] [LOCAL ] TSLX: Trimmed 48991 records to 35254 (keeping 200 days of data) [2025-09-24T21:44:49.616325] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-24T21:44:49.732398] [DEBUG] [LOCAL ] TSLX: Primary data saved (35254 records). [2025-09-24T21:44:49.732540] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-24T21:44:49.732681] [INFO ] [MAIN ] Update Progress: 2141/2373 symbols completed. TSLX took 28.2s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-24T21:44:49.911833] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:49.967745] [DEBUG] [LOCAL ] TT: Loaded 47893 existing records from primary storage. [2025-09-24T21:44:49.968400] [INFO ] [MAIN ] TT: Loaded 47893 existing records. [2025-09-24T21:44:49.979882] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T21:44:50.166331] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:44:50.167248] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-24T21:44:50.167329] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-24T21:44:50.178479] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-24T21:44:50.193014] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-24T21:44:50.255281] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-24T21:44:50.424732] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-24T21:44:50.580973] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:51.186991] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T21:44:51.216027] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-24T21:44:51.320384] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T21:44:52.016134] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-24T21:44:52.816149] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-24T21:44:53.133458] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-24T21:44:53.312296] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T21:44:53.616082] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-24T21:44:53.768780] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:44:54.265140] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T21:44:54.267553] [INFO ] [REMOTE ] TSQ: Full fetch complete (16707 records). [2025-09-24T21:44:54.267633] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-24T21:44:54.421255] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-24T21:44:54.656530] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-24T21:44:54.656635] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-24T21:44:54.657182] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-24T21:44:54.657230] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-24T21:44:54.657963] [DEBUG] [LOCAL ] TSQ: Trimmed 16707 records to 12093 (keeping 200 days of data) [2025-09-24T21:44:54.745900] [DEBUG] [LOCAL ] TSQ: Primary data saved (12093 records). [2025-09-24T21:44:54.746081] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-24T21:44:54.746184] [INFO ] [MAIN ] Update Progress: 2142/2373 symbols completed. TSQ took 22.6s. Estimated remaining: 30m 43s. Rate: 7.5 symbols/min [2025-09-24T21:44:54.921023] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:44:54.921274] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-24T21:44:54.921345] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-24T21:44:54.921589] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-24T21:44:54.921780] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-24T21:44:54.921923] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-24T21:44:54.921979] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-24T21:44:55.221225] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-24T21:44:55.350202] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:44:55.354429] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-24T21:44:56.016149] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-24T21:44:56.258553] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:44:56.259017] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-24T21:44:56.816131] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-24T21:44:57.044336] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:44:57.044731] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-24T21:44:57.616178] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-24T21:44:57.936476] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-24T21:44:58.416115] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-24T21:44:58.805613] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T21:44:59.216090] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-24T21:45:00.016150] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-24T21:45:00.596557] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T21:45:00.816114] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-24T21:45:00.895014] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-24T21:45:01.616093] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-24T21:45:01.988573] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-24T21:45:01.998962] [INFO ] [REMOTE ] TSN: Full fetch complete (76242 records). [2025-09-24T21:45:01.999231] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-24T21:45:02.427326] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-24T21:45:02.423079] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-24T21:45:02.428529] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-24T21:45:02.430288] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-24T21:45:02.430579] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-24T21:45:02.433010] [DEBUG] [LOCAL ] TSN: Trimmed 76242 records to 52869 (keeping 200 days of data) [2025-09-24T21:45:02.804156] [DEBUG] [LOCAL ] TSN: Primary data saved (52869 records). [2025-09-24T21:45:02.804379] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-24T21:45:02.804491] [INFO ] [MAIN ] Update Progress: 2143/2373 symbols completed. TSN took 36.5s. Estimated remaining: 30m 35s. Rate: 7.5 symbols/min [2025-09-24T21:45:02.996082] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:03.050807] [DEBUG] [LOCAL ] TTC: Loaded 42609 existing records from primary storage. [2025-09-24T21:45:03.051083] [INFO ] [MAIN ] TTC: Loaded 42609 existing records. [2025-09-24T21:45:03.254802] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:03.255691] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-24T21:45:03.255832] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-24T21:45:03.257200] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-24T21:45:03.257268] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-24T21:45:03.674573] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-09-24T21:45:03.681286] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:03.692524] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-24T21:45:04.016186] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-24T21:45:04.701110] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-24T21:45:04.816048] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-24T21:45:05.260798] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (3.64 seconds). [2025-09-24T21:45:05.441101] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T21:45:05.510614] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:45:05.610436] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T21:45:05.616034] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-24T21:45:06.416086] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-24T21:45:06.787575] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T21:45:07.216095] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-24T21:45:08.016089] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-24T21:45:08.816090] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-24T21:45:09.007999] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:45:09.047098] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-24T21:45:09.057091] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-24T21:45:09.057273] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-24T21:45:09.496507] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-24T21:45:09.496673] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-24T21:45:09.498269] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-24T21:45:09.498365] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-24T21:45:09.524600] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T21:45:09.532984] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-09-24T21:45:09.630679] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-24T21:45:09.895140] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-24T21:45:09.895403] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-24T21:45:09.895505] [INFO ] [MAIN ] Update Progress: 2144/2373 symbols completed. TSM took 45.1s. Estimated remaining: 30m 27s. Rate: 7.5 symbols/min [2025-09-24T21:45:10.065788] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:10.122463] [DEBUG] [LOCAL ] TTE: Loaded 51652 existing records from primary storage. [2025-09-24T21:45:10.122623] [INFO ] [MAIN ] TTE: Loaded 51652 existing records. [2025-09-24T21:45:10.309485] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:10.309892] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-24T21:45:10.310057] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-24T21:45:10.311376] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-24T21:45:10.311442] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-24T21:45:10.416235] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-24T21:45:10.447707] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:45:10.718857] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:11.216045] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-24T21:45:11.631775] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T21:45:11.901841] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-24T21:45:12.016325] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-24T21:45:12.816128] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-24T21:45:13.497392] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:45:13.502233] [INFO ] [REMOTE ] TTAM: Full fetch complete (32903 records). [2025-09-24T21:45:13.502319] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-24T21:45:13.621290] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-24T21:45:13.697820] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-24T21:45:13.698335] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:45:13.698480] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:45:13.698565] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-24T21:45:13.698670] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-24T21:45:13.699002] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-24T21:45:13.699211] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-24T21:45:13.699337] [INFO ] [MAIN ] Update Progress: 2145/2373 symbols completed. TTAM took 19.0s. Estimated remaining: 30m 19s. Rate: 7.5 symbols/min [2025-09-24T21:45:13.881759] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:13.927232] [DEBUG] [LOCAL ] TTI: Loaded 45312 existing records from primary storage. [2025-09-24T21:45:13.927436] [INFO ] [MAIN ] TTI: Loaded 45312 existing records. [2025-09-24T21:45:14.110677] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:14.111101] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-24T21:45:14.111330] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-24T21:45:14.112671] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-24T21:45:14.112737] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-24T21:45:14.355870] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (3.14 seconds). [2025-09-24T21:45:14.432250] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-24T21:45:14.543677] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:15.216089] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-24T21:45:15.574625] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-24T21:45:16.000771] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-24T21:45:16.016063] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-24T21:45:16.388006] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T21:45:16.466628] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-24T21:45:16.816115] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-24T21:45:17.503585] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T21:45:17.616112] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-24T21:45:18.357739] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:45:18.416098] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-24T21:45:19.221320] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-24T21:45:19.242522] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-24T21:45:19.895212] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:45:20.016081] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-24T21:45:20.816124] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-24T21:45:20.887495] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:45:21.599176] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T21:45:21.616033] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-24T21:45:22.422114] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-24T21:45:22.431835] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T21:45:22.989888] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T21:45:23.216158] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-24T21:45:24.016049] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-24T21:45:24.474886] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-24T21:45:24.816074] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-24T21:45:24.907119] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T21:45:25.611664] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T21:45:25.621321] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-24T21:45:26.416100] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-24T21:45:26.652082] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T21:45:27.216055] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-24T21:45:27.641004] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-24T21:45:27.779145] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T21:45:27.787441] [INFO ] [REMOTE ] TT: Full fetch complete (69791 records). [2025-09-24T21:45:27.787585] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-24T21:45:28.024069] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-24T21:45:28.238603] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T21:45:28.272613] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-24T21:45:28.273231] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-24T21:45:28.274601] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-24T21:45:28.275058] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-24T21:45:28.276746] [DEBUG] [LOCAL ] TT: Trimmed 69791 records to 47821 (keeping 200 days of data) [2025-09-24T21:45:28.610459] [DEBUG] [LOCAL ] TT: Primary data saved (47821 records). [2025-09-24T21:45:28.610615] [INFO ] [MAIN ] TT: Full history saved. [2025-09-24T21:45:28.610750] [INFO ] [MAIN ] Update Progress: 2146/2373 symbols completed. TT took 38.9s. Estimated remaining: 30m 11s. Rate: 7.5 symbols/min [2025-09-24T21:45:28.797743] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:28.816126] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-24T21:45:28.857523] [DEBUG] [LOCAL ] TU: Loaded 49920 existing records from primary storage. [2025-09-24T21:45:28.857724] [INFO ] [MAIN ] TU: Loaded 49920 existing records. [2025-09-24T21:45:29.042299] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:29.042695] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-24T21:45:29.042771] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-24T21:45:29.044031] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-24T21:45:29.044103] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-24T21:45:29.425585] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:29.616097] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-24T21:45:29.942045] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-24T21:45:30.416065] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-24T21:45:30.457318] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T21:45:31.083942] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T21:45:31.216096] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-24T21:45:32.016060] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-24T21:45:32.190415] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T21:45:32.816102] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-24T21:45:32.879779] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T21:45:33.179583] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-24T21:45:33.616103] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-24T21:45:34.416053] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-24T21:45:34.447146] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:45:34.680639] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T21:45:35.216125] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-24T21:45:36.016139] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-24T21:45:36.331833] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-24T21:45:36.682178] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T21:45:36.816124] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-24T21:45:37.356200] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T21:45:37.364239] [INFO ] [REMOTE ] TTI: Full fetch complete (64906 records). [2025-09-24T21:45:37.364434] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-24T21:45:37.621166] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-24T21:45:37.775681] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-24T21:45:37.775795] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-24T21:45:37.777542] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-24T21:45:37.777636] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-24T21:45:37.782596] [DEBUG] [LOCAL ] TTI: Trimmed 64906 records to 45370 (keeping 200 days of data) [2025-09-24T21:45:38.075594] [DEBUG] [LOCAL ] TTI: Primary data saved (45370 records). [2025-09-24T21:45:38.075786] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-24T21:45:38.075983] [INFO ] [MAIN ] Update Progress: 2147/2373 symbols completed. TTI took 24.4s. Estimated remaining: 30m 4s. Rate: 7.5 symbols/min [2025-09-24T21:45:38.297374] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:38.300896] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:45:38.357768] [DEBUG] [LOCAL ] TUYA: Loaded 46578 existing records from primary storage. [2025-09-24T21:45:38.357954] [INFO ] [MAIN ] TUYA: Loaded 46578 existing records. [2025-09-24T21:45:38.429068] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-24T21:45:38.553253] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:38.553602] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-24T21:45:38.553685] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-24T21:45:38.554601] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-24T21:45:38.554709] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-24T21:45:38.952966] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:39.216111] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-24T21:45:39.368887] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:45:40.016079] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-24T21:45:40.188745] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T21:45:40.347954] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-24T21:45:40.816123] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-24T21:45:41.378149] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T21:45:41.390523] [INFO ] [REMOTE ] TTC: Full fetch complete (62222 records). [2025-09-24T21:45:41.390720] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-24T21:45:41.628836] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-24T21:45:41.850431] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-24T21:45:41.850534] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-24T21:45:41.851704] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-24T21:45:41.851801] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-24T21:45:41.853359] [DEBUG] [LOCAL ] TTC: Trimmed 62222 records to 42495 (keeping 200 days of data) [2025-09-24T21:45:42.137414] [DEBUG] [LOCAL ] TTC: Primary data saved (42495 records). [2025-09-24T21:45:42.137556] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-24T21:45:42.137705] [INFO ] [MAIN ] Update Progress: 2148/2373 symbols completed. TTC took 39.3s. Estimated remaining: 29m 55s. Rate: 7.5 symbols/min [2025-09-24T21:45:42.322944] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:42.375589] [DEBUG] [LOCAL ] TV: Loaded 43003 existing records from primary storage. [2025-09-24T21:45:42.375771] [INFO ] [MAIN ] TV: Loaded 43003 existing records. [2025-09-24T21:45:42.439317] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-24T21:45:42.681116] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:42.681603] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-24T21:45:42.681786] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-24T21:45:42.694493] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-24T21:45:42.709317] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-24T21:45:42.783347] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-24T21:45:43.217512] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:43.217691] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-24T21:45:43.259600] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:45:44.016074] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-24T21:45:44.061207] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:45:44.816100] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-24T21:45:44.923099] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:45:45.616108] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-24T21:45:45.737171] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T21:45:46.416069] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-24T21:45:46.561200] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:45:46.570630] [INFO ] [REMOTE ] TTE: Full fetch complete (75084 records). [2025-09-24T21:45:46.570854] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-24T21:45:46.991525] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-24T21:45:46.991770] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-24T21:45:46.993357] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-24T21:45:46.993454] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-24T21:45:46.996722] [DEBUG] [LOCAL ] TTE: Trimmed 75084 records to 51656 (keeping 200 days of data) [2025-09-24T21:45:47.149378] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T21:45:47.244149] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-24T21:45:47.411731] [DEBUG] [LOCAL ] TTE: Primary data saved (51656 records). [2025-09-24T21:45:47.411962] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-24T21:45:47.412105] [INFO ] [MAIN ] Update Progress: 2149/2373 symbols completed. TTE took 37.5s. Estimated remaining: 29m 47s. Rate: 7.5 symbols/min [2025-09-24T21:45:47.612501] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:47.620325] [DEBUG] [LOCAL ] TVC: Loaded 3471 existing records from primary storage. [2025-09-24T21:45:47.620519] [INFO ] [MAIN ] TVC: Loaded 3471 existing records. [2025-09-24T21:45:47.831526] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:47.832006] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-24T21:45:47.832093] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-24T21:45:47.832905] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-24T21:45:47.832988] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-24T21:45:48.027815] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-24T21:45:48.038524] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-24T21:45:48.300978] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:48.816075] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-24T21:45:49.055493] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-24T21:45:49.621148] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-24T21:45:49.639437] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T21:45:50.232055] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T21:45:50.413896] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-24T21:45:50.422226] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-24T21:45:50.783740] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-24T21:45:51.216088] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-24T21:45:52.016114] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-24T21:45:52.816147] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-24T21:45:52.866841] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T21:45:53.239551] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T21:45:53.616086] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-24T21:45:54.416073] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-24T21:45:54.544904] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T21:45:54.969754] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T21:45:55.195606] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T21:45:55.216038] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-24T21:45:56.016112] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-24T21:45:56.579772] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-24T21:45:56.816098] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-24T21:45:57.532972] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T21:45:57.616071] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-24T21:45:57.886266] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-24T21:45:57.899982] [INFO ] [REMOTE ] TU: Full fetch complete (72941 records). [2025-09-24T21:45:57.900212] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-24T21:45:58.309541] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-24T21:45:58.309669] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-24T21:45:58.310918] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-24T21:45:58.310987] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-24T21:45:58.312534] [DEBUG] [LOCAL ] TU: Trimmed 72941 records to 49905 (keeping 200 days of data) [2025-09-24T21:45:58.416083] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-24T21:45:58.650635] [DEBUG] [LOCAL ] TU: Primary data saved (49905 records). [2025-09-24T21:45:58.650824] [INFO ] [MAIN ] TU: Full history saved. [2025-09-24T21:45:58.650942] [INFO ] [MAIN ] Update Progress: 2150/2373 symbols completed. TU took 30.0s. Estimated remaining: 29m 39s. Rate: 7.5 symbols/min [2025-09-24T21:45:58.827924] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:45:58.832838] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T21:45:58.840714] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-24T21:45:58.840910] [INFO ] [MAIN ] TVE: Loaded 2795 existing records. [2025-09-24T21:45:59.021281] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:45:59.021543] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-24T21:45:59.021594] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-24T21:45:59.021964] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-24T21:45:59.022027] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-24T21:45:59.217890] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-24T21:45:59.419517] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:45:59.449214] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T21:45:59.838095] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-24T21:46:00.016091] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-24T21:46:00.816122] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-24T21:46:01.485929] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-24T21:46:01.616107] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-24T21:46:01.748503] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T21:46:02.001325] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-24T21:46:02.416107] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-24T21:46:02.917669] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T21:46:03.216085] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-24T21:46:04.016080] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-24T21:46:04.794294] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:46:04.816145] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-24T21:46:05.367374] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T21:46:05.616152] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-24T21:46:06.421149] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-24T21:46:06.436684] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:46:06.856392] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T21:46:06.981455] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-24T21:46:07.216085] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-24T21:46:08.016107] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-24T21:46:08.517742] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T21:46:08.518872] [INFO ] [REMOTE ] TVC: Full fetch complete (5669 records). [2025-09-24T21:46:08.518947] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-24T21:46:08.817422] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-24T21:46:08.946134] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-24T21:46:08.946293] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-24T21:46:08.946567] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-24T21:46:08.946768] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-24T21:46:08.948752] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T21:46:08.957624] [DEBUG] [LOCAL ] TVC: Trimmed 5669 records to 3445 (keeping 200 days of data) [2025-09-24T21:46:08.967832] [INFO ] [REMOTE ] TUYA: Full fetch complete (65879 records). [2025-09-24T21:46:08.969877] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-24T21:46:09.103255] [DEBUG] [LOCAL ] TVC: Primary data saved (3445 records). [2025-09-24T21:46:09.103726] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-24T21:46:09.109224] [INFO ] [MAIN ] Update Progress: 2151/2373 symbols completed. TVC took 21.7s. Estimated remaining: 29m 32s. Rate: 7.5 symbols/min [2025-09-24T21:46:09.541407] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:09.628798] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-24T21:46:09.625052] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-24T21:46:09.630337] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-24T21:46:09.632019] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-24T21:46:09.632328] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-24T21:46:09.634327] [DEBUG] [LOCAL ] TUYA: Trimmed 65879 records to 46557 (keeping 200 days of data) [2025-09-24T21:46:09.753401] [DEBUG] [LOCAL ] TWI: Loaded 34560 existing records from primary storage. [2025-09-24T21:46:09.755355] [INFO ] [MAIN ] TWI: Loaded 34560 existing records. [2025-09-24T21:46:09.982629] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:46:09.984605] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-24T21:46:09.984707] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-24T21:46:09.986792] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-24T21:46:09.987117] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-24T21:46:10.266962] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-24T21:46:10.422468] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-24T21:46:10.564203] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:10.567316] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T21:46:10.632841] [DEBUG] [LOCAL ] TUYA: Primary data saved (46557 records). [2025-09-24T21:46:10.633028] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-24T21:46:10.633122] [INFO ] [MAIN ] Update Progress: 2152/2373 symbols completed. TUYA took 32.6s. Estimated remaining: 29m 23s. Rate: 7.5 symbols/min [2025-09-24T21:46:10.806697] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:10.865677] [DEBUG] [LOCAL ] TWLO: Loaded 52725 existing records from primary storage. [2025-09-24T21:46:10.865862] [INFO ] [MAIN ] TWLO: Loaded 52725 existing records. [2025-09-24T21:46:10.985685] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T21:46:11.057478] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:46:11.057796] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-24T21:46:11.057855] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-24T21:46:11.059099] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-24T21:46:11.059161] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-24T21:46:11.216453] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-24T21:46:11.424734] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:12.016077] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-24T21:46:12.816081] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-24T21:46:12.865556] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T21:46:13.427616] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T21:46:13.616056] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-24T21:46:13.967390] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T21:46:14.099500] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-24T21:46:14.416080] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-24T21:46:15.216079] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-24T21:46:15.691380] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-24T21:46:15.914392] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-24T21:46:16.016075] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-24T21:46:16.816127] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-24T21:46:17.454883] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T21:46:17.486832] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-24T21:46:17.616101] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-24T21:46:18.416085] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-24T21:46:19.061072] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T21:46:19.216097] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-24T21:46:20.016115] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-24T21:46:20.519550] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T21:46:20.526763] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T21:46:20.761872] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:46:20.816110] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-24T21:46:21.616130] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-24T21:46:22.164969] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T21:46:22.416107] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-24T21:46:23.100576] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:46:23.111802] [INFO ] [REMOTE ] TV: Full fetch complete (62402 records). [2025-09-24T21:46:23.111989] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-24T21:46:23.220334] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-24T21:46:23.529511] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-24T21:46:23.529619] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-24T21:46:23.530766] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-24T21:46:23.530830] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-24T21:46:23.532094] [DEBUG] [LOCAL ] TV: Trimmed 62402 records to 42983 (keeping 200 days of data) [2025-09-24T21:46:23.791322] [DEBUG] [LOCAL ] TV: Primary data saved (42983 records). [2025-09-24T21:46:23.791461] [INFO ] [MAIN ] TV: Full history saved. [2025-09-24T21:46:23.791550] [INFO ] [MAIN ] Update Progress: 2153/2373 symbols completed. TV took 41.7s. Estimated remaining: 29m 16s. Rate: 7.5 symbols/min [2025-09-24T21:46:23.977177] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:23.982844] [DEBUG] [LOCAL ] TWN: Loaded 3226 existing records from primary storage. [2025-09-24T21:46:23.982937] [INFO ] [MAIN ] TWN: Loaded 3226 existing records. [2025-09-24T21:46:24.028097] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-24T21:46:24.179274] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:46:24.179967] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-24T21:46:24.180045] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-24T21:46:24.180371] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-24T21:46:24.180442] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-24T21:46:24.463536] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-24T21:46:24.600520] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:24.604133] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-24T21:46:24.646281] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T21:46:24.816086] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-24T21:46:25.616121] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-24T21:46:26.358117] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T21:46:26.416063] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-24T21:46:26.559018] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T21:46:26.991185] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T21:46:27.216119] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-24T21:46:27.821005] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T21:46:28.016129] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-24T21:46:28.816092] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-24T21:46:29.616096] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-24T21:46:30.008117] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-24T21:46:30.090915] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-24T21:46:30.093179] [INFO ] [REMOTE ] TVE: Full fetch complete (4344 records). [2025-09-24T21:46:30.093362] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-24T21:46:30.421628] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-24T21:46:30.495438] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-24T21:46:30.497889] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-24T21:46:30.498199] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-24T21:46:30.498354] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-24T21:46:30.500284] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:46:30.500689] [DEBUG] [LOCAL ] TVE: Trimmed 4344 records to 2769 (keeping 200 days of data) [2025-09-24T21:46:30.527059] [DEBUG] [LOCAL ] TVE: Primary data saved (2769 records). [2025-09-24T21:46:30.527177] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-24T21:46:30.527274] [INFO ] [MAIN ] Update Progress: 2154/2373 symbols completed. TVE took 31.9s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-24T21:46:30.695448] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:30.743107] [DEBUG] [LOCAL ] TWO: Loaded 48326 existing records from primary storage. [2025-09-24T21:46:30.743277] [INFO ] [MAIN ] TWO: Loaded 48326 existing records. [2025-09-24T21:46:30.919939] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:46:30.920198] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-24T21:46:30.920246] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-24T21:46:30.921390] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-24T21:46:30.921451] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-24T21:46:31.221316] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-24T21:46:31.288516] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:31.924558] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T21:46:32.016143] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-24T21:46:32.419152] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-24T21:46:32.520249] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T21:46:32.816098] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-24T21:46:33.616090] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-24T21:46:34.416080] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-24T21:46:34.636296] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T21:46:34.939295] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T21:46:35.060941] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-24T21:46:35.216106] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-24T21:46:36.016107] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-24T21:46:36.620351] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T21:46:36.816183] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-24T21:46:37.616144] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-24T21:46:38.088306] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-24T21:46:38.139422] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T21:46:38.169110] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-24T21:46:38.416060] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-24T21:46:39.216111] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-24T21:46:40.023408] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-24T21:46:40.049173] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T21:46:40.816105] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-24T21:46:41.224269] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T21:46:41.230164] [INFO ] [REMOTE ] TWI: Full fetch complete (53301 records). [2025-09-24T21:46:41.230285] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-24T21:46:41.431544] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T21:46:41.571251] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-24T21:46:41.627058] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-24T21:46:41.685400] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-24T21:46:41.685500] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-24T21:46:41.686863] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-24T21:46:41.686940] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-24T21:46:41.688343] [DEBUG] [LOCAL ] TWI: Trimmed 53301 records to 34508 (keeping 200 days of data) [2025-09-24T21:46:41.893070] [DEBUG] [LOCAL ] TWI: Primary data saved (34508 records). [2025-09-24T21:46:41.893210] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-24T21:46:41.893312] [INFO ] [MAIN ] Update Progress: 2155/2373 symbols completed. TWI took 32.8s. Estimated remaining: 28m 60s. Rate: 7.5 symbols/min [2025-09-24T21:46:42.067256] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:42.067447] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-24T21:46:42.067502] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-24T21:46:42.067696] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-24T21:46:42.067751] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-24T21:46:42.067800] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-24T21:46:42.067836] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-24T21:46:42.421344] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-24T21:46:42.465758] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:43.216138] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-24T21:46:43.447758] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:46:43.448150] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-24T21:46:43.683915] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-24T21:46:43.693304] [INFO ] [REMOTE ] TWLO: Full fetch complete (76443 records). [2025-09-24T21:46:43.693472] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-24T21:46:44.018690] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-24T21:46:44.112763] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-24T21:46:44.140389] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-24T21:46:44.142354] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-24T21:46:44.143962] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-24T21:46:44.152370] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-24T21:46:44.154765] [DEBUG] [LOCAL ] TWLO: Trimmed 76443 records to 52722 (keeping 200 days of data) [2025-09-24T21:46:44.400815] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:46:44.402266] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-24T21:46:44.492022] [DEBUG] [LOCAL ] TWLO: Primary data saved (52722 records). [2025-09-24T21:46:44.492184] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-24T21:46:44.492278] [INFO ] [MAIN ] Update Progress: 2156/2373 symbols completed. TWLO took 33.9s. Estimated remaining: 28m 51s. Rate: 7.5 symbols/min [2025-09-24T21:46:44.660970] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:46:44.683750] [DEBUG] [LOCAL ] TX: Loaded 23690 existing records from primary storage. [2025-09-24T21:46:44.683879] [INFO ] [MAIN ] TX: Loaded 23690 existing records. [2025-09-24T21:46:44.823437] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-24T21:46:44.871931] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:46:44.872246] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-24T21:46:44.872312] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-24T21:46:44.873083] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-24T21:46:44.873160] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-24T21:46:45.242977] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:46:45.616092] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-24T21:46:46.068485] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T21:46:46.416098] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-24T21:46:46.609383] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-24T21:46:46.799148] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:46:46.799497] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-24T21:46:47.216081] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-24T21:46:47.420488] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:46:47.420924] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-24T21:46:48.016148] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-24T21:46:48.495224] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-24T21:46:48.496542] [INFO ] [REMOTE ] TWN: Full fetch complete (5362 records). [2025-09-24T21:46:48.496631] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-24T21:46:48.828973] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-24T21:46:48.873604] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-24T21:46:48.873721] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-24T21:46:48.873902] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-24T21:46:48.873941] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-24T21:46:48.874444] [DEBUG] [LOCAL ] TWN: Trimmed 5362 records to 3209 (keeping 200 days of data) [2025-09-24T21:46:48.895223] [DEBUG] [LOCAL ] TWN: Primary data saved (3209 records). [2025-09-24T21:46:48.895389] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-24T21:46:48.895490] [INFO ] [MAIN ] Update Progress: 2157/2373 symbols completed. TWN took 25.1s. Estimated remaining: 28m 43s. Rate: 7.5 symbols/min [2025-09-24T21:46:49.616081] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-24T21:46:50.416123] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-24T21:46:50.617705] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:46:50.618065] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-24T21:46:50.694527] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-24T21:46:50.754724] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:46:51.216082] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-24T21:46:52.016088] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-24T21:46:52.709971] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T21:46:52.741943] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T21:46:52.816075] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-24T21:46:53.616047] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-24T21:46:53.978906] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-24T21:46:54.191842] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-24T21:46:54.416168] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-24T21:46:55.216100] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-24T21:46:55.656622] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-24T21:46:55.947227] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T21:46:56.016050] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-24T21:46:56.816135] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-24T21:46:57.616107] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-24T21:46:57.881962] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T21:46:58.031881] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T21:46:58.067716] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-24T21:46:58.416098] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-24T21:46:58.999489] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T21:46:59.001112] [INFO ] [REMOTE ] TWOD: Full fetch complete (4284 records). [2025-09-24T21:46:59.001185] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-24T21:46:59.183141] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 90 unique days, need 200 days [2025-09-24T21:46:59.183379] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:46:59.183451] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:46:59.183525] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-24T21:46:59.183593] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-24T21:46:59.183633] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-24T21:46:59.183735] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-24T21:46:59.183819] [INFO ] [MAIN ] Update Progress: 2158/2373 symbols completed. TWOD took 17.3s. Estimated remaining: 28m 35s. Rate: 7.5 symbols/min [2025-09-24T21:46:59.216110] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-24T21:47:00.016135] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-24T21:47:00.997011] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T21:47:01.008084] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-24T21:47:01.342205] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-24T21:47:01.616090] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-24T21:47:02.479701] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T21:47:02.488092] [INFO ] [REMOTE ] TWO: Full fetch complete (68892 records). [2025-09-24T21:47:02.488208] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-24T21:47:02.924713] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-24T21:47:02.925396] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-24T21:47:02.927378] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-24T21:47:02.927488] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-24T21:47:02.926058] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T21:47:02.934048] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-24T21:47:02.935578] [DEBUG] [LOCAL ] TWO: Trimmed 68892 records to 48323 (keeping 200 days of data) [2025-09-24T21:47:03.230123] [DEBUG] [LOCAL ] TWO: Primary data saved (48323 records). [2025-09-24T21:47:03.230265] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-24T21:47:03.230361] [INFO ] [MAIN ] Update Progress: 2159/2373 symbols completed. TWO took 32.7s. Estimated remaining: 28m 27s. Rate: 7.5 symbols/min [2025-09-24T21:47:03.836755] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T21:47:03.842061] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-24T21:47:04.895414] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-24T21:47:04.900689] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-24T21:47:06.110340] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T21:47:06.116619] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-24T21:47:07.270980] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T21:47:07.276865] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-24T21:47:08.324729] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-24T21:47:08.329062] [INFO ] [REMOTE ] TX: Full fetch complete (35696 records). [2025-09-24T21:47:08.329192] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-24T21:47:08.729917] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-24T21:47:08.729996] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-24T21:47:08.730780] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-24T21:47:08.730843] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-24T21:47:08.731630] [DEBUG] [LOCAL ] TX: Trimmed 35696 records to 23676 (keeping 200 days of data) [2025-09-24T21:47:08.873791] [DEBUG] [LOCAL ] TX: Primary data saved (23676 records). [2025-09-24T21:47:08.873951] [INFO ] [MAIN ] TX: Full history saved. [2025-09-24T21:47:08.874056] [INFO ] [MAIN ] Update Progress: 2160/2373 symbols completed. TX took 24.4s. Estimated remaining: 28m 19s. Rate: 7.5 symbols/min [2025-09-24T21:47:09.520637] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:09.632498] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:09.636172] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:09.641448] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:09.651672] [DEBUG] [LOCAL ] TY: Loaded 7679 existing records from primary storage. [2025-09-24T21:47:09.651882] [INFO ] [MAIN ] TY: Loaded 7679 existing records. [2025-09-24T21:47:09.828592] [DEBUG] [LOCAL ] TXO: Loaded 18744 existing records from primary storage. [2025-09-24T21:47:09.864880] [INFO ] [MAIN ] TXO: Loaded 18744 existing records. [2025-09-24T21:47:09.881496] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:09.882939] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-24T21:47:09.882998] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-24T21:47:09.894077] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-24T21:47:09.914103] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-24T21:47:10.088834] [DEBUG] [LOCAL ] TXT: Loaded 49764 existing records from primary storage. [2025-09-24T21:47:10.106589] [DEBUG] [LOCAL ] TXNM: Loaded 43982 existing records from primary storage. [2025-09-24T21:47:10.138782] [INFO ] [MAIN ] TXT: Loaded 49764 existing records. [2025-09-24T21:47:10.145347] [INFO ] [MAIN ] TXNM: Loaded 43982 existing records. [2025-09-24T21:47:10.414253] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:10.567187] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-24T21:47:10.593277] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-24T21:47:10.704978] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-24T21:47:10.710438] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-24T21:47:10.780364] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:10.861325] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-24T21:47:10.861790] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:10.861561] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-24T21:47:10.894571] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-24T21:47:10.926464] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-24T21:47:10.954080] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-24T21:47:10.964638] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-24T21:47:11.008412] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-24T21:47:11.025442] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-24T21:47:11.103711] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:11.159073] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-24T21:47:11.921422] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:11.943258] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-24T21:47:12.085958] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:12.091829] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-24T21:47:12.120848] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:12.122751] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:47:12.122455] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-24T21:47:12.125600] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-24T21:47:12.718778] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-24T21:47:12.723331] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-24T21:47:12.987463] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-24T21:47:12.989950] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-24T21:47:13.340342] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T21:47:13.349551] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-24T21:47:13.369983] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-24T21:47:13.374912] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-24T21:47:13.807243] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-24T21:47:13.825329] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-24T21:47:13.840998] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T21:47:14.359526] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T21:47:14.416022] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-24T21:47:14.600574] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T21:47:15.013816] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-24T21:47:15.059250] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-24T21:47:15.216124] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-24T21:47:16.016149] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-24T21:47:16.801601] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-24T21:47:16.816092] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-24T21:47:17.218230] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T21:47:17.616107] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-24T21:47:17.936489] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T21:47:18.138967] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-24T21:47:18.416080] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-24T21:47:19.216084] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-24T21:47:19.893123] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:47:19.964298] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-24T21:47:20.016059] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-24T21:47:20.777373] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T21:47:20.816038] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-24T21:47:21.356999] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T21:47:21.616083] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-24T21:47:22.416075] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-24T21:47:23.042188] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T21:47:23.216106] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-24T21:47:23.845637] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T21:47:24.016134] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-24T21:47:24.349803] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:47:24.816119] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-24T21:47:25.576326] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T21:47:25.617305] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-24T21:47:25.623334] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T21:47:26.389269] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T21:47:26.416088] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-24T21:47:27.216055] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-24T21:47:27.390479] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:47:27.664752] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-24T21:47:27.666788] [INFO ] [REMOTE ] TY: Full fetch complete (11801 records). [2025-09-24T21:47:27.666877] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-24T21:47:28.025457] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-24T21:47:28.060725] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-24T21:47:28.060806] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-24T21:47:28.061154] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-24T21:47:28.061221] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-24T21:47:28.061741] [DEBUG] [LOCAL ] TY: Trimmed 11801 records to 7664 (keeping 200 days of data) [2025-09-24T21:47:28.110272] [DEBUG] [LOCAL ] TY: Primary data saved (7664 records). [2025-09-24T21:47:28.110422] [INFO ] [MAIN ] TY: Full history saved. [2025-09-24T21:47:28.110556] [INFO ] [MAIN ] Update Progress: 2161/2373 symbols completed. TY took 19.2s. Estimated remaining: 28m 12s. Rate: 7.5 symbols/min [2025-09-24T21:47:28.308752] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:28.325973] [DEBUG] [LOCAL ] TYG: Loaded 14240 existing records from primary storage. [2025-09-24T21:47:28.326100] [INFO ] [MAIN ] TYG: Loaded 14240 existing records. [2025-09-24T21:47:28.523879] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:28.524316] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-24T21:47:28.524418] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-24T21:47:28.525034] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-24T21:47:28.525133] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-24T21:47:28.821242] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-24T21:47:28.897763] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:29.616096] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-24T21:47:29.658569] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T21:47:29.858105] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T21:47:29.861758] [INFO ] [REMOTE ] TXO: Full fetch complete (25892 records). [2025-09-24T21:47:29.861853] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-24T21:47:30.240413] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-24T21:47:30.240572] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-24T21:47:30.241436] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-24T21:47:30.241621] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-24T21:47:30.243732] [DEBUG] [LOCAL ] TXO: Trimmed 25892 records to 18787 (keeping 200 days of data) [2025-09-24T21:47:30.371258] [DEBUG] [LOCAL ] TXO: Primary data saved (18787 records). [2025-09-24T21:47:30.371460] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-24T21:47:30.371664] [INFO ] [MAIN ] Update Progress: 2162/2373 symbols completed. TXO took 21.5s. Estimated remaining: 28m 3s. Rate: 7.5 symbols/min [2025-09-24T21:47:30.420042] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-24T21:47:30.561050] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:30.571105] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:47:30.600769] [DEBUG] [LOCAL ] TYL: Loaded 22381 existing records from primary storage. [2025-09-24T21:47:30.600938] [INFO ] [MAIN ] TYL: Loaded 22381 existing records. [2025-09-24T21:47:30.782976] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:30.783242] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-24T21:47:30.783291] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-24T21:47:30.784036] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-24T21:47:30.784098] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-24T21:47:31.156796] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:31.216111] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-24T21:47:32.016135] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-24T21:47:32.170519] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T21:47:32.197485] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-24T21:47:32.816100] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-24T21:47:33.616103] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-24T21:47:33.750735] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:47:33.883102] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T21:47:34.416081] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-24T21:47:34.449122] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-24T21:47:35.216124] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-24T21:47:35.992891] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-24T21:47:36.016038] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-24T21:47:36.821217] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-24T21:47:36.837278] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T21:47:37.616076] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-24T21:47:37.715778] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-24T21:47:37.959243] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-24T21:47:38.416095] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-24T21:47:38.968517] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T21:47:39.216079] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-24T21:47:40.016044] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-24T21:47:40.111565] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T21:47:40.383053] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-24T21:47:40.816084] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-24T21:47:41.234279] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-24T21:47:41.616131] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-24T21:47:42.277160] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T21:47:42.310685] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T21:47:42.416049] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-24T21:47:43.216048] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-24T21:47:43.498966] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T21:47:44.016124] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-24T21:47:44.792582] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-24T21:47:44.816038] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-24T21:47:45.146621] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:47:45.616167] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-24T21:47:46.263329] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T21:47:46.274065] [INFO ] [REMOTE ] TXNM: Full fetch complete (62643 records). [2025-09-24T21:47:46.274199] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-24T21:47:46.420117] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-24T21:47:46.673943] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-24T21:47:46.674034] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-24T21:47:46.675212] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-24T21:47:46.675276] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-24T21:47:46.676726] [DEBUG] [LOCAL ] TXNM: Trimmed 62643 records to 43846 (keeping 200 days of data) [2025-09-24T21:47:46.978863] [DEBUG] [LOCAL ] TXNM: Primary data saved (43846 records). [2025-09-24T21:47:46.979069] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-24T21:47:46.979321] [INFO ] [MAIN ] Update Progress: 2163/2373 symbols completed. TXNM took 38.1s. Estimated remaining: 27m 56s. Rate: 7.5 symbols/min [2025-09-24T21:47:47.184004] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:47.217083] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T21:47:47.217471] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-24T21:47:47.230082] [INFO ] [REMOTE ] TXT: Full fetch complete (72248 records). [2025-09-24T21:47:47.230384] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-24T21:47:47.517294] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-24T21:47:47.545556] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-24T21:47:47.823502] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-24T21:47:47.887830] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-24T21:47:47.897171] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-24T21:47:47.897376] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-24T21:47:47.895346] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:47.913145] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-24T21:47:47.914091] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-24T21:47:47.914731] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T21:47:47.920459] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-24T21:47:47.920783] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-24T21:47:47.974934] [DEBUG] [LOCAL ] TXT: Trimmed 72248 records to 49729 (keeping 200 days of data) [2025-09-24T21:47:48.033495] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-24T21:47:48.365514] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T21:47:48.466384] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:48.665365] [DEBUG] [LOCAL ] TXT: Primary data saved (49729 records). [2025-09-24T21:47:48.665518] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-24T21:47:48.665675] [INFO ] [MAIN ] Update Progress: 2164/2373 symbols completed. TXT took 39.8s. Estimated remaining: 27m 47s. Rate: 7.5 symbols/min [2025-09-24T21:47:48.821639] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-24T21:47:48.842277] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:48.900075] [DEBUG] [LOCAL ] UA: Loaded 50417 existing records from primary storage. [2025-09-24T21:47:48.900270] [INFO ] [MAIN ] UA: Loaded 50417 existing records. [2025-09-24T21:47:49.086263] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:49.086872] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-24T21:47:49.086932] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-24T21:47:49.088250] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-24T21:47:49.088312] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-24T21:47:49.459287] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:49.470720] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T21:47:49.616096] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-24T21:47:50.416104] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-24T21:47:51.216087] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-24T21:47:51.403508] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T21:47:51.438095] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-24T21:47:51.442140] [INFO ] [REMOTE ] TYL: Full fetch complete (31402 records). [2025-09-24T21:47:51.442221] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-24T21:47:51.651800] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-24T21:47:51.894162] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-24T21:47:51.894288] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-24T21:47:51.895145] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-24T21:47:51.895260] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-24T21:47:51.905806] [DEBUG] [LOCAL ] TYL: Trimmed 31402 records to 22299 (keeping 200 days of data) [2025-09-24T21:47:51.906680] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-24T21:47:52.016065] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-24T21:47:52.064364] [DEBUG] [LOCAL ] TYL: Primary data saved (22299 records). [2025-09-24T21:47:52.064490] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-24T21:47:52.064660] [INFO ] [MAIN ] Update Progress: 2165/2373 symbols completed. TYL took 21.7s. Estimated remaining: 27m 39s. Rate: 7.5 symbols/min [2025-09-24T21:47:52.236273] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:47:52.300778] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-24T21:47:52.300927] [INFO ] [MAIN ] UAA: Loaded 53509 existing records. [2025-09-24T21:47:52.480493] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:47:52.480783] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-24T21:47:52.480837] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-24T21:47:52.482018] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-24T21:47:52.482079] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-24T21:47:52.818788] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-24T21:47:52.857690] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:47:52.945809] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-24T21:47:53.616093] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-24T21:47:54.387584] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T21:47:54.416063] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-24T21:47:54.454771] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-24T21:47:55.216113] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-24T21:47:56.016110] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-24T21:47:56.778863] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-24T21:47:56.816054] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-24T21:47:56.956273] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T21:47:57.036829] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-24T21:47:57.616080] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-24T21:47:58.416068] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-24T21:47:58.486478] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T21:47:59.038593] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-24T21:47:59.216080] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-24T21:47:59.847830] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T21:48:00.016084] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-24T21:48:00.816093] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-24T21:48:01.479465] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-24T21:48:01.616046] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-24T21:48:02.260850] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-24T21:48:02.416069] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-24T21:48:03.148980] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-24T21:48:03.216093] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-24T21:48:04.016128] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-24T21:48:04.857772] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-24T21:48:04.861495] [INFO ] [REMOTE ] TYG: Full fetch complete (22535 records). [2025-09-24T21:48:04.861587] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-24T21:48:05.250125] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-24T21:48:05.250212] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-24T21:48:05.250764] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-24T21:48:05.250827] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-24T21:48:05.251470] [DEBUG] [LOCAL ] TYG: Trimmed 22535 records to 14210 (keeping 200 days of data) [2025-09-24T21:48:05.351894] [DEBUG] [LOCAL ] TYG: Primary data saved (14210 records). [2025-09-24T21:48:05.352163] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-24T21:48:05.352394] [INFO ] [MAIN ] Update Progress: 2166/2373 symbols completed. TYG took 37.2s. Estimated remaining: 27m 32s. Rate: 7.5 symbols/min [2025-09-24T21:48:05.532024] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:05.563605] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (3.95 seconds). [2025-09-24T21:48:05.578253] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-24T21:48:05.582741] [DEBUG] [LOCAL ] UAN: Loaded 5454 existing records from primary storage. [2025-09-24T21:48:05.583032] [INFO ] [MAIN ] UAN: Loaded 5454 existing records. [2025-09-24T21:48:05.801802] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:05.804987] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-24T21:48:05.815432] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-24T21:48:05.815953] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-24T21:48:05.816348] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-24T21:48:05.817234] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-24T21:48:05.817297] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-24T21:48:06.195329] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:06.231096] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-24T21:48:06.416130] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-24T21:48:07.008085] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-24T21:48:07.216047] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-24T21:48:07.379731] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-24T21:48:07.820534] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-24T21:48:07.932865] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:48:08.016061] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-24T21:48:08.816150] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-24T21:48:09.507906] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-24T21:48:09.616107] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-24T21:48:09.774768] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:48:10.416088] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-24T21:48:11.216086] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-24T21:48:11.820522] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-24T21:48:11.887408] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-24T21:48:12.016061] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-24T21:48:12.083529] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T21:48:12.816104] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-24T21:48:13.616089] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-24T21:48:14.416096] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-24T21:48:14.647059] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-24T21:48:14.850405] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T21:48:15.035757] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T21:48:15.216079] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-24T21:48:16.016126] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-24T21:48:16.741938] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-24T21:48:16.816052] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-24T21:48:16.983202] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-24T21:48:17.047564] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T21:48:17.512390] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T21:48:17.616097] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-24T21:48:18.416139] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-24T21:48:19.216148] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-24T21:48:19.400519] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T21:48:19.818093] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-24T21:48:20.016093] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-24T21:48:20.297521] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-24T21:48:20.816111] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-24T21:48:21.481318] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T21:48:21.616157] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-24T21:48:22.177694] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T21:48:22.179081] [INFO ] [REMOTE ] UAN: Full fetch complete (8273 records). [2025-09-24T21:48:22.179181] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-24T21:48:22.418705] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-24T21:48:22.561940] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-24T21:48:22.562069] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-24T21:48:22.562390] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-24T21:48:22.562498] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-24T21:48:22.563255] [DEBUG] [LOCAL ] UAN: Trimmed 8273 records to 5445 (keeping 200 days of data) [2025-09-24T21:48:22.625355] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-24T21:48:22.645441] [DEBUG] [LOCAL ] UAN: Primary data saved (5445 records). [2025-09-24T21:48:22.645591] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-24T21:48:22.645711] [INFO ] [MAIN ] Update Progress: 2167/2373 symbols completed. UAN took 17.3s. Estimated remaining: 27m 24s. Rate: 7.5 symbols/min [2025-09-24T21:48:22.817192] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:22.884606] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-24T21:48:22.884807] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-24T21:48:23.069608] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:23.069911] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-24T21:48:23.069962] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-24T21:48:23.071320] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-24T21:48:23.071392] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-24T21:48:23.221264] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-24T21:48:23.439540] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:24.016101] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-24T21:48:24.404909] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-24T21:48:24.816088] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-24T21:48:25.049027] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T21:48:25.058486] [INFO ] [REMOTE ] UA: Full fetch complete (72915 records). [2025-09-24T21:48:25.058711] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-24T21:48:25.447825] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-24T21:48:25.447934] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-24T21:48:25.449128] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-24T21:48:25.449193] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-24T21:48:25.450636] [DEBUG] [LOCAL ] UA: Trimmed 72915 records to 50422 (keeping 200 days of data) [2025-09-24T21:48:25.624313] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-24T21:48:25.748382] [DEBUG] [LOCAL ] UA: Primary data saved (50422 records). [2025-09-24T21:48:25.748521] [INFO ] [MAIN ] UA: Full history saved. [2025-09-24T21:48:25.748615] [INFO ] [MAIN ] Update Progress: 2168/2373 symbols completed. UA took 37.1s. Estimated remaining: 27m 16s. Rate: 7.5 symbols/min [2025-09-24T21:48:25.920527] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:25.971248] [DEBUG] [LOCAL ] UBS: Loaded 52443 existing records from primary storage. [2025-09-24T21:48:25.971400] [INFO ] [MAIN ] UBS: Loaded 52443 existing records. [2025-09-24T21:48:26.154704] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:26.155309] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-24T21:48:26.155415] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-24T21:48:26.156596] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-24T21:48:26.156688] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-24T21:48:26.539749] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:26.540344] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-24T21:48:26.577802] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-24T21:48:26.659636] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T21:48:27.216119] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-24T21:48:27.529480] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T21:48:27.539447] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-24T21:48:27.539621] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-24T21:48:27.951928] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-24T21:48:27.952041] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-24T21:48:27.953842] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-24T21:48:27.953922] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-24T21:48:27.956160] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-09-24T21:48:28.020970] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-24T21:48:28.291258] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-24T21:48:28.291483] [INFO ] [MAIN ] U: Full history saved. [2025-09-24T21:48:28.291588] [INFO ] [MAIN ] Update Progress: 2169/2373 symbols completed. U took 41.3s. Estimated remaining: 27m 8s. Rate: 7.5 symbols/min [2025-09-24T21:48:28.471116] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:28.501633] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-24T21:48:28.545515] [DEBUG] [LOCAL ] UCB: Loaded 38105 existing records from primary storage. [2025-09-24T21:48:28.545723] [INFO ] [MAIN ] UCB: Loaded 38105 existing records. [2025-09-24T21:48:28.727969] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:28.728244] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-24T21:48:28.728294] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-24T21:48:28.729281] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-24T21:48:28.729343] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-24T21:48:28.826454] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-24T21:48:29.116604] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:29.616111] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-24T21:48:29.767633] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-24T21:48:29.841951] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-24T21:48:29.851713] [INFO ] [REMOTE ] UAA: Full fetch complete (77479 records). [2025-09-24T21:48:29.851889] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-24T21:48:30.290313] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-24T21:48:30.290520] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-24T21:48:30.291916] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-24T21:48:30.292030] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-24T21:48:30.293742] [DEBUG] [LOCAL ] UAA: Trimmed 77479 records to 53509 (keeping 200 days of data) [2025-09-24T21:48:30.419361] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-24T21:48:30.520164] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T21:48:30.681405] [DEBUG] [LOCAL ] UAA: Primary data saved (53509 records). [2025-09-24T21:48:30.681694] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-24T21:48:30.681812] [INFO ] [MAIN ] Update Progress: 2170/2373 symbols completed. UAA took 38.6s. Estimated remaining: 26m 59s. Rate: 7.5 symbols/min [2025-09-24T21:48:30.864900] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:30.888063] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T21:48:30.941090] [DEBUG] [LOCAL ] UDR: Loaded 51781 existing records from primary storage. [2025-09-24T21:48:30.941330] [INFO ] [MAIN ] UDR: Loaded 51781 existing records. [2025-09-24T21:48:31.118929] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:31.119204] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-24T21:48:31.119253] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-24T21:48:31.120454] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-24T21:48:31.120516] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-24T21:48:31.219806] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-24T21:48:31.490707] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:32.016131] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-24T21:48:32.340636] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-24T21:48:32.706956] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T21:48:32.816135] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-24T21:48:33.414354] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T21:48:33.616125] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-24T21:48:33.893765] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T21:48:34.416110] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-24T21:48:35.216089] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-24T21:48:35.963331] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-24T21:48:36.016099] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-24T21:48:36.186875] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-24T21:48:36.613552] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-24T21:48:36.816160] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-24T21:48:37.176957] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-24T21:48:37.616087] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-24T21:48:38.416091] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-24T21:48:39.166028] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-24T21:48:39.221527] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-24T21:48:39.242021] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T21:48:39.500733] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-24T21:48:40.016074] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-24T21:48:40.816170] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-24T21:48:41.616130] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-24T21:48:41.662696] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-24T21:48:41.842619] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-24T21:48:42.416822] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-24T21:48:42.419718] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:48:43.210736] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T21:48:43.221455] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-24T21:48:43.697741] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-24T21:48:44.016075] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-24T21:48:44.816111] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-24T21:48:45.616165] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-24T21:48:45.693788] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-24T21:48:45.825465] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T21:48:46.241722] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T21:48:46.416077] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-24T21:48:46.880487] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T21:48:47.216119] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-24T21:48:48.016097] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-24T21:48:48.691696] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T21:48:48.816092] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-24T21:48:49.117360] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-24T21:48:49.470504] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-24T21:48:49.616098] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-24T21:48:50.416061] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-24T21:48:50.594327] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T21:48:51.126966] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T21:48:51.216042] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-24T21:48:51.643859] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T21:48:52.016085] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-24T21:48:52.571847] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T21:48:52.578217] [INFO ] [REMOTE ] UCB: Full fetch complete (54690 records). [2025-09-24T21:48:52.578327] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-24T21:48:52.827866] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-24T21:48:52.956148] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-24T21:48:52.956238] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-24T21:48:52.957305] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-24T21:48:52.957371] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-24T21:48:52.958621] [DEBUG] [LOCAL ] UCB: Trimmed 54690 records to 38057 (keeping 200 days of data) [2025-09-24T21:48:53.198693] [DEBUG] [LOCAL ] UCB: Primary data saved (38057 records). [2025-09-24T21:48:53.198863] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-24T21:48:53.198958] [INFO ] [MAIN ] Update Progress: 2171/2373 symbols completed. UCB took 24.9s. Estimated remaining: 26m 52s. Rate: 7.5 symbols/min [2025-09-24T21:48:53.373375] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:53.417283] [DEBUG] [LOCAL ] UE: Loaded 42935 existing records from primary storage. [2025-09-24T21:48:53.417443] [INFO ] [MAIN ] UE: Loaded 42935 existing records. [2025-09-24T21:48:53.602474] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:53.603050] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-24T21:48:53.603188] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-24T21:48:53.604581] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-24T21:48:53.604706] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-24T21:48:53.623686] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-24T21:48:54.021543] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:54.055868] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T21:48:54.416041] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-24T21:48:54.480708] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T21:48:55.216088] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-24T21:48:55.849001] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-24T21:48:55.942070] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-24T21:48:56.016042] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-24T21:48:56.110101] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T21:48:56.815612] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T21:48:56.819432] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-24T21:48:56.826807] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-24T21:48:56.826914] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-24T21:48:57.229354] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-24T21:48:57.229498] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-24T21:48:57.230742] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-24T21:48:57.230807] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-24T21:48:57.234828] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-09-24T21:48:57.576014] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-24T21:48:57.576183] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-24T21:48:57.576283] [INFO ] [MAIN ] Update Progress: 2172/2373 symbols completed. UBER took 34.9s. Estimated remaining: 26m 44s. Rate: 7.5 symbols/min [2025-09-24T21:48:57.621279] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-24T21:48:57.748521] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:57.757735] [DEBUG] [LOCAL ] UFI: Loaded 8156 existing records from primary storage. [2025-09-24T21:48:57.757838] [INFO ] [MAIN ] UFI: Loaded 8156 existing records. [2025-09-24T21:48:57.940628] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:48:57.940978] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-24T21:48:57.941030] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-24T21:48:57.941383] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-24T21:48:57.941442] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-24T21:48:58.311109] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:48:58.412372] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T21:48:58.421002] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-24T21:48:58.897485] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-24T21:48:58.906687] [INFO ] [REMOTE ] UDR: Full fetch complete (74421 records). [2025-09-24T21:48:58.906825] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-24T21:48:59.217811] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-24T21:48:59.260080] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T21:48:59.360460] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-24T21:48:59.360551] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-24T21:48:59.361801] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-24T21:48:59.361867] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-24T21:48:59.364006] [DEBUG] [LOCAL ] UDR: Trimmed 74421 records to 51792 (keeping 200 days of data) [2025-09-24T21:48:59.691932] [DEBUG] [LOCAL ] UDR: Primary data saved (51792 records). [2025-09-24T21:48:59.692218] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-24T21:48:59.692350] [INFO ] [MAIN ] Update Progress: 2173/2373 symbols completed. UDR took 29.0s. Estimated remaining: 26m 36s. Rate: 7.5 symbols/min [2025-09-24T21:48:59.863691] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:48:59.920584] [DEBUG] [LOCAL ] UGI: Loaded 50552 existing records from primary storage. [2025-09-24T21:48:59.920800] [INFO ] [MAIN ] UGI: Loaded 50552 existing records. [2025-09-24T21:49:00.022572] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-24T21:49:00.112087] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:00.112438] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-24T21:49:00.112493] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-24T21:49:00.114122] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-24T21:49:00.114186] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-24T21:49:00.497296] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:00.706075] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T21:49:00.816098] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-24T21:49:01.434142] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T21:49:01.500607] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T21:49:01.509975] [INFO ] [REMOTE ] UBS: Full fetch complete (75615 records). [2025-09-24T21:49:01.510148] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-24T21:49:01.621178] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-24T21:49:01.969537] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-24T21:49:01.969670] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-24T21:49:01.971030] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-24T21:49:01.971097] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-24T21:49:01.972707] [DEBUG] [LOCAL ] UBS: Trimmed 75615 records to 52439 (keeping 200 days of data) [2025-09-24T21:49:02.333705] [DEBUG] [LOCAL ] UBS: Primary data saved (52439 records). [2025-09-24T21:49:02.333894] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-24T21:49:02.333996] [INFO ] [MAIN ] Update Progress: 2174/2373 symbols completed. UBS took 36.6s. Estimated remaining: 26m 27s. Rate: 7.5 symbols/min [2025-09-24T21:49:02.422507] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-24T21:49:02.621499] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:02.681544] [DEBUG] [LOCAL ] UGP: Loaded 42568 existing records from primary storage. [2025-09-24T21:49:02.681814] [INFO ] [MAIN ] UGP: Loaded 42568 existing records. [2025-09-24T21:49:02.989391] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:02.989913] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-24T21:49:02.989989] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-24T21:49:02.992112] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-24T21:49:02.992195] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-24T21:49:03.203125] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T21:49:03.221829] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-24T21:49:03.499693] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:04.016048] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-24T21:49:04.084041] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-24T21:49:04.151227] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-24T21:49:04.816121] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-24T21:49:05.616057] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-24T21:49:05.648269] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T21:49:06.140396] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-24T21:49:06.156740] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-24T21:49:06.416077] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-24T21:49:07.216048] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-24T21:49:07.315878] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-24T21:49:08.016128] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-24T21:49:08.496892] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T21:49:08.577245] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T21:49:08.816109] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-24T21:49:09.616086] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-24T21:49:10.382850] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T21:49:10.416054] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-24T21:49:11.219771] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-24T21:49:11.226442] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:49:11.972069] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T21:49:12.016065] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-24T21:49:12.816079] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-24T21:49:12.895999] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-24T21:49:13.538573] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T21:49:13.567158] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T21:49:13.616065] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-24T21:49:14.416126] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-24T21:49:15.060554] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-24T21:49:15.221261] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-24T21:49:15.240548] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:49:16.016243] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-24T21:49:16.816118] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-24T21:49:17.003476] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-24T21:49:17.524142] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-24T21:49:17.552101] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:49:17.616054] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-24T21:49:18.416101] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-24T21:49:19.216119] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-24T21:49:19.442001] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-24T21:49:20.016057] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-24T21:49:20.201948] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T21:49:20.645675] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T21:49:20.654494] [INFO ] [REMOTE ] UE: Full fetch complete (61501 records). [2025-09-24T21:49:20.654611] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-24T21:49:20.821775] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-24T21:49:21.072734] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-24T21:49:21.072835] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-24T21:49:21.073955] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-24T21:49:21.074031] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-24T21:49:21.075434] [DEBUG] [LOCAL ] UE: Trimmed 61501 records to 42956 (keeping 200 days of data) [2025-09-24T21:49:21.347979] [DEBUG] [LOCAL ] UE: Primary data saved (42956 records). [2025-09-24T21:49:21.348196] [INFO ] [MAIN ] UE: Full history saved. [2025-09-24T21:49:21.348331] [INFO ] [MAIN ] Update Progress: 2175/2373 symbols completed. UE took 28.1s. Estimated remaining: 26m 20s. Rate: 7.5 symbols/min [2025-09-24T21:49:21.538576] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T21:49:21.570182] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:21.604406] [DEBUG] [LOCAL ] UHAL: Loaded 16490 existing records from primary storage. [2025-09-24T21:49:21.611038] [INFO ] [MAIN ] UHAL: Loaded 16490 existing records. [2025-09-24T21:49:21.622442] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-24T21:49:21.611243] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T21:49:21.683820] [INFO ] [REMOTE ] UFI: Full fetch complete (12322 records). [2025-09-24T21:49:21.702299] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-24T21:49:22.011195] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:22.103974] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-24T21:49:22.115846] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-24T21:49:22.131929] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-24T21:49:22.140004] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-24T21:49:22.371835] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-24T21:49:22.377051] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-24T21:49:22.390002] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-24T21:49:22.392318] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-24T21:49:22.395731] [DEBUG] [LOCAL ] UFI: Trimmed 12322 records to 8118 (keeping 200 days of data) [2025-09-24T21:49:22.426954] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-24T21:49:22.635158] [DEBUG] [LOCAL ] UFI: Primary data saved (8118 records). [2025-09-24T21:49:22.655693] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-24T21:49:22.655916] [INFO ] [MAIN ] Update Progress: 2176/2373 symbols completed. UFI took 25.1s. Estimated remaining: 26m 12s. Rate: 7.5 symbols/min [2025-09-24T21:49:22.655440] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:22.851017] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:22.915861] [DEBUG] [LOCAL ] UHS: Loaded 41216 existing records from primary storage. [2025-09-24T21:49:22.916107] [INFO ] [MAIN ] UHS: Loaded 41216 existing records. [2025-09-24T21:49:23.105316] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:23.105949] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-24T21:49:23.106030] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-24T21:49:23.107168] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-24T21:49:23.107240] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-24T21:49:23.216220] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-24T21:49:23.506120] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:23.536998] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-24T21:49:24.016110] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-24T21:49:24.238950] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T21:49:24.281769] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T21:49:24.816131] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-24T21:49:25.191758] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T21:49:25.616129] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-24T21:49:26.300189] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-24T21:49:26.416102] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-24T21:49:26.512552] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T21:49:27.216103] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-24T21:49:28.016095] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-24T21:49:28.192307] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T21:49:28.533108] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-24T21:49:28.816093] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-24T21:49:29.507201] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T21:49:29.616145] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-24T21:49:29.641754] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T21:49:30.416123] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-24T21:49:31.185008] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T21:49:31.216062] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-24T21:49:31.342381] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T21:49:32.016097] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-24T21:49:32.816065] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-24T21:49:32.902621] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-24T21:49:32.955560] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T21:49:33.616077] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-24T21:49:34.416067] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-24T21:49:34.563777] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T21:49:34.610983] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T21:49:35.216112] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-24T21:49:35.972577] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T21:49:36.015955] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-24T21:49:36.016070] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-24T21:49:36.816156] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-24T21:49:37.517285] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T21:49:37.525703] [INFO ] [REMOTE ] UGP: Full fetch complete (62059 records). [2025-09-24T21:49:37.525919] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-24T21:49:37.621337] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-24T21:49:37.981367] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-24T21:49:37.981493] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-24T21:49:37.983237] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-24T21:49:37.983334] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-24T21:49:37.985510] [DEBUG] [LOCAL ] UGP: Trimmed 62059 records to 42635 (keeping 200 days of data) [2025-09-24T21:49:38.259738] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T21:49:38.316855] [DEBUG] [LOCAL ] UGP: Primary data saved (42635 records). [2025-09-24T21:49:38.317069] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-24T21:49:38.317262] [INFO ] [MAIN ] Update Progress: 2177/2373 symbols completed. UGP took 36.0s. Estimated remaining: 26m 4s. Rate: 7.5 symbols/min [2025-09-24T21:49:38.422009] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-24T21:49:38.503051] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:38.521408] [DEBUG] [LOCAL ] UHT: Loaded 10042 existing records from primary storage. [2025-09-24T21:49:38.521599] [INFO ] [MAIN ] UHT: Loaded 10042 existing records. [2025-09-24T21:49:38.729966] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:38.730763] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-24T21:49:38.744173] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-24T21:49:38.745227] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-24T21:49:38.745787] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T21:49:38.745928] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-24T21:49:39.156547] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:39.216062] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-24T21:49:39.991532] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-24T21:49:40.016029] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-24T21:49:40.205121] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T21:49:40.816085] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-24T21:49:41.616142] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-24T21:49:41.741516] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-24T21:49:41.786172] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-24T21:49:42.416108] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-24T21:49:43.128467] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T21:49:43.137527] [INFO ] [REMOTE ] UGI: Full fetch complete (73399 records). [2025-09-24T21:49:43.137724] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-24T21:49:43.221344] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-24T21:49:43.551628] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-24T21:49:43.551836] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-24T21:49:43.553268] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-24T21:49:43.553339] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-24T21:49:43.556228] [DEBUG] [LOCAL ] UGI: Trimmed 73399 records to 50533 (keeping 200 days of data) [2025-09-24T21:49:43.906380] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-24T21:49:43.934204] [DEBUG] [LOCAL ] UGI: Primary data saved (50533 records). [2025-09-24T21:49:43.934382] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-24T21:49:43.934521] [INFO ] [MAIN ] Update Progress: 2178/2373 symbols completed. UGI took 44.2s. Estimated remaining: 25m 56s. Rate: 7.5 symbols/min [2025-09-24T21:49:44.026076] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-24T21:49:44.110093] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:44.125357] [DEBUG] [LOCAL ] UI: Loaded 12673 existing records from primary storage. [2025-09-24T21:49:44.125523] [INFO ] [MAIN ] UI: Loaded 12673 existing records. [2025-09-24T21:49:44.266198] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T21:49:44.326700] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:44.326990] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-24T21:49:44.327047] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-24T21:49:44.327985] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-24T21:49:44.328053] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-24T21:49:44.714188] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:44.808762] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-24T21:49:44.816030] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-24T21:49:45.588902] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-24T21:49:45.616042] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-24T21:49:46.416056] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-24T21:49:46.429707] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-24T21:49:47.206914] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-24T21:49:47.216015] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-24T21:49:47.936445] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:49:48.016053] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-24T21:49:48.816058] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-24T21:49:48.940206] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-24T21:49:49.616045] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-24T21:49:49.812486] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-24T21:49:49.817013] [INFO ] [REMOTE ] UHAL: Full fetch complete (23193 records). [2025-09-24T21:49:49.817151] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-24T21:49:50.310440] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-24T21:49:50.310794] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-24T21:49:50.311438] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-24T21:49:50.311501] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-24T21:49:50.312276] [DEBUG] [LOCAL ] UHAL: Trimmed 23193 records to 16535 (keeping 200 days of data) [2025-09-24T21:49:50.416234] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-24T21:49:50.436078] [DEBUG] [LOCAL ] UHAL: Primary data saved (16535 records). [2025-09-24T21:49:50.436301] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-24T21:49:50.436422] [INFO ] [MAIN ] Update Progress: 2179/2373 symbols completed. UHAL took 29.1s. Estimated remaining: 25m 48s. Rate: 7.5 symbols/min [2025-09-24T21:49:50.561455] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-24T21:49:50.623283] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:49:50.662445] [DEBUG] [LOCAL ] UIS: Loaded 37092 existing records from primary storage. [2025-09-24T21:49:50.662594] [INFO ] [MAIN ] UIS: Loaded 37092 existing records. [2025-09-24T21:49:50.843814] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:49:50.844136] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-24T21:49:50.844227] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-24T21:49:50.845414] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-24T21:49:50.845479] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-24T21:49:51.218306] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-24T21:49:51.218166] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:49:52.016044] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-24T21:49:52.029446] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T21:49:52.065704] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T21:49:52.816064] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-24T21:49:52.921687] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T21:49:53.603029] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T21:49:53.616029] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-24T21:49:54.421254] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-24T21:49:54.428053] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T21:49:55.216174] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-24T21:49:55.260752] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T21:49:56.016184] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-24T21:49:56.563151] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-24T21:49:56.816127] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-24T21:49:56.937447] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T21:49:57.616111] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-24T21:49:58.373942] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T21:49:58.416126] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-24T21:49:58.619014] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-24T21:49:59.109377] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-24T21:49:59.216110] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-24T21:50:00.016121] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-24T21:50:00.570676] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T21:50:00.578122] [INFO ] [REMOTE ] UHS: Full fetch complete (58276 records). [2025-09-24T21:50:00.578277] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-24T21:50:00.822261] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-24T21:50:00.985873] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-24T21:50:00.986009] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-24T21:50:00.987725] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-24T21:50:00.987801] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-24T21:50:00.991524] [DEBUG] [LOCAL ] UHS: Trimmed 58276 records to 41126 (keeping 200 days of data) [2025-09-24T21:50:01.283947] [DEBUG] [LOCAL ] UHS: Primary data saved (41126 records). [2025-09-24T21:50:01.284168] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-24T21:50:01.284306] [INFO ] [MAIN ] Update Progress: 2180/2373 symbols completed. UHS took 38.6s. Estimated remaining: 25m 40s. Rate: 7.5 symbols/min [2025-09-24T21:50:01.477784] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:01.495214] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:50:01.560794] [DEBUG] [LOCAL ] UL: Loaded 53069 existing records from primary storage. [2025-09-24T21:50:01.561014] [INFO ] [MAIN ] UL: Loaded 53069 existing records. [2025-09-24T21:50:01.623030] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-24T21:50:01.792914] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:50:01.793203] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:01.797408] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-24T21:50:01.798114] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-24T21:50:01.799619] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-24T21:50:01.799716] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-24T21:50:02.202962] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:02.416122] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-24T21:50:02.482430] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T21:50:02.486050] [INFO ] [REMOTE ] UI: Full fetch complete (18168 records). [2025-09-24T21:50:02.486145] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-24T21:50:02.877563] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-24T21:50:02.877705] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-24T21:50:02.878330] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-24T21:50:02.878376] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-24T21:50:02.879194] [DEBUG] [LOCAL ] UI: Trimmed 18168 records to 12758 (keeping 200 days of data) [2025-09-24T21:50:02.970612] [DEBUG] [LOCAL ] UI: Primary data saved (12758 records). [2025-09-24T21:50:02.970863] [INFO ] [MAIN ] UI: Full history saved. [2025-09-24T21:50:02.971003] [INFO ] [MAIN ] Update Progress: 2181/2373 symbols completed. UI took 19.0s. Estimated remaining: 25m 32s. Rate: 7.5 symbols/min [2025-09-24T21:50:03.156126] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:03.202446] [DEBUG] [LOCAL ] ULS: Loaded 39325 existing records from primary storage. [2025-09-24T21:50:03.202677] [INFO ] [MAIN ] ULS: Loaded 39325 existing records. [2025-09-24T21:50:03.224847] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-24T21:50:03.409047] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:03.409438] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-24T21:50:03.409520] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-24T21:50:03.410921] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-24T21:50:03.410990] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-24T21:50:03.801240] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:04.016125] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-24T21:50:04.180401] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-24T21:50:04.183323] [INFO ] [REMOTE ] UHT: Full fetch complete (15212 records). [2025-09-24T21:50:04.183407] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-24T21:50:04.544438] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-24T21:50:04.681469] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-24T21:50:04.681593] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-24T21:50:04.682157] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-24T21:50:04.682267] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-24T21:50:04.683433] [DEBUG] [LOCAL ] UHT: Trimmed 15212 records to 9977 (keeping 200 days of data) [2025-09-24T21:50:04.755279] [DEBUG] [LOCAL ] UHT: Primary data saved (9977 records). [2025-09-24T21:50:04.755504] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-24T21:50:04.755623] [INFO ] [MAIN ] Update Progress: 2182/2373 symbols completed. UHT took 26.4s. Estimated remaining: 25m 23s. Rate: 7.5 symbols/min [2025-09-24T21:50:04.826787] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-24T21:50:04.949105] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:05.013209] [DEBUG] [LOCAL ] UMC: Loaded 52732 existing records from primary storage. [2025-09-24T21:50:05.013430] [INFO ] [MAIN ] UMC: Loaded 52732 existing records. [2025-09-24T21:50:05.230266] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:05.230913] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-24T21:50:05.231066] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-24T21:50:05.232876] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-24T21:50:05.232948] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-24T21:50:05.622981] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-24T21:50:05.669788] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:05.696909] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T21:50:06.416119] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-24T21:50:06.784738] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-24T21:50:06.837499] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-24T21:50:07.216114] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-24T21:50:08.016110] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-24T21:50:08.190991] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T21:50:08.816070] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-24T21:50:08.905249] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-24T21:50:09.080326] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-24T21:50:09.616199] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-24T21:50:10.416203] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-24T21:50:10.615143] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-24T21:50:11.216075] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-24T21:50:11.550273] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T21:50:11.752714] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T21:50:12.016186] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-24T21:50:12.816170] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-24T21:50:13.052191] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T21:50:13.134566] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-24T21:50:13.616146] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-24T21:50:14.244511] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T21:50:14.416190] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-24T21:50:15.085570] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T21:50:15.216138] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-24T21:50:15.739595] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-24T21:50:16.016174] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-24T21:50:16.816161] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-24T21:50:17.263158] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T21:50:17.450059] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T21:50:17.616135] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-24T21:50:18.227469] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T21:50:18.416149] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-24T21:50:19.216073] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-24T21:50:19.462688] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T21:50:20.016074] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-24T21:50:20.217004] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T21:50:20.654267] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T21:50:20.816144] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-24T21:50:21.616205] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-24T21:50:21.942246] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-24T21:50:22.349853] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-24T21:50:22.416127] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-24T21:50:23.035336] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-24T21:50:23.216203] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-24T21:50:24.016068] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-24T21:50:24.348003] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T21:50:24.816176] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-24T21:50:25.246018] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-24T21:50:25.521149] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T21:50:25.616089] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-24T21:50:26.069383] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-24T21:50:26.416121] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-24T21:50:27.216073] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-24T21:50:27.529241] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-24T21:50:28.016144] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-24T21:50:28.236884] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T21:50:28.271173] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T21:50:28.279978] [INFO ] [REMOTE ] UIS: Full fetch complete (52001 records). [2025-09-24T21:50:28.280190] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-24T21:50:28.684364] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-24T21:50:28.684457] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-24T21:50:28.685493] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-24T21:50:28.685557] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-24T21:50:28.686850] [DEBUG] [LOCAL ] UIS: Trimmed 52001 records to 37087 (keeping 200 days of data) [2025-09-24T21:50:28.816112] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-24T21:50:28.921830] [DEBUG] [LOCAL ] UIS: Primary data saved (37087 records). [2025-09-24T21:50:28.921990] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-24T21:50:28.922081] [INFO ] [MAIN ] Update Progress: 2183/2373 symbols completed. UIS took 38.5s. Estimated remaining: 25m 17s. Rate: 7.5 symbols/min [2025-09-24T21:50:29.098945] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:29.135431] [DEBUG] [LOCAL ] UMH: Loaded 33444 existing records from primary storage. [2025-09-24T21:50:29.135572] [INFO ] [MAIN ] UMH: Loaded 33444 existing records. [2025-09-24T21:50:29.323974] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:29.324250] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-24T21:50:29.324305] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-24T21:50:29.325134] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-24T21:50:29.325195] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-24T21:50:29.619250] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-24T21:50:29.702903] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:29.801025] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-24T21:50:29.811094] [INFO ] [REMOTE ] UL: Full fetch complete (76866 records). [2025-09-24T21:50:29.811282] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-24T21:50:30.294794] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-24T21:50:30.295073] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-24T21:50:30.296727] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-24T21:50:30.296820] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-24T21:50:30.320845] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-24T21:50:30.329699] [DEBUG] [LOCAL ] UL: Trimmed 76866 records to 53066 (keeping 200 days of data) [2025-09-24T21:50:30.425687] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-24T21:50:30.701941] [DEBUG] [LOCAL ] UL: Primary data saved (53066 records). [2025-09-24T21:50:30.702116] [INFO ] [MAIN ] UL: Full history saved. [2025-09-24T21:50:30.702227] [INFO ] [MAIN ] Update Progress: 2184/2373 symbols completed. UL took 29.4s. Estimated remaining: 25m 8s. Rate: 7.5 symbols/min [2025-09-24T21:50:30.901145] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:30.919930] [DEBUG] [LOCAL ] UNF: Loaded 11855 existing records from primary storage. [2025-09-24T21:50:30.920152] [INFO ] [MAIN ] UNF: Loaded 11855 existing records. [2025-09-24T21:50:31.120605] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T21:50:31.166896] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:31.167504] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-24T21:50:31.167587] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-24T21:50:31.168189] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-24T21:50:31.168255] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-24T21:50:31.222783] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-24T21:50:31.539854] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:31.786678] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T21:50:32.016156] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-24T21:50:32.753869] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T21:50:32.783846] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T21:50:32.816061] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-24T21:50:33.616092] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-24T21:50:33.846908] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T21:50:33.853587] [INFO ] [REMOTE ] ULS: Full fetch complete (54391 records). [2025-09-24T21:50:33.853725] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-24T21:50:34.244353] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-24T21:50:34.244476] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-24T21:50:34.245583] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-24T21:50:34.245672] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-24T21:50:34.247043] [DEBUG] [LOCAL ] ULS: Trimmed 54391 records to 39304 (keeping 200 days of data) [2025-09-24T21:50:34.427140] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-24T21:50:34.488733] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-24T21:50:34.521527] [DEBUG] [LOCAL ] ULS: Primary data saved (39304 records). [2025-09-24T21:50:34.521703] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-24T21:50:34.521848] [INFO ] [MAIN ] Update Progress: 2185/2373 symbols completed. ULS took 31.6s. Estimated remaining: 24m 60s. Rate: 7.5 symbols/min [2025-09-24T21:50:34.691140] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:34.739591] [DEBUG] [LOCAL ] UNFI: Loaded 41876 existing records from primary storage. [2025-09-24T21:50:34.739764] [INFO ] [MAIN ] UNFI: Loaded 41876 existing records. [2025-09-24T21:50:34.916878] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:34.917139] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-24T21:50:34.917187] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-24T21:50:34.918139] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-24T21:50:34.918201] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-24T21:50:35.221209] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-24T21:50:35.277882] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:36.016067] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-24T21:50:36.410619] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T21:50:36.444533] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T21:50:36.816058] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-24T21:50:36.829463] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T21:50:37.616089] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-24T21:50:38.416098] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-24T21:50:38.648077] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-24T21:50:39.165193] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-24T21:50:39.164901] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T21:50:39.216025] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-24T21:50:40.016099] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-24T21:50:40.273076] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T21:50:40.816058] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-24T21:50:41.117167] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T21:50:41.591264] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-24T21:50:41.616031] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-24T21:50:42.416117] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-24T21:50:42.469248] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T21:50:43.216118] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-24T21:50:43.848223] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-24T21:50:44.016070] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-24T21:50:44.816054] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-24T21:50:44.894337] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:50:44.903929] [INFO ] [REMOTE ] UMC: Full fetch complete (76592 records). [2025-09-24T21:50:44.904056] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-24T21:50:45.027049] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-24T21:50:45.311635] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-24T21:50:45.311749] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-24T21:50:45.312960] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-24T21:50:45.313025] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-24T21:50:45.314450] [DEBUG] [LOCAL ] UMC: Trimmed 76592 records to 52717 (keeping 200 days of data) [2025-09-24T21:50:45.618846] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-24T21:50:45.623163] [DEBUG] [LOCAL ] UMC: Primary data saved (52717 records). [2025-09-24T21:50:45.623284] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-24T21:50:45.623388] [INFO ] [MAIN ] Update Progress: 2186/2373 symbols completed. UMC took 40.9s. Estimated remaining: 24m 52s. Rate: 7.5 symbols/min [2025-09-24T21:50:45.798120] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:45.855403] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-24T21:50:45.855542] [INFO ] [MAIN ] UNH: Loaded 53794 existing records. [2025-09-24T21:50:46.041142] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:46.059256] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-24T21:50:46.059422] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-24T21:50:46.060585] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-24T21:50:46.063173] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-24T21:50:46.068019] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-24T21:50:46.380199] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T21:50:46.416752] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-24T21:50:46.436316] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:47.216113] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-24T21:50:47.770980] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-24T21:50:48.016184] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-24T21:50:48.816086] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-24T21:50:49.403797] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-24T21:50:49.433933] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T21:50:49.616054] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-24T21:50:50.069701] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-24T21:50:50.416164] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-24T21:50:51.216082] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-24T21:50:51.812282] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-24T21:50:51.968493] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T21:50:52.016078] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-24T21:50:52.562514] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T21:50:52.816125] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-24T21:50:53.476612] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T21:50:53.616079] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-24T21:50:54.130026] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-24T21:50:54.416098] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-24T21:50:55.073215] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T21:50:55.138354] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T21:50:55.141013] [INFO ] [REMOTE ] UNF: Full fetch complete (17157 records). [2025-09-24T21:50:55.141110] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-24T21:50:55.221284] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-24T21:50:55.529626] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-24T21:50:55.529739] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-24T21:50:55.530162] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-24T21:50:55.530202] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-24T21:50:55.530779] [DEBUG] [LOCAL ] UNF: Trimmed 17157 records to 11900 (keeping 200 days of data) [2025-09-24T21:50:55.613191] [DEBUG] [LOCAL ] UNF: Primary data saved (11900 records). [2025-09-24T21:50:55.613356] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-24T21:50:55.613449] [INFO ] [MAIN ] Update Progress: 2187/2373 symbols completed. UNF took 24.9s. Estimated remaining: 24m 44s. Rate: 7.5 symbols/min [2025-09-24T21:50:55.792583] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:55.840224] [DEBUG] [LOCAL ] UNM: Loaded 48702 existing records from primary storage. [2025-09-24T21:50:55.840377] [INFO ] [MAIN ] UNM: Loaded 48702 existing records. [2025-09-24T21:50:56.019985] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-24T21:50:56.069624] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:56.069944] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-24T21:50:56.069995] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-24T21:50:56.071505] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-24T21:50:56.071570] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-24T21:50:56.486265] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:50:56.656879] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T21:50:56.816093] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-24T21:50:57.616083] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-24T21:50:58.154580] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-24T21:50:58.286038] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T21:50:58.293760] [INFO ] [REMOTE ] UMH: Full fetch complete (46539 records). [2025-09-24T21:50:58.293932] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-24T21:50:58.421187] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-24T21:50:58.714080] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-24T21:50:58.714188] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-24T21:50:58.715363] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-24T21:50:58.715428] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-24T21:50:58.716493] [DEBUG] [LOCAL ] UMH: Trimmed 46539 records to 33525 (keeping 200 days of data) [2025-09-24T21:50:58.933333] [DEBUG] [LOCAL ] UMH: Primary data saved (33525 records). [2025-09-24T21:50:58.933534] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-24T21:50:58.933669] [INFO ] [MAIN ] Update Progress: 2188/2373 symbols completed. UMH took 30.0s. Estimated remaining: 24m 36s. Rate: 7.5 symbols/min [2025-09-24T21:50:59.111116] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:50:59.118594] [DEBUG] [LOCAL ] UNMA: Loaded 3622 existing records from primary storage. [2025-09-24T21:50:59.118851] [INFO ] [MAIN ] UNMA: Loaded 3622 existing records. [2025-09-24T21:50:59.220562] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-24T21:50:59.309522] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:50:59.310038] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-24T21:50:59.310181] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-24T21:50:59.310614] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-24T21:50:59.310712] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-24T21:50:59.489774] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-24T21:50:59.718330] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:00.016081] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-24T21:51:00.667122] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-24T21:51:00.771529] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-24T21:51:00.816038] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-24T21:51:00.935303] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T21:51:01.616078] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-24T21:51:02.416089] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-24T21:51:03.086738] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-24T21:51:03.192567] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T21:51:03.216033] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-24T21:51:03.682400] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-24T21:51:04.016114] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-24T21:51:04.816052] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-24T21:51:04.900498] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-24T21:51:05.616130] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-24T21:51:06.416175] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-24T21:51:06.741379] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T21:51:06.874241] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (3.66 seconds). [2025-09-24T21:51:07.216146] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-24T21:51:07.461919] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-24T21:51:08.016099] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-24T21:51:08.816140] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-24T21:51:10.197993] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-24T21:51:10.199598] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-24T21:51:10.256193] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-24T21:51:10.358700] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (3.94 seconds). [2025-09-24T21:51:10.416041] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-24T21:51:10.762223] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T21:51:11.216072] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-24T21:51:11.266934] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-24T21:51:11.837089] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T21:51:12.016158] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-24T21:51:12.816104] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-24T21:51:13.144718] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-24T21:51:13.223089] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-24T21:51:13.330825] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-24T21:51:13.338310] [INFO ] [REMOTE ] UNFI: Full fetch complete (58848 records). [2025-09-24T21:51:13.338429] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-24T21:51:13.621169] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-24T21:51:13.723360] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-24T21:51:13.723446] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-24T21:51:13.724554] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-24T21:51:13.724622] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-24T21:51:13.725954] [DEBUG] [LOCAL ] UNFI: Trimmed 58848 records to 41833 (keeping 200 days of data) [2025-09-24T21:51:13.987256] [DEBUG] [LOCAL ] UNFI: Primary data saved (41833 records). [2025-09-24T21:51:13.987479] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-24T21:51:13.987723] [INFO ] [MAIN ] Update Progress: 2189/2373 symbols completed. UNFI took 39.5s. Estimated remaining: 24m 28s. Rate: 7.5 symbols/min [2025-09-24T21:51:14.167276] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:14.229552] [DEBUG] [LOCAL ] UNP: Loaded 53245 existing records from primary storage. [2025-09-24T21:51:14.229755] [INFO ] [MAIN ] UNP: Loaded 53245 existing records. [2025-09-24T21:51:14.406786] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:14.407077] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-24T21:51:14.407128] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-24T21:51:14.409136] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-24T21:51:14.409228] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-24T21:51:14.422057] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-24T21:51:14.796452] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:15.216128] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-24T21:51:15.686280] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:51:16.016193] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-24T21:51:16.350417] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T21:51:16.566359] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-24T21:51:16.816109] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-24T21:51:17.618293] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-24T21:51:17.621162] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:51:18.416118] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-24T21:51:19.216052] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-24T21:51:19.300973] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T21:51:19.539744] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-24T21:51:19.541194] [INFO ] [REMOTE ] UNMA: Full fetch complete (5798 records). [2025-09-24T21:51:19.541316] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-24T21:51:19.973853] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-09-24T21:51:19.971231] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-24T21:51:19.985360] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-24T21:51:19.986933] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-24T21:51:19.987567] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-24T21:51:19.988264] [DEBUG] [LOCAL ] UNMA: Trimmed 5798 records to 3596 (keeping 200 days of data) [2025-09-24T21:51:20.011884] [DEBUG] [LOCAL ] UNMA: Primary data saved (3596 records). [2025-09-24T21:51:20.011988] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-24T21:51:20.012206] [INFO ] [MAIN ] Update Progress: 2190/2373 symbols completed. UNMA took 21.1s. Estimated remaining: 24m 20s. Rate: 7.5 symbols/min [2025-09-24T21:51:20.024861] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-24T21:51:20.199120] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:20.257969] [DEBUG] [LOCAL ] UP: Loaded 43073 existing records from primary storage. [2025-09-24T21:51:20.258128] [INFO ] [MAIN ] UP: Loaded 43073 existing records. [2025-09-24T21:51:20.437446] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-24T21:51:20.486498] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:20.486819] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-24T21:51:20.486883] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-24T21:51:20.487954] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-24T21:51:20.488034] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-24T21:51:20.821530] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-24T21:51:20.856404] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:21.484265] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-24T21:51:21.500124] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-09-24T21:51:21.500293] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-24T21:51:21.621170] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-24T21:51:21.932916] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-24T21:51:21.933158] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-24T21:51:21.934554] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-24T21:51:21.934704] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-24T21:51:21.967773] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-24T21:51:21.977366] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53794 (keeping 200 days of data) [2025-09-24T21:51:22.351081] [DEBUG] [LOCAL ] UNH: Primary data saved (53794 records). [2025-09-24T21:51:22.351317] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-24T21:51:22.351472] [INFO ] [MAIN ] Update Progress: 2191/2373 symbols completed. UNH took 36.7s. Estimated remaining: 24m 12s. Rate: 7.5 symbols/min [2025-09-24T21:51:22.421316] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-24T21:51:22.555034] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:22.615373] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-24T21:51:22.615541] [INFO ] [MAIN ] UPS: Loaded 53710 existing records. [2025-09-24T21:51:22.795441] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:22.795730] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-24T21:51:22.795789] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-24T21:51:22.797112] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-24T21:51:22.797174] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-24T21:51:23.177661] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:23.216040] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-24T21:51:23.267881] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T21:51:24.016121] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-24T21:51:24.155439] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T21:51:24.816095] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-24T21:51:25.379527] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-24T21:51:25.616142] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-24T21:51:25.890962] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-24T21:51:26.001818] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T21:51:26.416089] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-24T21:51:27.216115] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-24T21:51:27.662836] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-24T21:51:27.783115] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-24T21:51:28.016083] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-24T21:51:28.821242] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-24T21:51:28.834107] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T21:51:29.616100] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-24T21:51:29.662537] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T21:51:30.416091] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-24T21:51:31.032791] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-24T21:51:31.216081] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-24T21:51:31.876859] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-24T21:51:31.922590] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T21:51:32.016031] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-24T21:51:32.764239] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T21:51:32.816047] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-24T21:51:33.616069] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-24T21:51:33.903837] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-24T21:51:34.416045] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-24T21:51:34.503985] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T21:51:34.844080] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:51:34.855164] [INFO ] [REMOTE ] UNM: Full fetch complete (70143 records). [2025-09-24T21:51:34.855361] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-24T21:51:35.221273] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-24T21:51:35.268560] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-24T21:51:35.268636] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-24T21:51:35.269960] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-24T21:51:35.270027] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-24T21:51:35.274229] [DEBUG] [LOCAL ] UNM: Trimmed 70143 records to 48699 (keeping 200 days of data) [2025-09-24T21:51:35.593482] [DEBUG] [LOCAL ] UNM: Primary data saved (48699 records). [2025-09-24T21:51:35.594179] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-24T21:51:35.594497] [INFO ] [MAIN ] Update Progress: 2192/2373 symbols completed. UNM took 40.0s. Estimated remaining: 24m 4s. Rate: 7.5 symbols/min [2025-09-24T21:51:35.775226] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:35.817018] [DEBUG] [LOCAL ] URI: Loaded 36431 existing records from primary storage. [2025-09-24T21:51:35.817178] [INFO ] [MAIN ] URI: Loaded 36431 existing records. [2025-09-24T21:51:36.017437] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-24T21:51:36.027306] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:36.040215] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-24T21:51:36.041316] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T21:51:36.040299] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-24T21:51:36.049858] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-24T21:51:36.050302] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-24T21:51:36.408088] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:36.816085] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-24T21:51:36.954836] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T21:51:37.616111] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-24T21:51:38.260154] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-24T21:51:38.347983] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T21:51:38.416052] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-24T21:51:39.216091] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-24T21:51:39.620871] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T21:51:40.016066] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-24T21:51:40.046465] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T21:51:40.668277] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T21:51:40.816087] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-24T21:51:41.616131] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-24T21:51:42.416135] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-24T21:51:43.427820] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-24T21:51:43.439992] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-24T21:51:43.467349] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-24T21:51:43.973914] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-24T21:51:44.016075] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-24T21:51:44.073626] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T21:51:44.816093] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-24T21:51:45.538408] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-24T21:51:45.548137] [INFO ] [REMOTE ] UNP: Full fetch complete (76898 records). [2025-09-24T21:51:45.548357] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-24T21:51:45.619022] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-24T21:51:45.708417] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-24T21:51:46.041979] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-24T21:51:46.042127] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-24T21:51:46.043464] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-24T21:51:46.043680] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-24T21:51:46.054492] [DEBUG] [LOCAL ] UNP: Trimmed 76898 records to 53251 (keeping 200 days of data) [2025-09-24T21:51:46.074273] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-24T21:51:46.174788] [INFO ] [REMOTE ] UP: Full fetch complete (62079 records). [2025-09-24T21:51:46.175908] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-24T21:51:46.421601] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-24T21:51:46.636598] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-24T21:51:46.636735] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-24T21:51:46.637965] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-24T21:51:46.638052] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-24T21:51:46.742745] [DEBUG] [LOCAL ] UP: Trimmed 62079 records to 43090 (keeping 200 days of data) [2025-09-24T21:51:46.970431] [DEBUG] [LOCAL ] UNP: Primary data saved (53251 records). [2025-09-24T21:51:47.015065] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-24T21:51:47.024960] [INFO ] [MAIN ] Update Progress: 2193/2373 symbols completed. UNP took 33.0s. Estimated remaining: 23m 57s. Rate: 7.5 symbols/min [2025-09-24T21:51:47.259600] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:47.312962] [DEBUG] [LOCAL ] UP: Primary data saved (43090 records). [2025-09-24T21:51:47.315699] [INFO ] [MAIN ] UP: Full history saved. [2025-09-24T21:51:47.315531] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:51:47.315978] [INFO ] [MAIN ] Update Progress: 2194/2373 symbols completed. UP took 27.3s. Estimated remaining: 23m 48s. Rate: 7.5 symbols/min [2025-09-24T21:51:47.341966] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-24T21:51:47.533735] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:47.534998] [DEBUG] [LOCAL ] USA: Loaded 36108 existing records from primary storage. [2025-09-24T21:51:47.535345] [INFO ] [MAIN ] USA: Loaded 36108 existing records. [2025-09-24T21:51:47.735492] [DEBUG] [LOCAL ] USAC: Loaded 22901 existing records from primary storage. [2025-09-24T21:51:47.734948] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:47.735886] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-24T21:51:47.735960] [INFO ] [MAIN ] USAC: Loaded 22901 existing records. [2025-09-24T21:51:47.780166] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-24T21:51:47.848190] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-24T21:51:47.858550] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-24T21:51:48.110399] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:48.137155] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-24T21:51:48.153918] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-24T21:51:48.166117] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-24T21:51:48.173900] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-24T21:51:48.720721] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:48.733676] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-24T21:51:48.827203] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:48.827911] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-24T21:51:48.877550] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-24T21:51:49.249749] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:51:49.616138] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-24T21:51:49.970787] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:51:50.132843] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T21:51:50.416136] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-24T21:51:51.216090] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-24T21:51:51.375544] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T21:51:51.844194] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-24T21:51:52.016089] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-24T21:51:52.816101] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-24T21:51:53.394678] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-24T21:51:53.495293] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-24T21:51:53.616092] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-24T21:51:54.107019] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-24T21:51:54.127875] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-24T21:51:54.136299] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-24T21:51:54.136474] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-24T21:51:54.421205] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-24T21:51:54.548478] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-24T21:51:54.548612] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-24T21:51:54.550120] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-24T21:51:54.550204] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-24T21:51:54.552127] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53710 (keeping 200 days of data) [2025-09-24T21:51:54.908021] [DEBUG] [LOCAL ] UPS: Primary data saved (53710 records). [2025-09-24T21:51:54.908173] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-24T21:51:54.908267] [INFO ] [MAIN ] Update Progress: 2195/2373 symbols completed. UPS took 32.6s. Estimated remaining: 23m 40s. Rate: 7.5 symbols/min [2025-09-24T21:51:55.084743] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:51:55.140541] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-24T21:51:55.140729] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-24T21:51:55.221244] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-24T21:51:55.326591] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:51:55.326860] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-24T21:51:55.326909] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-24T21:51:55.328088] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-24T21:51:55.328151] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-24T21:51:55.698162] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:51:55.834502] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-24T21:51:56.016086] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-24T21:51:56.811927] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T21:51:56.819467] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-24T21:51:57.006694] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T21:51:57.616091] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-24T21:51:58.063111] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T21:51:58.416104] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-24T21:51:58.904632] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T21:51:59.216178] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-24T21:51:59.563781] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-24T21:52:00.016082] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-24T21:52:00.518378] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:52:00.816076] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-24T21:52:01.223923] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T21:52:01.616097] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-24T21:52:01.796580] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T21:52:02.416082] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-24T21:52:02.969599] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T21:52:03.216085] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-24T21:52:03.778438] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T21:52:04.016107] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-24T21:52:04.665796] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T21:52:04.816120] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-24T21:52:05.125216] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-24T21:52:05.616091] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-24T21:52:06.416079] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-24T21:52:06.629296] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-24T21:52:06.679532] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T21:52:07.216127] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-24T21:52:07.596950] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-24T21:52:07.927293] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T21:52:07.934272] [INFO ] [REMOTE ] URI: Full fetch complete (53779 records). [2025-09-24T21:52:07.934473] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-24T21:52:08.021275] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-24T21:52:08.357344] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-24T21:52:08.357468] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-24T21:52:08.358984] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-24T21:52:08.359055] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-24T21:52:08.360733] [DEBUG] [LOCAL ] URI: Trimmed 53779 records to 36267 (keeping 200 days of data) [2025-09-24T21:52:08.617783] [DEBUG] [LOCAL ] URI: Primary data saved (36267 records). [2025-09-24T21:52:08.618002] [INFO ] [MAIN ] URI: Full history saved. [2025-09-24T21:52:08.618116] [INFO ] [MAIN ] Update Progress: 2196/2373 symbols completed. URI took 33.0s. Estimated remaining: 23m 33s. Rate: 7.5 symbols/min [2025-09-24T21:52:08.808212] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:08.816120] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-24T21:52:08.875204] [DEBUG] [LOCAL ] USFD: Loaded 51227 existing records from primary storage. [2025-09-24T21:52:08.875418] [INFO ] [MAIN ] USFD: Loaded 51227 existing records. [2025-09-24T21:52:09.062940] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:09.063304] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-24T21:52:09.063357] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-24T21:52:09.064536] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-24T21:52:09.064599] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-24T21:52:09.426457] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T21:52:09.500763] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:09.514045] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T21:52:09.616088] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-24T21:52:10.416167] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-24T21:52:11.068766] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T21:52:11.075908] [INFO ] [REMOTE ] USA: Full fetch complete (51592 records). [2025-09-24T21:52:11.076071] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-24T21:52:11.221227] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-24T21:52:11.480493] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-24T21:52:11.480635] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-24T21:52:11.481910] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-24T21:52:11.481981] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-24T21:52:11.483270] [DEBUG] [LOCAL ] USA: Trimmed 51592 records to 35974 (keeping 200 days of data) [2025-09-24T21:52:11.703827] [DEBUG] [LOCAL ] USA: Primary data saved (35974 records). [2025-09-24T21:52:11.703979] [INFO ] [MAIN ] USA: Full history saved. [2025-09-24T21:52:11.704069] [INFO ] [MAIN ] Update Progress: 2197/2373 symbols completed. USA took 24.7s. Estimated remaining: 23m 24s. Rate: 7.5 symbols/min [2025-09-24T21:52:12.016092] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-24T21:52:12.075227] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T21:52:12.424471] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-24T21:52:12.816135] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-24T21:52:13.616402] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-24T21:52:13.622078] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:52:14.416220] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-24T21:52:14.816872] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T21:52:14.842618] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T21:52:14.848096] [INFO ] [REMOTE ] USAC: Full fetch complete (35770 records). [2025-09-24T21:52:14.848184] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-24T21:52:15.219503] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-24T21:52:15.219254] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-24T21:52:15.220606] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-24T21:52:15.221462] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-24T21:52:15.221664] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-24T21:52:15.222586] [DEBUG] [LOCAL ] USAC: Trimmed 35770 records to 22802 (keeping 200 days of data) [2025-09-24T21:52:15.368044] [DEBUG] [LOCAL ] USAC: Primary data saved (22802 records). [2025-09-24T21:52:15.368185] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-24T21:52:15.368271] [INFO ] [MAIN ] Update Progress: 2198/2373 symbols completed. USAC took 28.0s. Estimated remaining: 23m 16s. Rate: 7.5 symbols/min [2025-09-24T21:52:16.177515] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T21:52:16.188027] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-24T21:52:17.321438] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-24T21:52:17.334261] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-24T21:52:17.794586] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:52:17.809579] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-24T21:52:18.927967] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T21:52:18.939357] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-24T21:52:19.574574] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T21:52:19.585383] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-24T21:52:20.519423] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T21:52:20.536899] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-24T21:52:20.811934] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-24T21:52:20.823138] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-24T21:52:22.235390] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T21:52:22.248048] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-24T21:52:22.529813] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:52:22.542041] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-24T21:52:23.945993] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-24T21:52:23.957932] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-24T21:52:24.222776] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:52:24.235273] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-24T21:52:24.316218] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-24T21:52:24.326257] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-09-24T21:52:24.326432] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-24T21:52:24.733990] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-24T21:52:24.734144] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-24T21:52:24.735626] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-24T21:52:24.735709] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-24T21:52:24.737683] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-09-24T21:52:25.068978] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-24T21:52:25.069125] [INFO ] [MAIN ] USB: Full history saved. [2025-09-24T21:52:25.069214] [INFO ] [MAIN ] Update Progress: 2199/2373 symbols completed. USB took 30.2s. Estimated remaining: 23m 8s. Rate: 7.5 symbols/min [2025-09-24T21:52:25.996928] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:52:26.009387] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-24T21:52:27.733243] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T21:52:27.744512] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-24T21:52:29.188913] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T21:52:29.197938] [INFO ] [REMOTE ] USFD: Full fetch complete (73883 records). [2025-09-24T21:52:29.198065] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-24T21:52:29.610110] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-24T21:52:29.610201] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-24T21:52:29.611485] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-24T21:52:29.611555] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-24T21:52:29.613200] [DEBUG] [LOCAL ] USFD: Trimmed 73883 records to 51210 (keeping 200 days of data) [2025-09-24T21:52:29.930083] [DEBUG] [LOCAL ] USFD: Primary data saved (51210 records). [2025-09-24T21:52:29.930239] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-24T21:52:29.930329] [INFO ] [MAIN ] Update Progress: 2200/2373 symbols completed. USFD took 21.3s. Estimated remaining: 22m 60s. Rate: 7.5 symbols/min [2025-09-24T21:52:30.553898] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:30.697315] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:30.691607] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:30.716841] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:30.752119] [DEBUG] [LOCAL ] USNA: Loaded 18221 existing records from primary storage. [2025-09-24T21:52:30.760424] [INFO ] [MAIN ] USNA: Loaded 18221 existing records. [2025-09-24T21:52:30.837154] [DEBUG] [LOCAL ] USPH: Loaded 16579 existing records from primary storage. [2025-09-24T21:52:30.857279] [INFO ] [MAIN ] USPH: Loaded 16579 existing records. [2025-09-24T21:52:30.877582] [DEBUG] [LOCAL ] UTF: Loaded 28596 existing records from primary storage. [2025-09-24T21:52:30.883190] [INFO ] [MAIN ] UTF: Loaded 28596 existing records. [2025-09-24T21:52:30.883825] [DEBUG] [LOCAL ] UTI: Loaded 40514 existing records from primary storage. [2025-09-24T21:52:30.968789] [INFO ] [MAIN ] UTI: Loaded 40514 existing records. [2025-09-24T21:52:31.383566] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:31.577259] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-24T21:52:31.610755] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:31.634895] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-24T21:52:31.634670] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:31.638393] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-24T21:52:31.638626] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:31.638490] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-24T21:52:31.639349] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-24T21:52:31.639275] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-24T21:52:31.639456] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-24T21:52:31.639600] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-24T21:52:31.639847] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-24T21:52:31.639791] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-24T21:52:31.645585] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-24T21:52:31.660597] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-24T21:52:31.675249] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-24T21:52:31.669795] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-24T21:52:31.675081] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-24T21:52:31.775466] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-24T21:52:33.126087] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:33.149417] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-24T21:52:33.119585] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:33.209269] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-24T21:52:33.289437] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:33.306045] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-24T21:52:33.310248] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:33.311490] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-24T21:52:34.191833] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T21:52:34.196317] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-24T21:52:34.261727] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-24T21:52:34.265763] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-24T21:52:34.611929] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-24T21:52:34.620897] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-24T21:52:34.624519] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T21:52:34.631426] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-24T21:52:34.961420] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-24T21:52:34.964940] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-24T21:52:35.041240] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T21:52:35.045863] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-24T21:52:35.791303] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-24T21:52:35.794305] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-24T21:52:35.985768] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T21:52:35.993743] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-24T21:52:36.148889] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T21:52:36.153978] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-24T21:52:36.179416] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T21:52:36.593449] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-24T21:52:36.816122] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-24T21:52:37.055970] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T21:52:37.154279] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-24T21:52:37.616145] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-24T21:52:37.947772] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-24T21:52:38.416120] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-24T21:52:38.785989] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T21:52:39.216140] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-24T21:52:39.596561] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-24T21:52:40.016138] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-24T21:52:40.342062] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T21:52:40.816073] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-24T21:52:40.990967] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T21:52:41.616115] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-24T21:52:41.792744] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T21:52:42.416132] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-24T21:52:43.193074] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T21:52:43.216059] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-24T21:52:43.695858] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-24T21:52:44.016099] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-24T21:52:44.714313] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T21:52:44.816120] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-24T21:52:45.164891] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-24T21:52:45.616146] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-24T21:52:45.787294] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T21:52:46.416145] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-24T21:52:47.090882] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-24T21:52:47.216064] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-24T21:52:47.686480] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-24T21:52:48.016145] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-24T21:52:48.786613] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T21:52:48.816088] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-24T21:52:49.009912] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-24T21:52:49.616145] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-24T21:52:50.360104] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T21:52:50.416067] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-24T21:52:50.705003] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-24T21:52:51.216094] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-24T21:52:51.557426] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T21:52:52.016224] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-24T21:52:52.271568] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-24T21:52:52.816104] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-24T21:52:52.928359] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-24T21:52:53.616179] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-24T21:52:53.783140] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:52:54.416094] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-24T21:52:55.030814] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-24T21:52:55.216071] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-24T21:52:55.252709] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-24T21:52:55.256133] [INFO ] [REMOTE ] USNA: Full fetch complete (26545 records). [2025-09-24T21:52:55.256224] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-24T21:52:55.641444] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-24T21:52:55.641530] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-24T21:52:55.642272] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-24T21:52:55.642339] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-24T21:52:55.644206] [DEBUG] [LOCAL ] USNA: Trimmed 26545 records to 18165 (keeping 200 days of data) [2025-09-24T21:52:55.761020] [DEBUG] [LOCAL ] USNA: Primary data saved (18165 records). [2025-09-24T21:52:55.761193] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-24T21:52:55.761292] [INFO ] [MAIN ] Update Progress: 2201/2373 symbols completed. USNA took 25.8s. Estimated remaining: 22m 53s. Rate: 7.5 symbols/min [2025-09-24T21:52:55.933215] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:55.946553] [DEBUG] [LOCAL ] UTL: Loaded 11057 existing records from primary storage. [2025-09-24T21:52:55.946706] [INFO ] [MAIN ] UTL: Loaded 11057 existing records. [2025-09-24T21:52:56.021235] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-24T21:52:56.172000] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:56.181270] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-24T21:52:56.181579] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-24T21:52:56.181870] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-24T21:52:56.185469] [INFO ] [REMOTE ] USPH: Full fetch complete (22523 records). [2025-09-24T21:52:56.185555] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-24T21:52:56.185685] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-24T21:52:56.185860] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-24T21:52:56.822585] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-24T21:52:57.041719] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-24T21:52:57.062270] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-24T21:52:57.078383] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-24T21:52:57.100799] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:57.101227] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-24T21:52:57.102861] [DEBUG] [LOCAL ] USPH: Trimmed 22523 records to 16566 (keeping 200 days of data) [2025-09-24T21:52:57.212563] [DEBUG] [LOCAL ] USPH: Primary data saved (16566 records). [2025-09-24T21:52:57.212782] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-24T21:52:57.212936] [INFO ] [MAIN ] Update Progress: 2202/2373 symbols completed. USPH took 27.3s. Estimated remaining: 22m 45s. Rate: 7.5 symbols/min [2025-09-24T21:52:57.397514] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:57.443768] [DEBUG] [LOCAL ] UTZ: Loaded 44740 existing records from primary storage. [2025-09-24T21:52:57.443929] [INFO ] [MAIN ] UTZ: Loaded 44740 existing records. [2025-09-24T21:52:57.577023] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-24T21:52:57.632506] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-24T21:52:57.632818] [INFO ] [REMOTE ] UTI: Full fetch complete (58038 records). [2025-09-24T21:52:57.669390] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-24T21:52:57.676877] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:57.677175] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-24T21:52:57.677228] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-24T21:52:57.684186] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-24T21:52:57.684527] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-24T21:52:58.408587] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:58.444071] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-24T21:52:58.497847] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-24T21:52:58.508721] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-24T21:52:58.509954] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-24T21:52:58.512308] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-24T21:52:58.514630] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-24T21:52:58.515005] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-24T21:52:58.516597] [DEBUG] [LOCAL ] UTI: Trimmed 58038 records to 40510 (keeping 200 days of data) [2025-09-24T21:52:58.765964] [DEBUG] [LOCAL ] UTI: Primary data saved (40510 records). [2025-09-24T21:52:58.766147] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-24T21:52:58.766271] [INFO ] [MAIN ] Update Progress: 2203/2373 symbols completed. UTI took 28.8s. Estimated remaining: 22m 36s. Rate: 7.5 symbols/min [2025-09-24T21:52:58.943401] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:52:58.965099] [DEBUG] [LOCAL ] UVE: Loaded 21861 existing records from primary storage. [2025-09-24T21:52:58.965239] [INFO ] [MAIN ] UVE: Loaded 21861 existing records. [2025-09-24T21:52:59.140222] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:52:59.140527] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-24T21:52:59.140576] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-24T21:52:59.141280] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-24T21:52:59.141340] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-24T21:52:59.221352] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-24T21:52:59.498554] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:52:59.915008] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-24T21:53:00.016081] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-24T21:53:00.165181] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T21:53:00.816093] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-24T21:53:01.621191] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-24T21:53:01.637675] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T21:53:01.681759] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T21:53:02.416112] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-24T21:53:02.787630] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T21:53:02.797116] [INFO ] [REMOTE ] UTF: Full fetch complete (41244 records). [2025-09-24T21:53:02.797326] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-24T21:53:03.199671] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-24T21:53:03.199777] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-24T21:53:03.200995] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-24T21:53:03.201071] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-24T21:53:03.203019] [DEBUG] [LOCAL ] UTF: Trimmed 41244 records to 28610 (keeping 200 days of data) [2025-09-24T21:53:03.262730] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-24T21:53:03.308904] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-24T21:53:03.403279] [DEBUG] [LOCAL ] UTF: Primary data saved (28610 records). [2025-09-24T21:53:03.403453] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-24T21:53:03.403594] [INFO ] [MAIN ] Update Progress: 2204/2373 symbols completed. UTF took 33.5s. Estimated remaining: 22m 28s. Rate: 7.5 symbols/min [2025-09-24T21:53:03.573737] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:03.597076] [DEBUG] [LOCAL ] UVV: Loaded 22410 existing records from primary storage. [2025-09-24T21:53:03.597274] [INFO ] [MAIN ] UVV: Loaded 22410 existing records. [2025-09-24T21:53:03.774803] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:03.775049] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-24T21:53:03.775098] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-24T21:53:03.775895] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-24T21:53:03.775971] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-24T21:53:04.021486] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-24T21:53:04.145341] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:04.199588] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T21:53:04.816157] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-24T21:53:05.623930] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-24T21:53:05.627310] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T21:53:05.677420] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-24T21:53:06.416058] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-24T21:53:06.540487] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T21:53:07.216102] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-24T21:53:07.761412] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:53:08.016110] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-24T21:53:08.298831] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T21:53:08.816108] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-24T21:53:09.351945] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:53:09.616055] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-24T21:53:09.868410] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:53:10.292826] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-24T21:53:10.416091] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-24T21:53:11.216097] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-24T21:53:11.482273] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T21:53:12.016101] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-24T21:53:12.737249] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T21:53:12.816120] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-24T21:53:12.866919] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T21:53:13.616081] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-24T21:53:14.317204] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T21:53:14.373977] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T21:53:14.416092] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-24T21:53:15.216109] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-24T21:53:15.496695] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T21:53:16.016108] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-24T21:53:16.442703] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-24T21:53:16.816118] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-24T21:53:17.324829] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-24T21:53:17.616121] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-24T21:53:18.421271] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-24T21:53:18.438738] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T21:53:18.463523] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-24T21:53:19.216203] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-24T21:53:19.268920] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-24T21:53:20.018492] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-24T21:53:20.021453] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T21:53:20.816112] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-24T21:53:21.444673] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-24T21:53:21.616099] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-24T21:53:22.149106] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-24T21:53:22.416113] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-24T21:53:22.680007] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-24T21:53:22.687467] [INFO ] [REMOTE ] UTZ: Full fetch complete (63685 records). [2025-09-24T21:53:22.687682] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-24T21:53:23.101137] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-24T21:53:23.101291] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-24T21:53:23.103352] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-24T21:53:23.103457] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-24T21:53:23.106195] [DEBUG] [LOCAL ] UTZ: Trimmed 63685 records to 44677 (keeping 200 days of data) [2025-09-24T21:53:23.220720] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-24T21:53:23.399703] [DEBUG] [LOCAL ] UTZ: Primary data saved (44677 records). [2025-09-24T21:53:23.399870] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-24T21:53:23.400048] [INFO ] [MAIN ] Update Progress: 2205/2373 symbols completed. UTZ took 26.2s. Estimated remaining: 22m 21s. Rate: 7.5 symbols/min [2025-09-24T21:53:23.602337] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T21:53:23.606073] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:23.668636] [DEBUG] [LOCAL ] UWMC: Loaded 52739 existing records from primary storage. [2025-09-24T21:53:23.668841] [INFO ] [MAIN ] UWMC: Loaded 52739 existing records. [2025-09-24T21:53:23.882668] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:23.883102] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-24T21:53:23.883192] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-24T21:53:23.884418] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-24T21:53:23.884510] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-24T21:53:24.017323] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-24T21:53:24.263090] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:24.342506] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-24T21:53:24.816098] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-24T21:53:24.934691] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-24T21:53:25.616161] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-24T21:53:26.180125] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-24T21:53:26.416135] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-24T21:53:27.188694] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-24T21:53:27.216054] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-24T21:53:27.400904] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-24T21:53:28.016119] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-24T21:53:28.448580] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-24T21:53:28.816066] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-24T21:53:28.912612] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-24T21:53:28.916744] [INFO ] [REMOTE ] UVV: Full fetch complete (29735 records). [2025-09-24T21:53:28.916832] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-24T21:53:29.301949] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-24T21:53:29.302049] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-24T21:53:29.302724] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-24T21:53:29.302800] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-24T21:53:29.303810] [DEBUG] [LOCAL ] UVV: Trimmed 29735 records to 22401 (keeping 200 days of data) [2025-09-24T21:53:29.449369] [DEBUG] [LOCAL ] UVV: Primary data saved (22401 records). [2025-09-24T21:53:29.449727] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-24T21:53:29.449920] [INFO ] [MAIN ] Update Progress: 2206/2373 symbols completed. UVV took 26.0s. Estimated remaining: 22m 13s. Rate: 7.5 symbols/min [2025-09-24T21:53:29.617518] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-24T21:53:29.649490] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:29.664797] [DEBUG] [LOCAL ] UZD: Loaded 6309 existing records from primary storage. [2025-09-24T21:53:29.664925] [INFO ] [MAIN ] UZD: Loaded 6309 existing records. [2025-09-24T21:53:29.798173] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T21:53:29.868405] [INFO ] [REMOTE ] UTL: Full fetch complete (15170 records). [2025-09-24T21:53:29.872156] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:29.872818] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-24T21:53:29.872718] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-24T21:53:29.873024] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-24T21:53:29.879080] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-24T21:53:29.919310] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-24T21:53:30.420898] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-24T21:53:30.722248] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:30.723824] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-24T21:53:30.724177] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-24T21:53:30.724910] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-24T21:53:30.725159] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-24T21:53:30.739336] [DEBUG] [LOCAL ] UTL: Trimmed 15170 records to 11080 (keeping 200 days of data) [2025-09-24T21:53:30.740932] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-24T21:53:30.826100] [DEBUG] [LOCAL ] UTL: Primary data saved (11080 records). [2025-09-24T21:53:30.826291] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-24T21:53:30.826412] [INFO ] [MAIN ] Update Progress: 2207/2373 symbols completed. UTL took 35.1s. Estimated remaining: 22m 4s. Rate: 7.5 symbols/min [2025-09-24T21:53:31.017103] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:31.030937] [DEBUG] [LOCAL ] UZE: Loaded 7458 existing records from primary storage. [2025-09-24T21:53:31.031125] [INFO ] [MAIN ] UZE: Loaded 7458 existing records. [2025-09-24T21:53:31.226741] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-24T21:53:31.233699] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:31.236075] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-24T21:53:31.236144] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-24T21:53:31.236504] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-24T21:53:31.236567] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-24T21:53:31.658853] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:32.016184] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-24T21:53:32.189480] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T21:53:32.318844] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-24T21:53:32.324962] [INFO ] [REMOTE ] UVE: Full fetch complete (29597 records). [2025-09-24T21:53:32.325215] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-24T21:53:32.635431] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T21:53:32.731818] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-24T21:53:32.731909] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-24T21:53:32.732610] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-24T21:53:32.732681] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-24T21:53:32.733599] [DEBUG] [LOCAL ] UVE: Trimmed 29597 records to 21838 (keeping 200 days of data) [2025-09-24T21:53:32.841053] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-24T21:53:32.894240] [DEBUG] [LOCAL ] UVE: Primary data saved (21838 records). [2025-09-24T21:53:32.894480] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-24T21:53:32.894752] [INFO ] [MAIN ] Update Progress: 2208/2373 symbols completed. UVE took 34.1s. Estimated remaining: 21m 56s. Rate: 7.5 symbols/min [2025-09-24T21:53:33.066792] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:33.076919] [DEBUG] [LOCAL ] UZF: Loaded 6444 existing records from primary storage. [2025-09-24T21:53:33.077017] [INFO ] [MAIN ] UZF: Loaded 6444 existing records. [2025-09-24T21:53:33.268620] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:33.268959] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-24T21:53:33.269089] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-24T21:53:33.269432] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-24T21:53:33.269525] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-24T21:53:33.621284] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-24T21:53:33.649992] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:34.416151] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-24T21:53:34.573751] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-24T21:53:34.596382] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T21:53:35.185168] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-24T21:53:35.216047] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-24T21:53:35.595487] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-24T21:53:36.016115] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-24T21:53:36.573153] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T21:53:36.816088] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-24T21:53:37.536443] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T21:53:37.616110] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-24T21:53:38.416074] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-24T21:53:38.484291] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-24T21:53:38.995014] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-24T21:53:39.216108] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-24T21:53:39.708173] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-24T21:53:40.016096] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-24T21:53:40.816090] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-24T21:53:41.536151] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:53:41.616034] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-24T21:53:41.790738] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T21:53:42.182205] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T21:53:42.416077] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-24T21:53:43.216063] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-24T21:53:43.245799] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-24T21:53:43.989027] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T21:53:44.016114] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-24T21:53:44.816099] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-24T21:53:45.530844] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-24T21:53:45.616071] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-24T21:53:45.782364] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T21:53:46.038111] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-24T21:53:46.416126] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-24T21:53:47.180741] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-24T21:53:47.216029] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-24T21:53:47.906393] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-24T21:53:48.016099] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-24T21:53:48.519034] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-24T21:53:48.816088] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-24T21:53:49.582189] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-24T21:53:49.616072] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-24T21:53:50.301397] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T21:53:50.303150] [INFO ] [REMOTE ] UZE: Full fetch complete (10148 records). [2025-09-24T21:53:50.303225] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-24T21:53:50.421146] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-24T21:53:50.736077] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-24T21:53:50.736156] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-24T21:53:50.736395] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-24T21:53:50.736434] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-24T21:53:50.736907] [DEBUG] [LOCAL ] UZE: Trimmed 10148 records to 7490 (keeping 200 days of data) [2025-09-24T21:53:50.788687] [DEBUG] [LOCAL ] UZE: Primary data saved (7490 records). [2025-09-24T21:53:50.789382] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-24T21:53:50.789728] [INFO ] [MAIN ] Update Progress: 2209/2373 symbols completed. UZE took 20.0s. Estimated remaining: 21m 49s. Rate: 7.5 symbols/min [2025-09-24T21:53:50.975129] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:51.053687] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-24T21:53:51.053968] [INFO ] [MAIN ] V: Loaded 53763 existing records. [2025-09-24T21:53:51.219845] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-24T21:53:51.245770] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:51.246290] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-24T21:53:51.246379] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-24T21:53:51.249364] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-24T21:53:51.249466] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-24T21:53:51.635977] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:52.001995] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-24T21:53:52.016095] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-24T21:53:52.152216] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T21:53:52.741110] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T21:53:52.816070] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-24T21:53:53.607577] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T21:53:53.616020] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-24T21:53:54.381009] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-24T21:53:54.416042] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-24T21:53:54.954431] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T21:53:55.216131] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-24T21:53:56.016105] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-24T21:53:56.134476] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-24T21:53:56.816129] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-24T21:53:57.359410] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T21:53:57.616104] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-24T21:53:57.710881] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-24T21:53:57.991332] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-24T21:53:57.992544] [INFO ] [REMOTE ] UZD: Full fetch complete (9375 records). [2025-09-24T21:53:57.992616] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-24T21:53:58.364013] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-24T21:53:58.364363] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-24T21:53:58.364726] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-24T21:53:58.364791] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-24T21:53:58.365237] [DEBUG] [LOCAL ] UZD: Trimmed 9375 records to 6284 (keeping 200 days of data) [2025-09-24T21:53:58.407681] [DEBUG] [LOCAL ] UZD: Primary data saved (6284 records). [2025-09-24T21:53:58.407790] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-24T21:53:58.407885] [INFO ] [MAIN ] Update Progress: 2210/2373 symbols completed. UZD took 29.0s. Estimated remaining: 21m 41s. Rate: 7.5 symbols/min [2025-09-24T21:53:58.421283] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-24T21:53:58.588847] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:53:58.636815] [DEBUG] [LOCAL ] VAC: Loaded 34611 existing records from primary storage. [2025-09-24T21:53:58.637015] [INFO ] [MAIN ] VAC: Loaded 34611 existing records. [2025-09-24T21:53:58.814949] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:53:58.815247] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-24T21:53:58.815306] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-24T21:53:58.816445] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-24T21:53:58.816508] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-24T21:53:59.177934] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:53:59.216042] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-24T21:54:00.016115] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-24T21:54:00.425775] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-24T21:54:00.555976] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-24T21:54:00.816126] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-24T21:54:00.996499] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-24T21:54:01.616155] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-24T21:54:02.416115] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-24T21:54:03.216137] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-24T21:54:03.634220] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-24T21:54:03.635844] [INFO ] [REMOTE ] UZF: Full fetch complete (8782 records). [2025-09-24T21:54:03.635923] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-24T21:54:04.032902] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-24T21:54:04.033073] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-24T21:54:04.033401] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-24T21:54:04.033479] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-24T21:54:04.034217] [DEBUG] [LOCAL ] UZF: Trimmed 8782 records to 6458 (keeping 200 days of data) [2025-09-24T21:54:04.101222] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (3.29 seconds). [2025-09-24T21:54:04.113851] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-24T21:54:04.122016] [DEBUG] [LOCAL ] UZF: Primary data saved (6458 records). [2025-09-24T21:54:04.122092] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-24T21:54:04.122172] [INFO ] [MAIN ] Update Progress: 2211/2373 symbols completed. UZF took 31.2s. Estimated remaining: 21m 33s. Rate: 7.5 symbols/min [2025-09-24T21:54:04.305243] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:04.366697] [DEBUG] [LOCAL ] VAL: Loaded 50437 existing records from primary storage. [2025-09-24T21:54:04.366916] [INFO ] [MAIN ] VAL: Loaded 50437 existing records. [2025-09-24T21:54:04.557582] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:04.557870] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-24T21:54:04.557920] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-24T21:54:04.559013] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-24T21:54:04.559087] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-24T21:54:04.939092] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:04.939423] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-24T21:54:05.310674] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-24T21:54:05.565397] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-24T21:54:05.616042] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-24T21:54:06.385231] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-24T21:54:06.416035] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-24T21:54:06.763196] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T21:54:06.802706] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T21:54:07.216122] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-24T21:54:08.016091] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-24T21:54:08.480428] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-24T21:54:08.816147] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-24T21:54:08.952845] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T21:54:09.104954] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-24T21:54:09.616092] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-24T21:54:10.416081] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-24T21:54:10.491597] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:54:10.502048] [INFO ] [REMOTE ] UWMC: Full fetch complete (75444 records). [2025-09-24T21:54:10.502247] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-24T21:54:10.926221] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-24T21:54:10.926400] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-24T21:54:10.927741] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-24T21:54:10.927829] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-24T21:54:10.929748] [DEBUG] [LOCAL ] UWMC: Trimmed 75444 records to 52739 (keeping 200 days of data) [2025-09-24T21:54:11.189537] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:54:11.216236] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-24T21:54:11.312710] [DEBUG] [LOCAL ] UWMC: Primary data saved (52739 records). [2025-09-24T21:54:11.312877] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-24T21:54:11.312984] [INFO ] [MAIN ] Update Progress: 2212/2373 symbols completed. UWMC took 47.9s. Estimated remaining: 21m 24s. Rate: 7.5 symbols/min [2025-09-24T21:54:11.495206] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:11.547964] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-24T21:54:11.548124] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-09-24T21:54:11.733393] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:11.733695] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-24T21:54:11.733755] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-24T21:54:11.735009] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-24T21:54:11.735072] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-24T21:54:12.024816] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-24T21:54:12.125940] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:12.153861] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T21:54:12.671546] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-24T21:54:12.816048] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-24T21:54:13.616087] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-24T21:54:14.219589] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-24T21:54:14.260947] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-24T21:54:14.416082] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-24T21:54:15.216122] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-24T21:54:16.016068] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-24T21:54:16.070329] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-24T21:54:16.816110] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-24T21:54:17.576533] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T21:54:17.616119] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-24T21:54:17.676606] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-24T21:54:18.033161] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-09-24T21:54:18.416061] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-24T21:54:18.655015] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-24T21:54:18.897263] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T21:54:19.216134] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-24T21:54:20.016132] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-24T21:54:20.315888] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T21:54:20.321756] [INFO ] [REMOTE ] VAC: Full fetch complete (47788 records). [2025-09-24T21:54:20.321896] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-24T21:54:20.739033] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-24T21:54:20.739303] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-24T21:54:20.740493] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-24T21:54:20.740613] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-24T21:54:20.742141] [DEBUG] [LOCAL ] VAC: Trimmed 47788 records to 34540 (keeping 200 days of data) [2025-09-24T21:54:20.826053] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-24T21:54:20.876009] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-24T21:54:21.040852] [DEBUG] [LOCAL ] VAC: Primary data saved (34540 records). [2025-09-24T21:54:21.041081] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-24T21:54:21.041201] [INFO ] [MAIN ] Update Progress: 2213/2373 symbols completed. VAC took 22.6s. Estimated remaining: 21m 17s. Rate: 7.5 symbols/min [2025-09-24T21:54:21.236011] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:21.243736] [DEBUG] [LOCAL ] VATE: Loaded 5673 existing records from primary storage. [2025-09-24T21:54:21.243879] [INFO ] [MAIN ] VATE: Loaded 5673 existing records. [2025-09-24T21:54:21.438915] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:21.439300] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-24T21:54:21.439445] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-24T21:54:21.439852] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-24T21:54:21.440010] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-24T21:54:21.659834] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-24T21:54:21.840807] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T21:54:21.883574] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:22.416170] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-24T21:54:22.998968] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-24T21:54:23.216097] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-24T21:54:23.765161] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-24T21:54:24.016126] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-24T21:54:24.093726] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-24T21:54:24.220616] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:54:24.816081] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-24T21:54:25.616124] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-24T21:54:26.416130] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-24T21:54:27.158432] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-24T21:54:27.160691] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T21:54:27.216034] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-24T21:54:27.375424] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-24T21:54:28.016059] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-24T21:54:28.077262] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-24T21:54:28.816075] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-24T21:54:28.978497] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-24T21:54:29.616095] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-24T21:54:29.753286] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T21:54:29.786563] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T21:54:30.416124] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-24T21:54:31.068476] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T21:54:31.216116] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-24T21:54:31.838184] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-24T21:54:32.016054] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-24T21:54:32.496545] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-24T21:54:32.505909] [INFO ] [REMOTE ] V: Full fetch complete (77829 records). [2025-09-24T21:54:32.506063] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-24T21:54:32.823148] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-24T21:54:32.909046] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-24T21:54:32.909146] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-24T21:54:32.910393] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-24T21:54:32.910477] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-24T21:54:32.912281] [DEBUG] [LOCAL ] V: Trimmed 77829 records to 53762 (keeping 200 days of data) [2025-09-24T21:54:32.940085] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T21:54:33.281408] [DEBUG] [LOCAL ] V: Primary data saved (53762 records). [2025-09-24T21:54:33.281550] [INFO ] [MAIN ] V: Full history saved. [2025-09-24T21:54:33.281636] [INFO ] [MAIN ] Update Progress: 2214/2373 symbols completed. V took 42.5s. Estimated remaining: 21m 9s. Rate: 7.5 symbols/min [2025-09-24T21:54:33.451968] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:33.461295] [DEBUG] [LOCAL ] VBF: Loaded 7089 existing records from primary storage. [2025-09-24T21:54:33.461412] [INFO ] [MAIN ] VBF: Loaded 7089 existing records. [2025-09-24T21:54:33.613793] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-24T21:54:33.619264] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-24T21:54:33.651397] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:33.651597] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-24T21:54:33.651679] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-24T21:54:33.651978] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-24T21:54:33.652037] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-24T21:54:34.014012] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:34.416113] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-24T21:54:34.962325] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T21:54:34.971060] [INFO ] [REMOTE ] VAL: Full fetch complete (73295 records). [2025-09-24T21:54:34.971190] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-24T21:54:35.224737] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-24T21:54:35.376089] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-24T21:54:35.376214] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-24T21:54:35.378022] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-24T21:54:35.378093] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-24T21:54:35.379632] [DEBUG] [LOCAL ] VAL: Trimmed 73295 records to 50416 (keeping 200 days of data) [2025-09-24T21:54:35.694151] [DEBUG] [LOCAL ] VAL: Primary data saved (50416 records). [2025-09-24T21:54:35.694312] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-24T21:54:35.694403] [INFO ] [MAIN ] Update Progress: 2215/2373 symbols completed. VAL took 31.6s. Estimated remaining: 21m 1s. Rate: 7.5 symbols/min [2025-09-24T21:54:35.875169] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:35.875870] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T21:54:35.891590] [DEBUG] [LOCAL ] VCV: Loaded 13406 existing records from primary storage. [2025-09-24T21:54:35.891724] [INFO ] [MAIN ] VCV: Loaded 13406 existing records. [2025-09-24T21:54:36.020763] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-24T21:54:36.079143] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:36.079361] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-24T21:54:36.079410] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-24T21:54:36.079873] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-24T21:54:36.079935] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-24T21:54:36.454489] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:36.509629] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-24T21:54:36.568823] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-24T21:54:36.816086] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-24T21:54:37.616099] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-24T21:54:37.636909] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-24T21:54:38.351255] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T21:54:38.416092] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-24T21:54:39.103495] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T21:54:39.105411] [INFO ] [REMOTE ] VATE: Full fetch complete (10543 records). [2025-09-24T21:54:39.105491] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-24T21:54:39.221241] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-24T21:54:39.489180] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-24T21:54:39.489255] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-24T21:54:39.489506] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-24T21:54:39.489546] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-24T21:54:39.490009] [DEBUG] [LOCAL ] VATE: Trimmed 10543 records to 5627 (keeping 200 days of data) [2025-09-24T21:54:39.524087] [DEBUG] [LOCAL ] VATE: Primary data saved (5627 records). [2025-09-24T21:54:39.524189] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-24T21:54:39.524274] [INFO ] [MAIN ] Update Progress: 2216/2373 symbols completed. VATE took 18.5s. Estimated remaining: 20m 52s. Rate: 7.5 symbols/min [2025-09-24T21:54:39.694176] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:39.739017] [DEBUG] [LOCAL ] VEEV: Loaded 47275 existing records from primary storage. [2025-09-24T21:54:39.739162] [INFO ] [MAIN ] VEEV: Loaded 47275 existing records. [2025-09-24T21:54:39.935412] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:39.935762] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-24T21:54:39.935856] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-24T21:54:39.937341] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-24T21:54:39.937407] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-24T21:54:40.021175] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-24T21:54:40.361191] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:40.362325] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:54:40.816082] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-24T21:54:41.383323] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T21:54:41.616098] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-24T21:54:42.177309] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-24T21:54:42.416094] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-24T21:54:43.139723] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-24T21:54:43.173045] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-24T21:54:43.216085] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-24T21:54:43.908977] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-24T21:54:44.016125] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-24T21:54:44.816082] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-24T21:54:45.606338] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T21:54:45.616019] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-24T21:54:45.742800] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-24T21:54:46.381502] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-24T21:54:46.416084] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-24T21:54:47.142661] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-24T21:54:47.216100] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-24T21:54:48.016085] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-24T21:54:48.787812] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T21:54:48.817982] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-24T21:54:48.823226] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-24T21:54:49.616081] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-24T21:54:50.328343] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T21:54:50.416061] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-24T21:54:50.957050] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-24T21:54:51.070784] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-24T21:54:51.216044] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-24T21:54:52.016089] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-24T21:54:52.716547] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-24T21:54:52.816034] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-24T21:54:53.291599] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-24T21:54:53.437322] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-24T21:54:53.616097] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-24T21:54:54.416084] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-24T21:54:54.999942] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-24T21:54:55.047575] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T21:54:55.216110] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-24T21:54:56.016109] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-24T21:54:56.734732] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-24T21:54:56.816145] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-24T21:54:56.893845] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-24T21:54:56.903756] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-24T21:54:56.903933] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-24T21:54:57.318573] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-24T21:54:57.318682] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-24T21:54:57.319914] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-24T21:54:57.319979] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-24T21:54:57.321497] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-09-24T21:54:57.627809] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-24T21:54:57.628921] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-24T21:54:57.659144] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-24T21:54:57.659249] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-24T21:54:57.659331] [INFO ] [MAIN ] Update Progress: 2217/2373 symbols completed. VALE took 46.3s. Estimated remaining: 20m 45s. Rate: 7.5 symbols/min [2025-09-24T21:54:57.830817] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:54:57.845128] [DEBUG] [LOCAL ] VEL: Loaded 13126 existing records from primary storage. [2025-09-24T21:54:57.845233] [INFO ] [MAIN ] VEL: Loaded 13126 existing records. [2025-09-24T21:54:58.026534] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:54:58.026812] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-24T21:54:58.026870] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-24T21:54:58.027247] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-24T21:54:58.027306] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-24T21:54:58.400515] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:54:58.416093] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-24T21:54:59.120626] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T21:54:59.216121] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-24T21:54:59.424924] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T21:54:59.960998] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-24T21:55:00.016045] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-24T21:55:00.816052] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-24T21:55:01.152569] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T21:55:01.155733] [INFO ] [REMOTE ] VCV: Full fetch complete (19607 records). [2025-09-24T21:55:01.155837] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-24T21:55:01.550722] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T21:55:01.550461] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-24T21:55:01.553056] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-24T21:55:01.553545] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-24T21:55:01.553590] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-24T21:55:01.554222] [DEBUG] [LOCAL ] VCV: Trimmed 19607 records to 13464 (keeping 200 days of data) [2025-09-24T21:55:01.619196] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-24T21:55:01.644278] [DEBUG] [LOCAL ] VCV: Primary data saved (13464 records). [2025-09-24T21:55:01.644466] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-24T21:55:01.644567] [INFO ] [MAIN ] Update Progress: 2218/2373 symbols completed. VCV took 26.0s. Estimated remaining: 20m 37s. Rate: 7.5 symbols/min [2025-09-24T21:55:01.839250] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:01.882382] [DEBUG] [LOCAL ] VET: Loaded 44097 existing records from primary storage. [2025-09-24T21:55:01.882533] [INFO ] [MAIN ] VET: Loaded 44097 existing records. [2025-09-24T21:55:02.062303] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:02.062623] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-24T21:55:02.062717] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-24T21:55:02.063676] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-24T21:55:02.063753] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-24T21:55:02.354847] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T21:55:02.372876] [INFO ] [REMOTE ] VBF: Full fetch complete (10373 records). [2025-09-24T21:55:02.378169] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-24T21:55:02.421682] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-24T21:55:02.481844] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:02.895038] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-24T21:55:02.895202] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-24T21:55:02.895676] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-24T21:55:02.895742] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-24T21:55:02.896440] [DEBUG] [LOCAL ] VBF: Trimmed 10373 records to 7071 (keeping 200 days of data) [2025-09-24T21:55:02.944552] [DEBUG] [LOCAL ] VBF: Primary data saved (7071 records). [2025-09-24T21:55:02.944795] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-24T21:55:02.944921] [INFO ] [MAIN ] Update Progress: 2219/2373 symbols completed. VBF took 29.7s. Estimated remaining: 20m 28s. Rate: 7.5 symbols/min [2025-09-24T21:55:03.132533] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:03.197353] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-09-24T21:55:03.197596] [INFO ] [MAIN ] VFC: Loaded 53611 existing records. [2025-09-24T21:55:03.221233] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-24T21:55:03.391303] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:03.391738] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-24T21:55:03.391811] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-24T21:55:03.393598] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-24T21:55:03.393734] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-24T21:55:03.803478] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:04.016139] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-24T21:55:04.450439] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T21:55:04.816109] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-24T21:55:05.021679] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-24T21:55:05.616098] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-24T21:55:05.874634] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-24T21:55:06.332544] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:55:06.416094] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-24T21:55:06.657908] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T21:55:07.216073] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-24T21:55:07.439411] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T21:55:08.016086] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-24T21:55:08.816082] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-24T21:55:08.858604] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:55:09.077380] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-24T21:55:09.616111] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-24T21:55:10.416111] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-24T21:55:10.451119] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T21:55:10.613268] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-24T21:55:11.216112] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-24T21:55:11.938933] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T21:55:12.016102] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-24T21:55:12.655181] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T21:55:12.816127] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-24T21:55:13.400265] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T21:55:13.616068] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-24T21:55:13.787065] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T21:55:14.416123] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-24T21:55:15.175959] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-24T21:55:15.216084] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-24T21:55:15.420034] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T21:55:16.016088] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-24T21:55:16.816084] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-24T21:55:16.986567] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T21:55:17.616111] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-24T21:55:17.712464] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T21:55:18.416101] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-24T21:55:18.557313] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T21:55:18.565980] [INFO ] [REMOTE ] VEEV: Full fetch complete (68346 records). [2025-09-24T21:55:18.566172] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-24T21:55:18.985334] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-24T21:55:18.985523] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-24T21:55:18.986890] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-24T21:55:18.986962] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-24T21:55:18.988542] [DEBUG] [LOCAL ] VEEV: Trimmed 68346 records to 47121 (keeping 200 days of data) [2025-09-24T21:55:19.100628] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T21:55:19.218958] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-24T21:55:19.301157] [DEBUG] [LOCAL ] VEEV: Primary data saved (47121 records). [2025-09-24T21:55:19.301303] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-24T21:55:19.301415] [INFO ] [MAIN ] Update Progress: 2220/2373 symbols completed. VEEV took 39.8s. Estimated remaining: 20m 21s. Rate: 7.5 symbols/min [2025-09-24T21:55:19.493785] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:19.494300] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-24T21:55:19.494359] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-24T21:55:19.494526] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-24T21:55:19.494579] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-24T21:55:19.494624] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-24T21:55:19.494694] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-24T21:55:19.647113] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-24T21:55:19.922997] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:20.016057] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-24T21:55:20.028414] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T21:55:20.246932] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:55:20.247258] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-24T21:55:20.816095] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-24T21:55:21.616142] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-24T21:55:21.714726] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T21:55:22.416129] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-24T21:55:23.219516] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-24T21:55:23.221332] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T21:55:23.224521] [INFO ] [REMOTE ] VEL: Full fetch complete (16755 records). [2025-09-24T21:55:23.224798] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-24T21:55:23.353680] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T21:55:23.670038] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-24T21:55:23.670149] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-24T21:55:23.670547] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-24T21:55:23.670591] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-24T21:55:23.671157] [DEBUG] [LOCAL ] VEL: Trimmed 16755 records to 13086 (keeping 200 days of data) [2025-09-24T21:55:23.748176] [DEBUG] [LOCAL ] VEL: Primary data saved (13086 records). [2025-09-24T21:55:23.748321] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-24T21:55:23.748408] [INFO ] [MAIN ] Update Progress: 2221/2373 symbols completed. VEL took 26.1s. Estimated remaining: 20m 13s. Rate: 7.5 symbols/min [2025-09-24T21:55:23.920856] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:23.927619] [DEBUG] [LOCAL ] VGI: Loaded 5174 existing records from primary storage. [2025-09-24T21:55:23.927742] [INFO ] [MAIN ] VGI: Loaded 5174 existing records. [2025-09-24T21:55:24.021438] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-24T21:55:24.119431] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:24.119702] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-24T21:55:24.119762] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-24T21:55:24.120087] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-24T21:55:24.120149] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-24T21:55:24.485710] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:24.816072] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-24T21:55:24.940425] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T21:55:25.433519] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T21:55:25.616055] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-24T21:55:26.136992] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-24T21:55:26.416074] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-24T21:55:27.216111] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-24T21:55:27.271288] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T21:55:27.935387] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T21:55:28.016060] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-24T21:55:28.470709] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-24T21:55:28.589729] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T21:55:28.816107] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-24T21:55:29.616099] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-24T21:55:30.416135] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-24T21:55:30.843148] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-24T21:55:31.128638] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T21:55:31.216045] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-24T21:55:32.014533] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T21:55:32.024757] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-24T21:55:32.742977] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T21:55:32.816123] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-24T21:55:33.616088] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-24T21:55:34.015254] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-24T21:55:34.013895] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-24T21:55:34.416045] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-24T21:55:34.528444] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T21:55:35.216118] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-24T21:55:36.016115] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-24T21:55:36.445470] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T21:55:36.816117] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-24T21:55:37.113153] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-24T21:55:37.182679] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T21:55:37.194074] [INFO ] [REMOTE ] VET: Full fetch complete (64360 records). [2025-09-24T21:55:37.194310] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-24T21:55:37.516978] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-24T21:55:37.607577] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-24T21:55:37.607699] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-24T21:55:37.609337] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-24T21:55:37.609434] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-24T21:55:37.611052] [DEBUG] [LOCAL ] VET: Trimmed 64360 records to 44066 (keeping 200 days of data) [2025-09-24T21:55:37.661764] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-24T21:55:37.872403] [DEBUG] [LOCAL ] VET: Primary data saved (44066 records). [2025-09-24T21:55:37.872546] [INFO ] [MAIN ] VET: Full history saved. [2025-09-24T21:55:37.872678] [INFO ] [MAIN ] Update Progress: 2222/2373 symbols completed. VET took 36.2s. Estimated remaining: 20m 5s. Rate: 7.5 symbols/min [2025-09-24T21:55:38.048154] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:38.066440] [DEBUG] [LOCAL ] VGM: Loaded 18238 existing records from primary storage. [2025-09-24T21:55:38.066559] [INFO ] [MAIN ] VGM: Loaded 18238 existing records. [2025-09-24T21:55:38.244415] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:38.244735] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-24T21:55:38.244793] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-24T21:55:38.245412] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-24T21:55:38.245485] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-24T21:55:38.426415] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-24T21:55:38.602321] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:39.216080] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-24T21:55:39.786223] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-24T21:55:39.803137] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-24T21:55:40.016056] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-24T21:55:40.585290] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-24T21:55:40.619311] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T21:55:40.816070] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-24T21:55:41.616064] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-24T21:55:41.826000] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T21:55:42.416122] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-24T21:55:43.216084] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-24T21:55:43.318092] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-24T21:55:43.699366] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-24T21:55:44.016091] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-24T21:55:44.816096] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-24T21:55:44.949239] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T21:55:45.427075] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T21:55:45.616054] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-24T21:55:45.767366] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-24T21:55:45.776823] [INFO ] [REMOTE ] VG: Full fetch complete (64897 records). [2025-09-24T21:55:45.776970] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-24T21:55:46.011194] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-24T21:55:46.012116] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:55:46.012192] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:55:46.012320] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-24T21:55:46.012473] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-24T21:55:46.012563] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-24T21:55:46.012668] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-24T21:55:46.012798] [INFO ] [MAIN ] Update Progress: 2223/2373 symbols completed. VG took 26.7s. Estimated remaining: 19m 57s. Rate: 7.5 symbols/min [2025-09-24T21:55:46.199184] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:46.200843] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-24T21:55:46.208161] [DEBUG] [LOCAL ] VHI: Loaded 2886 existing records from primary storage. [2025-09-24T21:55:46.208268] [INFO ] [MAIN ] VHI: Loaded 2886 existing records. [2025-09-24T21:55:46.385613] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:46.385897] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-24T21:55:46.385953] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-24T21:55:46.386306] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-24T21:55:46.386366] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-24T21:55:46.421266] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-24T21:55:46.770817] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:47.216059] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-24T21:55:47.488414] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T21:55:48.016819] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-24T21:55:48.017989] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T21:55:48.022769] [INFO ] [REMOTE ] VGI: Full fetch complete (7769 records). [2025-09-24T21:55:48.022922] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-24T21:55:48.496363] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-24T21:55:48.496521] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-24T21:55:48.497002] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-24T21:55:48.497121] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-24T21:55:48.498159] [DEBUG] [LOCAL ] VGI: Trimmed 7769 records to 5170 (keeping 200 days of data) [2025-09-24T21:55:48.547170] [DEBUG] [LOCAL ] VGI: Primary data saved (5170 records). [2025-09-24T21:55:48.547357] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-24T21:55:48.547592] [INFO ] [MAIN ] Update Progress: 2224/2373 symbols completed. VGI took 24.8s. Estimated remaining: 19m 49s. Rate: 7.5 symbols/min [2025-09-24T21:55:48.801610] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:48.801887] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-24T21:55:48.801954] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-24T21:55:48.806014] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-24T21:55:48.806140] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-24T21:55:48.806245] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-24T21:55:48.806319] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-24T21:55:48.823192] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-24T21:55:49.269089] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-24T21:55:49.524348] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:49.548719] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T21:55:49.616085] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-24T21:55:50.223144] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-24T21:55:50.416079] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-24T21:55:50.966717] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-24T21:55:51.216088] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-24T21:55:51.823753] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T21:55:52.016057] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-24T21:55:52.816082] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-24T21:55:53.616060] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-24T21:55:53.787795] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-24T21:55:53.908593] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-24T21:55:53.919499] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-09-24T21:55:53.919670] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-24T21:55:54.025461] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-24T21:55:54.336199] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-24T21:55:54.336328] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-24T21:55:54.338004] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-24T21:55:54.338085] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-24T21:55:54.343086] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 53610 (keeping 200 days of data) [2025-09-24T21:55:54.419607] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-24T21:55:54.695727] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-09-24T21:55:54.695899] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-24T21:55:54.695995] [INFO ] [MAIN ] Update Progress: 2225/2373 symbols completed. VFC took 51.8s. Estimated remaining: 19m 41s. Rate: 7.5 symbols/min [2025-09-24T21:55:54.863288] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:55:54.922372] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-24T21:55:54.922519] [INFO ] [MAIN ] VICI: Loaded 53649 existing records. [2025-09-24T21:55:55.108287] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:55:55.108567] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-24T21:55:55.108633] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-24T21:55:55.110315] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-24T21:55:55.110388] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-24T21:55:55.221178] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-24T21:55:55.442453] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-24T21:55:55.514516] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:55:55.538885] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:55:55.539230] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-24T21:55:56.016091] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-24T21:55:56.524152] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-24T21:55:56.816079] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-24T21:55:57.370123] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-24T21:55:57.616091] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-24T21:55:57.841725] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:55:57.842124] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-24T21:55:58.416099] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-24T21:55:58.621836] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:55:58.622203] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-24T21:55:59.216113] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-24T21:56:00.016131] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-24T21:56:00.352040] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-24T21:56:00.664452] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T21:56:00.816075] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-24T21:56:01.616050] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-24T21:56:01.801577] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T21:56:01.888711] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:01.889192] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-24T21:56:02.416078] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-24T21:56:02.917600] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-24T21:56:03.216096] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-24T21:56:04.016076] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-24T21:56:04.259861] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-24T21:56:04.491742] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-24T21:56:04.492857] [INFO ] [REMOTE ] VHI: Full fetch complete (4606 records). [2025-09-24T21:56:04.492931] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-24T21:56:04.823969] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-24T21:56:04.869699] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-24T21:56:04.869790] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-24T21:56:04.869953] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-24T21:56:04.869993] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-24T21:56:04.870382] [DEBUG] [LOCAL ] VHI: Trimmed 4606 records to 2880 (keeping 200 days of data) [2025-09-24T21:56:04.892323] [DEBUG] [LOCAL ] VHI: Primary data saved (2880 records). [2025-09-24T21:56:04.892447] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-24T21:56:04.892604] [INFO ] [MAIN ] Update Progress: 2226/2373 symbols completed. VHI took 18.9s. Estimated remaining: 19m 33s. Rate: 7.5 symbols/min [2025-09-24T21:56:05.076938] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:05.077089] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:05.077833] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-24T21:56:05.156304] [DEBUG] [LOCAL ] VIK: Loaded 52512 existing records from primary storage. [2025-09-24T21:56:05.156473] [INFO ] [MAIN ] VIK: Loaded 52512 existing records. [2025-09-24T21:56:05.341107] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:05.341408] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-24T21:56:05.341484] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-24T21:56:05.343768] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-24T21:56:05.343833] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-24T21:56:05.622769] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-24T21:56:05.706275] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:06.416126] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-24T21:56:07.216098] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-24T21:56:07.504773] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:07.505136] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-24T21:56:07.583982] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T21:56:07.589455] [INFO ] [REMOTE ] VGM: Full fetch complete (26183 records). [2025-09-24T21:56:07.589558] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-24T21:56:07.910323] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-24T21:56:08.014447] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-24T21:56:08.014667] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-24T21:56:08.015248] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-24T21:56:08.015290] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-24T21:56:08.016081] [DEBUG] [LOCAL ] VGM: Trimmed 26183 records to 18204 (keeping 200 days of data) [2025-09-24T21:56:08.016232] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-24T21:56:08.140269] [DEBUG] [LOCAL ] VGM: Primary data saved (18204 records). [2025-09-24T21:56:08.140427] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-24T21:56:08.140609] [INFO ] [MAIN ] Update Progress: 2227/2373 symbols completed. VGM took 30.3s. Estimated remaining: 19m 25s. Rate: 7.5 symbols/min [2025-09-24T21:56:08.312572] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:08.376227] [DEBUG] [LOCAL ] VIPS: Loaded 51359 existing records from primary storage. [2025-09-24T21:56:08.376392] [INFO ] [MAIN ] VIPS: Loaded 51359 existing records. [2025-09-24T21:56:08.553703] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:08.553968] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-24T21:56:08.554016] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-24T21:56:08.555407] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-24T21:56:08.555470] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-24T21:56:08.824339] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-24T21:56:08.916295] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:09.095765] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:09.096134] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-24T21:56:09.616097] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-24T21:56:09.937920] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-24T21:56:10.416070] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-24T21:56:10.691318] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:10.691826] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-24T21:56:11.212400] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T21:56:11.222286] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-24T21:56:12.016125] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-24T21:56:12.816103] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-24T21:56:13.031958] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:56:13.033192] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-24T21:56:13.038296] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-24T21:56:13.616088] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-24T21:56:13.657808] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:56:14.416058] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-24T21:56:14.644490] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T21:56:14.648254] [INFO ] [REMOTE ] VIA: Full fetch complete (2331 records). [2025-09-24T21:56:14.648338] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-24T21:56:14.833278] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 9 unique days, need 200 days [2025-09-24T21:56:14.833525] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:56:14.833598] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:56:14.833704] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-24T21:56:14.833799] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-24T21:56:14.833858] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-24T21:56:14.833921] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-24T21:56:14.834007] [INFO ] [MAIN ] Update Progress: 2228/2373 symbols completed. VIA took 26.3s. Estimated remaining: 19m 17s. Rate: 7.5 symbols/min [2025-09-24T21:56:15.016772] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:15.081281] [DEBUG] [LOCAL ] VIRT: Loaded 46883 existing records from primary storage. [2025-09-24T21:56:15.081450] [INFO ] [MAIN ] VIRT: Loaded 46883 existing records. [2025-09-24T21:56:15.221252] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-24T21:56:15.279687] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:15.279964] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-24T21:56:15.280024] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-24T21:56:15.281723] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-24T21:56:15.281787] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-24T21:56:15.688609] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:16.016051] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-24T21:56:16.512442] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-24T21:56:16.816087] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-24T21:56:16.911419] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T21:56:17.508707] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-24T21:56:17.616115] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-24T21:56:18.416142] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-24T21:56:19.031603] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-24T21:56:19.216110] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-24T21:56:19.904459] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-24T21:56:20.016088] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-24T21:56:20.816118] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-24T21:56:21.371499] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (2.96 seconds). [2025-09-24T21:56:21.470056] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-24T21:56:21.616120] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-24T21:56:21.835502] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T21:56:22.416119] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-24T21:56:22.579041] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-24T21:56:23.221245] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-24T21:56:23.237952] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-24T21:56:24.016112] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-24T21:56:24.245701] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-24T21:56:24.816090] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-24T21:56:25.127057] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T21:56:25.616131] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-24T21:56:25.731609] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T21:56:26.308144] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-24T21:56:26.416104] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-24T21:56:27.216155] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-24T21:56:27.579202] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-24T21:56:28.016066] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-24T21:56:28.190868] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-24T21:56:28.783403] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T21:56:28.816041] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-24T21:56:29.315180] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-24T21:56:29.616088] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-24T21:56:30.416115] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-24T21:56:30.473702] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T21:56:31.006394] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-24T21:56:31.216097] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-24T21:56:32.016111] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-24T21:56:32.364663] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-24T21:56:32.816203] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-24T21:56:33.616063] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-24T21:56:33.782678] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-24T21:56:34.379371] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-24T21:56:34.416111] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-24T21:56:34.915846] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-24T21:56:35.216183] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-24T21:56:35.852232] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-24T21:56:36.000105] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T21:56:36.016058] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-24T21:56:36.665986] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-24T21:56:36.816096] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-24T21:56:37.616100] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-24T21:56:37.744869] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T21:56:38.416095] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-24T21:56:38.507382] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-24T21:56:38.516680] [INFO ] [REMOTE ] VIK: Full fetch complete (75860 records). [2025-09-24T21:56:38.516872] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-24T21:56:38.946308] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-24T21:56:38.946537] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-24T21:56:38.948056] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-24T21:56:38.948168] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-24T21:56:38.949862] [DEBUG] [LOCAL ] VIK: Trimmed 75860 records to 52500 (keeping 200 days of data) [2025-09-24T21:56:39.216492] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-24T21:56:39.230819] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T21:56:39.247341] [INFO ] [REMOTE ] VICI: Full fetch complete (77655 records). [2025-09-24T21:56:39.248485] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-24T21:56:39.404101] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-24T21:56:39.738078] [DEBUG] [LOCAL ] VIK: Primary data saved (52500 records). [2025-09-24T21:56:39.760091] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-24T21:56:39.765375] [INFO ] [MAIN ] Update Progress: 2229/2373 symbols completed. VIK took 34.9s. Estimated remaining: 19m 10s. Rate: 7.5 symbols/min [2025-09-24T21:56:39.784664] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-24T21:56:39.784846] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-24T21:56:39.786280] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-24T21:56:39.819227] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-24T21:56:39.890804] [DEBUG] [LOCAL ] VICI: Trimmed 77655 records to 53649 (keeping 200 days of data) [2025-09-24T21:56:39.966407] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:40.018791] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-24T21:56:40.219203] [DEBUG] [LOCAL ] VIST: Loaded 46006 existing records from primary storage. [2025-09-24T21:56:40.222685] [INFO ] [MAIN ] VIST: Loaded 46006 existing records. [2025-09-24T21:56:40.498365] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:40.517132] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-24T21:56:40.517526] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-24T21:56:40.519113] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-24T21:56:40.519970] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-24T21:56:40.916407] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:40.916555] [DEBUG] [LOCAL ] VICI: Primary data saved (53649 records). [2025-09-24T21:56:40.917203] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-24T21:56:40.917414] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-24T21:56:40.918584] [INFO ] [MAIN ] Update Progress: 2230/2373 symbols completed. VICI took 46.2s. Estimated remaining: 19m 1s. Rate: 7.5 symbols/min [2025-09-24T21:56:41.179675] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:41.183581] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-24T21:56:41.246637] [DEBUG] [LOCAL ] VIV: Loaded 45188 existing records from primary storage. [2025-09-24T21:56:41.246834] [INFO ] [MAIN ] VIV: Loaded 45188 existing records. [2025-09-24T21:56:41.511239] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:41.512344] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-24T21:56:41.512530] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-24T21:56:41.528441] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-24T21:56:41.550743] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-24T21:56:41.620241] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T21:56:41.631790] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-24T21:56:41.687744] [INFO ] [REMOTE ] VIPS: Full fetch complete (74611 records). [2025-09-24T21:56:41.688056] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-24T21:56:42.568885] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:42.569357] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-24T21:56:42.673724] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-24T21:56:42.673926] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-24T21:56:42.675475] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-24T21:56:42.675600] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-24T21:56:42.687405] [DEBUG] [LOCAL ] VIPS: Trimmed 74611 records to 51364 (keeping 200 days of data) [2025-09-24T21:56:42.709953] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T21:56:43.034882] [DEBUG] [LOCAL ] VIPS: Primary data saved (51364 records). [2025-09-24T21:56:43.035026] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-24T21:56:43.035116] [INFO ] [MAIN ] Update Progress: 2231/2373 symbols completed. VIPS took 34.9s. Estimated remaining: 18m 53s. Rate: 7.5 symbols/min [2025-09-24T21:56:43.217090] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:43.217307] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-24T21:56:43.250494] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T21:56:43.274935] [DEBUG] [LOCAL ] VKQ: Loaded 17404 existing records from primary storage. [2025-09-24T21:56:43.275057] [INFO ] [MAIN ] VKQ: Loaded 17404 existing records. [2025-09-24T21:56:43.456250] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:43.456477] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-24T21:56:43.456525] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-24T21:56:43.457069] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-24T21:56:43.457165] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-24T21:56:43.865503] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:44.016109] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-24T21:56:44.176911] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T21:56:44.816068] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-24T21:56:45.064547] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-24T21:56:45.616058] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-24T21:56:45.689288] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T21:56:45.700876] [INFO ] [REMOTE ] VIRT: Full fetch complete (66935 records). [2025-09-24T21:56:45.701065] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-24T21:56:46.129485] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-24T21:56:46.129821] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-24T21:56:46.131208] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-24T21:56:46.131353] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-24T21:56:46.157228] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T21:56:46.160872] [DEBUG] [LOCAL ] VIRT: Trimmed 66935 records to 46870 (keeping 200 days of data) [2025-09-24T21:56:46.419320] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-24T21:56:46.471364] [DEBUG] [LOCAL ] VIRT: Primary data saved (46870 records). [2025-09-24T21:56:46.471515] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-24T21:56:46.471603] [INFO ] [MAIN ] Update Progress: 2232/2373 symbols completed. VIRT took 31.6s. Estimated remaining: 18m 45s. Rate: 7.5 symbols/min [2025-09-24T21:56:46.641834] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:56:46.669893] [DEBUG] [LOCAL ] VLN: Loaded 28471 existing records from primary storage. [2025-09-24T21:56:46.670071] [INFO ] [MAIN ] VLN: Loaded 28471 existing records. [2025-09-24T21:56:46.889926] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:56:46.890475] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-24T21:56:46.890754] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-24T21:56:46.891397] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-24T21:56:46.891459] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-24T21:56:47.218770] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-24T21:56:47.276788] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:56:47.303229] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T21:56:47.337991] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-24T21:56:48.016080] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-24T21:56:48.564988] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-24T21:56:48.582099] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-24T21:56:48.816119] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-24T21:56:49.616057] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-24T21:56:49.765624] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T21:56:50.416068] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-24T21:56:51.216055] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-24T21:56:51.466323] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T21:56:51.925454] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T21:56:52.016088] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-24T21:56:52.818684] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-24T21:56:52.823994] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T21:56:53.438080] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-24T21:56:53.616088] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-24T21:56:54.406460] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T21:56:54.416469] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-24T21:56:54.810007] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T21:56:55.025030] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-24T21:56:55.216083] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-24T21:56:56.016110] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-24T21:56:56.816065] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-24T21:56:57.035562] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T21:56:57.047812] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T21:56:57.616087] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-24T21:56:58.284176] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T21:56:58.303013] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-24T21:56:58.416034] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-24T21:56:59.216051] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-24T21:56:59.550681] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T21:57:00.016144] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-24T21:57:00.816096] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-24T21:57:01.036181] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-24T21:57:01.214731] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-24T21:57:01.616058] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-24T21:57:01.809760] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T21:57:02.416130] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-24T21:57:02.640051] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T21:57:03.216090] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-24T21:57:04.016098] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-24T21:57:04.088592] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T21:57:04.304553] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-24T21:57:04.816080] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-24T21:57:05.616104] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-24T21:57:05.782835] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T21:57:05.974598] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-24T21:57:06.416078] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-24T21:57:06.699761] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T21:57:07.216127] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-24T21:57:07.846634] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T21:57:08.016074] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-24T21:57:08.049256] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-24T21:57:08.053451] [INFO ] [REMOTE ] VKQ: Full fetch complete (24575 records). [2025-09-24T21:57:08.053541] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-24T21:57:08.440800] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-24T21:57:08.440885] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-24T21:57:08.441414] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-24T21:57:08.441454] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-24T21:57:08.442146] [DEBUG] [LOCAL ] VKQ: Trimmed 24575 records to 17393 (keeping 200 days of data) [2025-09-24T21:57:08.547919] [DEBUG] [LOCAL ] VKQ: Primary data saved (17393 records). [2025-09-24T21:57:08.548074] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-24T21:57:08.548163] [INFO ] [MAIN ] Update Progress: 2233/2373 symbols completed. VKQ took 25.5s. Estimated remaining: 18m 38s. Rate: 7.5 symbols/min [2025-09-24T21:57:08.718322] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:08.774861] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-24T21:57:08.775010] [INFO ] [MAIN ] VLO: Loaded 53088 existing records. [2025-09-24T21:57:08.821414] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-24T21:57:08.969394] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:08.969683] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-24T21:57:08.969742] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-24T21:57:08.971123] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-24T21:57:08.971186] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-24T21:57:09.350821] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:09.492701] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:57:09.616129] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-24T21:57:10.416100] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-24T21:57:10.674944] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-24T21:57:11.078920] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-24T21:57:11.086451] [INFO ] [REMOTE ] VIV: Full fetch complete (64742 records). [2025-09-24T21:57:11.086624] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-24T21:57:11.227427] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-24T21:57:11.484977] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-24T21:57:11.485079] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-24T21:57:11.486365] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-24T21:57:11.486441] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-24T21:57:11.487928] [DEBUG] [LOCAL ] VIV: Trimmed 64742 records to 45175 (keeping 200 days of data) [2025-09-24T21:57:11.764860] [DEBUG] [LOCAL ] VIV: Primary data saved (45175 records). [2025-09-24T21:57:11.765063] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-24T21:57:11.765192] [INFO ] [MAIN ] Update Progress: 2234/2373 symbols completed. VIV took 30.8s. Estimated remaining: 18m 29s. Rate: 7.5 symbols/min [2025-09-24T21:57:11.939558] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:11.960027] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T21:57:12.001327] [DEBUG] [LOCAL ] VLRS: Loaded 40846 existing records from primary storage. [2025-09-24T21:57:12.001479] [INFO ] [MAIN ] VLRS: Loaded 40846 existing records. [2025-09-24T21:57:12.021918] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-24T21:57:12.194762] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:12.195048] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-24T21:57:12.195103] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-24T21:57:12.195923] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-24T21:57:12.195984] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-24T21:57:12.554864] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:12.816054] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-24T21:57:13.066533] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-24T21:57:13.230565] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T21:57:13.616083] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-24T21:57:13.914383] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-24T21:57:14.416142] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-24T21:57:14.931886] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T21:57:14.938048] [INFO ] [REMOTE ] VLN: Full fetch complete (43265 records). [2025-09-24T21:57:14.938144] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-24T21:57:15.221358] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-24T21:57:15.343418] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-24T21:57:15.343511] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-24T21:57:15.344506] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-24T21:57:15.344571] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-24T21:57:15.345663] [DEBUG] [LOCAL ] VLN: Trimmed 43265 records to 28530 (keeping 200 days of data) [2025-09-24T21:57:15.508561] [DEBUG] [LOCAL ] VLN: Primary data saved (28530 records). [2025-09-24T21:57:15.508745] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-24T21:57:15.508854] [INFO ] [MAIN ] Update Progress: 2235/2373 symbols completed. VLN took 29.0s. Estimated remaining: 18m 21s. Rate: 7.5 symbols/min [2025-09-24T21:57:15.681797] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:15.688870] [DEBUG] [LOCAL ] VLT: Loaded 4588 existing records from primary storage. [2025-09-24T21:57:15.688974] [INFO ] [MAIN ] VLT: Loaded 4588 existing records. [2025-09-24T21:57:15.904300] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:15.905104] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-24T21:57:15.905353] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-24T21:57:15.906024] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-24T21:57:15.906235] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-24T21:57:16.020284] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-24T21:57:16.253205] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T21:57:16.324802] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:16.566355] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-24T21:57:16.576088] [INFO ] [REMOTE ] VIST: Full fetch complete (66846 records). [2025-09-24T21:57:16.576265] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-24T21:57:16.821418] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-24T21:57:17.000803] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-24T21:57:17.000946] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-24T21:57:17.002463] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-24T21:57:17.002585] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-24T21:57:17.004753] [DEBUG] [LOCAL ] VIST: Trimmed 66846 records to 46010 (keeping 200 days of data) [2025-09-24T21:57:17.285876] [DEBUG] [LOCAL ] VIST: Primary data saved (46010 records). [2025-09-24T21:57:17.286027] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-24T21:57:17.286117] [INFO ] [MAIN ] Update Progress: 2236/2373 symbols completed. VIST took 37.5s. Estimated remaining: 18m 13s. Rate: 7.5 symbols/min [2025-09-24T21:57:17.474960] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:17.477237] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-24T21:57:17.510558] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-24T21:57:17.556875] [DEBUG] [LOCAL ] VLTO: Loaded 45994 existing records from primary storage. [2025-09-24T21:57:17.557031] [INFO ] [MAIN ] VLTO: Loaded 45994 existing records. [2025-09-24T21:57:17.621329] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-24T21:57:17.742194] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:17.742446] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-24T21:57:17.742496] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-24T21:57:17.743575] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-24T21:57:17.743636] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-24T21:57:18.112618] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:18.299796] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-24T21:57:18.416067] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-24T21:57:19.216138] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-24T21:57:20.016095] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-24T21:57:20.352876] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-24T21:57:20.633534] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-24T21:57:20.697869] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-24T21:57:20.816071] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-24T21:57:21.616077] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-24T21:57:22.317870] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T21:57:22.416942] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-24T21:57:22.422830] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T21:57:23.216130] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-24T21:57:23.933268] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-24T21:57:24.016037] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-24T21:57:24.255376] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T21:57:24.579232] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T21:57:24.816089] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-24T21:57:25.300940] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-24T21:57:25.616077] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-24T21:57:26.416073] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-24T21:57:27.216112] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-24T21:57:27.530558] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-24T21:57:27.568281] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-24T21:57:27.773120] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-24T21:57:28.016099] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-24T21:57:28.816110] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-24T21:57:29.616055] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-24T21:57:29.937340] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-24T21:57:30.187163] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T21:57:30.416142] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-24T21:57:30.872497] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-24T21:57:31.216069] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-24T21:57:31.647071] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-24T21:57:32.017046] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-24T21:57:32.019766] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T21:57:32.640766] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-24T21:57:32.642252] [INFO ] [REMOTE ] VLT: Full fetch complete (7520 records). [2025-09-24T21:57:32.642329] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-24T21:57:32.822030] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-24T21:57:33.005036] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-24T21:57:33.005144] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-24T21:57:33.005390] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-24T21:57:33.005435] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-24T21:57:33.005989] [DEBUG] [LOCAL ] VLT: Trimmed 7520 records to 4578 (keeping 200 days of data) [2025-09-24T21:57:33.034681] [DEBUG] [LOCAL ] VLT: Primary data saved (4578 records). [2025-09-24T21:57:33.034767] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-24T21:57:33.034846] [INFO ] [MAIN ] Update Progress: 2237/2373 symbols completed. VLT took 17.5s. Estimated remaining: 18m 5s. Rate: 7.5 symbols/min [2025-09-24T21:57:33.616191] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-24T21:57:34.416150] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-24T21:57:34.813241] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T21:57:35.177901] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T21:57:35.216045] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-24T21:57:35.799466] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-24T21:57:36.016067] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-24T21:57:36.816061] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-24T21:57:36.896438] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T21:57:37.476007] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T21:57:37.616094] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-24T21:57:38.416143] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-24T21:57:38.880135] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-24T21:57:38.958396] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:57:39.216117] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-24T21:57:39.949791] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T21:57:40.016105] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-24T21:57:40.816133] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-24T21:57:40.978031] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T21:57:41.173133] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T21:57:41.616095] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-24T21:57:42.416069] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-24T21:57:42.565885] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T21:57:43.128418] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-24T21:57:43.216045] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-24T21:57:43.576979] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-24T21:57:43.583681] [INFO ] [REMOTE ] VLRS: Full fetch complete (58763 records). [2025-09-24T21:57:43.583885] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-24T21:57:44.032518] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-24T21:57:44.032749] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-24T21:57:44.032218] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T21:57:44.042811] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-24T21:57:44.026812] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-24T21:57:44.044673] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-24T21:57:44.046937] [DEBUG] [LOCAL ] VLRS: Trimmed 58763 records to 40700 (keeping 200 days of data) [2025-09-24T21:57:44.048498] [INFO ] [REMOTE ] VLO: Full fetch complete (76930 records). [2025-09-24T21:57:44.048801] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-24T21:57:44.696999] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-24T21:57:44.697464] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-24T21:57:44.699322] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-24T21:57:44.699413] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-24T21:57:44.703543] [DEBUG] [LOCAL ] VLO: Trimmed 76930 records to 53088 (keeping 200 days of data) [2025-09-24T21:57:44.852289] [DEBUG] [LOCAL ] VLRS: Primary data saved (40700 records). [2025-09-24T21:57:44.852895] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-24T21:57:44.853360] [INFO ] [MAIN ] Update Progress: 2238/2373 symbols completed. VLRS took 33.1s. Estimated remaining: 17m 57s. Rate: 7.5 symbols/min [2025-09-24T21:57:45.078431] [DEBUG] [LOCAL ] VLO: Primary data saved (53088 records). [2025-09-24T21:57:45.078578] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-24T21:57:45.078697] [INFO ] [MAIN ] Update Progress: 2239/2373 symbols completed. VLO took 36.5s. Estimated remaining: 17m 49s. Rate: 7.5 symbols/min [2025-09-24T21:57:45.649210] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-24T21:57:45.659726] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-24T21:57:46.975560] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-24T21:57:46.985735] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-24T21:57:47.675112] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T21:57:47.683285] [INFO ] [REMOTE ] VLTO: Full fetch complete (66762 records). [2025-09-24T21:57:47.683423] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-24T21:57:48.093060] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-24T21:57:48.093146] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-24T21:57:48.094284] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-24T21:57:48.094348] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-24T21:57:48.095631] [DEBUG] [LOCAL ] VLTO: Trimmed 66762 records to 46007 (keeping 200 days of data) [2025-09-24T21:57:48.390336] [DEBUG] [LOCAL ] VLTO: Primary data saved (46007 records). [2025-09-24T21:57:48.390486] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-24T21:57:48.390576] [INFO ] [MAIN ] Update Progress: 2240/2373 symbols completed. VLTO took 31.1s. Estimated remaining: 17m 41s. Rate: 7.5 symbols/min [2025-09-24T21:57:49.011792] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:48.973302] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:49.122806] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:49.155886] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:57:49.163732] [DEBUG] [LOCAL ] VMI: Loaded 15478 existing records from primary storage. [2025-09-24T21:57:49.170343] [INFO ] [MAIN ] VMI: Loaded 15478 existing records. [2025-09-24T21:57:49.219718] [DEBUG] [LOCAL ] VMO: Loaded 21025 existing records from primary storage. [2025-09-24T21:57:49.219909] [INFO ] [MAIN ] VMO: Loaded 21025 existing records. [2025-09-24T21:57:49.286492] [DEBUG] [LOCAL ] VNCE: Loaded 7130 existing records from primary storage. [2025-09-24T21:57:49.309516] [INFO ] [MAIN ] VNCE: Loaded 7130 existing records. [2025-09-24T21:57:49.720579] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:49.744405] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:49.745693] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-24T21:57:49.747167] [DEBUG] [LOCAL ] VMC: Loaded 43793 existing records from primary storage. [2025-09-24T21:57:49.747249] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-24T21:57:49.752819] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-24T21:57:49.753003] [INFO ] [MAIN ] VMC: Loaded 43793 existing records. [2025-09-24T21:57:49.758326] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-24T21:57:49.753110] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-24T21:57:49.758495] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-24T21:57:49.831956] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-24T21:57:49.842372] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:49.952921] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-24T21:57:49.878537] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-24T21:57:49.958292] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-24T21:57:50.031936] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-24T21:57:50.082360] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-24T21:57:50.395182] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:57:50.554866] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-24T21:57:50.561892] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-24T21:57:50.589627] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-24T21:57:50.628039] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-24T21:57:51.040404] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:51.072193] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-24T21:57:51.231524] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:51.242194] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-24T21:57:51.493854] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:51.522016] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-24T21:57:51.604686] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:57:51.605012] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-24T21:57:52.127706] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-24T21:57:52.130930] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-24T21:57:52.385994] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-24T21:57:52.391400] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-24T21:57:52.467913] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T21:57:52.472516] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-24T21:57:52.989772] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T21:57:52.998705] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-24T21:57:53.093877] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-24T21:57:53.097238] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-24T21:57:53.163069] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-24T21:57:53.616052] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-24T21:57:53.782893] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-24T21:57:54.046698] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-24T21:57:54.422794] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-24T21:57:54.444256] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T21:57:54.667704] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T21:57:54.951153] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-24T21:57:55.216183] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-24T21:57:56.016124] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-24T21:57:56.816089] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-24T21:57:56.843304] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-24T21:57:56.930142] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-24T21:57:57.616122] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-24T21:57:57.799941] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-24T21:57:58.416056] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-24T21:57:58.654748] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T21:57:59.216132] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-24T21:57:59.718128] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-24T21:58:00.016078] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-24T21:58:00.458276] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-24T21:58:00.816070] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-24T21:58:01.023115] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-24T21:58:01.616056] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-24T21:58:02.019248] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-24T21:58:02.264094] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T21:58:02.416062] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-24T21:58:03.128233] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-24T21:58:03.216093] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-24T21:58:04.016208] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-24T21:58:04.816065] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-24T21:58:05.017379] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T21:58:05.049616] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-24T21:58:05.466404] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-24T21:58:05.616067] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-24T21:58:06.416112] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-24T21:58:07.023554] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-24T21:58:07.214381] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T21:58:07.223481] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-24T21:58:08.016111] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-24T21:58:08.216764] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-24T21:58:08.816133] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-24T21:58:09.534334] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T21:58:09.616142] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-24T21:58:09.696946] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T21:58:10.362809] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T21:58:10.366036] [INFO ] [REMOTE ] VMI: Full fetch complete (21142 records). [2025-09-24T21:58:10.366208] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-24T21:58:10.423772] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-24T21:58:10.765890] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-24T21:58:10.766004] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-24T21:58:10.766633] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-24T21:58:10.766763] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-24T21:58:10.767499] [DEBUG] [LOCAL ] VMI: Trimmed 21142 records to 15472 (keeping 200 days of data) [2025-09-24T21:58:10.871817] [DEBUG] [LOCAL ] VMI: Primary data saved (15472 records). [2025-09-24T21:58:10.871988] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-24T21:58:10.872195] [INFO ] [MAIN ] Update Progress: 2241/2373 symbols completed. VMI took 22.5s. Estimated remaining: 17m 34s. Rate: 7.5 symbols/min [2025-09-24T21:58:11.048189] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:11.102951] [DEBUG] [LOCAL ] VNO: Loaded 48999 existing records from primary storage. [2025-09-24T21:58:11.103102] [INFO ] [MAIN ] VNO: Loaded 48999 existing records. [2025-09-24T21:58:11.221278] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-24T21:58:11.287301] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:11.287566] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-24T21:58:11.287636] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-24T21:58:11.288895] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-24T21:58:11.288969] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-24T21:58:11.668296] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:11.694879] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-24T21:58:12.016150] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-24T21:58:12.183722] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T21:58:12.816122] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-24T21:58:13.441103] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T21:58:13.616115] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-24T21:58:14.416042] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-24T21:58:14.442937] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T21:58:14.643841] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T21:58:14.648151] [INFO ] [REMOTE ] VNCE: Full fetch complete (15233 records). [2025-09-24T21:58:14.648257] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-24T21:58:15.039792] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-24T21:58:15.039892] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-24T21:58:15.040725] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-24T21:58:15.040790] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-24T21:58:15.041929] [DEBUG] [LOCAL ] VNCE: Trimmed 15233 records to 7242 (keeping 200 days of data) [2025-09-24T21:58:15.093170] [DEBUG] [LOCAL ] VNCE: Primary data saved (7242 records). [2025-09-24T21:58:15.093327] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-24T21:58:15.093499] [INFO ] [MAIN ] Update Progress: 2242/2373 symbols completed. VNCE took 26.7s. Estimated remaining: 17m 25s. Rate: 7.5 symbols/min [2025-09-24T21:58:15.221176] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-24T21:58:15.288477] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:15.347445] [DEBUG] [LOCAL ] VNT: Loaded 43968 existing records from primary storage. [2025-09-24T21:58:15.347596] [INFO ] [MAIN ] VNT: Loaded 43968 existing records. [2025-09-24T21:58:15.529897] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:15.530141] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-24T21:58:15.530202] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-24T21:58:15.531348] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-24T21:58:15.531455] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-24T21:58:15.907279] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:15.982169] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-24T21:58:15.990506] [INFO ] [REMOTE ] VMC: Full fetch complete (62659 records). [2025-09-24T21:58:15.990624] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-24T21:58:16.022340] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-24T21:58:16.279159] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T21:58:16.444536] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-24T21:58:16.444623] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-24T21:58:16.445864] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-24T21:58:16.445930] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-24T21:58:16.447240] [DEBUG] [LOCAL ] VMC: Trimmed 62659 records to 43704 (keeping 200 days of data) [2025-09-24T21:58:16.741929] [DEBUG] [LOCAL ] VMC: Primary data saved (43704 records). [2025-09-24T21:58:16.742075] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-24T21:58:16.742224] [INFO ] [MAIN ] Update Progress: 2243/2373 symbols completed. VMC took 28.4s. Estimated remaining: 17m 17s. Rate: 7.5 symbols/min [2025-09-24T21:58:16.821343] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-24T21:58:16.920261] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:16.931505] [DEBUG] [LOCAL ] VOC: Loaded 8936 existing records from primary storage. [2025-09-24T21:58:16.931612] [INFO ] [MAIN ] VOC: Loaded 8936 existing records. [2025-09-24T21:58:17.121466] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:17.122390] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-24T21:58:17.122463] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-24T21:58:17.122953] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-24T21:58:17.123016] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-24T21:58:17.498807] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:17.568434] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T21:58:17.616114] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-24T21:58:17.926372] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-24T21:58:18.249042] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-24T21:58:18.416137] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-24T21:58:19.216149] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-24T21:58:19.486859] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-24T21:58:20.016139] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-24T21:58:20.798166] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T21:58:20.816018] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-24T21:58:20.823881] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T21:58:21.616160] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-24T21:58:22.408747] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T21:58:22.418389] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-24T21:58:23.206342] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-24T21:58:23.216031] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-24T21:58:23.318758] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T21:58:23.977436] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T21:58:24.016142] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-24T21:58:24.816172] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-24T21:58:24.873561] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-24T21:58:25.616147] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-24T21:58:26.421305] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-24T21:58:26.460460] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:58:26.739569] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-24T21:58:27.216085] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-24T21:58:28.016663] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-24T21:58:28.023434] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T21:58:28.651556] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-24T21:58:28.816058] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-24T21:58:28.986694] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-24T21:58:29.616051] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-24T21:58:29.815935] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-24T21:58:30.416074] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-24T21:58:30.686363] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-24T21:58:30.691402] [INFO ] [REMOTE ] VMO: Full fetch complete (31481 records). [2025-09-24T21:58:30.691522] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-24T21:58:31.064574] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-24T21:58:31.064694] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-24T21:58:31.065494] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-24T21:58:31.065557] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-24T21:58:31.066375] [DEBUG] [LOCAL ] VMO: Trimmed 31481 records to 21024 (keeping 200 days of data) [2025-09-24T21:58:31.204938] [DEBUG] [LOCAL ] VMO: Primary data saved (21024 records). [2025-09-24T21:58:31.205076] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-24T21:58:31.205236] [INFO ] [MAIN ] Update Progress: 2244/2373 symbols completed. VMO took 42.8s. Estimated remaining: 17m 9s. Rate: 7.5 symbols/min [2025-09-24T21:58:31.226465] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-24T21:58:31.380392] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:31.437483] [DEBUG] [LOCAL ] VOYA: Loaded 42835 existing records from primary storage. [2025-09-24T21:58:31.437686] [INFO ] [MAIN ] VOYA: Loaded 42835 existing records. [2025-09-24T21:58:31.622306] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:31.622639] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-24T21:58:31.622743] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-24T21:58:31.624448] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-24T21:58:31.624517] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-24T21:58:31.991245] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:32.018056] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-24T21:58:32.020969] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T21:58:32.082694] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-24T21:58:32.816125] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-24T21:58:33.320317] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T21:58:33.616082] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-24T21:58:34.397481] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T21:58:34.416051] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-24T21:58:35.216096] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-24T21:58:35.296368] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-24T21:58:35.604924] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T21:58:36.016091] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-24T21:58:36.816075] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-24T21:58:36.853863] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T21:58:37.083217] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T21:58:37.616099] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-24T21:58:38.187864] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T21:58:38.416104] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-24T21:58:38.975567] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-24T21:58:39.216107] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-24T21:58:39.984009] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-24T21:58:40.016050] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-24T21:58:40.756109] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:58:40.765355] [INFO ] [REMOTE ] VNO: Full fetch complete (70479 records). [2025-09-24T21:58:40.765507] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-24T21:58:40.822943] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-24T21:58:41.205683] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-24T21:58:41.205976] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-24T21:58:41.208232] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-24T21:58:41.208323] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-24T21:58:41.234312] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T21:58:41.242995] [DEBUG] [LOCAL ] VNO: Trimmed 70479 records to 48973 (keeping 200 days of data) [2025-09-24T21:58:41.551061] [DEBUG] [LOCAL ] VNO: Primary data saved (48973 records). [2025-09-24T21:58:41.551214] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-24T21:58:41.551323] [INFO ] [MAIN ] Update Progress: 2245/2373 symbols completed. VNO took 30.7s. Estimated remaining: 17m 2s. Rate: 7.5 symbols/min [2025-09-24T21:58:41.626363] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-24T21:58:41.736390] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:41.736576] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-24T21:58:41.736613] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-24T21:58:41.736930] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-24T21:58:41.736973] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-24T21:58:41.737066] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-24T21:58:41.737116] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-24T21:58:42.086007] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:42.348157] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-24T21:58:42.416055] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-24T21:58:42.511834] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T21:58:42.939587] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-24T21:58:43.216116] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-24T21:58:44.016096] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-24T21:58:44.704327] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T21:58:44.816033] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-24T21:58:45.527697] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-24T21:58:45.616028] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-24T21:58:46.416115] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-24T21:58:46.478748] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-24T21:58:46.622894] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:46.623359] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-24T21:58:47.046739] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-24T21:58:47.216102] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-24T21:58:47.436393] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:47.436760] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-24T21:58:48.016086] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-24T21:58:48.814758] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T21:58:48.817031] [INFO ] [REMOTE ] VOC: Full fetch complete (13189 records). [2025-09-24T21:58:48.817171] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-24T21:58:48.816443] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-24T21:58:49.120898] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:49.136621] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-24T21:58:49.193712] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-24T21:58:49.193803] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-24T21:58:49.194146] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-24T21:58:49.194189] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-24T21:58:49.194748] [DEBUG] [LOCAL ] VOC: Trimmed 13189 records to 8934 (keeping 200 days of data) [2025-09-24T21:58:49.246331] [DEBUG] [LOCAL ] VOC: Primary data saved (8934 records). [2025-09-24T21:58:49.246475] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-24T21:58:49.246565] [INFO ] [MAIN ] Update Progress: 2246/2373 symbols completed. VOC took 32.5s. Estimated remaining: 16m 54s. Rate: 7.5 symbols/min [2025-09-24T21:58:49.423426] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:49.441892] [DEBUG] [LOCAL ] VPG: Loaded 17231 existing records from primary storage. [2025-09-24T21:58:49.442034] [INFO ] [MAIN ] VPG: Loaded 17231 existing records. [2025-09-24T21:58:49.619840] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-24T21:58:49.623804] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:49.625002] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-24T21:58:49.625061] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-24T21:58:49.625609] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-24T21:58:49.625728] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-24T21:58:49.887422] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:49.920136] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-24T21:58:50.015245] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:50.416136] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-24T21:58:51.216100] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-24T21:58:51.312947] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-24T21:58:52.016158] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-24T21:58:52.222828] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:52.223197] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-24T21:58:52.816059] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-24T21:58:52.837472] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-24T21:58:52.845062] [INFO ] [REMOTE ] VNT: Full fetch complete (63510 records). [2025-09-24T21:58:52.845184] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-24T21:58:53.084801] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T21:58:53.117780] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-24T21:58:53.241047] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-24T21:58:53.241190] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-24T21:58:53.242386] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-24T21:58:53.242456] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-24T21:58:53.243778] [DEBUG] [LOCAL ] VNT: Trimmed 63510 records to 43902 (keeping 200 days of data) [2025-09-24T21:58:53.526582] [DEBUG] [LOCAL ] VNT: Primary data saved (43902 records). [2025-09-24T21:58:53.526745] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-24T21:58:53.526835] [INFO ] [MAIN ] Update Progress: 2247/2373 symbols completed. VNT took 38.4s. Estimated remaining: 16m 45s. Rate: 7.5 symbols/min [2025-09-24T21:58:53.625101] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-24T21:58:53.703110] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:58:53.710990] [DEBUG] [LOCAL ] VPV: Loaded 5371 existing records from primary storage. [2025-09-24T21:58:53.711150] [INFO ] [MAIN ] VPV: Loaded 5371 existing records. [2025-09-24T21:58:53.890800] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:58:53.891149] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-24T21:58:53.891207] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-24T21:58:53.891591] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-24T21:58:53.891693] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-24T21:58:54.271334] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:58:54.416079] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-24T21:58:55.216057] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-24T21:58:55.283079] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T21:58:56.014879] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T21:58:56.023327] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-24T21:58:56.032178] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-24T21:58:56.816079] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-24T21:58:57.616064] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-24T21:58:57.655160] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T21:58:57.850565] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-24T21:58:58.179250] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-24T21:58:58.416094] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-24T21:58:59.216126] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-24T21:58:59.894993] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-24T21:58:59.969526] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T21:59:00.016127] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-24T21:59:00.816122] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-24T21:59:00.840890] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-24T21:59:01.616114] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-24T21:59:02.360993] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-24T21:59:02.368706] [INFO ] [REMOTE ] VOYA: Full fetch complete (62078 records). [2025-09-24T21:59:02.368836] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-24T21:59:02.418679] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-24T21:59:02.483806] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T21:59:02.861219] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-24T21:59:02.861311] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-24T21:59:02.862402] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-24T21:59:02.862469] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-24T21:59:02.865623] [DEBUG] [LOCAL ] VOYA: Trimmed 62078 records to 42801 (keeping 200 days of data) [2025-09-24T21:59:03.133793] [DEBUG] [LOCAL ] VOYA: Primary data saved (42801 records). [2025-09-24T21:59:03.133940] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-24T21:59:03.134028] [INFO ] [MAIN ] Update Progress: 2248/2373 symbols completed. VOYA took 31.9s. Estimated remaining: 16m 38s. Rate: 7.5 symbols/min [2025-09-24T21:59:03.221318] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-24T21:59:03.318138] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:03.353976] [DEBUG] [LOCAL ] VRE: Loaded 34915 existing records from primary storage. [2025-09-24T21:59:03.354119] [INFO ] [MAIN ] VRE: Loaded 34915 existing records. [2025-09-24T21:59:03.546115] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:03.546621] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-24T21:59:03.546739] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-24T21:59:03.547959] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-24T21:59:03.548027] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-24T21:59:03.761618] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T21:59:03.954356] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:03.959369] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-24T21:59:04.016069] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-24T21:59:04.727075] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-24T21:59:04.816087] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-24T21:59:05.384596] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-24T21:59:05.616103] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-24T21:59:06.416051] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-24T21:59:06.700719] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-24T21:59:07.216096] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-24T21:59:07.802493] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-24T21:59:07.948333] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-24T21:59:08.016062] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-24T21:59:08.816125] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-24T21:59:09.333790] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T21:59:09.616090] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-24T21:59:09.789384] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T21:59:10.416059] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-24T21:59:10.956249] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T21:59:11.216093] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-24T21:59:12.016117] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-24T21:59:12.070247] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T21:59:12.078163] [INFO ] [REMOTE ] VOYG: Full fetch complete (24022 records). [2025-09-24T21:59:12.078296] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-24T21:59:12.284220] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-24T21:59:12.295956] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-24T21:59:12.300111] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T21:59:12.300561] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T21:59:12.301012] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-24T21:59:12.301085] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-24T21:59:12.301122] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-24T21:59:12.301178] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-24T21:59:12.301277] [INFO ] [MAIN ] Update Progress: 2249/2373 symbols completed. VOYG took 30.7s. Estimated remaining: 16m 30s. Rate: 7.5 symbols/min [2025-09-24T21:59:12.489445] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:12.550409] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-24T21:59:12.550560] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-24T21:59:12.743018] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:12.743265] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-24T21:59:12.743316] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-24T21:59:12.744916] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-24T21:59:12.744981] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-24T21:59:12.819700] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-24T21:59:13.123415] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:13.209624] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T21:59:13.616099] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-24T21:59:13.894328] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T21:59:14.416080] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-24T21:59:14.963398] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T21:59:15.116122] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-24T21:59:15.119274] [INFO ] [REMOTE ] VPG: Full fetch complete (23035 records). [2025-09-24T21:59:15.119359] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-24T21:59:15.221326] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-24T21:59:15.520234] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-24T21:59:15.520345] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-24T21:59:15.521142] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-24T21:59:15.521211] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-24T21:59:15.522202] [DEBUG] [LOCAL ] VPG: Trimmed 23035 records to 17215 (keeping 200 days of data) [2025-09-24T21:59:15.629259] [DEBUG] [LOCAL ] VPG: Primary data saved (17215 records). [2025-09-24T21:59:15.629413] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-24T21:59:15.629503] [INFO ] [MAIN ] Update Progress: 2250/2373 symbols completed. VPG took 26.4s. Estimated remaining: 16m 21s. Rate: 7.5 symbols/min [2025-09-24T21:59:15.805764] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:15.816781] [DEBUG] [LOCAL ] VRTS: Loaded 9107 existing records from primary storage. [2025-09-24T21:59:15.816901] [INFO ] [MAIN ] VRTS: Loaded 9107 existing records. [2025-09-24T21:59:15.923565] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-24T21:59:16.013567] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:16.013930] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-24T21:59:16.013989] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-24T21:59:16.014508] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-24T21:59:16.014571] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-24T21:59:16.025756] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-24T21:59:16.376634] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:16.816086] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-24T21:59:17.513163] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T21:59:17.616059] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-24T21:59:18.422395] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-24T21:59:18.436547] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-24T21:59:19.088406] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T21:59:19.165561] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T21:59:19.216130] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-24T21:59:20.016110] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-24T21:59:20.644240] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-24T21:59:20.646034] [INFO ] [REMOTE ] VPV: Full fetch complete (9374 records). [2025-09-24T21:59:20.646115] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-24T21:59:20.827333] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-24T21:59:21.030718] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-24T21:59:21.030811] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-24T21:59:21.031076] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-24T21:59:21.031126] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-24T21:59:21.031602] [DEBUG] [LOCAL ] VPV: Trimmed 9374 records to 5372 (keeping 200 days of data) [2025-09-24T21:59:21.064457] [DEBUG] [LOCAL ] VPV: Primary data saved (5372 records). [2025-09-24T21:59:21.064583] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-24T21:59:21.064695] [INFO ] [MAIN ] Update Progress: 2251/2373 symbols completed. VPV took 27.5s. Estimated remaining: 16m 13s. Rate: 7.5 symbols/min [2025-09-24T21:59:21.248876] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:21.303799] [DEBUG] [LOCAL ] VSCO: Loaded 52871 existing records from primary storage. [2025-09-24T21:59:21.303953] [INFO ] [MAIN ] VSCO: Loaded 52871 existing records. [2025-09-24T21:59:21.499286] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:21.499766] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-24T21:59:21.499841] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-24T21:59:21.501235] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-24T21:59:21.501326] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-24T21:59:21.617323] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-24T21:59:21.846178] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-24T21:59:21.940606] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:22.124888] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-24T21:59:22.233378] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-24T21:59:22.416103] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-24T21:59:22.988366] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-24T21:59:23.216122] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-24T21:59:24.016104] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-24T21:59:24.816079] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-24T21:59:25.080668] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T21:59:25.573396] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-24T21:59:25.604010] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-24T21:59:25.618164] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-24T21:59:26.416084] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-24T21:59:27.216052] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-24T21:59:27.251660] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-24T21:59:27.870038] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-24T21:59:27.893744] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T21:59:28.016076] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-24T21:59:28.816118] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-24T21:59:29.295210] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-24T21:59:29.616080] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-24T21:59:30.177462] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T21:59:30.416059] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-24T21:59:30.520820] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-24T21:59:31.216127] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-24T21:59:31.885995] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T21:59:31.894186] [INFO ] [REMOTE ] VRE: Full fetch complete (47730 records). [2025-09-24T21:59:31.894366] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-24T21:59:32.021365] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-24T21:59:32.304515] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T21:59:32.325963] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-24T21:59:32.326077] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-24T21:59:32.327635] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-24T21:59:32.327725] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-24T21:59:32.328860] [DEBUG] [LOCAL ] VRE: Trimmed 47730 records to 34858 (keeping 200 days of data) [2025-09-24T21:59:32.541517] [DEBUG] [LOCAL ] VRE: Primary data saved (34858 records). [2025-09-24T21:59:32.541698] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-24T21:59:32.541803] [INFO ] [MAIN ] Update Progress: 2252/2373 symbols completed. VRE took 29.4s. Estimated remaining: 16m 5s. Rate: 7.5 symbols/min [2025-09-24T21:59:32.719988] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:32.770102] [DEBUG] [LOCAL ] VSH: Loaded 48617 existing records from primary storage. [2025-09-24T21:59:32.770283] [INFO ] [MAIN ] VSH: Loaded 48617 existing records. [2025-09-24T21:59:32.826445] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-24T21:59:32.960952] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:32.961235] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-24T21:59:32.961311] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-24T21:59:32.962828] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-24T21:59:32.962893] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-24T21:59:33.332851] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:33.423181] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T21:59:33.616111] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-24T21:59:33.786003] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-24T21:59:34.416114] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-24T21:59:35.216095] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-24T21:59:35.979125] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-24T21:59:36.023517] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-24T21:59:36.029452] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-24T21:59:36.416742] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-24T21:59:36.816093] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-24T21:59:36.825033] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-24T21:59:36.827015] [INFO ] [REMOTE ] VRTS: Full fetch complete (11245 records). [2025-09-24T21:59:36.827088] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-24T21:59:37.247197] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-24T21:59:37.247279] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-24T21:59:37.247571] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-24T21:59:37.247610] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-24T21:59:37.248081] [DEBUG] [LOCAL ] VRTS: Trimmed 11245 records to 9142 (keeping 200 days of data) [2025-09-24T21:59:37.304297] [DEBUG] [LOCAL ] VRTS: Primary data saved (9142 records). [2025-09-24T21:59:37.304418] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-24T21:59:37.304501] [INFO ] [MAIN ] Update Progress: 2253/2373 symbols completed. VRTS took 21.7s. Estimated remaining: 15m 57s. Rate: 7.5 symbols/min [2025-09-24T21:59:37.481722] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:37.539161] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-24T21:59:37.539333] [INFO ] [MAIN ] VST: Loaded 53720 existing records. [2025-09-24T21:59:37.621239] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-24T21:59:37.727261] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:37.727491] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-24T21:59:37.727539] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-24T21:59:37.729066] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-24T21:59:37.729131] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-24T21:59:38.087516] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:38.416108] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-24T21:59:38.883169] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-24T21:59:39.216171] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-24T21:59:40.016085] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-24T21:59:40.096543] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T21:59:40.495428] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T21:59:40.818601] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-24T21:59:40.824581] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-24T21:59:41.541684] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-24T21:59:41.616042] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-24T21:59:42.416057] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-24T21:59:42.519398] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T21:59:43.157149] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T21:59:43.216064] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-24T21:59:44.016094] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-24T21:59:44.816066] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-24T21:59:44.985078] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-24T21:59:45.030327] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T21:59:45.616088] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-24T21:59:46.416138] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-24T21:59:46.471250] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-24T21:59:46.523762] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T21:59:47.216092] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-24T21:59:47.765324] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-24T21:59:48.016124] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-24T21:59:48.364396] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-24T21:59:48.816118] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-24T21:59:49.302794] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-24T21:59:49.616076] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-24T21:59:50.416160] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-24T21:59:50.517408] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-24T21:59:50.672493] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-24T21:59:51.216085] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-24T21:59:51.871397] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-24T21:59:52.016094] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-24T21:59:52.120601] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-24T21:59:52.816075] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-24T21:59:53.042575] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-24T21:59:53.052016] [INFO ] [REMOTE ] VSCO: Full fetch complete (76218 records). [2025-09-24T21:59:53.052233] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-24T21:59:53.455518] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-24T21:59:53.455700] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-24T21:59:53.457047] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-24T21:59:53.457136] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-24T21:59:53.459303] [DEBUG] [LOCAL ] VSCO: Trimmed 76218 records to 52822 (keeping 200 days of data) [2025-09-24T21:59:53.666343] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-24T21:59:53.836696] [DEBUG] [LOCAL ] VSCO: Primary data saved (52822 records). [2025-09-24T21:59:53.836862] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-24T21:59:53.836953] [INFO ] [MAIN ] Update Progress: 2254/2373 symbols completed. VSCO took 32.8s. Estimated remaining: 15m 50s. Rate: 7.5 symbols/min [2025-09-24T21:59:54.014476] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:54.066292] [DEBUG] [LOCAL ] VSTS: Loaded 49047 existing records from primary storage. [2025-09-24T21:59:54.066510] [INFO ] [MAIN ] VSTS: Loaded 49047 existing records. [2025-09-24T21:59:54.256993] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:54.257290] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-24T21:59:54.257345] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-24T21:59:54.259132] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-24T21:59:54.259195] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-24T21:59:54.640447] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:54.641068] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-24T21:59:54.673865] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T21:59:54.718506] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-24T21:59:55.216115] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-24T21:59:56.016074] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-24T21:59:56.144705] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-24T21:59:56.333930] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-24T21:59:56.816083] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-24T21:59:57.324124] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-24T21:59:57.335084] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-24T21:59:57.335245] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-24T21:59:57.566190] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T21:59:57.633447] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-24T21:59:57.778962] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-24T21:59:57.779067] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-24T21:59:57.780338] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-24T21:59:57.780404] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-24T21:59:57.781946] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-09-24T21:59:58.137017] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-24T21:59:58.137213] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-24T21:59:58.137384] [INFO ] [MAIN ] Update Progress: 2255/2373 symbols completed. VRT took 45.8s. Estimated remaining: 15m 42s. Rate: 7.5 symbols/min [2025-09-24T21:59:58.307511] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T21:59:58.353836] [DEBUG] [LOCAL ] VTEX: Loaded 43413 existing records from primary storage. [2025-09-24T21:59:58.354031] [INFO ] [MAIN ] VTEX: Loaded 43413 existing records. [2025-09-24T21:59:58.423832] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-24T21:59:58.539861] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T21:59:58.540102] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-24T21:59:58.540151] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-24T21:59:58.541060] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-24T21:59:58.541131] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-24T21:59:58.906760] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T21:59:59.216103] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-24T21:59:59.276435] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T21:59:59.278158] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-24T21:59:59.859343] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-24T22:00:00.016074] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-24T22:00:00.790555] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T22:00:00.816038] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-24T22:00:01.616161] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-24T22:00:02.357956] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T22:00:02.416101] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-24T22:00:02.891474] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-09-24T22:00:03.216127] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-24T22:00:04.016154] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-24T22:00:05.023546] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (3.41 seconds). [2025-09-24T22:00:05.032588] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-24T22:00:05.701870] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-24T22:00:05.709477] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-24T22:00:05.840801] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (3.42 seconds). [2025-09-24T22:00:06.416055] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-24T22:00:06.613021] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-24T22:00:06.675848] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T22:00:07.216054] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-24T22:00:07.532735] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-24T22:00:08.016055] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-24T22:00:08.116952] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T22:00:08.124975] [INFO ] [REMOTE ] VSH: Full fetch complete (71225 records). [2025-09-24T22:00:08.125103] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-24T22:00:08.538038] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-24T22:00:08.538315] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-24T22:00:08.539830] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-24T22:00:08.539914] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-24T22:00:08.544688] [DEBUG] [LOCAL ] VSH: Trimmed 71225 records to 48566 (keeping 200 days of data) [2025-09-24T22:00:08.834202] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-24T22:00:08.891821] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-24T22:00:08.910310] [DEBUG] [LOCAL ] VSH: Primary data saved (48566 records). [2025-09-24T22:00:08.910441] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-24T22:00:08.910546] [INFO ] [MAIN ] Update Progress: 2256/2373 symbols completed. VSH took 36.4s. Estimated remaining: 15m 34s. Rate: 7.5 symbols/min [2025-09-24T22:00:09.095871] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:09.146817] [DEBUG] [LOCAL ] VTLE: Loaded 48624 existing records from primary storage. [2025-09-24T22:00:09.146967] [INFO ] [MAIN ] VTLE: Loaded 48624 existing records. [2025-09-24T22:00:09.334380] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:09.335161] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-24T22:00:09.335253] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-24T22:00:09.336704] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-24T22:00:09.336887] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-24T22:00:09.622329] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-24T22:00:09.726299] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:09.739051] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T22:00:10.416073] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-24T22:00:10.883682] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-24T22:00:11.216053] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-24T22:00:11.613609] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-24T22:00:11.751783] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-24T22:00:12.016098] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-24T22:00:12.731674] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T22:00:12.816103] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-24T22:00:13.616078] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-24T22:00:13.852829] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T22:00:13.864664] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-09-24T22:00:13.864900] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-24T22:00:14.293428] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-24T22:00:14.293596] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-24T22:00:14.295376] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-24T22:00:14.295492] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-24T22:00:14.299409] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 53720 (keeping 200 days of data) [2025-09-24T22:00:14.417753] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-24T22:00:14.680730] [DEBUG] [LOCAL ] VST: Primary data saved (53720 records). [2025-09-24T22:00:14.680904] [INFO ] [MAIN ] VST: Full history saved. [2025-09-24T22:00:14.681032] [INFO ] [MAIN ] Update Progress: 2257/2373 symbols completed. VST took 37.4s. Estimated remaining: 15m 26s. Rate: 7.5 symbols/min [2025-09-24T22:00:14.880529] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:14.901696] [DEBUG] [LOCAL ] VTMX: Loaded 17446 existing records from primary storage. [2025-09-24T22:00:14.901847] [INFO ] [MAIN ] VTMX: Loaded 17446 existing records. [2025-09-24T22:00:15.113126] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:15.114334] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-24T22:00:15.114396] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-24T22:00:15.114999] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-24T22:00:15.115068] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-24T22:00:15.545215] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-24T22:00:15.549716] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:15.560293] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-24T22:00:15.591086] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-24T22:00:15.989443] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-24T22:00:16.016048] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-24T22:00:16.303994] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T22:00:16.816087] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-24T22:00:17.402552] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T22:00:17.616102] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-24T22:00:17.907713] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-24T22:00:18.276369] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T22:00:18.416054] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-24T22:00:19.216152] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-24T22:00:19.730336] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T22:00:20.016080] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-24T22:00:20.512427] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-24T22:00:20.816103] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-24T22:00:21.446884] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-24T22:00:21.616106] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-24T22:00:21.921486] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T22:00:22.416071] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-24T22:00:23.216266] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-24T22:00:23.599688] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-24T22:00:24.016129] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-24T22:00:24.067950] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T22:00:24.077190] [INFO ] [REMOTE ] VTEX: Full fetch complete (60873 records). [2025-09-24T22:00:24.077387] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-24T22:00:24.505206] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T22:00:24.504544] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-24T22:00:24.509123] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-24T22:00:24.511020] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-24T22:00:24.511104] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-24T22:00:24.512497] [DEBUG] [LOCAL ] VTEX: Trimmed 60873 records to 43395 (keeping 200 days of data) [2025-09-24T22:00:24.787188] [DEBUG] [LOCAL ] VTEX: Primary data saved (43395 records). [2025-09-24T22:00:24.787352] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-24T22:00:24.787491] [INFO ] [MAIN ] Update Progress: 2258/2373 symbols completed. VTEX took 26.6s. Estimated remaining: 15m 18s. Rate: 7.5 symbols/min [2025-09-24T22:00:24.821535] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-24T22:00:24.986579] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:24.997798] [DEBUG] [LOCAL ] VTN: Loaded 7265 existing records from primary storage. [2025-09-24T22:00:24.997931] [INFO ] [MAIN ] VTN: Loaded 7265 existing records. [2025-09-24T22:00:25.183688] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:25.184038] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-24T22:00:25.184111] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-24T22:00:25.184786] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-24T22:00:25.184862] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-24T22:00:25.576498] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:25.607779] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T22:00:25.618149] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-24T22:00:25.660630] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-24T22:00:26.416075] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-24T22:00:26.460268] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T22:00:27.216106] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-24T22:00:27.963665] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-24T22:00:28.016045] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-24T22:00:28.166986] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T22:00:28.743129] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-24T22:00:28.816106] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-24T22:00:29.616083] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-24T22:00:29.664438] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-24T22:00:30.416113] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-24T22:00:31.059998] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T22:00:31.077586] [INFO ] [REMOTE ] VSTS: Full fetch complete (69896 records). [2025-09-24T22:00:31.077862] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-24T22:00:31.224781] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-24T22:00:31.359615] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-24T22:00:31.712326] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-24T22:00:31.712460] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-24T22:00:31.714502] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-24T22:00:31.714604] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-24T22:00:31.716829] [DEBUG] [LOCAL ] VSTS: Trimmed 69896 records to 49050 (keeping 200 days of data) [2025-09-24T22:00:32.031780] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-24T22:00:32.140313] [DEBUG] [LOCAL ] VSTS: Primary data saved (49050 records). [2025-09-24T22:00:32.140482] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-24T22:00:32.140702] [INFO ] [MAIN ] Update Progress: 2259/2373 symbols completed. VSTS took 38.3s. Estimated remaining: 15m 10s. Rate: 7.5 symbols/min [2025-09-24T22:00:32.192403] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T22:00:32.360020] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:32.382884] [DEBUG] [LOCAL ] VTOL: Loaded 19767 existing records from primary storage. [2025-09-24T22:00:32.383046] [INFO ] [MAIN ] VTOL: Loaded 19767 existing records. [2025-09-24T22:00:32.586815] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:32.592854] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-24T22:00:32.593526] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-24T22:00:32.593823] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T22:00:32.597001] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-24T22:00:32.597127] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-24T22:00:32.826126] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-24T22:00:32.981386] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:33.391101] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-24T22:00:33.616105] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-24T22:00:34.416099] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-24T22:00:34.490633] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T22:00:35.216106] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-24T22:00:36.016090] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-24T22:00:36.077921] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-24T22:00:36.247056] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-24T22:00:36.516236] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T22:00:36.816080] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-24T22:00:37.545169] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T22:00:37.616053] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-24T22:00:38.279147] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-24T22:00:38.416130] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-24T22:00:39.216103] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-24T22:00:39.337509] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T22:00:39.339835] [INFO ] [REMOTE ] VTN: Full fetch complete (11462 records). [2025-09-24T22:00:39.339914] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-24T22:00:39.727704] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-24T22:00:39.727794] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-24T22:00:39.728091] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-24T22:00:39.728131] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-24T22:00:39.728568] [DEBUG] [LOCAL ] VTN: Trimmed 11462 records to 7212 (keeping 200 days of data) [2025-09-24T22:00:39.772834] [DEBUG] [LOCAL ] VTN: Primary data saved (7212 records). [2025-09-24T22:00:39.772982] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-24T22:00:39.773119] [INFO ] [MAIN ] Update Progress: 2260/2373 symbols completed. VTN took 15.0s. Estimated remaining: 15m 2s. Rate: 7.5 symbols/min [2025-09-24T22:00:39.964735] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:40.022399] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-24T22:00:40.025979] [DEBUG] [LOCAL ] VTR: Loaded 52845 existing records from primary storage. [2025-09-24T22:00:40.026078] [INFO ] [MAIN ] VTR: Loaded 52845 existing records. [2025-09-24T22:00:40.157141] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T22:00:40.230327] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:40.230584] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-24T22:00:40.230635] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-24T22:00:40.232475] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-24T22:00:40.232538] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-24T22:00:40.602829] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:40.816162] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-24T22:00:41.616049] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-24T22:00:41.778592] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T22:00:41.948574] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-24T22:00:42.416052] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-24T22:00:42.425049] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-24T22:00:43.216081] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-24T22:00:44.016104] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-24T22:00:44.079072] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-24T22:00:44.082500] [INFO ] [REMOTE ] VTMX: Full fetch complete (26084 records). [2025-09-24T22:00:44.082605] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-24T22:00:44.501934] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-24T22:00:44.502050] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-24T22:00:44.506214] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-24T22:00:44.506314] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-24T22:00:44.508845] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-24T22:00:44.520123] [DEBUG] [LOCAL ] VTMX: Trimmed 26084 records to 17530 (keeping 200 days of data) [2025-09-24T22:00:44.626556] [DEBUG] [LOCAL ] VTMX: Primary data saved (17530 records). [2025-09-24T22:00:44.626727] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-24T22:00:44.626842] [INFO ] [MAIN ] Update Progress: 2261/2373 symbols completed. VTMX took 29.9s. Estimated remaining: 14m 54s. Rate: 7.5 symbols/min [2025-09-24T22:00:44.798360] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:44.820594] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-24T22:00:44.834879] [DEBUG] [LOCAL ] VTS: Loaded 30554 existing records from primary storage. [2025-09-24T22:00:44.835013] [INFO ] [MAIN ] VTS: Loaded 30554 existing records. [2025-09-24T22:00:45.018695] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:45.018920] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-24T22:00:45.018969] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-24T22:00:45.019825] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-24T22:00:45.019885] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-24T22:00:45.147928] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-24T22:00:45.400903] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:45.616111] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-24T22:00:46.416070] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-24T22:00:46.577088] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-24T22:00:46.604592] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T22:00:47.216060] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-24T22:00:47.236524] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T22:00:48.016100] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-24T22:00:48.816100] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-24T22:00:48.965162] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-24T22:00:48.994620] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T22:00:49.616094] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-24T22:00:49.800951] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-24T22:00:50.416071] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-24T22:00:51.090061] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T22:00:51.098579] [INFO ] [REMOTE ] VTLE: Full fetch complete (68755 records). [2025-09-24T22:00:51.098798] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-24T22:00:51.221151] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-24T22:00:51.531820] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-24T22:00:51.531932] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-24T22:00:51.533430] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-24T22:00:51.533519] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-24T22:00:51.547191] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T22:00:51.552031] [DEBUG] [LOCAL ] VTLE: Trimmed 68755 records to 48611 (keeping 200 days of data) [2025-09-24T22:00:51.866113] [DEBUG] [LOCAL ] VTLE: Primary data saved (48611 records). [2025-09-24T22:00:51.866262] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-24T22:00:51.866385] [INFO ] [MAIN ] Update Progress: 2262/2373 symbols completed. VTLE took 43.0s. Estimated remaining: 14m 46s. Rate: 7.5 symbols/min [2025-09-24T22:00:52.027857] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-24T22:00:52.062043] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:00:52.093965] [DEBUG] [LOCAL ] VVR: Loaded 30480 existing records from primary storage. [2025-09-24T22:00:52.094153] [INFO ] [MAIN ] VVR: Loaded 30480 existing records. [2025-09-24T22:00:52.320428] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:00:52.320850] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-24T22:00:52.320926] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-24T22:00:52.322490] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-24T22:00:52.322575] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-24T22:00:52.690014] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:00:52.816141] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-24T22:00:52.916883] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-24T22:00:53.083352] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-24T22:00:53.616074] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-24T22:00:53.899224] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T22:00:54.416125] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-24T22:00:54.905339] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T22:00:55.216091] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-24T22:00:56.016062] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-24T22:00:56.379429] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T22:00:56.756258] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-24T22:00:56.816046] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-24T22:00:57.065375] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T22:00:57.616115] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-24T22:00:57.874314] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T22:00:58.416083] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-24T22:00:59.077244] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-24T22:00:59.216050] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-24T22:00:59.444427] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-24T22:00:59.451804] [INFO ] [REMOTE ] VTOL: Full fetch complete (26139 records). [2025-09-24T22:00:59.451942] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-24T22:00:59.832918] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-24T22:00:59.833027] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-24T22:00:59.833853] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-24T22:00:59.833920] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-24T22:00:59.834954] [DEBUG] [LOCAL ] VTOL: Trimmed 26139 records to 19720 (keeping 200 days of data) [2025-09-24T22:00:59.954560] [DEBUG] [LOCAL ] VTOL: Primary data saved (19720 records). [2025-09-24T22:00:59.954746] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-24T22:00:59.954848] [INFO ] [MAIN ] Update Progress: 2263/2373 symbols completed. VTOL took 27.8s. Estimated remaining: 14m 38s. Rate: 7.5 symbols/min [2025-09-24T22:01:00.021193] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-24T22:01:00.128179] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:00.175091] [DEBUG] [LOCAL ] VVV: Loaded 50212 existing records from primary storage. [2025-09-24T22:01:00.175246] [INFO ] [MAIN ] VVV: Loaded 50212 existing records. [2025-09-24T22:01:00.361734] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:00.362193] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-24T22:01:00.362270] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-24T22:01:00.369606] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-24T22:01:00.382401] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-24T22:01:00.454558] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T22:01:00.767239] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:00.816100] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-24T22:01:01.616151] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-24T22:01:01.981074] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T22:01:02.416090] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-24T22:01:02.499311] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-24T22:01:03.035010] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-24T22:01:03.216131] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-24T22:01:04.016098] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-24T22:01:04.288596] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T22:01:04.319452] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T22:01:04.816099] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-24T22:01:05.616056] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-24T22:01:05.649004] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T22:01:05.716168] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-24T22:01:06.416061] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-24T22:01:06.626502] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T22:01:07.216080] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-24T22:01:08.024797] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-24T22:01:08.030422] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T22:01:08.553067] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-24T22:01:08.816095] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-24T22:01:09.414269] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-24T22:01:09.616138] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-24T22:01:10.228092] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-24T22:01:10.234881] [INFO ] [REMOTE ] VTS: Full fetch complete (40819 records). [2025-09-24T22:01:10.235058] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-24T22:01:10.417687] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-24T22:01:10.652224] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-24T22:01:10.652311] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-24T22:01:10.653298] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-24T22:01:10.653369] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-24T22:01:10.654446] [DEBUG] [LOCAL ] VTS: Trimmed 40819 records to 30559 (keeping 200 days of data) [2025-09-24T22:01:10.847961] [DEBUG] [LOCAL ] VTS: Primary data saved (30559 records). [2025-09-24T22:01:10.848091] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-24T22:01:10.848184] [INFO ] [MAIN ] Update Progress: 2264/2373 symbols completed. VTS took 26.2s. Estimated remaining: 14m 30s. Rate: 7.5 symbols/min [2025-09-24T22:01:11.020759] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:11.043437] [DEBUG] [LOCAL ] VVX: Loaded 23369 existing records from primary storage. [2025-09-24T22:01:11.043573] [INFO ] [MAIN ] VVX: Loaded 23369 existing records. [2025-09-24T22:01:11.215346] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T22:01:11.226223] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-24T22:01:11.269826] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:11.271044] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-24T22:01:11.271121] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-24T22:01:11.271708] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-24T22:01:11.271773] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-24T22:01:11.638218] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:12.016071] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-24T22:01:12.305332] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-24T22:01:12.512474] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T22:01:12.816115] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-24T22:01:13.616102] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-24T22:01:13.807704] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T22:01:14.416081] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-24T22:01:14.701407] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-24T22:01:14.800980] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-24T22:01:15.216088] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-24T22:01:16.016058] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-24T22:01:16.131831] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-24T22:01:16.438451] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T22:01:16.816136] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-24T22:01:17.545598] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-24T22:01:17.616046] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-24T22:01:17.656224] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T22:01:18.416079] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-24T22:01:18.687005] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T22:01:19.216284] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-24T22:01:20.016103] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-24T22:01:20.092425] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-24T22:01:20.118729] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T22:01:20.820570] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-24T22:01:20.825483] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T22:01:20.835322] [INFO ] [REMOTE ] VTR: Full fetch complete (76329 records). [2025-09-24T22:01:20.835446] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-24T22:01:21.245636] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-24T22:01:21.245751] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-24T22:01:21.247116] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-24T22:01:21.247182] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-24T22:01:21.248688] [DEBUG] [LOCAL ] VTR: Trimmed 76329 records to 52846 (keeping 200 days of data) [2025-09-24T22:01:21.600861] [DEBUG] [LOCAL ] VTR: Primary data saved (52846 records). [2025-09-24T22:01:21.601018] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-24T22:01:21.601109] [INFO ] [MAIN ] Update Progress: 2265/2373 symbols completed. VTR took 41.8s. Estimated remaining: 14m 22s. Rate: 7.5 symbols/min [2025-09-24T22:01:21.616828] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-24T22:01:21.782405] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:21.830575] [DEBUG] [LOCAL ] VYX: Loaded 49075 existing records from primary storage. [2025-09-24T22:01:21.830753] [INFO ] [MAIN ] VYX: Loaded 49075 existing records. [2025-09-24T22:01:22.014516] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:22.014813] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-24T22:01:22.014867] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-24T22:01:22.016160] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-24T22:01:22.016220] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-24T22:01:22.381719] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:22.416036] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-24T22:01:22.452038] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-24T22:01:22.614989] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T22:01:23.216138] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-24T22:01:24.020285] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-24T22:01:24.026374] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T22:01:24.529909] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T22:01:24.816162] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-24T22:01:25.268358] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-24T22:01:25.616104] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-24T22:01:26.006974] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T22:01:26.016221] [INFO ] [REMOTE ] VVV: Full fetch complete (72311 records). [2025-09-24T22:01:26.016393] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-24T22:01:26.414836] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-24T22:01:26.414931] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-24T22:01:26.416195] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-24T22:01:26.416134] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-24T22:01:26.416396] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-24T22:01:26.418771] [DEBUG] [LOCAL ] VVV: Trimmed 72311 records to 50210 (keeping 200 days of data) [2025-09-24T22:01:26.532952] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T22:01:26.740851] [DEBUG] [LOCAL ] VVV: Primary data saved (50210 records). [2025-09-24T22:01:26.740997] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-24T22:01:26.741083] [INFO ] [MAIN ] Update Progress: 2266/2373 symbols completed. VVV took 26.8s. Estimated remaining: 14m 14s. Rate: 7.5 symbols/min [2025-09-24T22:01:26.911877] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:26.964096] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-24T22:01:26.964269] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-24T22:01:27.148477] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:27.148778] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-24T22:01:27.148835] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-24T22:01:27.150591] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-24T22:01:27.150681] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-24T22:01:27.225438] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-24T22:01:27.527949] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:27.548224] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-24T22:01:28.016133] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-24T22:01:28.567057] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T22:01:28.816086] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-24T22:01:28.884543] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-24T22:01:29.616094] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-24T22:01:30.380840] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-24T22:01:30.426045] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-24T22:01:30.430873] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T22:01:31.216146] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-24T22:01:32.016130] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-24T22:01:32.413321] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T22:01:32.421054] [INFO ] [REMOTE ] VVR: Full fetch complete (45774 records). [2025-09-24T22:01:32.421260] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-24T22:01:32.820160] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-24T22:01:32.874900] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-24T22:01:32.877189] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-24T22:01:32.877514] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-24T22:01:32.890370] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-24T22:01:32.890446] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-24T22:01:32.891545] [DEBUG] [LOCAL ] VVR: Trimmed 45774 records to 30603 (keeping 200 days of data) [2025-09-24T22:01:33.087779] [DEBUG] [LOCAL ] VVR: Primary data saved (30603 records). [2025-09-24T22:01:33.087953] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-24T22:01:33.088050] [INFO ] [MAIN ] Update Progress: 2267/2373 symbols completed. VVR took 41.2s. Estimated remaining: 14m 6s. Rate: 7.5 symbols/min [2025-09-24T22:01:33.291579] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:33.353485] [DEBUG] [LOCAL ] W: Loaded 53503 existing records from primary storage. [2025-09-24T22:01:33.353762] [INFO ] [MAIN ] W: Loaded 53503 existing records. [2025-09-24T22:01:33.524540] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-24T22:01:33.573799] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:33.574396] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-24T22:01:33.574449] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-24T22:01:33.575800] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-24T22:01:33.575863] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-24T22:01:33.624932] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-24T22:01:33.967180] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:34.416083] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-24T22:01:34.593021] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-24T22:01:34.768947] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-24T22:01:34.774274] [INFO ] [REMOTE ] VVX: Full fetch complete (33555 records). [2025-09-24T22:01:34.774375] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-24T22:01:35.155229] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-24T22:01:35.155310] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-24T22:01:35.156068] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-24T22:01:35.156132] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-24T22:01:35.156963] [DEBUG] [LOCAL ] VVX: Trimmed 33555 records to 23347 (keeping 200 days of data) [2025-09-24T22:01:35.217831] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-24T22:01:35.302021] [DEBUG] [LOCAL ] VVX: Primary data saved (23347 records). [2025-09-24T22:01:35.302156] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-24T22:01:35.302264] [INFO ] [MAIN ] Update Progress: 2268/2373 symbols completed. VVX took 24.5s. Estimated remaining: 13m 58s. Rate: 7.5 symbols/min [2025-09-24T22:01:35.473523] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:35.518358] [DEBUG] [LOCAL ] WAB: Loaded 44280 existing records from primary storage. [2025-09-24T22:01:35.518500] [INFO ] [MAIN ] WAB: Loaded 44280 existing records. [2025-09-24T22:01:35.700924] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:35.701188] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-24T22:01:35.701238] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-24T22:01:35.702238] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-24T22:01:35.702301] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-24T22:01:36.021169] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-24T22:01:36.080825] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:36.327786] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-24T22:01:36.816100] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-24T22:01:36.968668] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T22:01:37.616102] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-24T22:01:38.201468] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T22:01:38.416047] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-24T22:01:38.552970] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-24T22:01:39.089156] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T22:01:39.216097] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-24T22:01:40.016055] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-24T22:01:40.064563] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-24T22:01:40.816082] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-24T22:01:41.475718] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-24T22:01:41.616081] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-24T22:01:41.753036] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T22:01:42.197969] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-24T22:01:42.416072] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-24T22:01:43.216075] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-24T22:01:43.306884] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-24T22:01:44.016057] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-24T22:01:44.224761] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T22:01:44.799322] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T22:01:44.816033] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-24T22:01:45.616157] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-24T22:01:46.119682] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-24T22:01:46.193221] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-24T22:01:46.416110] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-24T22:01:47.216120] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-24T22:01:47.347581] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-24T22:01:48.016131] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-24T22:01:48.804233] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-24T22:01:48.813213] [INFO ] [REMOTE ] VYX: Full fetch complete (70301 records). [2025-09-24T22:01:48.813376] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-24T22:01:48.821165] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-24T22:01:49.240334] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-24T22:01:49.298232] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-24T22:01:49.298778] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-24T22:01:49.300176] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-24T22:01:49.300248] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-24T22:01:49.302452] [DEBUG] [LOCAL ] VYX: Trimmed 70301 records to 49030 (keeping 200 days of data) [2025-09-24T22:01:49.606722] [DEBUG] [LOCAL ] VYX: Primary data saved (49030 records). [2025-09-24T22:01:49.606860] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-24T22:01:49.606963] [INFO ] [MAIN ] Update Progress: 2269/2373 symbols completed. VYX took 28.0s. Estimated remaining: 13m 50s. Rate: 7.5 symbols/min [2025-09-24T22:01:49.641410] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-24T22:01:49.800746] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:01:49.829580] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T22:01:49.878547] [DEBUG] [LOCAL ] WAL: Loaded 45418 existing records from primary storage. [2025-09-24T22:01:49.878726] [INFO ] [MAIN ] WAL: Loaded 45418 existing records. [2025-09-24T22:01:50.056881] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:01:50.057186] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-24T22:01:50.057235] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-24T22:01:50.058402] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-24T22:01:50.058463] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-24T22:01:50.422214] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:01:50.418475] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-24T22:01:51.041168] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-24T22:01:51.216126] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-24T22:01:52.016057] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-24T22:01:52.069727] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:01:52.129971] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-24T22:01:52.816126] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-24T22:01:53.195200] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-24T22:01:53.568042] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T22:01:53.616095] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-24T22:01:54.416135] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-24T22:01:54.842387] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-24T22:01:55.216108] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-24T22:01:55.856907] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-24T22:01:55.896111] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T22:01:56.016108] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-24T22:01:56.816095] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-24T22:01:57.616046] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-24T22:01:57.787822] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T22:01:57.889892] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-24T22:01:58.270187] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T22:01:58.416058] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-24T22:01:59.216053] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-24T22:01:59.351835] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T22:02:00.016154] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-24T22:02:00.381712] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-24T22:02:00.816085] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-24T22:02:01.105878] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T22:02:01.616104] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-24T22:02:02.194189] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T22:02:02.206635] [INFO ] [REMOTE ] WAB: Full fetch complete (64512 records). [2025-09-24T22:02:02.206963] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-24T22:02:02.427987] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-24T22:02:02.676729] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-24T22:02:02.677067] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-24T22:02:02.678830] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-24T22:02:02.679012] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-24T22:02:02.683191] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-24T22:02:02.696682] [DEBUG] [LOCAL ] WAB: Trimmed 64512 records to 44215 (keeping 200 days of data) [2025-09-24T22:02:02.843339] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-24T22:02:03.022715] [DEBUG] [LOCAL ] WAB: Primary data saved (44215 records). [2025-09-24T22:02:03.022869] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-24T22:02:03.022988] [INFO ] [MAIN ] Update Progress: 2270/2373 symbols completed. WAB took 27.7s. Estimated remaining: 13m 42s. Rate: 7.5 symbols/min [2025-09-24T22:02:03.196125] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:03.216673] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-24T22:02:03.235670] [DEBUG] [LOCAL ] WAT: Loaded 35074 existing records from primary storage. [2025-09-24T22:02:03.235870] [INFO ] [MAIN ] WAT: Loaded 35074 existing records. [2025-09-24T22:02:03.457132] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:03.457787] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-24T22:02:03.457886] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-24T22:02:03.458851] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-24T22:02:03.458938] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-24T22:02:03.831244] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:03.951064] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-24T22:02:03.960934] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-24T22:02:03.961111] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-24T22:02:04.019680] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-24T22:02:04.425717] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-24T22:02:04.426597] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-24T22:02:04.428094] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-24T22:02:04.429585] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-24T22:02:04.438400] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-24T22:02:04.440521] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-09-24T22:02:04.800353] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-24T22:02:04.800550] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-24T22:02:04.800815] [INFO ] [MAIN ] Update Progress: 2271/2373 symbols completed. VZ took 38.1s. Estimated remaining: 13m 34s. Rate: 7.5 symbols/min [2025-09-24T22:02:04.822476] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-24T22:02:05.079037] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:05.079260] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-24T22:02:05.079317] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-24T22:02:05.079487] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-24T22:02:05.079532] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-24T22:02:05.079574] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-24T22:02:05.079607] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-24T22:02:05.472885] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:05.616159] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-24T22:02:05.925827] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-24T22:02:05.938606] [INFO ] [REMOTE ] W: Full fetch complete (77436 records). [2025-09-24T22:02:05.938841] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-24T22:02:06.342989] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-24T22:02:06.343069] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-24T22:02:06.344280] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-24T22:02:06.344344] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-24T22:02:06.345907] [DEBUG] [LOCAL ] W: Trimmed 77436 records to 53496 (keeping 200 days of data) [2025-09-24T22:02:06.440894] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-24T22:02:06.651911] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:06.652444] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-24T22:02:06.709482] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T22:02:06.740484] [DEBUG] [LOCAL ] W: Primary data saved (53496 records). [2025-09-24T22:02:06.740702] [INFO ] [MAIN ] W: Full history saved. [2025-09-24T22:02:06.740959] [INFO ] [MAIN ] Update Progress: 2272/2373 symbols completed. W took 33.7s. Estimated remaining: 13m 26s. Rate: 7.5 symbols/min [2025-09-24T22:02:06.926622] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:06.997348] [DEBUG] [LOCAL ] WBS: Loaded 48780 existing records from primary storage. [2025-09-24T22:02:06.998802] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-24T22:02:06.998928] [INFO ] [MAIN ] WBS: Loaded 48780 existing records. [2025-09-24T22:02:07.184072] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:07.184378] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-24T22:02:07.184435] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-24T22:02:07.185737] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-24T22:02:07.185837] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-24T22:02:07.221280] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-24T22:02:07.556801] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:08.016163] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-24T22:02:08.740387] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-24T22:02:08.816071] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-24T22:02:09.616067] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-24T22:02:10.124402] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-24T22:02:10.427860] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-24T22:02:10.430388] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T22:02:11.213464] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-24T22:02:11.222260] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-24T22:02:12.016096] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-24T22:02:12.063398] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-24T22:02:12.232252] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:12.232612] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-24T22:02:12.696859] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T22:02:12.816081] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-24T22:02:13.035151] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:13.035549] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-24T22:02:13.616124] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-24T22:02:14.416138] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-24T22:02:15.206535] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-24T22:02:15.216327] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-24T22:02:16.016056] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-24T22:02:16.425090] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:16.425443] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-24T22:02:16.487224] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T22:02:16.567102] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-24T22:02:16.816089] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-24T22:02:17.047735] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:17.048107] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-24T22:02:17.616107] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-24T22:02:18.416124] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-24T22:02:18.599623] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T22:02:19.216124] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-24T22:02:19.692835] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T22:02:20.016129] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-24T22:02:20.268112] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:20.268443] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-24T22:02:20.798114] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-24T22:02:20.816044] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-24T22:02:21.041256] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:21.041668] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-24T22:02:21.616089] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-24T22:02:21.824634] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:21.825029] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-24T22:02:22.416073] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-24T22:02:22.872737] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T22:02:23.216065] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-24T22:02:23.867594] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T22:02:23.874302] [INFO ] [REMOTE ] WAT: Full fetch complete (49936 records). [2025-09-24T22:02:23.874434] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-24T22:02:24.028536] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-24T22:02:24.282068] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-24T22:02:24.282160] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-24T22:02:24.283286] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-24T22:02:24.283370] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-24T22:02:24.285464] [DEBUG] [LOCAL ] WAT: Trimmed 49936 records to 35095 (keeping 200 days of data) [2025-09-24T22:02:24.525434] [DEBUG] [LOCAL ] WAT: Primary data saved (35095 records). [2025-09-24T22:02:24.525629] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-24T22:02:24.525890] [INFO ] [MAIN ] Update Progress: 2273/2373 symbols completed. WAT took 21.5s. Estimated remaining: 13m 18s. Rate: 7.5 symbols/min [2025-09-24T22:02:24.696394] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:24.710668] [DEBUG] [LOCAL ] WBX: Loaded 12641 existing records from primary storage. [2025-09-24T22:02:24.710794] [INFO ] [MAIN ] WBX: Loaded 12641 existing records. [2025-09-24T22:02:24.821184] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-24T22:02:24.890629] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:24.890873] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-24T22:02:24.890934] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-24T22:02:24.891334] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-24T22:02:24.891403] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-24T22:02:25.107781] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:02:25.140236] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-24T22:02:25.248237] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:25.616088] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-24T22:02:25.909784] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T22:02:26.416105] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-24T22:02:27.053842] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-24T22:02:27.216094] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-24T22:02:28.016098] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-24T22:02:28.206323] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-24T22:02:28.816061] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-24T22:02:28.862093] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T22:02:29.526613] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-24T22:02:29.616064] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-24T22:02:30.416110] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-24T22:02:30.468752] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:02:30.894779] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-24T22:02:31.089849] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-24T22:02:31.093157] [INFO ] [REMOTE ] WBI: Full fetch complete (1922 records). [2025-09-24T22:02:31.093242] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-24T22:02:31.221183] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-24T22:02:31.291673] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-24T22:02:31.291906] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-24T22:02:31.292010] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-24T22:02:31.292089] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-24T22:02:31.292155] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-24T22:02:31.292227] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-24T22:02:31.292298] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-24T22:02:31.292459] [INFO ] [MAIN ] Update Progress: 2274/2373 symbols completed. WBI took 26.5s. Estimated remaining: 13m 10s. Rate: 7.5 symbols/min [2025-09-24T22:02:31.478476] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:31.543595] [DEBUG] [LOCAL ] WCC: Loaded 40057 existing records from primary storage. [2025-09-24T22:02:31.543801] [INFO ] [MAIN ] WCC: Loaded 40057 existing records. [2025-09-24T22:02:31.736272] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:31.736565] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-24T22:02:31.736618] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-24T22:02:31.737821] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-24T22:02:31.737885] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-24T22:02:32.021315] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-24T22:02:32.127834] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:32.816097] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-24T22:02:32.886259] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-24T22:02:33.400170] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-24T22:02:33.616091] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-24T22:02:34.426785] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-24T22:02:34.454430] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T22:02:35.044882] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-24T22:02:35.216125] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-24T22:02:36.016060] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-24T22:02:36.181341] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T22:02:36.740016] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T22:02:36.749239] [INFO ] [REMOTE ] WAL: Full fetch complete (66343 records). [2025-09-24T22:02:36.749378] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-24T22:02:36.824394] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-24T22:02:37.143591] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-24T22:02:37.143715] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-24T22:02:37.144929] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-24T22:02:37.145023] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-24T22:02:37.146472] [DEBUG] [LOCAL ] WAL: Trimmed 66343 records to 45337 (keeping 200 days of data) [2025-09-24T22:02:37.279901] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-24T22:02:37.484912] [DEBUG] [LOCAL ] WAL: Primary data saved (45337 records). [2025-09-24T22:02:37.485090] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-24T22:02:37.485189] [INFO ] [MAIN ] Update Progress: 2275/2373 symbols completed. WAL took 47.9s. Estimated remaining: 13m 2s. Rate: 7.5 symbols/min [2025-09-24T22:02:37.621169] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-24T22:02:37.681517] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:37.735301] [DEBUG] [LOCAL ] WCN: Loaded 48064 existing records from primary storage. [2025-09-24T22:02:37.735448] [INFO ] [MAIN ] WCN: Loaded 48064 existing records. [2025-09-24T22:02:37.937759] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:37.938044] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-24T22:02:37.938093] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-24T22:02:37.939333] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-24T22:02:37.939397] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-24T22:02:38.299285] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:38.416089] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-24T22:02:38.571151] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T22:02:39.076579] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T22:02:39.216082] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-24T22:02:40.016103] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-24T22:02:40.156165] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T22:02:40.692352] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T22:02:40.701624] [INFO ] [REMOTE ] WBS: Full fetch complete (69340 records). [2025-09-24T22:02:40.701856] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-24T22:02:40.824705] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-24T22:02:41.033003] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-24T22:02:41.165340] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-24T22:02:41.165436] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-24T22:02:41.166806] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-24T22:02:41.166875] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-24T22:02:41.170305] [DEBUG] [LOCAL ] WBS: Trimmed 69340 records to 48737 (keeping 200 days of data) [2025-09-24T22:02:41.474271] [DEBUG] [LOCAL ] WBS: Primary data saved (48737 records). [2025-09-24T22:02:41.474415] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-24T22:02:41.474532] [INFO ] [MAIN ] Update Progress: 2276/2373 symbols completed. WBS took 34.7s. Estimated remaining: 12m 54s. Rate: 7.5 symbols/min [2025-09-24T22:02:41.625870] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-24T22:02:41.652993] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:02:41.676637] [DEBUG] [LOCAL ] WD: Loaded 23537 existing records from primary storage. [2025-09-24T22:02:41.676816] [INFO ] [MAIN ] WD: Loaded 23537 existing records. [2025-09-24T22:02:41.855743] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:02:41.856024] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-24T22:02:41.856073] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-24T22:02:41.856786] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-24T22:02:41.856847] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-24T22:02:42.233801] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:02:42.416114] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-24T22:02:42.468312] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T22:02:43.214939] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-24T22:02:43.217794] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-24T22:02:43.532615] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-24T22:02:44.016081] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-24T22:02:44.805601] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-24T22:02:44.816046] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-24T22:02:44.876297] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T22:02:45.543825] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-24T22:02:45.616059] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-24T22:02:46.224629] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T22:02:46.416125] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-24T22:02:47.216149] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-24T22:02:47.718455] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-24T22:02:47.719917] [INFO ] [REMOTE ] WBX: Full fetch complete (25906 records). [2025-09-24T22:02:47.720063] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-24T22:02:48.017834] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-24T22:02:48.140160] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-24T22:02:48.140303] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-24T22:02:48.140980] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-24T22:02:48.141236] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-24T22:02:48.142484] [DEBUG] [LOCAL ] WBX: Trimmed 25906 records to 12517 (keeping 200 days of data) [2025-09-24T22:02:48.220489] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T22:02:48.250228] [DEBUG] [LOCAL ] WBX: Primary data saved (12517 records). [2025-09-24T22:02:48.250373] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-24T22:02:48.250463] [INFO ] [MAIN ] Update Progress: 2277/2373 symbols completed. WBX took 23.7s. Estimated remaining: 12m 46s. Rate: 7.5 symbols/min [2025-09-24T22:02:48.816126] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-24T22:02:49.616211] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-24T22:02:49.865369] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T22:02:49.899483] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T22:02:50.416117] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-24T22:02:51.216070] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-24T22:02:51.315400] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T22:02:51.483362] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-24T22:02:52.016125] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-24T22:02:52.816065] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-24T22:02:53.103950] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-24T22:02:53.130947] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T22:02:53.616093] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-24T22:02:54.412532] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-24T22:02:54.420701] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-24T22:02:54.523976] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T22:02:55.216080] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-24T22:02:56.016116] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-24T22:02:56.221730] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-24T22:02:56.248094] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-24T22:02:56.816083] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-24T22:02:57.361179] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T22:02:57.616114] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-24T22:02:58.316509] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-24T22:02:58.416037] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-24T22:02:58.883264] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-24T22:02:59.216121] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-24T22:03:00.016053] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-24T22:03:00.061390] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-24T22:03:00.816056] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-24T22:03:00.858206] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T22:03:01.219252] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-24T22:03:01.616151] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-24T22:03:02.416152] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-24T22:03:03.064289] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T22:03:03.216061] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-24T22:03:05.001988] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (3.39 seconds). [2025-09-24T22:03:05.010366] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-24T22:03:05.146354] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-24T22:03:05.152492] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-24T22:03:05.303040] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-24T22:03:05.311329] [INFO ] [REMOTE ] WCN: Full fetch complete (69360 records). [2025-09-24T22:03:05.311442] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-24T22:03:05.706136] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-24T22:03:05.706218] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-24T22:03:05.707371] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-24T22:03:05.707434] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-24T22:03:05.708784] [DEBUG] [LOCAL ] WCN: Trimmed 69360 records to 48029 (keeping 200 days of data) [2025-09-24T22:03:06.021805] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T22:03:06.028060] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-24T22:03:06.037971] [DEBUG] [LOCAL ] WCN: Primary data saved (48029 records). [2025-09-24T22:03:06.038059] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-24T22:03:06.038139] [INFO ] [MAIN ] Update Progress: 2278/2373 symbols completed. WCN took 28.6s. Estimated remaining: 12m 38s. Rate: 7.5 symbols/min [2025-09-24T22:03:06.565334] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-24T22:03:06.572104] [INFO ] [REMOTE ] WCC: Full fetch complete (57797 records). [2025-09-24T22:03:06.572208] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-24T22:03:06.986998] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-24T22:03:06.987147] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-24T22:03:06.989116] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-24T22:03:06.989256] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-24T22:03:06.990695] [DEBUG] [LOCAL ] WCC: Trimmed 57797 records to 39967 (keeping 200 days of data) [2025-09-24T22:03:07.131917] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-24T22:03:07.137664] [INFO ] [REMOTE ] WD: Full fetch complete (32881 records). [2025-09-24T22:03:07.138560] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-24T22:03:07.650423] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-24T22:03:07.650862] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-24T22:03:07.652135] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-24T22:03:07.652537] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-24T22:03:07.655422] [DEBUG] [LOCAL ] WD: Trimmed 32881 records to 23422 (keeping 200 days of data) [2025-09-24T22:03:07.811468] [DEBUG] [LOCAL ] WCC: Primary data saved (39967 records). [2025-09-24T22:03:07.812424] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-24T22:03:07.812902] [INFO ] [MAIN ] Update Progress: 2279/2373 symbols completed. WCC took 36.5s. Estimated remaining: 12m 30s. Rate: 7.5 symbols/min [2025-09-24T22:03:07.840010] [DEBUG] [LOCAL ] WD: Primary data saved (23422 records). [2025-09-24T22:03:07.840201] [INFO ] [MAIN ] WD: Full history saved. [2025-09-24T22:03:07.840336] [INFO ] [MAIN ] Update Progress: 2280/2373 symbols completed. WD took 26.4s. Estimated remaining: 12m 22s. Rate: 7.5 symbols/min [2025-09-24T22:03:08.522142] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:08.537801] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:08.541502] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:08.560415] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:08.571511] [DEBUG] [LOCAL ] WEA: Loaded 7353 existing records from primary storage. [2025-09-24T22:03:08.571672] [INFO ] [MAIN ] WEA: Loaded 7353 existing records. [2025-09-24T22:03:08.716883] [DEBUG] [LOCAL ] WDH: Loaded 17064 existing records from primary storage. [2025-09-24T22:03:08.743300] [INFO ] [MAIN ] WDH: Loaded 17064 existing records. [2025-09-24T22:03:08.711187] [DEBUG] [LOCAL ] WDI: Loaded 21050 existing records from primary storage. [2025-09-24T22:03:08.797457] [INFO ] [MAIN ] WDI: Loaded 21050 existing records. [2025-09-24T22:03:08.869140] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:08.947481] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-24T22:03:08.965058] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-24T22:03:09.052759] [DEBUG] [LOCAL ] WDS: Loaded 43647 existing records from primary storage. [2025-09-24T22:03:09.032817] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-24T22:03:09.053086] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-24T22:03:09.074717] [INFO ] [MAIN ] WDS: Loaded 43647 existing records. [2025-09-24T22:03:09.411456] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:09.475744] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:09.481404] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-24T22:03:09.515070] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-24T22:03:09.523787] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-24T22:03:09.551915] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-24T22:03:09.565353] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-24T22:03:09.597357] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-24T22:03:09.609530] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-24T22:03:09.674476] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-24T22:03:09.784714] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:09.879102] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-24T22:03:09.914821] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-24T22:03:09.960431] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-24T22:03:10.078090] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-24T22:03:10.230266] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:10.269725] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-24T22:03:10.765279] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:10.807476] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:10.822263] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-24T22:03:10.848892] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-24T22:03:11.014792] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:11.015146] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-24T22:03:11.137738] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-24T22:03:11.139816] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-24T22:03:11.768846] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-24T22:03:11.771176] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-24T22:03:11.839364] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-24T22:03:11.847902] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-24T22:03:11.858993] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T22:03:12.016090] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-24T22:03:12.135148] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-24T22:03:12.514183] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-24T22:03:12.816061] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-24T22:03:12.953634] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-24T22:03:13.046728] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-24T22:03:13.616091] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-24T22:03:14.416084] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-24T22:03:15.122179] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T22:03:15.216088] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-24T22:03:15.311834] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-24T22:03:15.344862] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-24T22:03:16.016081] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-24T22:03:16.055098] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-24T22:03:16.816094] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-24T22:03:17.545459] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T22:03:17.616047] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-24T22:03:18.097048] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-24T22:03:18.416080] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-24T22:03:19.216082] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-24T22:03:19.303541] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-24T22:03:19.390348] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-24T22:03:20.016092] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-24T22:03:20.139326] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T22:03:20.816081] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-24T22:03:21.073305] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-24T22:03:21.616159] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-24T22:03:22.421232] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-24T22:03:22.442009] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-24T22:03:22.674407] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-24T22:03:23.216101] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-24T22:03:23.232822] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T22:03:24.016122] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-24T22:03:24.816080] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-24T22:03:24.865501] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:03:24.887630] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-24T22:03:25.616084] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-24T22:03:25.727753] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-24T22:03:26.416141] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-24T22:03:26.707463] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-24T22:03:27.216137] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-24T22:03:27.684385] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T22:03:27.809535] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-24T22:03:28.016137] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-24T22:03:28.816097] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-24T22:03:29.616097] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-24T22:03:29.832297] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T22:03:29.857986] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-24T22:03:29.861584] [INFO ] [REMOTE ] WDI: Full fetch complete (30757 records). [2025-09-24T22:03:29.861687] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-24T22:03:30.292921] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-24T22:03:30.293885] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-24T22:03:30.294056] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-24T22:03:30.297459] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-24T22:03:30.297533] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-24T22:03:30.298606] [DEBUG] [LOCAL ] WDI: Trimmed 30757 records to 21004 (keeping 200 days of data) [2025-09-24T22:03:30.423044] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-24T22:03:30.441293] [DEBUG] [LOCAL ] WDI: Primary data saved (21004 records). [2025-09-24T22:03:30.441422] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-24T22:03:30.441509] [INFO ] [MAIN ] Update Progress: 2281/2373 symbols completed. WDI took 22.6s. Estimated remaining: 12m 14s. Rate: 7.5 symbols/min [2025-09-24T22:03:30.641314] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:30.686789] [DEBUG] [LOCAL ] WEAV: Loaded 42058 existing records from primary storage. [2025-09-24T22:03:30.686936] [INFO ] [MAIN ] WEAV: Loaded 42058 existing records. [2025-09-24T22:03:30.871959] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:30.872206] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-24T22:03:30.872263] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-24T22:03:30.873274] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-24T22:03:30.873337] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-24T22:03:31.221255] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-24T22:03:31.251022] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:31.502299] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-24T22:03:32.016079] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-24T22:03:32.502045] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-24T22:03:32.816084] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-24T22:03:33.398131] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-24T22:03:33.404145] [INFO ] [REMOTE ] WDH: Full fetch complete (22816 records). [2025-09-24T22:03:33.404227] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-24T22:03:33.622215] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-24T22:03:33.784290] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-24T22:03:33.784380] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-24T22:03:33.784999] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-24T22:03:33.785063] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-24T22:03:33.785883] [DEBUG] [LOCAL ] WDH: Trimmed 22816 records to 17223 (keeping 200 days of data) [2025-09-24T22:03:33.889824] [DEBUG] [LOCAL ] WDH: Primary data saved (17223 records). [2025-09-24T22:03:33.889991] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-24T22:03:33.890099] [INFO ] [MAIN ] Update Progress: 2282/2373 symbols completed. WDH took 26.0s. Estimated remaining: 12m 6s. Rate: 7.5 symbols/min [2025-09-24T22:03:34.075054] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:34.101504] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-24T22:03:34.167497] [DEBUG] [LOCAL ] WEC: Loaded 52213 existing records from primary storage. [2025-09-24T22:03:34.167689] [INFO ] [MAIN ] WEC: Loaded 52213 existing records. [2025-09-24T22:03:34.354615] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:34.354936] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-24T22:03:34.354992] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-24T22:03:34.356379] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-24T22:03:34.356448] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-24T22:03:34.421196] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-24T22:03:34.510483] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-24T22:03:34.734236] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:35.216080] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-24T22:03:36.016096] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-24T22:03:36.046046] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T22:03:36.651954] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-24T22:03:36.816078] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-24T22:03:37.616086] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-24T22:03:37.855078] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-24T22:03:38.310758] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T22:03:38.416081] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-24T22:03:38.844123] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T22:03:38.852142] [INFO ] [REMOTE ] WDS: Full fetch complete (64835 records). [2025-09-24T22:03:38.852304] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-24T22:03:39.218305] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-24T22:03:39.239348] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-24T22:03:39.239455] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-24T22:03:39.240793] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-24T22:03:39.241069] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-24T22:03:39.242464] [DEBUG] [LOCAL ] WDS: Trimmed 64835 records to 43599 (keeping 200 days of data) [2025-09-24T22:03:39.517188] [DEBUG] [LOCAL ] WDS: Primary data saved (43599 records). [2025-09-24T22:03:39.517347] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-24T22:03:39.517441] [INFO ] [MAIN ] Update Progress: 2283/2373 symbols completed. WDS took 31.7s. Estimated remaining: 11m 58s. Rate: 7.5 symbols/min [2025-09-24T22:03:39.694617] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:39.750351] [DEBUG] [LOCAL ] WELL: Loaded 52359 existing records from primary storage. [2025-09-24T22:03:39.750791] [INFO ] [MAIN ] WELL: Loaded 52359 existing records. [2025-09-24T22:03:39.875674] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-24T22:03:39.937161] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-24T22:03:39.982528] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:39.982809] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-24T22:03:39.982863] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-24T22:03:39.984320] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-24T22:03:39.984382] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-24T22:03:40.021295] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-24T22:03:40.340126] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:40.816106] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-24T22:03:40.879583] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-24T22:03:41.616128] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-24T22:03:42.421420] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-24T22:03:42.443113] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T22:03:43.216077] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-24T22:03:43.565214] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-24T22:03:43.830173] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-24T22:03:44.016104] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-24T22:03:44.816116] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-24T22:03:44.957969] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T22:03:45.113598] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-24T22:03:45.616108] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-24T22:03:46.253659] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-24T22:03:46.416092] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-24T22:03:46.586893] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T22:03:47.216098] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-24T22:03:47.674495] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-24T22:03:47.774171] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-24T22:03:47.776127] [INFO ] [REMOTE ] WEA: Full fetch complete (9921 records). [2025-09-24T22:03:47.776200] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-24T22:03:48.022030] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-24T22:03:48.175659] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-24T22:03:48.175830] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-24T22:03:48.176116] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-24T22:03:48.176159] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-24T22:03:48.176756] [DEBUG] [LOCAL ] WEA: Trimmed 9921 records to 7343 (keeping 200 days of data) [2025-09-24T22:03:48.222133] [DEBUG] [LOCAL ] WEA: Primary data saved (7343 records). [2025-09-24T22:03:48.222276] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-24T22:03:48.222366] [INFO ] [MAIN ] Update Progress: 2284/2373 symbols completed. WEA took 40.4s. Estimated remaining: 11m 50s. Rate: 7.5 symbols/min [2025-09-24T22:03:48.395681] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:48.446489] [DEBUG] [LOCAL ] WES: Loaded 48023 existing records from primary storage. [2025-09-24T22:03:48.446671] [INFO ] [MAIN ] WES: Loaded 48023 existing records. [2025-09-24T22:03:48.628681] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:48.628971] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-24T22:03:48.629021] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-24T22:03:48.630361] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-24T22:03:48.630423] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-24T22:03:48.824435] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-24T22:03:49.007746] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:49.516395] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-24T22:03:49.616125] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-24T22:03:50.416083] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-24T22:03:50.806982] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-24T22:03:51.226927] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-24T22:03:51.233005] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T22:03:51.891864] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T22:03:52.016115] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-24T22:03:52.486434] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-24T22:03:52.816132] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-24T22:03:53.616143] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-24T22:03:53.898888] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-24T22:03:54.308706] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-24T22:03:54.317131] [INFO ] [REMOTE ] WEAV: Full fetch complete (61528 records). [2025-09-24T22:03:54.317365] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-24T22:03:54.421256] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-24T22:03:54.740806] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-24T22:03:54.740957] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-24T22:03:54.742273] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-24T22:03:54.742365] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-24T22:03:54.743862] [DEBUG] [LOCAL ] WEAV: Trimmed 61528 records to 41969 (keeping 200 days of data) [2025-09-24T22:03:54.992509] [DEBUG] [LOCAL ] WEAV: Primary data saved (41969 records). [2025-09-24T22:03:54.992668] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-24T22:03:54.992807] [INFO ] [MAIN ] Update Progress: 2285/2373 symbols completed. WEAV took 24.6s. Estimated remaining: 11m 42s. Rate: 7.5 symbols/min [2025-09-24T22:03:55.167157] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:03:55.207492] [DEBUG] [LOCAL ] WEX: Loaded 35399 existing records from primary storage. [2025-09-24T22:03:55.207639] [INFO ] [MAIN ] WEX: Loaded 35399 existing records. [2025-09-24T22:03:55.228040] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-24T22:03:55.428002] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:03:55.428393] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-24T22:03:55.428706] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-24T22:03:55.430593] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-24T22:03:55.430516] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-24T22:03:55.430773] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-24T22:03:55.846472] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:03:56.016042] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-24T22:03:56.382692] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-24T22:03:56.587102] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T22:03:56.816093] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-24T22:03:57.616116] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-24T22:03:57.863595] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-24T22:03:58.213003] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-24T22:03:58.416102] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-24T22:03:59.102896] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T22:03:59.216083] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-24T22:04:00.016143] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-24T22:04:00.199761] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T22:04:00.816091] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-24T22:04:00.885859] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-24T22:04:01.247254] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-24T22:04:01.616103] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-24T22:04:02.416143] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-24T22:04:02.547265] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-24T22:04:03.216062] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-24T22:04:03.474708] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:04:03.563404] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T22:04:04.016154] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-24T22:04:04.816089] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-24T22:04:04.934077] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T22:04:05.475760] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-24T22:04:05.616118] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-24T22:04:06.416104] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-24T22:04:06.543573] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-24T22:04:07.216099] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-24T22:04:07.368226] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-24T22:04:07.871510] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T22:04:08.016052] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-24T22:04:08.527450] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-24T22:04:08.539966] [INFO ] [REMOTE ] WEC: Full fetch complete (75473 records). [2025-09-24T22:04:08.540114] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-24T22:04:08.821403] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-24T22:04:08.992102] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-24T22:04:08.992227] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-24T22:04:08.993660] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-24T22:04:08.993731] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-24T22:04:09.028937] [DEBUG] [LOCAL ] WEC: Trimmed 75473 records to 52208 (keeping 200 days of data) [2025-09-24T22:04:09.028774] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-24T22:04:09.374571] [DEBUG] [LOCAL ] WEC: Primary data saved (52208 records). [2025-09-24T22:04:09.374748] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-24T22:04:09.374848] [INFO ] [MAIN ] Update Progress: 2286/2373 symbols completed. WEC took 35.5s. Estimated remaining: 11m 34s. Rate: 7.5 symbols/min [2025-09-24T22:04:09.583949] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:09.602861] [DEBUG] [LOCAL ] WF: Loaded 10870 existing records from primary storage. [2025-09-24T22:04:09.603068] [INFO ] [MAIN ] WF: Loaded 10870 existing records. [2025-09-24T22:04:09.621343] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-24T22:04:09.804236] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:09.804490] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-24T22:04:09.804539] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-24T22:04:09.805051] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-24T22:04:09.805115] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-24T22:04:10.162755] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:10.379597] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T22:04:10.416042] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-24T22:04:11.216109] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-24T22:04:11.278566] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T22:04:12.016085] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-24T22:04:12.090609] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T22:04:12.229329] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T22:04:12.816117] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-24T22:04:13.616056] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-24T22:04:13.729719] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T22:04:14.287710] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T22:04:14.416047] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-24T22:04:15.139388] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T22:04:15.216111] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-24T22:04:15.581514] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-24T22:04:16.016117] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-24T22:04:16.054073] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T22:04:16.816129] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-24T22:04:17.616064] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-24T22:04:17.666069] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-24T22:04:17.919317] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-24T22:04:17.934107] [INFO ] [REMOTE ] WES: Full fetch complete (69753 records). [2025-09-24T22:04:17.934443] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-24T22:04:18.358603] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-24T22:04:18.358734] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-24T22:04:18.359932] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-24T22:04:18.360035] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-24T22:04:18.362041] [DEBUG] [LOCAL ] WES: Trimmed 69753 records to 48003 (keeping 200 days of data) [2025-09-24T22:04:18.420762] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-24T22:04:18.674297] [DEBUG] [LOCAL ] WES: Primary data saved (48003 records). [2025-09-24T22:04:18.674563] [INFO ] [MAIN ] WES: Full history saved. [2025-09-24T22:04:18.674768] [INFO ] [MAIN ] Update Progress: 2287/2373 symbols completed. WES took 30.5s. Estimated remaining: 11m 26s. Rate: 7.5 symbols/min [2025-09-24T22:04:18.879049] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:18.905882] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T22:04:18.996528] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-24T22:04:19.007002] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-24T22:04:19.007506] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-24T22:04:19.081306] [INFO ] [REMOTE ] WELL: Full fetch complete (75725 records). [2025-09-24T22:04:19.103699] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-24T22:04:19.230475] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-24T22:04:19.349511] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:19.372026] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-24T22:04:19.372491] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-24T22:04:19.379923] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-24T22:04:19.393873] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-24T22:04:19.928084] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-24T22:04:19.946671] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-24T22:04:19.948945] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-24T22:04:19.949770] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-24T22:04:20.018269] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-24T22:04:20.030906] [DEBUG] [LOCAL ] WELL: Trimmed 75725 records to 52356 (keeping 200 days of data) [2025-09-24T22:04:20.076126] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:20.442941] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T22:04:20.620837] [DEBUG] [LOCAL ] WELL: Primary data saved (52356 records). [2025-09-24T22:04:20.621069] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-24T22:04:20.621281] [INFO ] [MAIN ] Update Progress: 2288/2373 symbols completed. WELL took 41.1s. Estimated remaining: 11m 18s. Rate: 7.5 symbols/min [2025-09-24T22:04:20.821293] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-24T22:04:20.906264] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:20.919463] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-24T22:04:20.955281] [DEBUG] [LOCAL ] WFG: Loaded 24918 existing records from primary storage. [2025-09-24T22:04:20.955482] [INFO ] [MAIN ] WFG: Loaded 24918 existing records. [2025-09-24T22:04:21.196689] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:21.197017] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-24T22:04:21.197073] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-24T22:04:21.197781] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-24T22:04:21.197845] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-24T22:04:21.547709] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:21.616065] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-24T22:04:22.240305] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T22:04:22.249161] [INFO ] [REMOTE ] WEX: Full fetch complete (50887 records). [2025-09-24T22:04:22.249281] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-24T22:04:22.422279] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-24T22:04:22.644470] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-24T22:04:22.644583] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-24T22:04:22.645695] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-24T22:04:22.645892] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-24T22:04:22.664055] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-24T22:04:22.668392] [DEBUG] [LOCAL ] WEX: Trimmed 50887 records to 35325 (keeping 200 days of data) [2025-09-24T22:04:22.909902] [DEBUG] [LOCAL ] WEX: Primary data saved (35325 records). [2025-09-24T22:04:22.910064] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-24T22:04:22.910156] [INFO ] [MAIN ] Update Progress: 2289/2373 symbols completed. WEX took 27.9s. Estimated remaining: 11m 10s. Rate: 7.5 symbols/min [2025-09-24T22:04:23.091676] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:23.134434] [DEBUG] [LOCAL ] WGO: Loaded 39379 existing records from primary storage. [2025-09-24T22:04:23.134600] [INFO ] [MAIN ] WGO: Loaded 39379 existing records. [2025-09-24T22:04:23.223000] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-24T22:04:23.324442] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:23.330963] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-24T22:04:23.330783] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-24T22:04:23.331130] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-24T22:04:23.335699] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-24T22:04:23.335805] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-24T22:04:23.686782] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:24.016097] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-24T22:04:24.234003] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-24T22:04:24.816122] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-24T22:04:25.567684] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T22:04:25.616033] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-24T22:04:26.089940] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T22:04:26.416112] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-24T22:04:27.216074] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-24T22:04:27.301224] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-24T22:04:28.016061] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-24T22:04:28.154436] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T22:04:28.316973] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-24T22:04:28.816127] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-24T22:04:29.501592] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T22:04:29.519591] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-24T22:04:29.616108] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-24T22:04:30.416079] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-24T22:04:30.931831] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-24T22:04:31.222697] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-24T22:04:31.230111] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-24T22:04:32.016089] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-24T22:04:32.816149] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-24T22:04:33.064261] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-24T22:04:33.373859] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T22:04:33.616081] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-24T22:04:34.157949] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T22:04:34.170607] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-24T22:04:34.416107] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-24T22:04:35.216092] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-24T22:04:35.757028] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-24T22:04:35.759299] [INFO ] [REMOTE ] WF: Full fetch complete (16662 records). [2025-09-24T22:04:35.759414] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-24T22:04:35.969780] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-24T22:04:36.026928] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-24T22:04:36.179982] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-24T22:04:36.180084] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-24T22:04:36.180482] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-24T22:04:36.180522] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-24T22:04:36.181132] [DEBUG] [LOCAL ] WF: Trimmed 16662 records to 10830 (keeping 200 days of data) [2025-09-24T22:04:36.254805] [DEBUG] [LOCAL ] WF: Primary data saved (10830 records). [2025-09-24T22:04:36.254952] [INFO ] [MAIN ] WF: Full history saved. [2025-09-24T22:04:36.255100] [INFO ] [MAIN ] Update Progress: 2290/2373 symbols completed. WF took 26.9s. Estimated remaining: 11m 2s. Rate: 7.5 symbols/min [2025-09-24T22:04:36.423484] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:36.482674] [DEBUG] [LOCAL ] WH: Loaded 45807 existing records from primary storage. [2025-09-24T22:04:36.483065] [INFO ] [MAIN ] WH: Loaded 45807 existing records. [2025-09-24T22:04:36.660103] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:36.660585] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-24T22:04:36.660710] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-24T22:04:36.662372] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-24T22:04:36.662448] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-24T22:04:36.819023] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-24T22:04:37.044127] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:37.616055] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-24T22:04:37.983574] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-24T22:04:38.041059] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-24T22:04:38.416098] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-24T22:04:38.889623] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-24T22:04:39.216055] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-24T22:04:39.647908] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T22:04:40.016130] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-24T22:04:40.643547] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-24T22:04:40.816088] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-24T22:04:41.616101] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-24T22:04:42.096261] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-24T22:04:42.169485] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T22:04:42.416076] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-24T22:04:42.835981] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-24T22:04:43.216074] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-24T22:04:43.583700] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-24T22:04:44.016093] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-24T22:04:44.505344] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-24T22:04:44.816091] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-24T22:04:45.616106] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-24T22:04:46.277753] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-24T22:04:46.337414] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-24T22:04:46.416095] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-24T22:04:46.762290] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-24T22:04:47.216172] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-24T22:04:47.493593] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T22:04:47.500413] [INFO ] [REMOTE ] WGO: Full fetch complete (57360 records). [2025-09-24T22:04:47.500590] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-24T22:04:47.893905] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-24T22:04:47.893995] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-24T22:04:47.895049] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-24T22:04:47.895112] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-24T22:04:47.896321] [DEBUG] [LOCAL ] WGO: Trimmed 57360 records to 39309 (keeping 200 days of data) [2025-09-24T22:04:48.020837] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-24T22:04:48.146861] [DEBUG] [LOCAL ] WGO: Primary data saved (39309 records). [2025-09-24T22:04:48.147209] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-24T22:04:48.147366] [INFO ] [MAIN ] Update Progress: 2291/2373 symbols completed. WGO took 25.2s. Estimated remaining: 10m 54s. Rate: 7.5 symbols/min [2025-09-24T22:04:48.317962] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:48.357447] [DEBUG] [LOCAL ] WHD: Loaded 40569 existing records from primary storage. [2025-09-24T22:04:48.357599] [INFO ] [MAIN ] WHD: Loaded 40569 existing records. [2025-09-24T22:04:48.540132] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:48.540566] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-24T22:04:48.540681] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-24T22:04:48.549771] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-24T22:04:48.562905] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-24T22:04:48.572906] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T22:04:48.824684] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-24T22:04:48.975205] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:49.616168] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-24T22:04:49.827458] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T22:04:50.416120] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-24T22:04:50.796746] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T22:04:50.821067] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T22:04:50.825909] [INFO ] [REMOTE ] WFG: Full fetch complete (35767 records). [2025-09-24T22:04:50.826000] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-24T22:04:51.201261] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-24T22:04:51.201355] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-24T22:04:51.202127] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-24T22:04:51.202188] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-24T22:04:51.203024] [DEBUG] [LOCAL ] WFG: Trimmed 35767 records to 24893 (keeping 200 days of data) [2025-09-24T22:04:51.256293] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-24T22:04:51.361658] [DEBUG] [LOCAL ] WFG: Primary data saved (24893 records). [2025-09-24T22:04:51.361801] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-24T22:04:51.361930] [INFO ] [MAIN ] Update Progress: 2292/2373 symbols completed. WFG took 30.7s. Estimated remaining: 10m 46s. Rate: 7.5 symbols/min [2025-09-24T22:04:51.530155] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:04:51.535594] [DEBUG] [LOCAL ] WHG: Loaded 3395 existing records from primary storage. [2025-09-24T22:04:51.535720] [INFO ] [MAIN ] WHG: Loaded 3395 existing records. [2025-09-24T22:04:51.721019] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:04:51.721392] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-24T22:04:51.721447] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-24T22:04:51.721885] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-24T22:04:51.721949] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-24T22:04:52.022286] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-24T22:04:52.110399] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:04:52.458811] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-24T22:04:52.801765] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-24T22:04:52.816054] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-24T22:04:53.616122] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-24T22:04:53.663339] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-24T22:04:53.984883] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T22:04:54.225501] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-24T22:04:54.416102] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-24T22:04:54.912099] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-24T22:04:55.216120] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-24T22:04:55.819066] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-24T22:04:56.016091] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-24T22:04:56.816149] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-24T22:04:57.554293] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T22:04:57.616056] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-24T22:04:58.416195] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-24T22:04:59.040524] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-24T22:04:59.114747] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-24T22:04:59.118697] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-24T22:04:59.216085] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-24T22:05:00.016082] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-24T22:05:00.816077] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-24T22:05:00.974518] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T22:05:01.448398] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-24T22:05:01.616199] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-24T22:05:01.640403] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-24T22:05:02.416103] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-24T22:05:03.042547] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T22:05:03.216096] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-24T22:05:03.886744] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-24T22:05:04.016086] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-24T22:05:04.786056] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-24T22:05:04.798167] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-24T22:05:04.798331] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-24T22:05:04.822923] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-24T22:05:05.163981] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-24T22:05:05.282130] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-24T22:05:05.282239] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-24T22:05:05.283488] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-24T22:05:05.283552] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-24T22:05:05.285129] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-09-24T22:05:05.616379] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-24T22:05:05.640876] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-24T22:05:05.641025] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-24T22:05:05.641144] [INFO ] [MAIN ] Update Progress: 2293/2373 symbols completed. WFC took 47.0s. Estimated remaining: 10m 39s. Rate: 7.5 symbols/min [2025-09-24T22:05:05.809253] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:05.858197] [DEBUG] [LOCAL ] WHR: Loaded 48114 existing records from primary storage. [2025-09-24T22:05:05.858337] [INFO ] [MAIN ] WHR: Loaded 48114 existing records. [2025-09-24T22:05:06.045019] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:06.045302] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-24T22:05:06.045357] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-24T22:05:06.046801] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-24T22:05:06.046863] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-24T22:05:06.416251] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:06.416406] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-24T22:05:06.442549] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-24T22:05:07.124846] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-24T22:05:07.216191] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-24T22:05:07.314185] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T22:05:08.016156] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-24T22:05:08.712438] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T22:05:08.720335] [INFO ] [REMOTE ] WH: Full fetch complete (64978 records). [2025-09-24T22:05:08.720461] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-24T22:05:08.821622] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-24T22:05:09.164098] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-24T22:05:09.164242] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-24T22:05:09.165674] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-24T22:05:09.165796] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-24T22:05:09.167611] [DEBUG] [LOCAL ] WH: Trimmed 64978 records to 45708 (keeping 200 days of data) [2025-09-24T22:05:09.344068] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-24T22:05:09.547432] [DEBUG] [LOCAL ] WH: Primary data saved (45708 records). [2025-09-24T22:05:09.547570] [INFO ] [MAIN ] WH: Full history saved. [2025-09-24T22:05:09.547686] [INFO ] [MAIN ] Update Progress: 2294/2373 symbols completed. WH took 33.3s. Estimated remaining: 10m 30s. Rate: 7.5 symbols/min [2025-09-24T22:05:09.621915] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-24T22:05:09.719705] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:09.726191] [DEBUG] [LOCAL ] WIA: Loaded 4863 existing records from primary storage. [2025-09-24T22:05:09.726285] [INFO ] [MAIN ] WIA: Loaded 4863 existing records. [2025-09-24T22:05:09.902975] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:09.903211] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-24T22:05:09.903269] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-24T22:05:09.903515] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-24T22:05:09.903575] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-24T22:05:10.264013] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:10.268327] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T22:05:10.416048] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-24T22:05:10.567829] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-24T22:05:10.804294] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-24T22:05:11.216085] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-24T22:05:12.016082] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-24T22:05:12.658453] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-24T22:05:12.816251] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-24T22:05:12.959447] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-24T22:05:13.250512] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-24T22:05:13.616207] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-24T22:05:13.984700] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-24T22:05:14.416193] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-24T22:05:15.216155] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-24T22:05:15.745676] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-24T22:05:15.771103] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-24T22:05:16.016118] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-24T22:05:16.641139] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-24T22:05:16.816096] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-24T22:05:17.250483] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-24T22:05:17.616122] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-24T22:05:18.416078] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-24T22:05:19.193575] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-24T22:05:19.216030] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-24T22:05:19.972114] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-24T22:05:20.016086] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-24T22:05:20.816138] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-24T22:05:21.060844] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-24T22:05:21.492459] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-24T22:05:21.517723] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T22:05:21.616052] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-24T22:05:22.416080] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-24T22:05:23.063198] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-24T22:05:23.085293] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-24T22:05:23.092594] [INFO ] [REMOTE ] WHD: Full fetch complete (57158 records). [2025-09-24T22:05:23.092779] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-24T22:05:23.221193] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-24T22:05:23.498542] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-24T22:05:23.498622] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-24T22:05:23.499720] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-24T22:05:23.499783] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-24T22:05:23.501298] [DEBUG] [LOCAL ] WHD: Trimmed 57158 records to 40532 (keeping 200 days of data) [2025-09-24T22:05:23.765101] [DEBUG] [LOCAL ] WHD: Primary data saved (40532 records). [2025-09-24T22:05:23.765230] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-24T22:05:23.765312] [INFO ] [MAIN ] Update Progress: 2295/2373 symbols completed. WHD took 35.6s. Estimated remaining: 10m 23s. Rate: 7.5 symbols/min [2025-09-24T22:05:23.952878] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:23.966194] [DEBUG] [LOCAL ] WINN: Loaded 11865 existing records from primary storage. [2025-09-24T22:05:23.966345] [INFO ] [MAIN ] WINN: Loaded 11865 existing records. [2025-09-24T22:05:24.028856] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-24T22:05:24.148683] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:24.148977] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-24T22:05:24.149028] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-24T22:05:24.149506] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-24T22:05:24.149568] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-24T22:05:24.521586] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:24.694556] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T22:05:24.816089] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-24T22:05:24.979175] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T22:05:25.616085] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-24T22:05:25.858246] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-24T22:05:26.022268] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-24T22:05:26.023610] [INFO ] [REMOTE ] WHG: Full fetch complete (4665 records). [2025-09-24T22:05:26.023740] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-24T22:05:26.434393] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-24T22:05:26.443002] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-24T22:05:26.443948] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-24T22:05:26.444208] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-24T22:05:26.444270] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-24T22:05:26.444938] [DEBUG] [LOCAL ] WHG: Trimmed 4665 records to 3384 (keeping 200 days of data) [2025-09-24T22:05:26.468346] [DEBUG] [LOCAL ] WHG: Primary data saved (3384 records). [2025-09-24T22:05:26.468493] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-24T22:05:26.468584] [INFO ] [MAIN ] Update Progress: 2296/2373 symbols completed. WHG took 35.1s. Estimated remaining: 10m 14s. Rate: 7.5 symbols/min [2025-09-24T22:05:26.649498] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:26.703904] [DEBUG] [LOCAL ] WIT: Loaded 52285 existing records from primary storage. [2025-09-24T22:05:26.704089] [INFO ] [MAIN ] WIT: Loaded 52285 existing records. [2025-09-24T22:05:26.885610] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:26.885928] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-24T22:05:26.885982] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-24T22:05:26.887130] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-24T22:05:26.887191] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-24T22:05:27.220338] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-24T22:05:27.257881] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:27.345339] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T22:05:27.958234] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T22:05:27.960044] [INFO ] [REMOTE ] WIA: Full fetch complete (7288 records). [2025-09-24T22:05:27.960162] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-24T22:05:28.022196] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-24T22:05:28.324943] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-24T22:05:28.325027] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-24T22:05:28.325263] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-24T22:05:28.325302] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-24T22:05:28.325740] [DEBUG] [LOCAL ] WIA: Trimmed 7288 records to 4865 (keeping 200 days of data) [2025-09-24T22:05:28.355118] [DEBUG] [LOCAL ] WIA: Primary data saved (4865 records). [2025-09-24T22:05:28.355210] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-24T22:05:28.355290] [INFO ] [MAIN ] Update Progress: 2297/2373 symbols completed. WIA took 18.8s. Estimated remaining: 10m 6s. Rate: 7.5 symbols/min [2025-09-24T22:05:28.527946] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:28.548224] [DEBUG] [LOCAL ] WIW: Loaded 20769 existing records from primary storage. [2025-09-24T22:05:28.548371] [INFO ] [MAIN ] WIW: Loaded 20769 existing records. [2025-09-24T22:05:28.725801] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:28.726065] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-24T22:05:28.726114] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-24T22:05:28.727311] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-24T22:05:28.727373] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-24T22:05:28.824246] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-24T22:05:29.083623] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:29.616102] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-24T22:05:29.663483] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-24T22:05:29.905263] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T22:05:30.416089] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-24T22:05:31.216110] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-24T22:05:31.293218] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-24T22:05:31.461760] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-24T22:05:32.016081] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-24T22:05:32.377735] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-24T22:05:32.816079] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-24T22:05:33.616084] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-24T22:05:33.789810] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-24T22:05:34.416091] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-24T22:05:34.597833] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-24T22:05:34.695688] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-24T22:05:35.216101] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-24T22:05:36.016105] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-24T22:05:36.057434] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T22:05:36.184829] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-24T22:05:36.816117] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-24T22:05:37.073421] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-24T22:05:37.431626] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T22:05:37.616106] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-24T22:05:38.416100] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-24T22:05:38.595809] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-24T22:05:39.200544] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-24T22:05:39.216036] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-24T22:05:40.013378] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-24T22:05:40.016066] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-24T22:05:40.816082] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-24T22:05:41.602748] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-24T22:05:41.605368] [INFO ] [REMOTE ] WINN: Full fetch complete (17702 records). [2025-09-24T22:05:41.605447] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-24T22:05:41.621246] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-24T22:05:41.998564] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-24T22:05:41.998794] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-24T22:05:41.999324] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-24T22:05:41.999462] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-24T22:05:42.000573] [DEBUG] [LOCAL ] WINN: Trimmed 17702 records to 11834 (keeping 200 days of data) [2025-09-24T22:05:42.082328] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-24T22:05:42.114368] [DEBUG] [LOCAL ] WINN: Primary data saved (11834 records). [2025-09-24T22:05:42.114505] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-24T22:05:42.114591] [INFO ] [MAIN ] Update Progress: 2298/2373 symbols completed. WINN took 18.3s. Estimated remaining: 9m 59s. Rate: 7.5 symbols/min [2025-09-24T22:05:42.287071] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:42.327623] [DEBUG] [LOCAL ] WK: Loaded 36653 existing records from primary storage. [2025-09-24T22:05:42.327796] [INFO ] [MAIN ] WK: Loaded 36653 existing records. [2025-09-24T22:05:42.420074] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-24T22:05:42.513668] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:42.514111] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-24T22:05:42.514195] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-24T22:05:42.525256] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-24T22:05:42.525965] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-24T22:05:42.526385] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-24T22:05:42.897333] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:43.216088] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-24T22:05:44.016062] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-24T22:05:44.232340] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T22:05:44.816074] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-24T22:05:45.061891] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T22:05:45.089811] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-24T22:05:45.616115] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-24T22:05:46.416106] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-24T22:05:46.557936] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T22:05:46.566810] [INFO ] [REMOTE ] WHR: Full fetch complete (68378 records). [2025-09-24T22:05:46.566992] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-24T22:05:46.764340] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-24T22:05:46.984595] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-24T22:05:46.984708] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-24T22:05:46.985884] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-24T22:05:46.985951] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-24T22:05:46.987407] [DEBUG] [LOCAL ] WHR: Trimmed 68378 records to 48110 (keeping 200 days of data) [2025-09-24T22:05:47.216137] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-24T22:05:47.298969] [DEBUG] [LOCAL ] WHR: Primary data saved (48110 records). [2025-09-24T22:05:47.299134] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-24T22:05:47.299255] [INFO ] [MAIN ] Update Progress: 2299/2373 symbols completed. WHR took 41.7s. Estimated remaining: 9m 50s. Rate: 7.5 symbols/min [2025-09-24T22:05:47.475094] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:05:47.490241] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-24T22:05:47.528175] [DEBUG] [LOCAL ] WKC: Loaded 35151 existing records from primary storage. [2025-09-24T22:05:47.528338] [INFO ] [MAIN ] WKC: Loaded 35151 existing records. [2025-09-24T22:05:47.705116] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:05:47.705420] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-24T22:05:47.705472] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-24T22:05:47.706432] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-24T22:05:47.706492] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-24T22:05:48.023002] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-24T22:05:48.066995] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:05:48.627051] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T22:05:48.816112] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-24T22:05:49.616173] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-24T22:05:49.816454] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-24T22:05:49.881773] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-24T22:05:50.416105] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-24T22:05:51.218296] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-24T22:05:51.223218] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-24T22:05:51.380764] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T22:05:52.016081] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-24T22:05:52.816082] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-24T22:05:52.985617] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T22:05:53.428145] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T22:05:53.616086] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-24T22:05:54.293803] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T22:05:54.416085] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-24T22:05:55.227696] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-24T22:05:55.234139] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T22:05:55.982115] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T22:05:56.016061] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-24T22:05:56.059736] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-24T22:05:56.816082] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-24T22:05:57.616118] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-24T22:05:57.889812] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-24T22:05:57.915111] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T22:05:58.416111] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-24T22:05:59.116506] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T22:05:59.216136] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-24T22:05:59.548371] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T22:05:59.552625] [INFO ] [REMOTE ] WIW: Full fetch complete (30379 records). [2025-09-24T22:05:59.552743] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-24T22:05:59.943230] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-24T22:05:59.943316] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-24T22:05:59.943975] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-24T22:05:59.944037] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-24T22:05:59.944982] [DEBUG] [LOCAL ] WIW: Trimmed 30379 records to 20625 (keeping 200 days of data) [2025-09-24T22:06:00.032560] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-24T22:06:00.074922] [DEBUG] [LOCAL ] WIW: Primary data saved (20625 records). [2025-09-24T22:06:00.075056] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-24T22:06:00.075141] [INFO ] [MAIN ] Update Progress: 2300/2373 symbols completed. WIW took 31.7s. Estimated remaining: 9m 43s. Rate: 7.5 symbols/min [2025-09-24T22:06:00.248007] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:00.291300] [DEBUG] [LOCAL ] WLK: Loaded 45411 existing records from primary storage. [2025-09-24T22:06:00.291474] [INFO ] [MAIN ] WLK: Loaded 45411 existing records. [2025-09-24T22:06:00.475602] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:00.493752] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-24T22:06:00.494017] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-24T22:06:00.495490] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T22:06:00.495569] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-24T22:06:00.502253] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-24T22:06:00.824140] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-24T22:06:00.867838] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:01.056013] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-24T22:06:01.616103] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-24T22:06:02.416159] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-24T22:06:02.886041] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-24T22:06:03.216080] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-24T22:06:04.016069] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-24T22:06:04.347421] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-24T22:06:04.419444] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-24T22:06:04.816075] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-24T22:06:04.970588] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T22:06:05.616060] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-24T22:06:05.667338] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-24T22:06:06.312176] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T22:06:06.322180] [INFO ] [REMOTE ] WIT: Full fetch complete (75576 records). [2025-09-24T22:06:06.322332] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-24T22:06:06.424072] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-24T22:06:06.749446] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-24T22:06:06.749636] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-24T22:06:06.751452] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-24T22:06:06.751532] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-24T22:06:06.753934] [DEBUG] [LOCAL ] WIT: Trimmed 75576 records to 52291 (keeping 200 days of data) [2025-09-24T22:06:07.114589] [DEBUG] [LOCAL ] WIT: Primary data saved (52291 records). [2025-09-24T22:06:07.115041] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-24T22:06:07.115703] [INFO ] [MAIN ] Update Progress: 2301/2373 symbols completed. WIT took 40.6s. Estimated remaining: 9m 35s. Rate: 7.5 symbols/min [2025-09-24T22:06:07.117109] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T22:06:07.218358] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-24T22:06:07.303956] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:07.313280] [DEBUG] [LOCAL ] WLKP: Loaded 6653 existing records from primary storage. [2025-09-24T22:06:07.313407] [INFO ] [MAIN ] WLKP: Loaded 6653 existing records. [2025-09-24T22:06:07.508591] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:07.508868] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-24T22:06:07.508916] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-24T22:06:07.509330] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-24T22:06:07.509390] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-24T22:06:07.890789] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:07.954924] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T22:06:08.016066] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-24T22:06:08.457606] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-24T22:06:08.743832] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-24T22:06:08.816129] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-24T22:06:09.616093] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-24T22:06:10.193740] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-24T22:06:10.416080] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-24T22:06:10.618399] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-24T22:06:10.904204] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-24T22:06:11.216085] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-24T22:06:11.764774] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-24T22:06:12.016082] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-24T22:06:12.571321] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T22:06:12.816111] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-24T22:06:13.616089] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-24T22:06:13.859192] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-24T22:06:14.416078] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-24T22:06:15.219599] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-24T22:06:15.232309] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-24T22:06:15.804182] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-24T22:06:16.017018] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-24T22:06:16.018736] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-24T22:06:16.816078] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-24T22:06:17.616084] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-24T22:06:18.176337] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-24T22:06:18.269715] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T22:06:18.416094] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-24T22:06:19.064073] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T22:06:19.071553] [INFO ] [REMOTE ] WK: Full fetch complete (52017 records). [2025-09-24T22:06:19.071700] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-24T22:06:19.222328] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-24T22:06:19.459426] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-24T22:06:19.459512] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-24T22:06:19.460524] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-24T22:06:19.460587] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-24T22:06:19.461730] [DEBUG] [LOCAL ] WK: Trimmed 52017 records to 36687 (keeping 200 days of data) [2025-09-24T22:06:19.704359] [DEBUG] [LOCAL ] WK: Primary data saved (36687 records). [2025-09-24T22:06:19.704589] [INFO ] [MAIN ] WK: Full history saved. [2025-09-24T22:06:19.705069] [INFO ] [MAIN ] Update Progress: 2302/2373 symbols completed. WK took 37.6s. Estimated remaining: 9m 27s. Rate: 7.5 symbols/min [2025-09-24T22:06:19.706924] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-24T22:06:19.758520] [INFO ] [REMOTE ] WKC: Full fetch complete (51357 records). [2025-09-24T22:06:19.785385] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-24T22:06:20.021293] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-24T22:06:20.021226] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:20.051255] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-24T22:06:20.097301] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-24T22:06:20.171802] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-24T22:06:20.187814] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-24T22:06:20.198475] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-24T22:06:20.198539] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-24T22:06:20.460282] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-24T22:06:20.521766] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-24T22:06:20.537405] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-24T22:06:20.572331] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-24T22:06:20.621136] [DEBUG] [LOCAL ] WKC: Trimmed 51357 records to 35109 (keeping 200 days of data) [2025-09-24T22:06:20.697128] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:20.757304] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-24T22:06:20.816063] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-24T22:06:20.944078] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T22:06:20.967160] [DEBUG] [LOCAL ] WKC: Primary data saved (35109 records). [2025-09-24T22:06:20.967737] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-24T22:06:20.967847] [INFO ] [MAIN ] Update Progress: 2303/2373 symbols completed. WKC took 33.7s. Estimated remaining: 9m 19s. Rate: 7.5 symbols/min [2025-09-24T22:06:21.138115] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:21.169708] [DEBUG] [LOCAL ] WLY: Loaded 30209 existing records from primary storage. [2025-09-24T22:06:21.169878] [INFO ] [MAIN ] WLY: Loaded 30209 existing records. [2025-09-24T22:06:21.350230] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:21.350477] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-24T22:06:21.350526] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-24T22:06:21.351328] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-24T22:06:21.351388] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-24T22:06:21.492184] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-24T22:06:21.621323] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-24T22:06:21.727863] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:22.014538] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-24T22:06:22.416105] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-24T22:06:23.216103] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-24T22:06:23.905590] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T22:06:23.907845] [INFO ] [REMOTE ] WLKP: Full fetch complete (10223 records). [2025-09-24T22:06:23.907935] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-24T22:06:24.026428] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-24T22:06:24.475540] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-24T22:06:24.489805] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-24T22:06:24.529246] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-24T22:06:24.521298] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-24T22:06:24.540962] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-24T22:06:24.541627] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-24T22:06:24.549277] [DEBUG] [LOCAL ] WLKP: Trimmed 10223 records to 6685 (keeping 200 days of data) [2025-09-24T22:06:24.620228] [DEBUG] [LOCAL ] WLKP: Primary data saved (6685 records). [2025-09-24T22:06:24.620428] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-24T22:06:24.620604] [INFO ] [MAIN ] Update Progress: 2304/2373 symbols completed. WLKP took 17.5s. Estimated remaining: 9m 10s. Rate: 7.5 symbols/min [2025-09-24T22:06:24.824851] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-24T22:06:24.936772] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:25.024947] [DEBUG] [LOCAL ] WM: Loaded 50959 existing records from primary storage. [2025-09-24T22:06:25.025180] [INFO ] [MAIN ] WM: Loaded 50959 existing records. [2025-09-24T22:06:25.245999] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-24T22:06:25.253200] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:25.254517] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-24T22:06:25.254569] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-24T22:06:25.256194] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-24T22:06:25.256258] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-24T22:06:25.618529] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:25.618603] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-24T22:06:26.038864] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-24T22:06:26.416083] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-24T22:06:26.845495] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-24T22:06:27.216091] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-24T22:06:28.016090] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-24T22:06:28.816082] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-24T22:06:29.112034] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T22:06:29.616060] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-24T22:06:29.645194] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T22:06:29.990362] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-24T22:06:30.201357] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-24T22:06:30.416080] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-24T22:06:31.216113] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-24T22:06:32.016136] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-24T22:06:32.181258] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-24T22:06:32.526302] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-24T22:06:32.816136] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-24T22:06:33.616074] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-24T22:06:33.943607] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-24T22:06:33.962245] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-24T22:06:34.170417] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-24T22:06:34.416093] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-24T22:06:35.216141] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-24T22:06:35.942778] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T22:06:36.016122] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-24T22:06:36.816134] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-24T22:06:37.004382] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-24T22:06:37.616069] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-24T22:06:37.666342] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T22:06:38.038358] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-24T22:06:38.083025] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T22:06:38.416086] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-24T22:06:39.216108] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-24T22:06:39.452208] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T22:06:39.564300] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-24T22:06:39.565180] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-09-24T22:06:39.565249] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-24T22:06:39.741887] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T22:06:39.742048] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-24T22:06:39.742094] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-24T22:06:39.742141] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-24T22:06:39.742196] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-24T22:06:39.742232] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-24T22:06:39.742272] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-24T22:06:39.742328] [INFO ] [MAIN ] Update Progress: 2305/2373 symbols completed. WLTG took 20.0s. Estimated remaining: 9m 3s. Rate: 7.5 symbols/min [2025-09-24T22:06:39.909434] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:39.968673] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-24T22:06:39.968820] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-24T22:06:40.021318] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-24T22:06:40.150294] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:40.150530] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-24T22:06:40.150578] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-24T22:06:40.151938] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-24T22:06:40.152000] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-24T22:06:40.519768] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:40.816164] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-24T22:06:41.486800] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T22:06:41.616110] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-24T22:06:42.416145] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-24T22:06:42.707057] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T22:06:43.216147] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-24T22:06:43.260688] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T22:06:43.272233] [INFO ] [REMOTE ] WLK: Full fetch complete (62748 records). [2025-09-24T22:06:43.272542] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-24T22:06:43.698230] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-24T22:06:43.698361] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-24T22:06:43.700213] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-24T22:06:43.700307] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-24T22:06:43.703766] [DEBUG] [LOCAL ] WLK: Trimmed 62748 records to 45404 (keeping 200 days of data) [2025-09-24T22:06:44.017168] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-24T22:06:44.030551] [DEBUG] [LOCAL ] WLK: Primary data saved (45404 records). [2025-09-24T22:06:44.030843] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-24T22:06:44.031104] [INFO ] [MAIN ] Update Progress: 2306/2373 symbols completed. WLK took 44.0s. Estimated remaining: 8m 55s. Rate: 7.5 symbols/min [2025-09-24T22:06:44.215264] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:44.235288] [DEBUG] [LOCAL ] WMK: Loaded 14549 existing records from primary storage. [2025-09-24T22:06:44.235468] [INFO ] [MAIN ] WMK: Loaded 14549 existing records. [2025-09-24T22:06:44.481226] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-24T22:06:44.476805] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:44.494896] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-24T22:06:44.495078] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-24T22:06:44.495916] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-24T22:06:44.495985] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-24T22:06:44.763109] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T22:06:44.822745] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-24T22:06:44.951434] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:45.616152] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-24T22:06:45.868440] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T22:06:46.352628] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T22:06:46.416099] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-24T22:06:46.491159] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-24T22:06:47.216094] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-24T22:06:48.016140] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-24T22:06:48.057890] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-24T22:06:48.440231] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-24T22:06:48.816165] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-24T22:06:49.616053] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-24T22:06:49.861069] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-24T22:06:50.416056] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-24T22:06:50.682852] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-24T22:06:50.720814] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-24T22:06:51.216127] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-24T22:06:52.016058] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-24T22:06:52.028561] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-24T22:06:52.164270] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T22:06:52.816087] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-24T22:06:53.116226] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T22:06:53.616101] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-24T22:06:53.826776] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-24T22:06:54.416102] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-24T22:06:54.800939] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-24T22:06:54.808511] [INFO ] [REMOTE ] WLY: Full fetch complete (43184 records). [2025-09-24T22:06:54.808680] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-24T22:06:55.201511] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-24T22:06:55.201606] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-24T22:06:55.202539] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-24T22:06:55.202630] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-24T22:06:55.203833] [DEBUG] [LOCAL ] WLY: Trimmed 43184 records to 30036 (keeping 200 days of data) [2025-09-24T22:06:55.266370] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-24T22:06:55.400329] [DEBUG] [LOCAL ] WLY: Primary data saved (30036 records). [2025-09-24T22:06:55.400477] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-24T22:06:55.400622] [INFO ] [MAIN ] Update Progress: 2307/2373 symbols completed. WLY took 34.4s. Estimated remaining: 8m 47s. Rate: 7.5 symbols/min [2025-09-24T22:06:55.596894] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:06:55.648160] [DEBUG] [LOCAL ] WMS: Loaded 39642 existing records from primary storage. [2025-09-24T22:06:55.648305] [INFO ] [MAIN ] WMS: Loaded 39642 existing records. [2025-09-24T22:06:55.838355] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:06:55.838753] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-24T22:06:55.838821] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-24T22:06:55.840008] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-24T22:06:55.840085] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-24T22:06:56.018935] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-24T22:06:56.221505] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:06:56.363809] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-24T22:06:56.604696] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-24T22:06:56.816094] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-24T22:06:57.616099] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-24T22:06:58.080231] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-24T22:06:58.354262] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-24T22:06:58.416043] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-24T22:06:58.751580] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-24T22:06:59.056058] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-24T22:06:59.216148] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-24T22:07:00.016142] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-24T22:07:00.816112] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-24T22:07:01.010424] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-24T22:07:01.020066] [INFO ] [REMOTE ] WM: Full fetch complete (73734 records). [2025-09-24T22:07:01.020242] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-24T22:07:01.467459] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-24T22:07:01.517372] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-24T22:07:01.517465] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-24T22:07:01.518817] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-24T22:07:01.518887] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-24T22:07:01.520307] [DEBUG] [LOCAL ] WM: Trimmed 73734 records to 50956 (keeping 200 days of data) [2025-09-24T22:07:01.621774] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-24T22:07:01.893095] [DEBUG] [LOCAL ] WM: Primary data saved (50956 records). [2025-09-24T22:07:01.893327] [INFO ] [MAIN ] WM: Full history saved. [2025-09-24T22:07:01.893504] [INFO ] [MAIN ] Update Progress: 2308/2373 symbols completed. WM took 37.3s. Estimated remaining: 8m 39s. Rate: 7.5 symbols/min [2025-09-24T22:07:02.078915] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:02.079209] [DEBUG] [LOCAL ] WMT: No existing data file found in primary storage. [2025-09-24T22:07:02.079250] [WARN ] [MAIN ] WMT: No existing data found, performing full refresh instead. [2025-09-24T22:07:02.079484] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-24T22:07:02.079543] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-24T22:07:02.079617] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-24T22:07:02.079703] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-24T22:07:02.419013] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-24T22:07:02.461375] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:02.521775] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T22:07:02.544243] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-24T22:07:03.216101] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-24T22:07:03.934019] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-24T22:07:03.958584] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-24T22:07:04.016063] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-24T22:07:04.816131] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-24T22:07:05.565470] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T22:07:05.616032] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-24T22:07:06.416120] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-24T22:07:07.202155] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-24T22:07:07.216023] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-24T22:07:07.250509] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-24T22:07:08.016062] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-24T22:07:08.402454] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-24T22:07:08.437839] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-24T22:07:08.816095] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-24T22:07:09.616143] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-24T22:07:10.416063] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-24T22:07:10.477965] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-24T22:07:10.534487] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-24T22:07:10.538293] [INFO ] [REMOTE ] WMK: Full fetch complete (19386 records). [2025-09-24T22:07:10.538367] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-24T22:07:10.946156] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-24T22:07:10.946261] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-24T22:07:10.946869] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-24T22:07:10.946949] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-24T22:07:10.947742] [DEBUG] [LOCAL ] WMK: Trimmed 19386 records to 14531 (keeping 200 days of data) [2025-09-24T22:07:11.059742] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-24T22:07:11.090944] [DEBUG] [LOCAL ] WMK: Primary data saved (14531 records). [2025-09-24T22:07:11.091073] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-24T22:07:11.091236] [INFO ] [MAIN ] Update Progress: 2309/2373 symbols completed. WMK took 27.1s. Estimated remaining: 8m 31s. Rate: 7.5 symbols/min [2025-09-24T22:07:11.221173] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-24T22:07:11.267735] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:11.317699] [DEBUG] [LOCAL ] WNC: Loaded 40165 existing records from primary storage. [2025-09-24T22:07:11.317880] [INFO ] [MAIN ] WNC: Loaded 40165 existing records. [2025-09-24T22:07:11.510075] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:11.510390] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-24T22:07:11.510441] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-24T22:07:11.511696] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-24T22:07:11.511761] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-24T22:07:11.918579] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:12.016044] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-24T22:07:12.069767] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:07:12.816087] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-24T22:07:13.331447] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T22:07:13.471639] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-24T22:07:13.616098] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-24T22:07:14.054924] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T22:07:14.416099] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-24T22:07:14.714512] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-24T22:07:15.216082] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-24T22:07:16.016141] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-24T22:07:16.753328] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-24T22:07:16.765103] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T22:07:16.824341] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-24T22:07:16.829780] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T22:07:16.839920] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-24T22:07:16.840077] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-24T22:07:17.307337] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-24T22:07:17.307456] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-24T22:07:17.308886] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-24T22:07:17.308961] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-24T22:07:17.310666] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-24T22:07:17.638321] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-24T22:07:17.847873] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-24T22:07:17.848111] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-24T22:07:17.848259] [INFO ] [MAIN ] Update Progress: 2310/2373 symbols completed. WMB took 38.1s. Estimated remaining: 8m 23s. Rate: 7.5 symbols/min [2025-09-24T22:07:18.094033] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:18.133553] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-24T22:07:18.179744] [DEBUG] [LOCAL ] WNS: Loaded 39966 existing records from primary storage. [2025-09-24T22:07:18.179934] [INFO ] [MAIN ] WNS: Loaded 39966 existing records. [2025-09-24T22:07:18.380628] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:18.381019] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-24T22:07:18.381093] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-24T22:07:18.382222] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-24T22:07:18.382301] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-24T22:07:18.422752] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-24T22:07:18.804218] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:18.833352] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-24T22:07:19.216091] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-24T22:07:20.016066] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-24T22:07:20.186493] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T22:07:20.816129] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-24T22:07:21.616186] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-24T22:07:21.684228] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T22:07:21.857624] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-24T22:07:22.416089] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-24T22:07:22.476949] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-24T22:07:22.564453] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-24T22:07:23.216081] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-24T22:07:24.016096] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-24T22:07:24.501788] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-24T22:07:24.816159] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-24T22:07:25.110595] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-24T22:07:25.524889] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-24T22:07:25.616081] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-24T22:07:26.321598] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T22:07:26.329524] [INFO ] [REMOTE ] WMS: Full fetch complete (57349 records). [2025-09-24T22:07:26.329730] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-24T22:07:26.421404] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-24T22:07:26.727750] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-24T22:07:26.727840] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-24T22:07:26.729132] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-24T22:07:26.729213] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-24T22:07:26.732860] [DEBUG] [LOCAL ] WMS: Trimmed 57349 records to 39665 (keeping 200 days of data) [2025-09-24T22:07:27.001095] [DEBUG] [LOCAL ] WMS: Primary data saved (39665 records). [2025-09-24T22:07:27.001250] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-24T22:07:27.001341] [INFO ] [MAIN ] Update Progress: 2311/2373 symbols completed. WMS took 31.6s. Estimated remaining: 8m 15s. Rate: 7.5 symbols/min [2025-09-24T22:07:27.186237] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:27.215888] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T22:07:27.216075] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-24T22:07:27.275849] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-24T22:07:27.276004] [INFO ] [MAIN ] WOLF: Loaded 53532 existing records. [2025-09-24T22:07:27.453816] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:27.454076] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-24T22:07:27.454124] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-24T22:07:27.455224] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-24T22:07:27.455285] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-24T22:07:27.848104] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:27.860976] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-24T22:07:28.016042] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-24T22:07:28.816116] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-24T22:07:29.616099] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-24T22:07:29.846490] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-24T22:07:30.251538] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-24T22:07:30.308336] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-24T22:07:30.416087] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-24T22:07:30.688329] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T22:07:31.216115] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-24T22:07:31.493144] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-24T22:07:32.016079] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-24T22:07:32.816093] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-24T22:07:32.997594] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T22:07:33.002999] [INFO ] [REMOTE ] WNC: Full fetch complete (57492 records). [2025-09-24T22:07:33.003095] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-24T22:07:33.393413] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-24T22:07:33.393587] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-24T22:07:33.394721] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-24T22:07:33.394870] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-24T22:07:33.396188] [DEBUG] [LOCAL ] WNC: Trimmed 57492 records to 40028 (keeping 200 days of data) [2025-09-24T22:07:33.616771] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-24T22:07:33.658379] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-24T22:07:33.688267] [DEBUG] [LOCAL ] WNC: Primary data saved (40028 records). [2025-09-24T22:07:33.688389] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-24T22:07:33.688480] [INFO ] [MAIN ] Update Progress: 2312/2373 symbols completed. WNC took 22.6s. Estimated remaining: 8m 7s. Rate: 7.5 symbols/min [2025-09-24T22:07:33.856012] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:33.879483] [DEBUG] [LOCAL ] WOR: Loaded 24614 existing records from primary storage. [2025-09-24T22:07:33.879629] [INFO ] [MAIN ] WOR: Loaded 24614 existing records. [2025-09-24T22:07:34.056010] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:34.056246] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-24T22:07:34.056294] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-24T22:07:34.056952] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-24T22:07:34.057013] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-24T22:07:34.414880] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:34.416027] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-24T22:07:35.065700] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T22:07:35.216608] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-24T22:07:35.220624] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-24T22:07:35.247145] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-24T22:07:36.016073] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-24T22:07:36.816135] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-24T22:07:37.616095] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-24T22:07:37.702344] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-24T22:07:37.905599] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-24T22:07:37.988408] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-24T22:07:38.421124] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-24T22:07:38.430586] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-24T22:07:39.216115] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-24T22:07:40.016134] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-24T22:07:40.816152] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-24T22:07:40.901139] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T22:07:41.017012] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-24T22:07:41.616127] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-24T22:07:41.889103] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-24T22:07:41.989600] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T22:07:42.416143] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-24T22:07:43.056115] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T22:07:43.216115] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-24T22:07:44.016095] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-24T22:07:44.730005] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-24T22:07:44.740397] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-24T22:07:44.740556] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-24T22:07:44.828527] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-24T22:07:44.885963] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-24T22:07:44.976884] [INFO ] [REMOTE ] WNS: Full fetch complete (54835 records). [2025-09-24T22:07:45.008371] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-24T22:07:45.328082] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-24T22:07:45.380975] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-24T22:07:45.382119] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-24T22:07:45.384035] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-24T22:07:45.384149] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-24T22:07:45.459485] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-09-24T22:07:45.633222] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-24T22:07:45.963902] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-24T22:07:45.964541] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-24T22:07:45.965968] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-24T22:07:45.966055] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-24T22:07:45.969801] [DEBUG] [LOCAL ] WNS: Trimmed 54835 records to 40001 (keeping 200 days of data) [2025-09-24T22:07:46.303930] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-24T22:07:46.325858] [DEBUG] [LOCAL ] WNS: Primary data saved (40001 records). [2025-09-24T22:07:46.326593] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-24T22:07:46.327353] [INFO ] [MAIN ] Update Progress: 2313/2373 symbols completed. WNS took 28.5s. Estimated remaining: 7m 59s. Rate: 7.5 symbols/min [2025-09-24T22:07:46.416944] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-24T22:07:46.456873] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-24T22:07:46.477840] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-24T22:07:46.504442] [INFO ] [MAIN ] Update Progress: 2314/2373 symbols completed. WMT took 44.6s. Estimated remaining: 7m 51s. Rate: 7.5 symbols/min [2025-09-24T22:07:46.605026] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:46.718367] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:07:46.743329] [DEBUG] [LOCAL ] WOW: Loaded 30117 existing records from primary storage. [2025-09-24T22:07:46.743610] [INFO ] [MAIN ] WOW: Loaded 30117 existing records. [2025-09-24T22:07:46.959138] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:46.959499] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-24T22:07:46.959553] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-24T22:07:46.961112] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-24T22:07:46.961258] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-24T22:07:47.085792] [DEBUG] [LOCAL ] WPC: Loaded 48608 existing records from primary storage. [2025-09-24T22:07:47.086041] [INFO ] [MAIN ] WPC: Loaded 48608 existing records. [2025-09-24T22:07:47.485182] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:07:47.486108] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-24T22:07:47.486296] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-24T22:07:47.497091] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-24T22:07:47.497284] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-24T22:07:47.683341] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:47.690360] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-24T22:07:47.918393] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-24T22:07:48.009241] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:07:48.016061] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-24T22:07:48.392306] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-24T22:07:48.816104] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-24T22:07:48.887103] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-24T22:07:49.616116] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-24T22:07:49.750582] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T22:07:50.416077] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-24T22:07:50.619573] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T22:07:50.900405] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-24T22:07:51.183869] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T22:07:51.216051] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-24T22:07:52.016087] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-24T22:07:52.396626] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T22:07:52.816134] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-24T22:07:53.617764] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-24T22:07:53.635998] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-24T22:07:53.929457] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T22:07:54.416094] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-24T22:07:54.699682] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-24T22:07:55.216098] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-24T22:07:55.524577] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-24T22:07:56.016125] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-24T22:07:56.816089] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-24T22:07:57.618802] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-24T22:07:57.657231] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T22:07:57.797340] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-24T22:07:58.122183] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T22:07:58.314406] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-24T22:07:58.416137] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-24T22:07:59.216094] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-24T22:07:59.392611] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-24T22:07:59.397136] [INFO ] [REMOTE ] WOR: Full fetch complete (35967 records). [2025-09-24T22:07:59.397244] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-24T22:07:59.774456] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-24T22:07:59.774535] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-24T22:07:59.775321] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-24T22:07:59.775383] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-24T22:07:59.776230] [DEBUG] [LOCAL ] WOR: Trimmed 35967 records to 24727 (keeping 200 days of data) [2025-09-24T22:07:59.928056] [DEBUG] [LOCAL ] WOR: Primary data saved (24727 records). [2025-09-24T22:07:59.928188] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-24T22:07:59.928272] [INFO ] [MAIN ] Update Progress: 2315/2373 symbols completed. WOR took 26.2s. Estimated remaining: 7m 43s. Rate: 7.5 symbols/min [2025-09-24T22:08:00.021292] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-24T22:08:00.134008] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:00.185592] [DEBUG] [LOCAL ] WPM: Loaded 52728 existing records from primary storage. [2025-09-24T22:08:00.185813] [INFO ] [MAIN ] WPM: Loaded 52728 existing records. [2025-09-24T22:08:00.361874] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:00.362101] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-24T22:08:00.362150] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-24T22:08:00.363311] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-24T22:08:00.363372] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-24T22:08:00.720441] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:00.816046] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-24T22:08:01.108520] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T22:08:01.188205] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-24T22:08:01.616128] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-24T22:08:02.416108] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-24T22:08:02.542523] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-24T22:08:03.216044] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-24T22:08:03.329076] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-24T22:08:03.600214] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-24T22:08:04.016084] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-24T22:08:04.741630] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-24T22:08:04.816047] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-24T22:08:05.286021] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T22:08:05.616091] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-24T22:08:06.416051] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-24T22:08:06.525455] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T22:08:07.216064] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-24T22:08:07.395496] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-24T22:08:08.016105] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-24T22:08:08.623029] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-24T22:08:08.674580] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-24T22:08:08.816092] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-24T22:08:09.612339] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T22:08:09.622724] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-24T22:08:10.416147] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-24T22:08:11.110886] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-24T22:08:11.140503] [INFO ] [REMOTE ] WOLF: Full fetch complete (77599 records). [2025-09-24T22:08:11.156118] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-24T22:08:11.160091] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-24T22:08:11.224020] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-24T22:08:11.644110] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-24T22:08:11.644215] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-24T22:08:11.645609] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-24T22:08:11.645701] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-24T22:08:11.647501] [DEBUG] [LOCAL ] WOLF: Trimmed 77599 records to 53532 (keeping 200 days of data) [2025-09-24T22:08:11.983511] [DEBUG] [LOCAL ] WOLF: Primary data saved (53532 records). [2025-09-24T22:08:11.983703] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-24T22:08:11.983825] [INFO ] [MAIN ] Update Progress: 2316/2373 symbols completed. WOLF took 45.0s. Estimated remaining: 7m 35s. Rate: 7.5 symbols/min [2025-09-24T22:08:12.020855] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-24T22:08:12.197297] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:12.213892] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T22:08:12.258429] [DEBUG] [LOCAL ] WPP: Loaded 33736 existing records from primary storage. [2025-09-24T22:08:12.258618] [INFO ] [MAIN ] WPP: Loaded 33736 existing records. [2025-09-24T22:08:12.435269] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:12.435549] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-24T22:08:12.435599] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-24T22:08:12.436409] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-24T22:08:12.436471] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-24T22:08:12.802046] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:12.821163] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-24T22:08:12.838386] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T22:08:13.542839] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T22:08:13.550230] [INFO ] [REMOTE ] WOW: Full fetch complete (41648 records). [2025-09-24T22:08:13.550346] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-24T22:08:13.621238] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-24T22:08:13.933037] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-24T22:08:13.933115] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-24T22:08:13.933985] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-24T22:08:13.934049] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-24T22:08:13.935012] [DEBUG] [LOCAL ] WOW: Trimmed 41648 records to 30194 (keeping 200 days of data) [2025-09-24T22:08:14.107015] [DEBUG] [LOCAL ] WOW: Primary data saved (30194 records). [2025-09-24T22:08:14.107280] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-24T22:08:14.107397] [INFO ] [MAIN ] Update Progress: 2317/2373 symbols completed. WOW took 27.8s. Estimated remaining: 7m 27s. Rate: 7.5 symbols/min [2025-09-24T22:08:14.416074] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-24T22:08:14.684349] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-24T22:08:15.216101] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-24T22:08:15.346109] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-24T22:08:15.406536] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-24T22:08:16.016086] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-24T22:08:16.816064] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-24T22:08:17.067976] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-24T22:08:17.616056] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-24T22:08:17.719568] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-24T22:08:17.732105] [INFO ] [REMOTE ] WPC: Full fetch complete (70878 records). [2025-09-24T22:08:17.732289] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-24T22:08:18.147015] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-24T22:08:18.147192] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-24T22:08:18.148614] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-24T22:08:18.148748] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-24T22:08:18.166559] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-24T22:08:18.172962] [DEBUG] [LOCAL ] WPC: Trimmed 70878 records to 48540 (keeping 200 days of data) [2025-09-24T22:08:18.417365] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-24T22:08:18.469339] [DEBUG] [LOCAL ] WPC: Primary data saved (48540 records). [2025-09-24T22:08:18.469461] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-24T22:08:18.469549] [INFO ] [MAIN ] Update Progress: 2318/2373 symbols completed. WPC took 32.0s. Estimated remaining: 7m 19s. Rate: 7.5 symbols/min [2025-09-24T22:08:19.529605] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-24T22:08:19.534520] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-24T22:08:19.652074] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T22:08:20.016138] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-24T22:08:21.002319] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-24T22:08:21.010184] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-24T22:08:21.666456] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T22:08:21.681161] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-24T22:08:22.452238] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-24T22:08:22.460215] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-24T22:08:23.196899] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-24T22:08:23.206632] [INFO ] [REMOTE ] WPM: Full fetch complete (75838 records). [2025-09-24T22:08:23.206806] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-24T22:08:23.673284] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-24T22:08:23.673394] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-24T22:08:23.675025] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-24T22:08:23.675102] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-24T22:08:23.678455] [DEBUG] [LOCAL ] WPM: Trimmed 75838 records to 52734 (keeping 200 days of data) [2025-09-24T22:08:23.927371] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-24T22:08:23.941865] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-24T22:08:24.045991] [DEBUG] [LOCAL ] WPM: Primary data saved (52734 records). [2025-09-24T22:08:24.046145] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-24T22:08:24.046232] [INFO ] [MAIN ] Update Progress: 2319/2373 symbols completed. WPM took 24.1s. Estimated remaining: 7m 11s. Rate: 7.5 symbols/min [2025-09-24T22:08:25.183066] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-24T22:08:25.189957] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-24T22:08:26.864547] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T22:08:26.873774] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-24T22:08:28.421914] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T22:08:28.430127] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-24T22:08:29.861467] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T22:08:29.868178] [INFO ] [REMOTE ] WPP: Full fetch complete (45018 records). [2025-09-24T22:08:29.868325] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-24T22:08:30.268388] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-24T22:08:30.268593] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-24T22:08:30.269775] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-24T22:08:30.269845] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-24T22:08:30.271063] [DEBUG] [LOCAL ] WPP: Trimmed 45018 records to 33738 (keeping 200 days of data) [2025-09-24T22:08:30.480110] [DEBUG] [LOCAL ] WPP: Primary data saved (33738 records). [2025-09-24T22:08:30.480260] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-24T22:08:30.480364] [INFO ] [MAIN ] Update Progress: 2320/2373 symbols completed. WPP took 18.5s. Estimated remaining: 7m 3s. Rate: 7.5 symbols/min [2025-09-24T22:08:31.163462] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:31.253549] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:31.258083] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:31.254602] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:31.308192] [DEBUG] [LOCAL ] WS: Loaded 23862 existing records from primary storage. [2025-09-24T22:08:31.315833] [INFO ] [MAIN ] WS: Loaded 23862 existing records. [2025-09-24T22:08:31.496751] [DEBUG] [LOCAL ] WRBY: Loaded 50882 existing records from primary storage. [2025-09-24T22:08:31.497454] [INFO ] [MAIN ] WRBY: Loaded 50882 existing records. [2025-09-24T22:08:31.509329] [DEBUG] [LOCAL ] WSM: Loaded 49906 existing records from primary storage. [2025-09-24T22:08:31.514782] [INFO ] [MAIN ] WSM: Loaded 49906 existing records. [2025-09-24T22:08:31.766897] [DEBUG] [LOCAL ] WRB: Loaded 50581 existing records from primary storage. [2025-09-24T22:08:31.803390] [INFO ] [MAIN ] WRB: Loaded 50581 existing records. [2025-09-24T22:08:31.806910] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:31.844243] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-24T22:08:31.885708] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-24T22:08:32.042784] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:32.031823] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-24T22:08:32.055386] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-24T22:08:32.059626] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-24T22:08:32.095477] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-24T22:08:32.161321] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:32.179070] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-24T22:08:32.265293] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-24T22:08:32.259976] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-24T22:08:32.283037] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-24T22:08:32.277399] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:32.333555] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-24T22:08:32.344322] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-24T22:08:32.350241] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-24T22:08:32.355553] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-24T22:08:32.451737] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-24T22:08:32.530710] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-24T22:08:33.415125] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:33.509888] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-24T22:08:33.720552] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:33.803003] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-24T22:08:33.809202] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:33.814266] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:33.815542] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-24T22:08:33.816746] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-24T22:08:34.963234] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T22:08:34.969606] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-24T22:08:35.269661] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T22:08:35.280946] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-24T22:08:35.468110] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-24T22:08:35.478247] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-24T22:08:35.537168] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-24T22:08:35.547060] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-24T22:08:36.121417] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T22:08:36.127967] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-24T22:08:36.888072] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T22:08:36.898737] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-24T22:08:37.035512] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-24T22:08:37.045827] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-24T22:08:37.104706] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-24T22:08:37.117017] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-24T22:08:37.179140] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-24T22:08:37.184852] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-24T22:08:38.561499] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-24T22:08:38.573315] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T22:08:38.581052] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-24T22:08:38.581335] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-24T22:08:38.716020] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T22:08:38.728723] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-24T22:08:38.796990] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-24T22:08:39.216173] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-24T22:08:39.708390] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-24T22:08:40.031241] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-24T22:08:40.034062] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T22:08:40.260039] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-24T22:08:40.816057] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-24T22:08:41.185147] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T22:08:41.208547] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-24T22:08:41.616111] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-24T22:08:42.416054] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-24T22:08:42.539087] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T22:08:42.957862] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-24T22:08:43.216107] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-24T22:08:44.016083] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-24T22:08:44.329158] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-24T22:08:44.408751] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-24T22:08:44.816123] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-24T22:08:45.616053] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-24T22:08:45.661452] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-24T22:08:45.768610] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T22:08:46.416085] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-24T22:08:47.216087] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-24T22:08:47.497208] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T22:08:47.968155] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-24T22:08:48.016110] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-24T22:08:48.386172] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-24T22:08:48.390790] [INFO ] [REMOTE ] WS: Full fetch complete (36271 records). [2025-09-24T22:08:48.390922] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-24T22:08:48.801200] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-24T22:08:48.801316] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-24T22:08:48.802291] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-24T22:08:48.802407] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-24T22:08:48.803720] [DEBUG] [LOCAL ] WS: Trimmed 36271 records to 23893 (keeping 200 days of data) [2025-09-24T22:08:48.816167] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-24T22:08:48.994157] [DEBUG] [LOCAL ] WS: Primary data saved (23893 records). [2025-09-24T22:08:48.994457] [INFO ] [MAIN ] WS: Full history saved. [2025-09-24T22:08:48.994748] [INFO ] [MAIN ] Update Progress: 2321/2373 symbols completed. WS took 18.5s. Estimated remaining: 6m 55s. Rate: 7.5 symbols/min [2025-09-24T22:08:49.182967] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:49.220969] [DEBUG] [LOCAL ] WSO: Loaded 24720 existing records from primary storage. [2025-09-24T22:08:49.221183] [INFO ] [MAIN ] WSO: Loaded 24720 existing records. [2025-09-24T22:08:49.424735] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:49.425344] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-24T22:08:49.425471] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-24T22:08:49.426377] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-24T22:08:49.426457] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-24T22:08:49.626635] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-24T22:08:49.802279] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:08:49.834723] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T22:08:50.416113] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-24T22:08:50.682560] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T22:08:51.216205] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-24T22:08:51.482719] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-24T22:08:52.016055] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-24T22:08:52.279543] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:08:52.816077] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-24T22:08:52.996361] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-24T22:08:53.616066] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-24T22:08:53.779128] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T22:08:53.908629] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-24T22:08:54.416082] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-24T22:08:54.892245] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-24T22:08:55.216062] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-24T22:08:55.559492] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-24T22:08:56.016101] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-24T22:08:56.588583] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-24T22:08:56.816185] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-24T22:08:57.616090] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-24T22:08:57.710462] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-24T22:08:57.805324] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-24T22:08:58.308740] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-24T22:08:58.317692] [INFO ] [REMOTE ] WRB: Full fetch complete (73144 records). [2025-09-24T22:08:58.317876] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-24T22:08:58.419017] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-24T22:08:58.722062] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-24T22:08:58.722243] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-24T22:08:58.723679] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-24T22:08:58.723751] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-24T22:08:58.725312] [DEBUG] [LOCAL ] WRB: Trimmed 73144 records to 50554 (keeping 200 days of data) [2025-09-24T22:08:59.070367] [DEBUG] [LOCAL ] WRB: Primary data saved (50554 records). [2025-09-24T22:08:59.070515] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-24T22:08:59.070685] [INFO ] [MAIN ] Update Progress: 2322/2373 symbols completed. WRB took 28.6s. Estimated remaining: 6m 47s. Rate: 7.5 symbols/min [2025-09-24T22:08:59.231589] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-24T22:08:59.239768] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-24T22:08:59.276579] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:08:59.283390] [INFO ] [REMOTE ] WSM: Full fetch complete (72172 records). [2025-09-24T22:08:59.283605] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-24T22:08:59.465878] [DEBUG] [LOCAL ] WSR: Loaded 23361 existing records from primary storage. [2025-09-24T22:08:59.480332] [INFO ] [MAIN ] WSR: Loaded 23361 existing records. [2025-09-24T22:08:59.870993] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:08:59.894842] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-24T22:08:59.913909] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-24T22:08:59.914069] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-24T22:08:59.914208] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-24T22:08:59.916097] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-24T22:08:59.916148] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-24T22:08:59.916398] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-24T22:08:59.916332] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-24T22:09:00.024561] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-24T22:09:00.034201] [DEBUG] [LOCAL ] WSM: Trimmed 72172 records to 49858 (keeping 200 days of data) [2025-09-24T22:09:00.452522] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:00.474969] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-24T22:09:00.694452] [DEBUG] [LOCAL ] WSM: Primary data saved (49858 records). [2025-09-24T22:09:00.694631] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-24T22:09:00.694800] [INFO ] [MAIN ] Update Progress: 2323/2373 symbols completed. WSM took 30.2s. Estimated remaining: 6m 39s. Rate: 7.5 symbols/min [2025-09-24T22:09:00.821400] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-24T22:09:00.869088] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:00.922380] [DEBUG] [LOCAL ] WST: Loaded 37595 existing records from primary storage. [2025-09-24T22:09:00.922674] [INFO ] [MAIN ] WST: Loaded 37595 existing records. [2025-09-24T22:09:01.125783] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:01.126154] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-24T22:09:01.126209] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-24T22:09:01.128008] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-24T22:09:01.128077] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-24T22:09:01.531030] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:01.616162] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-24T22:09:02.052801] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-24T22:09:02.064007] [INFO ] [REMOTE ] WRBY: Full fetch complete (73344 records). [2025-09-24T22:09:02.064287] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-24T22:09:02.421277] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-24T22:09:02.465432] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-24T22:09:02.622528] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-24T22:09:02.623005] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-24T22:09:02.625028] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-24T22:09:02.625323] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-24T22:09:02.632165] [DEBUG] [LOCAL ] WRBY: Trimmed 73344 records to 50878 (keeping 200 days of data) [2025-09-24T22:09:03.149281] [DEBUG] [LOCAL ] WRBY: Primary data saved (50878 records). [2025-09-24T22:09:03.149576] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-24T22:09:03.149878] [INFO ] [MAIN ] Update Progress: 2324/2373 symbols completed. WRBY took 32.7s. Estimated remaining: 6m 31s. Rate: 7.5 symbols/min [2025-09-24T22:09:03.226801] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-24T22:09:03.467185] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:03.539460] [DEBUG] [LOCAL ] WT: Loaded 47621 existing records from primary storage. [2025-09-24T22:09:03.539877] [INFO ] [MAIN ] WT: Loaded 47621 existing records. [2025-09-24T22:09:03.770054] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:03.770520] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-24T22:09:03.770591] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-24T22:09:03.772504] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-24T22:09:03.772790] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-24T22:09:04.192466] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:04.192930] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-24T22:09:05.182279] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (3.57 seconds). [2025-09-24T22:09:05.190375] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-24T22:09:05.238501] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-24T22:09:05.281718] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-24T22:09:05.616097] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-24T22:09:05.958606] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T22:09:06.416122] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-24T22:09:06.443710] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T22:09:06.694865] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-24T22:09:07.216083] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-24T22:09:08.016057] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-24T22:09:08.053094] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T22:09:08.248499] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-24T22:09:08.816102] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-24T22:09:09.229559] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-24T22:09:09.616070] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-24T22:09:10.416104] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-24T22:09:10.467983] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-24T22:09:10.744296] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-24T22:09:11.216087] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-24T22:09:11.922423] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-24T22:09:12.016078] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-24T22:09:12.799499] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T22:09:12.816030] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-24T22:09:13.169511] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-24T22:09:13.616098] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-24T22:09:14.104611] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-24T22:09:14.416078] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-24T22:09:15.221395] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-24T22:09:15.224383] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-24T22:09:15.630106] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-24T22:09:16.016080] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-24T22:09:16.816108] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-24T22:09:17.073022] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-24T22:09:17.616091] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-24T22:09:18.416105] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-24T22:09:18.448789] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-24T22:09:18.521493] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T22:09:19.085905] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T22:09:19.216045] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-24T22:09:19.391916] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-24T22:09:20.016090] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-24T22:09:20.629798] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T22:09:20.816105] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-24T22:09:21.340096] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-24T22:09:21.345714] [INFO ] [REMOTE ] WSO: Full fetch complete (34015 records). [2025-09-24T22:09:21.345824] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-24T22:09:21.621294] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-24T22:09:21.742236] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-24T22:09:21.742320] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-24T22:09:21.743111] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-24T22:09:21.743179] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-24T22:09:21.744336] [DEBUG] [LOCAL ] WSO: Trimmed 34015 records to 24693 (keeping 200 days of data) [2025-09-24T22:09:21.918507] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-24T22:09:21.929561] [DEBUG] [LOCAL ] WSO: Primary data saved (24693 records). [2025-09-24T22:09:21.929768] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-24T22:09:21.929920] [INFO ] [MAIN ] Update Progress: 2325/2373 symbols completed. WSO took 32.9s. Estimated remaining: 6m 23s. Rate: 7.5 symbols/min [2025-09-24T22:09:22.101990] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:22.148065] [DEBUG] [LOCAL ] WTI: Loaded 43736 existing records from primary storage. [2025-09-24T22:09:22.148234] [INFO ] [MAIN ] WTI: Loaded 43736 existing records. [2025-09-24T22:09:22.330317] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:22.330602] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-24T22:09:22.330682] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-24T22:09:22.332351] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-24T22:09:22.332413] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-24T22:09:22.421167] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-24T22:09:22.722259] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:23.201280] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T22:09:23.216030] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-24T22:09:23.258947] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-24T22:09:24.016121] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-24T22:09:24.747252] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T22:09:24.816027] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-24T22:09:25.116630] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-24T22:09:25.405041] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-24T22:09:25.616049] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-24T22:09:26.416172] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-24T22:09:27.179175] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T22:09:27.216056] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-24T22:09:27.492806] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T22:09:27.496990] [INFO ] [REMOTE ] WSR: Full fetch complete (32788 records). [2025-09-24T22:09:27.497087] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-24T22:09:27.901562] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-24T22:09:27.901660] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-24T22:09:27.902419] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-24T22:09:27.902463] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-24T22:09:27.903230] [DEBUG] [LOCAL ] WSR: Trimmed 32788 records to 23275 (keeping 200 days of data) [2025-09-24T22:09:28.016150] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-24T22:09:28.050168] [DEBUG] [LOCAL ] WSR: Primary data saved (23275 records). [2025-09-24T22:09:28.050286] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-24T22:09:28.050368] [INFO ] [MAIN ] Update Progress: 2326/2373 symbols completed. WSR took 29.0s. Estimated remaining: 6m 15s. Rate: 7.5 symbols/min [2025-09-24T22:09:28.222900] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:28.223056] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-24T22:09:28.223093] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-24T22:09:28.223278] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-24T22:09:28.223334] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-24T22:09:28.223379] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-24T22:09:28.223413] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-24T22:09:28.591872] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:28.816061] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-24T22:09:29.073535] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:09:29.465173] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-24T22:09:29.471385] [INFO ] [REMOTE ] WST: Full fetch complete (53500 records). [2025-09-24T22:09:29.471502] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-24T22:09:29.625519] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-24T22:09:29.912138] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-24T22:09:29.915381] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-24T22:09:29.916824] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-24T22:09:29.916981] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-24T22:09:29.920240] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T22:09:29.931093] [DEBUG] [LOCAL ] WST: Trimmed 53500 records to 37580 (keeping 200 days of data) [2025-09-24T22:09:30.177565] [DEBUG] [LOCAL ] WST: Primary data saved (37580 records). [2025-09-24T22:09:30.177746] [INFO ] [MAIN ] WST: Full history saved. [2025-09-24T22:09:30.177845] [INFO ] [MAIN ] Update Progress: 2327/2373 symbols completed. WST took 29.5s. Estimated remaining: 6m 7s. Rate: 7.5 symbols/min [2025-09-24T22:09:30.357450] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:30.413277] [DEBUG] [LOCAL ] WTRG: Loaded 50937 existing records from primary storage. [2025-09-24T22:09:30.413435] [INFO ] [MAIN ] WTRG: Loaded 50937 existing records. [2025-09-24T22:09:30.424987] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-24T22:09:30.597594] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:30.597887] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-24T22:09:30.597936] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-24T22:09:30.599166] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-24T22:09:30.599227] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-24T22:09:30.942668] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-24T22:09:30.965358] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:31.216132] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-24T22:09:31.431348] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-24T22:09:32.016112] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-24T22:09:32.816086] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-24T22:09:33.616109] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-24T22:09:33.980290] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-24T22:09:34.183107] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-24T22:09:34.216462] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-24T22:09:34.225939] [INFO ] [REMOTE ] WT: Full fetch complete (69058 records). [2025-09-24T22:09:34.226131] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-24T22:09:34.421451] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-24T22:09:34.644437] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-24T22:09:34.644542] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-24T22:09:34.645911] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-24T22:09:34.645981] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-24T22:09:34.647480] [DEBUG] [LOCAL ] WT: Trimmed 69058 records to 47637 (keeping 200 days of data) [2025-09-24T22:09:34.935706] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-24T22:09:34.950823] [DEBUG] [LOCAL ] WT: Primary data saved (47637 records). [2025-09-24T22:09:34.951011] [INFO ] [MAIN ] WT: Full history saved. [2025-09-24T22:09:34.951117] [INFO ] [MAIN ] Update Progress: 2328/2373 symbols completed. WT took 31.8s. Estimated remaining: 5m 59s. Rate: 7.5 symbols/min [2025-09-24T22:09:35.122913] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:35.142882] [DEBUG] [LOCAL ] WTS: Loaded 18514 existing records from primary storage. [2025-09-24T22:09:35.143046] [INFO ] [MAIN ] WTS: Loaded 18514 existing records. [2025-09-24T22:09:35.221317] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-24T22:09:35.329253] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:35.329716] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-24T22:09:35.329906] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-24T22:09:35.330835] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-24T22:09:35.330901] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-24T22:09:35.614469] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-24T22:09:35.662407] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-24T22:09:35.741819] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:36.016143] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-24T22:09:36.516060] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-24T22:09:36.816146] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-24T22:09:37.225621] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-24T22:09:37.616082] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-24T22:09:38.112955] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-24T22:09:38.416087] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-24T22:09:39.216145] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-24T22:09:39.933307] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T22:09:40.016056] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-24T22:09:40.816067] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-24T22:09:40.899374] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T22:09:41.351537] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-24T22:09:41.616083] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-24T22:09:41.666767] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T22:09:42.416112] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-24T22:09:42.873680] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-24T22:09:43.070028] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T22:09:43.216049] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-24T22:09:44.016089] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-24T22:09:44.816059] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-24T22:09:44.936046] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-24T22:09:45.027148] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-24T22:09:45.242862] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T22:09:45.244147] [INFO ] [REMOTE ] WTM: Full fetch complete (2210 records). [2025-09-24T22:09:45.244220] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-24T22:09:45.423428] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-24T22:09:45.423696] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-24T22:09:45.423771] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-24T22:09:45.423845] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-24T22:09:45.423916] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-24T22:09:45.423955] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-24T22:09:45.424031] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-24T22:09:45.424136] [INFO ] [MAIN ] Update Progress: 2329/2373 symbols completed. WTM took 17.4s. Estimated remaining: 5m 51s. Rate: 7.5 symbols/min [2025-09-24T22:09:45.592632] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:09:45.617683] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-24T22:09:45.639551] [DEBUG] [LOCAL ] WTTR: Loaded 45098 existing records from primary storage. [2025-09-24T22:09:45.639825] [INFO ] [MAIN ] WTTR: Loaded 45098 existing records. [2025-09-24T22:09:45.835348] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:09:45.835732] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-24T22:09:45.835821] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-24T22:09:45.836954] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-24T22:09:45.837020] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-24T22:09:46.239789] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:09:46.416089] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-24T22:09:47.216148] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-24T22:09:47.501354] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-24T22:09:48.006156] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T22:09:48.016034] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-24T22:09:48.216829] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-24T22:09:48.816092] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-24T22:09:49.610105] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-24T22:09:49.618584] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-24T22:09:50.386147] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-24T22:09:50.416097] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-24T22:09:51.216060] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-24T22:09:51.267024] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:09:52.016151] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-24T22:09:52.187750] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-24T22:09:52.407968] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T22:09:52.816085] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-24T22:09:53.621906] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-24T22:09:53.643011] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-24T22:09:54.416060] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-24T22:09:54.553506] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T22:09:54.722384] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-24T22:09:55.216094] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-24T22:09:55.925754] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-24T22:09:56.016035] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-24T22:09:56.816109] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-24T22:09:56.957223] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-24T22:09:57.338231] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T22:09:57.616107] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-24T22:09:58.416123] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-24T22:09:58.541607] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-24T22:09:59.216043] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-24T22:09:59.250570] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-24T22:09:59.962943] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-24T22:10:00.016079] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-24T22:10:00.816074] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-24T22:10:00.995205] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-24T22:10:01.527735] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-24T22:10:01.535405] [INFO ] [REMOTE ] WTI: Full fetch complete (64166 records). [2025-09-24T22:10:01.535537] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-24T22:10:01.621224] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-24T22:10:01.955709] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-24T22:10:01.955825] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-24T22:10:01.957331] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-24T22:10:01.957400] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-24T22:10:01.958897] [DEBUG] [LOCAL ] WTI: Trimmed 64166 records to 43754 (keeping 200 days of data) [2025-09-24T22:10:02.219303] [DEBUG] [LOCAL ] WTI: Primary data saved (43754 records). [2025-09-24T22:10:02.219437] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-24T22:10:02.219536] [INFO ] [MAIN ] Update Progress: 2330/2373 symbols completed. WTI took 40.3s. Estimated remaining: 5m 43s. Rate: 7.5 symbols/min [2025-09-24T22:10:02.397834] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:02.417690] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-24T22:10:02.436928] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-24T22:10:02.495022] [DEBUG] [LOCAL ] WU: Loaded 53454 existing records from primary storage. [2025-09-24T22:10:02.495206] [INFO ] [MAIN ] WU: Loaded 53454 existing records. [2025-09-24T22:10:02.675121] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:02.675393] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-24T22:10:02.675481] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-24T22:10:02.676786] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-24T22:10:02.676850] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-24T22:10:03.037324] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:03.216055] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-24T22:10:03.335581] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-24T22:10:03.345301] [INFO ] [REMOTE ] WTRG: Full fetch complete (73241 records). [2025-09-24T22:10:03.345462] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-24T22:10:03.484753] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-24T22:10:03.792682] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-24T22:10:03.792776] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-24T22:10:03.794051] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-24T22:10:03.794117] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-24T22:10:03.795600] [DEBUG] [LOCAL ] WTRG: Trimmed 73241 records to 50931 (keeping 200 days of data) [2025-09-24T22:10:04.016114] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-24T22:10:04.110898] [DEBUG] [LOCAL ] WTRG: Primary data saved (50931 records). [2025-09-24T22:10:04.111050] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-24T22:10:04.111140] [INFO ] [MAIN ] Update Progress: 2331/2373 symbols completed. WTRG took 33.9s. Estimated remaining: 5m 35s. Rate: 7.5 symbols/min [2025-09-24T22:10:04.281058] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:04.329669] [DEBUG] [LOCAL ] WWW: Loaded 49188 existing records from primary storage. [2025-09-24T22:10:04.329824] [INFO ] [MAIN ] WWW: Loaded 49188 existing records. [2025-09-24T22:10:04.509704] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:04.509965] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-24T22:10:04.510013] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-24T22:10:04.511114] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-24T22:10:04.511174] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-24T22:10:04.818771] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-24T22:10:04.884421] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:04.911417] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-24T22:10:04.936737] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-24T22:10:05.616088] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-24T22:10:06.416146] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-24T22:10:06.844305] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-24T22:10:07.196060] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-24T22:10:07.216040] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-24T22:10:07.758414] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-24T22:10:08.016115] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-24T22:10:08.816068] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-24T22:10:08.855736] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-24T22:10:09.178351] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T22:10:09.616086] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-24T22:10:10.416154] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-24T22:10:10.603208] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-24T22:10:11.214424] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-24T22:10:11.222294] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-24T22:10:11.224014] [INFO ] [REMOTE ] WTTR: Full fetch complete (65601 records). [2025-09-24T22:10:11.224108] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-24T22:10:11.652892] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-24T22:10:11.653138] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-24T22:10:11.654504] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-24T22:10:11.654676] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-24T22:10:11.656465] [DEBUG] [LOCAL ] WTTR: Trimmed 65601 records to 45054 (keeping 200 days of data) [2025-09-24T22:10:11.773012] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T22:10:11.986180] [DEBUG] [LOCAL ] WTTR: Primary data saved (45054 records). [2025-09-24T22:10:11.986333] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-24T22:10:11.986456] [INFO ] [MAIN ] Update Progress: 2332/2373 symbols completed. WTTR took 26.6s. Estimated remaining: 5m 27s. Rate: 7.5 symbols/min [2025-09-24T22:10:12.021864] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-24T22:10:12.214043] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:12.274435] [DEBUG] [LOCAL ] WY: Loaded 53118 existing records from primary storage. [2025-09-24T22:10:12.274630] [INFO ] [MAIN ] WY: Loaded 53118 existing records. [2025-09-24T22:10:12.457604] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:12.457900] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-24T22:10:12.457950] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-24T22:10:12.459143] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-24T22:10:12.459206] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-24T22:10:12.828320] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-24T22:10:12.828235] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:12.857975] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-24T22:10:13.616122] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-24T22:10:13.838357] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-24T22:10:13.911496] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-24T22:10:14.416186] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-24T22:10:15.216057] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-24T22:10:15.362425] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-24T22:10:16.016101] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-24T22:10:16.318783] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-24T22:10:16.343810] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-24T22:10:16.816078] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-24T22:10:17.616091] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-24T22:10:17.739206] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-24T22:10:18.416057] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-24T22:10:18.593157] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T22:10:19.216137] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-24T22:10:19.443370] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-24T22:10:20.016056] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-24T22:10:20.221740] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T22:10:20.499426] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-24T22:10:20.816098] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-24T22:10:21.332629] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T22:10:21.616072] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-24T22:10:22.416046] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-24T22:10:22.673506] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T22:10:23.165272] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-24T22:10:23.216037] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-24T22:10:23.467363] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-24T22:10:24.016090] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-24T22:10:24.816058] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-24T22:10:25.232972] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T22:10:25.616051] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-24T22:10:25.741516] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-24T22:10:25.744434] [INFO ] [REMOTE ] WTS: Full fetch complete (26355 records). [2025-09-24T22:10:25.744509] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-24T22:10:26.154063] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-24T22:10:26.154202] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-24T22:10:26.156719] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-24T22:10:26.155477] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-24T22:10:26.167583] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-24T22:10:26.169077] [DEBUG] [LOCAL ] WTS: Trimmed 26355 records to 18480 (keeping 200 days of data) [2025-09-24T22:10:26.286089] [DEBUG] [LOCAL ] WTS: Primary data saved (18480 records). [2025-09-24T22:10:26.286245] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-24T22:10:26.286337] [INFO ] [MAIN ] Update Progress: 2333/2373 symbols completed. WTS took 51.3s. Estimated remaining: 5m 19s. Rate: 7.5 symbols/min [2025-09-24T22:10:26.431675] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-24T22:10:26.464730] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:26.495230] [DEBUG] [LOCAL ] XFLT: Loaded 30138 existing records from primary storage. [2025-09-24T22:10:26.495369] [INFO ] [MAIN ] XFLT: Loaded 30138 existing records. [2025-09-24T22:10:26.675218] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:26.675486] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-24T22:10:26.675540] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-24T22:10:26.676364] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-24T22:10:26.676430] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-24T22:10:27.033590] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:27.216052] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-24T22:10:27.565261] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-24T22:10:28.016073] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-24T22:10:28.079739] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-24T22:10:28.218199] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-24T22:10:28.816122] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-24T22:10:29.616059] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-24T22:10:29.816210] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-24T22:10:29.825940] [INFO ] [REMOTE ] WU: Full fetch complete (77324 records). [2025-09-24T22:10:29.826088] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-24T22:10:30.236854] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-24T22:10:30.237075] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-24T22:10:30.238512] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-24T22:10:30.238580] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-24T22:10:30.240141] [DEBUG] [LOCAL ] WU: Trimmed 77324 records to 53453 (keeping 200 days of data) [2025-09-24T22:10:30.421011] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-24T22:10:30.507939] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-24T22:10:30.617291] [DEBUG] [LOCAL ] WU: Primary data saved (53453 records). [2025-09-24T22:10:30.617437] [INFO ] [MAIN ] WU: Full history saved. [2025-09-24T22:10:30.617538] [INFO ] [MAIN ] Update Progress: 2334/2373 symbols completed. WU took 28.4s. Estimated remaining: 5m 11s. Rate: 7.5 symbols/min [2025-09-24T22:10:30.793159] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:30.837017] [DEBUG] [LOCAL ] XHR: Loaded 44220 existing records from primary storage. [2025-09-24T22:10:30.837171] [INFO ] [MAIN ] XHR: Loaded 44220 existing records. [2025-09-24T22:10:31.025814] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:31.026106] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-24T22:10:31.026157] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-24T22:10:31.027294] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-24T22:10:31.027357] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-24T22:10:31.237212] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-24T22:10:31.407552] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:31.492312] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-24T22:10:31.544255] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-24T22:10:32.016137] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-24T22:10:32.816064] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-24T22:10:33.129756] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-24T22:10:33.578512] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T22:10:33.616044] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-24T22:10:34.088844] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-24T22:10:34.416100] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-24T22:10:35.033612] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T22:10:35.216099] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-24T22:10:35.831116] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-24T22:10:35.840047] [INFO ] [REMOTE ] WWW: Full fetch complete (69956 records). [2025-09-24T22:10:35.840183] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-24T22:10:36.017596] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-24T22:10:36.243287] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-24T22:10:36.243612] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-24T22:10:36.244995] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-24T22:10:36.245172] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-24T22:10:36.246957] [DEBUG] [LOCAL ] WWW: Trimmed 69956 records to 49176 (keeping 200 days of data) [2025-09-24T22:10:36.489933] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-24T22:10:36.576183] [DEBUG] [LOCAL ] WWW: Primary data saved (49176 records). [2025-09-24T22:10:36.576334] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-24T22:10:36.576440] [INFO ] [MAIN ] Update Progress: 2335/2373 symbols completed. WWW took 32.5s. Estimated remaining: 5m 3s. Rate: 7.5 symbols/min [2025-09-24T22:10:36.762164] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:36.762434] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-24T22:10:36.762527] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-24T22:10:36.762768] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-24T22:10:36.762828] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-24T22:10:36.762877] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-24T22:10:36.762922] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-24T22:10:36.825586] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-24T22:10:37.124168] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:37.616135] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-24T22:10:37.823462] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:10:37.823900] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-24T22:10:37.993171] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-24T22:10:38.034903] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-24T22:10:38.416108] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-24T22:10:39.216133] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-24T22:10:39.781141] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-24T22:10:39.823896] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-24T22:10:40.016116] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-24T22:10:40.816126] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-24T22:10:41.232677] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-24T22:10:41.384434] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-24T22:10:41.394960] [INFO ] [REMOTE ] WY: Full fetch complete (76831 records). [2025-09-24T22:10:41.395109] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-24T22:10:41.621196] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-24T22:10:41.829281] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-24T22:10:41.829373] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-24T22:10:41.830772] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-24T22:10:41.830852] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-24T22:10:41.832526] [DEBUG] [LOCAL ] WY: Trimmed 76831 records to 53119 (keeping 200 days of data) [2025-09-24T22:10:42.196821] [DEBUG] [LOCAL ] WY: Primary data saved (53119 records). [2025-09-24T22:10:42.197046] [INFO ] [MAIN ] WY: Full history saved. [2025-09-24T22:10:42.197211] [INFO ] [MAIN ] Update Progress: 2336/2373 symbols completed. WY took 30.2s. Estimated remaining: 4m 55s. Rate: 7.5 symbols/min [2025-09-24T22:10:42.371757] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:42.416133] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-24T22:10:42.436677] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-24T22:10:42.436870] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-24T22:10:42.618990] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:42.619273] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-24T22:10:42.619321] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-24T22:10:42.620834] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-24T22:10:42.620896] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-24T22:10:42.692719] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:10:42.715582] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-24T22:10:42.991303] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:43.143148] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-24T22:10:43.216031] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-24T22:10:44.016108] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-24T22:10:44.602746] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-24T22:10:44.816084] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-24T22:10:45.325800] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-24T22:10:45.616121] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-24T22:10:46.416146] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-24T22:10:46.984900] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-24T22:10:47.216071] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-24T22:10:47.270444] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-24T22:10:48.017000] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T22:10:48.017091] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-24T22:10:48.356334] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-24T22:10:48.816118] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-24T22:10:49.616088] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-24T22:10:50.428972] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-24T22:10:50.434900] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-24T22:10:50.488680] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T22:10:50.998826] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-24T22:10:51.216112] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-24T22:10:51.624377] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-24T22:10:51.630767] [INFO ] [REMOTE ] XFLT: Full fetch complete (44394 records). [2025-09-24T22:10:51.630966] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-24T22:10:52.016570] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-24T22:10:52.016305] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-24T22:10:52.016722] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-24T22:10:52.019594] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-24T22:10:52.019814] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-24T22:10:52.020916] [DEBUG] [LOCAL ] XFLT: Trimmed 44394 records to 29992 (keeping 200 days of data) [2025-09-24T22:10:52.217515] [DEBUG] [LOCAL ] XFLT: Primary data saved (29992 records). [2025-09-24T22:10:52.217767] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-24T22:10:52.217932] [INFO ] [MAIN ] Update Progress: 2337/2373 symbols completed. XFLT took 25.9s. Estimated remaining: 4m 47s. Rate: 7.5 symbols/min [2025-09-24T22:10:52.396464] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:10:52.433283] [DEBUG] [LOCAL ] XPER: Loaded 29640 existing records from primary storage. [2025-09-24T22:10:52.433456] [INFO ] [MAIN ] XPER: Loaded 29640 existing records. [2025-09-24T22:10:52.625364] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:10:52.625932] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-24T22:10:52.626028] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-24T22:10:52.626807] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-24T22:10:52.626867] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-24T22:10:52.816832] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-24T22:10:53.011458] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:10:53.030906] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-24T22:10:53.616100] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-24T22:10:54.090714] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-24T22:10:54.416093] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-24T22:10:54.513947] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-24T22:10:55.061817] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-24T22:10:55.216092] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-24T22:10:56.016186] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-24T22:10:56.787578] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-24T22:10:56.816035] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-24T22:10:56.881829] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-24T22:10:57.262684] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-24T22:10:57.616100] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-24T22:10:58.416095] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-24T22:10:58.977686] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T22:10:59.216132] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-24T22:10:59.332911] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-24T22:10:59.946045] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-24T22:11:00.016042] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-24T22:11:00.692046] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T22:11:00.816094] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-24T22:11:01.289217] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T22:11:01.616070] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-24T22:11:02.416084] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-24T22:11:02.531341] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-24T22:11:03.216092] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-24T22:11:03.823597] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-24T22:11:04.016146] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-24T22:11:04.259053] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-24T22:11:04.455175] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-24T22:11:04.816082] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-24T22:11:05.616076] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-24T22:11:05.668307] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-24T22:11:06.131131] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-24T22:11:06.416145] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-24T22:11:07.216085] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-24T22:11:07.705275] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-24T22:11:07.989636] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-24T22:11:08.016045] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-24T22:11:08.713065] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T22:11:08.724928] [INFO ] [REMOTE ] XIFR: Full fetch complete (54570 records). [2025-09-24T22:11:08.725099] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-24T22:11:08.821224] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-24T22:11:08.939884] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-24T22:11:08.957082] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-24T22:11:08.957287] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-24T22:11:08.957395] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-24T22:11:08.958813] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-24T22:11:08.958639] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-24T22:11:08.959016] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-24T22:11:08.966214] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-24T22:11:08.966883] [INFO ] [MAIN ] Update Progress: 2338/2373 symbols completed. XIFR took 32.4s. Estimated remaining: 4m 39s. Rate: 7.5 symbols/min [2025-09-24T22:11:09.143613] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:09.208791] [DEBUG] [LOCAL ] XPEV: Loaded 53641 existing records from primary storage. [2025-09-24T22:11:09.208971] [INFO ] [MAIN ] XPEV: Loaded 53641 existing records. [2025-09-24T22:11:09.386593] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:09.386857] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-24T22:11:09.386905] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-24T22:11:09.388195] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-24T22:11:09.388256] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-24T22:11:09.621378] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-24T22:11:09.758027] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:10.265343] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-24T22:11:10.273143] [INFO ] [REMOTE ] XHR: Full fetch complete (61547 records). [2025-09-24T22:11:10.273297] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-24T22:11:10.427635] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-24T22:11:10.691196] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-24T22:11:10.691288] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-24T22:11:10.692498] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-24T22:11:10.692590] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-24T22:11:10.694072] [DEBUG] [LOCAL ] XHR: Trimmed 61547 records to 44125 (keeping 200 days of data) [2025-09-24T22:11:10.985209] [DEBUG] [LOCAL ] XHR: Primary data saved (44125 records). [2025-09-24T22:11:10.985384] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-24T22:11:10.985582] [INFO ] [MAIN ] Update Progress: 2339/2373 symbols completed. XHR took 40.4s. Estimated remaining: 4m 31s. Rate: 7.5 symbols/min [2025-09-24T22:11:11.163020] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:11.212729] [DEBUG] [LOCAL ] XPO: Loaded 48148 existing records from primary storage. [2025-09-24T22:11:11.212873] [INFO ] [MAIN ] XPO: Loaded 48148 existing records. [2025-09-24T22:11:11.245886] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-24T22:11:11.396953] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:11.397238] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-24T22:11:11.397301] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-24T22:11:11.398627] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-24T22:11:11.398732] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-24T22:11:11.754191] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:12.016086] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-24T22:11:12.116893] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-24T22:11:12.600428] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T22:11:12.725717] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-24T22:11:12.816044] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-24T22:11:13.458628] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T22:11:13.616105] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-24T22:11:14.416085] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-24T22:11:14.850936] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-24T22:11:15.216078] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-24T22:11:15.966196] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-24T22:11:16.023067] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-24T22:11:16.029317] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-24T22:11:16.816083] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-24T22:11:17.215454] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T22:11:17.590931] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-24T22:11:17.616032] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-24T22:11:18.176172] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-24T22:11:18.416082] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-24T22:11:18.844951] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-24T22:11:18.857813] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-24T22:11:18.858000] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-24T22:11:19.225195] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-24T22:11:19.345343] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-24T22:11:19.345436] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-24T22:11:19.347206] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-24T22:11:19.347365] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-24T22:11:19.349515] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-09-24T22:11:19.702775] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-24T22:11:19.703115] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-24T22:11:19.703227] [INFO ] [MAIN ] Update Progress: 2340/2373 symbols completed. XOM took 37.5s. Estimated remaining: 4m 23s. Rate: 7.5 symbols/min [2025-09-24T22:11:19.887721] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:19.930327] [DEBUG] [LOCAL ] XPOF: Loaded 38831 existing records from primary storage. [2025-09-24T22:11:19.930521] [INFO ] [MAIN ] XPOF: Loaded 38831 existing records. [2025-09-24T22:11:20.019300] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-24T22:11:20.134050] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-24T22:11:20.194920] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:20.195555] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-24T22:11:20.195615] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-24T22:11:20.197063] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-24T22:11:20.197128] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-24T22:11:20.567831] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:20.816091] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-24T22:11:21.183720] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-24T22:11:21.212909] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-24T22:11:21.219560] [INFO ] [REMOTE ] XPER: Full fetch complete (43184 records). [2025-09-24T22:11:21.219755] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-24T22:11:21.621520] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-24T22:11:21.623975] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-24T22:11:21.624123] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-24T22:11:21.625263] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-24T22:11:21.626279] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-24T22:11:21.637448] [DEBUG] [LOCAL ] XPER: Trimmed 43184 records to 29606 (keeping 200 days of data) [2025-09-24T22:11:21.651922] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-24T22:11:21.824216] [DEBUG] [LOCAL ] XPER: Primary data saved (29606 records). [2025-09-24T22:11:21.824358] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-24T22:11:21.824482] [INFO ] [MAIN ] Update Progress: 2341/2373 symbols completed. XPER took 29.6s. Estimated remaining: 4m 15s. Rate: 7.5 symbols/min [2025-09-24T22:11:22.012271] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:22.064519] [DEBUG] [LOCAL ] XPRO: Loaded 46074 existing records from primary storage. [2025-09-24T22:11:22.064714] [INFO ] [MAIN ] XPRO: Loaded 46074 existing records. [2025-09-24T22:11:22.243067] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:22.243366] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-24T22:11:22.243434] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-24T22:11:22.244491] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-24T22:11:22.244559] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-24T22:11:22.416355] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-24T22:11:22.613767] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:23.216097] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-24T22:11:23.426492] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-24T22:11:24.016126] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-24T22:11:24.808966] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T22:11:24.818976] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-24T22:11:24.992075] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-24T22:11:25.616065] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-24T22:11:25.731007] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-24T22:11:25.960024] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-24T22:11:26.416118] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-24T22:11:27.198613] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T22:11:27.216036] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-24T22:11:27.700200] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-24T22:11:28.016115] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-24T22:11:28.670158] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-24T22:11:28.816133] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-24T22:11:29.616102] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-24T22:11:30.213261] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-24T22:11:30.417799] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-24T22:11:30.426244] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-24T22:11:31.216068] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-24T22:11:31.247039] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T22:11:32.018132] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-24T22:11:32.023427] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-24T22:11:32.821327] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-24T22:11:32.850353] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T22:11:33.532733] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-24T22:11:33.616096] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-24T22:11:34.416088] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-24T22:11:34.548543] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-24T22:11:35.216092] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-24T22:11:35.708764] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-24T22:11:36.021160] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-24T22:11:36.038586] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-24T22:11:36.816089] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-24T22:11:36.857174] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-24T22:11:36.865283] [INFO ] [REMOTE ] XPO: Full fetch complete (70107 records). [2025-09-24T22:11:36.865412] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-24T22:11:37.257854] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-24T22:11:37.257935] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-24T22:11:37.259234] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-24T22:11:37.259299] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-24T22:11:37.260779] [DEBUG] [LOCAL ] XPO: Trimmed 70107 records to 48080 (keeping 200 days of data) [2025-09-24T22:11:37.547019] [DEBUG] [LOCAL ] XPO: Primary data saved (48080 records). [2025-09-24T22:11:37.547151] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-24T22:11:37.547250] [INFO ] [MAIN ] Update Progress: 2342/2373 symbols completed. XPO took 26.6s. Estimated remaining: 4m 7s. Rate: 7.5 symbols/min [2025-09-24T22:11:37.622082] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-24T22:11:37.719831] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:37.748890] [DEBUG] [LOCAL ] XYF: Loaded 28034 existing records from primary storage. [2025-09-24T22:11:37.749043] [INFO ] [MAIN ] XYF: Loaded 28034 existing records. [2025-09-24T22:11:37.930990] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:37.931236] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-24T22:11:37.931316] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-24T22:11:37.932019] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-24T22:11:37.932080] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-24T22:11:38.299581] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:38.338320] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-24T22:11:38.412284] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-24T22:11:38.423791] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-24T22:11:39.108792] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-24T22:11:39.216041] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-24T22:11:40.016063] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-24T22:11:40.169382] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-24T22:11:40.635492] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-24T22:11:40.816064] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-24T22:11:40.867342] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-24T22:11:41.409567] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-24T22:11:41.616051] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-24T22:11:42.416096] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-24T22:11:42.920175] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-24T22:11:43.216061] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-24T22:11:43.281609] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-24T22:11:44.016105] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-24T22:11:44.720615] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-24T22:11:44.816100] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-24T22:11:45.215845] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-24T22:11:45.616121] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-24T22:11:46.349042] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-24T22:11:46.416077] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-24T22:11:47.216102] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-24T22:11:47.672008] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-24T22:11:47.679880] [INFO ] [REMOTE ] XPRO: Full fetch complete (66607 records). [2025-09-24T22:11:47.680004] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-24T22:11:48.020402] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-24T22:11:48.080547] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-24T22:11:48.080817] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-24T22:11:48.082093] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-24T22:11:48.082191] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-24T22:11:48.083936] [DEBUG] [LOCAL ] XPRO: Trimmed 66607 records to 45971 (keeping 200 days of data) [2025-09-24T22:11:48.202105] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-24T22:11:48.371211] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-24T22:11:48.428401] [DEBUG] [LOCAL ] XPRO: Primary data saved (45971 records). [2025-09-24T22:11:48.428560] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-24T22:11:48.428674] [INFO ] [MAIN ] Update Progress: 2343/2373 symbols completed. XPRO took 26.6s. Estimated remaining: 3m 59s. Rate: 7.5 symbols/min [2025-09-24T22:11:48.637045] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:48.694401] [DEBUG] [LOCAL ] XYL: Loaded 48125 existing records from primary storage. [2025-09-24T22:11:48.694587] [INFO ] [MAIN ] XYL: Loaded 48125 existing records. [2025-09-24T22:11:48.821250] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-24T22:11:48.891297] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:48.891589] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-24T22:11:48.891663] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-24T22:11:48.892983] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-24T22:11:48.893045] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-24T22:11:49.261748] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:49.616109] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-24T22:11:49.657426] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-24T22:11:49.722630] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-24T22:11:50.416143] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-24T22:11:51.182157] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T22:11:51.216034] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-24T22:11:52.016127] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-24T22:11:52.759050] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-24T22:11:52.769301] [INFO ] [REMOTE ] XPEV: Full fetch complete (77679 records). [2025-09-24T22:11:52.769478] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-24T22:11:52.835025] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-24T22:11:53.108676] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-24T22:11:53.223016] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-24T22:11:53.223135] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-24T22:11:53.224520] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-24T22:11:53.224756] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-24T22:11:53.248837] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-24T22:11:53.255752] [DEBUG] [LOCAL ] XPEV: Trimmed 77679 records to 53639 (keeping 200 days of data) [2025-09-24T22:11:53.589141] [DEBUG] [LOCAL ] XPEV: Primary data saved (53639 records). [2025-09-24T22:11:53.589286] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-24T22:11:53.589375] [INFO ] [MAIN ] Update Progress: 2344/2373 symbols completed. XPEV took 44.6s. Estimated remaining: 3m 51s. Rate: 7.5 symbols/min [2025-09-24T22:11:53.621243] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-24T22:11:53.765817] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:53.766085] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-24T22:11:53.766225] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-24T22:11:53.766482] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-24T22:11:53.766556] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-24T22:11:53.766659] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-24T22:11:53.766736] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-24T22:11:54.067024] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T22:11:54.094881] [INFO ] [REMOTE ] XPOF: Full fetch complete (52230 records). [2025-09-24T22:11:54.114043] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-24T22:11:54.231772] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:54.424098] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-24T22:11:54.589805] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-24T22:11:54.589884] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-24T22:11:54.590984] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-24T22:11:54.591047] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-24T22:11:54.592135] [DEBUG] [LOCAL ] XPOF: Trimmed 52230 records to 38829 (keeping 200 days of data) [2025-09-24T22:11:54.817327] [DEBUG] [LOCAL ] XPOF: Primary data saved (38829 records). [2025-09-24T22:11:54.817482] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-24T22:11:54.817578] [INFO ] [MAIN ] Update Progress: 2345/2373 symbols completed. XPOF took 35.1s. Estimated remaining: 3m 43s. Rate: 7.5 symbols/min [2025-09-24T22:11:54.996694] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:11:55.034146] [DEBUG] [LOCAL ] YALA: Loaded 37425 existing records from primary storage. [2025-09-24T22:11:55.034281] [INFO ] [MAIN ] YALA: Loaded 37425 existing records. [2025-09-24T22:11:55.212456] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:11:55.212713] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-24T22:11:55.212770] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-24T22:11:55.213898] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-24T22:11:55.213957] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-24T22:11:55.245500] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-24T22:11:55.584050] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:11:55.609829] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-24T22:11:55.853485] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-24T22:11:55.853968] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-24T22:11:55.880813] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-24T22:11:56.016116] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-24T22:11:56.816092] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-24T22:11:57.616082] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-24T22:11:58.007052] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-24T22:11:58.009429] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-24T22:11:58.416158] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-24T22:11:58.530173] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-24T22:11:59.216109] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-24T22:12:00.016124] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-24T22:12:00.087293] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-24T22:12:00.816102] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-24T22:12:01.250271] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-24T22:12:01.256890] [INFO ] [REMOTE ] XYF: Full fetch complete (31557 records). [2025-09-24T22:12:01.257137] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-24T22:12:01.625045] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-24T22:12:01.671269] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-24T22:12:01.671442] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-24T22:12:01.672496] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-24T22:12:01.672739] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-24T22:12:01.688759] [DEBUG] [LOCAL ] XYF: Trimmed 31557 records to 28209 (keeping 200 days of data) [2025-09-24T22:12:01.718249] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-24T22:12:01.948013] [DEBUG] [LOCAL ] XYF: Primary data saved (28209 records). [2025-09-24T22:12:01.948177] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-24T22:12:01.948277] [INFO ] [MAIN ] Update Progress: 2346/2373 symbols completed. XYF took 24.4s. Estimated remaining: 3m 35s. Rate: 7.5 symbols/min [2025-09-24T22:12:02.132572] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:02.149322] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-24T22:12:02.201295] [DEBUG] [LOCAL ] YELP: Loaded 45370 existing records from primary storage. [2025-09-24T22:12:02.201491] [INFO ] [MAIN ] YELP: Loaded 45370 existing records. [2025-09-24T22:12:02.387345] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:02.387618] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-24T22:12:02.387702] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-24T22:12:02.388823] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-24T22:12:02.388890] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-24T22:12:02.421263] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-24T22:12:02.767220] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:03.216097] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-24T22:12:04.016152] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-24T22:12:04.760001] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-24T22:12:04.807280] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-24T22:12:04.816020] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-24T22:12:05.571080] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-24T22:12:05.616082] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-24T22:12:05.831040] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-24T22:12:06.017130] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (3.60 seconds). [2025-09-24T22:12:06.416079] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-24T22:12:07.063700] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-24T22:12:07.216145] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-24T22:12:07.769442] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-24T22:12:08.016132] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-24T22:12:08.634070] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-24T22:12:08.816091] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-24T22:12:09.585003] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T22:12:09.616036] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-24T22:12:10.416057] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-24T22:12:10.445810] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-24T22:12:10.882570] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-24T22:12:11.216101] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-24T22:12:12.016082] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-24T22:12:12.175737] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-24T22:12:12.526442] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-24T22:12:12.816098] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-24T22:12:13.616121] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-24T22:12:14.358213] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-24T22:12:14.402275] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-24T22:12:14.416031] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-24T22:12:14.727736] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-24T22:12:14.736496] [INFO ] [REMOTE ] XYL: Full fetch complete (69893 records). [2025-09-24T22:12:14.736626] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-24T22:12:15.113591] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T22:12:15.179421] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-24T22:12:15.179504] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-24T22:12:15.180765] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-24T22:12:15.180831] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-24T22:12:15.182224] [DEBUG] [LOCAL ] XYL: Trimmed 69893 records to 48124 (keeping 200 days of data) [2025-09-24T22:12:15.237954] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-24T22:12:15.488784] [DEBUG] [LOCAL ] XYL: Primary data saved (48124 records). [2025-09-24T22:12:15.488924] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-24T22:12:15.489012] [INFO ] [MAIN ] Update Progress: 2347/2373 symbols completed. XYL took 27.1s. Estimated remaining: 3m 28s. Rate: 7.5 symbols/min [2025-09-24T22:12:15.658490] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:15.709533] [DEBUG] [LOCAL ] YETI: Loaded 52472 existing records from primary storage. [2025-09-24T22:12:15.709707] [INFO ] [MAIN ] YETI: Loaded 52472 existing records. [2025-09-24T22:12:15.888883] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:15.889124] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-24T22:12:15.889172] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-24T22:12:15.890556] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-24T22:12:15.890619] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-24T22:12:16.032174] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-24T22:12:16.292506] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:16.816058] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-24T22:12:16.913681] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-24T22:12:17.616055] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-24T22:12:17.842881] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T22:12:18.416074] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-24T22:12:19.216109] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-24T22:12:19.576456] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-24T22:12:19.654016] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-24T22:12:20.016072] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-24T22:12:20.174412] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-24T22:12:20.816066] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-24T22:12:21.021500] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-24T22:12:21.616053] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-24T22:12:21.805435] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-24T22:12:21.971903] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T22:12:22.416165] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-24T22:12:23.216048] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-24T22:12:23.245562] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-24T22:12:23.297777] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T22:12:23.303214] [INFO ] [REMOTE ] YALA: Full fetch complete (46588 records). [2025-09-24T22:12:23.303346] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-24T22:12:23.703511] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-24T22:12:23.703617] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-24T22:12:23.704848] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-24T22:12:23.704916] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-24T22:12:23.706273] [DEBUG] [LOCAL ] YALA: Trimmed 46588 records to 37494 (keeping 200 days of data) [2025-09-24T22:12:23.946257] [DEBUG] [LOCAL ] YALA: Primary data saved (37494 records). [2025-09-24T22:12:23.946412] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-24T22:12:23.946505] [INFO ] [MAIN ] Update Progress: 2348/2373 symbols completed. YALA took 29.1s. Estimated remaining: 3m 20s. Rate: 7.5 symbols/min [2025-09-24T22:12:24.021190] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-24T22:12:24.139492] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:24.185291] [DEBUG] [LOCAL ] YEXT: Loaded 43298 existing records from primary storage. [2025-09-24T22:12:24.185445] [INFO ] [MAIN ] YEXT: Loaded 43298 existing records. [2025-09-24T22:12:24.381149] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:24.381382] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-24T22:12:24.381467] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-24T22:12:24.382568] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-24T22:12:24.382628] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-24T22:12:24.740760] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:24.816031] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-24T22:12:24.853501] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-24T22:12:25.616108] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-24T22:12:26.238256] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-24T22:12:26.299394] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T22:12:26.416152] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-24T22:12:27.216141] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-24T22:12:27.414980] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T22:12:28.016125] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-24T22:12:28.816103] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-24T22:12:28.883375] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-24T22:12:28.990055] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-24T22:12:29.140529] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-24T22:12:29.149275] [INFO ] [REMOTE ] YELP: Full fetch complete (64206 records). [2025-09-24T22:12:29.149478] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-24T22:12:29.566987] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-24T22:12:29.567141] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-24T22:12:29.569169] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-24T22:12:29.569258] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-24T22:12:29.571105] [DEBUG] [LOCAL ] YELP: Trimmed 64206 records to 45313 (keeping 200 days of data) [2025-09-24T22:12:29.620732] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-24T22:12:29.851983] [DEBUG] [LOCAL ] YELP: Primary data saved (45313 records). [2025-09-24T22:12:29.852146] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-24T22:12:29.852244] [INFO ] [MAIN ] Update Progress: 2349/2373 symbols completed. YELP took 27.9s. Estimated remaining: 3m 12s. Rate: 7.5 symbols/min [2025-09-24T22:12:30.039831] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:30.040179] [DEBUG] [LOCAL ] YMM: No existing data file found in primary storage. [2025-09-24T22:12:30.040293] [WARN ] [MAIN ] YMM: No existing data found, performing full refresh instead. [2025-09-24T22:12:30.040541] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-24T22:12:30.040710] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-24T22:12:30.040939] [DEBUG] [LOCAL ] YMM: No primary data file found to delete. [2025-09-24T22:12:30.041060] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-24T22:12:30.230445] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T22:12:30.426429] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-24T22:12:30.471304] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:31.216092] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-24T22:12:31.474631] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-24T22:12:31.919851] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-24T22:12:32.016070] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-24T22:12:32.806374] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-24T22:12:32.816994] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-24T22:12:33.553789] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-24T22:12:33.564681] [INFO ] [REMOTE ] XYZ: Full fetch complete (66617 records). [2025-09-24T22:12:33.564948] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-24T22:12:33.621355] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-24T22:12:33.818313] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-24T22:12:33.849665] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-24T22:12:33.851569] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-24T22:12:33.851680] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-24T22:12:33.851762] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-24T22:12:33.851859] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-24T22:12:33.851922] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-24T22:12:33.851995] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-24T22:12:33.852105] [INFO ] [MAIN ] Update Progress: 2350/2373 symbols completed. XYZ took 40.3s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-24T22:12:34.052506] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:34.107065] [DEBUG] [LOCAL ] YOU: Loaded 49867 existing records from primary storage. [2025-09-24T22:12:34.107308] [INFO ] [MAIN ] YOU: Loaded 49867 existing records. [2025-09-24T22:12:34.320976] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:34.321355] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-24T22:12:34.321410] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-24T22:12:34.323723] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-24T22:12:34.323791] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-24T22:12:34.423012] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-24T22:12:34.723776] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:35.216056] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-24T22:12:35.459692] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-24T22:12:36.016093] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-24T22:12:36.041952] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T22:12:36.816086] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-24T22:12:37.616124] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-24T22:12:37.874493] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-24T22:12:38.267837] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-24T22:12:38.416084] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-24T22:12:39.143888] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-24T22:12:39.216191] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-24T22:12:39.567137] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-24T22:12:40.000589] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-24T22:12:40.016037] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-24T22:12:40.786702] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-24T22:12:40.816037] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-24T22:12:41.616088] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-24T22:12:41.755888] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-24T22:12:42.296425] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-24T22:12:42.416107] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-24T22:12:43.179446] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T22:12:43.216045] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-24T22:12:44.016055] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-24T22:12:44.126748] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-24T22:12:44.816062] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-24T22:12:44.971612] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-24T22:12:45.617459] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-24T22:12:45.617374] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-24T22:12:46.416065] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-24T22:12:46.564989] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-24T22:12:47.077364] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-24T22:12:47.216079] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-24T22:12:48.016065] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-24T22:12:48.082922] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-24T22:12:48.669014] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-24T22:12:48.677185] [INFO ] [REMOTE ] YEXT: Full fetch complete (63518 records). [2025-09-24T22:12:48.677316] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-24T22:12:48.821167] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-24T22:12:49.076971] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-24T22:12:49.077064] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-24T22:12:49.078252] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-24T22:12:49.078317] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-24T22:12:49.079614] [DEBUG] [LOCAL ] YEXT: Trimmed 63518 records to 43265 (keeping 200 days of data) [2025-09-24T22:12:49.343281] [DEBUG] [LOCAL ] YEXT: Primary data saved (43265 records). [2025-09-24T22:12:49.343581] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-24T22:12:49.343823] [INFO ] [MAIN ] Update Progress: 2351/2373 symbols completed. YEXT took 25.4s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-24T22:12:49.543339] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:49.579674] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-24T22:12:49.621144] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-24T22:12:49.647340] [DEBUG] [LOCAL ] YPF: Loaded 50493 existing records from primary storage. [2025-09-24T22:12:49.647614] [INFO ] [MAIN ] YPF: Loaded 50493 existing records. [2025-09-24T22:12:49.859608] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:49.860013] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-24T22:12:49.860068] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-24T22:12:49.861557] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-24T22:12:49.861636] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-24T22:12:50.238911] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:50.416140] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-24T22:12:50.674807] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-24T22:12:51.216055] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-24T22:12:51.331582] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-24T22:12:51.896285] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-24T22:12:52.016061] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-24T22:12:52.813425] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-24T22:12:52.826500] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-24T22:12:53.375112] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-24T22:12:53.616086] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-24T22:12:54.181728] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T22:12:54.191214] [INFO ] [REMOTE ] YETI: Full fetch complete (75408 records). [2025-09-24T22:12:54.191368] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-24T22:12:54.426482] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-24T22:12:54.631249] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-24T22:12:54.631339] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-24T22:12:54.632817] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-24T22:12:54.632891] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-24T22:12:54.634505] [DEBUG] [LOCAL ] YETI: Trimmed 75408 records to 52468 (keeping 200 days of data) [2025-09-24T22:12:54.966424] [DEBUG] [LOCAL ] YETI: Primary data saved (52468 records). [2025-09-24T22:12:54.966572] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-24T22:12:54.966712] [INFO ] [MAIN ] Update Progress: 2352/2373 symbols completed. YETI took 39.5s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-24T22:12:55.172751] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:12:55.174962] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-24T22:12:55.197735] [DEBUG] [LOCAL ] YRD: Loaded 12584 existing records from primary storage. [2025-09-24T22:12:55.197862] [INFO ] [MAIN ] YRD: Loaded 12584 existing records. [2025-09-24T22:12:55.221239] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-24T22:12:55.386388] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:12:55.386677] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-24T22:12:55.386785] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-24T22:12:55.387214] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-24T22:12:55.387278] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-24T22:12:55.755227] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:12:56.016106] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-24T22:12:56.263889] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-24T22:12:56.816119] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-24T22:12:56.923413] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-24T22:12:57.082804] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-24T22:12:57.616104] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-24T22:12:58.416092] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-24T22:12:58.677964] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:12:59.196660] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-24T22:12:59.216039] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-24T22:12:59.547320] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-24T22:13:00.016118] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-24T22:13:00.816062] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-24T22:13:00.978065] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-24T22:13:01.616064] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-24T22:13:01.777114] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-24T22:13:01.803930] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-24T22:13:02.416111] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-24T22:13:03.216115] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-24T22:13:03.348822] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-24T22:13:03.357383] [INFO ] [REMOTE ] YOU: Full fetch complete (72164 records). [2025-09-24T22:13:03.357536] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-24T22:13:03.766683] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-24T22:13:03.766836] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-24T22:13:03.768384] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-24T22:13:03.768479] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-24T22:13:03.770626] [DEBUG] [LOCAL ] YOU: Trimmed 72164 records to 49833 (keeping 200 days of data) [2025-09-24T22:13:04.023283] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-24T22:13:04.030850] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-24T22:13:04.137563] [DEBUG] [LOCAL ] YOU: Primary data saved (49833 records). [2025-09-24T22:13:04.137749] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-24T22:13:04.137909] [INFO ] [MAIN ] Update Progress: 2353/2373 symbols completed. YOU took 30.3s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-24T22:13:04.312436] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:04.338722] [DEBUG] [LOCAL ] YSG: Loaded 24977 existing records from primary storage. [2025-09-24T22:13:04.338868] [INFO ] [MAIN ] YSG: Loaded 24977 existing records. [2025-09-24T22:13:04.517024] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:04.517376] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-24T22:13:04.517551] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-24T22:13:04.518280] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-24T22:13:04.518346] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-24T22:13:04.819728] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-24T22:13:04.903255] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:04.952090] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-24T22:13:04.979592] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-24T22:13:05.616091] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-24T22:13:06.414894] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-24T22:13:06.424716] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-24T22:13:06.616083] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-24T22:13:07.216081] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-24T22:13:08.020227] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-24T22:13:08.023210] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-24T22:13:08.283937] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:13:08.816086] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-24T22:13:09.616122] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-24T22:13:09.761791] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-24T22:13:09.794925] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-24T22:13:10.416097] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-24T22:13:11.204798] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-24T22:13:11.216045] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-24T22:13:11.284942] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T22:13:12.016081] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-24T22:13:12.090509] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-24T22:13:12.816089] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-24T22:13:13.087082] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-24T22:13:13.616117] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-24T22:13:13.626739] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-24T22:13:13.629268] [INFO ] [REMOTE ] YRD: Full fetch complete (19212 records). [2025-09-24T22:13:13.629344] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-24T22:13:14.021363] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-24T22:13:14.021491] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-24T22:13:14.022061] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-24T22:13:14.022149] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-24T22:13:14.022785] [DEBUG] [LOCAL ] YRD: Trimmed 19212 records to 12584 (keeping 200 days of data) [2025-09-24T22:13:14.105046] [DEBUG] [LOCAL ] YRD: Primary data saved (12584 records). [2025-09-24T22:13:14.105202] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-24T22:13:14.105322] [INFO ] [MAIN ] Update Progress: 2354/2373 symbols completed. YRD took 19.1s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-24T22:13:14.278674] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:14.345904] [DEBUG] [LOCAL ] YUM: Loaded 51264 existing records from primary storage. [2025-09-24T22:13:14.346061] [INFO ] [MAIN ] YUM: Loaded 51264 existing records. [2025-09-24T22:13:14.423982] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-24T22:13:14.533473] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:14.533743] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-24T22:13:14.533801] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-24T22:13:14.535254] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-24T22:13:14.535327] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-24T22:13:14.809398] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-24T22:13:14.920876] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:15.216089] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-24T22:13:16.016096] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-24T22:13:16.209370] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-24T22:13:16.219576] [INFO ] [REMOTE ] YPF: Full fetch complete (73528 records). [2025-09-24T22:13:16.219746] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-24T22:13:16.612388] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-24T22:13:16.612574] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-24T22:13:16.614014] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-24T22:13:16.614080] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-24T22:13:16.615635] [DEBUG] [LOCAL ] YPF: Trimmed 73528 records to 50499 (keeping 200 days of data) [2025-09-24T22:13:16.739348] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-24T22:13:16.820009] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-24T22:13:16.982756] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-24T22:13:17.006274] [DEBUG] [LOCAL ] YPF: Primary data saved (50499 records). [2025-09-24T22:13:17.006440] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-24T22:13:17.006666] [INFO ] [MAIN ] Update Progress: 2355/2373 symbols completed. YPF took 27.7s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-24T22:13:17.192354] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:17.248160] [DEBUG] [LOCAL ] YUMC: Loaded 52708 existing records from primary storage. [2025-09-24T22:13:17.248318] [INFO ] [MAIN ] YUMC: Loaded 52708 existing records. [2025-09-24T22:13:17.435348] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:17.435613] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-24T22:13:17.435706] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-24T22:13:17.441617] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-24T22:13:17.441801] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-24T22:13:17.616085] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-24T22:13:17.835500] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:17.896599] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-24T22:13:18.416089] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-24T22:13:19.216100] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-24T22:13:19.358745] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-24T22:13:19.370090] [INFO ] [REMOTE ] YMM: Full fetch complete (76440 records). [2025-09-24T22:13:19.370285] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-24T22:13:19.502214] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-24T22:13:19.893974] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-24T22:13:19.894067] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-24T22:13:19.895376] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-24T22:13:19.895441] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-24T22:13:19.897019] [DEBUG] [LOCAL ] YMM: Trimmed 76440 records to 52676 (keeping 200 days of data) [2025-09-24T22:13:20.017024] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-24T22:13:20.246146] [DEBUG] [LOCAL ] YMM: Primary data saved (52676 records). [2025-09-24T22:13:20.246306] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-24T22:13:20.246450] [INFO ] [MAIN ] Update Progress: 2356/2373 symbols completed. YMM took 50.4s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-24T22:13:20.421880] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:20.476067] [DEBUG] [LOCAL ] ZBH: Loaded 51247 existing records from primary storage. [2025-09-24T22:13:20.476224] [INFO ] [MAIN ] ZBH: Loaded 51247 existing records. [2025-09-24T22:13:20.660775] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:20.661098] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-24T22:13:20.661238] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-24T22:13:20.662858] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-24T22:13:20.662921] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-24T22:13:20.819263] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-24T22:13:21.074947] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-24T22:13:21.079212] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:21.590804] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-24T22:13:21.616037] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-24T22:13:21.763725] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-24T22:13:22.416098] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-24T22:13:23.216068] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-24T22:13:23.296968] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-24T22:13:24.016072] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-24T22:13:24.261562] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-24T22:13:24.816067] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-24T22:13:25.003108] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-24T22:13:25.427778] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-24T22:13:25.616106] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-24T22:13:26.205810] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T22:13:26.416107] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-24T22:13:27.088409] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-24T22:13:27.216086] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-24T22:13:27.965626] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-24T22:13:28.016085] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-24T22:13:28.504387] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-24T22:13:28.816186] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-24T22:13:29.616070] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-24T22:13:29.706077] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-24T22:13:29.897557] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-24T22:13:29.903570] [INFO ] [REMOTE ] YSG: Full fetch complete (32779 records). [2025-09-24T22:13:29.903742] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-24T22:13:30.295137] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-24T22:13:30.295229] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-24T22:13:30.296079] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-24T22:13:30.296150] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-24T22:13:30.297093] [DEBUG] [LOCAL ] YSG: Trimmed 32779 records to 25192 (keeping 200 days of data) [2025-09-24T22:13:30.419604] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-24T22:13:30.461033] [DEBUG] [LOCAL ] YSG: Primary data saved (25192 records). [2025-09-24T22:13:30.461148] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-24T22:13:30.461310] [INFO ] [MAIN ] Update Progress: 2357/2373 symbols completed. YSG took 26.3s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-24T22:13:31.216058] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-24T22:13:31.400786] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-24T22:13:32.016097] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-24T22:13:32.241152] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T22:13:32.816105] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-24T22:13:33.211253] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-24T22:13:33.274035] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-24T22:13:33.616076] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-24T22:13:34.416129] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-24T22:13:34.634915] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-24T22:13:35.216052] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-24T22:13:35.432087] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-24T22:13:36.016095] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-24T22:13:36.158622] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-24T22:13:36.816157] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-24T22:13:36.983933] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-24T22:13:37.536842] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-24T22:13:37.616069] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-24T22:13:38.416132] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-24T22:13:38.816430] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-24T22:13:38.890854] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T22:13:39.216114] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-24T22:13:40.016136] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-24T22:13:40.127383] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T22:13:40.816124] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-24T22:13:41.090382] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-24T22:13:41.567631] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-24T22:13:41.616051] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-24T22:13:42.151586] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-24T22:13:42.161226] [INFO ] [REMOTE ] YUMC: Full fetch complete (76158 records). [2025-09-24T22:13:42.161410] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-24T22:13:42.430257] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-24T22:13:42.572146] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-24T22:13:42.572246] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-24T22:13:42.573833] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-24T22:13:42.573932] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-24T22:13:42.575601] [DEBUG] [LOCAL ] YUMC: Trimmed 76158 records to 52698 (keeping 200 days of data) [2025-09-24T22:13:42.915127] [DEBUG] [LOCAL ] YUMC: Primary data saved (52698 records). [2025-09-24T22:13:42.915298] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-24T22:13:42.915397] [INFO ] [MAIN ] Update Progress: 2358/2373 symbols completed. YUMC took 25.9s. Estimated remaining: 1m 60s. Rate: 7.5 symbols/min [2025-09-24T22:13:43.517015] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-24T22:13:43.532042] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-24T22:13:44.271109] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-24T22:13:44.297285] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-24T22:13:44.311233] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-24T22:13:44.323009] [INFO ] [REMOTE ] YUM: Full fetch complete (74367 records). [2025-09-24T22:13:44.323141] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-24T22:13:44.717774] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-24T22:13:44.717880] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-24T22:13:44.719233] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-24T22:13:44.719308] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-24T22:13:44.720907] [DEBUG] [LOCAL ] YUM: Trimmed 74367 records to 51236 (keeping 200 days of data) [2025-09-24T22:13:45.057384] [DEBUG] [LOCAL ] YUM: Primary data saved (51236 records). [2025-09-24T22:13:45.057548] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-24T22:13:45.057677] [INFO ] [MAIN ] Update Progress: 2359/2373 symbols completed. YUM took 31.0s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-24T22:13:46.158247] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-24T22:13:46.170675] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-24T22:13:47.970291] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T22:13:47.981329] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-24T22:13:49.820057] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-24T22:13:49.829461] [INFO ] [REMOTE ] ZBH: Full fetch complete (73841 records). [2025-09-24T22:13:49.829698] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-24T22:13:50.239289] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-24T22:13:50.239385] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-24T22:13:50.240737] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-24T22:13:50.240806] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-24T22:13:50.242503] [DEBUG] [LOCAL ] ZBH: Trimmed 73841 records to 51231 (keeping 200 days of data) [2025-09-24T22:13:50.568545] [DEBUG] [LOCAL ] ZBH: Primary data saved (51231 records). [2025-09-24T22:13:50.568774] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-24T22:13:50.568886] [INFO ] [MAIN ] Update Progress: 2360/2373 symbols completed. ZBH took 30.3s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-24T22:13:51.167217] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:51.300505] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:51.223553] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:51.331809] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:13:51.372566] [DEBUG] [LOCAL ] ZEPP: Loaded 16807 existing records from primary storage. [2025-09-24T22:13:51.372880] [INFO ] [MAIN ] ZEPP: Loaded 16807 existing records. [2025-09-24T22:13:51.386225] [DEBUG] [LOCAL ] ZH: Loaded 26759 existing records from primary storage. [2025-09-24T22:13:51.405529] [INFO ] [MAIN ] ZH: Loaded 26759 existing records. [2025-09-24T22:13:51.711957] [DEBUG] [LOCAL ] ZGN: Loaded 40910 existing records from primary storage. [2025-09-24T22:13:51.719170] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-24T22:13:51.719307] [INFO ] [MAIN ] ZGN: Loaded 40910 existing records. [2025-09-24T22:13:51.791165] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:51.756626] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-24T22:13:51.900728] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-24T22:13:51.984197] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:51.965137] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-24T22:13:52.033098] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-24T22:13:52.038345] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-24T22:13:52.059309] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-24T22:13:52.070534] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-24T22:13:52.111921] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-24T22:13:52.160814] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-24T22:13:52.399511] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:52.482510] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:13:52.493295] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-24T22:13:52.498816] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-24T22:13:52.552010] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-24T22:13:52.578406] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-24T22:13:52.594041] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-24T22:13:52.680427] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-24T22:13:52.696687] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-24T22:13:52.695017] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-24T22:13:53.452832] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:53.471988] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:53.508065] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-24T22:13:53.495933] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-24T22:13:53.894115] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:53.905342] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-24T22:13:53.936637] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:13:53.936967] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-24T22:13:54.244630] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-24T22:13:54.245998] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-24T22:13:54.711624] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-24T22:13:54.716871] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-24T22:13:54.786116] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-24T22:13:54.787449] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-24T22:13:55.252470] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T22:13:55.260966] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-24T22:13:55.368041] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-24T22:13:55.369429] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-24T22:13:55.438019] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-24T22:13:55.442687] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-24T22:13:55.952626] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-24T22:13:55.954334] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-24T22:13:56.521487] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-24T22:13:56.536633] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-24T22:13:56.537553] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-24T22:13:56.539572] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-24T22:13:56.651052] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-24T22:13:56.786847] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-24T22:13:56.816106] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-24T22:13:57.170222] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-24T22:13:57.616155] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-24T22:13:58.263282] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-24T22:13:58.416126] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-24T22:13:58.505195] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-24T22:13:58.574771] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-24T22:13:59.016415] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-24T22:13:59.216117] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-24T22:14:00.016163] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-24T22:14:00.816211] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-24T22:14:01.333930] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-24T22:14:01.430611] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-24T22:14:01.616145] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-24T22:14:02.398951] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-24T22:14:02.416035] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-24T22:14:02.953035] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-24T22:14:03.216087] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-24T22:14:04.021825] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-24T22:14:04.033481] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-24T22:14:04.132278] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-24T22:14:04.816100] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-24T22:14:05.616100] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-24T22:14:05.687636] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-24T22:14:05.803332] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-24T22:14:06.416093] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-24T22:14:07.121023] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-24T22:14:07.216088] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-24T22:14:08.016082] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-24T22:14:08.448890] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-24T22:14:08.611827] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-24T22:14:08.816076] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-24T22:14:09.574636] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-24T22:14:09.616034] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-24T22:14:10.416111] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-24T22:14:10.769057] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-24T22:14:11.158802] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-24T22:14:11.216080] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-24T22:14:11.806032] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-24T22:14:11.812022] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18269 records). [2025-09-24T22:14:11.812121] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-24T22:14:12.024461] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-24T22:14:12.196350] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-24T22:14:12.196449] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-24T22:14:12.197003] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-24T22:14:12.197072] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-24T22:14:12.197752] [DEBUG] [LOCAL ] ZEPP: Trimmed 18269 records to 16916 (keeping 200 days of data) [2025-09-24T22:14:12.299268] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16916 records). [2025-09-24T22:14:12.299428] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-24T22:14:12.299522] [INFO ] [MAIN ] Update Progress: 2361/2373 symbols completed. ZEPP took 21.7s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-24T22:14:12.500862] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:12.559395] [DEBUG] [LOCAL ] ZIM: Loaded 53542 existing records from primary storage. [2025-09-24T22:14:12.559559] [INFO ] [MAIN ] ZIM: Loaded 53542 existing records. [2025-09-24T22:14:12.747191] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:12.747477] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-24T22:14:12.747529] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-24T22:14:12.749027] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-24T22:14:12.749092] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-24T22:14:12.819485] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-24T22:14:13.124842] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:13.261435] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-24T22:14:13.460818] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-24T22:14:13.616065] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-24T22:14:13.984326] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-24T22:14:14.416092] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-24T22:14:15.216101] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-24T22:14:15.687706] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-24T22:14:15.693259] [INFO ] [REMOTE ] ZH: Full fetch complete (40062 records). [2025-09-24T22:14:15.693378] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-24T22:14:16.024501] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-24T22:14:16.144772] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-24T22:14:16.160161] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-24T22:14:16.160241] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-24T22:14:16.171302] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-24T22:14:16.171467] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-24T22:14:16.173066] [DEBUG] [LOCAL ] ZH: Trimmed 40062 records to 26784 (keeping 200 days of data) [2025-09-24T22:14:16.347003] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-24T22:14:16.356073] [INFO ] [REMOTE ] ZGN: Full fetch complete (58356 records). [2025-09-24T22:14:16.357159] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-24T22:14:16.445293] [DEBUG] [LOCAL ] ZH: Primary data saved (26784 records). [2025-09-24T22:14:16.468237] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-24T22:14:16.471937] [INFO ] [MAIN ] Update Progress: 2362/2373 symbols completed. ZH took 25.9s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-24T22:14:16.827391] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:16.823947] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-24T22:14:16.959163] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-24T22:14:16.959251] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-24T22:14:16.960546] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-24T22:14:16.960626] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-24T22:14:16.962363] [DEBUG] [LOCAL ] ZGN: Trimmed 58356 records to 40828 (keeping 200 days of data) [2025-09-24T22:14:17.050507] [DEBUG] [LOCAL ] ZIP: Loaded 44413 existing records from primary storage. [2025-09-24T22:14:17.077247] [INFO ] [MAIN ] ZIP: Loaded 44413 existing records. [2025-09-24T22:14:17.427878] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:17.430478] [DEBUG] [LOCAL ] ZGN: Primary data saved (40828 records). [2025-09-24T22:14:17.430876] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-24T22:14:17.430972] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-24T22:14:17.431074] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-24T22:14:17.431211] [INFO ] [MAIN ] Update Progress: 2363/2373 symbols completed. ZGN took 26.8s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-24T22:14:17.463357] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-24T22:14:17.495793] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-24T22:14:17.745499] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:18.068031] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:18.069734] [DEBUG] [LOCAL ] ZK: Loaded 40229 existing records from primary storage. [2025-09-24T22:14:18.070590] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-24T22:14:18.071946] [INFO ] [MAIN ] ZK: Loaded 40229 existing records. [2025-09-24T22:14:18.282056] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:18.282720] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-24T22:14:18.282919] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-24T22:14:18.299585] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-24T22:14:18.324523] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-24T22:14:18.333407] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-24T22:14:18.418181] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-24T22:14:18.731638] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:18.980305] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-24T22:14:19.216146] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-24T22:14:19.486413] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-24T22:14:20.016088] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-24T22:14:20.720329] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-24T22:14:20.816113] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-24T22:14:21.123359] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-24T22:14:21.360392] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-24T22:14:21.616111] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-24T22:14:22.416148] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-24T22:14:22.918490] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-24T22:14:23.009007] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-24T22:14:23.216088] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-24T22:14:23.738995] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-24T22:14:24.016151] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-24T22:14:24.816080] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-24T22:14:24.894714] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T22:14:25.287890] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-24T22:14:25.616092] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-24T22:14:26.416105] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-24T22:14:27.081392] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-24T22:14:27.163811] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-24T22:14:27.174911] [INFO ] [REMOTE ] ZETA: Full fetch complete (77677 records). [2025-09-24T22:14:27.175174] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-24T22:14:27.221201] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-24T22:14:27.606471] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-24T22:14:27.606686] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-24T22:14:27.608100] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-24T22:14:27.608169] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-24T22:14:27.610297] [DEBUG] [LOCAL ] ZETA: Trimmed 77677 records to 53595 (keeping 200 days of data) [2025-09-24T22:14:27.947548] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-24T22:14:27.976794] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-24T22:14:27.976962] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-24T22:14:27.977062] [INFO ] [MAIN ] Update Progress: 2364/2373 symbols completed. ZETA took 37.4s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-24T22:14:28.021261] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-24T22:14:28.151527] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:28.162577] [DEBUG] [LOCAL ] ZKH: Loaded 8058 existing records from primary storage. [2025-09-24T22:14:28.162741] [INFO ] [MAIN ] ZKH: Loaded 8058 existing records. [2025-09-24T22:14:28.342147] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:28.342419] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-24T22:14:28.342467] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-24T22:14:28.342874] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-24T22:14:28.342934] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-24T22:14:28.726947] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:28.759265] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-24T22:14:28.816070] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-24T22:14:29.616144] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-24T22:14:30.292439] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-24T22:14:30.311735] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-24T22:14:30.416049] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-24T22:14:30.497773] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-24T22:14:31.080913] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-24T22:14:31.216063] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-24T22:14:31.773516] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-24T22:14:32.016121] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-24T22:14:32.816122] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-24T22:14:33.616161] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-24T22:14:33.666860] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T22:14:34.339780] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-24T22:14:34.416095] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-24T22:14:35.095689] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-24T22:14:35.216101] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-24T22:14:35.530271] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-24T22:14:36.016081] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-24T22:14:36.816075] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-24T22:14:36.879757] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-24T22:14:37.616079] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-24T22:14:38.121282] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-24T22:14:38.367062] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-24T22:14:38.416040] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-24T22:14:39.062888] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-24T22:14:39.216076] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-24T22:14:40.016092] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-24T22:14:40.548536] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-24T22:14:40.572637] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-24T22:14:40.666856] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-24T22:14:40.816082] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-24T22:14:41.616081] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-24T22:14:42.082797] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-24T22:14:42.416119] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-24T22:14:43.042236] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-24T22:14:43.216086] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-24T22:14:43.913756] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-24T22:14:43.921367] [INFO ] [REMOTE ] ZIP: Full fetch complete (59374 records). [2025-09-24T22:14:43.921502] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-24T22:14:44.021225] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-24T22:14:44.419139] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-24T22:14:44.419396] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-24T22:14:44.421090] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-24T22:14:44.421162] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-24T22:14:44.423393] [DEBUG] [LOCAL ] ZIP: Trimmed 59374 records to 44382 (keeping 200 days of data) [2025-09-24T22:14:44.566096] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-24T22:14:44.730080] [DEBUG] [LOCAL ] ZIP: Primary data saved (44382 records). [2025-09-24T22:14:44.730227] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-24T22:14:44.730332] [INFO ] [MAIN ] Update Progress: 2365/2373 symbols completed. ZIP took 28.3s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-24T22:14:44.825188] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-24T22:14:44.908392] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:44.956894] [DEBUG] [LOCAL ] ZTO: Loaded 49981 existing records from primary storage. [2025-09-24T22:14:44.957096] [INFO ] [MAIN ] ZTO: Loaded 49981 existing records. [2025-09-24T22:14:45.134544] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:45.134859] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-24T22:14:45.134964] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-24T22:14:45.136283] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-24T22:14:45.136345] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-24T22:14:45.443935] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-24T22:14:45.522613] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:45.616104] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-24T22:14:46.393382] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-24T22:14:46.416033] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-24T22:14:46.828117] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-24T22:14:47.216146] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-24T22:14:47.893995] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-24T22:14:48.016120] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-24T22:14:48.611551] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-24T22:14:48.623586] [INFO ] [REMOTE ] ZIM: Full fetch complete (77504 records). [2025-09-24T22:14:48.623789] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-24T22:14:48.825179] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-24T22:14:49.027313] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-24T22:14:49.027411] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-24T22:14:49.028802] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-24T22:14:49.028874] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-24T22:14:49.030488] [DEBUG] [LOCAL ] ZIM: Trimmed 77504 records to 53525 (keeping 200 days of data) [2025-09-24T22:14:49.391775] [DEBUG] [LOCAL ] ZIM: Primary data saved (53525 records). [2025-09-24T22:14:49.391945] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-24T22:14:49.392045] [INFO ] [MAIN ] Update Progress: 2366/2373 symbols completed. ZIM took 37.1s. Estimated remaining: 55.9s. Rate: 7.5 symbols/min [2025-09-24T22:14:49.575017] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:49.592700] [DEBUG] [LOCAL ] ZTR: Loaded 16720 existing records from primary storage. [2025-09-24T22:14:49.592859] [INFO ] [MAIN ] ZTR: Loaded 16720 existing records. [2025-09-24T22:14:49.629487] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-24T22:14:49.804066] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:49.833681] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-24T22:14:49.833880] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-24T22:14:49.836302] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-24T22:14:49.836228] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-24T22:14:49.836437] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-24T22:14:50.215815] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:50.299341] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-24T22:14:50.416099] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-24T22:14:50.471574] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-24T22:14:50.481042] [INFO ] [REMOTE ] ZK: Full fetch complete (57445 records). [2025-09-24T22:14:50.481235] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-24T22:14:50.873369] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-24T22:14:50.873462] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-24T22:14:50.874702] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-24T22:14:50.874767] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-24T22:14:50.876116] [DEBUG] [LOCAL ] ZK: Trimmed 57445 records to 40087 (keeping 200 days of data) [2025-09-24T22:14:51.122455] [DEBUG] [LOCAL ] ZK: Primary data saved (40087 records). [2025-09-24T22:14:51.122586] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-24T22:14:51.122694] [INFO ] [MAIN ] Update Progress: 2367/2373 symbols completed. ZK took 33.7s. Estimated remaining: 47.9s. Rate: 7.5 symbols/min [2025-09-24T22:14:51.221541] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-24T22:14:51.300359] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:51.359320] [DEBUG] [LOCAL ] ZTS: Loaded 53002 existing records from primary storage. [2025-09-24T22:14:51.359468] [INFO ] [MAIN ] ZTS: Loaded 53002 existing records. [2025-09-24T22:14:51.545921] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:51.546219] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-24T22:14:51.546270] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-24T22:14:51.547965] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-24T22:14:51.548028] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-24T22:14:51.944819] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:51.968244] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-24T22:14:51.970934] [INFO ] [REMOTE ] ZKH: Full fetch complete (11917 records). [2025-09-24T22:14:51.971026] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-24T22:14:52.019667] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-24T22:14:52.330059] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-24T22:14:52.412028] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-24T22:14:52.412114] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-24T22:14:52.412428] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-24T22:14:52.412469] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-24T22:14:52.412980] [DEBUG] [LOCAL ] ZKH: Trimmed 11917 records to 8000 (keeping 200 days of data) [2025-09-24T22:14:52.457438] [DEBUG] [LOCAL ] ZKH: Primary data saved (8000 records). [2025-09-24T22:14:52.457567] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-24T22:14:52.457692] [INFO ] [MAIN ] Update Progress: 2368/2373 symbols completed. ZKH took 24.5s. Estimated remaining: 39.9s. Rate: 7.5 symbols/min [2025-09-24T22:14:52.633239] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:14:52.674691] [DEBUG] [LOCAL ] ZVIA: Loaded 35414 existing records from primary storage. [2025-09-24T22:14:52.674862] [INFO ] [MAIN ] ZVIA: Loaded 35414 existing records. [2025-09-24T22:14:52.825130] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-24T22:14:52.859135] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:14:52.859403] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-24T22:14:52.859471] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-24T22:14:52.860383] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-24T22:14:52.860448] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-24T22:14:53.223604] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:14:53.616067] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-24T22:14:53.854157] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-24T22:14:53.948283] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-24T22:14:54.416117] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-24T22:14:55.055311] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-24T22:14:55.216120] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-24T22:14:56.016151] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-24T22:14:56.482143] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-24T22:14:56.624771] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-24T22:14:56.816157] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-24T22:14:57.162359] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-24T22:14:57.616198] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-24T22:14:58.413577] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-24T22:14:58.422991] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-24T22:14:58.810421] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-24T22:14:59.216079] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-24T22:14:59.973747] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-24T22:15:00.016090] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-24T22:15:00.816075] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-24T22:15:01.005222] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-24T22:15:01.181299] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-24T22:15:01.616117] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-24T22:15:02.418317] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-24T22:15:02.422490] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-24T22:15:03.216130] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-24T22:15:04.016091] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-24T22:15:04.552961] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-09-24T22:15:04.763226] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-24T22:15:04.816090] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-24T22:15:04.863525] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-24T22:15:05.187705] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-24T22:15:05.616153] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-24T22:15:06.392227] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-24T22:15:06.416055] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-24T22:15:07.207446] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-24T22:15:07.222513] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-24T22:15:08.016086] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-24T22:15:08.235482] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-24T22:15:08.266219] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-24T22:15:08.786782] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-24T22:15:08.816083] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-24T22:15:09.616091] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-24T22:15:09.743243] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-24T22:15:10.416086] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-24T22:15:11.026798] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-24T22:15:11.216081] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-24T22:15:11.998947] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-24T22:15:12.016030] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-24T22:15:12.481937] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-24T22:15:12.816086] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-24T22:15:13.616071] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-24T22:15:14.416051] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-24T22:15:14.621157] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-24T22:15:14.715808] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-24T22:15:15.216094] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-24T22:15:15.918518] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-24T22:15:16.016087] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-24T22:15:16.455533] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-24T22:15:16.823291] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-24T22:15:16.844588] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-24T22:15:17.088983] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-24T22:15:17.616096] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-24T22:15:18.332688] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-24T22:15:18.416058] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-24T22:15:18.495075] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-24T22:15:18.498397] [INFO ] [REMOTE ] ZTR: Full fetch complete (26817 records). [2025-09-24T22:15:18.498529] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-24T22:15:18.915503] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-24T22:15:18.915732] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-24T22:15:18.916590] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-24T22:15:18.916724] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-24T22:15:18.917945] [DEBUG] [LOCAL ] ZTR: Trimmed 26817 records to 16705 (keeping 200 days of data) [2025-09-24T22:15:19.024440] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-24T22:15:19.036738] [INFO ] [REMOTE ] ZTS: Full fetch complete (76690 records). [2025-09-24T22:15:19.037450] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-24T22:15:19.221221] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-24T22:15:19.261439] [DEBUG] [LOCAL ] ZTR: Primary data saved (16705 records). [2025-09-24T22:15:19.321446] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-24T22:15:19.356410] [INFO ] [MAIN ] Update Progress: 2369/2373 symbols completed. ZTR took 30.0s. Estimated remaining: 31.9s. Rate: 7.5 symbols/min [2025-09-24T22:15:19.656245] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-24T22:15:19.665456] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-24T22:15:19.694949] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-24T22:15:19.692675] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-16 to 2025-09-24. [2025-09-24T22:15:19.695301] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-24T22:15:19.702027] [DEBUG] [LOCAL ] ZTS: Trimmed 76690 records to 53002 (keeping 200 days of data) [2025-09-24T22:15:19.864509] [DEBUG] [LOCAL ] ZWS: Loaded 42484 existing records from primary storage. [2025-09-24T22:15:19.865133] [INFO ] [MAIN ] ZWS: Loaded 42484 existing records. [2025-09-24T22:15:20.016560] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-24T22:15:20.098436] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-07, but need from 2024-12-05 for 200 day retention. Performing full refresh. [2025-09-24T22:15:20.100418] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-24T22:15:20.100542] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-24T22:15:20.102521] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-24T22:15:20.102872] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-24T22:15:20.593679] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-05 to 2025-09-24 (requires 10 months of data pull). [2025-09-24T22:15:20.718856] [DEBUG] [LOCAL ] ZTS: Primary data saved (53002 records). [2025-09-24T22:15:20.720372] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-24T22:15:20.720546] [INFO ] [MAIN ] Update Progress: 2370/2373 symbols completed. ZTS took 29.6s. Estimated remaining: 23.9s. Rate: 7.5 symbols/min [2025-09-24T22:15:20.816079] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-24T22:15:20.927460] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-24T22:15:21.616040] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-24T22:15:21.811703] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-24T22:15:22.416094] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-24T22:15:22.551604] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-24T22:15:23.092686] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-24T22:15:23.099491] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52500 records). [2025-09-24T22:15:23.099684] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-24T22:15:23.221219] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-24T22:15:23.525685] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-24T22:15:23.525809] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-24T22:15:23.527000] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-24T22:15:23.527065] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-24T22:15:23.528240] [DEBUG] [LOCAL ] ZVIA: Trimmed 52500 records to 35403 (keeping 200 days of data) [2025-09-24T22:15:23.771233] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-24T22:15:23.791517] [INFO ] [REMOTE ] ZTO: Full fetch complete (73083 records). [2025-09-24T22:15:23.795395] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35403 records). [2025-09-24T22:15:23.795689] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-24T22:15:23.795927] [INFO ] [MAIN ] Update Progress: 2371/2373 symbols completed. ZVIA took 31.3s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-24T22:15:23.796213] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-24T22:15:24.204216] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-24T22:15:24.204310] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-24T22:15:24.205603] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-24T22:15:24.205726] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-24T22:15:24.207333] [DEBUG] [LOCAL ] ZTO: Trimmed 73083 records to 49977 (keeping 200 days of data) [2025-09-24T22:15:24.562867] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-24T22:15:24.577006] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-24T22:15:24.605226] [DEBUG] [LOCAL ] ZTO: Primary data saved (49977 records). [2025-09-24T22:15:24.605363] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-24T22:15:24.605605] [INFO ] [MAIN ] Update Progress: 2372/2373 symbols completed. ZTO took 39.9s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-24T22:15:26.390277] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-24T22:15:26.399567] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-24T22:15:28.083448] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-24T22:15:28.093551] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-24T22:15:29.865042] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-24T22:15:29.876321] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-24T22:15:31.191602] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-24T22:15:31.200245] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-24T22:15:32.424041] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-24T22:15:32.432284] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-24T22:15:34.006738] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-24T22:15:34.017270] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-24T22:15:35.263284] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-24T22:15:35.275377] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-24T22:15:36.706285] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-24T22:15:36.714285] [INFO ] [REMOTE ] ZWS: Full fetch complete (61994 records). [2025-09-24T22:15:36.714415] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-24T22:15:37.148518] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-24T22:15:37.148630] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-24T22:15:37.150051] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-24T22:15:37.150119] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-24T22:15:37.151561] [DEBUG] [LOCAL ] ZWS: Trimmed 61994 records to 42484 (keeping 200 days of data) [2025-09-24T22:15:37.445063] [DEBUG] [LOCAL ] ZWS: Primary data saved (42484 records). [2025-09-24T22:15:37.445210] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-24T22:15:37.445467] [INFO ] [MAIN ] Update Progress: 2373/2373 symbols completed. ZWS took 18.1s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-24T22:15:37.448110] [INFO ] [MAIN ] Parallel update completed in 5h 15m 34s [2025-09-24T22:15:37.448353] [WARN ] [MAIN ] Failed symbols (298): AAM, AACT, AAMI, AAUC, ABCB, ABG, ABBV, ABM, ACA, ABT... [2025-09-24T22:15:37.448437] [INFO ] [MAIN ] Update success rate: 87.4% (2075/2373 symbols) [2025-09-24T22:15:38.308962] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2075/2373 @ 87.44%)' [2025-09-24T22:15:38.310240] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-24T22:15:38.310551] [INFO ] [STATE ] Last completion updated: 2025-09-24T22:15:38.310338 [2025-09-24T22:15:38.310861] [WARN ] [STATE ] State set to: RUNNING [2025-09-24T22:15:38.310959] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-24T22:15:38.311101] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-24T22:15:38.311172] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-24T22:15:38.313226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-24T22:15:38.313546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-24T22:15:38.313933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-24T22:15:38.314289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-24T22:15:38.314606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-24T22:15:38.314970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-24T22:15:38.315437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-24T22:15:38.315718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-24T22:15:38.316093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-24T22:15:38.316397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-24T22:15:38.316669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-24T22:15:38.316959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-24T22:15:38.317263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-24T22:15:38.317606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-24T22:15:38.317959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-24T22:15:38.318259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-24T22:15:38.318618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-24T22:15:38.319117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-24T22:15:38.319448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-24T22:15:38.319749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-24T22:15:38.320088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-24T22:15:38.320406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-24T22:15:38.320700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-24T22:15:38.321053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-24T22:15:38.321309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-24T22:15:38.321622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-24T22:15:38.322025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-24T22:15:38.322334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-24T22:15:38.322702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-24T22:15:38.323015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-24T22:15:38.323425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-24T22:15:38.323707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-24T22:15:38.323953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-24T22:15:38.324213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-24T22:15:38.324471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-24T22:15:38.324783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-24T22:15:38.325160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-24T22:15:38.325579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-24T22:15:38.325907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-24T22:15:38.326163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-24T22:15:38.326390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-24T22:15:38.326775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-24T22:15:38.327036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-24T22:15:38.327317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-24T22:15:38.327626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-24T22:15:38.328288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-24T22:15:38.328549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-24T22:15:38.328849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-24T22:15:38.329224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-24T22:15:38.329432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-24T22:15:38.329744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-24T22:15:38.330453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-24T22:15:38.330764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-24T22:15:38.331089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-24T22:15:38.331350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-24T22:15:38.331633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-24T22:15:38.331928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-24T22:15:38.332177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-24T22:15:38.332497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-24T22:15:38.332722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-24T22:15:38.333008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-24T22:15:38.333247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-24T22:15:38.333552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-24T22:15:38.333785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-24T22:15:38.334151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-24T22:15:38.334450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-24T22:15:38.334714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-24T22:15:38.335021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-24T22:15:38.335326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-24T22:15:38.335830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-24T22:15:38.336101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-24T22:15:38.336394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-24T22:15:38.336618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-24T22:15:38.336868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-24T22:15:38.337055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-24T22:15:38.337348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-24T22:15:38.337692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-24T22:15:38.337875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-24T22:15:38.338138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-24T22:15:38.338431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-24T22:15:38.338717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-24T22:15:38.339063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-24T22:15:38.339357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-24T22:15:38.339627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-24T22:15:38.339916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-24T22:15:38.340255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-24T22:15:38.340495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-24T22:15:38.340797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-24T22:15:38.340983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-24T22:15:38.341376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-24T22:15:38.341739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-24T22:15:38.342144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-24T22:15:38.342414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-24T22:15:38.342737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-24T22:15:38.343063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-24T22:15:38.343336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-24T22:15:38.343821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-24T22:15:38.344090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-24T22:15:38.344357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-24T22:15:38.344616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-24T22:15:38.344965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-24T22:15:38.345231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-24T22:15:38.345531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-24T22:15:38.345821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-24T22:15:38.346036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-24T22:15:38.346296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-24T22:15:38.346591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-24T22:15:38.346919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-24T22:15:38.347195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-24T22:15:38.347413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-24T22:15:38.347707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-24T22:15:38.347901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-24T22:15:38.348153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-24T22:15:38.348451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-24T22:15:38.348742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-24T22:15:38.348998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-24T22:15:38.349238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-24T22:15:38.349477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-24T22:15:38.349746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-24T22:15:38.349989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-24T22:15:38.350248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-24T22:15:38.350480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-24T22:15:38.350764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-24T22:15:38.351035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-24T22:15:38.351311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-24T22:15:38.351538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-24T22:15:38.351961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-24T22:15:38.352240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-24T22:15:38.352503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-24T22:15:38.352724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-24T22:15:38.353102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-24T22:15:38.353354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-24T22:15:38.353557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-24T22:15:38.353791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-24T22:15:38.353986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-24T22:15:38.354307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-24T22:15:38.354598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-24T22:15:38.354886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-24T22:15:38.355099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-24T22:15:38.355377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-24T22:15:38.355707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-24T22:15:38.360659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-24T22:15:38.361037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-24T22:15:38.361312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-24T22:15:38.361532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-24T22:15:38.362621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-24T22:15:38.362866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-24T22:15:38.363089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-24T22:15:38.363311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-24T22:15:38.363541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-24T22:15:38.363902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-24T22:15:38.364306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-24T22:15:38.364605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-24T22:15:38.364946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-24T22:15:38.365164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-24T22:15:38.365385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-24T22:15:38.365783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-24T22:15:38.366000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-24T22:15:38.366362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-24T22:15:38.366539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-24T22:15:38.366905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-24T22:15:38.367183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-24T22:15:38.367391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-24T22:15:38.367753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-24T22:15:38.368023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-24T22:15:38.368265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-24T22:15:38.368511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-24T22:15:38.368865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-24T22:15:38.369192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-24T22:15:38.369449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-24T22:15:38.369937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-24T22:15:38.370347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-24T22:15:38.370628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-24T22:15:38.370960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-24T22:15:38.371184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-24T22:15:38.371461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-24T22:15:38.371728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-24T22:15:38.371969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-24T22:15:38.372239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-24T22:15:38.372413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-24T22:15:38.372602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-24T22:15:38.372928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-24T22:15:38.373096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-24T22:15:38.373339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-24T22:15:38.373531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-24T22:15:38.373825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-24T22:15:38.374122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-24T22:15:38.374380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-24T22:15:38.374569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-24T22:15:38.374772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-24T22:15:38.375025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-24T22:15:38.375239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-24T22:15:38.375455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-24T22:15:38.375705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-24T22:15:38.375967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-24T22:15:38.376143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-24T22:15:38.376378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-24T22:15:38.376565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-24T22:15:38.376780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-24T22:15:38.376987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-24T22:15:38.377223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-24T22:15:38.377444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-24T22:15:38.377818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-24T22:15:38.378106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-24T22:15:38.378302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-24T22:15:38.378671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-24T22:15:38.378923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-24T22:15:38.379137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-24T22:15:38.379560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-24T22:15:38.379822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-24T22:15:38.380040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-24T22:15:38.380347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-24T22:15:38.380632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-24T22:15:38.380838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-24T22:15:38.381074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-24T22:15:38.381259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-24T22:15:38.381450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-24T22:15:38.381703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-24T22:15:38.381974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-24T22:15:38.382188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-24T22:15:38.382384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-24T22:15:38.382585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-24T22:15:38.382923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-24T22:15:38.383098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-24T22:15:38.383300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-24T22:15:38.383559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-24T22:15:38.383900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-24T22:15:38.384123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-24T22:15:38.384327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-24T22:15:38.384564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-24T22:15:38.384908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-24T22:15:38.385127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-24T22:15:38.385398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-24T22:15:38.385826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-24T22:15:38.386035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-24T22:15:38.386287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-24T22:15:38.386511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-24T22:15:38.386763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-24T22:15:38.386945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-24T22:15:38.387194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-24T22:15:38.387442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-24T22:15:38.387809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-24T22:15:38.388035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-24T22:15:38.388249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-24T22:15:38.388480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-24T22:15:38.388681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-24T22:15:38.388979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-24T22:15:38.389191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-24T22:15:38.389376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-24T22:15:38.389679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-24T22:15:38.389882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-24T22:15:38.390178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-24T22:15:38.390372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-24T22:15:38.390585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-24T22:15:38.391021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-24T22:15:38.391283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-24T22:15:38.391493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-24T22:15:38.391752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-24T22:15:38.391935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-24T22:15:38.392137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-24T22:15:38.392364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-24T22:15:38.392626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-24T22:15:38.392928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-24T22:15:38.393126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-24T22:15:38.393319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-24T22:15:38.393561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-24T22:15:38.393928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-24T22:15:38.394189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-24T22:15:38.394410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-24T22:15:38.394613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-24T22:15:38.394830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-24T22:15:38.395051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-24T22:15:38.395252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-24T22:15:38.395437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-24T22:15:38.395715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-24T22:15:38.395945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-24T22:15:38.396185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-24T22:15:38.396412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-24T22:15:38.396608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-24T22:15:38.396881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-24T22:15:38.397071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-24T22:15:38.397254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-24T22:15:38.397631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-24T22:15:38.397920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-24T22:15:38.398189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-24T22:15:38.398380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-24T22:15:38.398547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-24T22:15:38.398734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-24T22:15:38.398906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-24T22:15:38.399123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-24T22:15:38.399315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-24T22:15:38.399528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-24T22:15:38.399781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-24T22:15:38.400107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-24T22:15:38.400362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-24T22:15:38.400595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-24T22:15:38.400835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-24T22:15:38.401080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-24T22:15:38.401328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-24T22:15:38.401865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-24T22:15:38.402131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-24T22:15:38.402324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-24T22:15:38.402526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-24T22:15:38.402723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-24T22:15:38.402936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-24T22:15:38.403184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-24T22:15:38.403431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-24T22:15:38.403660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-24T22:15:38.403844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-24T22:15:38.404041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-24T22:15:38.404276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-24T22:15:38.404508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-24T22:15:38.404730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-24T22:15:38.405010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-24T22:15:38.405196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-24T22:15:38.405383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-24T22:15:38.405581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-24T22:15:38.405868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-24T22:15:38.406108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-24T22:15:38.406334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-24T22:15:38.406596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-24T22:15:38.406809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-24T22:15:38.407009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-24T22:15:38.407236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-24T22:15:38.407495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-24T22:15:38.407789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-24T22:15:38.407972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-24T22:15:38.408172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-24T22:15:38.408396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-24T22:15:38.408560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-24T22:15:38.409010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-24T22:15:38.409190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-24T22:15:38.409511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-24T22:15:38.409902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-24T22:15:38.410133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-24T22:15:38.410338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-24T22:15:38.410634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-24T22:15:38.410863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-24T22:15:38.411055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-24T22:15:38.411246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-24T22:15:38.411416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-24T22:15:38.411580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-24T22:15:38.411808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-24T22:15:38.412031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-24T22:15:38.412280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-24T22:15:38.412570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-24T22:15:38.412814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-24T22:15:38.413008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-24T22:15:38.413166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-24T22:15:38.413462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-24T22:15:38.413745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-24T22:15:38.413921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-24T22:15:38.414148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-24T22:15:38.414383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-24T22:15:38.414617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-24T22:15:38.414960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-24T22:15:38.415256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-24T22:15:38.415493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-24T22:15:38.415807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-24T22:15:38.416021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-24T22:15:38.416307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-24T22:15:38.416537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-24T22:15:38.416912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-24T22:15:38.417164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-24T22:15:38.417414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-24T22:15:38.417906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-24T22:15:38.418152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-24T22:15:38.418774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-24T22:15:38.419029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-24T22:15:38.419300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-24T22:15:38.419516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-24T22:15:38.419881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-24T22:15:38.420169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-24T22:15:38.420407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-24T22:15:38.420617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-24T22:15:38.420910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-24T22:15:38.421201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-24T22:15:38.421467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-24T22:15:38.421953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-24T22:15:38.422205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-24T22:15:38.422467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-24T22:15:38.422792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-24T22:15:38.423050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-24T22:15:38.423283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-24T22:15:38.423585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-24T22:15:38.423909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-24T22:15:38.424161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-24T22:15:38.424398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-24T22:15:38.424609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-24T22:15:38.424899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-24T22:15:38.425141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-24T22:15:38.425411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-24T22:15:38.425679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-24T22:15:38.425901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-24T22:15:38.426214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-24T22:15:38.426467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-24T22:15:38.426675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-24T22:15:38.426933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-24T22:15:38.427203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-24T22:15:38.427550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-24T22:15:38.427815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-24T22:15:38.428087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-24T22:15:38.428274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-24T22:15:38.428487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-24T22:15:38.428755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-24T22:15:38.429018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-24T22:15:38.429316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-24T22:15:38.429560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-24T22:15:38.429990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-24T22:15:38.430243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-24T22:15:38.430449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-24T22:15:38.430701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-24T22:15:38.430935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-24T22:15:38.431125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-24T22:15:38.431391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-24T22:15:38.431594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-24T22:15:38.431903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-24T22:15:38.432122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-24T22:15:38.432344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-24T22:15:38.432596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-24T22:15:38.432857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-24T22:15:38.433408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-24T22:15:38.433669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-24T22:15:38.433939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-24T22:15:38.434167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-24T22:15:38.434383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-24T22:15:38.434621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-24T22:15:38.434870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-24T22:15:38.435075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-24T22:15:38.435265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-24T22:15:38.435540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-24T22:15:38.435815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-24T22:15:38.436129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-24T22:15:38.436402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-24T22:15:38.436611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-24T22:15:38.436883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-24T22:15:38.437263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-24T22:15:38.437517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-24T22:15:38.437789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-24T22:15:38.438021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-24T22:15:38.438341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-24T22:15:38.438615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-24T22:15:38.438905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-24T22:15:38.439156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-24T22:15:38.439690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-24T22:15:38.439920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-24T22:15:38.440095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-24T22:15:38.440330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-24T22:15:38.440587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-24T22:15:38.440914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-24T22:15:38.441408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-24T22:15:38.442203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-24T22:15:38.442426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-24T22:15:38.442682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-24T22:15:38.442946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-24T22:15:38.443172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-24T22:15:38.443405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-24T22:15:38.443766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-24T22:15:38.443958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-24T22:15:38.444179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-24T22:15:38.444397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-24T22:15:38.444702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-24T22:15:38.444953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-24T22:15:38.445174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-24T22:15:38.445427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-24T22:15:38.445822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-24T22:15:38.446086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-24T22:15:38.446320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-24T22:15:38.446551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-24T22:15:38.446824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-24T22:15:38.447093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-24T22:15:38.447351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-24T22:15:38.447708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-24T22:15:38.447932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-24T22:15:38.448132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-24T22:15:38.448569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-24T22:15:38.448864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-24T22:15:38.449192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-24T22:15:38.449427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-24T22:15:38.449638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-24T22:15:38.449883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-24T22:15:38.450167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-24T22:15:38.450386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-24T22:15:38.450587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-24T22:15:38.450841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-24T22:15:38.451081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-24T22:15:38.451332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-24T22:15:38.451581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-24T22:15:38.451852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-24T22:15:38.452128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-24T22:15:38.452374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-24T22:15:38.452581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-24T22:15:38.453132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-24T22:15:38.453355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-24T22:15:38.453562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-24T22:15:38.453947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-24T22:15:38.454187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-24T22:15:38.454436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-24T22:15:38.454754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-24T22:15:38.454999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-24T22:15:38.455281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-24T22:15:38.455521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-24T22:15:38.455819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-24T22:15:38.456010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-24T22:15:38.456280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-24T22:15:38.456504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-24T22:15:38.456768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-24T22:15:38.456990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-24T22:15:38.457201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-24T22:15:38.457444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-24T22:15:38.457748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-24T22:15:38.458087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-24T22:15:38.458357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-24T22:15:38.458600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-24T22:15:38.458922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-24T22:15:38.459133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-24T22:15:38.459341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-24T22:15:38.459504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-24T22:15:38.459727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-24T22:15:38.459951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-24T22:15:38.460179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-24T22:15:38.460436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-24T22:15:38.460881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-24T22:15:38.461112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-24T22:15:38.461312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-24T22:15:38.461619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-24T22:15:38.461910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-24T22:15:38.462142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-24T22:15:38.462362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-24T22:15:38.462619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-24T22:15:38.462971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-24T22:15:38.463217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-24T22:15:38.463438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-24T22:15:38.463670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-24T22:15:38.463906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-24T22:15:38.464089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-24T22:15:38.464304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-24T22:15:38.464532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-24T22:15:38.464753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-24T22:15:38.465209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-24T22:15:38.465399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-24T22:15:38.465638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-24T22:15:38.465897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-24T22:15:38.466144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-24T22:15:38.466371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-24T22:15:38.466598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-24T22:15:38.466938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-24T22:15:38.467205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-24T22:15:38.467400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-24T22:15:38.467707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-24T22:15:38.467927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-24T22:15:38.468198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-24T22:15:38.468471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-24T22:15:38.468744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-24T22:15:38.468962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-24T22:15:38.469187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-24T22:15:38.469449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-24T22:15:38.469807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-24T22:15:38.470019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-24T22:15:38.470212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-24T22:15:38.470431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-24T22:15:38.470693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-24T22:15:38.471003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-24T22:15:38.471219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-24T22:15:38.471427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-24T22:15:38.471669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-24T22:15:38.471883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-24T22:15:38.472154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-24T22:15:38.472335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-24T22:15:38.472519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-24T22:15:38.472759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-24T22:15:38.472951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-24T22:15:38.473261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-24T22:15:38.473472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-24T22:15:38.473671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-24T22:15:38.473860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-24T22:15:38.474060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-24T22:15:38.474260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-24T22:15:38.474669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-24T22:15:38.474864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-24T22:15:38.475104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-24T22:15:38.475282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-24T22:15:38.475525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-24T22:15:38.475791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-24T22:15:38.475974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-24T22:15:38.476156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-24T22:15:38.476319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-24T22:15:38.476482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-24T22:15:38.476746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-24T22:15:38.476952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-24T22:15:38.477115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-24T22:15:38.477278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-24T22:15:38.477463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-24T22:15:38.477633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-24T22:15:38.477966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-24T22:15:38.478165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-24T22:15:38.478370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-24T22:15:38.478547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-24T22:15:38.478731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-24T22:15:38.478884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-24T22:15:38.479085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-24T22:15:38.479283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-24T22:15:38.479435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-24T22:15:38.479598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-24T22:15:38.479807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-24T22:15:38.480087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-24T22:15:38.480237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-24T22:15:38.480408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-24T22:15:38.480619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-24T22:15:38.480889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-24T22:15:38.481073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-24T22:15:38.481404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-24T22:15:38.481567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-24T22:15:38.481746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-24T22:15:38.481926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-24T22:15:38.482106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-24T22:15:38.482276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-24T22:15:38.482473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-24T22:15:38.482685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-24T22:15:38.482850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-24T22:15:38.483000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-24T22:15:38.483170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-24T22:15:38.483348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-24T22:15:38.483526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-24T22:15:38.483714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-24T22:15:38.483881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-24T22:15:38.484049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-24T22:15:38.484252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-24T22:15:38.484445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-24T22:15:38.484603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-24T22:15:38.484837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-24T22:15:38.485085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-24T22:15:38.485245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-24T22:15:38.485441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-24T22:15:38.485704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-24T22:15:38.485905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-24T22:15:38.486113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-24T22:15:38.486254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-24T22:15:38.486443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-24T22:15:38.486607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-24T22:15:38.486800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-24T22:15:38.486961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-24T22:15:38.487175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-24T22:15:38.487388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-24T22:15:38.487593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-24T22:15:38.487791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-24T22:15:38.487979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-24T22:15:38.488494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-24T22:15:38.488753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-24T22:15:38.488916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-24T22:15:38.489109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-24T22:15:38.489276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-24T22:15:38.489441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-24T22:15:38.489625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-24T22:15:38.489827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-24T22:15:38.489989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-24T22:15:38.490155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-24T22:15:38.490309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-24T22:15:38.490529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-24T22:15:38.490736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-24T22:15:38.490886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-24T22:15:38.491040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-24T22:15:38.491197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-24T22:15:38.491386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-24T22:15:38.491560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-24T22:15:38.491731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-24T22:15:38.491915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-24T22:15:38.492082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-24T22:15:38.492241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-24T22:15:38.492425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-24T22:15:38.492579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-24T22:15:38.492792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-24T22:15:38.492967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-24T22:15:38.493152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-24T22:15:38.493298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-24T22:15:38.493469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-24T22:15:38.493634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-24T22:15:38.493923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-24T22:15:38.494070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-24T22:15:38.494234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-24T22:15:38.494406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-24T22:15:38.494579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-24T22:15:38.494792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-24T22:15:38.494986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-24T22:15:38.495146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-24T22:15:38.495440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-24T22:15:38.495660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-24T22:15:38.495862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-24T22:15:38.496032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-24T22:15:38.496184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-24T22:15:38.496325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-24T22:15:38.496509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-24T22:15:38.496751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-24T22:15:38.496901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-24T22:15:38.497100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-24T22:15:38.497266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-24T22:15:38.497485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-24T22:15:38.497634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-24T22:15:38.497801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-24T22:15:38.498073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-24T22:15:38.498253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-24T22:15:38.498435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-24T22:15:38.498615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-24T22:15:38.498788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-24T22:15:38.498948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-24T22:15:38.499105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-24T22:15:38.499287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-24T22:15:38.499464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-24T22:15:38.499597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-24T22:15:38.499781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-24T22:15:38.499958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-24T22:15:38.500127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-24T22:15:38.500306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-24T22:15:38.500474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-24T22:15:38.500695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-24T22:15:38.500867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-24T22:15:38.501042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-24T22:15:38.501206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-24T22:15:38.501365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-24T22:15:38.501558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-24T22:15:38.501932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-24T22:15:38.502109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-24T22:15:38.502256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-24T22:15:38.502414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-24T22:15:38.502610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-24T22:15:38.502850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-24T22:15:38.503058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-24T22:15:38.503225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-24T22:15:38.503402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-24T22:15:38.503585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-24T22:15:38.503826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-24T22:15:38.503955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-24T22:15:38.504137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-24T22:15:38.504302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-24T22:15:38.504498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-24T22:15:38.504706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-24T22:15:38.504875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-24T22:15:38.505044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-24T22:15:38.505194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-24T22:15:38.505363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-24T22:15:38.505518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-24T22:15:38.505865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-24T22:15:38.506090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-24T22:15:38.506372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-24T22:15:38.506550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-24T22:15:38.506734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-24T22:15:38.506902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-24T22:15:38.507189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-24T22:15:38.507362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-24T22:15:38.507527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-24T22:15:38.507710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-24T22:15:38.507880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-24T22:15:38.508043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-24T22:15:38.508189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-24T22:15:38.508351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-24T22:15:38.508516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-24T22:15:38.508736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-24T22:15:38.508907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-24T22:15:38.509097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-24T22:15:38.509261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-24T22:15:38.509409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-24T22:15:38.509598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-24T22:15:38.509809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-24T22:15:38.510022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-24T22:15:38.510171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-24T22:15:38.510313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-24T22:15:38.510630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-24T22:15:38.510829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-24T22:15:38.510976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-24T22:15:38.511175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-24T22:15:38.511329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-24T22:15:38.511500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-24T22:15:38.511687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-24T22:15:38.511838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-24T22:15:38.512025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-24T22:15:38.512160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-24T22:15:38.512341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-24T22:15:38.512509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-24T22:15:38.512802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-24T22:15:38.512990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-24T22:15:38.513177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-24T22:15:38.513500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-24T22:15:38.513791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-24T22:15:38.513996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-24T22:15:38.514216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-24T22:15:38.514394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-24T22:15:38.514577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-24T22:15:38.514817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-24T22:15:38.515017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-24T22:15:38.515188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-24T22:15:38.515372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-24T22:15:38.515532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-24T22:15:38.515707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-24T22:15:38.515884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-24T22:15:38.516032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-24T22:15:38.516222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-24T22:15:38.516355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-24T22:15:38.516490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-24T22:15:38.516718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-24T22:15:38.516934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-24T22:15:38.517091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-24T22:15:38.517281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-24T22:15:38.517446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-24T22:15:38.517619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-24T22:15:38.517792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-24T22:15:38.517959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-24T22:15:38.518138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-24T22:15:38.518285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-24T22:15:38.518472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-24T22:15:38.518663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-24T22:15:38.518815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-24T22:15:38.518971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-24T22:15:38.519122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-24T22:15:38.519261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-24T22:15:38.519414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-24T22:15:38.519564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-24T22:15:38.519749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-24T22:15:38.519912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-24T22:15:38.520064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-24T22:15:38.520257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-24T22:15:38.520406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-24T22:15:38.520553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-24T22:15:38.520824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-24T22:15:38.520980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-24T22:15:38.521143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-24T22:15:38.521291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-24T22:15:38.521431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-24T22:15:38.521587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-24T22:15:38.521846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-24T22:15:38.522034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-24T22:15:38.522209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-24T22:15:38.522383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-24T22:15:38.522550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-24T22:15:38.522744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-24T22:15:38.522916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-24T22:15:38.523082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-24T22:15:38.523241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-24T22:15:38.523390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-24T22:15:38.523559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-24T22:15:38.523773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-24T22:15:38.523916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-24T22:15:38.524089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-24T22:15:38.524271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-24T22:15:38.524425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-24T22:15:38.524602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-24T22:15:38.524823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-24T22:15:38.524988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-24T22:15:38.525150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-24T22:15:38.525419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-24T22:15:38.525566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-24T22:15:38.525744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-24T22:15:38.525927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-24T22:15:38.526098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-24T22:15:38.526316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-24T22:15:38.526485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-24T22:15:38.526684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-24T22:15:38.526831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-24T22:15:38.527000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-24T22:15:38.527154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-24T22:15:38.527309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-24T22:15:38.527476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-24T22:15:38.527664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-24T22:15:38.527816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-24T22:15:38.527970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-24T22:15:38.528129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-24T22:15:38.528298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-24T22:15:38.528509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-24T22:15:38.528700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-24T22:15:38.528862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-24T22:15:38.529125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-24T22:15:38.529290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-24T22:15:38.529462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-24T22:15:38.529882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-24T22:15:38.530027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-24T22:15:38.530181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-24T22:15:38.530394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-24T22:15:38.530566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-24T22:15:38.530752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-24T22:15:38.530927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-24T22:15:38.531084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-24T22:15:38.531262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-24T22:15:38.531430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-24T22:15:38.531590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-24T22:15:38.531787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-24T22:15:38.531943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-24T22:15:38.532099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-24T22:15:38.532251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-24T22:15:38.532401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-24T22:15:38.532563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-24T22:15:38.532782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-24T22:15:38.532961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-24T22:15:38.533104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-24T22:15:38.533284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-24T22:15:38.533436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-24T22:15:38.533597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-24T22:15:38.533767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-24T22:15:38.534093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-24T22:15:38.534243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-24T22:15:38.534416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-24T22:15:38.534568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-24T22:15:38.534773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-24T22:15:38.534939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-24T22:15:38.535105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-24T22:15:38.535288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-24T22:15:38.535454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-24T22:15:38.535620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-24T22:15:38.535833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-24T22:15:38.535982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-24T22:15:38.536140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-24T22:15:38.536329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-24T22:15:38.536514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-24T22:15:38.536717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-24T22:15:38.536874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-24T22:15:38.537019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-24T22:15:38.537189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-24T22:15:38.537348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-24T22:15:38.537542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-24T22:15:38.537871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-24T22:15:38.538074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-24T22:15:38.538208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-24T22:15:38.538355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-24T22:15:38.538512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-24T22:15:38.538692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-24T22:15:38.538859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-24T22:15:38.539035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-24T22:15:38.539195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-24T22:15:38.539400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-24T22:15:38.539568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-24T22:15:38.539757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-24T22:15:38.539959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-24T22:15:38.540125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-24T22:15:38.540272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-24T22:15:38.540433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-24T22:15:38.540823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-24T22:15:38.540982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-24T22:15:38.541154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-24T22:15:38.541291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-24T22:15:38.541530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-24T22:15:38.541709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-24T22:15:38.541873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-24T22:15:38.542018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-24T22:15:38.542200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-24T22:15:38.542377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-24T22:15:38.542538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-24T22:15:38.542730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-24T22:15:38.542879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-24T22:15:38.543017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-24T22:15:38.543172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-24T22:15:38.543353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-24T22:15:38.543548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-24T22:15:38.543732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-24T22:15:38.543898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-24T22:15:38.544044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-24T22:15:38.544203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-24T22:15:38.544420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-24T22:15:38.544598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-24T22:15:38.544807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-24T22:15:38.544959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-24T22:15:38.545144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-24T22:15:38.545315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-24T22:15:38.545476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-24T22:15:38.545783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-24T22:15:38.545930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-24T22:15:38.546115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-24T22:15:38.546258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-24T22:15:38.546564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-24T22:15:38.546743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-24T22:15:38.546913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-24T22:15:38.547059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-24T22:15:38.547227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-24T22:15:38.547394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-24T22:15:38.547565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-24T22:15:38.547760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-24T22:15:38.547954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-24T22:15:38.548104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-24T22:15:38.548261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-24T22:15:38.548405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-24T22:15:38.548564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-24T22:15:38.548731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-24T22:15:38.548910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-24T22:15:38.549293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-24T22:15:38.549473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-24T22:15:38.549621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-24T22:15:38.549816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-24T22:15:38.549975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-24T22:15:38.550153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-24T22:15:38.550352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-24T22:15:38.550522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-24T22:15:38.550726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-24T22:15:38.550893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-24T22:15:38.551049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-24T22:15:38.551206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-24T22:15:38.551384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-24T22:15:38.551611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-24T22:15:38.551836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-24T22:15:38.552011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-24T22:15:38.552176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-24T22:15:38.552372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-24T22:15:38.552534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-24T22:15:38.552718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-24T22:15:38.552871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-24T22:15:38.553031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-24T22:15:38.553198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-24T22:15:38.553362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-24T22:15:38.553546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-24T22:15:38.553836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-24T22:15:38.554004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-24T22:15:38.554156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-24T22:15:38.554352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-24T22:15:38.554525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-24T22:15:38.554759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-24T22:15:38.554912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-24T22:15:38.555076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-24T22:15:38.555264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-24T22:15:38.555439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-24T22:15:38.555586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-24T22:15:38.555802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-24T22:15:38.555964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-24T22:15:38.556137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-24T22:15:38.556305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-24T22:15:38.556469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-24T22:15:38.556634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-24T22:15:38.556842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-24T22:15:38.557010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-24T22:15:38.557180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-24T22:15:38.557309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-24T22:15:38.557503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-24T22:15:38.557700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-24T22:15:38.558033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-24T22:15:38.558194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-24T22:15:38.558412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-24T22:15:38.558590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-24T22:15:38.558781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-24T22:15:38.558953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-24T22:15:38.559130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-24T22:15:38.559271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-24T22:15:38.559436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-24T22:15:38.559579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-24T22:15:38.559741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-24T22:15:38.559907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-24T22:15:38.560038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-24T22:15:38.560165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-24T22:15:38.560359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-24T22:15:38.560543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-24T22:15:38.560750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-24T22:15:38.560874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-24T22:15:38.561202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-24T22:15:38.561350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-24T22:15:38.561517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-24T22:15:38.561853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-24T22:15:38.562065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-24T22:15:38.562230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-24T22:15:38.562379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-24T22:15:38.562550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-24T22:15:38.562755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-24T22:15:38.562899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-24T22:15:38.563099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-24T22:15:38.563262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-24T22:15:38.563428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-24T22:15:38.563604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-24T22:15:38.563806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-24T22:15:38.563958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-24T22:15:38.564130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-24T22:15:38.564337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-24T22:15:38.564483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-24T22:15:38.564676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-24T22:15:38.564852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-24T22:15:38.564990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-24T22:15:38.565179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-24T22:15:38.565352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-24T22:15:38.565614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-24T22:15:38.565823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-24T22:15:38.565964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-24T22:15:38.566110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-24T22:15:38.566268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-24T22:15:38.566408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-24T22:15:38.566596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-24T22:15:38.566767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-24T22:15:38.566924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-24T22:15:38.567141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-24T22:15:38.567281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-24T22:15:38.567477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-24T22:15:38.567610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-24T22:15:38.567796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-24T22:15:38.567982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-24T22:15:38.568161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-24T22:15:38.568323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-24T22:15:38.568462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-24T22:15:38.568631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-24T22:15:38.568819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-24T22:15:38.569138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-24T22:15:38.569289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-24T22:15:38.569462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-24T22:15:38.569616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-24T22:15:38.569928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-24T22:15:38.570086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-24T22:15:38.570266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-24T22:15:38.570423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-24T22:15:38.570615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-24T22:15:38.570834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-24T22:15:38.570962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-24T22:15:38.571080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-24T22:15:38.571255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-24T22:15:38.571407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-24T22:15:38.571602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-24T22:15:38.571796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-24T22:15:38.571959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-24T22:15:38.572135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-24T22:15:38.572299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-24T22:15:38.572468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-24T22:15:38.572614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-24T22:15:38.572784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-24T22:15:38.572959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-24T22:15:38.573137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-24T22:15:38.573304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-24T22:15:38.573448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-24T22:15:38.573677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-24T22:15:38.573840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-24T22:15:38.574026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-24T22:15:38.574196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-24T22:15:38.574344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-24T22:15:38.574699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-24T22:15:38.574909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-24T22:15:38.575061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-24T22:15:38.575224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-24T22:15:38.575412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-24T22:15:38.575596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-24T22:15:38.575832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-24T22:15:38.576052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-24T22:15:38.576246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-24T22:15:38.576421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-24T22:15:38.576568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-24T22:15:38.576849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-24T22:15:38.577030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-24T22:15:38.577221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-24T22:15:38.577426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-24T22:15:38.577617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-24T22:15:38.578013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-24T22:15:38.578189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-24T22:15:38.578343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-24T22:15:38.578509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-24T22:15:38.578692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-24T22:15:38.578858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-24T22:15:38.579066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-24T22:15:38.579244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-24T22:15:38.579465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-24T22:15:38.579669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-24T22:15:38.579849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-24T22:15:38.580003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-24T22:15:38.580164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-24T22:15:38.580390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-24T22:15:38.580584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-24T22:15:38.580773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-24T22:15:38.580946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-24T22:15:38.581198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-24T22:15:38.581366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-24T22:15:38.581539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-24T22:15:38.581780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-24T22:15:38.581989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-24T22:15:38.582162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-24T22:15:38.582357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-24T22:15:38.582523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-24T22:15:38.582755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-24T22:15:38.582932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-24T22:15:38.583089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-24T22:15:38.583240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-24T22:15:38.583422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-24T22:15:38.583589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-24T22:15:38.583798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-24T22:15:38.583987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-24T22:15:38.584145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-24T22:15:38.584266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-24T22:15:38.584366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-24T22:15:38.584492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-24T22:15:38.584634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-24T22:15:38.584800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-24T22:15:38.584947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-24T22:15:38.585079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-24T22:15:38.585227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-24T22:15:38.585468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-24T22:15:38.586118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-24T22:15:38.586356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-24T22:15:38.586543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-24T22:15:38.586763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-24T22:15:38.586965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-24T22:15:38.587535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-24T22:15:38.587760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-24T22:15:38.587974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-24T22:15:38.588168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-24T22:15:38.588349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-24T22:15:38.588575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-24T22:15:38.588806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-24T22:15:38.589014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-24T22:15:38.589171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-24T22:15:38.589315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-24T22:15:38.589504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-24T22:15:38.589675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-24T22:15:38.589847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-24T22:15:38.590248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-24T22:15:38.590428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-24T22:15:38.590625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-24T22:15:38.591040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-24T22:15:38.591173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-24T22:15:38.591320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-24T22:15:38.591486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-24T22:15:38.591699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-24T22:15:38.591905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-24T22:15:38.592061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-24T22:15:38.592224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-24T22:15:38.592374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-24T22:15:38.592530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-24T22:15:38.592702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-24T22:15:38.592870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-24T22:15:38.593038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-24T22:15:38.593229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-24T22:15:38.593402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-24T22:15:38.593577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-24T22:15:38.593915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-24T22:15:38.594116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-24T22:15:38.594289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-24T22:15:38.594456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-24T22:15:38.594667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-24T22:15:38.594850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-24T22:15:38.595047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-24T22:15:38.595219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-24T22:15:38.595449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-24T22:15:38.595599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-24T22:15:38.595811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-24T22:15:38.595985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-24T22:15:38.596152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-24T22:15:38.596343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-24T22:15:38.596504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-24T22:15:38.596699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-24T22:15:38.596864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-24T22:15:38.597013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-24T22:15:38.597143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-24T22:15:38.597274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-24T22:15:38.597510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-24T22:15:38.597863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-24T22:15:38.598039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-24T22:15:38.598219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-24T22:15:38.598418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-24T22:15:38.598628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-24T22:15:38.598851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-24T22:15:38.599014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-24T22:15:38.599377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-24T22:15:38.599588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-24T22:15:38.599799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-24T22:15:38.599998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-24T22:15:38.600201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-24T22:15:38.600440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-24T22:15:38.600623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-24T22:15:38.600854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-24T22:15:38.601036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-24T22:15:38.601226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-24T22:15:38.601382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-24T22:15:38.601541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-24T22:15:38.601745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-24T22:15:38.601903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-24T22:15:38.602082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-24T22:15:38.602264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-24T22:15:38.602413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-24T22:15:38.602571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-24T22:15:38.602770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-24T22:15:38.602964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-24T22:15:38.603172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-24T22:15:38.603364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-24T22:15:38.603583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-24T22:15:38.603776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-24T22:15:38.603978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-24T22:15:38.604165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-24T22:15:38.604364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-24T22:15:38.604560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-24T22:15:38.604791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-24T22:15:38.604985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-24T22:15:38.605184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-24T22:15:38.605364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-24T22:15:38.605538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-24T22:15:38.605903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-24T22:15:38.606117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-24T22:15:38.606323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-24T22:15:38.606499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-24T22:15:38.606713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-24T22:15:38.606917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-24T22:15:38.607102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-24T22:15:38.607289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-24T22:15:38.607489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-24T22:15:38.607706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-24T22:15:38.608143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-24T22:15:38.608297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-24T22:15:38.608470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-24T22:15:38.608735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-24T22:15:38.608972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-24T22:15:38.609188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-24T22:15:38.609383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-24T22:15:38.609554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-24T22:15:38.609751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-24T22:15:38.610180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-24T22:15:38.610378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-24T22:15:38.610581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-24T22:15:38.610772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-24T22:15:38.610991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-24T22:15:38.611179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-24T22:15:38.611387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-24T22:15:38.611564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-24T22:15:38.611769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-24T22:15:38.611954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-24T22:15:38.612094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-24T22:15:38.612237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-24T22:15:38.612396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-24T22:15:38.612569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-24T22:15:38.612865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-24T22:15:38.613007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-24T22:15:38.613156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-24T22:15:38.613316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-24T22:15:38.613458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-24T22:15:38.613598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-24T22:15:38.613788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-24T22:15:38.613940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-24T22:15:38.614173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-24T22:15:38.614297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-24T22:15:38.614482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-24T22:15:38.614629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-24T22:15:38.614808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-24T22:15:38.614945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-24T22:15:38.615086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-24T22:15:38.615267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-24T22:15:38.615409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-24T22:15:38.615531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-24T22:15:38.615698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-24T22:15:38.615896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-24T22:15:38.616047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-24T22:15:38.616199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-24T22:15:38.616387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-24T22:15:38.616560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-24T22:15:38.616806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-24T22:15:38.617023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-24T22:15:38.617212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-24T22:15:38.617365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-24T22:15:38.617549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-24T22:15:38.617871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-24T22:15:38.618057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-24T22:15:38.618287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-24T22:15:38.618488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-24T22:15:38.618737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-24T22:15:38.618957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-24T22:15:38.619124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-24T22:15:38.619313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-24T22:15:38.619487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-24T22:15:38.619691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-24T22:15:38.619872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-24T22:15:38.620231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-24T22:15:38.620410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-24T22:15:38.620607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-24T22:15:38.620830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-24T22:15:38.621014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-24T22:15:38.621193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-24T22:15:38.621403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-24T22:15:38.621603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-24T22:15:38.621810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-24T22:15:38.621959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-24T22:15:38.622152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-24T22:15:38.622321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-24T22:15:38.622481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-24T22:15:38.622690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-24T22:15:38.622859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-24T22:15:38.622996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-24T22:15:38.623120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-24T22:15:38.623298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-24T22:15:38.623636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-24T22:15:38.623886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-24T22:15:38.624007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-24T22:15:38.624155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-24T22:15:38.624339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-24T22:15:38.624524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-24T22:15:38.624684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-24T22:15:38.624828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-24T22:15:38.624980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-24T22:15:38.625106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-24T22:15:38.625212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-24T22:15:38.625335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-24T22:15:38.625485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-24T22:15:38.625633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-24T22:15:38.625840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-24T22:15:38.625975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-24T22:15:38.626166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-24T22:15:38.626314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-24T22:15:38.626459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-24T22:15:38.626621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-24T22:15:38.626805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-24T22:15:38.626975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-24T22:15:38.627290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-24T22:15:38.627452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-24T22:15:38.627590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-24T22:15:38.627766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-24T22:15:38.627929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-24T22:15:38.628068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-24T22:15:38.628230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-24T22:15:38.628396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-24T22:15:38.628557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-24T22:15:38.628747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-24T22:15:38.628911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-24T22:15:38.629067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-24T22:15:38.629216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-24T22:15:38.629397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-24T22:15:38.629588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-24T22:15:38.629787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-24T22:15:38.630014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-24T22:15:38.630209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-24T22:15:38.630363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-24T22:15:38.630573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-24T22:15:38.630863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-24T22:15:38.631030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-24T22:15:38.631237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-24T22:15:38.631389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-24T22:15:38.631558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-24T22:15:38.631778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-24T22:15:38.631975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-24T22:15:38.632180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-24T22:15:38.632312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-24T22:15:38.632476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-24T22:15:38.632791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-24T22:15:38.632985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-24T22:15:38.633165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-24T22:15:38.633325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-24T22:15:38.633527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-24T22:15:38.633742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-24T22:15:38.633926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-24T22:15:38.634111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-24T22:15:38.634325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-24T22:15:38.634532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-24T22:15:38.634795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-24T22:15:38.634950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-24T22:15:38.635100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-24T22:15:38.635305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-24T22:15:38.635499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-24T22:15:38.635718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-24T22:15:38.635917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-24T22:15:38.636095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-24T22:15:38.636316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-24T22:15:38.636492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-24T22:15:38.636695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-24T22:15:38.636887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-24T22:15:38.637068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-24T22:15:38.637395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-24T22:15:38.637576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-24T22:15:38.637784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-24T22:15:38.637991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-24T22:15:38.638178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-24T22:15:38.638358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-24T22:15:38.638544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-24T22:15:38.638845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-24T22:15:38.639021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-24T22:15:38.639326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-24T22:15:38.639502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-24T22:15:38.639745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-24T22:15:38.639902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-24T22:15:38.640072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-24T22:15:38.640229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-24T22:15:38.640392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-24T22:15:38.640552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-24T22:15:38.640711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-24T22:15:38.640883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-24T22:15:38.641032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-24T22:15:38.641174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-24T22:15:38.641324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-24T22:15:38.641466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-24T22:15:38.641627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-24T22:15:38.641784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-24T22:15:38.641933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-24T22:15:38.642128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-24T22:15:38.642307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-24T22:15:38.642454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-24T22:15:38.642608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-24T22:15:38.642822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-24T22:15:38.643004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-24T22:15:38.643272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-24T22:15:38.643460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-24T22:15:38.643918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-24T22:15:38.644095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-24T22:15:38.644287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-24T22:15:38.644500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-24T22:15:38.644706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-24T22:15:38.644852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-24T22:15:38.644973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-24T22:15:38.645157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-24T22:15:38.645345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-24T22:15:38.645552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-24T22:15:38.645744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-24T22:15:38.645987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-24T22:15:38.646155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-24T22:15:38.646359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-24T22:15:38.646544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-24T22:15:38.646749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-24T22:15:38.646962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-24T22:15:38.647159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-24T22:15:38.647341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-24T22:15:38.647552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-24T22:15:38.648023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-24T22:15:38.648241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-24T22:15:38.648515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-24T22:15:38.648902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-24T22:15:38.649066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-24T22:15:38.649250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-24T22:15:38.649437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-24T22:15:38.649627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-24T22:15:38.649850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-24T22:15:38.650055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-24T22:15:38.650248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-24T22:15:38.650466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-24T22:15:38.651083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-24T22:15:38.651333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-24T22:15:38.651501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-24T22:15:38.651714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-24T22:15:38.651943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-24T22:15:38.652111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-24T22:15:38.652283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-24T22:15:38.652483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-24T22:15:38.652721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-24T22:15:38.652914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-24T22:15:38.653080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-24T22:15:38.653263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-24T22:15:38.653447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-24T22:15:38.653901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-24T22:15:38.654091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-24T22:15:38.654230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-24T22:15:38.654364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-24T22:15:38.654598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-24T22:15:38.654818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-24T22:15:38.655000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-24T22:15:38.655178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-24T22:15:38.655358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-24T22:15:38.655550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-24T22:15:38.655737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-24T22:15:38.655944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-24T22:15:38.656109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-24T22:15:38.656318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-24T22:15:38.656481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-24T22:15:38.656690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-24T22:15:38.656893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-24T22:15:38.657022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-24T22:15:38.657160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-24T22:15:38.657385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-24T22:15:38.657539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-24T22:15:38.657716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-24T22:15:38.657921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-24T22:15:38.658119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-24T22:15:38.658260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-24T22:15:38.658415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-24T22:15:38.658583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-24T22:15:38.658842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-24T22:15:38.659069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-24T22:15:38.659240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-24T22:15:38.659408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-24T22:15:38.659587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-24T22:15:38.659843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-24T22:15:38.660007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-24T22:15:38.660169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-24T22:15:38.660390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-24T22:15:38.660591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-24T22:15:38.660771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-24T22:15:38.660931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-24T22:15:38.661093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-24T22:15:38.661274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-24T22:15:38.661439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-24T22:15:38.661615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-24T22:15:38.661794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-24T22:15:38.661981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-24T22:15:38.662165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-24T22:15:38.662382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-24T22:15:38.662724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-24T22:15:38.662897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-24T22:15:38.663057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-24T22:15:38.663241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-24T22:15:38.663427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-24T22:15:38.663577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-24T22:15:38.663820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-24T22:15:38.664057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-24T22:15:38.664257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-24T22:15:38.664459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-24T22:15:38.664700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-24T22:15:38.664863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-24T22:15:38.665036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-24T22:15:38.665185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-24T22:15:38.665358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-24T22:15:38.665522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-24T22:15:38.665813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-24T22:15:38.665934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-24T22:15:38.666111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-24T22:15:38.666268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-24T22:15:38.666432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-24T22:15:38.666620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-24T22:15:38.666830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-24T22:15:38.667025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-24T22:15:38.667222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-24T22:15:38.667457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-24T22:15:38.667714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-24T22:15:38.667873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-24T22:15:38.668061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-24T22:15:38.668221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-24T22:15:38.668411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-24T22:15:38.668590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-24T22:15:38.668835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-24T22:15:38.669029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-24T22:15:38.669328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-24T22:15:38.669473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-24T22:15:38.669685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-24T22:15:38.669844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-24T22:15:38.670008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-24T22:15:38.670157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-24T22:15:38.670346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-24T22:15:38.670520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-24T22:15:38.670734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-24T22:15:38.670931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-24T22:15:38.671068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-24T22:15:38.671189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-24T22:15:38.671342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-24T22:15:38.671615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-24T22:15:38.671828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-24T22:15:38.671997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-24T22:15:38.672181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-24T22:15:38.672374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-24T22:15:38.672552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-24T22:15:38.672806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-24T22:15:38.672976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-24T22:15:38.673116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-24T22:15:38.673276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-24T22:15:38.673463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-24T22:15:38.673634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-24T22:15:38.673862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-24T22:15:38.674278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-24T22:15:38.674465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-24T22:15:38.674695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-24T22:15:38.674851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-24T22:15:38.674995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-24T22:15:38.675169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-24T22:15:38.675334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-24T22:15:38.675506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-24T22:15:38.675861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-24T22:15:38.676019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-24T22:15:38.676215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-24T22:15:38.676417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-24T22:15:38.676615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-24T22:15:38.676796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-24T22:15:38.677003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-24T22:15:38.677155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-24T22:15:38.677340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-24T22:15:38.677572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-24T22:15:38.677793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-24T22:15:38.678046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-24T22:15:38.678205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-24T22:15:38.678378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-24T22:15:38.678560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-24T22:15:38.678739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-24T22:15:38.678865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-24T22:15:38.679020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-24T22:15:38.679201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-24T22:15:38.679376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-24T22:15:38.679541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-24T22:15:38.679859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-24T22:15:38.679987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-24T22:15:38.680407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-24T22:15:38.680625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-24T22:15:38.680837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-24T22:15:38.681018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-24T22:15:38.681190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-24T22:15:38.681333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-24T22:15:38.681465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-24T22:15:38.681679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-24T22:15:38.681851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-24T22:15:38.682009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-24T22:15:38.682319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-24T22:15:38.682496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-24T22:15:38.682762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-24T22:15:38.682893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-24T22:15:38.682999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-24T22:15:38.683145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-24T22:15:38.683302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-24T22:15:38.683469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-24T22:15:38.683638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-24T22:15:38.683967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-24T22:15:38.684136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-24T22:15:38.684306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-24T22:15:38.684448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-24T22:15:38.684620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-24T22:15:38.684823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-24T22:15:38.685009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-24T22:15:38.685197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-24T22:15:38.685366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-24T22:15:38.685501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-24T22:15:38.685708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-24T22:15:38.685909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-24T22:15:38.686089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-24T22:15:38.686287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-24T22:15:38.686452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-24T22:15:38.686625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-24T22:15:38.686851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-24T22:15:38.687048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-24T22:15:38.687237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-24T22:15:38.687428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-24T22:15:38.687596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-24T22:15:38.687891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-24T22:15:38.688124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-24T22:15:38.688288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-24T22:15:38.688438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-24T22:15:38.688598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-24T22:15:38.688792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-24T22:15:38.688940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-24T22:15:38.689124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-24T22:15:38.689546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-24T22:15:38.689735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-24T22:15:38.689895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-24T22:15:38.690106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-24T22:15:38.690308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-24T22:15:38.690500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-24T22:15:38.690712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-24T22:15:38.690856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-24T22:15:38.691004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-24T22:15:38.691262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-24T22:15:38.691437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-24T22:15:38.691623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-24T22:15:38.691853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-24T22:15:38.692035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-24T22:15:38.692260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-24T22:15:38.692432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-24T22:15:38.692603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-24T22:15:38.692787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-24T22:15:38.692946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-24T22:15:38.693187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-24T22:15:38.693364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-24T22:15:38.693549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-24T22:15:38.693756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-24T22:15:38.693965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-24T22:15:38.694145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-24T22:15:38.694353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-24T22:15:38.694498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-24T22:15:38.694734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-24T22:15:38.694876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-24T22:15:38.695040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-24T22:15:38.695202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-24T22:15:38.695399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-24T22:15:38.695560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-24T22:15:38.695813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-24T22:15:38.695987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-24T22:15:38.696146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-24T22:15:38.696277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-24T22:15:38.696446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-24T22:15:38.696607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-24T22:15:38.696816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-24T22:15:38.697016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-24T22:15:38.697181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-24T22:15:38.697408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-24T22:15:38.697579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-24T22:15:38.697777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-24T22:15:38.697945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-24T22:15:38.698102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-24T22:15:38.698269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-24T22:15:38.698425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-24T22:15:38.698599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-24T22:15:38.698781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-24T22:15:38.699162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-24T22:15:38.699328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-24T22:15:38.699532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-24T22:15:38.699721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-24T22:15:38.699894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-24T22:15:38.700041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-24T22:15:38.700193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-24T22:15:38.700354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-24T22:15:38.700521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-24T22:15:38.700715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-24T22:15:38.700849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-24T22:15:38.700962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-24T22:15:38.701123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-24T22:15:38.701245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-24T22:15:38.701362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-24T22:15:38.701486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-24T22:15:38.701688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-24T22:15:38.701829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-24T22:15:38.701974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-24T22:15:38.702179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-24T22:15:38.702337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-24T22:15:38.702507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-24T22:15:38.702680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-24T22:15:38.702835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-24T22:15:38.702974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-24T22:15:38.703100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-24T22:15:38.703237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-24T22:15:38.703377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-24T22:15:38.703903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-24T22:15:38.704111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-24T22:15:38.704286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-24T22:15:38.704459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-24T22:15:38.704612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-24T22:15:38.704802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-24T22:15:38.704986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-24T22:15:38.705207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-24T22:15:38.705398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-24T22:15:38.705584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-24T22:15:38.705754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-24T22:15:38.705936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-24T22:15:38.706160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-24T22:15:38.706333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-24T22:15:38.706498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-24T22:15:38.706746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-24T22:15:38.706923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-24T22:15:38.707099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-24T22:15:38.707291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-24T22:15:38.707499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-24T22:15:38.707680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-24T22:15:38.707811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-24T22:15:38.707961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-24T22:15:38.708160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-24T22:15:38.708359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-24T22:15:38.708520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-24T22:15:38.708734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-24T22:15:38.708889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-24T22:15:38.709050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-24T22:15:38.709259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-24T22:15:38.709456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-24T22:15:38.709622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-24T22:15:38.709846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-24T22:15:38.710035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-24T22:15:38.710196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-24T22:15:38.710358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-24T22:15:38.710519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-24T22:15:38.710705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-24T22:15:38.710856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-24T22:15:38.711034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-24T22:15:38.711184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-24T22:15:38.711362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-24T22:15:38.711515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-24T22:15:38.711821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-24T22:15:38.712006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-24T22:15:38.712368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-24T22:15:38.712516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-24T22:15:38.712633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-24T22:15:38.712798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-24T22:15:38.712917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-24T22:15:38.713045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-24T22:15:38.713168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-24T22:15:38.713272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-24T22:15:38.713403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-24T22:15:38.713504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-24T22:15:38.713623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-24T22:15:38.713787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-24T22:15:38.713911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-24T22:15:38.714070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-24T22:15:38.714203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-24T22:15:38.714364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-24T22:15:38.714501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-24T22:15:38.714632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-24T22:15:38.714790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-24T22:15:38.714908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-24T22:15:38.715060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-24T22:15:38.715205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-24T22:15:38.715542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-24T22:15:38.715707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-24T22:15:38.715892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-24T22:15:38.716079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-24T22:15:38.716257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-24T22:15:38.716494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-24T22:15:38.716713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-24T22:15:38.716909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-24T22:15:38.717058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-24T22:15:38.717217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-24T22:15:38.717366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-24T22:15:38.717587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-24T22:15:38.717795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-24T22:15:38.717977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-24T22:15:38.718157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-24T22:15:38.718327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-24T22:15:38.718512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-24T22:15:38.718754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-24T22:15:38.718943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-24T22:15:38.719129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-24T22:15:38.719302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-24T22:15:38.719452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-24T22:15:38.719602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-24T22:15:38.719923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-24T22:15:38.720075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-24T22:15:38.720244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-24T22:15:38.720422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-24T22:15:38.720615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-24T22:15:38.720936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-24T22:15:38.721129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-24T22:15:38.721306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-24T22:15:38.721475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-24T22:15:38.721711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-24T22:15:38.721893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-24T22:15:38.722116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-24T22:15:38.722288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-24T22:15:38.722427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-24T22:15:38.722560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-24T22:15:38.722758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-24T22:15:38.722930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-24T22:15:38.723128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-24T22:15:38.723274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-24T22:15:38.723434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-24T22:15:38.723799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-24T22:15:38.723925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-24T22:15:38.724043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-24T22:15:38.724190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-24T22:15:38.724335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-24T22:15:38.724461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-24T22:15:38.724560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-24T22:15:38.724717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-24T22:15:38.724853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-24T22:15:38.724982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-24T22:15:38.725122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-24T22:15:38.725293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-24T22:15:38.725433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-24T22:15:38.725572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-24T22:15:38.725733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-24T22:15:38.725912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-24T22:15:38.726055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-24T22:15:38.726197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-24T22:15:38.726357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-24T22:15:38.726514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-24T22:15:38.726700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-24T22:15:38.726829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-24T22:15:38.726991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-24T22:15:38.727122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-24T22:15:38.727218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-24T22:15:38.727340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-24T22:15:38.727535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-24T22:15:38.727857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-24T22:15:38.727998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-24T22:15:38.728170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-24T22:15:38.728371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-24T22:15:38.728496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-24T22:15:38.728663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-24T22:15:38.728868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-24T22:15:38.729035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-24T22:15:38.729185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-24T22:15:38.729309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-24T22:15:38.729450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-24T22:15:38.729590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-24T22:15:38.729754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-24T22:15:38.729910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-24T22:15:38.730055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-24T22:15:38.730192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-24T22:15:38.730346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-24T22:15:38.730486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-24T22:15:38.730623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-24T22:15:38.730780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-24T22:15:38.730889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-24T22:15:38.731022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-24T22:15:38.731192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-24T22:15:38.731405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-24T22:15:38.731578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-24T22:15:38.731921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-24T22:15:38.732127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-24T22:15:38.732297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-24T22:15:38.732439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-24T22:15:38.732586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-24T22:15:38.733115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-24T22:15:38.733403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-24T22:15:38.733572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-24T22:15:38.733770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-24T22:15:38.733897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-24T22:15:38.734040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-24T22:15:38.734160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-24T22:15:38.734308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-24T22:15:38.734471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-24T22:15:38.734675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-24T22:15:38.734838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-24T22:15:38.735042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-24T22:15:38.735210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-24T22:15:38.735385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-24T22:15:38.735557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-24T22:15:38.735778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-24T22:15:38.735969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-24T22:15:38.736144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-24T22:15:38.736325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-24T22:15:38.736483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-24T22:15:38.736694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-24T22:15:38.736877] [INFO ] [LOCAL ] Deleted 1976 derivative data files. [2025-09-24T22:15:38.736962] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-24T22:15:38.739625] [INFO ] [LOCAL ] Found 2075 symbols with primary data. [2025-09-24T22:15:38.740729] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2075 symbols [2025-09-24T22:15:38.743036] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:38.745048] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:38.743365] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:38.850474] [DEBUG] [LOCAL ] A: Loaded 50780 existing records from primary storage. [2025-09-24T22:15:38.852767] [INFO ] [MAIN ] A: Loaded 50780 primary data records. [2025-09-24T22:15:38.878252] [DEBUG] [LOCAL ] AAP: Loaded 52097 existing records from primary storage. [2025-09-24T22:15:38.922073] [INFO ] [MAIN ] AAP: Loaded 52097 primary data records. [2025-09-24T22:15:39.171874] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-24T22:15:39.226973] [INFO ] [MAIN ] AA: Loaded 53614 primary data records. [2025-09-24T22:15:40.006710] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:40.006373] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:40.008592] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 52097 primary records. [2025-09-24T22:15:40.007982] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50780 primary records. [2025-09-24T22:15:40.008746] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-24T22:15:40.008890] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-24T22:15:40.035062] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-09-24T22:15:40.046319] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-24T22:15:40.048738] [INFO ] [MAIN ] Derivative Progress: 1/2075 symbols completed. A took 1.3s. Estimated remaining: 45m 14s. Rate: 45.8 symbols/min [2025-09-24T22:15:40.050091] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:40.056631] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:40.057594] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53614 primary records. [2025-09-24T22:15:40.057959] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-24T22:15:40.071489] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-09-24T22:15:40.072278] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-24T22:15:40.074849] [INFO ] [MAIN ] Derivative Progress: 2/2075 symbols completed. AAP took 1.3s. Estimated remaining: 23m 4s. Rate: 89.9 symbols/min [2025-09-24T22:15:40.075163] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:40.078795] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-09-24T22:15:40.079101] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-24T22:15:40.082143] [INFO ] [MAIN ] Derivative Progress: 3/2075 symbols completed. AA took 1.3s. Estimated remaining: 15m 27s. Rate: 134.1 symbols/min [2025-09-24T22:15:40.083876] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:40.137506] [DEBUG] [LOCAL ] AB: Loaded 28323 existing records from primary storage. [2025-09-24T22:15:40.149862] [INFO ] [MAIN ] AB: Loaded 28323 primary data records. [2025-09-24T22:15:40.151045] [DEBUG] [LOCAL ] AAT: Loaded 30649 existing records from primary storage. [2025-09-24T22:15:40.162743] [INFO ] [MAIN ] AAT: Loaded 30649 primary data records. [2025-09-24T22:15:40.325732] [DEBUG] [LOCAL ] ABEV: Loaded 53276 existing records from primary storage. [2025-09-24T22:15:40.347619] [INFO ] [MAIN ] ABEV: Loaded 53276 primary data records. [2025-09-24T22:15:41.189760] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:41.191327] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 28323 primary records. [2025-09-24T22:15:41.191697] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:41.192680] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30649 primary records. [2025-09-24T22:15:41.191937] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-24T22:15:41.193569] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-24T22:15:41.225275] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-24T22:15:41.238984] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-24T22:15:41.239709] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:41.241879] [INFO ] [MAIN ] Derivative Progress: 4/2075 symbols completed. AAT took 1.2s. Estimated remaining: 21m 35s. Rate: 95.9 symbols/min [2025-09-24T22:15:41.242708] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:41.243586] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53276 primary records. [2025-09-24T22:15:41.244569] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-24T22:15:41.261041] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-24T22:15:41.261765] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-24T22:15:41.263933] [INFO ] [MAIN ] Derivative Progress: 5/2075 symbols completed. AB took 1.2s. Estimated remaining: 17m 25s. Rate: 118.9 symbols/min [2025-09-24T22:15:41.264938] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:41.268345] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-24T22:15:41.268638] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-24T22:15:41.271051] [INFO ] [MAIN ] Derivative Progress: 6/2075 symbols completed. ABEV took 1.2s. Estimated remaining: 14m 33s. Rate: 142.2 symbols/min [2025-09-24T22:15:41.271437] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:41.330125] [DEBUG] [LOCAL ] ACEL: Loaded 27124 existing records from primary storage. [2025-09-24T22:15:41.330363] [INFO ] [MAIN ] ACEL: Loaded 27124 primary data records. [2025-09-24T22:15:41.343482] [DEBUG] [LOCAL ] ABR: Loaded 52104 existing records from primary storage. [2025-09-24T22:15:41.356844] [INFO ] [MAIN ] ABR: Loaded 52104 primary data records. [2025-09-24T22:15:41.608623] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-24T22:15:41.614325] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-09-24T22:15:42.422026] [DEBUG] [MAIN ] ABR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:42.427944] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:42.428783] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52104 primary records. [2025-09-24T22:15:42.429443] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 27124 primary records. [2025-09-24T22:15:42.429524] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-24T22:15:42.429690] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-24T22:15:42.460218] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-09-24T22:15:42.460769] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-24T22:15:42.462916] [INFO ] [MAIN ] Derivative Progress: 7/2075 symbols completed. ACEL took 1.2s. Estimated remaining: 18m 20s. Rate: 112.8 symbols/min [2025-09-24T22:15:42.463296] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:42.467674] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-24T22:15:42.469388] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-24T22:15:42.471248] [INFO ] [MAIN ] Derivative Progress: 8/2075 symbols completed. ABR took 1.2s. Estimated remaining: 16m 4s. Rate: 128.6 symbols/min [2025-09-24T22:15:42.471727] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:42.485822] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:42.486556] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-09-24T22:15:42.486755] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-24T22:15:42.503710] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-09-24T22:15:42.503838] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-24T22:15:42.506712] [INFO ] [MAIN ] Derivative Progress: 9/2075 symbols completed. ACHR took 1.2s. Estimated remaining: 14m 25s. Rate: 143.4 symbols/min [2025-09-24T22:15:42.507162] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:42.556757] [DEBUG] [LOCAL ] ACI: Loaded 53269 existing records from primary storage. [2025-09-24T22:15:42.569803] [INFO ] [MAIN ] ACI: Loaded 53269 primary data records. [2025-09-24T22:15:42.587877] [DEBUG] [LOCAL ] ACM: Loaded 43152 existing records from primary storage. [2025-09-24T22:15:42.602459] [INFO ] [MAIN ] ACM: Loaded 43152 primary data records. [2025-09-24T22:15:42.869199] [DEBUG] [LOCAL ] ACN: Loaded 53424 existing records from primary storage. [2025-09-24T22:15:42.952581] [INFO ] [MAIN ] ACN: Loaded 53424 primary data records. [2025-09-24T22:15:43.643666] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:43.657213] [DEBUG] [MAIN ] ACM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:43.658152] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43152 primary records. [2025-09-24T22:15:43.658448] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-24T22:15:43.656938] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53269 primary records. [2025-09-24T22:15:43.670891] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-24T22:15:43.676041] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-24T22:15:43.683453] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-24T22:15:43.688123] [INFO ] [MAIN ] Derivative Progress: 10/2075 symbols completed. ACM took 1.2s. Estimated remaining: 17m 2s. Rate: 121.3 symbols/min [2025-09-24T22:15:43.693894] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:43.710378] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-24T22:15:43.711527] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-24T22:15:43.711411] [DEBUG] [MAIN ] ACN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:43.713444] [INFO ] [MAIN ] Derivative Progress: 11/2075 symbols completed. ACI took 1.3s. Estimated remaining: 15m 33s. Rate: 132.7 symbols/min [2025-09-24T22:15:43.713789] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:43.715050] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53424 primary records. [2025-09-24T22:15:43.715240] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-24T22:15:43.737043] [DEBUG] [LOCAL ] ACR: Loaded 6297 existing records from primary storage. [2025-09-24T22:15:43.737665] [INFO ] [MAIN ] ACR: Loaded 6297 primary data records. [2025-09-24T22:15:43.812448] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-24T22:15:43.847677] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-24T22:15:43.853922] [INFO ] [MAIN ] Derivative Progress: 12/2075 symbols completed. ACN took 1.3s. Estimated remaining: 14m 39s. Rate: 140.8 symbols/min [2025-09-24T22:15:43.882388] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:43.946606] [DEBUG] [LOCAL ] ACP: Loaded 31136 existing records from primary storage. [2025-09-24T22:15:43.947157] [INFO ] [MAIN ] ACP: Loaded 31136 primary data records. [2025-09-24T22:15:44.393925] [DEBUG] [LOCAL ] ACRE: Loaded 33608 existing records from primary storage. [2025-09-24T22:15:44.395616] [INFO ] [MAIN ] ACRE: Loaded 33608 primary data records. [2025-09-24T22:15:44.604753] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:44.730120] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 6297 primary records. [2025-09-24T22:15:44.731058] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-24T22:15:44.767264] [DEBUG] [MAIN ] ACP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:44.766770] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-09-24T22:15:44.768366] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-24T22:15:44.770601] [INFO ] [MAIN ] Derivative Progress: 13/2075 symbols completed. ACR took 1.1s. Estimated remaining: 15m 57s. Rate: 129.3 symbols/min [2025-09-24T22:15:44.768223] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31136 primary records. [2025-09-24T22:15:44.771032] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-24T22:15:44.788902] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-09-24T22:15:44.789192] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-24T22:15:44.792346] [INFO ] [MAIN ] Derivative Progress: 14/2075 symbols completed. ACP took 1.1s. Estimated remaining: 14m 51s. Rate: 138.8 symbols/min [2025-09-24T22:15:44.808040] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:44.808584] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33608 primary records. [2025-09-24T22:15:44.808684] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-24T22:15:44.823160] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-24T22:15:44.823221] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-24T22:15:44.825335] [INFO ] [MAIN ] Derivative Progress: 15/2075 symbols completed. ACRE took 1.0s. Estimated remaining: 13m 56s. Rate: 147.9 symbols/min [2025-09-24T22:15:44.826123] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:44.826225] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:44.826003] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:44.836449] [DEBUG] [LOCAL ] ACV: Loaded 6946 existing records from primary storage. [2025-09-24T22:15:44.836583] [INFO ] [MAIN ] ACV: Loaded 6946 primary data records. [2025-09-24T22:15:45.211486] [DEBUG] [LOCAL ] ADCT: Loaded 34069 existing records from primary storage. [2025-09-24T22:15:45.224182] [INFO ] [MAIN ] ADCT: Loaded 34069 primary data records. [2025-09-24T22:15:45.240538] [DEBUG] [LOCAL ] ACVA: Loaded 49322 existing records from primary storage. [2025-09-24T22:15:45.259460] [INFO ] [MAIN ] ACVA: Loaded 49322 primary data records. [2025-09-24T22:15:45.906665] [DEBUG] [MAIN ] ACV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:45.908208] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 6946 primary records. [2025-09-24T22:15:45.908484] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-24T22:15:45.931219] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-24T22:15:45.931496] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-24T22:15:45.934212] [INFO ] [MAIN ] Derivative Progress: 16/2075 symbols completed. ACV took 1.1s. Estimated remaining: 15m 26s. Rate: 133.4 symbols/min [2025-09-24T22:15:45.947042] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:45.948604] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:45.949916] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 34069 primary records. [2025-09-24T22:15:45.950136] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-24T22:15:45.972766] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-24T22:15:45.972932] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-24T22:15:45.983598] [INFO ] [MAIN ] Derivative Progress: 17/2075 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 37s. Rate: 140.8 symbols/min [2025-09-24T22:15:45.990163] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:45.989906] [DEBUG] [MAIN ] ACVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:45.991124] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49322 primary records. [2025-09-24T22:15:45.991593] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-24T22:15:46.009069] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-24T22:15:46.009275] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-24T22:15:46.012173] [INFO ] [MAIN ] Derivative Progress: 18/2075 symbols completed. ACVA took 1.2s. Estimated remaining: 13m 51s. Rate: 148.5 symbols/min [2025-09-24T22:15:46.012553] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:46.051139] [DEBUG] [LOCAL ] ADM: Loaded 53395 existing records from primary storage. [2025-09-24T22:15:46.052175] [INFO ] [MAIN ] ADM: Loaded 53395 primary data records. [2025-09-24T22:15:46.399080] [DEBUG] [LOCAL ] ADNT: Loaded 47461 existing records from primary storage. [2025-09-24T22:15:46.413094] [INFO ] [MAIN ] ADNT: Loaded 47461 primary data records. [2025-09-24T22:15:46.414101] [DEBUG] [LOCAL ] ADT: Loaded 53477 existing records from primary storage. [2025-09-24T22:15:46.426921] [INFO ] [MAIN ] ADT: Loaded 53477 primary data records. [2025-09-24T22:15:47.100712] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:47.103607] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53395 primary records. [2025-09-24T22:15:47.103972] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-24T22:15:47.122557] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-09-24T22:15:47.123202] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-24T22:15:47.125426] [INFO ] [MAIN ] Derivative Progress: 19/2075 symbols completed. ADM took 1.2s. Estimated remaining: 15m 7s. Rate: 135.9 symbols/min [2025-09-24T22:15:47.126149] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:47.150486] [DEBUG] [MAIN ] ADNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:47.151762] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47461 primary records. [2025-09-24T22:15:47.151927] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-24T22:15:47.186398] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:47.188126] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53477 primary records. [2025-09-24T22:15:47.189263] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-24T22:15:47.214020] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-09-24T22:15:47.215253] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-24T22:15:47.217620] [INFO ] [MAIN ] Derivative Progress: 20/2075 symbols completed. ADNT took 1.2s. Estimated remaining: 14m 31s. Rate: 141.5 symbols/min [2025-09-24T22:15:47.220080] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:47.214776] [DEBUG] [LOCAL ] ADX: Loaded 27783 existing records from primary storage. [2025-09-24T22:15:47.221171] [INFO ] [MAIN ] ADX: Loaded 27783 primary data records. [2025-09-24T22:15:47.227878] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-24T22:15:47.261351] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-24T22:15:47.293175] [INFO ] [MAIN ] Derivative Progress: 21/2075 symbols completed. ADT took 1.3s. Estimated remaining: 13m 57s. Rate: 147.3 symbols/min [2025-09-24T22:15:47.307357] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:47.428263] [DEBUG] [LOCAL ] AEFC: Loaded 8584 existing records from primary storage. [2025-09-24T22:15:47.564103] [INFO ] [MAIN ] AEFC: Loaded 8584 primary data records. [2025-09-24T22:15:47.781114] [DEBUG] [LOCAL ] AEE: Loaded 50147 existing records from primary storage. [2025-09-24T22:15:47.782260] [INFO ] [MAIN ] AEE: Loaded 50147 primary data records. [2025-09-24T22:15:48.276364] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:48.277478] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27783 primary records. [2025-09-24T22:15:48.277722] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-24T22:15:48.314006] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-24T22:15:48.314590] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-24T22:15:48.315237] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:48.318917] [INFO ] [MAIN ] Derivative Progress: 22/2075 symbols completed. ADX took 1.2s. Estimated remaining: 14m 54s. Rate: 137.8 symbols/min [2025-09-24T22:15:48.316136] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8584 primary records. [2025-09-24T22:15:48.319874] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:48.319412] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-24T22:15:48.336719] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-24T22:15:48.336984] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-24T22:15:48.339869] [INFO ] [MAIN ] Derivative Progress: 23/2075 symbols completed. AEFC took 1.0s. Estimated remaining: 14m 16s. Rate: 143.8 symbols/min [2025-09-24T22:15:48.340360] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:48.358157] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:48.359087] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50147 primary records. [2025-09-24T22:15:48.359230] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-24T22:15:48.393253] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-24T22:15:48.393399] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-24T22:15:48.395934] [INFO ] [MAIN ] Derivative Progress: 24/2075 symbols completed. AEE took 1.2s. Estimated remaining: 13m 45s. Rate: 149.1 symbols/min [2025-09-24T22:15:48.396352] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:48.415851] [DEBUG] [LOCAL ] AEG: Loaded 49615 existing records from primary storage. [2025-09-24T22:15:48.426136] [INFO ] [MAIN ] AEG: Loaded 49615 primary data records. [2025-09-24T22:15:48.554548] [DEBUG] [LOCAL ] AER: Loaded 48631 existing records from primary storage. [2025-09-24T22:15:48.555118] [INFO ] [MAIN ] AER: Loaded 48631 primary data records. [2025-09-24T22:15:48.923835] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-09-24T22:15:48.965516] [INFO ] [MAIN ] AES: Loaded 53671 primary data records. [2025-09-24T22:15:49.494211] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:49.495605] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49615 primary records. [2025-09-24T22:15:49.496260] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-24T22:15:49.518192] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-24T22:15:49.518451] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-24T22:15:49.521996] [INFO ] [MAIN ] Derivative Progress: 25/2075 symbols completed. AEG took 1.2s. Estimated remaining: 14m 44s. Rate: 139.1 symbols/min [2025-09-24T22:15:49.535495] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:49.536390] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:49.537908] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48631 primary records. [2025-09-24T22:15:49.538155] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-24T22:15:49.573427] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:49.574428] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53671 primary records. [2025-09-24T22:15:49.573551] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-24T22:15:49.574695] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-24T22:15:49.574606] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-24T22:15:49.577847] [INFO ] [MAIN ] Derivative Progress: 26/2075 symbols completed. AER took 1.2s. Estimated remaining: 14m 14s. Rate: 143.9 symbols/min [2025-09-24T22:15:49.578241] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:49.615043] [DEBUG] [LOCAL ] AFB: Loaded 11277 existing records from primary storage. [2025-09-24T22:15:49.615180] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-24T22:15:49.615451] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-24T22:15:49.617927] [INFO ] [MAIN ] Derivative Progress: 27/2075 symbols completed. AES took 1.2s. Estimated remaining: 13m 45s. Rate: 148.9 symbols/min [2025-09-24T22:15:49.618403] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:49.618187] [INFO ] [MAIN ] AFB: Loaded 11277 primary data records. [2025-09-24T22:15:49.739995] [DEBUG] [LOCAL ] AESI: Loaded 49499 existing records from primary storage. [2025-09-24T22:15:49.740293] [INFO ] [MAIN ] AESI: Loaded 49499 primary data records. [2025-09-24T22:15:50.095184] [DEBUG] [LOCAL ] AFG: Loaded 32578 existing records from primary storage. [2025-09-24T22:15:50.106161] [INFO ] [MAIN ] AFG: Loaded 32578 primary data records. [2025-09-24T22:15:50.636451] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:50.637807] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11277 primary records. [2025-09-24T22:15:50.638017] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-24T22:15:50.658793] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-24T22:15:50.659200] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-24T22:15:50.661595] [INFO ] [MAIN ] Derivative Progress: 28/2075 symbols completed. AFB took 1.1s. Estimated remaining: 14m 32s. Rate: 140.9 symbols/min [2025-09-24T22:15:50.675228] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:50.675980] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49499 primary records. [2025-09-24T22:15:50.676184] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-24T22:15:50.695106] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-24T22:15:50.695332] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-24T22:15:50.697502] [INFO ] [MAIN ] Derivative Progress: 29/2075 symbols completed. AESI took 1.2s. Estimated remaining: 14m 4s. Rate: 145.5 symbols/min [2025-09-24T22:15:50.710120] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:50.710857] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32578 primary records. [2025-09-24T22:15:50.710920] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-24T22:15:50.727023] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-24T22:15:50.727096] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-24T22:15:50.729416] [INFO ] [MAIN ] Derivative Progress: 30/2075 symbols completed. AFG took 1.1s. Estimated remaining: 13m 37s. Rate: 150.1 symbols/min [2025-09-24T22:15:50.730281] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:50.730337] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:50.731244] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:50.737949] [DEBUG] [LOCAL ] AFGD: Loaded 1845 existing records from primary storage. [2025-09-24T22:15:50.738913] [INFO ] [MAIN ] AFGD: Loaded 1845 primary data records. [2025-09-24T22:15:50.750360] [DEBUG] [LOCAL ] AFGE: Loaded 2506 existing records from primary storage. [2025-09-24T22:15:50.760324] [INFO ] [MAIN ] AFGE: Loaded 2506 primary data records. [2025-09-24T22:15:50.790572] [DEBUG] [LOCAL ] AFGB: Loaded 2386 existing records from primary storage. [2025-09-24T22:15:50.830397] [INFO ] [MAIN ] AFGB: Loaded 2386 primary data records. [2025-09-24T22:15:51.754933] [DEBUG] [MAIN ] AFGD: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:15:51.757420] [INFO ] [MAIN ] AFGD: Generated 1792 derivative records from 1845 primary records. [2025-09-24T22:15:51.758204] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-24T22:15:51.784468] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:51.793543] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2506 primary records. [2025-09-24T22:15:51.798523] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-24T22:15:51.799441] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:51.800347] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2386 primary records. [2025-09-24T22:15:51.801376] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-24T22:15:51.803112] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1792 records). [2025-09-24T22:15:51.803212] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-24T22:15:51.805676] [INFO ] [MAIN ] Derivative Progress: 31/2075 symbols completed. AFGD took 1.1s. Estimated remaining: 14m 21s. Rate: 142.4 symbols/min [2025-09-24T22:15:51.806140] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:51.832841] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-09-24T22:15:51.833967] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-24T22:15:51.836627] [INFO ] [MAIN ] Derivative Progress: 32/2075 symbols completed. AFGE took 1.1s. Estimated remaining: 13m 56s. Rate: 146.6 symbols/min [2025-09-24T22:15:51.838403] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:51.840179] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-24T22:15:51.840385] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-24T22:15:51.842882] [INFO ] [MAIN ] Derivative Progress: 33/2075 symbols completed. AFGB took 1.1s. Estimated remaining: 13m 31s. Rate: 151.1 symbols/min [2025-09-24T22:15:51.843462] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:51.913057] [DEBUG] [LOCAL ] AGCO: Loaded 42446 existing records from primary storage. [2025-09-24T22:15:51.927389] [INFO ] [MAIN ] AGCO: Loaded 42446 primary data records. [2025-09-24T22:15:51.952422] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-09-24T22:15:52.021038] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-09-24T22:15:52.057196] [DEBUG] [LOCAL ] AFL: Loaded 53143 existing records from primary storage. [2025-09-24T22:15:52.116368] [INFO ] [MAIN ] AFL: Loaded 53143 primary data records. [2025-09-24T22:15:53.307593] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:53.309867] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42446 primary records. [2025-09-24T22:15:53.310140] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-24T22:15:53.351557] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-24T22:15:53.366136] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-24T22:15:53.369681] [INFO ] [MAIN ] Derivative Progress: 34/2075 symbols completed. AGCO took 1.5s. Estimated remaining: 14m 38s. Rate: 139.4 symbols/min [2025-09-24T22:15:53.372678] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:53.372519] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:53.374507] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53643 primary records. [2025-09-24T22:15:53.374847] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-24T22:15:53.410183] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:53.422436] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53143 primary records. [2025-09-24T22:15:53.421299] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-09-24T22:15:53.422744] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-24T22:15:53.422856] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-24T22:15:53.425302] [INFO ] [MAIN ] Derivative Progress: 35/2075 symbols completed. AG took 1.6s. Estimated remaining: 14m 16s. Rate: 143.0 symbols/min [2025-09-24T22:15:53.426811] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:53.450352] [DEBUG] [LOCAL ] AGD: Loaded 17713 existing records from primary storage. [2025-09-24T22:15:53.454602] [INFO ] [MAIN ] AGD: Loaded 17713 primary data records. [2025-09-24T22:15:53.454800] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-24T22:15:53.476829] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-24T22:15:53.517435] [INFO ] [MAIN ] Derivative Progress: 36/2075 symbols completed. AFL took 1.7s. Estimated remaining: 13m 57s. Rate: 146.2 symbols/min [2025-09-24T22:15:53.545359] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:53.801812] [DEBUG] [LOCAL ] AGI: Loaded 53419 existing records from primary storage. [2025-09-24T22:15:53.802378] [INFO ] [MAIN ] AGI: Loaded 53419 primary data records. [2025-09-24T22:15:54.176059] [DEBUG] [LOCAL ] AGL: Loaded 52421 existing records from primary storage. [2025-09-24T22:15:54.184690] [INFO ] [MAIN ] AGL: Loaded 52421 primary data records. [2025-09-24T22:15:54.315076] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:54.359120] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17713 primary records. [2025-09-24T22:15:54.367621] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-24T22:15:54.525356] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-24T22:15:54.525710] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-24T22:15:54.527890] [INFO ] [MAIN ] Derivative Progress: 37/2075 symbols completed. AGD took 1.2s. Estimated remaining: 14m 30s. Rate: 140.6 symbols/min [2025-09-24T22:15:54.528822] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:54.550583] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:54.551720] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53419 primary records. [2025-09-24T22:15:54.551883] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-24T22:15:54.557024] [DEBUG] [LOCAL ] AGM: Loaded 9961 existing records from primary storage. [2025-09-24T22:15:54.564306] [INFO ] [MAIN ] AGM: Loaded 9961 primary data records. [2025-09-24T22:15:54.670567] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-24T22:15:54.685327] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-24T22:15:54.691125] [INFO ] [MAIN ] Derivative Progress: 38/2075 symbols completed. AGI took 1.3s. Estimated remaining: 14m 15s. Rate: 142.9 symbols/min [2025-09-24T22:15:54.692243] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:54.754528] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:54.788216] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52421 primary records. [2025-09-24T22:15:54.832765] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-24T22:15:54.944122] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-24T22:15:54.944443] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-24T22:15:54.948127] [INFO ] [MAIN ] Derivative Progress: 39/2075 symbols completed. AGL took 1.4s. Estimated remaining: 14m 6s. Rate: 144.4 symbols/min [2025-09-24T22:15:54.949045] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:54.961063] [DEBUG] [LOCAL ] AGO: Loaded 28083 existing records from primary storage. [2025-09-24T22:15:54.962798] [INFO ] [MAIN ] AGO: Loaded 28083 primary data records. [2025-09-24T22:15:55.259826] [DEBUG] [LOCAL ] AGRO: Loaded 33723 existing records from primary storage. [2025-09-24T22:15:55.278774] [INFO ] [MAIN ] AGRO: Loaded 33723 primary data records. [2025-09-24T22:15:55.338546] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:55.359064] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 9961 primary records. [2025-09-24T22:15:55.368322] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-24T22:15:55.470353] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-24T22:15:55.505546] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-24T22:15:55.538763] [INFO ] [MAIN ] Derivative Progress: 40/2075 symbols completed. AGM took 1.0s. Estimated remaining: 14m 15s. Rate: 142.9 symbols/min [2025-09-24T22:15:55.629388] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:55.651825] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:55.652621] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28083 primary records. [2025-09-24T22:15:55.652771] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-24T22:15:55.679400] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-24T22:15:55.679732] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-24T22:15:55.681772] [INFO ] [MAIN ] Derivative Progress: 41/2075 symbols completed. AGO took 1.0s. Estimated remaining: 14m 0s. Rate: 145.2 symbols/min [2025-09-24T22:15:55.686858] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:55.706901] [DEBUG] [LOCAL ] AGX: Loaded 33392 existing records from primary storage. [2025-09-24T22:15:55.712257] [INFO ] [MAIN ] AGX: Loaded 33392 primary data records. [2025-09-24T22:15:55.712189] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:55.713167] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33723 primary records. [2025-09-24T22:15:55.734421] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-24T22:15:55.836352] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-24T22:15:55.851700] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-24T22:15:55.870519] [INFO ] [MAIN ] Derivative Progress: 42/2075 symbols completed. AGRO took 0.9s. Estimated remaining: 13m 49s. Rate: 147.1 symbols/min [2025-09-24T22:15:55.938686] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:56.149572] [DEBUG] [LOCAL ] AHH: Loaded 41386 existing records from primary storage. [2025-09-24T22:15:56.150670] [INFO ] [MAIN ] AHH: Loaded 41386 primary data records. [2025-09-24T22:15:56.535282] [DEBUG] [LOCAL ] AHR: Loaded 49294 existing records from primary storage. [2025-09-24T22:15:56.536765] [INFO ] [MAIN ] AHR: Loaded 49294 primary data records. [2025-09-24T22:15:56.536534] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:56.560007] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33392 primary records. [2025-09-24T22:15:56.584015] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-24T22:15:56.690799] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-24T22:15:56.701669] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-24T22:15:56.786924] [INFO ] [MAIN ] Derivative Progress: 43/2075 symbols completed. AGX took 1.2s. Estimated remaining: 14m 13s. Rate: 143.0 symbols/min [2025-09-24T22:15:56.913613] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:56.915530] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41386 primary records. [2025-09-24T22:15:56.915803] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-24T22:15:56.933359] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-24T22:15:56.933869] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-24T22:15:56.936945] [INFO ] [MAIN ] Derivative Progress: 44/2075 symbols completed. AHH took 1.3s. Estimated remaining: 13m 60s. Rate: 145.1 symbols/min [2025-09-24T22:15:56.956721] [DEBUG] [MAIN ] AHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:56.957310] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49294 primary records. [2025-09-24T22:15:56.957372] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-24T22:15:56.972570] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-24T22:15:56.972665] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-24T22:15:56.975054] [INFO ] [MAIN ] Derivative Progress: 45/2075 symbols completed. AHR took 1.0s. Estimated remaining: 13m 43s. Rate: 148.1 symbols/min [2025-09-24T22:15:56.975843] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:56.976021] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:56.976108] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:56.986630] [DEBUG] [LOCAL ] AHT: Loaded 6070 existing records from primary storage. [2025-09-24T22:15:56.986842] [INFO ] [MAIN ] AHT: Loaded 6070 primary data records. [2025-09-24T22:15:57.336348] [DEBUG] [LOCAL ] AIG: Loaded 53475 existing records from primary storage. [2025-09-24T22:15:57.337701] [INFO ] [MAIN ] AIG: Loaded 53475 primary data records. [2025-09-24T22:15:57.447532] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-24T22:15:57.454751] [INFO ] [MAIN ] AI: Loaded 53749 primary data records. [2025-09-24T22:15:58.046825] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:58.047903] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6070 primary records. [2025-09-24T22:15:58.048407] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-24T22:15:58.070595] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-09-24T22:15:58.071049] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-24T22:15:58.073363] [INFO ] [MAIN ] Derivative Progress: 46/2075 symbols completed. AHT took 1.1s. Estimated remaining: 14m 13s. Rate: 142.8 symbols/min [2025-09-24T22:15:58.073881] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:58.090952] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:58.091631] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53475 primary records. [2025-09-24T22:15:58.091849] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-24T22:15:58.111862] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-24T22:15:58.112197] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-24T22:15:58.114144] [INFO ] [MAIN ] Derivative Progress: 47/2075 symbols completed. AIG took 1.1s. Estimated remaining: 13m 56s. Rate: 145.6 symbols/min [2025-09-24T22:15:58.120204] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:58.133186] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:58.133885] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53749 primary records. [2025-09-24T22:15:58.134097] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-24T22:15:58.160980] [DEBUG] [LOCAL ] AIN: Loaded 24576 existing records from primary storage. [2025-09-24T22:15:58.161810] [INFO ] [MAIN ] AIN: Loaded 24576 primary data records. [2025-09-24T22:15:58.226096] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-24T22:15:58.218032] [DEBUG] [LOCAL ] AIO: Loaded 13261 existing records from primary storage. [2025-09-24T22:15:58.235268] [INFO ] [MAIN ] AIO: Loaded 13261 primary data records. [2025-09-24T22:15:58.240492] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-24T22:15:58.260598] [INFO ] [MAIN ] Derivative Progress: 48/2075 symbols completed. AI took 1.3s. Estimated remaining: 13m 44s. Rate: 147.5 symbols/min [2025-09-24T22:15:58.339940] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:58.820958] [DEBUG] [LOCAL ] AIR: Loaded 27507 existing records from primary storage. [2025-09-24T22:15:58.821207] [INFO ] [MAIN ] AIR: Loaded 27507 primary data records. [2025-09-24T22:15:59.172268] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:59.173074] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24576 primary records. [2025-09-24T22:15:59.173331] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-24T22:15:59.200493] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-24T22:15:59.201297] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-24T22:15:59.203901] [INFO ] [MAIN ] Derivative Progress: 49/2075 symbols completed. AIN took 1.1s. Estimated remaining: 14m 6s. Rate: 143.7 symbols/min [2025-09-24T22:15:59.217196] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:59.217557] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:59.219418] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13261 primary records. [2025-09-24T22:15:59.220146] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-24T22:15:59.236673] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-24T22:15:59.237074] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-24T22:15:59.239511] [INFO ] [MAIN ] Derivative Progress: 50/2075 symbols completed. AIO took 1.1s. Estimated remaining: 13m 50s. Rate: 146.3 symbols/min [2025-09-24T22:15:59.239835] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:59.264410] [DEBUG] [MAIN ] AIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:15:59.274875] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 27507 primary records. [2025-09-24T22:15:59.275151] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-24T22:15:59.315173] [DEBUG] [LOCAL ] AIV: Loaded 40245 existing records from primary storage. [2025-09-24T22:15:59.316014] [INFO ] [MAIN ] AIV: Loaded 40245 primary data records. [2025-09-24T22:15:59.374738] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-24T22:15:59.416335] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-24T22:15:59.435009] [DEBUG] [LOCAL ] AIZ: Loaded 30117 existing records from primary storage. [2025-09-24T22:15:59.454268] [INFO ] [MAIN ] Derivative Progress: 51/2075 symbols completed. AIR took 1.1s. Estimated remaining: 13m 42s. Rate: 147.7 symbols/min [2025-09-24T22:15:59.445989] [INFO ] [MAIN ] AIZ: Loaded 30117 primary data records. [2025-09-24T22:15:59.488372] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:15:59.744226] [DEBUG] [LOCAL ] AIZN: Loaded 3886 existing records from primary storage. [2025-09-24T22:15:59.750670] [INFO ] [MAIN ] AIZN: Loaded 3886 primary data records. [2025-09-24T22:16:00.351347] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:00.352939] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40245 primary records. [2025-09-24T22:16:00.353681] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-24T22:16:00.374938] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-24T22:16:00.375962] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-24T22:16:00.378320] [INFO ] [MAIN ] Derivative Progress: 52/2075 symbols completed. AIV took 1.2s. Estimated remaining: 14m 2s. Rate: 144.2 symbols/min [2025-09-24T22:16:00.378750] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:00.392043] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:00.392728] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 30117 primary records. [2025-09-24T22:16:00.393001] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-24T22:16:00.412896] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-24T22:16:00.420862] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-24T22:16:00.427517] [INFO ] [MAIN ] Derivative Progress: 53/2075 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 47s. Rate: 146.6 symbols/min [2025-09-24T22:16:00.428050] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:00.428686] [DEBUG] [MAIN ] AIZN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:00.429799] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3886 primary records. [2025-09-24T22:16:00.429961] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-24T22:16:00.445492] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-24T22:16:00.445585] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-24T22:16:00.448083] [INFO ] [MAIN ] Derivative Progress: 54/2075 symbols completed. AIZN took 1.0s. Estimated remaining: 13m 32s. Rate: 149.3 symbols/min [2025-09-24T22:16:00.448445] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:00.486019] [DEBUG] [LOCAL ] AJG: Loaded 47053 existing records from primary storage. [2025-09-24T22:16:00.486218] [INFO ] [MAIN ] AJG: Loaded 47053 primary data records. [2025-09-24T22:16:00.635201] [DEBUG] [LOCAL ] AL: Loaded 44086 existing records from primary storage. [2025-09-24T22:16:00.653112] [INFO ] [MAIN ] AL: Loaded 44086 primary data records. [2025-09-24T22:16:00.697581] [DEBUG] [LOCAL ] AKR: Loaded 45761 existing records from primary storage. [2025-09-24T22:16:00.721345] [INFO ] [MAIN ] AKR: Loaded 45761 primary data records. [2025-09-24T22:16:01.502959] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:01.504612] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 47053 primary records. [2025-09-24T22:16:01.505150] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-24T22:16:01.525842] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-09-24T22:16:01.527318] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-24T22:16:01.530416] [INFO ] [MAIN ] Derivative Progress: 55/2075 symbols completed. AJG took 1.2s. Estimated remaining: 13m 57s. Rate: 144.8 symbols/min [2025-09-24T22:16:01.530915] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:01.550394] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:01.563839] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44086 primary records. [2025-09-24T22:16:01.564048] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-24T22:16:01.565059] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:01.566322] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45761 primary records. [2025-09-24T22:16:01.566890] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-24T22:16:01.594473] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-24T22:16:01.597808] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-24T22:16:01.602070] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-09-24T22:16:01.602319] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-24T22:16:01.604636] [INFO ] [MAIN ] Derivative Progress: 56/2075 symbols completed. AL took 1.2s. Estimated remaining: 13m 44s. Rate: 147.0 symbols/min [2025-09-24T22:16:01.609230] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:01.609303] [INFO ] [MAIN ] Derivative Progress: 57/2075 symbols completed. AKR took 1.2s. Estimated remaining: 13m 30s. Rate: 149.5 symbols/min [2025-09-24T22:16:01.610227] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:01.658021] [DEBUG] [LOCAL ] ALB: Loaded 53222 existing records from primary storage. [2025-09-24T22:16:01.667325] [INFO ] [MAIN ] ALB: Loaded 53222 primary data records. [2025-09-24T22:16:01.807438] [DEBUG] [LOCAL ] ALE: Loaded 30136 existing records from primary storage. [2025-09-24T22:16:01.827950] [INFO ] [MAIN ] ALE: Loaded 30136 primary data records. [2025-09-24T22:16:01.870255] [DEBUG] [LOCAL ] ALC: Loaded 50772 existing records from primary storage. [2025-09-24T22:16:02.085479] [INFO ] [MAIN ] ALC: Loaded 50772 primary data records. [2025-09-24T22:16:02.769262] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:02.770569] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53222 primary records. [2025-09-24T22:16:02.770952] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-24T22:16:02.791027] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-24T22:16:02.792150] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-24T22:16:02.795063] [INFO ] [MAIN ] Derivative Progress: 58/2075 symbols completed. ALB took 1.3s. Estimated remaining: 13m 57s. Rate: 144.7 symbols/min [2025-09-24T22:16:02.825627] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:02.827161] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 30136 primary records. [2025-09-24T22:16:02.827249] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-24T22:16:02.826333] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:02.828405] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50772 primary records. [2025-09-24T22:16:02.829188] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-24T22:16:02.858844] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-09-24T22:16:02.858977] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-24T22:16:02.861797] [INFO ] [MAIN ] Derivative Progress: 59/2075 symbols completed. ALE took 1.3s. Estimated remaining: 13m 44s. Rate: 146.8 symbols/min [2025-09-24T22:16:02.866464] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-24T22:16:02.866629] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-24T22:16:02.868798] [INFO ] [MAIN ] Derivative Progress: 60/2075 symbols completed. ALC took 1.3s. Estimated remaining: 13m 30s. Rate: 149.2 symbols/min [2025-09-24T22:16:02.869712] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:02.869947] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:02.870090] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:02.884571] [DEBUG] [LOCAL ] ALG: Loaded 10414 existing records from primary storage. [2025-09-24T22:16:02.884724] [INFO ] [MAIN ] ALG: Loaded 10414 primary data records. [2025-09-24T22:16:03.241757] [DEBUG] [LOCAL ] ALK: Loaded 53068 existing records from primary storage. [2025-09-24T22:16:03.243580] [DEBUG] [LOCAL ] ALIT: Loaded 52761 existing records from primary storage. [2025-09-24T22:16:03.244289] [INFO ] [MAIN ] ALIT: Loaded 52761 primary data records. [2025-09-24T22:16:03.244418] [INFO ] [MAIN ] ALK: Loaded 53068 primary data records. [2025-09-24T22:16:03.901674] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:03.903798] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10414 primary records. [2025-09-24T22:16:03.904229] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-24T22:16:03.923490] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-24T22:16:03.923803] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-24T22:16:03.926411] [INFO ] [MAIN ] Derivative Progress: 61/2075 symbols completed. ALG took 1.1s. Estimated remaining: 13m 52s. Rate: 145.3 symbols/min [2025-09-24T22:16:03.929527] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:03.955054] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:03.956018] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53068 primary records. [2025-09-24T22:16:03.956128] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-24T22:16:03.985412] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:03.986715] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-09-24T22:16:03.987499] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52761 primary records. [2025-09-24T22:16:03.987756] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-24T22:16:03.987911] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-24T22:16:03.991167] [INFO ] [MAIN ] Derivative Progress: 62/2075 symbols completed. ALK took 1.1s. Estimated remaining: 13m 40s. Rate: 147.3 symbols/min [2025-09-24T22:16:03.992081] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:04.020511] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-24T22:16:04.020739] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-24T22:16:04.022590] [INFO ] [MAIN ] Derivative Progress: 63/2075 symbols completed. ALIT took 1.2s. Estimated remaining: 13m 27s. Rate: 149.5 symbols/min [2025-09-24T22:16:04.022972] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:04.048921] [DEBUG] [LOCAL ] ALL: Loaded 50194 existing records from primary storage. [2025-09-24T22:16:04.049149] [INFO ] [MAIN ] ALL: Loaded 50194 primary data records. [2025-09-24T22:16:04.430332] [DEBUG] [LOCAL ] ALLE: Loaded 45119 existing records from primary storage. [2025-09-24T22:16:04.430882] [INFO ] [MAIN ] ALLE: Loaded 45119 primary data records. [2025-09-24T22:16:04.559122] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-24T22:16:04.607827] [INFO ] [MAIN ] ALLY: Loaded 53218 primary data records. [2025-09-24T22:16:05.116123] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:05.118486] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50194 primary records. [2025-09-24T22:16:05.119395] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-24T22:16:05.141548] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-24T22:16:05.142054] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-24T22:16:05.144237] [INFO ] [MAIN ] Derivative Progress: 64/2075 symbols completed. ALL took 1.2s. Estimated remaining: 13m 50s. Rate: 145.4 symbols/min [2025-09-24T22:16:05.144811] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:05.163428] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:05.164204] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 45119 primary records. [2025-09-24T22:16:05.164314] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-24T22:16:05.184521] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-24T22:16:05.192328] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-24T22:16:05.199449] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:05.200344] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53218 primary records. [2025-09-24T22:16:05.200462] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-24T22:16:05.199102] [INFO ] [MAIN ] Derivative Progress: 65/2075 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 38s. Rate: 147.4 symbols/min [2025-09-24T22:16:05.200919] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:05.227886] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-24T22:16:05.228032] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-24T22:16:05.230682] [INFO ] [MAIN ] Derivative Progress: 66/2075 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 26s. Rate: 149.5 symbols/min [2025-09-24T22:16:05.231055] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:05.251165] [DEBUG] [LOCAL ] ALSN: Loaded 43286 existing records from primary storage. [2025-09-24T22:16:05.260415] [INFO ] [MAIN ] ALSN: Loaded 43286 primary data records. [2025-09-24T22:16:05.261855] [DEBUG] [LOCAL ] ALTG: Loaded 23914 existing records from primary storage. [2025-09-24T22:16:05.273128] [INFO ] [MAIN ] ALTG: Loaded 23914 primary data records. [2025-09-24T22:16:05.373742] [DEBUG] [LOCAL ] ALUR: Loaded 10867 existing records from primary storage. [2025-09-24T22:16:05.422433] [INFO ] [MAIN ] ALUR: Loaded 10867 primary data records. [2025-09-24T22:16:06.238127] [DEBUG] [MAIN ] ALSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:06.239818] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43286 primary records. [2025-09-24T22:16:06.240176] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:06.241104] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-24T22:16:06.242056] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23914 primary records. [2025-09-24T22:16:06.242177] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-24T22:16:06.264824] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:06.281942] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10867 primary records. [2025-09-24T22:16:06.286940] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-24T22:16:06.286882] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-24T22:16:06.288200] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-24T22:16:06.292760] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-24T22:16:06.291578] [INFO ] [MAIN ] Derivative Progress: 67/2075 symbols completed. ALSN took 1.1s. Estimated remaining: 13m 46s. Rate: 145.9 symbols/min [2025-09-24T22:16:06.299765] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-24T22:16:06.305733] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:06.302945] [INFO ] [MAIN ] Derivative Progress: 68/2075 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 34s. Rate: 148.0 symbols/min [2025-09-24T22:16:06.309349] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:06.311288] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-09-24T22:16:06.311846] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-24T22:16:06.314490] [INFO ] [MAIN ] Derivative Progress: 69/2075 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 22s. Rate: 150.1 symbols/min [2025-09-24T22:16:06.315032] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:06.323056] [DEBUG] [LOCAL ] ALX: Loaded 6011 existing records from primary storage. [2025-09-24T22:16:06.323237] [INFO ] [MAIN ] ALX: Loaded 6011 primary data records. [2025-09-24T22:16:06.710181] [DEBUG] [LOCAL ] ALV: Loaded 42613 existing records from primary storage. [2025-09-24T22:16:06.709514] [DEBUG] [LOCAL ] AMBC: Loaded 37037 existing records from primary storage. [2025-09-24T22:16:06.710361] [INFO ] [MAIN ] AMBC: Loaded 37037 primary data records. [2025-09-24T22:16:06.710453] [INFO ] [MAIN ] ALV: Loaded 42613 primary data records. [2025-09-24T22:16:07.354280] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:07.356536] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6011 primary records. [2025-09-24T22:16:07.357435] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-24T22:16:07.376469] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-24T22:16:07.376899] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-24T22:16:07.379612] [INFO ] [MAIN ] Derivative Progress: 70/2075 symbols completed. ALX took 1.1s. Estimated remaining: 13m 40s. Rate: 146.6 symbols/min [2025-09-24T22:16:07.380468] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:07.398212] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:07.399809] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42613 primary records. [2025-09-24T22:16:07.400536] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-24T22:16:07.430053] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-24T22:16:07.430184] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-24T22:16:07.428880] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:07.430902] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 37037 primary records. [2025-09-24T22:16:07.431067] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-24T22:16:07.433177] [INFO ] [MAIN ] Derivative Progress: 71/2075 symbols completed. ALV took 1.1s. Estimated remaining: 13m 30s. Rate: 148.5 symbols/min [2025-09-24T22:16:07.445831] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:07.463243] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-24T22:16:07.475693] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-24T22:16:07.477891] [INFO ] [MAIN ] Derivative Progress: 72/2075 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 19s. Rate: 150.3 symbols/min [2025-09-24T22:16:07.480078] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:07.481335] [DEBUG] [LOCAL ] AMBP: Loaded 45326 existing records from primary storage. [2025-09-24T22:16:07.481852] [INFO ] [MAIN ] AMBP: Loaded 45326 primary data records. [2025-09-24T22:16:07.811789] [DEBUG] [LOCAL ] AMC: Loaded 53759 existing records from primary storage. [2025-09-24T22:16:07.812095] [INFO ] [MAIN ] AMC: Loaded 53759 primary data records. [2025-09-24T22:16:07.988304] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-24T22:16:08.143705] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-09-24T22:16:08.369073] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:08.520238] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45326 primary records. [2025-09-24T22:16:08.535385] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-24T22:16:08.574225] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-24T22:16:08.574374] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-24T22:16:08.577266] [INFO ] [MAIN ] Derivative Progress: 73/2075 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 38s. Rate: 146.8 symbols/min [2025-09-24T22:16:08.574124] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:08.578273] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53759 primary records. [2025-09-24T22:16:08.578574] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-24T22:16:08.598685] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-24T22:16:08.598991] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-24T22:16:08.601261] [INFO ] [MAIN ] Derivative Progress: 74/2075 symbols completed. AMC took 1.2s. Estimated remaining: 13m 27s. Rate: 148.7 symbols/min [2025-09-24T22:16:08.618902] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:08.619562] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-09-24T22:16:08.619624] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-24T22:16:08.635483] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-24T22:16:08.635542] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-24T22:16:08.638767] [INFO ] [MAIN ] Derivative Progress: 75/2075 symbols completed. AMCR took 1.2s. Estimated remaining: 13m 17s. Rate: 150.5 symbols/min [2025-09-24T22:16:08.639329] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:08.639397] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:08.639590] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:08.663366] [DEBUG] [LOCAL ] AMG: Loaded 20745 existing records from primary storage. [2025-09-24T22:16:08.663634] [INFO ] [MAIN ] AMG: Loaded 20745 primary data records. [2025-09-24T22:16:08.913706] [DEBUG] [LOCAL ] AMN: Loaded 42019 existing records from primary storage. [2025-09-24T22:16:09.009975] [INFO ] [MAIN ] AMN: Loaded 42019 primary data records. [2025-09-24T22:16:09.001395] [DEBUG] [LOCAL ] AMH: Loaded 51691 existing records from primary storage. [2025-09-24T22:16:09.031253] [INFO ] [MAIN ] AMH: Loaded 51691 primary data records. [2025-09-24T22:16:09.693590] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:09.696467] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20745 primary records. [2025-09-24T22:16:09.696919] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-24T22:16:09.723264] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-24T22:16:09.724558] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-24T22:16:09.727966] [INFO ] [MAIN ] Derivative Progress: 76/2075 symbols completed. AMG took 1.1s. Estimated remaining: 13m 35s. Rate: 147.2 symbols/min [2025-09-24T22:16:09.729943] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:09.745252] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:09.746236] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 42019 primary records. [2025-09-24T22:16:09.746373] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-24T22:16:09.770510] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-24T22:16:09.770884] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-24T22:16:09.786197] [INFO ] [MAIN ] Derivative Progress: 77/2075 symbols completed. AMN took 1.1s. Estimated remaining: 13m 26s. Rate: 148.8 symbols/min [2025-09-24T22:16:09.786567] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:09.787108] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:09.788027] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51691 primary records. [2025-09-24T22:16:09.788533] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-24T22:16:09.814368] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-24T22:16:09.814466] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-24T22:16:09.816606] [INFO ] [MAIN ] Derivative Progress: 78/2075 symbols completed. AMH took 1.2s. Estimated remaining: 13m 16s. Rate: 150.6 symbols/min [2025-09-24T22:16:09.817097] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:09.829280] [DEBUG] [LOCAL ] AMP: Loaded 32444 existing records from primary storage. [2025-09-24T22:16:09.829549] [INFO ] [MAIN ] AMP: Loaded 32444 primary data records. [2025-09-24T22:16:10.058630] [DEBUG] [LOCAL ] AMPY: Loaded 37388 existing records from primary storage. [2025-09-24T22:16:10.192970] [INFO ] [MAIN ] AMPY: Loaded 37388 primary data records. [2025-09-24T22:16:10.229321] [DEBUG] [LOCAL ] AMPX: Loaded 52169 existing records from primary storage. [2025-09-24T22:16:10.247612] [INFO ] [MAIN ] AMPX: Loaded 52169 primary data records. [2025-09-24T22:16:10.880135] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:10.881068] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32444 primary records. [2025-09-24T22:16:10.881348] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-24T22:16:10.899770] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-24T22:16:10.900082] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-24T22:16:10.902400] [INFO ] [MAIN ] Derivative Progress: 79/2075 symbols completed. AMP took 1.2s. Estimated remaining: 13m 33s. Rate: 147.4 symbols/min [2025-09-24T22:16:10.902810] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:10.922113] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:10.922880] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37388 primary records. [2025-09-24T22:16:10.923055] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-24T22:16:10.949849] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-09-24T22:16:10.961986] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-24T22:16:10.964669] [INFO ] [MAIN ] Derivative Progress: 80/2075 symbols completed. AMPY took 1.1s. Estimated remaining: 13m 24s. Rate: 149.0 symbols/min [2025-09-24T22:16:10.965175] [DEBUG] [MAIN ] AMPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:10.965923] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:10.974633] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52169 primary records. [2025-09-24T22:16:10.975930] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-24T22:16:10.977457] [DEBUG] [LOCAL ] AMR: Loaded 29069 existing records from primary storage. [2025-09-24T22:16:10.977660] [INFO ] [MAIN ] AMR: Loaded 29069 primary data records. [2025-09-24T22:16:11.105307] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-24T22:16:11.146156] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-24T22:16:11.196742] [INFO ] [MAIN ] Derivative Progress: 81/2075 symbols completed. AMPX took 1.4s. Estimated remaining: 13m 19s. Rate: 149.7 symbols/min [2025-09-24T22:16:11.228832] [DEBUG] [LOCAL ] AMRC: Loaded 38324 existing records from primary storage. [2025-09-24T22:16:11.314101] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:11.314624] [INFO ] [MAIN ] AMRC: Loaded 38324 primary data records. [2025-09-24T22:16:11.658855] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:11.660005] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29069 primary records. [2025-09-24T22:16:11.660189] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-24T22:16:11.684923] [DEBUG] [LOCAL ] AMT: Loaded 52448 existing records from primary storage. [2025-09-24T22:16:11.689483] [INFO ] [MAIN ] AMT: Loaded 52448 primary data records. [2025-09-24T22:16:11.693685] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-24T22:16:11.698937] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-24T22:16:11.701292] [INFO ] [MAIN ] Derivative Progress: 82/2075 symbols completed. AMR took 0.8s. Estimated remaining: 13m 21s. Rate: 149.3 symbols/min [2025-09-24T22:16:11.719433] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:11.840170] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:11.856605] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38324 primary records. [2025-09-24T22:16:11.856760] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-24T22:16:12.059708] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-24T22:16:12.047008] [DEBUG] [LOCAL ] AMTB: Loaded 20392 existing records from primary storage. [2025-09-24T22:16:12.060558] [INFO ] [MAIN ] AMTB: Loaded 20392 primary data records. [2025-09-24T22:16:12.060765] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-24T22:16:12.074241] [INFO ] [MAIN ] Derivative Progress: 83/2075 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 20s. Rate: 149.4 symbols/min [2025-09-24T22:16:12.084228] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:12.179398] [DEBUG] [LOCAL ] AMTD: Loaded 3560 existing records from primary storage. [2025-09-24T22:16:12.190005] [INFO ] [MAIN ] AMTD: Loaded 3560 primary data records. [2025-09-24T22:16:12.762756] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:12.763806] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52448 primary records. [2025-09-24T22:16:12.764094] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-24T22:16:12.783907] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-24T22:16:12.784224] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-24T22:16:12.786412] [INFO ] [MAIN ] Derivative Progress: 84/2075 symbols completed. AMT took 1.5s. Estimated remaining: 13m 27s. Rate: 148.0 symbols/min [2025-09-24T22:16:12.786798] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:12.828780] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:12.828153] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:12.834013] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20392 primary records. [2025-09-24T22:16:12.834679] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3560 primary records. [2025-09-24T22:16:12.834861] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-24T22:16:12.832972] [DEBUG] [LOCAL ] AMWL: Loaded 8630 existing records from primary storage. [2025-09-24T22:16:12.834811] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-24T22:16:12.835043] [INFO ] [MAIN ] AMWL: Loaded 8630 primary data records. [2025-09-24T22:16:12.962726] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-24T22:16:12.966903] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-24T22:16:12.970156] [INFO ] [MAIN ] Derivative Progress: 85/2075 symbols completed. AMTB took 1.3s. Estimated remaining: 13m 21s. Rate: 149.0 symbols/min [2025-09-24T22:16:12.982137] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:12.987370] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-24T22:16:12.998100] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-24T22:16:13.015548] [INFO ] [MAIN ] Derivative Progress: 86/2075 symbols completed. AMTD took 0.9s. Estimated remaining: 13m 13s. Rate: 150.5 symbols/min [2025-09-24T22:16:13.064821] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:13.237464] [DEBUG] [LOCAL ] AN: Loaded 32414 existing records from primary storage. [2025-09-24T22:16:13.245445] [INFO ] [MAIN ] AN: Loaded 32414 primary data records. [2025-09-24T22:16:13.286020] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:13.336295] [DEBUG] [LOCAL ] AMX: Loaded 49185 existing records from primary storage. [2025-09-24T22:16:13.341759] [INFO ] [MAIN ] AMX: Loaded 49185 primary data records. [2025-09-24T22:16:13.350730] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8630 primary records. [2025-09-24T22:16:13.425582] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-24T22:16:13.762751] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-24T22:16:13.791527] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-24T22:16:13.801355] [INFO ] [MAIN ] Derivative Progress: 87/2075 symbols completed. AMWL took 1.0s. Estimated remaining: 13m 21s. Rate: 148.9 symbols/min [2025-09-24T22:16:13.916234] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:13.954748] [DEBUG] [MAIN ] AN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:13.956755] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32414 primary records. [2025-09-24T22:16:13.956975] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-24T22:16:13.996491] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-24T22:16:13.995465] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:13.996635] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-24T22:16:14.013300] [INFO ] [MAIN ] Derivative Progress: 88/2075 symbols completed. AN took 1.0s. Estimated remaining: 13m 16s. Rate: 149.7 symbols/min [2025-09-24T22:16:14.011067] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49185 primary records. [2025-09-24T22:16:14.013696] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-24T22:16:14.029604] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-24T22:16:14.029724] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-24T22:16:14.032729] [INFO ] [MAIN ] Derivative Progress: 89/2075 symbols completed. AMX took 1.1s. Estimated remaining: 13m 8s. Rate: 151.3 symbols/min [2025-09-24T22:16:14.048989] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-24T22:16:14.049101] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-24T22:16:14.357932] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:14.358680] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-24T22:16:14.358750] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-24T22:16:14.374395] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-24T22:16:14.374460] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-24T22:16:14.376620] [INFO ] [MAIN ] Derivative Progress: 90/2075 symbols completed. ANET took 0.6s. Estimated remaining: 13m 6s. Rate: 151.5 symbols/min [2025-09-24T22:16:14.377296] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:14.377433] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:14.378034] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:14.398028] [DEBUG] [LOCAL ] ANRO: Loaded 19271 existing records from primary storage. [2025-09-24T22:16:14.403074] [INFO ] [MAIN ] ANRO: Loaded 19271 primary data records. [2025-09-24T22:16:14.541424] [DEBUG] [LOCAL ] ANVS: Loaded 23167 existing records from primary storage. [2025-09-24T22:16:14.546866] [INFO ] [MAIN ] ANVS: Loaded 23167 primary data records. [2025-09-24T22:16:14.774400] [DEBUG] [LOCAL ] ANF: Loaded 52242 existing records from primary storage. [2025-09-24T22:16:14.929127] [INFO ] [MAIN ] ANF: Loaded 52242 primary data records. [2025-09-24T22:16:15.493289] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:15.495407] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19271 primary records. [2025-09-24T22:16:15.495676] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-24T22:16:15.517504] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-24T22:16:15.517736] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-24T22:16:15.534721] [INFO ] [MAIN ] Derivative Progress: 91/2075 symbols completed. ANRO took 1.2s. Estimated remaining: 13m 22s. Rate: 148.4 symbols/min [2025-09-24T22:16:15.535840] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:15.536810] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:15.537895] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23167 primary records. [2025-09-24T22:16:15.538277] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-24T22:16:15.570996] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:15.572740] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52242 primary records. [2025-09-24T22:16:15.573244] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-24T22:16:15.573142] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-24T22:16:15.573732] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-24T22:16:15.576593] [INFO ] [MAIN ] Derivative Progress: 92/2075 symbols completed. ANVS took 1.2s. Estimated remaining: 13m 14s. Rate: 149.9 symbols/min [2025-09-24T22:16:15.584430] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:15.602354] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-24T22:16:15.602508] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-24T22:16:15.605325] [INFO ] [MAIN ] Derivative Progress: 93/2075 symbols completed. ANF took 1.2s. Estimated remaining: 13m 6s. Rate: 151.4 symbols/min [2025-09-24T22:16:15.605831] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:15.621383] [DEBUG] [LOCAL ] AOD: Loaded 30057 existing records from primary storage. [2025-09-24T22:16:15.621628] [INFO ] [MAIN ] AOD: Loaded 30057 primary data records. [2025-09-24T22:16:15.723417] [DEBUG] [LOCAL ] AOMR: Loaded 16701 existing records from primary storage. [2025-09-24T22:16:15.740955] [INFO ] [MAIN ] AOMR: Loaded 16701 primary data records. [2025-09-24T22:16:16.129577] [DEBUG] [LOCAL ] AON: Loaded 45620 existing records from primary storage. [2025-09-24T22:16:16.130442] [INFO ] [MAIN ] AON: Loaded 45620 primary data records. [2025-09-24T22:16:16.679743] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:16.682722] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30057 primary records. [2025-09-24T22:16:16.683729] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-24T22:16:16.714344] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:16.717076] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16701 primary records. [2025-09-24T22:16:16.718238] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-24T22:16:16.717819] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-24T22:16:16.718503] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-24T22:16:16.721620] [INFO ] [MAIN ] Derivative Progress: 94/2075 symbols completed. AOD took 1.2s. Estimated remaining: 13m 20s. Rate: 148.5 symbols/min [2025-09-24T22:16:16.722932] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:16.756233] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:16.757571] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45620 primary records. [2025-09-24T22:16:16.756676] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-24T22:16:16.757769] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-24T22:16:16.757917] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-24T22:16:16.760150] [INFO ] [MAIN ] Derivative Progress: 95/2075 symbols completed. AOMR took 1.2s. Estimated remaining: 13m 12s. Rate: 149.9 symbols/min [2025-09-24T22:16:16.760634] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:16.786863] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-24T22:16:16.796333] [DEBUG] [LOCAL ] AORT: Loaded 29664 existing records from primary storage. [2025-09-24T22:16:16.796489] [INFO ] [MAIN ] AORT: Loaded 29664 primary data records. [2025-09-24T22:16:16.795887] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-24T22:16:16.810166] [INFO ] [MAIN ] Derivative Progress: 96/2075 symbols completed. AON took 1.2s. Estimated remaining: 13m 5s. Rate: 151.3 symbols/min [2025-09-24T22:16:16.820153] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:17.146908] [DEBUG] [LOCAL ] AOS: Loaded 49129 existing records from primary storage. [2025-09-24T22:16:17.147819] [INFO ] [MAIN ] AOS: Loaded 49129 primary data records. [2025-09-24T22:16:17.271832] [DEBUG] [LOCAL ] APD: Loaded 45371 existing records from primary storage. [2025-09-24T22:16:17.283271] [INFO ] [MAIN ] APD: Loaded 45371 primary data records. [2025-09-24T22:16:17.680395] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:17.797415] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29664 primary records. [2025-09-24T22:16:17.807262] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-24T22:16:17.831832] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-24T22:16:17.832842] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-24T22:16:17.835687] [INFO ] [MAIN ] Derivative Progress: 97/2075 symbols completed. AORT took 1.1s. Estimated remaining: 13m 17s. Rate: 148.9 symbols/min [2025-09-24T22:16:17.836352] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:17.860588] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:17.863042] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 49129 primary records. [2025-09-24T22:16:17.865057] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-24T22:16:17.891022] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:17.892461] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45371 primary records. [2025-09-24T22:16:17.892575] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-24T22:16:17.922261] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-24T22:16:17.921584] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-09-24T22:16:17.922410] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-24T22:16:17.924875] [INFO ] [MAIN ] Derivative Progress: 98/2075 symbols completed. APD took 1.1s. Estimated remaining: 13m 10s. Rate: 150.1 symbols/min [2025-09-24T22:16:17.925029] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-24T22:16:17.925355] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:17.927679] [INFO ] [MAIN ] Derivative Progress: 99/2075 symbols completed. AOS took 1.2s. Estimated remaining: 13m 2s. Rate: 151.6 symbols/min [2025-09-24T22:16:17.928324] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:17.946288] [DEBUG] [LOCAL ] APG: Loaded 50211 existing records from primary storage. [2025-09-24T22:16:17.946573] [INFO ] [MAIN ] APG: Loaded 50211 primary data records. [2025-09-24T22:16:18.313812] [DEBUG] [LOCAL ] APLE: Loaded 52015 existing records from primary storage. [2025-09-24T22:16:18.314137] [INFO ] [MAIN ] APLE: Loaded 52015 primary data records. [2025-09-24T22:16:18.313032] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-24T22:16:18.314241] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-09-24T22:16:19.005927] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:19.007780] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50211 primary records. [2025-09-24T22:16:19.008262] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-24T22:16:19.033690] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-09-24T22:16:19.034019] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-24T22:16:19.036221] [INFO ] [MAIN ] Derivative Progress: 100/2075 symbols completed. APG took 1.2s. Estimated remaining: 13m 16s. Rate: 148.9 symbols/min [2025-09-24T22:16:19.036820] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:19.055520] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:19.057201] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-09-24T22:16:19.058673] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-24T22:16:19.079774] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:19.081783] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 52015 primary records. [2025-09-24T22:16:19.084520] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-24T22:16:19.105052] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-09-24T22:16:19.103934] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-09-24T22:16:19.105326] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-24T22:16:19.105263] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-24T22:16:19.107223] [INFO ] [MAIN ] Derivative Progress: 101/2075 symbols completed. APLE took 1.2s. Estimated remaining: 13m 9s. Rate: 150.1 symbols/min [2025-09-24T22:16:19.107501] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:19.110275] [INFO ] [MAIN ] Derivative Progress: 102/2075 symbols completed. APH took 1.2s. Estimated remaining: 13m 1s. Rate: 151.6 symbols/min [2025-09-24T22:16:19.110706] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:19.134083] [DEBUG] [LOCAL ] APOS: Loaded 7502 existing records from primary storage. [2025-09-24T22:16:19.134217] [INFO ] [MAIN ] APOS: Loaded 7502 primary data records. [2025-09-24T22:16:19.259638] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-24T22:16:19.262137] [INFO ] [MAIN ] APO: Loaded 53385 primary data records. [2025-09-24T22:16:19.674337] [DEBUG] [LOCAL ] APTV: Loaded 52216 existing records from primary storage. [2025-09-24T22:16:19.680784] [INFO ] [MAIN ] APTV: Loaded 52216 primary data records. [2025-09-24T22:16:20.139318] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:20.141037] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7502 primary records. [2025-09-24T22:16:20.141785] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-24T22:16:20.161726] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-24T22:16:20.162103] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-24T22:16:20.164418] [INFO ] [MAIN ] Derivative Progress: 103/2075 symbols completed. APOS took 1.1s. Estimated remaining: 13m 13s. Rate: 149.2 symbols/min [2025-09-24T22:16:20.185850] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:20.194137] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53385 primary records. [2025-09-24T22:16:20.195115] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-24T22:16:20.217365] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-24T22:16:20.217542] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-24T22:16:20.220793] [INFO ] [MAIN ] Derivative Progress: 104/2075 symbols completed. APO took 1.2s. Estimated remaining: 13m 6s. Rate: 150.4 symbols/min [2025-09-24T22:16:20.234626] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:20.235435] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52216 primary records. [2025-09-24T22:16:20.235530] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-24T22:16:20.251483] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-24T22:16:20.251562] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-24T22:16:20.254668] [INFO ] [MAIN ] Derivative Progress: 105/2075 symbols completed. APTV took 1.1s. Estimated remaining: 12m 59s. Rate: 151.8 symbols/min [2025-09-24T22:16:20.255560] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:20.255819] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:20.256038] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:20.267002] [DEBUG] [LOCAL ] AQNB: Loaded 4187 existing records from primary storage. [2025-09-24T22:16:20.267138] [INFO ] [MAIN ] AQNB: Loaded 4187 primary data records. [2025-09-24T22:16:20.620552] [DEBUG] [LOCAL ] ARCO: Loaded 44642 existing records from primary storage. [2025-09-24T22:16:20.639755] [INFO ] [MAIN ] ARCO: Loaded 44642 primary data records. [2025-09-24T22:16:20.663602] [DEBUG] [LOCAL ] AQN: Loaded 51928 existing records from primary storage. [2025-09-24T22:16:20.686974] [INFO ] [MAIN ] AQN: Loaded 51928 primary data records. [2025-09-24T22:16:21.336869] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:16:21.338083] [INFO ] [MAIN ] AQNB: Generated 1793 derivative records from 4187 primary records. [2025-09-24T22:16:21.338333] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-24T22:16:21.368899] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1793 records). [2025-09-24T22:16:21.370347] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-24T22:16:21.373596] [INFO ] [MAIN ] Derivative Progress: 106/2075 symbols completed. AQNB took 1.1s. Estimated remaining: 13m 12s. Rate: 149.2 symbols/min [2025-09-24T22:16:21.374185] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:21.389429] [DEBUG] [MAIN ] AQN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:21.391990] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51928 primary records. [2025-09-24T22:16:21.392315] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-24T22:16:21.414585] [DEBUG] [MAIN ] ARCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:21.418315] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44642 primary records. [2025-09-24T22:16:21.423631] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-24T22:16:21.451037] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-24T22:16:21.451845] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-24T22:16:21.454358] [INFO ] [MAIN ] Derivative Progress: 107/2075 symbols completed. AQN took 1.2s. Estimated remaining: 13m 6s. Rate: 150.3 symbols/min [2025-09-24T22:16:21.452260] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-24T22:16:21.448788] [DEBUG] [LOCAL ] ARDC: Loaded 14492 existing records from primary storage. [2025-09-24T22:16:21.454923] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:21.454542] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-24T22:16:21.455067] [INFO ] [MAIN ] ARDC: Loaded 14492 primary data records. [2025-09-24T22:16:21.474410] [INFO ] [MAIN ] Derivative Progress: 108/2075 symbols completed. ARCO took 1.2s. Estimated remaining: 12m 58s. Rate: 151.6 symbols/min [2025-09-24T22:16:21.507328] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:21.824991] [DEBUG] [LOCAL ] ARI: Loaded 43442 existing records from primary storage. [2025-09-24T22:16:21.839262] [INFO ] [MAIN ] ARI: Loaded 43442 primary data records. [2025-09-24T22:16:21.876126] [DEBUG] [LOCAL ] ARE: Loaded 50610 existing records from primary storage. [2025-09-24T22:16:21.881701] [INFO ] [MAIN ] ARE: Loaded 50610 primary data records. [2025-09-24T22:16:21.990515] [DEBUG] [MAIN ] ARDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:22.031006] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14492 primary records. [2025-09-24T22:16:22.054837] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-24T22:16:22.503179] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-24T22:16:22.503500] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-24T22:16:22.506012] [INFO ] [MAIN ] Derivative Progress: 109/2075 symbols completed. ARDC took 1.1s. Estimated remaining: 13m 9s. Rate: 149.4 symbols/min [2025-09-24T22:16:22.507028] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:22.532361] [DEBUG] [MAIN ] ARI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:22.533203] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43442 primary records. [2025-09-24T22:16:22.533393] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-24T22:16:22.568757] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:22.570404] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50610 primary records. [2025-09-24T22:16:22.580586] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-24T22:16:22.597415] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-24T22:16:22.600737] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-24T22:16:22.603122] [INFO ] [MAIN ] Derivative Progress: 110/2075 symbols completed. ARI took 1.1s. Estimated remaining: 13m 4s. Rate: 150.5 symbols/min [2025-09-24T22:16:22.603418] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:22.604105] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-24T22:16:22.604416] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-24T22:16:22.608136] [INFO ] [MAIN ] Derivative Progress: 111/2075 symbols completed. ARE took 1.2s. Estimated remaining: 12m 56s. Rate: 151.8 symbols/min [2025-09-24T22:16:22.608818] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:22.625264] [DEBUG] [LOCAL ] ARLO: Loaded 43875 existing records from primary storage. [2025-09-24T22:16:22.625593] [INFO ] [MAIN ] ARLO: Loaded 43875 primary data records. [2025-09-24T22:16:23.041505] [DEBUG] [LOCAL ] ARMK: Loaded 50354 existing records from primary storage. [2025-09-24T22:16:23.042254] [INFO ] [MAIN ] ARMK: Loaded 50354 primary data records. [2025-09-24T22:16:23.043168] [DEBUG] [LOCAL ] AROC: Loaded 48972 existing records from primary storage. [2025-09-24T22:16:23.048450] [INFO ] [MAIN ] AROC: Loaded 48972 primary data records. [2025-09-24T22:16:23.699354] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:23.702123] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43875 primary records. [2025-09-24T22:16:23.702547] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-24T22:16:23.721796] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-09-24T22:16:23.723003] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-24T22:16:23.725294] [INFO ] [MAIN ] Derivative Progress: 112/2075 symbols completed. ARLO took 1.2s. Estimated remaining: 13m 8s. Rate: 149.4 symbols/min [2025-09-24T22:16:23.726805] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:23.749949] [DEBUG] [MAIN ] AROC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:23.752226] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48972 primary records. [2025-09-24T22:16:23.752469] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-24T22:16:23.787035] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:23.788820] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50354 primary records. [2025-09-24T22:16:23.788940] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-24T22:16:23.823868] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-09-24T22:16:23.825446] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-24T22:16:23.828718] [INFO ] [MAIN ] Derivative Progress: 113/2075 symbols completed. ARMK took 1.2s. Estimated remaining: 13m 3s. Rate: 150.4 symbols/min [2025-09-24T22:16:23.826304] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-09-24T22:16:23.830104] [DEBUG] [LOCAL ] ARW: Loaded 33201 existing records from primary storage. [2025-09-24T22:16:23.830408] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:23.828947] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-24T22:16:23.833254] [INFO ] [MAIN ] Derivative Progress: 114/2075 symbols completed. AROC took 1.2s. Estimated remaining: 12m 56s. Rate: 151.7 symbols/min [2025-09-24T22:16:23.833350] [INFO ] [MAIN ] ARW: Loaded 33201 primary data records. [2025-09-24T22:16:23.833807] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:23.970619] [DEBUG] [LOCAL ] ASA: Loaded 13835 existing records from primary storage. [2025-09-24T22:16:23.986425] [INFO ] [MAIN ] ASA: Loaded 13835 primary data records. [2025-09-24T22:16:24.391616] [DEBUG] [LOCAL ] AS: Loaded 53077 existing records from primary storage. [2025-09-24T22:16:24.510544] [INFO ] [MAIN ] AS: Loaded 53077 primary data records. [2025-09-24T22:16:24.945064] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:24.946722] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33201 primary records. [2025-09-24T22:16:24.947055] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-24T22:16:24.966388] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-24T22:16:24.967776] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-24T22:16:24.969689] [INFO ] [MAIN ] Derivative Progress: 115/2075 symbols completed. ARW took 1.2s. Estimated remaining: 13m 8s. Rate: 149.3 symbols/min [2025-09-24T22:16:24.972228] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:24.988065] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:24.989051] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 13835 primary records. [2025-09-24T22:16:24.989466] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-24T22:16:25.007552] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-24T22:16:25.007849] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-24T22:16:25.023775] [INFO ] [MAIN ] Derivative Progress: 116/2075 symbols completed. ASA took 1.2s. Estimated remaining: 13m 2s. Rate: 150.4 symbols/min [2025-09-24T22:16:25.024370] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:25.046936] [DEBUG] [LOCAL ] ASBA: Loaded 3433 existing records from primary storage. [2025-09-24T22:16:25.047453] [INFO ] [MAIN ] ASBA: Loaded 3433 primary data records. [2025-09-24T22:16:25.047294] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:25.053633] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53077 primary records. [2025-09-24T22:16:25.079976] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-24T22:16:25.198850] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-09-24T22:16:25.205864] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-24T22:16:25.217385] [DEBUG] [LOCAL ] ASAN: Loaded 52745 existing records from primary storage. [2025-09-24T22:16:25.230811] [INFO ] [MAIN ] ASAN: Loaded 52745 primary data records. [2025-09-24T22:16:25.230584] [INFO ] [MAIN ] Derivative Progress: 117/2075 symbols completed. AS took 1.4s. Estimated remaining: 12m 58s. Rate: 151.0 symbols/min [2025-09-24T22:16:25.409086] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:25.756095] [DEBUG] [LOCAL ] ASC: Loaded 37684 existing records from primary storage. [2025-09-24T22:16:25.764062] [INFO ] [MAIN ] ASC: Loaded 37684 primary data records. [2025-09-24T22:16:25.790443] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:25.791190] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3433 primary records. [2025-09-24T22:16:25.801422] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-24T22:16:25.890038] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-24T22:16:25.895450] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-24T22:16:25.907685] [INFO ] [MAIN ] Derivative Progress: 118/2075 symbols completed. ASBA took 0.9s. Estimated remaining: 13m 2s. Rate: 150.1 symbols/min [2025-09-24T22:16:26.105438] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:26.106744] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52745 primary records. [2025-09-24T22:16:26.106934] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-24T22:16:26.124997] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-09-24T22:16:26.125298] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-24T22:16:26.127438] [INFO ] [MAIN ] Derivative Progress: 119/2075 symbols completed. ASAN took 1.2s. Estimated remaining: 12m 59s. Rate: 150.7 symbols/min [2025-09-24T22:16:26.143635] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:26.144225] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37684 primary records. [2025-09-24T22:16:26.144286] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-24T22:16:26.159840] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-24T22:16:26.159900] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-24T22:16:26.161916] [INFO ] [MAIN ] Derivative Progress: 120/2075 symbols completed. ASC took 0.9s. Estimated remaining: 12m 53s. Rate: 151.8 symbols/min [2025-09-24T22:16:26.162693] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:26.162520] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:26.163010] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:26.197740] [DEBUG] [LOCAL ] ASGI: Loaded 22386 existing records from primary storage. [2025-09-24T22:16:26.197897] [INFO ] [MAIN ] ASGI: Loaded 22386 primary data records. [2025-09-24T22:16:26.304953] [DEBUG] [LOCAL ] ASGN: Loaded 35922 existing records from primary storage. [2025-09-24T22:16:26.327675] [INFO ] [MAIN ] ASGN: Loaded 35922 primary data records. [2025-09-24T22:16:26.658265] [DEBUG] [LOCAL ] ASH: Loaded 37748 existing records from primary storage. [2025-09-24T22:16:26.680493] [INFO ] [MAIN ] ASH: Loaded 37748 primary data records. [2025-09-24T22:16:27.262745] [DEBUG] [MAIN ] ASGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:27.264689] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22386 primary records. [2025-09-24T22:16:27.264890] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-24T22:16:27.285565] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-24T22:16:27.299071] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-24T22:16:27.301203] [INFO ] [MAIN ] Derivative Progress: 121/2075 symbols completed. ASGI took 1.1s. Estimated remaining: 13m 4s. Rate: 149.5 symbols/min [2025-09-24T22:16:27.301975] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:27.302467] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:27.303415] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 35922 primary records. [2025-09-24T22:16:27.303735] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-24T22:16:27.320985] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-24T22:16:27.321215] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-24T22:16:27.323539] [INFO ] [MAIN ] Derivative Progress: 122/2075 symbols completed. ASGN took 1.2s. Estimated remaining: 12m 58s. Rate: 150.7 symbols/min [2025-09-24T22:16:27.323932] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:27.342595] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:27.343413] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37748 primary records. [2025-09-24T22:16:27.343570] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-24T22:16:27.349173] [DEBUG] [LOCAL ] ASR: Loaded 9262 existing records from primary storage. [2025-09-24T22:16:27.360510] [INFO ] [MAIN ] ASR: Loaded 9262 primary data records. [2025-09-24T22:16:27.438229] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-24T22:16:27.453560] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-24T22:16:27.462103] [INFO ] [MAIN ] Derivative Progress: 123/2075 symbols completed. ASH took 1.3s. Estimated remaining: 12m 53s. Rate: 151.5 symbols/min [2025-09-24T22:16:27.492068] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:27.567634] [DEBUG] [LOCAL ] ASPN: Loaded 49580 existing records from primary storage. [2025-09-24T22:16:27.586882] [INFO ] [MAIN ] ASPN: Loaded 49580 primary data records. [2025-09-24T22:16:28.097279] [DEBUG] [LOCAL ] ASX: Loaded 52874 existing records from primary storage. [2025-09-24T22:16:28.097820] [INFO ] [MAIN ] ASX: Loaded 52874 primary data records. [2025-09-24T22:16:28.241721] [DEBUG] [MAIN ] ASR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:28.259204] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9262 primary records. [2025-09-24T22:16:28.321998] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-24T22:16:28.471538] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-09-24T22:16:28.474782] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-24T22:16:28.477133] [INFO ] [MAIN ] Derivative Progress: 124/2075 symbols completed. ASR took 1.2s. Estimated remaining: 13m 3s. Rate: 149.6 symbols/min [2025-09-24T22:16:28.478310] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:28.501035] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:28.502251] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49580 primary records. [2025-09-24T22:16:28.502484] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-24T22:16:28.530423] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-24T22:16:28.530791] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-24T22:16:28.533733] [INFO ] [MAIN ] Derivative Progress: 125/2075 symbols completed. ASPN took 1.2s. Estimated remaining: 12m 57s. Rate: 150.6 symbols/min [2025-09-24T22:16:28.534289] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:28.562638] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:28.563755] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52874 primary records. [2025-09-24T22:16:28.563954] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-24T22:16:28.577993] [DEBUG] [LOCAL ] ATEN: Loaded 39882 existing records from primary storage. [2025-09-24T22:16:28.585862] [INFO ] [MAIN ] ATEN: Loaded 39882 primary data records. [2025-09-24T22:16:28.671934] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-24T22:16:28.684356] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-24T22:16:28.697775] [INFO ] [MAIN ] Derivative Progress: 126/2075 symbols completed. ASX took 1.2s. Estimated remaining: 12m 53s. Rate: 151.3 symbols/min [2025-09-24T22:16:28.712311] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:28.751808] [DEBUG] [LOCAL ] ATGE: Loaded 31901 existing records from primary storage. [2025-09-24T22:16:28.771863] [INFO ] [MAIN ] ATGE: Loaded 31901 primary data records. [2025-09-24T22:16:29.186844] [DEBUG] [LOCAL ] ATHM: Loaded 32665 existing records from primary storage. [2025-09-24T22:16:29.187111] [INFO ] [MAIN ] ATHM: Loaded 32665 primary data records. [2025-09-24T22:16:29.666617] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:29.668801] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39882 primary records. [2025-09-24T22:16:29.669315] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-24T22:16:29.689845] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-24T22:16:29.703425] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-24T22:16:29.706080] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:29.705714] [INFO ] [MAIN ] Derivative Progress: 127/2075 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 2s. Rate: 149.5 symbols/min [2025-09-24T22:16:29.707516] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:29.707177] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31901 primary records. [2025-09-24T22:16:29.708273] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-24T22:16:29.727670] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-24T22:16:29.727932] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-24T22:16:29.730345] [INFO ] [MAIN ] Derivative Progress: 128/2075 symbols completed. ATGE took 1.2s. Estimated remaining: 12m 56s. Rate: 150.6 symbols/min [2025-09-24T22:16:29.732556] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:29.737108] [DEBUG] [LOCAL ] ATHS: Loaded 7098 existing records from primary storage. [2025-09-24T22:16:29.737279] [INFO ] [MAIN ] ATHS: Loaded 7098 primary data records. [2025-09-24T22:16:29.831816] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:29.843778] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 32665 primary records. [2025-09-24T22:16:29.851537] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-24T22:16:29.953113] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-24T22:16:29.953363] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-24T22:16:29.956257] [INFO ] [MAIN ] Derivative Progress: 129/2075 symbols completed. ATHM took 1.2s. Estimated remaining: 12m 53s. Rate: 151.1 symbols/min [2025-09-24T22:16:30.090801] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:30.116066] [DEBUG] [LOCAL ] ATI: Loaded 51530 existing records from primary storage. [2025-09-24T22:16:30.117752] [INFO ] [MAIN ] ATI: Loaded 51530 primary data records. [2025-09-24T22:16:30.324141] [DEBUG] [LOCAL ] ATKR: Loaded 35658 existing records from primary storage. [2025-09-24T22:16:30.439294] [INFO ] [MAIN ] ATKR: Loaded 35658 primary data records. [2025-09-24T22:16:30.520795] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:30.544793] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 7098 primary records. [2025-09-24T22:16:30.561924] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-24T22:16:30.636303] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-24T22:16:30.658960] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-24T22:16:30.791729] [INFO ] [MAIN ] Derivative Progress: 130/2075 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 59s. Rate: 149.9 symbols/min [2025-09-24T22:16:30.792368] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:30.812666] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:30.813606] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51530 primary records. [2025-09-24T22:16:30.813767] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-24T22:16:30.832669] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-24T22:16:30.832899] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-24T22:16:30.835484] [INFO ] [MAIN ] Derivative Progress: 131/2075 symbols completed. ATI took 1.1s. Estimated remaining: 12m 53s. Rate: 150.9 symbols/min [2025-09-24T22:16:30.835879] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:30.863019] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:30.863927] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35658 primary records. [2025-09-24T22:16:30.864068] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-24T22:16:30.880448] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-24T22:16:30.888131] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-24T22:16:30.890833] [INFO ] [MAIN ] Derivative Progress: 132/2075 symbols completed. ATKR took 0.8s. Estimated remaining: 12m 48s. Rate: 151.9 symbols/min [2025-09-24T22:16:30.904390] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:30.905737] [DEBUG] [LOCAL ] ATO: Loaded 41900 existing records from primary storage. [2025-09-24T22:16:30.905967] [INFO ] [MAIN ] ATO: Loaded 41900 primary data records. [2025-09-24T22:16:31.035040] [DEBUG] [LOCAL ] ATR: Loaded 30413 existing records from primary storage. [2025-09-24T22:16:31.035263] [INFO ] [MAIN ] ATR: Loaded 30413 primary data records. [2025-09-24T22:16:31.133491] [DEBUG] [LOCAL ] ATS: Loaded 17957 existing records from primary storage. [2025-09-24T22:16:31.216099] [INFO ] [MAIN ] ATS: Loaded 17957 primary data records. [2025-09-24T22:16:31.940850] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:31.943795] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41900 primary records. [2025-09-24T22:16:31.943931] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-24T22:16:31.976682] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-24T22:16:31.975970] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:31.977736] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-24T22:16:31.977636] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30413 primary records. [2025-09-24T22:16:31.980020] [INFO ] [MAIN ] Derivative Progress: 133/2075 symbols completed. ATO took 1.2s. Estimated remaining: 12m 57s. Rate: 149.9 symbols/min [2025-09-24T22:16:31.980134] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-24T22:16:32.009985] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:32.011482] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17957 primary records. [2025-09-24T22:16:32.012203] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-24T22:16:32.012247] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-24T22:16:32.012374] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-24T22:16:32.015444] [INFO ] [MAIN ] Derivative Progress: 134/2075 symbols completed. ATR took 1.2s. Estimated remaining: 12m 52s. Rate: 150.9 symbols/min [2025-09-24T22:16:32.030531] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-24T22:16:32.030602] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-24T22:16:32.032930] [INFO ] [MAIN ] Derivative Progress: 135/2075 symbols completed. ATS took 1.1s. Estimated remaining: 12m 46s. Rate: 152.0 symbols/min [2025-09-24T22:16:32.033550] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:32.033810] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:32.033622] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:32.076107] [DEBUG] [LOCAL ] AVA: Loaded 39617 existing records from primary storage. [2025-09-24T22:16:32.076338] [INFO ] [MAIN ] AVA: Loaded 39617 primary data records. [2025-09-24T22:16:32.252440] [DEBUG] [LOCAL ] AUB: Loaded 46415 existing records from primary storage. [2025-09-24T22:16:32.278557] [INFO ] [MAIN ] AUB: Loaded 46415 primary data records. [2025-09-24T22:16:32.471361] [DEBUG] [LOCAL ] AU: Loaded 52936 existing records from primary storage. [2025-09-24T22:16:32.497490] [INFO ] [MAIN ] AU: Loaded 52936 primary data records. [2025-09-24T22:16:33.094776] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:33.096367] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39617 primary records. [2025-09-24T22:16:33.096597] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-24T22:16:33.113971] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-24T22:16:33.114175] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-24T22:16:33.117026] [INFO ] [MAIN ] Derivative Progress: 136/2075 symbols completed. AVA took 1.1s. Estimated remaining: 12m 55s. Rate: 150.1 symbols/min [2025-09-24T22:16:33.117390] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:33.155554] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:33.155829] [DEBUG] [LOCAL ] AVAL: Loaded 8932 existing records from primary storage. [2025-09-24T22:16:33.156203] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:33.156990] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52936 primary records. [2025-09-24T22:16:33.157623] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46415 primary records. [2025-09-24T22:16:33.157785] [INFO ] [MAIN ] AVAL: Loaded 8932 primary data records. [2025-09-24T22:16:33.168951] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-24T22:16:33.157720] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-24T22:16:33.324914] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-24T22:16:33.330580] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-24T22:16:33.333982] [INFO ] [MAIN ] Derivative Progress: 137/2075 symbols completed. AUB took 1.3s. Estimated remaining: 12m 52s. Rate: 150.6 symbols/min [2025-09-24T22:16:33.334764] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:33.356979] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-24T22:16:33.371728] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-24T22:16:33.385055] [INFO ] [MAIN ] Derivative Progress: 138/2075 symbols completed. AU took 1.4s. Estimated remaining: 12m 47s. Rate: 151.5 symbols/min [2025-09-24T22:16:33.547701] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:33.581552] [DEBUG] [LOCAL ] AVD: Loaded 22808 existing records from primary storage. [2025-09-24T22:16:33.583210] [INFO ] [MAIN ] AVD: Loaded 22808 primary data records. [2025-09-24T22:16:33.709575] [DEBUG] [LOCAL ] AVB: Loaded 41784 existing records from primary storage. [2025-09-24T22:16:33.698484] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:33.729310] [INFO ] [MAIN ] AVB: Loaded 41784 primary data records. [2025-09-24T22:16:33.730417] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8932 primary records. [2025-09-24T22:16:33.731102] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-24T22:16:33.938568] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-24T22:16:34.059844] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-24T22:16:34.063345] [INFO ] [MAIN ] Derivative Progress: 139/2075 symbols completed. AVAL took 0.9s. Estimated remaining: 12m 51s. Rate: 150.7 symbols/min [2025-09-24T22:16:34.074385] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:34.284691] [DEBUG] [LOCAL ] AVK: Loaded 17864 existing records from primary storage. [2025-09-24T22:16:34.284949] [INFO ] [MAIN ] AVK: Loaded 17864 primary data records. [2025-09-24T22:16:34.472607] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:34.521490] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22808 primary records. [2025-09-24T22:16:34.528844] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-24T22:16:34.690046] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:34.692562] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41784 primary records. [2025-09-24T22:16:34.693397] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-24T22:16:34.695441] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-24T22:16:34.696213] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-24T22:16:34.699277] [INFO ] [MAIN ] Derivative Progress: 140/2075 symbols completed. AVD took 1.2s. Estimated remaining: 12m 53s. Rate: 150.1 symbols/min [2025-09-24T22:16:34.707410] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:34.719608] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-24T22:16:34.720246] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-24T22:16:34.722519] [INFO ] [MAIN ] Derivative Progress: 141/2075 symbols completed. AVB took 1.4s. Estimated remaining: 12m 48s. Rate: 151.1 symbols/min [2025-09-24T22:16:34.723232] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:34.741538] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:34.742314] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 17864 primary records. [2025-09-24T22:16:34.742920] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-24T22:16:34.769108] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-24T22:16:34.769251] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-24T22:16:34.771791] [INFO ] [MAIN ] Derivative Progress: 142/2075 symbols completed. AVK took 0.7s. Estimated remaining: 12m 43s. Rate: 152.1 symbols/min [2025-09-24T22:16:34.775123] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:34.789358] [DEBUG] [LOCAL ] AVNS: Loaded 33619 existing records from primary storage. [2025-09-24T22:16:34.789627] [INFO ] [MAIN ] AVNS: Loaded 33619 primary data records. [2025-09-24T22:16:34.956195] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-24T22:16:34.971787] [INFO ] [MAIN ] AVTR: Loaded 53567 primary data records. [2025-09-24T22:16:35.321957] [DEBUG] [LOCAL ] AVY: Loaded 37582 existing records from primary storage. [2025-09-24T22:16:35.345847] [INFO ] [MAIN ] AVY: Loaded 37582 primary data records. [2025-09-24T22:16:35.913805] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:35.915195] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33619 primary records. [2025-09-24T22:16:35.915509] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-24T22:16:35.949890] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-24T22:16:35.950677] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-24T22:16:35.953193] [INFO ] [MAIN ] Derivative Progress: 143/2075 symbols completed. AVNS took 1.3s. Estimated remaining: 12m 53s. Rate: 150.0 symbols/min [2025-09-24T22:16:35.950759] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:35.954733] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53567 primary records. [2025-09-24T22:16:35.955243] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-24T22:16:35.954936] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:35.988807] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-24T22:16:35.989462] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-24T22:16:35.992174] [INFO ] [MAIN ] Derivative Progress: 144/2075 symbols completed. AVTR took 1.3s. Estimated remaining: 12m 48s. Rate: 150.9 symbols/min [2025-09-24T22:16:35.998259] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:35.998589] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:35.999639] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37582 primary records. [2025-09-24T22:16:35.999877] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-24T22:16:36.023460] [DEBUG] [LOCAL ] AWF: Loaded 24291 existing records from primary storage. [2025-09-24T22:16:36.026502] [INFO ] [MAIN ] AWF: Loaded 24291 primary data records. [2025-09-24T22:16:36.027450] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-24T22:16:36.039158] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-24T22:16:36.051239] [INFO ] [MAIN ] Derivative Progress: 145/2075 symbols completed. AVY took 1.3s. Estimated remaining: 12m 43s. Rate: 151.8 symbols/min [2025-09-24T22:16:36.108065] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:36.236045] [DEBUG] [LOCAL ] AWI: Loaded 25923 existing records from primary storage. [2025-09-24T22:16:36.351005] [INFO ] [MAIN ] AWI: Loaded 25923 primary data records. [2025-09-24T22:16:36.726356] [DEBUG] [LOCAL ] AWK: Loaded 48797 existing records from primary storage. [2025-09-24T22:16:36.735617] [INFO ] [MAIN ] AWK: Loaded 48797 primary data records. [2025-09-24T22:16:36.959114] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:37.092066] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24291 primary records. [2025-09-24T22:16:37.092546] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-24T22:16:37.122136] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-24T22:16:37.124007] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-24T22:16:37.126507] [INFO ] [MAIN ] Derivative Progress: 146/2075 symbols completed. AWF took 1.2s. Estimated remaining: 12m 51s. Rate: 150.0 symbols/min [2025-09-24T22:16:37.127039] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:37.144411] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:37.145614] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25923 primary records. [2025-09-24T22:16:37.145913] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-24T22:16:37.171335] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-09-24T22:16:37.171817] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-24T22:16:37.176758] [INFO ] [MAIN ] Derivative Progress: 147/2075 symbols completed. AWI took 1.2s. Estimated remaining: 12m 46s. Rate: 150.9 symbols/min [2025-09-24T22:16:37.177325] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:37.199089] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:37.199817] [DEBUG] [LOCAL ] AWP: Loaded 21617 existing records from primary storage. [2025-09-24T22:16:37.200026] [INFO ] [MAIN ] AWP: Loaded 21617 primary data records. [2025-09-24T22:16:37.200764] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48797 primary records. [2025-09-24T22:16:37.200877] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-24T22:16:37.361940] [DEBUG] [LOCAL ] AWR: Loaded 22612 existing records from primary storage. [2025-09-24T22:16:37.362298] [INFO ] [MAIN ] AWR: Loaded 22612 primary data records. [2025-09-24T22:16:37.362186] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-24T22:16:37.370588] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-24T22:16:37.378449] [INFO ] [MAIN ] Derivative Progress: 148/2075 symbols completed. AWK took 1.3s. Estimated remaining: 12m 43s. Rate: 151.4 symbols/min [2025-09-24T22:16:37.945810] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:37.946691] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21617 primary records. [2025-09-24T22:16:37.946780] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-24T22:16:37.963956] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-24T22:16:37.964170] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-24T22:16:37.966360] [INFO ] [MAIN ] Derivative Progress: 149/2075 symbols completed. AWP took 0.8s. Estimated remaining: 12m 46s. Rate: 150.9 symbols/min [2025-09-24T22:16:37.982257] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:37.982943] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22612 primary records. [2025-09-24T22:16:37.983007] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-24T22:16:38.007581] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-24T22:16:38.007761] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-24T22:16:38.011114] [INFO ] [MAIN ] Derivative Progress: 150/2075 symbols completed. AWR took 0.8s. Estimated remaining: 12m 41s. Rate: 151.8 symbols/min [2025-09-24T22:16:38.012084] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:38.012247] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:38.013344] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:38.048315] [DEBUG] [LOCAL ] AX: Loaded 28543 existing records from primary storage. [2025-09-24T22:16:38.060813] [INFO ] [MAIN ] AX: Loaded 28543 primary data records. [2025-09-24T22:16:38.215410] [DEBUG] [LOCAL ] AXL: Loaded 50488 existing records from primary storage. [2025-09-24T22:16:38.267717] [INFO ] [MAIN ] AXL: Loaded 50488 primary data records. [2025-09-24T22:16:38.512539] [DEBUG] [LOCAL ] AXP: Loaded 53254 existing records from primary storage. [2025-09-24T22:16:38.534075] [INFO ] [MAIN ] AXP: Loaded 53254 primary data records. [2025-09-24T22:16:39.062177] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:39.063293] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28543 primary records. [2025-09-24T22:16:39.063714] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-24T22:16:39.084636] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-24T22:16:39.085007] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-24T22:16:39.087619] [INFO ] [MAIN ] Derivative Progress: 151/2075 symbols completed. AX took 1.1s. Estimated remaining: 12m 49s. Rate: 150.1 symbols/min [2025-09-24T22:16:39.095770] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:39.101420] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:39.102307] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50488 primary records. [2025-09-24T22:16:39.102505] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-24T22:16:39.120961] [DEBUG] [LOCAL ] AXR: Loaded 3151 existing records from primary storage. [2025-09-24T22:16:39.122096] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-24T22:16:39.121149] [INFO ] [MAIN ] AXR: Loaded 3151 primary data records. [2025-09-24T22:16:39.122237] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-24T22:16:39.125867] [INFO ] [MAIN ] Derivative Progress: 152/2075 symbols completed. AXL took 1.1s. Estimated remaining: 12m 44s. Rate: 151.0 symbols/min [2025-09-24T22:16:39.137953] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:39.215613] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:39.244584] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53254 primary records. [2025-09-24T22:16:39.255542] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-24T22:16:39.463628] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-24T22:16:39.464944] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-24T22:16:39.467468] [INFO ] [MAIN ] Derivative Progress: 153/2075 symbols completed. AXP took 1.5s. Estimated remaining: 12m 43s. Rate: 151.2 symbols/min [2025-09-24T22:16:39.467952] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:39.482575] [DEBUG] [LOCAL ] AXS: Loaded 38308 existing records from primary storage. [2025-09-24T22:16:39.483064] [INFO ] [MAIN ] AXS: Loaded 38308 primary data records. [2025-09-24T22:16:39.857774] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:16:39.859236] [INFO ] [MAIN ] AXR: Generated 1792 derivative records from 3151 primary records. [2025-09-24T22:16:39.872931] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-24T22:16:39.887514] [DEBUG] [LOCAL ] AXTA: Loaded 52058 existing records from primary storage. [2025-09-24T22:16:39.888733] [INFO ] [MAIN ] AXTA: Loaded 52058 primary data records. [2025-09-24T22:16:39.891550] [DEBUG] [LOCAL ] AXR: Derivative data saved (1792 records). [2025-09-24T22:16:39.891866] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-24T22:16:39.906071] [INFO ] [MAIN ] Derivative Progress: 154/2075 symbols completed. AXR took 0.8s. Estimated remaining: 12m 43s. Rate: 151.1 symbols/min [2025-09-24T22:16:39.925153] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:40.230875] [DEBUG] [LOCAL ] AYI: Loaded 25117 existing records from primary storage. [2025-09-24T22:16:40.243589] [INFO ] [MAIN ] AYI: Loaded 25117 primary data records. [2025-09-24T22:16:40.250190] [DEBUG] [MAIN ] AXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:40.257826] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38308 primary records. [2025-09-24T22:16:40.268676] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-24T22:16:40.398693] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-24T22:16:40.404232] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-24T22:16:40.451982] [INFO ] [MAIN ] Derivative Progress: 155/2075 symbols completed. AXS took 1.3s. Estimated remaining: 12m 44s. Rate: 150.7 symbols/min [2025-09-24T22:16:40.574300] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:40.599472] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:40.601048] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52058 primary records. [2025-09-24T22:16:40.608629] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-24T22:16:40.609561] [DEBUG] [LOCAL ] AZO: Loaded 11473 existing records from primary storage. [2025-09-24T22:16:40.618540] [INFO ] [MAIN ] AZO: Loaded 11473 primary data records. [2025-09-24T22:16:40.735926] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-24T22:16:40.743194] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-24T22:16:40.750600] [INFO ] [MAIN ] Derivative Progress: 156/2075 symbols completed. AXTA took 1.3s. Estimated remaining: 12m 43s. Rate: 150.9 symbols/min [2025-09-24T22:16:40.781820] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:40.833768] [DEBUG] [MAIN ] AYI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:16:40.960620] [INFO ] [MAIN ] AYI: Generated 1793 derivative records from 25117 primary records. [2025-09-24T22:16:40.961406] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-24T22:16:40.980409] [DEBUG] [LOCAL ] AYI: Derivative data saved (1793 records). [2025-09-24T22:16:40.980947] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-24T22:16:40.983559] [INFO ] [MAIN ] Derivative Progress: 157/2075 symbols completed. AYI took 1.1s. Estimated remaining: 12m 40s. Rate: 151.3 symbols/min [2025-09-24T22:16:40.990417] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:41.004333] [DEBUG] [LOCAL ] AZZ: Loaded 22152 existing records from primary storage. [2025-09-24T22:16:41.004802] [INFO ] [MAIN ] AZZ: Loaded 22152 primary data records. [2025-09-24T22:16:41.197511] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:41.236816] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11473 primary records. [2025-09-24T22:16:41.382330] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-24T22:16:41.418204] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-24T22:16:41.420142] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-24T22:16:41.422673] [INFO ] [MAIN ] Derivative Progress: 158/2075 symbols completed. AZO took 0.8s. Estimated remaining: 12m 41s. Rate: 151.2 symbols/min [2025-09-24T22:16:41.424893] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-24T22:16:41.425282] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-24T22:16:41.425149] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:41.808323] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:41.825631] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22152 primary records. [2025-09-24T22:16:41.826244] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-24T22:16:41.845958] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-24T22:16:41.846329] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-24T22:16:41.848999] [INFO ] [MAIN ] Derivative Progress: 159/2075 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 40s. Rate: 151.2 symbols/min [2025-09-24T22:16:41.864443] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:41.865801] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-24T22:16:41.866378] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-24T22:16:42.046330] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:42.070692] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-24T22:16:42.070914] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-24T22:16:42.220355] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-24T22:16:42.220610] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-24T22:16:42.223496] [INFO ] [MAIN ] Derivative Progress: 160/2075 symbols completed. BA took 1.2s. Estimated remaining: 12m 40s. Rate: 151.2 symbols/min [2025-09-24T22:16:42.223859] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:42.245190] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-24T22:16:42.245708] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-24T22:16:42.591723] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:42.592578] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-24T22:16:42.592686] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-24T22:16:42.624953] [DEBUG] [LOCAL ] BAH: Loaded 51721 existing records from primary storage. [2025-09-24T22:16:42.626308] [INFO ] [MAIN ] BAH: Loaded 51721 primary data records. [2025-09-24T22:16:42.674120] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-24T22:16:42.679705] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-24T22:16:42.714348] [INFO ] [MAIN ] Derivative Progress: 161/2075 symbols completed. BABA took 1.3s. Estimated remaining: 12m 41s. Rate: 151.0 symbols/min [2025-09-24T22:16:42.754676] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:43.003288] [DEBUG] [MAIN ] BAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:43.004975] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-24T22:16:43.005556] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-24T22:16:43.047358] [DEBUG] [LOCAL ] BAK: Loaded 38810 existing records from primary storage. [2025-09-24T22:16:43.050063] [INFO ] [MAIN ] BAK: Loaded 38810 primary data records. [2025-09-24T22:16:43.051035] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-24T22:16:43.051786] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-24T22:16:43.093861] [INFO ] [MAIN ] Derivative Progress: 162/2075 symbols completed. BAC took 1.2s. Estimated remaining: 12m 40s. Rate: 151.0 symbols/min [2025-09-24T22:16:43.129673] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:43.394820] [DEBUG] [MAIN ] BAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:43.395986] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51721 primary records. [2025-09-24T22:16:43.396695] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-24T22:16:43.416866] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-24T22:16:43.417840] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-24T22:16:43.420246] [INFO ] [MAIN ] Derivative Progress: 163/2075 symbols completed. BAH took 1.2s. Estimated remaining: 12m 39s. Rate: 151.2 symbols/min [2025-09-24T22:16:43.473667] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:43.474967] [DEBUG] [LOCAL ] BALL: Loaded 51811 existing records from primary storage. [2025-09-24T22:16:43.475738] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 38810 primary records. [2025-09-24T22:16:43.475864] [INFO ] [MAIN ] BALL: Loaded 51811 primary data records. [2025-09-24T22:16:43.476015] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-24T22:16:43.679134] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-24T22:16:43.820116] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-24T22:16:43.855492] [INFO ] [MAIN ] Derivative Progress: 164/2075 symbols completed. BAK took 1.1s. Estimated remaining: 12m 39s. Rate: 151.1 symbols/min [2025-09-24T22:16:43.881424] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:43.882114] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51811 primary records. [2025-09-24T22:16:43.882181] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-24T22:16:43.897755] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-24T22:16:43.897817] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-24T22:16:43.900258] [INFO ] [MAIN ] Derivative Progress: 165/2075 symbols completed. BALL took 0.8s. Estimated remaining: 12m 34s. Rate: 151.9 symbols/min [2025-09-24T22:16:43.900894] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:43.901060] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:43.901200] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:43.931535] [DEBUG] [LOCAL ] BAP: Loaded 26395 existing records from primary storage. [2025-09-24T22:16:43.931779] [INFO ] [MAIN ] BAP: Loaded 26395 primary data records. [2025-09-24T22:16:44.177443] [DEBUG] [LOCAL ] BANC: Loaded 51263 existing records from primary storage. [2025-09-24T22:16:44.295122] [INFO ] [MAIN ] BANC: Loaded 51263 primary data records. [2025-09-24T22:16:44.296328] [DEBUG] [LOCAL ] BAM: Loaded 52001 existing records from primary storage. [2025-09-24T22:16:44.296508] [INFO ] [MAIN ] BAM: Loaded 52001 primary data records. [2025-09-24T22:16:45.009278] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:45.010710] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26395 primary records. [2025-09-24T22:16:45.011419] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-24T22:16:45.039922] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-24T22:16:45.040261] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-24T22:16:45.043090] [INFO ] [MAIN ] Derivative Progress: 166/2075 symbols completed. BAP took 1.1s. Estimated remaining: 12m 42s. Rate: 150.2 symbols/min [2025-09-24T22:16:45.045319] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:45.064567] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:45.069283] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52001 primary records. [2025-09-24T22:16:45.069924] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-24T22:16:45.099872] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:45.103094] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51263 primary records. [2025-09-24T22:16:45.103362] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-24T22:16:45.134915] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-24T22:16:45.137314] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-24T22:16:45.141974] [INFO ] [MAIN ] Derivative Progress: 167/2075 symbols completed. BAM took 1.2s. Estimated remaining: 12m 39s. Rate: 150.9 symbols/min [2025-09-24T22:16:45.144174] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:45.158953] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-24T22:16:45.159163] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-24T22:16:45.163794] [INFO ] [MAIN ] Derivative Progress: 168/2075 symbols completed. BANC took 1.3s. Estimated remaining: 12m 34s. Rate: 151.8 symbols/min [2025-09-24T22:16:45.165351] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:45.191781] [DEBUG] [LOCAL ] BARK: Loaded 38436 existing records from primary storage. [2025-09-24T22:16:45.192272] [INFO ] [MAIN ] BARK: Loaded 38436 primary data records. [2025-09-24T22:16:45.569602] [DEBUG] [LOCAL ] BB: Loaded 52921 existing records from primary storage. [2025-09-24T22:16:45.569855] [INFO ] [MAIN ] BB: Loaded 52921 primary data records. [2025-09-24T22:16:45.586672] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-09-24T22:16:45.629822] [INFO ] [MAIN ] BAX: Loaded 53493 primary data records. [2025-09-24T22:16:46.516585] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:46.517525] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38436 primary records. [2025-09-24T22:16:46.517737] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-24T22:16:46.536521] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-09-24T22:16:46.536867] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-24T22:16:46.538880] [INFO ] [MAIN ] Derivative Progress: 169/2075 symbols completed. BARK took 1.5s. Estimated remaining: 12m 45s. Rate: 149.6 symbols/min [2025-09-24T22:16:46.540635] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:46.558159] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:46.560166] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52921 primary records. [2025-09-24T22:16:46.561240] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-24T22:16:46.589145] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:46.590815] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53493 primary records. [2025-09-24T22:16:46.591570] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-24T22:16:46.609475] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-24T22:16:46.610133] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-24T22:16:46.612879] [INFO ] [MAIN ] Derivative Progress: 170/2075 symbols completed. BB took 1.4s. Estimated remaining: 12m 41s. Rate: 150.3 symbols/min [2025-09-24T22:16:46.613757] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:46.631436] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-24T22:16:46.631627] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-24T22:16:46.634114] [INFO ] [MAIN ] Derivative Progress: 171/2075 symbols completed. BAX took 1.5s. Estimated remaining: 12m 36s. Rate: 151.1 symbols/min [2025-09-24T22:16:46.634580] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:46.664320] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-24T22:16:46.664686] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-24T22:16:47.022184] [DEBUG] [LOCAL ] BBAR: Loaded 41302 existing records from primary storage. [2025-09-24T22:16:47.022529] [INFO ] [MAIN ] BBAR: Loaded 41302 primary data records. [2025-09-24T22:16:47.142435] [DEBUG] [LOCAL ] BBD: Loaded 53181 existing records from primary storage. [2025-09-24T22:16:47.154222] [INFO ] [MAIN ] BBD: Loaded 53181 primary data records. [2025-09-24T22:16:47.715319] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:47.716897] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-24T22:16:47.717621] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-24T22:16:47.738785] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-24T22:16:47.739327] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-24T22:16:47.742199] [INFO ] [MAIN ] Derivative Progress: 172/2075 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 43s. Rate: 149.6 symbols/min [2025-09-24T22:16:47.743206] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:47.763512] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:47.764352] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41302 primary records. [2025-09-24T22:16:47.764785] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-24T22:16:47.807167] [DEBUG] [MAIN ] BBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:47.809387] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53181 primary records. [2025-09-24T22:16:47.809833] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-24T22:16:47.811475] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-24T22:16:47.812555] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-24T22:16:47.814792] [INFO ] [MAIN ] Derivative Progress: 173/2075 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 39s. Rate: 150.3 symbols/min [2025-09-24T22:16:47.827118] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:47.850272] [DEBUG] [LOCAL ] BBDO: Loaded 5017 existing records from primary storage. [2025-09-24T22:16:47.850501] [INFO ] [MAIN ] BBDO: Loaded 5017 primary data records. [2025-09-24T22:16:47.846171] [DEBUG] [LOCAL ] BBDC: Loaded 33300 existing records from primary storage. [2025-09-24T22:16:47.850421] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-24T22:16:47.863229] [INFO ] [MAIN ] BBDC: Loaded 33300 primary data records. [2025-09-24T22:16:47.863529] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-24T22:16:47.889041] [INFO ] [MAIN ] Derivative Progress: 174/2075 symbols completed. BBD took 1.3s. Estimated remaining: 12m 35s. Rate: 151.0 symbols/min [2025-09-24T22:16:47.968748] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:48.253669] [DEBUG] [LOCAL ] BBN: Loaded 17983 existing records from primary storage. [2025-09-24T22:16:48.382519] [INFO ] [MAIN ] BBN: Loaded 17983 primary data records. [2025-09-24T22:16:48.946297] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:48.947802] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5017 primary records. [2025-09-24T22:16:48.947924] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-24T22:16:48.963476] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:48.971111] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33300 primary records. [2025-09-24T22:16:48.976126] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-24T22:16:48.997060] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-24T22:16:48.997282] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-24T22:16:49.001398] [INFO ] [MAIN ] Derivative Progress: 175/2075 symbols completed. BBDC took 1.3s. Estimated remaining: 12m 43s. Rate: 149.4 symbols/min [2025-09-24T22:16:49.003084] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:49.004327] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-24T22:16:49.004588] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-24T22:16:49.007082] [INFO ] [MAIN ] Derivative Progress: 176/2075 symbols completed. BBDO took 1.2s. Estimated remaining: 12m 38s. Rate: 150.3 symbols/min [2025-09-24T22:16:49.007769] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:49.030085] [DEBUG] [LOCAL ] BBU: Loaded 4110 existing records from primary storage. [2025-09-24T22:16:49.030577] [INFO ] [MAIN ] BBU: Loaded 4110 primary data records. [2025-09-24T22:16:49.062746] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:49.093011] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 17983 primary records. [2025-09-24T22:16:49.107783] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-24T22:16:49.135367] [DEBUG] [LOCAL ] BBUC: Loaded 13112 existing records from primary storage. [2025-09-24T22:16:49.148544] [INFO ] [MAIN ] BBUC: Loaded 13112 primary data records. [2025-09-24T22:16:49.559695] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-24T22:16:49.560424] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-24T22:16:49.594553] [INFO ] [MAIN ] Derivative Progress: 177/2075 symbols completed. BBN took 1.6s. Estimated remaining: 12m 40s. Rate: 149.9 symbols/min [2025-09-24T22:16:49.595363] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:49.749867] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:16:49.750976] [INFO ] [MAIN ] BBU: Generated 1793 derivative records from 4110 primary records. [2025-09-24T22:16:49.751134] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-24T22:16:49.785824] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:49.798288] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13112 primary records. [2025-09-24T22:16:49.798955] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-24T22:16:49.800674] [DEBUG] [LOCAL ] BBU: Derivative data saved (1793 records). [2025-09-24T22:16:49.801130] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-24T22:16:49.804137] [INFO ] [MAIN ] Derivative Progress: 178/2075 symbols completed. BBU took 0.8s. Estimated remaining: 12m 37s. Rate: 150.3 symbols/min [2025-09-24T22:16:49.836408] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-24T22:16:49.836516] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-24T22:16:49.838850] [INFO ] [MAIN ] Derivative Progress: 179/2075 symbols completed. BBUC took 0.8s. Estimated remaining: 12m 33s. Rate: 151.1 symbols/min [2025-09-24T22:16:49.836286] [DEBUG] [LOCAL ] BBVA: Loaded 49477 existing records from primary storage. [2025-09-24T22:16:49.839216] [INFO ] [MAIN ] BBVA: Loaded 49477 primary data records. [2025-09-24T22:16:50.156638] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:50.157371] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49477 primary records. [2025-09-24T22:16:50.157438] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-24T22:16:50.173216] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-24T22:16:50.173281] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-24T22:16:50.175428] [INFO ] [MAIN ] Derivative Progress: 180/2075 symbols completed. BBVA took 0.6s. Estimated remaining: 12m 32s. Rate: 151.2 symbols/min [2025-09-24T22:16:50.176422] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:50.176838] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:50.176620] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:50.207228] [DEBUG] [LOCAL ] BBW: Loaded 26707 existing records from primary storage. [2025-09-24T22:16:50.207527] [INFO ] [MAIN ] BBW: Loaded 26707 primary data records. [2025-09-24T22:16:50.452633] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-24T22:16:50.586880] [INFO ] [MAIN ] BBWI: Loaded 53580 primary data records. [2025-09-24T22:16:50.587871] [DEBUG] [LOCAL ] BBY: Loaded 53480 existing records from primary storage. [2025-09-24T22:16:50.644548] [INFO ] [MAIN ] BBY: Loaded 53480 primary data records. [2025-09-24T22:16:51.257881] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:51.262458] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26707 primary records. [2025-09-24T22:16:51.263606] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-24T22:16:51.295846] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:51.297783] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53580 primary records. [2025-09-24T22:16:51.298889] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-24T22:16:51.315457] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-24T22:16:51.319489] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-24T22:16:51.322297] [INFO ] [MAIN ] Derivative Progress: 181/2075 symbols completed. BBW took 1.1s. Estimated remaining: 12m 40s. Rate: 149.6 symbols/min [2025-09-24T22:16:51.323837] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-24T22:16:51.324366] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:51.324561] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-24T22:16:51.340510] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:51.340242] [INFO ] [MAIN ] Derivative Progress: 182/2075 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 35s. Rate: 150.4 symbols/min [2025-09-24T22:16:51.341431] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53480 primary records. [2025-09-24T22:16:51.341973] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:51.341919] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-24T22:16:51.359972] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-24T22:16:51.360247] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-24T22:16:51.362855] [INFO ] [MAIN ] Derivative Progress: 183/2075 symbols completed. BBY took 1.2s. Estimated remaining: 12m 31s. Rate: 151.2 symbols/min [2025-09-24T22:16:51.363282] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:51.413299] [DEBUG] [LOCAL ] BCC: Loaded 28355 existing records from primary storage. [2025-09-24T22:16:51.413637] [INFO ] [MAIN ] BCC: Loaded 28355 primary data records. [2025-09-24T22:16:51.420223] [DEBUG] [LOCAL ] BC: Loaded 44422 existing records from primary storage. [2025-09-24T22:16:51.437759] [INFO ] [MAIN ] BC: Loaded 44422 primary data records. [2025-09-24T22:16:51.980492] [DEBUG] [LOCAL ] BCE: Loaded 52340 existing records from primary storage. [2025-09-24T22:16:52.102230] [INFO ] [MAIN ] BCE: Loaded 52340 primary data records. [2025-09-24T22:16:52.469605] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:52.471684] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28355 primary records. [2025-09-24T22:16:52.471978] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-24T22:16:52.507211] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:52.505583] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-24T22:16:52.509959] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44422 primary records. [2025-09-24T22:16:52.509144] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-24T22:16:52.510390] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-24T22:16:52.512687] [INFO ] [MAIN ] Derivative Progress: 184/2075 symbols completed. BCC took 1.2s. Estimated remaining: 12m 38s. Rate: 149.6 symbols/min [2025-09-24T22:16:52.513386] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:52.536403] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:52.540692] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52340 primary records. [2025-09-24T22:16:52.544184] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-24T22:16:52.544271] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-24T22:16:52.544479] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-24T22:16:52.546905] [INFO ] [MAIN ] Derivative Progress: 185/2075 symbols completed. BC took 1.2s. Estimated remaining: 12m 34s. Rate: 150.4 symbols/min [2025-09-24T22:16:52.548334] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:52.573994] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-24T22:16:52.574191] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-24T22:16:52.576675] [INFO ] [MAIN ] Derivative Progress: 186/2075 symbols completed. BCE took 1.2s. Estimated remaining: 12m 30s. Rate: 151.1 symbols/min [2025-09-24T22:16:52.577068] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:52.587145] [DEBUG] [LOCAL ] BCO: Loaded 26443 existing records from primary storage. [2025-09-24T22:16:52.587470] [INFO ] [MAIN ] BCO: Loaded 26443 primary data records. [2025-09-24T22:16:52.704605] [DEBUG] [LOCAL ] BCSF: Loaded 27844 existing records from primary storage. [2025-09-24T22:16:52.716250] [INFO ] [MAIN ] BCSF: Loaded 27844 primary data records. [2025-09-24T22:16:52.882600] [DEBUG] [LOCAL ] BCX: Loaded 21656 existing records from primary storage. [2025-09-24T22:16:52.918599] [INFO ] [MAIN ] BCX: Loaded 21656 primary data records. [2025-09-24T22:16:53.606667] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:53.607713] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26443 primary records. [2025-09-24T22:16:53.608620] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-24T22:16:53.634572] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-24T22:16:53.639441] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-24T22:16:53.644225] [INFO ] [MAIN ] Derivative Progress: 187/2075 symbols completed. BCO took 1.1s. Estimated remaining: 12m 36s. Rate: 149.8 symbols/min [2025-09-24T22:16:53.641968] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:53.645564] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27844 primary records. [2025-09-24T22:16:53.644495] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:53.645752] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-24T22:16:53.671391] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:53.673545] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21656 primary records. [2025-09-24T22:16:53.674679] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-24T22:16:53.677298] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-24T22:16:53.677447] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-24T22:16:53.680223] [INFO ] [MAIN ] Derivative Progress: 188/2075 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 32s. Rate: 150.5 symbols/min [2025-09-24T22:16:53.680635] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:53.702489] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-24T22:16:53.702626] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-24T22:16:53.704773] [INFO ] [MAIN ] Derivative Progress: 189/2075 symbols completed. BCX took 1.1s. Estimated remaining: 12m 28s. Rate: 151.3 symbols/min [2025-09-24T22:16:53.705539] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:53.714056] [DEBUG] [LOCAL ] BDC: Loaded 24794 existing records from primary storage. [2025-09-24T22:16:53.714224] [INFO ] [MAIN ] BDC: Loaded 24794 primary data records. [2025-09-24T22:16:54.049164] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-24T22:16:54.049402] [INFO ] [MAIN ] BE: Loaded 53653 primary data records. [2025-09-24T22:16:54.241634] [DEBUG] [LOCAL ] BEN: Loaded 53059 existing records from primary storage. [2025-09-24T22:16:54.282086] [INFO ] [MAIN ] BEN: Loaded 53059 primary data records. [2025-09-24T22:16:54.768690] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:54.769897] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24794 primary records. [2025-09-24T22:16:54.770270] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-24T22:16:54.789879] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-24T22:16:54.790634] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-24T22:16:54.793346] [INFO ] [MAIN ] Derivative Progress: 190/2075 symbols completed. BDC took 1.1s. Estimated remaining: 12m 35s. Rate: 149.9 symbols/min [2025-09-24T22:16:54.793921] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:54.814525] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:54.818700] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53653 primary records. [2025-09-24T22:16:54.817605] [DEBUG] [LOCAL ] BEPH: Loaded 5099 existing records from primary storage. [2025-09-24T22:16:54.818963] [INFO ] [MAIN ] BEPH: Loaded 5099 primary data records. [2025-09-24T22:16:54.824427] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-24T22:16:54.948272] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-09-24T22:16:54.954200] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-24T22:16:54.974068] [INFO ] [MAIN ] Derivative Progress: 191/2075 symbols completed. BE took 1.3s. Estimated remaining: 12m 32s. Rate: 150.3 symbols/min [2025-09-24T22:16:54.984109] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:55.013398] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:55.022133] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53059 primary records. [2025-09-24T22:16:55.023751] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-24T22:16:55.175370] [DEBUG] [LOCAL ] BEPI: Loaded 3425 existing records from primary storage. [2025-09-24T22:16:55.179230] [INFO ] [MAIN ] BEPI: Loaded 3425 primary data records. [2025-09-24T22:16:55.299020] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-24T22:16:55.309419] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-24T22:16:55.369525] [INFO ] [MAIN ] Derivative Progress: 192/2075 symbols completed. BEN took 1.7s. Estimated remaining: 12m 32s. Rate: 150.3 symbols/min [2025-09-24T22:16:55.375317] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:55.504523] [DEBUG] [LOCAL ] BEPJ: Loaded 3247 existing records from primary storage. [2025-09-24T22:16:55.505568] [INFO ] [MAIN ] BEPJ: Loaded 3247 primary data records. [2025-09-24T22:16:55.719950] [DEBUG] [MAIN ] BEPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:55.837578] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5099 primary records. [2025-09-24T22:16:55.838061] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-24T22:16:55.858010] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-24T22:16:55.871185] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-24T22:16:55.873669] [INFO ] [MAIN ] Derivative Progress: 193/2075 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 32s. Rate: 150.1 symbols/min [2025-09-24T22:16:55.874458] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:55.875747] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3425 primary records. [2025-09-24T22:16:55.875942] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-24T22:16:55.893437] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-24T22:16:55.893639] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-24T22:16:55.896126] [INFO ] [MAIN ] Derivative Progress: 194/2075 symbols completed. BEPI took 0.9s. Estimated remaining: 12m 28s. Rate: 150.9 symbols/min [2025-09-24T22:16:55.912172] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:55.912759] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3247 primary records. [2025-09-24T22:16:55.912822] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-24T22:16:55.926481] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-09-24T22:16:55.926547] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-24T22:16:55.929101] [INFO ] [MAIN ] Derivative Progress: 195/2075 symbols completed. BEPJ took 0.6s. Estimated remaining: 12m 24s. Rate: 151.6 symbols/min [2025-09-24T22:16:55.929870] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:55.930041] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:55.929638] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:55.954128] [DEBUG] [LOCAL ] BFK: Loaded 13975 existing records from primary storage. [2025-09-24T22:16:55.954309] [INFO ] [MAIN ] BFK: Loaded 13975 primary data records. [2025-09-24T22:16:56.066133] [DEBUG] [LOCAL ] BFAM: Loaded 33023 existing records from primary storage. [2025-09-24T22:16:56.077896] [INFO ] [MAIN ] BFAM: Loaded 33023 primary data records. [2025-09-24T22:16:56.215411] [DEBUG] [LOCAL ] BFH: Loaded 41716 existing records from primary storage. [2025-09-24T22:16:56.234262] [INFO ] [MAIN ] BFH: Loaded 41716 primary data records. [2025-09-24T22:16:56.999301] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:57.000689] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13975 primary records. [2025-09-24T22:16:57.000803] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-24T22:16:57.014865] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:57.023182] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33023 primary records. [2025-09-24T22:16:57.023430] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-24T22:16:57.050593] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-24T22:16:57.050500] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-24T22:16:57.050801] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-24T22:16:57.050733] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-24T22:16:57.054894] [INFO ] [MAIN ] Derivative Progress: 196/2075 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 31s. Rate: 150.2 symbols/min [2025-09-24T22:16:57.057514] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:57.057712] [INFO ] [MAIN ] Derivative Progress: 197/2075 symbols completed. BFK took 1.1s. Estimated remaining: 12m 27s. Rate: 150.9 symbols/min [2025-09-24T22:16:57.058027] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:57.071624] [DEBUG] [MAIN ] BFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:57.072816] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41716 primary records. [2025-09-24T22:16:57.072880] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-24T22:16:57.097787] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-24T22:16:57.096701] [DEBUG] [LOCAL ] BFZ: Loaded 11925 existing records from primary storage. [2025-09-24T22:16:57.097903] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-24T22:16:57.100450] [INFO ] [MAIN ] Derivative Progress: 198/2075 symbols completed. BFH took 1.2s. Estimated remaining: 12m 23s. Rate: 151.6 symbols/min [2025-09-24T22:16:57.100631] [INFO ] [MAIN ] BFZ: Loaded 11925 primary data records. [2025-09-24T22:16:57.101008] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:57.332518] [DEBUG] [LOCAL ] BGB: Loaded 17384 existing records from primary storage. [2025-09-24T22:16:57.445397] [INFO ] [MAIN ] BGB: Loaded 17384 primary data records. [2025-09-24T22:16:57.455094] [DEBUG] [LOCAL ] BFLY: Loaded 51826 existing records from primary storage. [2025-09-24T22:16:57.456113] [INFO ] [MAIN ] BFLY: Loaded 51826 primary data records. [2025-09-24T22:16:58.100442] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:58.101588] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11925 primary records. [2025-09-24T22:16:58.101819] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-24T22:16:58.121480] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-24T22:16:58.122114] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-24T22:16:58.124473] [INFO ] [MAIN ] Derivative Progress: 199/2075 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 28s. Rate: 150.4 symbols/min [2025-09-24T22:16:58.124878] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:58.147061] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:58.155246] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17384 primary records. [2025-09-24T22:16:58.159925] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-24T22:16:58.160748] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:58.166209] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51826 primary records. [2025-09-24T22:16:58.166563] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-24T22:16:58.201835] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-24T22:16:58.198224] [DEBUG] [LOCAL ] BGH: Loaded 16392 existing records from primary storage. [2025-09-24T22:16:58.202209] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-24T22:16:58.204833] [INFO ] [MAIN ] Derivative Progress: 200/2075 symbols completed. BFLY took 1.1s. Estimated remaining: 12m 25s. Rate: 151.0 symbols/min [2025-09-24T22:16:58.204985] [INFO ] [MAIN ] BGH: Loaded 16392 primary data records. [2025-09-24T22:16:58.227021] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:58.238949] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-24T22:16:58.244904] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-24T22:16:58.253973] [INFO ] [MAIN ] Derivative Progress: 201/2075 symbols completed. BGB took 1.2s. Estimated remaining: 12m 21s. Rate: 151.7 symbols/min [2025-09-24T22:16:58.281265] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:58.379678] [DEBUG] [LOCAL ] BGR: Loaded 13451 existing records from primary storage. [2025-09-24T22:16:58.411595] [INFO ] [MAIN ] BGR: Loaded 13451 primary data records. [2025-09-24T22:16:58.809048] [DEBUG] [LOCAL ] BGS: Loaded 50445 existing records from primary storage. [2025-09-24T22:16:58.886151] [INFO ] [MAIN ] BGS: Loaded 50445 primary data records. [2025-09-24T22:16:59.192481] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:59.216153] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16392 primary records. [2025-09-24T22:16:59.216480] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-24T22:16:59.355397] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-24T22:16:59.356081] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-24T22:16:59.358607] [INFO ] [MAIN ] Derivative Progress: 202/2075 symbols completed. BGH took 1.2s. Estimated remaining: 12m 28s. Rate: 150.3 symbols/min [2025-09-24T22:16:59.361450] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:59.380684] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:59.384022] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13451 primary records. [2025-09-24T22:16:59.384331] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-24T22:16:59.389611] [DEBUG] [LOCAL ] BGSF: Loaded 6821 existing records from primary storage. [2025-09-24T22:16:59.390170] [INFO ] [MAIN ] BGSF: Loaded 6821 primary data records. [2025-09-24T22:16:59.597709] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-09-24T22:16:59.721589] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-24T22:16:59.734850] [INFO ] [MAIN ] Derivative Progress: 203/2075 symbols completed. BGR took 1.5s. Estimated remaining: 12m 27s. Rate: 150.4 symbols/min [2025-09-24T22:16:59.742956] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:59.750387] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:16:59.752688] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50445 primary records. [2025-09-24T22:16:59.753577] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-24T22:16:59.786172] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-24T22:16:59.786803] [DEBUG] [LOCAL ] BGT: Loaded 16560 existing records from primary storage. [2025-09-24T22:16:59.787016] [INFO ] [MAIN ] BGT: Loaded 16560 primary data records. [2025-09-24T22:16:59.787110] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-24T22:16:59.790080] [INFO ] [MAIN ] Derivative Progress: 204/2075 symbols completed. BGS took 1.5s. Estimated remaining: 12m 23s. Rate: 151.0 symbols/min [2025-09-24T22:16:59.795675] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:16:59.918969] [DEBUG] [LOCAL ] BGX: Loaded 10704 existing records from primary storage. [2025-09-24T22:16:59.942805] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:16:59.975039] [INFO ] [MAIN ] BGSF: Generated 1792 derivative records from 6821 primary records. [2025-09-24T22:16:59.953116] [INFO ] [MAIN ] BGX: Loaded 10704 primary data records. [2025-09-24T22:17:00.016453] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-24T22:17:00.391670] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1792 records). [2025-09-24T22:17:00.514355] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-24T22:17:00.528391] [INFO ] [MAIN ] Derivative Progress: 205/2075 symbols completed. BGSF took 1.2s. Estimated remaining: 12m 26s. Rate: 150.4 symbols/min [2025-09-24T22:17:00.529472] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:00.562438] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:00.563610] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16560 primary records. [2025-09-24T22:17:00.563917] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-24T22:17:00.586348] [DEBUG] [LOCAL ] BGY: Loaded 22545 existing records from primary storage. [2025-09-24T22:17:00.588053] [INFO ] [MAIN ] BGY: Loaded 22545 primary data records. [2025-09-24T22:17:00.660292] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-24T22:17:00.682995] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-24T22:17:00.704426] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:00.719679] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10704 primary records. [2025-09-24T22:17:00.714946] [INFO ] [MAIN ] Derivative Progress: 206/2075 symbols completed. BGT took 1.0s. Estimated remaining: 12m 24s. Rate: 150.8 symbols/min [2025-09-24T22:17:00.719909] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-24T22:17:00.720631] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:00.979254] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-24T22:17:00.979433] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-24T22:17:00.981987] [INFO ] [MAIN ] Derivative Progress: 207/2075 symbols completed. BGX took 1.2s. Estimated remaining: 12m 22s. Rate: 151.0 symbols/min [2025-09-24T22:17:00.982540] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:01.048304] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:01.049577] [DEBUG] [LOCAL ] BHC: Loaded 46794 existing records from primary storage. [2025-09-24T22:17:01.049809] [INFO ] [MAIN ] BHC: Loaded 46794 primary data records. [2025-09-24T22:17:01.050294] [DEBUG] [LOCAL ] BHE: Loaded 25094 existing records from primary storage. [2025-09-24T22:17:01.051169] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22545 primary records. [2025-09-24T22:17:01.051608] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-24T22:17:01.051504] [INFO ] [MAIN ] BHE: Loaded 25094 primary data records. [2025-09-24T22:17:01.408702] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-24T22:17:01.534362] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-24T22:17:01.543574] [INFO ] [MAIN ] Derivative Progress: 208/2075 symbols completed. BGY took 1.0s. Estimated remaining: 12m 23s. Rate: 150.7 symbols/min [2025-09-24T22:17:01.800954] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:01.802110] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46794 primary records. [2025-09-24T22:17:01.802464] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-24T22:17:01.823415] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-09-24T22:17:01.836534] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-24T22:17:01.838908] [INFO ] [MAIN ] Derivative Progress: 209/2075 symbols completed. BHC took 1.1s. Estimated remaining: 12m 22s. Rate: 150.9 symbols/min [2025-09-24T22:17:01.839297] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:01.840083] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 25094 primary records. [2025-09-24T22:17:01.840153] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-24T22:17:01.857637] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-24T22:17:01.857814] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-24T22:17:01.861285] [INFO ] [MAIN ] Derivative Progress: 210/2075 symbols completed. BHE took 0.9s. Estimated remaining: 12m 18s. Rate: 151.6 symbols/min [2025-09-24T22:17:01.863357] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:01.863443] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:01.863118] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:01.903518] [DEBUG] [LOCAL ] BHR: Loaded 21489 existing records from primary storage. [2025-09-24T22:17:01.904406] [DEBUG] [LOCAL ] BHK: Loaded 22541 existing records from primary storage. [2025-09-24T22:17:01.904714] [INFO ] [MAIN ] BHK: Loaded 22541 primary data records. [2025-09-24T22:17:01.904955] [INFO ] [MAIN ] BHR: Loaded 21489 primary data records. [2025-09-24T22:17:02.324232] [DEBUG] [LOCAL ] BHP: Loaded 53374 existing records from primary storage. [2025-09-24T22:17:02.549518] [INFO ] [MAIN ] BHP: Loaded 53374 primary data records. [2025-09-24T22:17:02.999338] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:03.017628] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21489 primary records. [2025-09-24T22:17:03.016828] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:03.018786] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22541 primary records. [2025-09-24T22:17:03.019102] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-24T22:17:03.019171] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-24T22:17:03.060276] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-24T22:17:03.067540] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-24T22:17:03.084296] [DEBUG] [MAIN ] BHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:03.083291] [INFO ] [MAIN ] Derivative Progress: 211/2075 symbols completed. BHK took 1.2s. Estimated remaining: 12m 25s. Rate: 150.1 symbols/min [2025-09-24T22:17:03.086045] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53374 primary records. [2025-09-24T22:17:03.086273] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-24T22:17:03.086953] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:03.084998] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-24T22:17:03.087509] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-24T22:17:03.090957] [INFO ] [MAIN ] Derivative Progress: 212/2075 symbols completed. BHR took 1.2s. Estimated remaining: 12m 21s. Rate: 150.8 symbols/min [2025-09-24T22:17:03.098593] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:03.112533] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-24T22:17:03.112876] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-24T22:17:03.116567] [INFO ] [MAIN ] Derivative Progress: 213/2075 symbols completed. BHP took 1.3s. Estimated remaining: 12m 18s. Rate: 151.5 symbols/min [2025-09-24T22:17:03.117020] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:03.194515] [DEBUG] [LOCAL ] BIO: Loaded 25314 existing records from primary storage. [2025-09-24T22:17:03.193312] [DEBUG] [LOCAL ] BHVN: Loaded 49636 existing records from primary storage. [2025-09-24T22:17:03.194849] [INFO ] [MAIN ] BIO: Loaded 25314 primary data records. [2025-09-24T22:17:03.195145] [INFO ] [MAIN ] BHVN: Loaded 49636 primary data records. [2025-09-24T22:17:03.284089] [DEBUG] [LOCAL ] BILL: Loaded 52325 existing records from primary storage. [2025-09-24T22:17:03.337536] [INFO ] [MAIN ] BILL: Loaded 52325 primary data records. [2025-09-24T22:17:04.308078] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:04.309206] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25314 primary records. [2025-09-24T22:17:04.317504] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-24T22:17:04.338122] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:04.351111] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49636 primary records. [2025-09-24T22:17:04.351462] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-24T22:17:04.350384] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:04.353156] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52325 primary records. [2025-09-24T22:17:04.354332] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-24T22:17:04.386605] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-09-24T22:17:04.388056] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-24T22:17:04.390406] [INFO ] [MAIN ] Derivative Progress: 214/2075 symbols completed. BILL took 1.3s. Estimated remaining: 12m 25s. Rate: 149.9 symbols/min [2025-09-24T22:17:04.391739] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:04.391826] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-24T22:17:04.394828] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-24T22:17:04.396579] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-24T22:17:04.399258] [INFO ] [MAIN ] Derivative Progress: 215/2075 symbols completed. BIO took 1.3s. Estimated remaining: 12m 21s. Rate: 150.6 symbols/min [2025-09-24T22:17:04.399875] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:04.399471] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-24T22:17:04.402456] [INFO ] [MAIN ] Derivative Progress: 216/2075 symbols completed. BHVN took 1.3s. Estimated remaining: 12m 17s. Rate: 151.3 symbols/min [2025-09-24T22:17:04.403274] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:04.411374] [DEBUG] [LOCAL ] BIPJ: Loaded 2962 existing records from primary storage. [2025-09-24T22:17:04.411621] [INFO ] [MAIN ] BIPJ: Loaded 2962 primary data records. [2025-09-24T22:17:04.437047] [DEBUG] [LOCAL ] BIPI: Loaded 3248 existing records from primary storage. [2025-09-24T22:17:04.454631] [INFO ] [MAIN ] BIPI: Loaded 3248 primary data records. [2025-09-24T22:17:04.984443] [DEBUG] [LOCAL ] BIPC: Loaded 41668 existing records from primary storage. [2025-09-24T22:17:05.091126] [INFO ] [MAIN ] BIPC: Loaded 41668 primary data records. [2025-09-24T22:17:05.529052] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:05.529454] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:05.530943] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 2962 primary records. [2025-09-24T22:17:05.531705] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3248 primary records. [2025-09-24T22:17:05.532184] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-24T22:17:05.532398] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-24T22:17:05.565265] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-24T22:17:05.566958] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-24T22:17:05.571493] [INFO ] [MAIN ] Derivative Progress: 217/2075 symbols completed. BIPI took 1.2s. Estimated remaining: 12m 23s. Rate: 149.9 symbols/min [2025-09-24T22:17:05.573082] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:05.575917] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-09-24T22:17:05.576284] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-24T22:17:05.581325] [INFO ] [MAIN ] Derivative Progress: 218/2075 symbols completed. BIPJ took 1.2s. Estimated remaining: 12m 20s. Rate: 150.6 symbols/min [2025-09-24T22:17:05.582038] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:05.602473] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:05.603548] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41668 primary records. [2025-09-24T22:17:05.603703] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-24T22:17:05.621497] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-24T22:17:05.621749] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-24T22:17:05.624351] [INFO ] [MAIN ] Derivative Progress: 219/2075 symbols completed. BIPC took 1.2s. Estimated remaining: 12m 16s. Rate: 151.2 symbols/min [2025-09-24T22:17:05.631576] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:05.657834] [DEBUG] [LOCAL ] BIT: Loaded 22357 existing records from primary storage. [2025-09-24T22:17:05.657994] [INFO ] [MAIN ] BIT: Loaded 22357 primary data records. [2025-09-24T22:17:05.786908] [DEBUG] [LOCAL ] BIRK: Loaded 50906 existing records from primary storage. [2025-09-24T22:17:05.792206] [INFO ] [MAIN ] BIRK: Loaded 50906 primary data records. [2025-09-24T22:17:06.200259] [DEBUG] [LOCAL ] BJ: Loaded 51395 existing records from primary storage. [2025-09-24T22:17:06.224488] [INFO ] [MAIN ] BJ: Loaded 51395 primary data records. [2025-09-24T22:17:06.750765] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:06.754555] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22357 primary records. [2025-09-24T22:17:06.755522] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-24T22:17:06.796170] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:06.795744] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-24T22:17:06.798066] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50906 primary records. [2025-09-24T22:17:06.798289] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-24T22:17:06.798420] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-24T22:17:06.801931] [INFO ] [MAIN ] Derivative Progress: 220/2075 symbols completed. BIT took 1.2s. Estimated remaining: 12m 23s. Rate: 149.9 symbols/min [2025-09-24T22:17:06.814349] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:06.829540] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-24T22:17:06.830683] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-24T22:17:06.833925] [INFO ] [MAIN ] Derivative Progress: 221/2075 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 19s. Rate: 150.5 symbols/min [2025-09-24T22:17:06.836128] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:06.851289] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:06.852087] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51395 primary records. [2025-09-24T22:17:06.852210] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-24T22:17:06.885137] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-09-24T22:17:06.885467] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-24T22:17:06.887843] [INFO ] [MAIN ] Derivative Progress: 222/2075 symbols completed. BJ took 1.3s. Estimated remaining: 12m 16s. Rate: 151.1 symbols/min [2025-09-24T22:17:06.888191] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:06.926223] [DEBUG] [LOCAL ] BK: Loaded 53553 existing records from primary storage. [2025-09-24T22:17:06.926552] [INFO ] [MAIN ] BK: Loaded 53553 primary data records. [2025-09-24T22:17:07.110812] [DEBUG] [LOCAL ] BKE: Loaded 34750 existing records from primary storage. [2025-09-24T22:17:07.099108] [DEBUG] [LOCAL ] BKD: Loaded 50137 existing records from primary storage. [2025-09-24T22:17:07.126707] [INFO ] [MAIN ] BKD: Loaded 50137 primary data records. [2025-09-24T22:17:07.126858] [INFO ] [MAIN ] BKE: Loaded 34750 primary data records. [2025-09-24T22:17:08.102118] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:08.103359] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53553 primary records. [2025-09-24T22:17:08.103884] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-24T22:17:08.122152] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-24T22:17:08.122529] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-24T22:17:08.124675] [INFO ] [MAIN ] Derivative Progress: 223/2075 symbols completed. BK took 1.3s. Estimated remaining: 12m 22s. Rate: 149.7 symbols/min [2025-09-24T22:17:08.143569] [DEBUG] [MAIN ] BKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:08.155604] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:08.156288] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34750 primary records. [2025-09-24T22:17:08.156392] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-24T22:17:08.156976] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50137 primary records. [2025-09-24T22:17:08.157607] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-24T22:17:08.184984] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-24T22:17:08.185235] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-24T22:17:08.188022] [INFO ] [MAIN ] Derivative Progress: 224/2075 symbols completed. BKD took 1.4s. Estimated remaining: 12m 19s. Rate: 150.3 symbols/min [2025-09-24T22:17:08.190688] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-09-24T22:17:08.190773] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-24T22:17:08.195465] [INFO ] [MAIN ] Derivative Progress: 225/2075 symbols completed. BKE took 1.3s. Estimated remaining: 12m 16s. Rate: 150.9 symbols/min [2025-09-24T22:17:08.196246] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:08.196404] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:08.196325] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:08.214045] [DEBUG] [LOCAL ] BKN: Loaded 7731 existing records from primary storage. [2025-09-24T22:17:08.214174] [INFO ] [MAIN ] BKN: Loaded 7731 primary data records. [2025-09-24T22:17:08.413395] [DEBUG] [LOCAL ] BKKT: Loaded 34400 existing records from primary storage. [2025-09-24T22:17:08.443920] [INFO ] [MAIN ] BKKT: Loaded 34400 primary data records. [2025-09-24T22:17:08.438263] [DEBUG] [LOCAL ] BKH: Loaded 36608 existing records from primary storage. [2025-09-24T22:17:08.588805] [INFO ] [MAIN ] BKH: Loaded 36608 primary data records. [2025-09-24T22:17:09.295637] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:09.296879] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7731 primary records. [2025-09-24T22:17:09.297355] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-24T22:17:09.316494] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-24T22:17:09.317010] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-24T22:17:09.320271] [INFO ] [MAIN ] Derivative Progress: 226/2075 symbols completed. BKN took 1.1s. Estimated remaining: 12m 21s. Rate: 149.7 symbols/min [2025-09-24T22:17:09.320835] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:09.338500] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:09.339226] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 34400 primary records. [2025-09-24T22:17:09.339418] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-24T22:17:09.358220] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-24T22:17:09.358387] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-24T22:17:09.360932] [INFO ] [MAIN ] Derivative Progress: 227/2075 symbols completed. BKKT took 1.2s. Estimated remaining: 12m 18s. Rate: 150.3 symbols/min [2025-09-24T22:17:09.361595] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:09.376202] [DEBUG] [MAIN ] BKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:09.377416] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36608 primary records. [2025-09-24T22:17:09.377589] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-24T22:17:09.403723] [DEBUG] [LOCAL ] BKT: Loaded 10910 existing records from primary storage. [2025-09-24T22:17:09.405635] [INFO ] [MAIN ] BKT: Loaded 10910 primary data records. [2025-09-24T22:17:09.474778] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-24T22:17:09.483976] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-24T22:17:09.498949] [INFO ] [MAIN ] Derivative Progress: 228/2075 symbols completed. BKH took 1.3s. Estimated remaining: 12m 15s. Rate: 150.7 symbols/min [2025-09-24T22:17:09.516353] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:09.544742] [DEBUG] [LOCAL ] BKSY: Loaded 48281 existing records from primary storage. [2025-09-24T22:17:09.555343] [INFO ] [MAIN ] BKSY: Loaded 48281 primary data records. [2025-09-24T22:17:10.145105] [DEBUG] [LOCAL ] BKU: Loaded 41905 existing records from primary storage. [2025-09-24T22:17:10.162266] [INFO ] [MAIN ] BKU: Loaded 41905 primary data records. [2025-09-24T22:17:10.493580] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:10.495138] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 10910 primary records. [2025-09-24T22:17:10.495318] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-24T22:17:10.530155] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:10.531524] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48281 primary records. [2025-09-24T22:17:10.531620] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-24T22:17:10.532923] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-24T22:17:10.533179] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-24T22:17:10.536277] [INFO ] [MAIN ] Derivative Progress: 229/2075 symbols completed. BKT took 1.2s. Estimated remaining: 12m 20s. Rate: 149.7 symbols/min [2025-09-24T22:17:10.537283] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:10.554112] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-24T22:17:10.554238] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-24T22:17:10.556834] [INFO ] [MAIN ] Derivative Progress: 230/2075 symbols completed. BKSY took 1.2s. Estimated remaining: 12m 17s. Rate: 150.3 symbols/min [2025-09-24T22:17:10.557614] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:10.574504] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:10.575272] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41905 primary records. [2025-09-24T22:17:10.575377] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-24T22:17:10.600941] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-24T22:17:10.601077] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-24T22:17:10.604063] [INFO ] [MAIN ] Derivative Progress: 231/2075 symbols completed. BKU took 1.1s. Estimated remaining: 12m 13s. Rate: 150.9 symbols/min [2025-09-24T22:17:10.604492] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:10.627335] [DEBUG] [LOCAL ] BKV: Loaded 29686 existing records from primary storage. [2025-09-24T22:17:10.627694] [INFO ] [MAIN ] BKV: Loaded 29686 primary data records. [2025-09-24T22:17:10.738536] [DEBUG] [LOCAL ] BLCO: Loaded 35617 existing records from primary storage. [2025-09-24T22:17:10.764801] [INFO ] [MAIN ] BLCO: Loaded 35617 primary data records. [2025-09-24T22:17:10.793303] [DEBUG] [LOCAL ] BLD: Loaded 28097 existing records from primary storage. [2025-09-24T22:17:10.872735] [INFO ] [MAIN ] BLD: Loaded 28097 primary data records. [2025-09-24T22:17:11.717304] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:11.718316] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29686 primary records. [2025-09-24T22:17:11.718605] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-24T22:17:11.752320] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-24T22:17:11.752245] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:11.752691] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-24T22:17:11.753515] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35617 primary records. [2025-09-24T22:17:11.755914] [INFO ] [MAIN ] Derivative Progress: 232/2075 symbols completed. BKV took 1.2s. Estimated remaining: 12m 19s. Rate: 149.7 symbols/min [2025-09-24T22:17:11.753708] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-24T22:17:11.757274] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:11.778054] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-24T22:17:11.778447] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-24T22:17:11.781133] [INFO ] [MAIN ] Derivative Progress: 233/2075 symbols completed. BLCO took 1.2s. Estimated remaining: 12m 16s. Rate: 150.3 symbols/min [2025-09-24T22:17:11.781413] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:11.795422] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:11.796622] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 28097 primary records. [2025-09-24T22:17:11.796831] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-24T22:17:11.825905] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-24T22:17:11.826711] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-24T22:17:11.829694] [INFO ] [MAIN ] Derivative Progress: 234/2075 symbols completed. BLD took 1.2s. Estimated remaining: 12m 12s. Rate: 150.8 symbols/min [2025-09-24T22:17:11.829965] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:11.826622] [DEBUG] [LOCAL ] BLE: Loaded 14568 existing records from primary storage. [2025-09-24T22:17:11.830292] [INFO ] [MAIN ] BLE: Loaded 14568 primary data records. [2025-09-24T22:17:12.183101] [DEBUG] [LOCAL ] BLDR: Loaded 51664 existing records from primary storage. [2025-09-24T22:17:12.183475] [INFO ] [MAIN ] BLDR: Loaded 51664 primary data records. [2025-09-24T22:17:12.307537] [DEBUG] [LOCAL ] BLK: Loaded 34754 existing records from primary storage. [2025-09-24T22:17:12.323615] [INFO ] [MAIN ] BLK: Loaded 34754 primary data records. [2025-09-24T22:17:12.832998] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:12.833791] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14568 primary records. [2025-09-24T22:17:12.834042] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-24T22:17:12.853701] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-24T22:17:12.854375] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-24T22:17:12.857735] [INFO ] [MAIN ] Derivative Progress: 235/2075 symbols completed. BLE took 1.1s. Estimated remaining: 12m 17s. Rate: 149.8 symbols/min [2025-09-24T22:17:12.857999] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:12.880577] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:12.881462] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51664 primary records. [2025-09-24T22:17:12.881672] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-24T22:17:12.899059] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-24T22:17:12.899472] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-24T22:17:12.901702] [INFO ] [MAIN ] Derivative Progress: 236/2075 symbols completed. BLDR took 1.1s. Estimated remaining: 12m 14s. Rate: 150.4 symbols/min [2025-09-24T22:17:12.901987] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:12.918513] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:12.919261] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34754 primary records. [2025-09-24T22:17:12.919428] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-24T22:17:12.954163] [DEBUG] [LOCAL ] BLW: Loaded 12773 existing records from primary storage. [2025-09-24T22:17:12.954756] [INFO ] [MAIN ] BLW: Loaded 12773 primary data records. [2025-09-24T22:17:12.994510] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-24T22:17:13.016188] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-24T22:17:13.058637] [INFO ] [MAIN ] Derivative Progress: 237/2075 symbols completed. BLK took 1.2s. Estimated remaining: 12m 11s. Rate: 150.8 symbols/min [2025-09-24T22:17:13.074437] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:13.088445] [DEBUG] [LOCAL ] BLND: Loaded 49442 existing records from primary storage. [2025-09-24T22:17:13.089219] [INFO ] [MAIN ] BLND: Loaded 49442 primary data records. [2025-09-24T22:17:13.399101] [DEBUG] [LOCAL ] BLX: Loaded 15678 existing records from primary storage. [2025-09-24T22:17:13.403181] [INFO ] [MAIN ] BLX: Loaded 15678 primary data records. [2025-09-24T22:17:13.975099] [DEBUG] [MAIN ] BLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:13.976025] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12773 primary records. [2025-09-24T22:17:13.976820] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-24T22:17:13.995988] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-24T22:17:13.996138] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-24T22:17:13.998483] [INFO ] [MAIN ] Derivative Progress: 238/2075 symbols completed. BLW took 1.1s. Estimated remaining: 12m 15s. Rate: 149.9 symbols/min [2025-09-24T22:17:14.013716] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:14.014479] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49442 primary records. [2025-09-24T22:17:14.014622] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-24T22:17:14.045058] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-09-24T22:17:14.044994] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:14.045191] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-24T22:17:14.045908] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15678 primary records. [2025-09-24T22:17:14.048161] [INFO ] [MAIN ] Derivative Progress: 239/2075 symbols completed. BLND took 1.2s. Estimated remaining: 12m 12s. Rate: 150.5 symbols/min [2025-09-24T22:17:14.048397] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-24T22:17:14.063599] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-24T22:17:14.063689] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-24T22:17:14.066264] [INFO ] [MAIN ] Derivative Progress: 240/2075 symbols completed. BLX took 1.0s. Estimated remaining: 12m 9s. Rate: 151.1 symbols/min [2025-09-24T22:17:14.066775] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:14.067114] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:14.067158] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:14.079966] [DEBUG] [LOCAL ] BME: Loaded 10831 existing records from primary storage. [2025-09-24T22:17:14.080099] [INFO ] [MAIN ] BME: Loaded 10831 primary data records. [2025-09-24T22:17:14.284409] [DEBUG] [LOCAL ] BMEZ: Loaded 26022 existing records from primary storage. [2025-09-24T22:17:14.394933] [INFO ] [MAIN ] BMEZ: Loaded 26022 primary data records. [2025-09-24T22:17:14.457153] [DEBUG] [LOCAL ] BMA: Loaded 35033 existing records from primary storage. [2025-09-24T22:17:14.472802] [INFO ] [MAIN ] BMA: Loaded 35033 primary data records. [2025-09-24T22:17:15.069998] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:15.071287] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10831 primary records. [2025-09-24T22:17:15.071400] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-24T22:17:15.092265] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-24T22:17:15.092410] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-24T22:17:15.094948] [INFO ] [MAIN ] Derivative Progress: 241/2075 symbols completed. BME took 1.0s. Estimated remaining: 12m 13s. Rate: 150.1 symbols/min [2025-09-24T22:17:15.095366] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:15.123114] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:15.128402] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:15.129219] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35033 primary records. [2025-09-24T22:17:15.129869] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26022 primary records. [2025-09-24T22:17:15.135802] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-24T22:17:15.135881] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-24T22:17:15.167168] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-24T22:17:15.175546] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-24T22:17:15.179151] [INFO ] [MAIN ] Derivative Progress: 242/2075 symbols completed. BMA took 1.1s. Estimated remaining: 12m 10s. Rate: 150.6 symbols/min [2025-09-24T22:17:15.179464] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:15.181370] [DEBUG] [LOCAL ] BMI: Loaded 24210 existing records from primary storage. [2025-09-24T22:17:15.180486] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-24T22:17:15.181853] [INFO ] [MAIN ] BMI: Loaded 24210 primary data records. [2025-09-24T22:17:15.181917] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-24T22:17:15.185073] [INFO ] [MAIN ] Derivative Progress: 243/2075 symbols completed. BMEZ took 1.1s. Estimated remaining: 12m 7s. Rate: 151.2 symbols/min [2025-09-24T22:17:15.219478] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:15.272492] [DEBUG] [LOCAL ] BMN: Loaded 2520 existing records from primary storage. [2025-09-24T22:17:15.290997] [INFO ] [MAIN ] BMN: Loaded 2520 primary data records. [2025-09-24T22:17:15.875811] [DEBUG] [LOCAL ] BMO: Loaded 41316 existing records from primary storage. [2025-09-24T22:17:15.876019] [INFO ] [MAIN ] BMO: Loaded 41316 primary data records. [2025-09-24T22:17:16.215719] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:16.216807] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24210 primary records. [2025-09-24T22:17:16.217090] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-24T22:17:16.252024] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:16.253602] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2520 primary records. [2025-09-24T22:17:16.255055] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-24T22:17:16.255574] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-24T22:17:16.255718] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-24T22:17:16.265058] [INFO ] [MAIN ] Derivative Progress: 244/2075 symbols completed. BMI took 1.2s. Estimated remaining: 12m 12s. Rate: 150.1 symbols/min [2025-09-24T22:17:16.269871] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:16.273538] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-09-24T22:17:16.273842] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-24T22:17:16.276772] [INFO ] [MAIN ] Derivative Progress: 245/2075 symbols completed. BMN took 1.1s. Estimated remaining: 12m 9s. Rate: 150.7 symbols/min [2025-09-24T22:17:16.277296] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:16.296077] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:16.296958] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41316 primary records. [2025-09-24T22:17:16.297077] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-24T22:17:16.314263] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-24T22:17:16.314511] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-24T22:17:16.317481] [INFO ] [MAIN ] Derivative Progress: 246/2075 symbols completed. BMO took 1.1s. Estimated remaining: 12m 5s. Rate: 151.3 symbols/min [2025-09-24T22:17:16.317906] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:16.395629] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-24T22:17:16.396984] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-24T22:17:16.417773] [DEBUG] [LOCAL ] BN: Loaded 52994 existing records from primary storage. [2025-09-24T22:17:16.440462] [INFO ] [MAIN ] BN: Loaded 52994 primary data records. [2025-09-24T22:17:16.477561] [DEBUG] [LOCAL ] BNED: Loaded 29914 existing records from primary storage. [2025-09-24T22:17:16.524768] [INFO ] [MAIN ] BNED: Loaded 29914 primary data records. [2025-09-24T22:17:17.372029] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:17.392474] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52994 primary records. [2025-09-24T22:17:17.398010] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:17.398283] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-24T22:17:17.399987] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-24T22:17:17.400322] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:17.400422] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-24T22:17:17.401117] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29914 primary records. [2025-09-24T22:17:17.401918] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-24T22:17:17.445811] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-24T22:17:17.444931] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-24T22:17:17.446487] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-24T22:17:17.449822] [INFO ] [MAIN ] Derivative Progress: 247/2075 symbols completed. BN took 1.2s. Estimated remaining: 12m 11s. Rate: 150.1 symbols/min [2025-09-24T22:17:17.446415] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-24T22:17:17.453844] [INFO ] [MAIN ] Derivative Progress: 248/2075 symbols completed. BNED took 1.1s. Estimated remaining: 12m 7s. Rate: 150.7 symbols/min [2025-09-24T22:17:17.450854] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:17.454336] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:17.460121] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-24T22:17:17.460337] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-24T22:17:17.462419] [INFO ] [MAIN ] Derivative Progress: 249/2075 symbols completed. BMY took 1.2s. Estimated remaining: 12m 4s. Rate: 151.3 symbols/min [2025-09-24T22:17:17.462761] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:17.465873] [DEBUG] [LOCAL ] BNJ: Loaded 2584 existing records from primary storage. [2025-09-24T22:17:17.468475] [INFO ] [MAIN ] BNJ: Loaded 2584 primary data records. [2025-09-24T22:17:17.468408] [DEBUG] [LOCAL ] BNH: Loaded 4826 existing records from primary storage. [2025-09-24T22:17:17.468575] [INFO ] [MAIN ] BNH: Loaded 4826 primary data records. [2025-09-24T22:17:18.168688] [DEBUG] [LOCAL ] BNL: Loaded 46864 existing records from primary storage. [2025-09-24T22:17:18.170155] [INFO ] [MAIN ] BNL: Loaded 46864 primary data records. [2025-09-24T22:17:18.505044] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:18.518319] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4826 primary records. [2025-09-24T22:17:18.518452] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-24T22:17:18.519784] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:18.528589] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2584 primary records. [2025-09-24T22:17:18.534419] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-24T22:17:18.536313] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-24T22:17:18.536584] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-24T22:17:18.545406] [INFO ] [MAIN ] Derivative Progress: 250/2075 symbols completed. BNH took 1.1s. Estimated remaining: 12m 9s. Rate: 150.3 symbols/min [2025-09-24T22:17:18.549898] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:18.554026] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-24T22:17:18.554500] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-24T22:17:18.557138] [INFO ] [MAIN ] Derivative Progress: 251/2075 symbols completed. BNJ took 1.1s. Estimated remaining: 12m 5s. Rate: 150.9 symbols/min [2025-09-24T22:17:18.557675] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:18.562602] [DEBUG] [LOCAL ] BNT: Loaded 3412 existing records from primary storage. [2025-09-24T22:17:18.563153] [INFO ] [MAIN ] BNT: Loaded 3412 primary data records. [2025-09-24T22:17:18.656409] [DEBUG] [LOCAL ] BNY: Loaded 7382 existing records from primary storage. [2025-09-24T22:17:18.673449] [INFO ] [MAIN ] BNY: Loaded 7382 primary data records. [2025-09-24T22:17:18.848481] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:18.980060] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46864 primary records. [2025-09-24T22:17:18.980728] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-24T22:17:19.201962] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-24T22:17:19.202815] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-24T22:17:19.207051] [INFO ] [MAIN ] Derivative Progress: 252/2075 symbols completed. BNL took 1.7s. Estimated remaining: 12m 7s. Rate: 150.5 symbols/min [2025-09-24T22:17:19.208296] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:19.237995] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:19.240307] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3412 primary records. [2025-09-24T22:17:19.247235] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-24T22:17:19.247619] [DEBUG] [LOCAL ] BOC: Loaded 18381 existing records from primary storage. [2025-09-24T22:17:19.254952] [INFO ] [MAIN ] BOC: Loaded 18381 primary data records. [2025-09-24T22:17:19.324600] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:19.336284] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7382 primary records. [2025-09-24T22:17:19.345983] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-24T22:17:19.336401] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-24T22:17:19.377307] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-24T22:17:19.379786] [INFO ] [MAIN ] Derivative Progress: 253/2075 symbols completed. BNT took 0.8s. Estimated remaining: 12m 5s. Rate: 150.8 symbols/min [2025-09-24T22:17:19.407740] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-24T22:17:19.418511] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-24T22:17:19.426083] [INFO ] [MAIN ] Derivative Progress: 254/2075 symbols completed. BNY took 0.9s. Estimated remaining: 12m 2s. Rate: 151.4 symbols/min [2025-09-24T22:17:19.622627] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:19.623377] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18381 primary records. [2025-09-24T22:17:19.623442] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-24T22:17:19.638974] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-24T22:17:19.639051] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-24T22:17:19.641281] [INFO ] [MAIN ] Derivative Progress: 255/2075 symbols completed. BOC took 0.4s. Estimated remaining: 12m 0s. Rate: 151.6 symbols/min [2025-09-24T22:17:19.641958] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:19.642072] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:19.643007] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:19.663754] [DEBUG] [LOCAL ] BOE: Loaded 17572 existing records from primary storage. [2025-09-24T22:17:19.663919] [INFO ] [MAIN ] BOE: Loaded 17572 primary data records. [2025-09-24T22:17:19.805981] [DEBUG] [LOCAL ] BOND: Loaded 32119 existing records from primary storage. [2025-09-24T22:17:19.805086] [DEBUG] [LOCAL ] BOH: Loaded 31331 existing records from primary storage. [2025-09-24T22:17:19.811523] [INFO ] [MAIN ] BOH: Loaded 31331 primary data records. [2025-09-24T22:17:19.811681] [INFO ] [MAIN ] BOND: Loaded 32119 primary data records. [2025-09-24T22:17:20.742507] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:20.743336] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17572 primary records. [2025-09-24T22:17:20.743777] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-24T22:17:20.766125] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-24T22:17:20.766403] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-24T22:17:20.776335] [INFO ] [MAIN ] Derivative Progress: 256/2075 symbols completed. BOE took 1.1s. Estimated remaining: 12m 5s. Rate: 150.5 symbols/min [2025-09-24T22:17:20.777026] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:20.790402] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:20.796485] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 31331 primary records. [2025-09-24T22:17:20.796875] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-24T22:17:20.798335] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:20.810204] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32119 primary records. [2025-09-24T22:17:20.812634] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-24T22:17:20.823341] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-24T22:17:20.823485] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-24T22:17:20.826308] [INFO ] [MAIN ] Derivative Progress: 257/2075 symbols completed. BOH took 1.2s. Estimated remaining: 12m 2s. Rate: 151.0 symbols/min [2025-09-24T22:17:20.830877] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:20.836509] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-09-24T22:17:20.836879] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-24T22:17:20.839444] [INFO ] [MAIN ] Derivative Progress: 258/2075 symbols completed. BOND took 1.2s. Estimated remaining: 11m 59s. Rate: 151.6 symbols/min [2025-09-24T22:17:20.840014] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:20.884021] [DEBUG] [LOCAL ] BOOT: Loaded 40846 existing records from primary storage. [2025-09-24T22:17:20.884227] [INFO ] [MAIN ] BOOT: Loaded 40846 primary data records. [2025-09-24T22:17:20.905333] [DEBUG] [LOCAL ] BOW: Loaded 23628 existing records from primary storage. [2025-09-24T22:17:20.905683] [INFO ] [MAIN ] BOW: Loaded 23628 primary data records. [2025-09-24T22:17:21.149740] [DEBUG] [LOCAL ] BORR: Loaded 51165 existing records from primary storage. [2025-09-24T22:17:21.233897] [INFO ] [MAIN ] BORR: Loaded 51165 primary data records. [2025-09-24T22:17:21.966370] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:21.968439] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40846 primary records. [2025-09-24T22:17:21.968555] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-24T22:17:21.967481] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:21.979063] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23628 primary records. [2025-09-24T22:17:21.986546] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-24T22:17:21.987932] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-24T22:17:21.988287] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-24T22:17:21.990469] [INFO ] [MAIN ] Derivative Progress: 259/2075 symbols completed. BOOT took 1.2s. Estimated remaining: 12m 4s. Rate: 150.5 symbols/min [2025-09-24T22:17:21.991148] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:22.019131] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-24T22:17:22.031637] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-24T22:17:22.034450] [INFO ] [MAIN ] Derivative Progress: 260/2075 symbols completed. BOW took 1.2s. Estimated remaining: 12m 1s. Rate: 151.0 symbols/min [2025-09-24T22:17:22.034990] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:22.036035] [DEBUG] [MAIN ] BORR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:22.036860] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51165 primary records. [2025-09-24T22:17:22.037037] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-24T22:17:22.066163] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-24T22:17:22.066329] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-24T22:17:22.069260] [INFO ] [MAIN ] Derivative Progress: 261/2075 symbols completed. BORR took 1.2s. Estimated remaining: 11m 58s. Rate: 151.6 symbols/min [2025-09-24T22:17:22.069751] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:22.087025] [DEBUG] [LOCAL ] BOX: Loaded 50296 existing records from primary storage. [2025-09-24T22:17:22.087277] [INFO ] [MAIN ] BOX: Loaded 50296 primary data records. [2025-09-24T22:17:22.437627] [DEBUG] [LOCAL ] BR: Loaded 34707 existing records from primary storage. [2025-09-24T22:17:22.437874] [INFO ] [MAIN ] BR: Loaded 34707 primary data records. [2025-09-24T22:17:22.439103] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-24T22:17:22.461329] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-24T22:17:23.095713] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:23.097240] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50296 primary records. [2025-09-24T22:17:23.098376] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-24T22:17:23.117617] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-24T22:17:23.118168] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-24T22:17:23.121727] [INFO ] [MAIN ] Derivative Progress: 262/2075 symbols completed. BOX took 1.1s. Estimated remaining: 12m 2s. Rate: 150.6 symbols/min [2025-09-24T22:17:23.122758] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:23.139850] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:23.153196] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34707 primary records. [2025-09-24T22:17:23.153513] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-24T22:17:23.153778] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:23.155185] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-24T22:17:23.155600] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-24T22:17:23.187996] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-24T22:17:23.188356] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-24T22:17:23.190932] [INFO ] [MAIN ] Derivative Progress: 263/2075 symbols completed. BR took 1.1s. Estimated remaining: 11m 60s. Rate: 151.1 symbols/min [2025-09-24T22:17:23.205285] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:23.191693] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-24T22:17:23.205730] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-24T22:17:23.209225] [INFO ] [MAIN ] Derivative Progress: 264/2075 symbols completed. BP took 1.2s. Estimated remaining: 11m 57s. Rate: 151.6 symbols/min [2025-09-24T22:17:23.210015] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:23.235213] [DEBUG] [LOCAL ] BRBR: Loaded 51234 existing records from primary storage. [2025-09-24T22:17:23.235480] [INFO ] [MAIN ] BRBR: Loaded 51234 primary data records. [2025-09-24T22:17:23.326006] [DEBUG] [LOCAL ] BRC: Loaded 19348 existing records from primary storage. [2025-09-24T22:17:23.358877] [INFO ] [MAIN ] BRC: Loaded 19348 primary data records. [2025-09-24T22:17:23.554134] [DEBUG] [LOCAL ] BRCC: Loaded 40396 existing records from primary storage. [2025-09-24T22:17:23.557673] [INFO ] [MAIN ] BRCC: Loaded 40396 primary data records. [2025-09-24T22:17:24.293992] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:24.295272] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51234 primary records. [2025-09-24T22:17:24.295492] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-24T22:17:24.319296] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-24T22:17:24.319449] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-24T22:17:24.321776] [INFO ] [MAIN ] Derivative Progress: 265/2075 symbols completed. BRBR took 1.2s. Estimated remaining: 12m 1s. Rate: 150.6 symbols/min [2025-09-24T22:17:24.330014] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:24.335867] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:24.336901] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19348 primary records. [2025-09-24T22:17:24.337103] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-24T22:17:24.367626] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:24.368923] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40396 primary records. [2025-09-24T22:17:24.369445] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-24T22:17:24.370482] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-24T22:17:24.370581] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-24T22:17:24.387208] [INFO ] [MAIN ] Derivative Progress: 266/2075 symbols completed. BRC took 1.2s. Estimated remaining: 11m 58s. Rate: 151.1 symbols/min [2025-09-24T22:17:24.390285] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:24.390010] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-24T22:17:24.390591] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-24T22:17:24.394572] [INFO ] [MAIN ] Derivative Progress: 267/2075 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 55s. Rate: 151.6 symbols/min [2025-09-24T22:17:24.395032] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:24.446620] [DEBUG] [LOCAL ] BRO: Loaded 51915 existing records from primary storage. [2025-09-24T22:17:24.446929] [INFO ] [MAIN ] BRO: Loaded 51915 primary data records. [2025-09-24T22:17:24.575036] [DEBUG] [LOCAL ] BRSP: Loaded 36996 existing records from primary storage. [2025-09-24T22:17:24.578508] [INFO ] [MAIN ] BRSP: Loaded 36996 primary data records. [2025-09-24T22:17:24.754269] [DEBUG] [LOCAL ] BROS: Loaded 53287 existing records from primary storage. [2025-09-24T22:17:24.783936] [INFO ] [MAIN ] BROS: Loaded 53287 primary data records. [2025-09-24T22:17:25.441837] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:25.442733] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51915 primary records. [2025-09-24T22:17:25.443043] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-24T22:17:25.473057] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-24T22:17:25.477776] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-24T22:17:25.480334] [INFO ] [MAIN ] Derivative Progress: 268/2075 symbols completed. BRO took 1.2s. Estimated remaining: 11m 60s. Rate: 150.6 symbols/min [2025-09-24T22:17:25.481031] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:25.482140] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36996 primary records. [2025-09-24T22:17:25.482446] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-24T22:17:25.500937] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-24T22:17:25.501765] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-24T22:17:25.504827] [INFO ] [MAIN ] Derivative Progress: 269/2075 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 57s. Rate: 151.2 symbols/min [2025-09-24T22:17:25.517517] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:25.518183] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53287 primary records. [2025-09-24T22:17:25.518246] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-24T22:17:25.533597] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-24T22:17:25.533682] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-24T22:17:25.536331] [INFO ] [MAIN ] Derivative Progress: 270/2075 symbols completed. BROS took 1.1s. Estimated remaining: 11m 54s. Rate: 151.7 symbols/min [2025-09-24T22:17:25.537101] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:25.537235] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:25.537415] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:25.546275] [DEBUG] [LOCAL ] BRT: Loaded 4967 existing records from primary storage. [2025-09-24T22:17:25.546467] [INFO ] [MAIN ] BRT: Loaded 4967 primary data records. [2025-09-24T22:17:25.663389] [DEBUG] [LOCAL ] BRW: Loaded 19261 existing records from primary storage. [2025-09-24T22:17:25.675297] [INFO ] [MAIN ] BRW: Loaded 19261 primary data records. [2025-09-24T22:17:26.132101] [DEBUG] [LOCAL ] BRX: Loaded 51773 existing records from primary storage. [2025-09-24T22:17:26.132501] [INFO ] [MAIN ] BRX: Loaded 51773 primary data records. [2025-09-24T22:17:26.619732] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:26.621915] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4967 primary records. [2025-09-24T22:17:26.622203] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-24T22:17:26.647885] [DEBUG] [MAIN ] BRW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:26.649715] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 19261 primary records. [2025-09-24T22:17:26.651393] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-24T22:17:26.654987] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-09-24T22:17:26.655175] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-24T22:17:26.658749] [INFO ] [MAIN ] Derivative Progress: 271/2075 symbols completed. BRT took 1.1s. Estimated remaining: 11m 58s. Rate: 150.7 symbols/min [2025-09-24T22:17:26.667789] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:26.692542] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-24T22:17:26.692153] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:26.692847] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-24T22:17:26.696358] [INFO ] [MAIN ] Derivative Progress: 272/2075 symbols completed. BRW took 1.2s. Estimated remaining: 11m 56s. Rate: 151.2 symbols/min [2025-09-24T22:17:26.693605] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51773 primary records. [2025-09-24T22:17:26.696789] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:26.697250] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-24T22:17:26.714075] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-24T22:17:26.714146] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-24T22:17:26.716873] [INFO ] [MAIN ] Derivative Progress: 273/2075 symbols completed. BRX took 1.2s. Estimated remaining: 11m 53s. Rate: 151.7 symbols/min [2025-09-24T22:17:26.717331] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:26.782448] [DEBUG] [LOCAL ] BSBR: Loaded 35185 existing records from primary storage. [2025-09-24T22:17:26.782752] [INFO ] [MAIN ] BSBR: Loaded 35185 primary data records. [2025-09-24T22:17:26.795395] [DEBUG] [LOCAL ] BSAC: Loaded 33027 existing records from primary storage. [2025-09-24T22:17:26.840571] [INFO ] [MAIN ] BSAC: Loaded 33027 primary data records. [2025-09-24T22:17:26.953883] [DEBUG] [LOCAL ] BSM: Loaded 32388 existing records from primary storage. [2025-09-24T22:17:26.994974] [INFO ] [MAIN ] BSM: Loaded 32388 primary data records. [2025-09-24T22:17:27.736210] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:27.737548] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35185 primary records. [2025-09-24T22:17:27.737976] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-24T22:17:27.784842] [DEBUG] [MAIN ] BSAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:27.785210] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:27.786805] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 33027 primary records. [2025-09-24T22:17:27.789032] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-24T22:17:27.788864] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32388 primary records. [2025-09-24T22:17:27.789917] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-24T22:17:27.789801] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-09-24T22:17:27.791380] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-24T22:17:27.793912] [INFO ] [MAIN ] Derivative Progress: 274/2075 symbols completed. BSBR took 1.1s. Estimated remaining: 11m 57s. Rate: 150.8 symbols/min [2025-09-24T22:17:27.812390] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:27.823158] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-24T22:17:27.823506] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-24T22:17:27.826717] [INFO ] [MAIN ] Derivative Progress: 275/2075 symbols completed. BSAC took 1.2s. Estimated remaining: 11m 54s. Rate: 151.3 symbols/min [2025-09-24T22:17:27.827682] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:27.829166] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-24T22:17:27.829322] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-24T22:17:27.832358] [INFO ] [MAIN ] Derivative Progress: 276/2075 symbols completed. BSM took 1.1s. Estimated remaining: 11m 51s. Rate: 151.8 symbols/min [2025-09-24T22:17:27.832862] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:27.846236] [DEBUG] [LOCAL ] BTA: Loaded 5372 existing records from primary storage. [2025-09-24T22:17:27.853099] [INFO ] [MAIN ] BTA: Loaded 5372 primary data records. [2025-09-24T22:17:27.884874] [DEBUG] [LOCAL ] BST: Loaded 19137 existing records from primary storage. [2025-09-24T22:17:27.909558] [INFO ] [MAIN ] BST: Loaded 19137 primary data records. [2025-09-24T22:17:28.410940] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-24T22:17:28.521038] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-24T22:17:28.894289] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:28.896347] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19137 primary records. [2025-09-24T22:17:28.896554] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-24T22:17:28.896918] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:28.898261] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5372 primary records. [2025-09-24T22:17:28.898378] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-24T22:17:28.936701] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-24T22:17:28.939222] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-24T22:17:28.942018] [INFO ] [MAIN ] Derivative Progress: 277/2075 symbols completed. BST took 1.1s. Estimated remaining: 11m 55s. Rate: 150.8 symbols/min [2025-09-24T22:17:28.939120] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-24T22:17:28.942507] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:28.942837] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-24T22:17:28.946153] [INFO ] [MAIN ] Derivative Progress: 278/2075 symbols completed. BTA took 1.1s. Estimated remaining: 11m 52s. Rate: 151.4 symbols/min [2025-09-24T22:17:28.947626] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:28.963172] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:28.964064] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-24T22:17:28.964246] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-24T22:17:28.991213] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-24T22:17:28.991596] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-24T22:17:28.994815] [INFO ] [MAIN ] Derivative Progress: 279/2075 symbols completed. BSX took 1.2s. Estimated remaining: 11m 50s. Rate: 151.8 symbols/min [2025-09-24T22:17:28.992018] [DEBUG] [LOCAL ] BTCM: Loaded 14856 existing records from primary storage. [2025-09-24T22:17:28.995277] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:28.995468] [INFO ] [MAIN ] BTCM: Loaded 14856 primary data records. [2025-09-24T22:17:29.160137] [DEBUG] [LOCAL ] BTT: Loaded 15944 existing records from primary storage. [2025-09-24T22:17:29.170770] [INFO ] [MAIN ] BTT: Loaded 15944 primary data records. [2025-09-24T22:17:29.351053] [DEBUG] [LOCAL ] BTI: Loaded 53558 existing records from primary storage. [2025-09-24T22:17:29.479969] [INFO ] [MAIN ] BTI: Loaded 53558 primary data records. [2025-09-24T22:17:30.098456] [DEBUG] [MAIN ] BTCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:30.099574] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 14856 primary records. [2025-09-24T22:17:30.100875] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-24T22:17:30.131760] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:30.132976] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15944 primary records. [2025-09-24T22:17:30.133320] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-24T22:17:30.137185] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-24T22:17:30.148329] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-24T22:17:30.150757] [INFO ] [MAIN ] Derivative Progress: 280/2075 symbols completed. BTCM took 1.2s. Estimated remaining: 11m 54s. Rate: 150.8 symbols/min [2025-09-24T22:17:30.151333] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:30.166338] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:30.169221] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53558 primary records. [2025-09-24T22:17:30.169581] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-24T22:17:30.171257] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-09-24T22:17:30.178493] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-24T22:17:30.182731] [INFO ] [MAIN ] Derivative Progress: 281/2075 symbols completed. BTT took 1.2s. Estimated remaining: 11m 51s. Rate: 151.3 symbols/min [2025-09-24T22:17:30.186321] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:30.190213] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-24T22:17:30.190686] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-24T22:17:30.193367] [INFO ] [MAIN ] Derivative Progress: 282/2075 symbols completed. BTI took 1.2s. Estimated remaining: 11m 49s. Rate: 151.8 symbols/min [2025-09-24T22:17:30.193869] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:30.218450] [DEBUG] [LOCAL ] BTZ: Loaded 22755 existing records from primary storage. [2025-09-24T22:17:30.218700] [INFO ] [MAIN ] BTZ: Loaded 22755 primary data records. [2025-09-24T22:17:30.562862] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-24T22:17:30.571620] [INFO ] [MAIN ] BTU: Loaded 53303 primary data records. [2025-09-24T22:17:30.698687] [DEBUG] [LOCAL ] BUD: Loaded 52737 existing records from primary storage. [2025-09-24T22:17:30.716482] [INFO ] [MAIN ] BUD: Loaded 52737 primary data records. [2025-09-24T22:17:31.227373] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:31.229297] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22755 primary records. [2025-09-24T22:17:31.229786] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-24T22:17:31.247353] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-24T22:17:31.247708] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-24T22:17:31.250481] [INFO ] [MAIN ] Derivative Progress: 283/2075 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 52s. Rate: 150.9 symbols/min [2025-09-24T22:17:31.268296] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:31.269020] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53303 primary records. [2025-09-24T22:17:31.269263] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-24T22:17:31.299466] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:31.300620] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-24T22:17:31.300732] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-24T22:17:31.300570] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52737 primary records. [2025-09-24T22:17:31.303256] [INFO ] [MAIN ] Derivative Progress: 284/2075 symbols completed. BTU took 1.2s. Estimated remaining: 11m 50s. Rate: 151.4 symbols/min [2025-09-24T22:17:31.303356] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-24T22:17:31.318876] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-24T22:17:31.318937] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-24T22:17:31.321736] [INFO ] [MAIN ] Derivative Progress: 285/2075 symbols completed. BUD took 1.1s. Estimated remaining: 11m 47s. Rate: 151.9 symbols/min [2025-09-24T22:17:31.322376] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:31.322336] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:31.322953] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:31.335972] [DEBUG] [LOCAL ] BUI: Loaded 11472 existing records from primary storage. [2025-09-24T22:17:31.336109] [INFO ] [MAIN ] BUI: Loaded 11472 primary data records. [2025-09-24T22:17:31.663519] [DEBUG] [LOCAL ] BUR: Loaded 45078 existing records from primary storage. [2025-09-24T22:17:31.678240] [INFO ] [MAIN ] BUR: Loaded 45078 primary data records. [2025-09-24T22:17:31.767851] [DEBUG] [LOCAL ] BURL: Loaded 46310 existing records from primary storage. [2025-09-24T22:17:31.786205] [INFO ] [MAIN ] BURL: Loaded 46310 primary data records. [2025-09-24T22:17:32.405579] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:32.406402] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11472 primary records. [2025-09-24T22:17:32.406674] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-24T22:17:32.425903] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-24T22:17:32.426249] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-24T22:17:32.429460] [INFO ] [MAIN ] Derivative Progress: 286/2075 symbols completed. BUI took 1.1s. Estimated remaining: 11m 51s. Rate: 150.9 symbols/min [2025-09-24T22:17:32.429856] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:32.448637] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:32.449421] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45078 primary records. [2025-09-24T22:17:32.449789] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-24T22:17:32.473097] [DEBUG] [LOCAL ] BUXX: Loaded 15128 existing records from primary storage. [2025-09-24T22:17:32.473797] [INFO ] [MAIN ] BUXX: Loaded 15128 primary data records. [2025-09-24T22:17:32.489049] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-09-24T22:17:32.489813] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-24T22:17:32.501536] [INFO ] [MAIN ] Derivative Progress: 287/2075 symbols completed. BUR took 1.2s. Estimated remaining: 11m 49s. Rate: 151.4 symbols/min [2025-09-24T22:17:32.545063] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:32.585913] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:32.597548] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46310 primary records. [2025-09-24T22:17:32.613711] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-24T22:17:32.815907] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-24T22:17:32.817496] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-24T22:17:32.820638] [INFO ] [MAIN ] Derivative Progress: 288/2075 symbols completed. BURL took 1.5s. Estimated remaining: 11m 48s. Rate: 151.5 symbols/min [2025-09-24T22:17:32.821222] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:32.836406] [DEBUG] [LOCAL ] BV: Loaded 38509 existing records from primary storage. [2025-09-24T22:17:32.836881] [INFO ] [MAIN ] BV: Loaded 38509 primary data records. [2025-09-24T22:17:33.063187] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:17:33.081331] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15128 primary records. [2025-09-24T22:17:33.181517] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-24T22:17:33.173243] [DEBUG] [LOCAL ] BVN: Loaded 43807 existing records from primary storage. [2025-09-24T22:17:33.182442] [INFO ] [MAIN ] BVN: Loaded 43807 primary data records. [2025-09-24T22:17:33.247342] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-24T22:17:33.281388] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-24T22:17:33.298206] [INFO ] [MAIN ] Derivative Progress: 289/2075 symbols completed. BUXX took 0.9s. Estimated remaining: 11m 48s. Rate: 151.4 symbols/min [2025-09-24T22:17:33.309773] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:33.535893] [DEBUG] [MAIN ] BV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:33.536997] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38509 primary records. [2025-09-24T22:17:33.537348] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-24T22:17:33.567484] [DEBUG] [LOCAL ] BW: Loaded 39574 existing records from primary storage. [2025-09-24T22:17:33.567704] [INFO ] [MAIN ] BW: Loaded 39574 primary data records. [2025-09-24T22:17:33.566795] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-09-24T22:17:33.568117] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-24T22:17:33.570789] [INFO ] [MAIN ] Derivative Progress: 290/2075 symbols completed. BV took 1.0s. Estimated remaining: 11m 47s. Rate: 151.5 symbols/min [2025-09-24T22:17:33.576443] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:33.909551] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:33.920127] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43807 primary records. [2025-09-24T22:17:33.920368] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-24T22:17:33.953632] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-24T22:17:33.954347] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-24T22:17:33.971290] [INFO ] [MAIN ] Derivative Progress: 291/2075 symbols completed. BVN took 1.2s. Estimated remaining: 11m 46s. Rate: 151.5 symbols/min [2025-09-24T22:17:33.971978] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:33.973256] [DEBUG] [LOCAL ] BWA: Loaded 52242 existing records from primary storage. [2025-09-24T22:17:33.973578] [INFO ] [MAIN ] BWA: Loaded 52242 primary data records. [2025-09-24T22:17:34.144490] [DEBUG] [LOCAL ] BWG: Loaded 12359 existing records from primary storage. [2025-09-24T22:17:34.174558] [INFO ] [MAIN ] BWG: Loaded 12359 primary data records. [2025-09-24T22:17:34.421541] [DEBUG] [MAIN ] BW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:34.440899] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39574 primary records. [2025-09-24T22:17:34.441462] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-24T22:17:34.684118] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-24T22:17:34.684279] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-24T22:17:34.686818] [INFO ] [MAIN ] Derivative Progress: 292/2075 symbols completed. BW took 1.4s. Estimated remaining: 11m 48s. Rate: 151.1 symbols/min [2025-09-24T22:17:34.688058] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:34.711514] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:34.712410] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52242 primary records. [2025-09-24T22:17:34.712846] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-24T22:17:34.717705] [DEBUG] [LOCAL ] BWMX: Loaded 7626 existing records from primary storage. [2025-09-24T22:17:34.726175] [INFO ] [MAIN ] BWMX: Loaded 7626 primary data records. [2025-09-24T22:17:34.848933] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-24T22:17:34.886702] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-24T22:17:34.887298] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:34.910999] [INFO ] [MAIN ] Derivative Progress: 293/2075 symbols completed. BWA took 1.3s. Estimated remaining: 11m 47s. Rate: 151.3 symbols/min [2025-09-24T22:17:34.941803] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12359 primary records. [2025-09-24T22:17:35.059057] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-24T22:17:35.058427] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:35.081487] [DEBUG] [LOCAL ] BWNB: Loaded 4454 existing records from primary storage. [2025-09-24T22:17:35.082314] [INFO ] [MAIN ] BWNB: Loaded 4454 primary data records. [2025-09-24T22:17:35.130336] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-24T22:17:35.130539] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-24T22:17:35.155494] [INFO ] [MAIN ] Derivative Progress: 294/2075 symbols completed. BWG took 1.2s. Estimated remaining: 11m 45s. Rate: 151.5 symbols/min [2025-09-24T22:17:35.179122] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:35.417083] [DEBUG] [MAIN ] BWMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:35.418520] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7626 primary records. [2025-09-24T22:17:35.418639] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-24T22:17:35.445536] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-24T22:17:35.445861] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-24T22:17:35.448043] [INFO ] [MAIN ] Derivative Progress: 295/2075 symbols completed. BWMX took 0.8s. Estimated remaining: 11m 44s. Rate: 151.7 symbols/min [2025-09-24T22:17:35.449528] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:35.471084] [DEBUG] [LOCAL ] BWXT: Loaded 46755 existing records from primary storage. [2025-09-24T22:17:35.471468] [INFO ] [MAIN ] BWXT: Loaded 46755 primary data records. [2025-09-24T22:17:35.590382] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:17:35.607251] [INFO ] [MAIN ] BWNB: Generated 1793 derivative records from 4454 primary records. [2025-09-24T22:17:35.642181] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-24T22:17:35.828900] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1793 records). [2025-09-24T22:17:35.828391] [DEBUG] [LOCAL ] BXMT: Loaded 47261 existing records from primary storage. [2025-09-24T22:17:35.829114] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-24T22:17:35.832223] [INFO ] [MAIN ] Derivative Progress: 296/2075 symbols completed. BWNB took 0.8s. Estimated remaining: 11m 44s. Rate: 151.7 symbols/min [2025-09-24T22:17:35.833151] [INFO ] [MAIN ] BXMT: Loaded 47261 primary data records. [2025-09-24T22:17:35.833325] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:36.188735] [DEBUG] [LOCAL ] BXMX: Loaded 19561 existing records from primary storage. [2025-09-24T22:17:36.188967] [INFO ] [MAIN ] BXMX: Loaded 19561 primary data records. [2025-09-24T22:17:36.310803] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:36.339475] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46755 primary records. [2025-09-24T22:17:36.362187] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-24T22:17:36.538545] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-24T22:17:36.539016] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-24T22:17:36.541849] [INFO ] [MAIN ] Derivative Progress: 297/2075 symbols completed. BWXT took 1.4s. Estimated remaining: 11m 45s. Rate: 151.3 symbols/min [2025-09-24T22:17:36.542970] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:36.561394] [DEBUG] [MAIN ] BXMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:36.562346] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47261 primary records. [2025-09-24T22:17:36.563523] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-24T22:17:36.585831] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-24T22:17:36.586047] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-24T22:17:36.588820] [INFO ] [MAIN ] Derivative Progress: 298/2075 symbols completed. BXMT took 1.1s. Estimated remaining: 11m 43s. Rate: 151.7 symbols/min [2025-09-24T22:17:36.601682] [DEBUG] [MAIN ] BXMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:36.602380] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19561 primary records. [2025-09-24T22:17:36.602444] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-24T22:17:36.630186] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-09-24T22:17:36.630325] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-24T22:17:36.633035] [INFO ] [MAIN ] Derivative Progress: 299/2075 symbols completed. BXMX took 0.8s. Estimated remaining: 11m 40s. Rate: 152.2 symbols/min [2025-09-24T22:17:36.653853] [DEBUG] [LOCAL ] BXP: Loaded 49802 existing records from primary storage. [2025-09-24T22:17:36.654015] [INFO ] [MAIN ] BXP: Loaded 49802 primary data records. [2025-09-24T22:17:37.014241] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:37.014912] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49802 primary records. [2025-09-24T22:17:37.014976] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-24T22:17:37.030003] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-24T22:17:37.030067] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-24T22:17:37.032100] [INFO ] [MAIN ] Derivative Progress: 300/2075 symbols completed. BXP took 0.5s. Estimated remaining: 11m 40s. Rate: 152.2 symbols/min [2025-09-24T22:17:37.032870] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:37.032745] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:37.033520] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:37.053936] [DEBUG] [LOCAL ] BYM: Loaded 12061 existing records from primary storage. [2025-09-24T22:17:37.054154] [INFO ] [MAIN ] BYM: Loaded 12061 primary data records. [2025-09-24T22:17:37.183743] [DEBUG] [LOCAL ] BY: Loaded 21597 existing records from primary storage. [2025-09-24T22:17:37.189464] [INFO ] [MAIN ] BY: Loaded 21597 primary data records. [2025-09-24T22:17:37.205694] [DEBUG] [LOCAL ] BZH: Loaded 32665 existing records from primary storage. [2025-09-24T22:17:37.210986] [INFO ] [MAIN ] BZH: Loaded 32665 primary data records. [2025-09-24T22:17:38.023147] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:38.024368] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12061 primary records. [2025-09-24T22:17:38.024834] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-24T22:17:38.071304] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-24T22:17:38.072246] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-24T22:17:38.071919] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:38.074659] [INFO ] [MAIN ] Derivative Progress: 301/2075 symbols completed. BYM took 1.0s. Estimated remaining: 11m 43s. Rate: 151.3 symbols/min [2025-09-24T22:17:38.075634] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32665 primary records. [2025-09-24T22:17:38.076047] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:38.076329] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:38.076417] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-24T22:17:38.077102] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21597 primary records. [2025-09-24T22:17:38.078484] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-24T22:17:38.110678] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-24T22:17:38.112113] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-24T22:17:38.115153] [INFO ] [MAIN ] Derivative Progress: 302/2075 symbols completed. BZH took 1.1s. Estimated remaining: 11m 41s. Rate: 151.8 symbols/min [2025-09-24T22:17:38.115563] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-24T22:17:38.116419] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:38.116353] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-24T22:17:38.119331] [INFO ] [MAIN ] Derivative Progress: 303/2075 symbols completed. BY took 1.1s. Estimated remaining: 11m 38s. Rate: 152.3 symbols/min [2025-09-24T22:17:38.120007] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:38.157053] [DEBUG] [LOCAL ] CAAP: Loaded 19503 existing records from primary storage. [2025-09-24T22:17:38.157255] [INFO ] [MAIN ] CAAP: Loaded 19503 primary data records. [2025-09-24T22:17:38.282836] [DEBUG] [LOCAL ] CACI: Loaded 25045 existing records from primary storage. [2025-09-24T22:17:38.283032] [INFO ] [MAIN ] CACI: Loaded 25045 primary data records. [2025-09-24T22:17:38.284049] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-24T22:17:38.342373] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-24T22:17:39.164237] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:39.167695] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19503 primary records. [2025-09-24T22:17:39.167904] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-24T22:17:39.192924] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:39.194155] [DEBUG] [MAIN ] C: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:39.194939] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 25045 primary records. [2025-09-24T22:17:39.206855] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-24T22:17:39.206951] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-24T22:17:39.207044] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-24T22:17:39.227366] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-24T22:17:39.235988] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-24T22:17:39.238983] [INFO ] [MAIN ] Derivative Progress: 304/2075 symbols completed. CAAP took 1.1s. Estimated remaining: 11m 42s. Rate: 151.4 symbols/min [2025-09-24T22:17:39.241507] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:39.246849] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-09-24T22:17:39.248018] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-24T22:17:39.248592] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-24T22:17:39.251292] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-24T22:17:39.251208] [INFO ] [MAIN ] Derivative Progress: 305/2075 symbols completed. CACI took 1.1s. Estimated remaining: 11m 39s. Rate: 151.9 symbols/min [2025-09-24T22:17:39.254096] [INFO ] [MAIN ] Derivative Progress: 306/2075 symbols completed. C took 1.2s. Estimated remaining: 11m 37s. Rate: 152.3 symbols/min [2025-09-24T22:17:39.254333] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:39.254051] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:39.260524] [DEBUG] [LOCAL ] CAF: Loaded 3440 existing records from primary storage. [2025-09-24T22:17:39.260678] [INFO ] [MAIN ] CAF: Loaded 3440 primary data records. [2025-09-24T22:17:39.606994] [DEBUG] [LOCAL ] CAE: Loaded 39010 existing records from primary storage. [2025-09-24T22:17:39.608267] [INFO ] [MAIN ] CAE: Loaded 39010 primary data records. [2025-09-24T22:17:39.621210] [DEBUG] [LOCAL ] CADE: Loaded 48819 existing records from primary storage. [2025-09-24T22:17:39.647027] [INFO ] [MAIN ] CADE: Loaded 48819 primary data records. [2025-09-24T22:17:40.298243] [DEBUG] [MAIN ] CAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:40.299397] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3440 primary records. [2025-09-24T22:17:40.299694] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-24T22:17:40.316561] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-09-24T22:17:40.316937] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-24T22:17:40.319543] [INFO ] [MAIN ] Derivative Progress: 307/2075 symbols completed. CAF took 1.1s. Estimated remaining: 11m 40s. Rate: 151.5 symbols/min [2025-09-24T22:17:40.319951] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:40.337346] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:40.338090] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39010 primary records. [2025-09-24T22:17:40.338269] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-24T22:17:40.367462] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:40.369220] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48819 primary records. [2025-09-24T22:17:40.369610] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-24T22:17:40.371493] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-24T22:17:40.372019] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-24T22:17:40.375168] [INFO ] [MAIN ] Derivative Progress: 308/2075 symbols completed. CAE took 1.1s. Estimated remaining: 11m 38s. Rate: 151.9 symbols/min [2025-09-24T22:17:40.375540] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:40.406200] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-09-24T22:17:40.406342] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-24T22:17:40.408500] [INFO ] [MAIN ] Derivative Progress: 309/2075 symbols completed. CADE took 1.2s. Estimated remaining: 11m 35s. Rate: 152.4 symbols/min [2025-09-24T22:17:40.408976] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:40.428458] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-24T22:17:40.428638] [INFO ] [MAIN ] CAG: Loaded 53659 primary data records. [2025-09-24T22:17:40.788882] [DEBUG] [LOCAL ] CAL: Loaded 43227 existing records from primary storage. [2025-09-24T22:17:40.789686] [INFO ] [MAIN ] CAL: Loaded 43227 primary data records. [2025-09-24T22:17:40.788073] [DEBUG] [LOCAL ] CAH: Loaded 51442 existing records from primary storage. [2025-09-24T22:17:40.790007] [INFO ] [MAIN ] CAH: Loaded 51442 primary data records. [2025-09-24T22:17:41.454184] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:41.455401] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53659 primary records. [2025-09-24T22:17:41.456035] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-24T22:17:41.478474] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-24T22:17:41.478938] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-24T22:17:41.481335] [INFO ] [MAIN ] Derivative Progress: 310/2075 symbols completed. CAG took 1.2s. Estimated remaining: 11m 39s. Rate: 151.5 symbols/min [2025-09-24T22:17:41.482071] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:41.502074] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:41.515440] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43227 primary records. [2025-09-24T22:17:41.516076] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-24T22:17:41.516787] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:41.526531] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51442 primary records. [2025-09-24T22:17:41.531755] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-24T22:17:41.561257] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-24T22:17:41.562161] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-09-24T22:17:41.561979] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-24T22:17:41.572511] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-24T22:17:41.576210] [INFO ] [MAIN ] Derivative Progress: 311/2075 symbols completed. CAH took 1.2s. Estimated remaining: 11m 37s. Rate: 151.9 symbols/min [2025-09-24T22:17:41.578673] [INFO ] [MAIN ] Derivative Progress: 312/2075 symbols completed. CAL took 1.2s. Estimated remaining: 11m 34s. Rate: 152.4 symbols/min [2025-09-24T22:17:41.579013] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:41.579192] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:41.580774] [DEBUG] [LOCAL ] CALX: Loaded 38509 existing records from primary storage. [2025-09-24T22:17:41.581165] [INFO ] [MAIN ] CALX: Loaded 38509 primary data records. [2025-09-24T22:17:41.695580] [DEBUG] [LOCAL ] CAPL: Loaded 5870 existing records from primary storage. [2025-09-24T22:17:41.699428] [INFO ] [MAIN ] CAPL: Loaded 5870 primary data records. [2025-09-24T22:17:41.911921] [DEBUG] [LOCAL ] CANG: Loaded 26695 existing records from primary storage. [2025-09-24T22:17:42.005736] [INFO ] [MAIN ] CANG: Loaded 26695 primary data records. [2025-09-24T22:17:42.628052] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:42.628911] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 38509 primary records. [2025-09-24T22:17:42.629198] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-24T22:17:42.658565] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-24T22:17:42.663835] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:42.663537] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-24T22:17:42.666198] [INFO ] [MAIN ] Derivative Progress: 313/2075 symbols completed. CALX took 1.2s. Estimated remaining: 11m 38s. Rate: 151.5 symbols/min [2025-09-24T22:17:42.667498] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5870 primary records. [2025-09-24T22:17:42.667681] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-24T22:17:42.697440] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:42.698616] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26695 primary records. [2025-09-24T22:17:42.698930] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-24T22:17:42.699314] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-24T22:17:42.700161] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-24T22:17:42.702699] [INFO ] [MAIN ] Derivative Progress: 314/2075 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 35s. Rate: 152.0 symbols/min [2025-09-24T22:17:42.717306] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-24T22:17:42.717367] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-24T22:17:42.719556] [INFO ] [MAIN ] Derivative Progress: 315/2075 symbols completed. CANG took 1.1s. Estimated remaining: 11m 33s. Rate: 152.4 symbols/min [2025-09-24T22:17:42.720089] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:42.720336] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:42.720150] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:42.761417] [DEBUG] [LOCAL ] CARS: Loaded 40146 existing records from primary storage. [2025-09-24T22:17:42.761663] [INFO ] [MAIN ] CARS: Loaded 40146 primary data records. [2025-09-24T22:17:43.013612] [DEBUG] [LOCAL ] CAT: Loaded 52923 existing records from primary storage. [2025-09-24T22:17:43.122147] [INFO ] [MAIN ] CAT: Loaded 52923 primary data records. [2025-09-24T22:17:43.122042] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-24T22:17:43.131539] [INFO ] [MAIN ] CARR: Loaded 53594 primary data records. [2025-09-24T22:17:43.794193] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:43.795473] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 40146 primary records. [2025-09-24T22:17:43.795977] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-24T22:17:43.836019] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-24T22:17:43.836286] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-24T22:17:43.844534] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:43.850479] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52923 primary records. [2025-09-24T22:17:43.849466] [INFO ] [MAIN ] Derivative Progress: 316/2075 symbols completed. CARS took 1.1s. Estimated remaining: 11m 36s. Rate: 151.5 symbols/min [2025-09-24T22:17:43.851027] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-24T22:17:43.851306] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:43.881634] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:43.886377] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-24T22:17:43.886539] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-24T22:17:43.891186] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53594 primary records. [2025-09-24T22:17:43.895712] [DEBUG] [LOCAL ] CATO: Loaded 7234 existing records from primary storage. [2025-09-24T22:17:43.889786] [INFO ] [MAIN ] Derivative Progress: 317/2075 symbols completed. CAT took 1.2s. Estimated remaining: 11m 34s. Rate: 152.0 symbols/min [2025-09-24T22:17:43.896441] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:43.895970] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-24T22:17:43.896058] [INFO ] [MAIN ] CATO: Loaded 7234 primary data records. [2025-09-24T22:17:44.110299] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-24T22:17:44.268462] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-24T22:17:44.271875] [INFO ] [MAIN ] Derivative Progress: 318/2075 symbols completed. CARR took 1.6s. Estimated remaining: 11m 34s. Rate: 152.0 symbols/min [2025-09-24T22:17:44.272415] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:44.299139] [DEBUG] [LOCAL ] CAVA: Loaded 53550 existing records from primary storage. [2025-09-24T22:17:44.299788] [INFO ] [MAIN ] CAVA: Loaded 53550 primary data records. [2025-09-24T22:17:44.531692] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:44.692069] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7234 primary records. [2025-09-24T22:17:44.692395] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-24T22:17:44.718742] [DEBUG] [LOCAL ] CB: Loaded 50082 existing records from primary storage. [2025-09-24T22:17:44.723467] [INFO ] [MAIN ] CB: Loaded 50082 primary data records. [2025-09-24T22:17:44.845157] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-24T22:17:44.846228] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-24T22:17:44.853893] [INFO ] [MAIN ] Derivative Progress: 319/2075 symbols completed. CATO took 1.0s. Estimated remaining: 11m 34s. Rate: 151.8 symbols/min [2025-09-24T22:17:44.859288] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:45.067614] [DEBUG] [LOCAL ] CBAN: Loaded 11061 existing records from primary storage. [2025-09-24T22:17:45.068123] [INFO ] [MAIN ] CBAN: Loaded 11061 primary data records. [2025-09-24T22:17:45.166325] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:45.177435] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53550 primary records. [2025-09-24T22:17:45.177569] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-24T22:17:45.303536] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-24T22:17:45.303716] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-24T22:17:45.306102] [INFO ] [MAIN ] Derivative Progress: 320/2075 symbols completed. CAVA took 1.4s. Estimated remaining: 11m 34s. Rate: 151.7 symbols/min [2025-09-24T22:17:45.306698] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:45.449848] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:45.451400] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 50082 primary records. [2025-09-24T22:17:45.459967] [DEBUG] [LOCAL ] CBL: Loaded 16676 existing records from primary storage. [2025-09-24T22:17:45.459420] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-24T22:17:45.460189] [INFO ] [MAIN ] CBL: Loaded 16676 primary data records. [2025-09-24T22:17:45.580172] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-24T22:17:45.584151] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-24T22:17:45.586540] [INFO ] [MAIN ] Derivative Progress: 321/2075 symbols completed. CB took 1.3s. Estimated remaining: 11m 33s. Rate: 151.8 symbols/min [2025-09-24T22:17:45.587443] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:45.684366] [DEBUG] [LOCAL ] CBNA: Loaded 2887 existing records from primary storage. [2025-09-24T22:17:45.686121] [INFO ] [MAIN ] CBNA: Loaded 2887 primary data records. [2025-09-24T22:17:45.900716] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:45.930921] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 11061 primary records. [2025-09-24T22:17:45.931455] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-24T22:17:46.151518] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-24T22:17:46.151891] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-24T22:17:46.155039] [INFO ] [MAIN ] Derivative Progress: 322/2075 symbols completed. CBAN took 1.3s. Estimated remaining: 11m 34s. Rate: 151.6 symbols/min [2025-09-24T22:17:46.155728] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:46.177415] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:46.178306] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16676 primary records. [2025-09-24T22:17:46.178635] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-24T22:17:46.211231] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:46.212841] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2887 primary records. [2025-09-24T22:17:46.212957] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-24T22:17:46.213073] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-24T22:17:46.213351] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-24T22:17:46.216137] [INFO ] [MAIN ] Derivative Progress: 323/2075 symbols completed. CBL took 0.9s. Estimated remaining: 11m 31s. Rate: 152.0 symbols/min [2025-09-24T22:17:46.230609] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:46.244521] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-09-24T22:17:46.244594] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-24T22:17:46.247228] [INFO ] [MAIN ] Derivative Progress: 324/2075 symbols completed. CBNA took 0.7s. Estimated remaining: 11m 29s. Rate: 152.5 symbols/min [2025-09-24T22:17:46.247689] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:46.265683] [DEBUG] [LOCAL ] CBRE: Loaded 50635 existing records from primary storage. [2025-09-24T22:17:46.265912] [INFO ] [MAIN ] CBRE: Loaded 50635 primary data records. [2025-09-24T22:17:46.420744] [DEBUG] [LOCAL ] CBT: Loaded 31097 existing records from primary storage. [2025-09-24T22:17:46.443442] [INFO ] [MAIN ] CBT: Loaded 31097 primary data records. [2025-09-24T22:17:46.574062] [DEBUG] [LOCAL ] CBU: Loaded 22866 existing records from primary storage. [2025-09-24T22:17:46.650720] [INFO ] [MAIN ] CBU: Loaded 22866 primary data records. [2025-09-24T22:17:47.320378] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:47.321406] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50635 primary records. [2025-09-24T22:17:47.321731] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-24T22:17:47.341155] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-24T22:17:47.342227] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-24T22:17:47.346046] [INFO ] [MAIN ] Derivative Progress: 325/2075 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 32s. Rate: 151.6 symbols/min [2025-09-24T22:17:47.346474] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:47.361627] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:47.363595] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31097 primary records. [2025-09-24T22:17:47.364373] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-24T22:17:47.390676] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:47.393352] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22866 primary records. [2025-09-24T22:17:47.394095] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-24T22:17:47.394282] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-24T22:17:47.394220] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-24T22:17:47.399475] [INFO ] [MAIN ] Derivative Progress: 326/2075 symbols completed. CBT took 1.2s. Estimated remaining: 11m 30s. Rate: 152.0 symbols/min [2025-09-24T22:17:47.410926] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:47.425251] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-24T22:17:47.435089] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-24T22:17:47.437579] [INFO ] [MAIN ] Derivative Progress: 327/2075 symbols completed. CBU took 1.2s. Estimated remaining: 11m 28s. Rate: 152.5 symbols/min [2025-09-24T22:17:47.437929] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:47.439457] [DEBUG] [LOCAL ] CBZ: Loaded 33505 existing records from primary storage. [2025-09-24T22:17:47.439808] [INFO ] [MAIN ] CBZ: Loaded 33505 primary data records. [2025-09-24T22:17:47.773318] [DEBUG] [LOCAL ] CC: Loaded 53032 existing records from primary storage. [2025-09-24T22:17:47.787082] [INFO ] [MAIN ] CC: Loaded 53032 primary data records. [2025-09-24T22:17:47.910262] [DEBUG] [LOCAL ] CCI: Loaded 53149 existing records from primary storage. [2025-09-24T22:17:47.911086] [INFO ] [MAIN ] CCI: Loaded 53149 primary data records. [2025-09-24T22:17:48.494817] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:48.509559] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33505 primary records. [2025-09-24T22:17:48.509916] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-24T22:17:48.530384] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-24T22:17:48.530987] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-24T22:17:48.533490] [INFO ] [MAIN ] Derivative Progress: 328/2075 symbols completed. CBZ took 1.2s. Estimated remaining: 11m 31s. Rate: 151.6 symbols/min [2025-09-24T22:17:48.554389] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:48.555555] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53032 primary records. [2025-09-24T22:17:48.555800] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-24T22:17:48.576056] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-24T22:17:48.576385] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-24T22:17:48.591761] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:48.591371] [INFO ] [MAIN ] Derivative Progress: 329/2075 symbols completed. CC took 1.2s. Estimated remaining: 11m 29s. Rate: 152.0 symbols/min [2025-09-24T22:17:48.592634] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53149 primary records. [2025-09-24T22:17:48.592869] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-24T22:17:48.609453] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-24T22:17:48.609518] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-24T22:17:48.611916] [INFO ] [MAIN ] Derivative Progress: 330/2075 symbols completed. CCI took 1.2s. Estimated remaining: 11m 27s. Rate: 152.5 symbols/min [2025-09-24T22:17:48.612395] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:48.612708] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:48.612882] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:48.630752] [DEBUG] [LOCAL ] CCIF: Loaded 15401 existing records from primary storage. [2025-09-24T22:17:48.630968] [INFO ] [MAIN ] CCIF: Loaded 15401 primary data records. [2025-09-24T22:17:48.980769] [DEBUG] [LOCAL ] CCK: Loaded 46358 existing records from primary storage. [2025-09-24T22:17:48.981076] [INFO ] [MAIN ] CCK: Loaded 46358 primary data records. [2025-09-24T22:17:48.981832] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-24T22:17:48.987826] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-09-24T22:17:49.629854] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:49.632600] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15401 primary records. [2025-09-24T22:17:49.632858] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-24T22:17:49.656627] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-24T22:17:49.656957] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-24T22:17:49.659628] [INFO ] [MAIN ] Derivative Progress: 331/2075 symbols completed. CCIF took 1.0s. Estimated remaining: 11m 30s. Rate: 151.7 symbols/min [2025-09-24T22:17:49.673220] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:49.672868] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:49.675968] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46358 primary records. [2025-09-24T22:17:49.676100] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-24T22:17:49.709272] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-24T22:17:49.709622] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:49.710631] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-09-24T22:17:49.709817] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-24T22:17:49.712851] [INFO ] [MAIN ] Derivative Progress: 332/2075 symbols completed. CCK took 1.1s. Estimated remaining: 11m 28s. Rate: 152.1 symbols/min [2025-09-24T22:17:49.713151] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-24T22:17:49.713298] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:49.732069] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-24T22:17:49.732223] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-24T22:17:49.734846] [INFO ] [MAIN ] Derivative Progress: 333/2075 symbols completed. CCJ took 1.1s. Estimated remaining: 11m 25s. Rate: 152.5 symbols/min [2025-09-24T22:17:49.735223] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:49.759342] [DEBUG] [LOCAL ] CCRD: Loaded 9021 existing records from primary storage. [2025-09-24T22:17:49.759483] [INFO ] [MAIN ] CCRD: Loaded 9021 primary data records. [2025-09-24T22:17:49.928920] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-24T22:17:49.965104] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-24T22:17:49.982499] [DEBUG] [LOCAL ] CCO: Loaded 47658 existing records from primary storage. [2025-09-24T22:17:49.997534] [INFO ] [MAIN ] CCO: Loaded 47658 primary data records. [2025-09-24T22:17:50.838824] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:50.840354] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9021 primary records. [2025-09-24T22:17:50.840639] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-24T22:17:50.870451] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-09-24T22:17:50.875223] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-24T22:17:50.877784] [INFO ] [MAIN ] Derivative Progress: 334/2075 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 29s. Rate: 151.7 symbols/min [2025-09-24T22:17:50.878364] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:50.878741] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:50.882475] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-24T22:17:50.882825] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-24T22:17:50.908965] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:50.910292] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47658 primary records. [2025-09-24T22:17:50.910919] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-24T22:17:50.926383] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-24T22:17:50.930809] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-24T22:17:50.933795] [INFO ] [MAIN ] Derivative Progress: 335/2075 symbols completed. CCL took 1.3s. Estimated remaining: 11m 27s. Rate: 152.0 symbols/min [2025-09-24T22:17:50.930909] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-24T22:17:50.934207] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-24T22:17:50.945093] [INFO ] [MAIN ] Derivative Progress: 336/2075 symbols completed. CCO took 1.2s. Estimated remaining: 11m 24s. Rate: 152.5 symbols/min [2025-09-24T22:17:50.945026] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:50.945944] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:50.958565] [DEBUG] [LOCAL ] CCS: Loaded 30736 existing records from primary storage. [2025-09-24T22:17:50.959066] [INFO ] [MAIN ] CCS: Loaded 30736 primary data records. [2025-09-24T22:17:51.136908] [DEBUG] [LOCAL ] CCU: Loaded 23608 existing records from primary storage. [2025-09-24T22:17:51.157168] [INFO ] [MAIN ] CCU: Loaded 23608 primary data records. [2025-09-24T22:17:51.448590] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-24T22:17:51.480614] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-24T22:17:52.000134] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:52.001418] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30736 primary records. [2025-09-24T22:17:52.002037] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-24T22:17:52.036904] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:52.039301] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23608 primary records. [2025-09-24T22:17:52.039937] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-24T22:17:52.050063] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-24T22:17:52.054668] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-24T22:17:52.058710] [INFO ] [MAIN ] Derivative Progress: 337/2075 symbols completed. CCS took 1.2s. Estimated remaining: 11m 28s. Rate: 151.7 symbols/min [2025-09-24T22:17:52.061602] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-24T22:17:52.062528] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-24T22:17:52.062592] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:52.065460] [INFO ] [MAIN ] Derivative Progress: 338/2075 symbols completed. CCU took 1.1s. Estimated remaining: 11m 25s. Rate: 152.1 symbols/min [2025-09-24T22:17:52.066477] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:52.087451] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:52.092828] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-24T22:17:52.093341] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-24T22:17:52.093146] [DEBUG] [LOCAL ] CDLR: Loaded 9802 existing records from primary storage. [2025-09-24T22:17:52.094282] [INFO ] [MAIN ] CDLR: Loaded 9802 primary data records. [2025-09-24T22:17:52.235382] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-24T22:17:52.236588] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-24T22:17:52.249523] [INFO ] [MAIN ] Derivative Progress: 339/2075 symbols completed. CDE took 1.3s. Estimated remaining: 11m 24s. Rate: 152.3 symbols/min [2025-09-24T22:17:52.255017] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:52.336707] [DEBUG] [LOCAL ] CDP: Loaded 42701 existing records from primary storage. [2025-09-24T22:17:52.460806] [INFO ] [MAIN ] CDP: Loaded 42701 primary data records. [2025-09-24T22:17:52.685446] [DEBUG] [LOCAL ] CDRE: Loaded 25426 existing records from primary storage. [2025-09-24T22:17:52.836974] [INFO ] [MAIN ] CDRE: Loaded 25426 primary data records. [2025-09-24T22:17:52.987698] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:53.048570] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9802 primary records. [2025-09-24T22:17:53.180824] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-24T22:17:53.199537] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-24T22:17:53.200931] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-24T22:17:53.204245] [INFO ] [MAIN ] Derivative Progress: 340/2075 symbols completed. CDLR took 1.1s. Estimated remaining: 11m 26s. Rate: 151.7 symbols/min [2025-09-24T22:17:53.205014] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:53.225790] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:53.226693] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42701 primary records. [2025-09-24T22:17:53.226951] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-24T22:17:53.249121] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-24T22:17:53.250828] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-24T22:17:53.253989] [INFO ] [MAIN ] Derivative Progress: 341/2075 symbols completed. CDP took 1.2s. Estimated remaining: 11m 24s. Rate: 152.1 symbols/min [2025-09-24T22:17:53.254294] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:53.267547] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:53.268262] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 25426 primary records. [2025-09-24T22:17:53.268439] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-24T22:17:53.304759] [DEBUG] [LOCAL ] CEE: Loaded 6649 existing records from primary storage. [2025-09-24T22:17:53.304484] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-09-24T22:17:53.304974] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-24T22:17:53.305040] [INFO ] [MAIN ] CEE: Loaded 6649 primary data records. [2025-09-24T22:17:53.319314] [INFO ] [MAIN ] Derivative Progress: 342/2075 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 22s. Rate: 152.5 symbols/min [2025-09-24T22:17:53.375466] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:53.397707] [DEBUG] [LOCAL ] CE: Loaded 51543 existing records from primary storage. [2025-09-24T22:17:53.411853] [INFO ] [MAIN ] CE: Loaded 51543 primary data records. [2025-09-24T22:17:53.817837] [DEBUG] [LOCAL ] CEPU: Loaded 26053 existing records from primary storage. [2025-09-24T22:17:53.827419] [INFO ] [MAIN ] CEPU: Loaded 26053 primary data records. [2025-09-24T22:17:54.349124] [DEBUG] [MAIN ] CEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:54.350614] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 6649 primary records. [2025-09-24T22:17:54.350721] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-24T22:17:54.373376] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-24T22:17:54.374265] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-24T22:17:54.377418] [INFO ] [MAIN ] Derivative Progress: 343/2075 symbols completed. CEE took 1.1s. Estimated remaining: 11m 25s. Rate: 151.7 symbols/min [2025-09-24T22:17:54.396466] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:54.397372] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51543 primary records. [2025-09-24T22:17:54.397676] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-24T22:17:54.415421] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-24T22:17:54.415550] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-24T22:17:54.418237] [INFO ] [MAIN ] Derivative Progress: 344/2075 symbols completed. CE took 1.2s. Estimated remaining: 11m 23s. Rate: 152.1 symbols/min [2025-09-24T22:17:54.434608] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:54.435248] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 26053 primary records. [2025-09-24T22:17:54.435310] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-24T22:17:54.451533] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-24T22:17:54.451611] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-24T22:17:54.454172] [INFO ] [MAIN ] Derivative Progress: 345/2075 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 21s. Rate: 152.5 symbols/min [2025-09-24T22:17:54.454745] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:54.454870] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:54.455403] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:54.543156] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-24T22:17:54.543509] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-09-24T22:17:54.589568] [DEBUG] [LOCAL ] CFR: Loaded 33520 existing records from primary storage. [2025-09-24T22:17:54.614198] [INFO ] [MAIN ] CFR: Loaded 33520 primary data records. [2025-09-24T22:17:54.764874] [DEBUG] [LOCAL ] CF: Loaded 52229 existing records from primary storage. [2025-09-24T22:17:54.792285] [INFO ] [MAIN ] CF: Loaded 52229 primary data records. [2025-09-24T22:17:55.664866] [DEBUG] [MAIN ] CFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:55.666051] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33520 primary records. [2025-09-24T22:17:55.679113] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:55.679849] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-09-24T22:17:55.679218] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-24T22:17:55.680013] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-24T22:17:55.710141] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-09-24T22:17:55.711280] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-24T22:17:55.714469] [INFO ] [MAIN ] Derivative Progress: 346/2075 symbols completed. CFG took 1.3s. Estimated remaining: 11m 24s. Rate: 151.6 symbols/min [2025-09-24T22:17:55.716233] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-24T22:17:55.716476] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-24T22:17:55.719738] [INFO ] [MAIN ] Derivative Progress: 347/2075 symbols completed. CFR took 1.3s. Estimated remaining: 11m 22s. Rate: 152.0 symbols/min [2025-09-24T22:17:55.719825] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:55.720157] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:55.739038] [DEBUG] [LOCAL ] CGV: Loaded 1403 existing records from primary storage. [2025-09-24T22:17:55.740169] [INFO ] [MAIN ] CGV: Loaded 1403 primary data records. [2025-09-24T22:17:55.740059] [DEBUG] [MAIN ] CF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:55.762792] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52229 primary records. [2025-09-24T22:17:55.797772] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-24T22:17:56.071957] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-24T22:17:56.084298] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-24T22:17:56.088280] [INFO ] [MAIN ] Derivative Progress: 348/2075 symbols completed. CF took 1.6s. Estimated remaining: 11m 22s. Rate: 152.0 symbols/min [2025-09-24T22:17:56.088868] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:56.090486] [DEBUG] [LOCAL ] CGAU: Loaded 42718 existing records from primary storage. [2025-09-24T22:17:56.090997] [INFO ] [MAIN ] CGAU: Loaded 42718 primary data records. [2025-09-24T22:17:56.302183] [DEBUG] [LOCAL ] CHCT: Loaded 23991 existing records from primary storage. [2025-09-24T22:17:56.307723] [INFO ] [MAIN ] CHCT: Loaded 23991 primary data records. [2025-09-24T22:17:56.596740] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:17:56.627479] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1403 primary records. [2025-09-24T22:17:56.628340] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-24T22:17:56.765452] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-24T22:17:56.767605] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-24T22:17:56.770862] [INFO ] [MAIN ] Derivative Progress: 349/2075 symbols completed. CGV took 1.1s. Estimated remaining: 11m 23s. Rate: 151.7 symbols/min [2025-09-24T22:17:56.784116] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:56.785616] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:56.786601] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42718 primary records. [2025-09-24T22:17:56.786758] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-24T22:17:56.805441] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-24T22:17:56.805703] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-24T22:17:56.807945] [INFO ] [MAIN ] Derivative Progress: 350/2075 symbols completed. CGAU took 1.1s. Estimated remaining: 11m 20s. Rate: 152.1 symbols/min [2025-09-24T22:17:56.808394] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:56.844716] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:56.845818] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 23991 primary records. [2025-09-24T22:17:56.846251] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-24T22:17:56.853402] [DEBUG] [LOCAL ] CHE: Loaded 14812 existing records from primary storage. [2025-09-24T22:17:56.861176] [INFO ] [MAIN ] CHE: Loaded 14812 primary data records. [2025-09-24T22:17:56.942322] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-24T22:17:57.010402] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-24T22:17:57.063673] [DEBUG] [LOCAL ] CHD: Loaded 52017 existing records from primary storage. [2025-09-24T22:17:57.091577] [INFO ] [MAIN ] CHD: Loaded 52017 primary data records. [2025-09-24T22:17:57.095076] [INFO ] [MAIN ] Derivative Progress: 351/2075 symbols completed. CHCT took 1.0s. Estimated remaining: 11m 20s. Rate: 152.2 symbols/min [2025-09-24T22:17:57.140060] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:57.604731] [DEBUG] [LOCAL ] CHGG: Loaded 47701 existing records from primary storage. [2025-09-24T22:17:57.610133] [INFO ] [MAIN ] CHGG: Loaded 47701 primary data records. [2025-09-24T22:17:57.610403] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:57.622684] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14812 primary records. [2025-09-24T22:17:57.622798] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-24T22:17:57.708779] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-24T22:17:57.716775] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-24T22:17:57.721018] [INFO ] [MAIN ] Derivative Progress: 352/2075 symbols completed. CHE took 0.9s. Estimated remaining: 11m 20s. Rate: 152.0 symbols/min [2025-09-24T22:17:57.737742] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:57.959120] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:57.974534] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52017 primary records. [2025-09-24T22:17:57.975571] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-24T22:17:58.006012] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-24T22:17:58.006186] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-24T22:17:58.009218] [INFO ] [MAIN ] Derivative Progress: 353/2075 symbols completed. CHD took 1.2s. Estimated remaining: 11m 19s. Rate: 152.1 symbols/min [2025-09-24T22:17:58.009577] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:58.023965] [DEBUG] [LOCAL ] CHH: Loaded 32181 existing records from primary storage. [2025-09-24T22:17:58.024169] [INFO ] [MAIN ] CHH: Loaded 32181 primary data records. [2025-09-24T22:17:58.177986] [DEBUG] [LOCAL ] CHMI: Loaded 22062 existing records from primary storage. [2025-09-24T22:17:58.183600] [INFO ] [MAIN ] CHMI: Loaded 22062 primary data records. [2025-09-24T22:17:58.267818] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:58.345197] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47701 primary records. [2025-09-24T22:17:58.401708] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-24T22:17:58.641114] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-24T22:17:58.641471] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-24T22:17:58.645977] [INFO ] [MAIN ] Derivative Progress: 354/2075 symbols completed. CHGG took 1.5s. Estimated remaining: 11m 20s. Rate: 151.8 symbols/min [2025-09-24T22:17:58.646619] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:58.727022] [DEBUG] [LOCAL ] CHN: Loaded 4808 existing records from primary storage. [2025-09-24T22:17:58.779900] [INFO ] [MAIN ] CHN: Loaded 4808 primary data records. [2025-09-24T22:17:59.131955] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:59.133699] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32181 primary records. [2025-09-24T22:17:59.139026] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-24T22:17:59.278580] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-24T22:17:59.278933] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-24T22:17:59.282692] [INFO ] [MAIN ] Derivative Progress: 355/2075 symbols completed. CHH took 1.6s. Estimated remaining: 11m 21s. Rate: 151.6 symbols/min [2025-09-24T22:17:59.508331] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:59.536488] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:59.539099] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 22062 primary records. [2025-09-24T22:17:59.539426] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-24T22:17:59.557382] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-24T22:17:59.557615] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-24T22:17:59.559774] [INFO ] [MAIN ] Derivative Progress: 356/2075 symbols completed. CHMI took 1.6s. Estimated remaining: 11m 20s. Rate: 151.7 symbols/min [2025-09-24T22:17:59.562746] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:59.590784] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:17:59.591572] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4808 primary records. [2025-09-24T22:17:59.591723] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-24T22:17:59.608260] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-24T22:17:59.622664] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-24T22:17:59.625738] [INFO ] [MAIN ] Derivative Progress: 357/2075 symbols completed. CHN took 1.0s. Estimated remaining: 11m 18s. Rate: 152.0 symbols/min [2025-09-24T22:17:59.626160] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:17:59.631377] [DEBUG] [LOCAL ] CHPT: Loaded 49274 existing records from primary storage. [2025-09-24T22:17:59.631755] [INFO ] [MAIN ] CHPT: Loaded 49274 primary data records. [2025-09-24T22:17:59.748281] [DEBUG] [LOCAL ] CHT: Loaded 19530 existing records from primary storage. [2025-09-24T22:17:59.748777] [INFO ] [MAIN ] CHT: Loaded 19530 primary data records. [2025-09-24T22:18:00.309906] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-24T22:18:00.310926] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-09-24T22:18:00.515552] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:00.516683] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 49274 primary records. [2025-09-24T22:18:00.626473] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-24T22:18:00.656143] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-24T22:18:00.656835] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-24T22:18:00.659834] [INFO ] [MAIN ] Derivative Progress: 358/2075 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 21s. Rate: 151.4 symbols/min [2025-09-24T22:18:00.673886] [DEBUG] [MAIN ] CHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:00.674715] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19530 primary records. [2025-09-24T22:18:00.675041] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-24T22:18:00.692371] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-09-24T22:18:00.692635] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-24T22:18:00.695372] [INFO ] [MAIN ] Derivative Progress: 359/2075 symbols completed. CHT took 1.1s. Estimated remaining: 11m 19s. Rate: 151.7 symbols/min [2025-09-24T22:18:00.711404] [DEBUG] [MAIN ] CHWY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:00.711977] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-09-24T22:18:00.712040] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-24T22:18:00.727219] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-24T22:18:00.727279] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-24T22:18:00.730156] [INFO ] [MAIN ] Derivative Progress: 360/2075 symbols completed. CHWY took 1.1s. Estimated remaining: 11m 16s. Rate: 152.1 symbols/min [2025-09-24T22:18:00.730946] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:00.731048] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:00.731194] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:00.755406] [DEBUG] [LOCAL ] CIA: Loaded 17021 existing records from primary storage. [2025-09-24T22:18:00.762820] [INFO ] [MAIN ] CIA: Loaded 17021 primary data records. [2025-09-24T22:18:00.889504] [DEBUG] [LOCAL ] CIB: Loaded 31023 existing records from primary storage. [2025-09-24T22:18:00.889811] [INFO ] [MAIN ] CIB: Loaded 31023 primary data records. [2025-09-24T22:18:01.087142] [DEBUG] [LOCAL ] CI: Loaded 49852 existing records from primary storage. [2025-09-24T22:18:01.204310] [INFO ] [MAIN ] CI: Loaded 49852 primary data records. [2025-09-24T22:18:01.785524] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:01.786716] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 17021 primary records. [2025-09-24T22:18:01.787853] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-24T22:18:01.820575] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-24T22:18:01.821347] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-24T22:18:01.823462] [INFO ] [MAIN ] Derivative Progress: 361/2075 symbols completed. CIA took 1.1s. Estimated remaining: 11m 19s. Rate: 151.4 symbols/min [2025-09-24T22:18:01.823796] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:01.824941] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 31023 primary records. [2025-09-24T22:18:01.825254] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-24T22:18:01.825189] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:01.846979] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-24T22:18:01.847185] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-24T22:18:01.850502] [INFO ] [MAIN ] Derivative Progress: 362/2075 symbols completed. CIB took 1.1s. Estimated remaining: 11m 17s. Rate: 151.8 symbols/min [2025-09-24T22:18:01.851051] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:01.870746] [DEBUG] [MAIN ] CI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:01.871693] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49852 primary records. [2025-09-24T22:18:01.873017] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-24T22:18:01.898519] [DEBUG] [LOCAL ] CIF: Loaded 4350 existing records from primary storage. [2025-09-24T22:18:01.904322] [INFO ] [MAIN ] CIF: Loaded 4350 primary data records. [2025-09-24T22:18:02.064118] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-24T22:18:02.094392] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-24T22:18:02.122794] [INFO ] [MAIN ] Derivative Progress: 363/2075 symbols completed. CI took 1.4s. Estimated remaining: 11m 16s. Rate: 151.9 symbols/min [2025-09-24T22:18:02.132105] [DEBUG] [LOCAL ] CIEN: Loaded 52083 existing records from primary storage. [2025-09-24T22:18:02.158446] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:02.158664] [INFO ] [MAIN ] CIEN: Loaded 52083 primary data records. [2025-09-24T22:18:02.628795] [DEBUG] [LOCAL ] CIG: Loaded 43740 existing records from primary storage. [2025-09-24T22:18:02.629193] [INFO ] [MAIN ] CIG: Loaded 43740 primary data records. [2025-09-24T22:18:02.818855] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:02.950826] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4350 primary records. [2025-09-24T22:18:02.964636] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-24T22:18:02.986253] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-24T22:18:02.986704] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-24T22:18:02.989431] [INFO ] [MAIN ] Derivative Progress: 364/2075 symbols completed. CIF took 1.1s. Estimated remaining: 11m 18s. Rate: 151.4 symbols/min [2025-09-24T22:18:02.990884] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:03.010394] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:03.011729] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52083 primary records. [2025-09-24T22:18:03.012826] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-24T22:18:03.042274] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-24T22:18:03.041223] [DEBUG] [LOCAL ] CII: Loaded 15476 existing records from primary storage. [2025-09-24T22:18:03.042467] [INFO ] [MAIN ] CII: Loaded 15476 primary data records. [2025-09-24T22:18:03.042916] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-24T22:18:03.057026] [INFO ] [MAIN ] Derivative Progress: 365/2075 symbols completed. CIEN took 1.2s. Estimated remaining: 11m 16s. Rate: 151.7 symbols/min [2025-09-24T22:18:03.101428] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:03.170925] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:03.187555] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43740 primary records. [2025-09-24T22:18:03.187814] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-24T22:18:03.448809] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-24T22:18:03.449035] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-24T22:18:03.449930] [DEBUG] [LOCAL ] CIM: Loaded 37312 existing records from primary storage. [2025-09-24T22:18:03.453304] [INFO ] [MAIN ] CIM: Loaded 37312 primary data records. [2025-09-24T22:18:03.452473] [INFO ] [MAIN ] Derivative Progress: 366/2075 symbols completed. CIG took 1.3s. Estimated remaining: 11m 16s. Rate: 151.7 symbols/min [2025-09-24T22:18:03.453984] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:03.546951] [DEBUG] [LOCAL ] CIMN: Loaded 2666 existing records from primary storage. [2025-09-24T22:18:03.566230] [INFO ] [MAIN ] CIMN: Loaded 2666 primary data records. [2025-09-24T22:18:03.993879] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:04.011234] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15476 primary records. [2025-09-24T22:18:04.011401] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-24T22:18:04.188945] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-24T22:18:04.189324] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-24T22:18:04.192400] [INFO ] [MAIN ] Derivative Progress: 367/2075 symbols completed. CII took 1.2s. Estimated remaining: 11m 17s. Rate: 151.4 symbols/min [2025-09-24T22:18:04.192944] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:04.224312] [DEBUG] [MAIN ] CIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:04.225502] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37312 primary records. [2025-09-24T22:18:04.226700] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-24T22:18:04.244842] [DEBUG] [LOCAL ] CINT: Loaded 18484 existing records from primary storage. [2025-09-24T22:18:04.250392] [INFO ] [MAIN ] CINT: Loaded 18484 primary data records. [2025-09-24T22:18:04.261528] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-24T22:18:04.266776] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:04.266976] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-24T22:18:04.281253] [INFO ] [MAIN ] Derivative Progress: 368/2075 symbols completed. CIM took 1.2s. Estimated remaining: 11m 15s. Rate: 151.7 symbols/min [2025-09-24T22:18:04.302892] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:04.292174] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2666 primary records. [2025-09-24T22:18:04.315864] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-24T22:18:04.407209] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-09-24T22:18:04.407601] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-24T22:18:04.410149] [INFO ] [MAIN ] Derivative Progress: 369/2075 symbols completed. CIMN took 1.0s. Estimated remaining: 11m 13s. Rate: 152.0 symbols/min [2025-09-24T22:18:04.426974] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:04.594850] [DEBUG] [LOCAL ] CIO: Loaded 20031 existing records from primary storage. [2025-09-24T22:18:04.626426] [INFO ] [MAIN ] CIO: Loaded 20031 primary data records. [2025-09-24T22:18:04.984363] [DEBUG] [LOCAL ] CIVI: Loaded 52587 existing records from primary storage. [2025-09-24T22:18:04.985182] [INFO ] [MAIN ] CIVI: Loaded 52587 primary data records. [2025-09-24T22:18:05.135183] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:05.164776] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18484 primary records. [2025-09-24T22:18:05.196363] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-24T22:18:05.331923] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-24T22:18:05.332248] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-24T22:18:05.336087] [INFO ] [MAIN ] Derivative Progress: 370/2075 symbols completed. CINT took 1.1s. Estimated remaining: 11m 16s. Rate: 151.4 symbols/min [2025-09-24T22:18:05.337819] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:05.356841] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:05.358132] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20031 primary records. [2025-09-24T22:18:05.358346] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-24T22:18:05.375059] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-24T22:18:05.375358] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-24T22:18:05.377988] [INFO ] [MAIN ] Derivative Progress: 371/2075 symbols completed. CIO took 1.1s. Estimated remaining: 11m 14s. Rate: 151.8 symbols/min [2025-09-24T22:18:05.378718] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:05.394975] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:05.395781] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52587 primary records. [2025-09-24T22:18:05.395899] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-24T22:18:05.426884] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-24T22:18:05.426962] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-24T22:18:05.429280] [INFO ] [MAIN ] Derivative Progress: 372/2075 symbols completed. CIVI took 1.0s. Estimated remaining: 11m 12s. Rate: 152.2 symbols/min [2025-09-24T22:18:05.429727] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:05.470757] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-24T22:18:05.471852] [INFO ] [MAIN ] CL: Loaded 53644 primary data records. [2025-09-24T22:18:05.476866] [DEBUG] [LOCAL ] CLCO: Loaded 12868 existing records from primary storage. [2025-09-24T22:18:05.471491] [DEBUG] [LOCAL ] CLB: Loaded 33033 existing records from primary storage. [2025-09-24T22:18:05.488384] [INFO ] [MAIN ] CLCO: Loaded 12868 primary data records. [2025-09-24T22:18:05.514349] [INFO ] [MAIN ] CLB: Loaded 33033 primary data records. [2025-09-24T22:18:06.501861] [DEBUG] [MAIN ] CLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:06.507585] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12868 primary records. [2025-09-24T22:18:06.520903] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-24T22:18:06.515636] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:06.522639] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33033 primary records. [2025-09-24T22:18:06.522779] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-24T22:18:06.521513] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:06.523994] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53644 primary records. [2025-09-24T22:18:06.524527] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-24T22:18:06.570829] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-09-24T22:18:06.572536] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-24T22:18:06.572773] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-24T22:18:06.575914] [INFO ] [MAIN ] Derivative Progress: 373/2075 symbols completed. CLB took 1.2s. Estimated remaining: 11m 15s. Rate: 151.4 symbols/min [2025-09-24T22:18:06.576088] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-24T22:18:06.579242] [INFO ] [MAIN ] Derivative Progress: 374/2075 symbols completed. CL took 1.2s. Estimated remaining: 11m 12s. Rate: 151.8 symbols/min [2025-09-24T22:18:06.581131] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-24T22:18:06.581300] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-24T22:18:06.583909] [INFO ] [MAIN ] Derivative Progress: 375/2075 symbols completed. CLCO took 1.2s. Estimated remaining: 11m 10s. Rate: 152.2 symbols/min [2025-09-24T22:18:06.584777] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:06.584905] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:06.584633] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:06.600311] [DEBUG] [LOCAL ] CLPR: Loaded 11546 existing records from primary storage. [2025-09-24T22:18:06.600541] [INFO ] [MAIN ] CLPR: Loaded 11546 primary data records. [2025-09-24T22:18:06.834500] [DEBUG] [LOCAL ] CLH: Loaded 28056 existing records from primary storage. [2025-09-24T22:18:06.944735] [INFO ] [MAIN ] CLH: Loaded 28056 primary data records. [2025-09-24T22:18:07.001312] [DEBUG] [LOCAL ] CLS: Loaded 53636 existing records from primary storage. [2025-09-24T22:18:07.014826] [INFO ] [MAIN ] CLS: Loaded 53636 primary data records. [2025-09-24T22:18:07.678262] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:07.679506] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11546 primary records. [2025-09-24T22:18:07.679801] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-24T22:18:07.698603] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-24T22:18:07.699099] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-24T22:18:07.701761] [INFO ] [MAIN ] Derivative Progress: 376/2075 symbols completed. CLPR took 1.1s. Estimated remaining: 11m 13s. Rate: 151.4 symbols/min [2025-09-24T22:18:07.702416] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:07.722960] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:07.724761] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 28056 primary records. [2025-09-24T22:18:07.725031] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-24T22:18:07.746216] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:07.751377] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53636 primary records. [2025-09-24T22:18:07.756385] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-24T22:18:07.756205] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-24T22:18:07.756530] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-24T22:18:07.758723] [INFO ] [MAIN ] Derivative Progress: 377/2075 symbols completed. CLH took 1.2s. Estimated remaining: 11m 11s. Rate: 151.8 symbols/min [2025-09-24T22:18:07.760279] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:07.791919] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-24T22:18:07.792205] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-24T22:18:07.794894] [INFO ] [MAIN ] Derivative Progress: 378/2075 symbols completed. CLS took 1.2s. Estimated remaining: 11m 9s. Rate: 152.2 symbols/min [2025-09-24T22:18:07.795300] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:07.819274] [DEBUG] [LOCAL ] CLVT: Loaded 51953 existing records from primary storage. [2025-09-24T22:18:07.819534] [INFO ] [MAIN ] CLVT: Loaded 51953 primary data records. [2025-09-24T22:18:07.899158] [DEBUG] [LOCAL ] CLW: Loaded 21898 existing records from primary storage. [2025-09-24T22:18:07.910918] [INFO ] [MAIN ] CLW: Loaded 21898 primary data records. [2025-09-24T22:18:08.291498] [DEBUG] [LOCAL ] CLX: Loaded 51425 existing records from primary storage. [2025-09-24T22:18:08.315120] [INFO ] [MAIN ] CLX: Loaded 51425 primary data records. [2025-09-24T22:18:08.838934] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:08.840103] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51953 primary records. [2025-09-24T22:18:08.840490] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-24T22:18:08.860740] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-24T22:18:08.861023] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-24T22:18:08.875378] [INFO ] [MAIN ] Derivative Progress: 379/2075 symbols completed. CLVT took 1.2s. Estimated remaining: 11m 12s. Rate: 151.5 symbols/min [2025-09-24T22:18:08.876367] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:08.877789] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21898 primary records. [2025-09-24T22:18:08.878215] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:08.878323] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-24T22:18:08.896470] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-24T22:18:08.897232] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-24T22:18:08.901887] [INFO ] [MAIN ] Derivative Progress: 380/2075 symbols completed. CLW took 1.1s. Estimated remaining: 11m 10s. Rate: 151.8 symbols/min [2025-09-24T22:18:08.903333] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:08.916971] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:08.917905] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51425 primary records. [2025-09-24T22:18:08.918006] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-24T22:18:08.941464] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-24T22:18:08.941785] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-24T22:18:08.944972] [INFO ] [MAIN ] Derivative Progress: 381/2075 symbols completed. CLX took 1.1s. Estimated remaining: 11m 8s. Rate: 152.2 symbols/min [2025-09-24T22:18:08.945485] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:08.955958] [DEBUG] [LOCAL ] CMBT: Loaded 22204 existing records from primary storage. [2025-09-24T22:18:08.956224] [INFO ] [MAIN ] CMBT: Loaded 22204 primary data records. [2025-09-24T22:18:09.308699] [DEBUG] [LOCAL ] CMA: Loaded 50097 existing records from primary storage. [2025-09-24T22:18:09.309700] [INFO ] [MAIN ] CMA: Loaded 50097 primary data records. [2025-09-24T22:18:09.331833] [DEBUG] [LOCAL ] CMC: Loaded 45646 existing records from primary storage. [2025-09-24T22:18:09.342120] [INFO ] [MAIN ] CMC: Loaded 45646 primary data records. [2025-09-24T22:18:10.032634] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:10.034238] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 22204 primary records. [2025-09-24T22:18:10.034570] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-24T22:18:10.069242] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-24T22:18:10.069849] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-24T22:18:10.071130] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:10.074122] [INFO ] [MAIN ] Derivative Progress: 382/2075 symbols completed. CMBT took 1.2s. Estimated remaining: 11m 11s. Rate: 151.5 symbols/min [2025-09-24T22:18:10.075695] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50097 primary records. [2025-09-24T22:18:10.076377] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:10.076528] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-24T22:18:10.093045] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:10.107007] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45646 primary records. [2025-09-24T22:18:10.110239] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-24T22:18:10.113328] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-24T22:18:10.113531] [DEBUG] [LOCAL ] CMCM: Loaded 4756 existing records from primary storage. [2025-09-24T22:18:10.113715] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-24T22:18:10.117223] [INFO ] [MAIN ] CMCM: Loaded 4756 primary data records. [2025-09-24T22:18:10.116923] [INFO ] [MAIN ] Derivative Progress: 383/2075 symbols completed. CMA took 1.2s. Estimated remaining: 11m 9s. Rate: 151.8 symbols/min [2025-09-24T22:18:10.178057] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:10.183491] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-24T22:18:10.194561] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-24T22:18:10.202430] [INFO ] [MAIN ] Derivative Progress: 384/2075 symbols completed. CMC took 1.3s. Estimated remaining: 11m 7s. Rate: 152.1 symbols/min [2025-09-24T22:18:10.219433] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:10.503766] [DEBUG] [LOCAL ] CMPO: Loaded 39590 existing records from primary storage. [2025-09-24T22:18:10.504198] [INFO ] [MAIN ] CMPO: Loaded 39590 primary data records. [2025-09-24T22:18:10.623725] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-24T22:18:10.625159] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-09-24T22:18:10.796052] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:10.943612] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4756 primary records. [2025-09-24T22:18:10.955150] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-24T22:18:11.173951] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-09-24T22:18:11.174266] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-24T22:18:11.176486] [INFO ] [MAIN ] Derivative Progress: 385/2075 symbols completed. CMCM took 1.1s. Estimated remaining: 11m 9s. Rate: 151.5 symbols/min [2025-09-24T22:18:11.177144] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:11.204794] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:11.205815] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 39590 primary records. [2025-09-24T22:18:11.206172] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-24T22:18:11.235358] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-09-24T22:18:11.235921] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-24T22:18:11.261246] [DEBUG] [MAIN ] CMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:11.260798] [INFO ] [MAIN ] Derivative Progress: 386/2075 symbols completed. CMPO took 1.0s. Estimated remaining: 11m 7s. Rate: 151.8 symbols/min [2025-09-24T22:18:11.263425] [DEBUG] [LOCAL ] CMRE: Loaded 35469 existing records from primary storage. [2025-09-24T22:18:11.262424] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:11.263534] [INFO ] [MAIN ] CMRE: Loaded 35469 primary data records. [2025-09-24T22:18:11.262210] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-09-24T22:18:11.263772] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-24T22:18:11.386180] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-24T22:18:11.390172] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-24T22:18:11.393072] [INFO ] [MAIN ] Derivative Progress: 387/2075 symbols completed. CMG took 1.3s. Estimated remaining: 11m 6s. Rate: 152.1 symbols/min [2025-09-24T22:18:11.393636] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:11.605571] [DEBUG] [LOCAL ] CMSC: Loaded 5072 existing records from primary storage. [2025-09-24T22:18:11.605789] [INFO ] [MAIN ] CMSC: Loaded 5072 primary data records. [2025-09-24T22:18:11.737164] [DEBUG] [LOCAL ] CMS: Loaded 52599 existing records from primary storage. [2025-09-24T22:18:11.760576] [INFO ] [MAIN ] CMS: Loaded 52599 primary data records. [2025-09-24T22:18:12.321252] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:12.323015] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35469 primary records. [2025-09-24T22:18:12.323935] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-24T22:18:12.354909] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-24T22:18:12.360325] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:12.361152] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5072 primary records. [2025-09-24T22:18:12.359942] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-24T22:18:12.363453] [INFO ] [MAIN ] Derivative Progress: 388/2075 symbols completed. CMRE took 1.2s. Estimated remaining: 11m 8s. Rate: 151.5 symbols/min [2025-09-24T22:18:12.361338] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-24T22:18:12.380930] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-24T22:18:12.381161] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-24T22:18:12.383581] [INFO ] [MAIN ] Derivative Progress: 389/2075 symbols completed. CMSC took 1.0s. Estimated remaining: 11m 6s. Rate: 151.9 symbols/min [2025-09-24T22:18:12.398394] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:12.398978] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52599 primary records. [2025-09-24T22:18:12.399040] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-24T22:18:12.414093] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-24T22:18:12.414158] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-24T22:18:12.416963] [INFO ] [MAIN ] Derivative Progress: 390/2075 symbols completed. CMS took 1.2s. Estimated remaining: 11m 4s. Rate: 152.3 symbols/min [2025-09-24T22:18:12.417463] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:12.417610] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:12.418763] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:12.429176] [DEBUG] [LOCAL ] CMSD: Loaded 8101 existing records from primary storage. [2025-09-24T22:18:12.429326] [INFO ] [MAIN ] CMSD: Loaded 8101 primary data records. [2025-09-24T22:18:12.527246] [DEBUG] [LOCAL ] CMU: Loaded 7267 existing records from primary storage. [2025-09-24T22:18:12.545131] [INFO ] [MAIN ] CMU: Loaded 7267 primary data records. [2025-09-24T22:18:12.894401] [DEBUG] [LOCAL ] CMTG: Loaded 37547 existing records from primary storage. [2025-09-24T22:18:12.925021] [INFO ] [MAIN ] CMTG: Loaded 37547 primary data records. [2025-09-24T22:18:13.429722] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:13.431145] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8101 primary records. [2025-09-24T22:18:13.431241] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-24T22:18:13.464688] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:13.466577] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 7267 primary records. [2025-09-24T22:18:13.466844] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-24T22:18:13.468189] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-09-24T22:18:13.468567] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-24T22:18:13.470972] [INFO ] [MAIN ] Derivative Progress: 391/2075 symbols completed. CMSD took 1.1s. Estimated remaining: 11m 6s. Rate: 151.6 symbols/min [2025-09-24T22:18:13.478944] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:13.486981] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-24T22:18:13.487215] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-24T22:18:13.489699] [INFO ] [MAIN ] Derivative Progress: 392/2075 symbols completed. CMU took 1.1s. Estimated remaining: 11m 4s. Rate: 152.0 symbols/min [2025-09-24T22:18:13.492339] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:13.507195] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:13.507947] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37547 primary records. [2025-09-24T22:18:13.508012] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-24T22:18:13.524413] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-24T22:18:13.524782] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-24T22:18:13.527635] [INFO ] [MAIN ] Derivative Progress: 393/2075 symbols completed. CMTG took 1.1s. Estimated remaining: 11m 2s. Rate: 152.3 symbols/min [2025-09-24T22:18:13.528064] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:13.549195] [DEBUG] [LOCAL ] CNF: Loaded 10918 existing records from primary storage. [2025-09-24T22:18:13.549331] [INFO ] [MAIN ] CNF: Loaded 10918 primary data records. [2025-09-24T22:18:13.690166] [DEBUG] [LOCAL ] CNA: Loaded 32762 existing records from primary storage. [2025-09-24T22:18:13.701473] [INFO ] [MAIN ] CNA: Loaded 32762 primary data records. [2025-09-24T22:18:14.050360] [DEBUG] [LOCAL ] CNC: Loaded 53738 existing records from primary storage. [2025-09-24T22:18:14.067446] [INFO ] [MAIN ] CNC: Loaded 53738 primary data records. [2025-09-24T22:18:14.652801] [DEBUG] [MAIN ] CNF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:18:14.654014] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10918 primary records. [2025-09-24T22:18:14.654528] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-24T22:18:14.688250] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:14.690737] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32762 primary records. [2025-09-24T22:18:14.690891] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-09-24T22:18:14.691142] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-24T22:18:14.691061] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-24T22:18:14.694354] [INFO ] [MAIN ] Derivative Progress: 394/2075 symbols completed. CNF took 1.2s. Estimated remaining: 11m 5s. Rate: 151.6 symbols/min [2025-09-24T22:18:14.709071] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:14.737863] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:14.739713] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53738 primary records. [2025-09-24T22:18:14.739891] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-24T22:18:14.739786] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-24T22:18:14.740947] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-24T22:18:14.743998] [INFO ] [MAIN ] Derivative Progress: 395/2075 symbols completed. CNA took 1.3s. Estimated remaining: 11m 4s. Rate: 151.9 symbols/min [2025-09-24T22:18:14.752189] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:14.762947] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-24T22:18:14.763259] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-24T22:18:14.767048] [INFO ] [MAIN ] Derivative Progress: 396/2075 symbols completed. CNC took 1.3s. Estimated remaining: 11m 2s. Rate: 152.3 symbols/min [2025-09-24T22:18:14.767356] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:14.859407] [DEBUG] [LOCAL ] CNH: Loaded 53559 existing records from primary storage. [2025-09-24T22:18:14.860204] [INFO ] [MAIN ] CNH: Loaded 53559 primary data records. [2025-09-24T22:18:14.941478] [DEBUG] [LOCAL ] CNK: Loaded 52902 existing records from primary storage. [2025-09-24T22:18:14.982817] [INFO ] [MAIN ] CNK: Loaded 52902 primary data records. [2025-09-24T22:18:14.989928] [DEBUG] [LOCAL ] CNI: Loaded 51659 existing records from primary storage. [2025-09-24T22:18:14.997493] [INFO ] [MAIN ] CNI: Loaded 51659 primary data records. [2025-09-24T22:18:15.910826] [DEBUG] [MAIN ] CNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:15.911956] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53559 primary records. [2025-09-24T22:18:15.912165] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-24T22:18:15.959966] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:15.954789] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-24T22:18:15.960263] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-24T22:18:15.962405] [INFO ] [MAIN ] Derivative Progress: 397/2075 symbols completed. CNH took 1.3s. Estimated remaining: 11m 5s. Rate: 151.5 symbols/min [2025-09-24T22:18:15.963472] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51659 primary records. [2025-09-24T22:18:15.963928] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:15.963636] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-24T22:18:15.960578] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:15.965978] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52902 primary records. [2025-09-24T22:18:15.966057] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-24T22:18:15.997494] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-24T22:18:15.997903] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-24T22:18:16.001085] [INFO ] [MAIN ] Derivative Progress: 398/2075 symbols completed. CNI took 1.3s. Estimated remaining: 11m 3s. Rate: 151.8 symbols/min [2025-09-24T22:18:16.001683] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:16.004345] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-24T22:18:16.004531] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-24T22:18:16.007227] [INFO ] [MAIN ] Derivative Progress: 399/2075 symbols completed. CNK took 1.2s. Estimated remaining: 11m 1s. Rate: 152.2 symbols/min [2025-09-24T22:18:16.007936] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:16.077432] [DEBUG] [LOCAL ] CNM: Loaded 50969 existing records from primary storage. [2025-09-24T22:18:16.078552] [INFO ] [MAIN ] CNM: Loaded 50969 primary data records. [2025-09-24T22:18:16.079214] [DEBUG] [LOCAL ] CNNE: Loaded 36748 existing records from primary storage. [2025-09-24T22:18:16.117211] [INFO ] [MAIN ] CNNE: Loaded 36748 primary data records. [2025-09-24T22:18:16.262162] [DEBUG] [LOCAL ] CNMD: Loaded 32356 existing records from primary storage. [2025-09-24T22:18:16.284738] [INFO ] [MAIN ] CNMD: Loaded 32356 primary data records. [2025-09-24T22:18:17.091928] [DEBUG] [MAIN ] CNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:17.105689] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50969 primary records. [2025-09-24T22:18:17.106475] [DEBUG] [MAIN ] CNNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:17.107339] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36748 primary records. [2025-09-24T22:18:17.106195] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-24T22:18:17.107431] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-24T22:18:17.149555] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:17.151824] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32356 primary records. [2025-09-24T22:18:17.152205] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-24T22:18:17.172068] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-24T22:18:17.172713] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-09-24T22:18:17.172817] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-24T22:18:17.173471] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-24T22:18:17.176236] [INFO ] [MAIN ] Derivative Progress: 400/2075 symbols completed. CNMD took 1.2s. Estimated remaining: 11m 3s. Rate: 151.5 symbols/min [2025-09-24T22:18:17.176770] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-24T22:18:17.178941] [INFO ] [MAIN ] Derivative Progress: 401/2075 symbols completed. CNNE took 1.2s. Estimated remaining: 11m 1s. Rate: 151.9 symbols/min [2025-09-24T22:18:17.179072] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:17.179319] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-24T22:18:17.179908] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:17.182040] [INFO ] [MAIN ] Derivative Progress: 402/2075 symbols completed. CNM took 1.2s. Estimated remaining: 10m 59s. Rate: 152.2 symbols/min [2025-09-24T22:18:17.182723] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:17.262924] [DEBUG] [LOCAL ] CNO: Loaded 41382 existing records from primary storage. [2025-09-24T22:18:17.278811] [INFO ] [MAIN ] CNO: Loaded 41382 primary data records. [2025-09-24T22:18:17.325510] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-24T22:18:17.364427] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-24T22:18:17.472298] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-24T22:18:17.492028] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-09-24T22:18:18.341620] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:18.342991] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 41382 primary records. [2025-09-24T22:18:18.343426] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-24T22:18:18.365625] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-09-24T22:18:18.366067] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-24T22:18:18.392671] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:18.387596] [INFO ] [MAIN ] Derivative Progress: 403/2075 symbols completed. CNO took 1.2s. Estimated remaining: 11m 2s. Rate: 151.5 symbols/min [2025-09-24T22:18:18.393802] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-09-24T22:18:18.393906] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-24T22:18:18.394754] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:18.396029] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-24T22:18:18.396124] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-24T22:18:18.428379] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-24T22:18:18.428885] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-24T22:18:18.431383] [INFO ] [MAIN ] Derivative Progress: 404/2075 symbols completed. CNQ took 1.2s. Estimated remaining: 11m 1s. Rate: 151.8 symbols/min [2025-09-24T22:18:18.431742] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-24T22:18:18.431914] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-24T22:18:18.434429] [INFO ] [MAIN ] Derivative Progress: 405/2075 symbols completed. CNP took 1.3s. Estimated remaining: 10m 58s. Rate: 152.2 symbols/min [2025-09-24T22:18:18.434961] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:18.435060] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:18.435106] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:18.494392] [DEBUG] [LOCAL ] CODI: Loaded 39726 existing records from primary storage. [2025-09-24T22:18:18.494726] [INFO ] [MAIN ] CODI: Loaded 39726 primary data records. [2025-09-24T22:18:18.647171] [DEBUG] [LOCAL ] CNX: Loaded 51382 existing records from primary storage. [2025-09-24T22:18:18.647781] [INFO ] [MAIN ] CNX: Loaded 51382 primary data records. [2025-09-24T22:18:18.645947] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-24T22:18:18.663509] [INFO ] [MAIN ] COF: Loaded 53610 primary data records. [2025-09-24T22:18:19.511533] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:19.512946] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39726 primary records. [2025-09-24T22:18:19.513369] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-24T22:18:19.549217] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-24T22:18:19.549743] [DEBUG] [MAIN ] CNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:19.550732] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51382 primary records. [2025-09-24T22:18:19.549400] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-24T22:18:19.550949] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-24T22:18:19.565357] [INFO ] [MAIN ] Derivative Progress: 406/2075 symbols completed. CODI took 1.1s. Estimated remaining: 11m 1s. Rate: 151.5 symbols/min [2025-09-24T22:18:19.565879] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:19.566095] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:19.566940] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53610 primary records. [2025-09-24T22:18:19.568231] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-24T22:18:19.597858] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-24T22:18:19.600684] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-24T22:18:19.603596] [INFO ] [MAIN ] Derivative Progress: 407/2075 symbols completed. COF took 1.2s. Estimated remaining: 10m 59s. Rate: 151.8 symbols/min [2025-09-24T22:18:19.604392] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-24T22:18:19.604813] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-24T22:18:19.604748] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:19.607146] [INFO ] [MAIN ] Derivative Progress: 408/2075 symbols completed. CNX took 1.2s. Estimated remaining: 10m 57s. Rate: 152.2 symbols/min [2025-09-24T22:18:19.607803] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:19.662905] [DEBUG] [LOCAL ] COHR: Loaded 53364 existing records from primary storage. [2025-09-24T22:18:19.677424] [INFO ] [MAIN ] COHR: Loaded 53364 primary data records. [2025-09-24T22:18:19.742874] [DEBUG] [LOCAL ] CON: Loaded 38732 existing records from primary storage. [2025-09-24T22:18:19.771079] [INFO ] [MAIN ] CON: Loaded 38732 primary data records. [2025-09-24T22:18:19.848826] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-24T22:18:19.878183] [INFO ] [MAIN ] COMP: Loaded 53386 primary data records. [2025-09-24T22:18:20.800501] [DEBUG] [MAIN ] CON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:20.803992] [DEBUG] [MAIN ] COHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:20.802568] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38732 primary records. [2025-09-24T22:18:20.804983] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53364 primary records. [2025-09-24T22:18:20.805822] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-24T22:18:20.805935] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-24T22:18:20.851294] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-24T22:18:20.852164] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-24T22:18:20.856242] [INFO ] [MAIN ] Derivative Progress: 409/2075 symbols completed. CON took 1.2s. Estimated remaining: 11m 0s. Rate: 151.4 symbols/min [2025-09-24T22:18:20.852936] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:20.857996] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:20.857606] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53386 primary records. [2025-09-24T22:18:20.859504] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-24T22:18:20.869350] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-24T22:18:20.870624] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-24T22:18:20.872635] [INFO ] [MAIN ] Derivative Progress: 410/2075 symbols completed. COHR took 1.3s. Estimated remaining: 10m 58s. Rate: 151.7 symbols/min [2025-09-24T22:18:20.879736] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:20.880873] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-09-24T22:18:20.881319] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-24T22:18:20.884796] [INFO ] [MAIN ] Derivative Progress: 411/2075 symbols completed. COMP took 1.3s. Estimated remaining: 10m 56s. Rate: 152.1 symbols/min [2025-09-24T22:18:20.885204] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:20.906869] [DEBUG] [LOCAL ] COOK: Loaded 24510 existing records from primary storage. [2025-09-24T22:18:20.907018] [INFO ] [MAIN ] COOK: Loaded 24510 primary data records. [2025-09-24T22:18:21.157853] [DEBUG] [LOCAL ] COR: Loaded 47251 existing records from primary storage. [2025-09-24T22:18:21.279631] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-24T22:18:21.279836] [INFO ] [MAIN ] COR: Loaded 47251 primary data records. [2025-09-24T22:18:21.280069] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-24T22:18:21.946144] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:21.948332] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24510 primary records. [2025-09-24T22:18:21.948731] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-24T22:18:21.972813] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-24T22:18:21.974158] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-24T22:18:21.977420] [INFO ] [MAIN ] Derivative Progress: 412/2075 symbols completed. COOK took 1.1s. Estimated remaining: 10m 59s. Rate: 151.4 symbols/min [2025-09-24T22:18:21.979046] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:22.007270] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:22.008909] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47251 primary records. [2025-09-24T22:18:22.007932] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:22.010005] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-24T22:18:22.009039] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-24T22:18:22.010601] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-24T22:18:22.043592] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-24T22:18:22.044523] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-24T22:18:22.047469] [INFO ] [MAIN ] Derivative Progress: 413/2075 symbols completed. COR took 1.2s. Estimated remaining: 10m 57s. Rate: 151.7 symbols/min [2025-09-24T22:18:22.048057] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:22.049206] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-24T22:18:22.049490] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-24T22:18:22.052227] [INFO ] [MAIN ] Derivative Progress: 414/2075 symbols completed. COP took 1.2s. Estimated remaining: 10m 55s. Rate: 152.1 symbols/min [2025-09-24T22:18:22.067793] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:22.091070] [DEBUG] [LOCAL ] COTY: Loaded 53254 existing records from primary storage. [2025-09-24T22:18:22.091325] [INFO ] [MAIN ] COTY: Loaded 53254 primary data records. [2025-09-24T22:18:22.494727] [DEBUG] [LOCAL ] CP: Loaded 53276 existing records from primary storage. [2025-09-24T22:18:22.503477] [INFO ] [MAIN ] CP: Loaded 53276 primary data records. [2025-09-24T22:18:22.493946] [DEBUG] [LOCAL ] COUR: Loaded 48958 existing records from primary storage. [2025-09-24T22:18:22.503771] [INFO ] [MAIN ] COUR: Loaded 48958 primary data records. [2025-09-24T22:18:23.172172] [DEBUG] [MAIN ] COTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:23.173501] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53254 primary records. [2025-09-24T22:18:23.174677] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-24T22:18:23.195475] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-09-24T22:18:23.196056] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-24T22:18:23.199076] [INFO ] [MAIN ] Derivative Progress: 415/2075 symbols completed. COTY took 1.2s. Estimated remaining: 10m 58s. Rate: 151.4 symbols/min [2025-09-24T22:18:23.199884] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:23.235716] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:23.235340] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:23.236841] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53276 primary records. [2025-09-24T22:18:23.237790] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48958 primary records. [2025-09-24T22:18:23.237018] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-24T22:18:23.238331] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-24T22:18:23.289211] [DEBUG] [LOCAL ] CPA: Loaded 28828 existing records from primary storage. [2025-09-24T22:18:23.290371] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-24T22:18:23.291264] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-24T22:18:23.291560] [INFO ] [MAIN ] CPA: Loaded 28828 primary data records. [2025-09-24T22:18:23.291677] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-24T22:18:23.293870] [INFO ] [MAIN ] Derivative Progress: 416/2075 symbols completed. CP took 1.2s. Estimated remaining: 10m 56s. Rate: 151.7 symbols/min [2025-09-24T22:18:23.293963] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-24T22:18:23.305883] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:23.309131] [INFO ] [MAIN ] Derivative Progress: 417/2075 symbols completed. COUR took 1.3s. Estimated remaining: 10m 54s. Rate: 152.0 symbols/min [2025-09-24T22:18:23.340787] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:23.500949] [DEBUG] [LOCAL ] CPF: Loaded 15464 existing records from primary storage. [2025-09-24T22:18:23.514792] [INFO ] [MAIN ] CPF: Loaded 15464 primary data records. [2025-09-24T22:18:23.535688] [DEBUG] [LOCAL ] CPAY: Loaded 30917 existing records from primary storage. [2025-09-24T22:18:23.657038] [INFO ] [MAIN ] CPAY: Loaded 30917 primary data records. [2025-09-24T22:18:24.381249] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:24.382453] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28828 primary records. [2025-09-24T22:18:24.383051] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-24T22:18:24.406670] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-24T22:18:24.406949] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-24T22:18:24.409205] [INFO ] [MAIN ] Derivative Progress: 418/2075 symbols completed. CPA took 1.2s. Estimated remaining: 10m 57s. Rate: 151.4 symbols/min [2025-09-24T22:18:24.440998] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:24.441358] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:24.443152] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30917 primary records. [2025-09-24T22:18:24.443243] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-24T22:18:24.442319] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15464 primary records. [2025-09-24T22:18:24.443815] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-24T22:18:24.473281] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-24T22:18:24.474000] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-24T22:18:24.478065] [INFO ] [MAIN ] Derivative Progress: 419/2075 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 55s. Rate: 151.7 symbols/min [2025-09-24T22:18:24.481861] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-24T22:18:24.482022] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-24T22:18:24.484798] [INFO ] [MAIN ] Derivative Progress: 420/2075 symbols completed. CPF took 1.2s. Estimated remaining: 10m 53s. Rate: 152.0 symbols/min [2025-09-24T22:18:24.485377] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:24.485673] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:24.485844] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:24.509928] [DEBUG] [LOCAL ] CPK: Loaded 13331 existing records from primary storage. [2025-09-24T22:18:24.510132] [INFO ] [MAIN ] CPK: Loaded 13331 primary data records. [2025-09-24T22:18:24.877970] [DEBUG] [LOCAL ] CPRI: Loaded 52566 existing records from primary storage. [2025-09-24T22:18:24.883333] [INFO ] [MAIN ] CPRI: Loaded 52566 primary data records. [2025-09-24T22:18:24.892628] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-24T22:18:24.904451] [INFO ] [MAIN ] CPNG: Loaded 53670 primary data records. [2025-09-24T22:18:25.578619] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:25.580059] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13331 primary records. [2025-09-24T22:18:25.580153] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-24T22:18:25.599096] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-24T22:18:25.599212] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-24T22:18:25.601582] [INFO ] [MAIN ] Derivative Progress: 421/2075 symbols completed. CPK took 1.1s. Estimated remaining: 10m 56s. Rate: 151.4 symbols/min [2025-09-24T22:18:25.602285] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:25.636587] [DEBUG] [MAIN ] CPNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:25.637018] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:25.638393] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52566 primary records. [2025-09-24T22:18:25.637784] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53670 primary records. [2025-09-24T22:18:25.638597] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-24T22:18:25.638538] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-24T22:18:25.682103] [DEBUG] [LOCAL ] CPS: Loaded 26208 existing records from primary storage. [2025-09-24T22:18:25.683333] [INFO ] [MAIN ] CPS: Loaded 26208 primary data records. [2025-09-24T22:18:25.722228] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-24T22:18:25.730366] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-09-24T22:18:25.735621] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-24T22:18:25.745011] [INFO ] [MAIN ] Derivative Progress: 422/2075 symbols completed. CPNG took 1.3s. Estimated remaining: 10m 54s. Rate: 151.6 symbols/min [2025-09-24T22:18:25.752633] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:25.760473] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-24T22:18:25.773776] [INFO ] [MAIN ] Derivative Progress: 423/2075 symbols completed. CPRI took 1.3s. Estimated remaining: 10m 52s. Rate: 151.9 symbols/min [2025-09-24T22:18:25.779855] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:26.003514] [DEBUG] [LOCAL ] CQP: Loaded 19841 existing records from primary storage. [2025-09-24T22:18:26.003700] [INFO ] [MAIN ] CQP: Loaded 19841 primary data records. [2025-09-24T22:18:26.143810] [DEBUG] [LOCAL ] CPT: Loaded 44379 existing records from primary storage. [2025-09-24T22:18:26.186379] [INFO ] [MAIN ] CPT: Loaded 44379 primary data records. [2025-09-24T22:18:26.734991] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:26.735979] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 26208 primary records. [2025-09-24T22:18:26.736114] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-24T22:18:26.755869] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-24T22:18:26.756377] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-24T22:18:26.758690] [INFO ] [MAIN ] Derivative Progress: 424/2075 symbols completed. CPS took 1.2s. Estimated remaining: 10m 54s. Rate: 151.4 symbols/min [2025-09-24T22:18:26.759063] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:26.778579] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:26.779699] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19841 primary records. [2025-09-24T22:18:26.780177] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-24T22:18:26.798988] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-24T22:18:26.800225] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-24T22:18:26.802574] [INFO ] [MAIN ] Derivative Progress: 425/2075 symbols completed. CQP took 1.0s. Estimated remaining: 10m 52s. Rate: 151.7 symbols/min [2025-09-24T22:18:26.803667] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:26.831435] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:26.832337] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44379 primary records. [2025-09-24T22:18:26.832482] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-24T22:18:26.849251] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-24T22:18:26.850096] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-24T22:18:26.852839] [INFO ] [MAIN ] Derivative Progress: 426/2075 symbols completed. CPT took 1.1s. Estimated remaining: 10m 51s. Rate: 152.0 symbols/min [2025-09-24T22:18:26.853139] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:26.872385] [DEBUG] [LOCAL ] CRBG: Loaded 52339 existing records from primary storage. [2025-09-24T22:18:26.872619] [INFO ] [MAIN ] CRBG: Loaded 52339 primary data records. [2025-09-24T22:18:27.234215] [DEBUG] [LOCAL ] CRC: Loaded 44323 existing records from primary storage. [2025-09-24T22:18:27.234447] [INFO ] [MAIN ] CRC: Loaded 44323 primary data records. [2025-09-24T22:18:27.358977] [DEBUG] [LOCAL ] CRGY: Loaded 52514 existing records from primary storage. [2025-09-24T22:18:27.359569] [INFO ] [MAIN ] CRGY: Loaded 52514 primary data records. [2025-09-24T22:18:27.884726] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:27.885990] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52339 primary records. [2025-09-24T22:18:27.886094] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-24T22:18:27.904110] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-24T22:18:27.906006] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-24T22:18:27.909493] [INFO ] [MAIN ] Derivative Progress: 427/2075 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 53s. Rate: 151.4 symbols/min [2025-09-24T22:18:27.910282] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:27.925113] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:27.925892] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44323 primary records. [2025-09-24T22:18:27.925992] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-24T22:18:27.945182] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-24T22:18:27.953061] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-24T22:18:27.960958] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:27.960415] [INFO ] [MAIN ] Derivative Progress: 428/2075 symbols completed. CRC took 1.2s. Estimated remaining: 10m 51s. Rate: 151.8 symbols/min [2025-09-24T22:18:27.961866] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52514 primary records. [2025-09-24T22:18:27.961969] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-24T22:18:27.962267] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:27.981057] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-24T22:18:27.981247] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-24T22:18:27.983581] [INFO ] [MAIN ] Derivative Progress: 429/2075 symbols completed. CRGY took 1.1s. Estimated remaining: 10m 49s. Rate: 152.1 symbols/min [2025-09-24T22:18:27.983927] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:28.054683] [DEBUG] [LOCAL ] CRH: Loaded 53468 existing records from primary storage. [2025-09-24T22:18:28.054984] [INFO ] [MAIN ] CRH: Loaded 53468 primary data records. [2025-09-24T22:18:28.084334] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-24T22:18:28.120369] [INFO ] [MAIN ] CRK: Loaded 52121 primary data records. [2025-09-24T22:18:28.171946] [DEBUG] [LOCAL ] CRL: Loaded 43211 existing records from primary storage. [2025-09-24T22:18:28.172149] [INFO ] [MAIN ] CRL: Loaded 43211 primary data records. [2025-09-24T22:18:29.053120] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:29.054245] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53468 primary records. [2025-09-24T22:18:29.055417] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-24T22:18:29.074005] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-24T22:18:29.074162] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-24T22:18:29.089425] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:29.089094] [INFO ] [MAIN ] Derivative Progress: 430/2075 symbols completed. CRH took 1.2s. Estimated remaining: 10m 52s. Rate: 151.5 symbols/min [2025-09-24T22:18:29.091260] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52121 primary records. [2025-09-24T22:18:29.092383] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-24T22:18:29.092311] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:29.123369] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-24T22:18:29.123088] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:29.123522] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-24T22:18:29.124625] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 43211 primary records. [2025-09-24T22:18:29.126995] [INFO ] [MAIN ] Derivative Progress: 431/2075 symbols completed. CRK took 1.2s. Estimated remaining: 10m 50s. Rate: 151.8 symbols/min [2025-09-24T22:18:29.124759] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-24T22:18:29.127314] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:29.148077] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-24T22:18:29.148349] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-24T22:18:29.150972] [INFO ] [MAIN ] Derivative Progress: 432/2075 symbols completed. CRL took 1.2s. Estimated remaining: 10m 48s. Rate: 152.1 symbols/min [2025-09-24T22:18:29.151358] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:29.178322] [DEBUG] [LOCAL ] CRT: Loaded 4954 existing records from primary storage. [2025-09-24T22:18:29.178476] [INFO ] [MAIN ] CRT: Loaded 4954 primary data records. [2025-09-24T22:18:29.315092] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-24T22:18:29.315805] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-24T22:18:29.506429] [DEBUG] [LOCAL ] CRS: Loaded 43297 existing records from primary storage. [2025-09-24T22:18:29.634278] [INFO ] [MAIN ] CRS: Loaded 43297 primary data records. [2025-09-24T22:18:30.164197] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:30.165514] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4954 primary records. [2025-09-24T22:18:30.165836] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-24T22:18:30.193063] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-24T22:18:30.198382] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:30.199279] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-24T22:18:30.198582] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-24T22:18:30.199504] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-24T22:18:30.201512] [INFO ] [MAIN ] Derivative Progress: 433/2075 symbols completed. CRT took 1.1s. Estimated remaining: 10m 50s. Rate: 151.5 symbols/min [2025-09-24T22:18:30.223441] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-24T22:18:30.223637] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-24T22:18:30.225992] [INFO ] [MAIN ] Derivative Progress: 434/2075 symbols completed. CRM took 1.1s. Estimated remaining: 10m 48s. Rate: 151.8 symbols/min [2025-09-24T22:18:30.238529] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:30.239146] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43297 primary records. [2025-09-24T22:18:30.239207] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-24T22:18:30.254556] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-24T22:18:30.254617] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-24T22:18:30.257074] [INFO ] [MAIN ] Derivative Progress: 435/2075 symbols completed. CRS took 1.1s. Estimated remaining: 10m 47s. Rate: 152.2 symbols/min [2025-09-24T22:18:30.257814] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:30.257728] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:30.257989] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:30.275269] [DEBUG] [LOCAL ] CSR: Loaded 12575 existing records from primary storage. [2025-09-24T22:18:30.275421] [INFO ] [MAIN ] CSR: Loaded 12575 primary data records. [2025-09-24T22:18:30.510312] [DEBUG] [LOCAL ] CSAN: Loaded 42311 existing records from primary storage. [2025-09-24T22:18:30.510574] [INFO ] [MAIN ] CSAN: Loaded 42311 primary data records. [2025-09-24T22:18:30.511078] [DEBUG] [LOCAL ] CSL: Loaded 31600 existing records from primary storage. [2025-09-24T22:18:30.646813] [INFO ] [MAIN ] CSL: Loaded 31600 primary data records. [2025-09-24T22:18:31.303432] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:31.304304] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12575 primary records. [2025-09-24T22:18:31.304513] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-24T22:18:31.324462] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-24T22:18:31.325206] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-24T22:18:31.327406] [INFO ] [MAIN ] Derivative Progress: 436/2075 symbols completed. CSR took 1.1s. Estimated remaining: 10m 49s. Rate: 151.6 symbols/min [2025-09-24T22:18:31.328242] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:31.348781] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:31.350422] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42311 primary records. [2025-09-24T22:18:31.350733] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-24T22:18:31.372464] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:31.376036] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31600 primary records. [2025-09-24T22:18:31.376168] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-24T22:18:31.394312] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-24T22:18:31.396024] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-24T22:18:31.398479] [INFO ] [MAIN ] Derivative Progress: 437/2075 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 47s. Rate: 151.9 symbols/min [2025-09-24T22:18:31.399092] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:31.412921] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-24T22:18:31.413190] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-24T22:18:31.415705] [INFO ] [MAIN ] Derivative Progress: 438/2075 symbols completed. CSL took 1.2s. Estimated remaining: 10m 45s. Rate: 152.2 symbols/min [2025-09-24T22:18:31.416155] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:31.427556] [DEBUG] [LOCAL ] CSV: Loaded 13045 existing records from primary storage. [2025-09-24T22:18:31.429438] [INFO ] [MAIN ] CSV: Loaded 13045 primary data records. [2025-09-24T22:18:31.530157] [DEBUG] [LOCAL ] CTBB: Loaded 7061 existing records from primary storage. [2025-09-24T22:18:31.518028] [DEBUG] [LOCAL ] CSTM: Loaded 47710 existing records from primary storage. [2025-09-24T22:18:31.549319] [INFO ] [MAIN ] CTBB: Loaded 7061 primary data records. [2025-09-24T22:18:31.573036] [INFO ] [MAIN ] CSTM: Loaded 47710 primary data records. [2025-09-24T22:18:32.405920] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:32.406789] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 13045 primary records. [2025-09-24T22:18:32.407099] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-24T22:18:32.427370] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-24T22:18:32.429206] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-24T22:18:32.432188] [INFO ] [MAIN ] Derivative Progress: 439/2075 symbols completed. CSV took 1.0s. Estimated remaining: 10m 47s. Rate: 151.6 symbols/min [2025-09-24T22:18:32.432850] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:32.446281] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:32.459908] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7061 primary records. [2025-09-24T22:18:32.460454] [DEBUG] [MAIN ] CSTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:32.461190] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47710 primary records. [2025-09-24T22:18:32.460617] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-24T22:18:32.461322] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-24T22:18:32.488152] [DEBUG] [LOCAL ] CTDD: Loaded 5838 existing records from primary storage. [2025-09-24T22:18:32.494797] [INFO ] [MAIN ] CTDD: Loaded 5838 primary data records. [2025-09-24T22:18:32.506736] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-24T22:18:32.516836] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-24T22:18:32.529923] [INFO ] [MAIN ] Derivative Progress: 440/2075 symbols completed. CTBB took 1.1s. Estimated remaining: 10m 46s. Rate: 151.9 symbols/min [2025-09-24T22:18:32.535638] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:32.585307] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-24T22:18:32.604723] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-24T22:18:32.610383] [INFO ] [MAIN ] Derivative Progress: 441/2075 symbols completed. CSTM took 1.3s. Estimated remaining: 10m 44s. Rate: 152.2 symbols/min [2025-09-24T22:18:32.616732] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:32.846611] [DEBUG] [LOCAL ] CTO: Loaded 28253 existing records from primary storage. [2025-09-24T22:18:32.854292] [INFO ] [MAIN ] CTO: Loaded 28253 primary data records. [2025-09-24T22:18:32.975261] [DEBUG] [LOCAL ] CTOS: Loaded 36721 existing records from primary storage. [2025-09-24T22:18:32.991774] [INFO ] [MAIN ] CTOS: Loaded 36721 primary data records. [2025-09-24T22:18:33.446408] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:33.509718] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5838 primary records. [2025-09-24T22:18:33.510724] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-24T22:18:33.531497] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-09-24T22:18:33.532766] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-24T22:18:33.535086] [INFO ] [MAIN ] Derivative Progress: 442/2075 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 46s. Rate: 151.7 symbols/min [2025-09-24T22:18:33.535342] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:33.560706] [DEBUG] [MAIN ] CTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:33.562191] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 28253 primary records. [2025-09-24T22:18:33.564144] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-24T22:18:33.593615] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:33.595239] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36721 primary records. [2025-09-24T22:18:33.595689] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-24T22:18:33.602940] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-24T22:18:33.613705] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-24T22:18:33.618288] [INFO ] [MAIN ] Derivative Progress: 443/2075 symbols completed. CTO took 1.1s. Estimated remaining: 10m 44s. Rate: 152.0 symbols/min [2025-09-24T22:18:33.620211] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:33.621098] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-24T22:18:33.621269] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-24T22:18:33.637776] [INFO ] [MAIN ] Derivative Progress: 444/2075 symbols completed. CTOS took 1.0s. Estimated remaining: 10m 42s. Rate: 152.3 symbols/min [2025-09-24T22:18:33.638299] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:33.660434] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-24T22:18:33.660677] [INFO ] [MAIN ] CTRA: Loaded 53649 primary data records. [2025-09-24T22:18:34.008271] [DEBUG] [LOCAL ] CTRI: Loaded 37887 existing records from primary storage. [2025-09-24T22:18:34.008466] [INFO ] [MAIN ] CTRI: Loaded 37887 primary data records. [2025-09-24T22:18:34.009488] [DEBUG] [LOCAL ] CTRE: Loaded 49225 existing records from primary storage. [2025-09-24T22:18:34.041330] [INFO ] [MAIN ] CTRE: Loaded 49225 primary data records. [2025-09-24T22:18:34.703469] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:34.705300] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53649 primary records. [2025-09-24T22:18:34.705546] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-24T22:18:34.736312] [DEBUG] [MAIN ] CTRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:34.737544] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 37887 primary records. [2025-09-24T22:18:34.738028] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-24T22:18:34.741611] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-24T22:18:34.753043] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-24T22:18:34.757020] [INFO ] [MAIN ] Derivative Progress: 445/2075 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 45s. Rate: 151.7 symbols/min [2025-09-24T22:18:34.757872] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:34.768190] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-24T22:18:34.775006] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:34.775797] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49225 primary records. [2025-09-24T22:18:34.774731] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-24T22:18:34.777968] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-24T22:18:34.777857] [INFO ] [MAIN ] Derivative Progress: 446/2075 symbols completed. CTRI took 1.1s. Estimated remaining: 10m 43s. Rate: 152.0 symbols/min [2025-09-24T22:18:34.778923] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:34.800890] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-24T22:18:34.801041] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-24T22:18:34.803458] [INFO ] [MAIN ] Derivative Progress: 447/2075 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 41s. Rate: 152.3 symbols/min [2025-09-24T22:18:34.803907] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:34.812025] [DEBUG] [LOCAL ] CTS: Loaded 19327 existing records from primary storage. [2025-09-24T22:18:34.812322] [INFO ] [MAIN ] CTS: Loaded 19327 primary data records. [2025-09-24T22:18:35.162351] [DEBUG] [LOCAL ] CTVA: Loaded 53225 existing records from primary storage. [2025-09-24T22:18:35.162744] [INFO ] [MAIN ] CTVA: Loaded 53225 primary data records. [2025-09-24T22:18:35.313810] [DEBUG] [LOCAL ] CUBE: Loaded 50695 existing records from primary storage. [2025-09-24T22:18:35.329163] [INFO ] [MAIN ] CUBE: Loaded 50695 primary data records. [2025-09-24T22:18:35.813835] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:35.815626] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19327 primary records. [2025-09-24T22:18:35.816283] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-24T22:18:35.852228] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-24T22:18:35.853050] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-24T22:18:35.852968] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:35.855624] [INFO ] [MAIN ] Derivative Progress: 448/2075 symbols completed. CTS took 1.1s. Estimated remaining: 10m 43s. Rate: 151.8 symbols/min [2025-09-24T22:18:35.856562] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53225 primary records. [2025-09-24T22:18:35.856793] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-24T22:18:35.886533] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:35.888269] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50695 primary records. [2025-09-24T22:18:35.888348] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-24T22:18:35.890369] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-09-24T22:18:35.897515] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-24T22:18:35.900326] [INFO ] [MAIN ] Derivative Progress: 449/2075 symbols completed. CTVA took 1.1s. Estimated remaining: 10m 42s. Rate: 152.1 symbols/min [2025-09-24T22:18:35.907369] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-24T22:18:35.907437] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-24T22:18:35.910102] [INFO ] [MAIN ] Derivative Progress: 450/2075 symbols completed. CUBE took 1.1s. Estimated remaining: 10m 40s. Rate: 152.4 symbols/min [2025-09-24T22:18:35.910916] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:35.910865] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:35.910721] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:35.918396] [DEBUG] [LOCAL ] CULP: Loaded 3045 existing records from primary storage. [2025-09-24T22:18:35.918686] [INFO ] [MAIN ] CULP: Loaded 3045 primary data records. [2025-09-24T22:18:36.107167] [DEBUG] [LOCAL ] CUBI: Loaded 27343 existing records from primary storage. [2025-09-24T22:18:36.142250] [INFO ] [MAIN ] CUBI: Loaded 27343 primary data records. [2025-09-24T22:18:36.396338] [DEBUG] [LOCAL ] CUK: Loaded 50995 existing records from primary storage. [2025-09-24T22:18:36.412426] [INFO ] [MAIN ] CUK: Loaded 50995 primary data records. [2025-09-24T22:18:36.965109] [DEBUG] [MAIN ] CULP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:36.966637] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 3045 primary records. [2025-09-24T22:18:36.966917] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-24T22:18:36.986294] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-09-24T22:18:36.986415] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-24T22:18:36.988744] [INFO ] [MAIN ] Derivative Progress: 451/2075 symbols completed. CULP took 1.1s. Estimated remaining: 10m 42s. Rate: 151.8 symbols/min [2025-09-24T22:18:37.001730] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:37.008097] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:37.009517] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27343 primary records. [2025-09-24T22:18:37.009744] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-24T22:18:37.039247] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:37.040275] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 50995 primary records. [2025-09-24T22:18:37.040620] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-24T22:18:37.065238] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-24T22:18:37.065857] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-24T22:18:37.068475] [INFO ] [MAIN ] Derivative Progress: 452/2075 symbols completed. CUBI took 1.2s. Estimated remaining: 10m 40s. Rate: 152.1 symbols/min [2025-09-24T22:18:37.069019] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:37.082620] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-24T22:18:37.083863] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-24T22:18:37.087494] [INFO ] [MAIN ] Derivative Progress: 453/2075 symbols completed. CUK took 1.2s. Estimated remaining: 10m 39s. Rate: 152.4 symbols/min [2025-09-24T22:18:37.087871] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:37.088970] [DEBUG] [LOCAL ] CURB: Loaded 32949 existing records from primary storage. [2025-09-24T22:18:37.089201] [INFO ] [MAIN ] CURB: Loaded 32949 primary data records. [2025-09-24T22:18:37.212871] [DEBUG] [LOCAL ] CURV: Loaded 26594 existing records from primary storage. [2025-09-24T22:18:37.224071] [INFO ] [MAIN ] CURV: Loaded 26594 primary data records. [2025-09-24T22:18:37.760790] [DEBUG] [LOCAL ] CUZ: Loaded 49420 existing records from primary storage. [2025-09-24T22:18:37.761382] [INFO ] [MAIN ] CUZ: Loaded 49420 primary data records. [2025-09-24T22:18:38.099745] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:38.100877] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32949 primary records. [2025-09-24T22:18:38.101235] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-24T22:18:38.122711] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-24T22:18:38.123251] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-24T22:18:38.125695] [INFO ] [MAIN ] Derivative Progress: 454/2075 symbols completed. CURB took 1.1s. Estimated remaining: 10m 40s. Rate: 151.9 symbols/min [2025-09-24T22:18:38.126293] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:38.143310] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:38.144317] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26594 primary records. [2025-09-24T22:18:38.144505] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-24T22:18:38.163988] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-09-24T22:18:38.164594] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-24T22:18:38.167360] [INFO ] [MAIN ] Derivative Progress: 455/2075 symbols completed. CURV took 1.1s. Estimated remaining: 10m 39s. Rate: 152.2 symbols/min [2025-09-24T22:18:38.167912] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:38.183998] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:38.184804] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49420 primary records. [2025-09-24T22:18:38.185009] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-24T22:18:38.225306] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-24T22:18:38.224916] [DEBUG] [LOCAL ] CVEO: Loaded 15263 existing records from primary storage. [2025-09-24T22:18:38.225517] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-24T22:18:38.228170] [INFO ] [MAIN ] Derivative Progress: 456/2075 symbols completed. CUZ took 1.1s. Estimated remaining: 10m 37s. Rate: 152.4 symbols/min [2025-09-24T22:18:38.228631] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:38.228394] [INFO ] [MAIN ] CVEO: Loaded 15263 primary data records. [2025-09-24T22:18:38.361671] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-09-24T22:18:38.368324] [INFO ] [MAIN ] CVE: Loaded 53556 primary data records. [2025-09-24T22:18:38.734899] [DEBUG] [LOCAL ] CVI: Loaded 46432 existing records from primary storage. [2025-09-24T22:18:38.746612] [INFO ] [MAIN ] CVI: Loaded 46432 primary data records. [2025-09-24T22:18:39.334841] [DEBUG] [MAIN ] CVEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:39.336216] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15263 primary records. [2025-09-24T22:18:39.336391] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-24T22:18:39.369881] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:39.372048] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53556 primary records. [2025-09-24T22:18:39.373098] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-24T22:18:39.374895] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-09-24T22:18:39.375099] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-24T22:18:39.378756] [INFO ] [MAIN ] Derivative Progress: 457/2075 symbols completed. CVEO took 1.2s. Estimated remaining: 10m 40s. Rate: 151.8 symbols/min [2025-09-24T22:18:39.391169] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:39.411946] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-24T22:18:39.412538] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-24T22:18:39.415002] [INFO ] [MAIN ] Derivative Progress: 458/2075 symbols completed. CVE took 1.3s. Estimated remaining: 10m 38s. Rate: 152.1 symbols/min [2025-09-24T22:18:39.412451] [DEBUG] [MAIN ] CVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:39.415310] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:39.416243] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46432 primary records. [2025-09-24T22:18:39.416444] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-24T22:18:39.444508] [DEBUG] [LOCAL ] CVLG: Loaded 15591 existing records from primary storage. [2025-09-24T22:18:39.445204] [INFO ] [MAIN ] CVLG: Loaded 15591 primary data records. [2025-09-24T22:18:39.445536] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-24T22:18:39.467554] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-24T22:18:39.480837] [INFO ] [MAIN ] Derivative Progress: 459/2075 symbols completed. CVI took 1.3s. Estimated remaining: 10m 36s. Rate: 152.4 symbols/min [2025-09-24T22:18:39.517604] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:39.809921] [DEBUG] [LOCAL ] CVNA: Loaded 53009 existing records from primary storage. [2025-09-24T22:18:39.811231] [INFO ] [MAIN ] CVNA: Loaded 53009 primary data records. [2025-09-24T22:18:39.994319] [DEBUG] [LOCAL ] CVS: Loaded 53697 existing records from primary storage. [2025-09-24T22:18:40.029891] [INFO ] [MAIN ] CVS: Loaded 53697 primary data records. [2025-09-24T22:18:40.486160] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:40.487221] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15591 primary records. [2025-09-24T22:18:40.487575] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-24T22:18:40.508594] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-24T22:18:40.510076] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-24T22:18:40.513602] [INFO ] [MAIN ] Derivative Progress: 460/2075 symbols completed. CVLG took 1.1s. Estimated remaining: 10m 38s. Rate: 151.8 symbols/min [2025-09-24T22:18:40.515395] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:40.532216] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:40.532971] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 53009 primary records. [2025-09-24T22:18:40.533144] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-24T22:18:40.552615] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-24T22:18:40.552914] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-24T22:18:40.567923] [INFO ] [MAIN ] Derivative Progress: 461/2075 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 37s. Rate: 152.1 symbols/min [2025-09-24T22:18:40.565805] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:40.569107] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:40.568833] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53697 primary records. [2025-09-24T22:18:40.569219] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-24T22:18:40.586048] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-24T22:18:40.586171] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-24T22:18:40.588841] [INFO ] [MAIN ] Derivative Progress: 462/2075 symbols completed. CVS took 1.1s. Estimated remaining: 10m 35s. Rate: 152.4 symbols/min [2025-09-24T22:18:40.589230] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:40.638556] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-24T22:18:40.638825] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-24T22:18:40.815809] [DEBUG] [LOCAL ] CWEN: Loaded 45039 existing records from primary storage. [2025-09-24T22:18:40.873816] [DEBUG] [LOCAL ] CWH: Loaded 51426 existing records from primary storage. [2025-09-24T22:18:40.837578] [INFO ] [MAIN ] CWEN: Loaded 45039 primary data records. [2025-09-24T22:18:40.880245] [INFO ] [MAIN ] CWH: Loaded 51426 primary data records. [2025-09-24T22:18:41.688508] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:41.689628] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-24T22:18:41.691118] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-24T22:18:41.723838] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-24T22:18:41.724379] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:41.725306] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45039 primary records. [2025-09-24T22:18:41.724565] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-24T22:18:41.728227] [INFO ] [MAIN ] Derivative Progress: 463/2075 symbols completed. CVX took 1.2s. Estimated remaining: 10m 37s. Rate: 151.8 symbols/min [2025-09-24T22:18:41.729178] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-24T22:18:41.743082] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:41.743907] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51426 primary records. [2025-09-24T22:18:41.751085] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-24T22:18:41.771584] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-24T22:18:41.772101] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-24T22:18:41.774720] [INFO ] [MAIN ] Derivative Progress: 464/2075 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 35s. Rate: 152.1 symbols/min [2025-09-24T22:18:41.776976] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-24T22:18:41.777042] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-24T22:18:41.779591] [INFO ] [MAIN ] Derivative Progress: 465/2075 symbols completed. CWH took 1.2s. Estimated remaining: 10m 34s. Rate: 152.4 symbols/min [2025-09-24T22:18:41.780147] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:41.780316] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:41.780432] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:41.790356] [DEBUG] [LOCAL ] CXE: Loaded 7207 existing records from primary storage. [2025-09-24T22:18:41.790525] [INFO ] [MAIN ] CXE: Loaded 7207 primary data records. [2025-09-24T22:18:42.020012] [DEBUG] [LOCAL ] CWT: Loaded 27912 existing records from primary storage. [2025-09-24T22:18:42.124869] [INFO ] [MAIN ] CWT: Loaded 27912 primary data records. [2025-09-24T22:18:42.245117] [DEBUG] [LOCAL ] CWK: Loaded 49420 existing records from primary storage. [2025-09-24T22:18:42.250222] [INFO ] [MAIN ] CWK: Loaded 49420 primary data records. [2025-09-24T22:18:42.835632] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:42.837291] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 7207 primary records. [2025-09-24T22:18:42.837808] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-24T22:18:42.855769] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-24T22:18:42.856097] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-24T22:18:42.858725] [INFO ] [MAIN ] Derivative Progress: 466/2075 symbols completed. CXE took 1.1s. Estimated remaining: 10m 36s. Rate: 151.9 symbols/min [2025-09-24T22:18:42.859742] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:42.868851] [DEBUG] [LOCAL ] CXH: Loaded 4414 existing records from primary storage. [2025-09-24T22:18:42.876898] [INFO ] [MAIN ] CXH: Loaded 4414 primary data records. [2025-09-24T22:18:42.927036] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:42.954192] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27912 primary records. [2025-09-24T22:18:42.972618] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-24T22:18:43.038366] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:43.056667] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49420 primary records. [2025-09-24T22:18:43.065978] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-24T22:18:43.236949] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-24T22:18:43.235561] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-24T22:18:43.237291] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-24T22:18:43.237225] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-24T22:18:43.239370] [INFO ] [MAIN ] Derivative Progress: 467/2075 symbols completed. CWT took 1.5s. Estimated remaining: 10m 35s. Rate: 151.9 symbols/min [2025-09-24T22:18:43.242505] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:43.242854] [INFO ] [MAIN ] Derivative Progress: 468/2075 symbols completed. CWK took 1.5s. Estimated remaining: 10m 34s. Rate: 152.2 symbols/min [2025-09-24T22:18:43.243767] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:43.280763] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:43.281730] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4414 primary records. [2025-09-24T22:18:43.281902] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-24T22:18:43.314458] [DEBUG] [LOCAL ] CXT: Loaded 31061 existing records from primary storage. [2025-09-24T22:18:43.315482] [INFO ] [MAIN ] CXT: Loaded 31061 primary data records. [2025-09-24T22:18:43.419405] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-09-24T22:18:43.419608] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-24T22:18:43.444783] [INFO ] [MAIN ] Derivative Progress: 469/2075 symbols completed. CXH took 0.6s. Estimated remaining: 10m 32s. Rate: 152.4 symbols/min [2025-09-24T22:18:43.427481] [DEBUG] [LOCAL ] CXM: Loaded 47947 existing records from primary storage. [2025-09-24T22:18:43.445169] [INFO ] [MAIN ] CXM: Loaded 47947 primary data records. [2025-09-24T22:18:43.445817] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:44.015977] [DEBUG] [LOCAL ] CXW: Loaded 44300 existing records from primary storage. [2025-09-24T22:18:44.016608] [INFO ] [MAIN ] CXW: Loaded 44300 primary data records. [2025-09-24T22:18:44.352068] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:44.353491] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31061 primary records. [2025-09-24T22:18:44.353632] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-24T22:18:44.374324] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-24T22:18:44.374937] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-24T22:18:44.378382] [INFO ] [MAIN ] Derivative Progress: 470/2075 symbols completed. CXT took 1.1s. Estimated remaining: 10m 34s. Rate: 151.9 symbols/min [2025-09-24T22:18:44.379769] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:44.395974] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:44.396759] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47947 primary records. [2025-09-24T22:18:44.396918] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-24T22:18:44.420284] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-24T22:18:44.420550] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-24T22:18:44.423096] [INFO ] [MAIN ] Derivative Progress: 471/2075 symbols completed. CXM took 1.2s. Estimated remaining: 10m 32s. Rate: 152.2 symbols/min [2025-09-24T22:18:44.423417] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:44.449975] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:44.450811] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44300 primary records. [2025-09-24T22:18:44.450979] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-24T22:18:44.483306] [DEBUG] [LOCAL ] CYH: Loaded 47783 existing records from primary storage. [2025-09-24T22:18:44.484412] [INFO ] [MAIN ] CYH: Loaded 47783 primary data records. [2025-09-24T22:18:44.484247] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-24T22:18:44.484670] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-24T22:18:44.487391] [INFO ] [MAIN ] Derivative Progress: 472/2075 symbols completed. CXW took 1.0s. Estimated remaining: 10m 31s. Rate: 152.5 symbols/min [2025-09-24T22:18:44.501133] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:44.659466] [DEBUG] [LOCAL ] DAC: Loaded 12600 existing records from primary storage. [2025-09-24T22:18:44.699398] [INFO ] [MAIN ] DAC: Loaded 12600 primary data records. [2025-09-24T22:18:44.874589] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-24T22:18:44.895103] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-09-24T22:18:45.558458] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:45.560450] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47783 primary records. [2025-09-24T22:18:45.560828] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-24T22:18:45.583178] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-24T22:18:45.585069] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-24T22:18:45.589031] [INFO ] [MAIN ] Derivative Progress: 473/2075 symbols completed. CYH took 1.2s. Estimated remaining: 10m 33s. Rate: 151.9 symbols/min [2025-09-24T22:18:45.590820] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:45.606413] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:45.607849] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12600 primary records. [2025-09-24T22:18:45.608179] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-24T22:18:45.645685] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-09-24T22:18:45.645493] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:45.645899] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-24T22:18:45.649379] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-09-24T22:18:45.649629] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-24T22:18:45.648328] [INFO ] [MAIN ] Derivative Progress: 474/2075 symbols completed. DAC took 1.2s. Estimated remaining: 10m 31s. Rate: 152.2 symbols/min [2025-09-24T22:18:45.649964] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:45.676580] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-24T22:18:45.676776] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-24T22:18:45.679637] [INFO ] [MAIN ] Derivative Progress: 475/2075 symbols completed. D took 1.3s. Estimated remaining: 10m 30s. Rate: 152.5 symbols/min [2025-09-24T22:18:45.693416] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:45.703093] [DEBUG] [LOCAL ] DAO: Loaded 21138 existing records from primary storage. [2025-09-24T22:18:45.703259] [INFO ] [MAIN ] DAO: Loaded 21138 primary data records. [2025-09-24T22:18:45.840814] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-24T22:18:45.841039] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-24T22:18:46.396430] [DEBUG] [LOCAL ] DAR: Loaded 51838 existing records from primary storage. [2025-09-24T22:18:46.397312] [INFO ] [MAIN ] DAR: Loaded 51838 primary data records. [2025-09-24T22:18:46.730663] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:46.733149] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 21138 primary records. [2025-09-24T22:18:46.733369] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-24T22:18:46.769799] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:46.769445] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-09-24T22:18:46.771008] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-24T22:18:46.771972] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-24T22:18:46.774529] [INFO ] [MAIN ] Derivative Progress: 476/2075 symbols completed. DAO took 1.1s. Estimated remaining: 10m 32s. Rate: 151.9 symbols/min [2025-09-24T22:18:46.774887] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:46.774987] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-24T22:18:46.795263] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-24T22:18:46.796168] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-24T22:18:46.798854] [INFO ] [MAIN ] Derivative Progress: 477/2075 symbols completed. DAL took 1.2s. Estimated remaining: 10m 30s. Rate: 152.2 symbols/min [2025-09-24T22:18:46.799193] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:46.813268] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:46.814087] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51838 primary records. [2025-09-24T22:18:46.823892] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-24T22:18:46.840698] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-24T22:18:46.841675] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-24T22:18:46.844234] [INFO ] [MAIN ] Derivative Progress: 478/2075 symbols completed. DAR took 1.2s. Estimated remaining: 10m 28s. Rate: 152.5 symbols/min [2025-09-24T22:18:46.865324] [DEBUG] [LOCAL ] DAVA: Loaded 40609 existing records from primary storage. [2025-09-24T22:18:46.865526] [INFO ] [MAIN ] DAVA: Loaded 40609 primary data records. [2025-09-24T22:18:47.037372] [DEBUG] [LOCAL ] DAY: Loaded 49845 existing records from primary storage. [2025-09-24T22:18:47.062681] [INFO ] [MAIN ] DAY: Loaded 49845 primary data records. [2025-09-24T22:18:47.604828] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:47.605718] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40609 primary records. [2025-09-24T22:18:47.605916] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-24T22:18:47.623684] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-24T22:18:47.624909] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-24T22:18:47.628087] [INFO ] [MAIN ] Derivative Progress: 479/2075 symbols completed. DAVA took 0.9s. Estimated remaining: 10m 29s. Rate: 152.2 symbols/min [2025-09-24T22:18:47.644707] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:47.645616] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49845 primary records. [2025-09-24T22:18:47.645705] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-24T22:18:47.665419] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-24T22:18:47.665556] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-24T22:18:47.668699] [INFO ] [MAIN ] Derivative Progress: 480/2075 symbols completed. DAY took 0.9s. Estimated remaining: 10m 28s. Rate: 152.4 symbols/min [2025-09-24T22:18:47.669883] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:47.670439] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:47.669801] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:47.682436] [DEBUG] [LOCAL ] DBL: Loaded 9131 existing records from primary storage. [2025-09-24T22:18:47.682575] [INFO ] [MAIN ] DBL: Loaded 9131 primary data records. [2025-09-24T22:18:47.918400] [DEBUG] [LOCAL ] DBI: Loaded 45023 existing records from primary storage. [2025-09-24T22:18:48.047599] [INFO ] [MAIN ] DBI: Loaded 45023 primary data records. [2025-09-24T22:18:48.054284] [DEBUG] [LOCAL ] DBRG: Loaded 49812 existing records from primary storage. [2025-09-24T22:18:48.071204] [INFO ] [MAIN ] DBRG: Loaded 49812 primary data records. [2025-09-24T22:18:48.677955] [DEBUG] [MAIN ] DBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:48.679178] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9131 primary records. [2025-09-24T22:18:48.680416] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-24T22:18:48.699739] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-24T22:18:48.699934] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-24T22:18:48.702599] [INFO ] [MAIN ] Derivative Progress: 481/2075 symbols completed. DBL took 1.0s. Estimated remaining: 10m 30s. Rate: 151.9 symbols/min [2025-09-24T22:18:48.703466] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:48.735502] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:48.749684] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 45023 primary records. [2025-09-24T22:18:48.754975] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-24T22:18:48.755441] [DEBUG] [LOCAL ] DCO: Loaded 13784 existing records from primary storage. [2025-09-24T22:18:48.755864] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:48.757588] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49812 primary records. [2025-09-24T22:18:48.758188] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-24T22:18:48.759451] [INFO ] [MAIN ] DCO: Loaded 13784 primary data records. [2025-09-24T22:18:48.923034] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-24T22:18:48.928545] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-24T22:18:48.928359] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-09-24T22:18:48.942801] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-24T22:18:48.931880] [INFO ] [MAIN ] Derivative Progress: 482/2075 symbols completed. DBI took 1.3s. Estimated remaining: 10m 29s. Rate: 152.1 symbols/min [2025-09-24T22:18:48.964171] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:48.964404] [INFO ] [MAIN ] Derivative Progress: 483/2075 symbols completed. DBRG took 1.3s. Estimated remaining: 10m 27s. Rate: 152.3 symbols/min [2025-09-24T22:18:49.014230] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:49.222801] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:49.223716] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13784 primary records. [2025-09-24T22:18:49.224085] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-24T22:18:49.268283] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-24T22:18:49.268400] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-24T22:18:49.271366] [INFO ] [MAIN ] Derivative Progress: 484/2075 symbols completed. DCO took 0.6s. Estimated remaining: 10m 26s. Rate: 152.4 symbols/min [2025-09-24T22:18:49.271774] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:49.307805] [DEBUG] [LOCAL ] DD: Loaded 52828 existing records from primary storage. [2025-09-24T22:18:49.308112] [INFO ] [MAIN ] DD: Loaded 52828 primary data records. [2025-09-24T22:18:49.309670] [DEBUG] [LOCAL ] DDD: Loaded 50881 existing records from primary storage. [2025-09-24T22:18:49.314995] [INFO ] [MAIN ] DDD: Loaded 50881 primary data records. [2025-09-24T22:18:49.877773] [DEBUG] [LOCAL ] DDL: Loaded 36335 existing records from primary storage. [2025-09-24T22:18:49.957451] [INFO ] [MAIN ] DDL: Loaded 36335 primary data records. [2025-09-24T22:18:50.343875] [DEBUG] [MAIN ] DD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:50.343415] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:50.345069] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50881 primary records. [2025-09-24T22:18:50.346262] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52828 primary records. [2025-09-24T22:18:50.346738] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-24T22:18:50.345246] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-24T22:18:50.379314] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-09-24T22:18:50.379965] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-24T22:18:50.382196] [INFO ] [MAIN ] Derivative Progress: 485/2075 symbols completed. DDD took 1.4s. Estimated remaining: 10m 28s. Rate: 151.8 symbols/min [2025-09-24T22:18:50.383222] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:50.388913] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-09-24T22:18:50.391809] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-24T22:18:50.394337] [INFO ] [MAIN ] Derivative Progress: 486/2075 symbols completed. DD took 1.4s. Estimated remaining: 10m 27s. Rate: 152.1 symbols/min [2025-09-24T22:18:50.395186] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:50.412230] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:50.413242] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36335 primary records. [2025-09-24T22:18:50.413468] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-24T22:18:50.419527] [DEBUG] [LOCAL ] DDS: Loaded 13202 existing records from primary storage. [2025-09-24T22:18:50.427769] [INFO ] [MAIN ] DDS: Loaded 13202 primary data records. [2025-09-24T22:18:50.455118] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-24T22:18:50.465791] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-24T22:18:50.486254] [INFO ] [MAIN ] Derivative Progress: 487/2075 symbols completed. DDL took 1.2s. Estimated remaining: 10m 25s. Rate: 152.4 symbols/min [2025-09-24T22:18:50.503332] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:50.795614] [DEBUG] [LOCAL ] DE: Loaded 47704 existing records from primary storage. [2025-09-24T22:18:50.796107] [INFO ] [MAIN ] DE: Loaded 47704 primary data records. [2025-09-24T22:18:50.967096] [DEBUG] [LOCAL ] DEA: Loaded 41343 existing records from primary storage. [2025-09-24T22:18:50.994787] [INFO ] [MAIN ] DEA: Loaded 41343 primary data records. [2025-09-24T22:18:51.392498] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:18:51.432191] [INFO ] [MAIN ] DDS: Generated 1793 derivative records from 13202 primary records. [2025-09-24T22:18:51.470557] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-24T22:18:51.819050] [DEBUG] [LOCAL ] DDS: Derivative data saved (1793 records). [2025-09-24T22:18:51.834216] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-24T22:18:51.837883] [INFO ] [MAIN ] Derivative Progress: 488/2075 symbols completed. DDS took 1.5s. Estimated remaining: 10m 28s. Rate: 151.6 symbols/min [2025-09-24T22:18:51.839222] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:51.861484] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:51.862387] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47704 primary records. [2025-09-24T22:18:51.862625] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-24T22:18:51.902070] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-24T22:18:51.903799] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-24T22:18:51.906820] [INFO ] [MAIN ] Derivative Progress: 489/2075 symbols completed. DE took 1.5s. Estimated remaining: 10m 27s. Rate: 151.9 symbols/min [2025-09-24T22:18:51.920262] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:51.922164] [DEBUG] [LOCAL ] DEC: Loaded 30630 existing records from primary storage. [2025-09-24T22:18:51.934561] [INFO ] [MAIN ] DEC: Loaded 30630 primary data records. [2025-09-24T22:18:51.942998] [DEBUG] [MAIN ] DEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:51.986280] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 41343 primary records. [2025-09-24T22:18:52.001003] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-24T22:18:52.196784] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-24T22:18:52.220621] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-24T22:18:52.367209] [INFO ] [MAIN ] Derivative Progress: 490/2075 symbols completed. DEA took 1.9s. Estimated remaining: 10m 26s. Rate: 151.8 symbols/min [2025-09-24T22:18:52.367695] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:52.385355] [DEBUG] [LOCAL ] DECK: Loaded 53301 existing records from primary storage. [2025-09-24T22:18:52.386628] [INFO ] [MAIN ] DECK: Loaded 53301 primary data records. [2025-09-24T22:18:52.736266] [DEBUG] [MAIN ] DEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:52.752486] [DEBUG] [LOCAL ] DEI: Loaded 48491 existing records from primary storage. [2025-09-24T22:18:52.751228] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30630 primary records. [2025-09-24T22:18:52.752728] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-24T22:18:52.752835] [INFO ] [MAIN ] DEI: Loaded 48491 primary data records. [2025-09-24T22:18:52.878809] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-09-24T22:18:52.891272] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-24T22:18:52.909816] [INFO ] [MAIN ] Derivative Progress: 491/2075 symbols completed. DEC took 1.1s. Estimated remaining: 10m 26s. Rate: 151.7 symbols/min [2025-09-24T22:18:52.935468] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:53.108485] [DEBUG] [MAIN ] DECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:53.109554] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53301 primary records. [2025-09-24T22:18:53.109804] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-24T22:18:53.129598] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-09-24T22:18:53.129859] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-24T22:18:53.132431] [INFO ] [MAIN ] Derivative Progress: 492/2075 symbols completed. DECK took 1.2s. Estimated remaining: 10m 25s. Rate: 151.9 symbols/min [2025-09-24T22:18:53.132776] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:53.162285] [DEBUG] [MAIN ] DEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:53.163060] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48491 primary records. [2025-09-24T22:18:53.163143] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-24T22:18:53.201877] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-24T22:18:53.202033] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-24T22:18:53.204457] [INFO ] [MAIN ] Derivative Progress: 493/2075 symbols completed. DEI took 0.8s. Estimated remaining: 10m 24s. Rate: 152.1 symbols/min [2025-09-24T22:18:53.205975] [DEBUG] [LOCAL ] DEO: Loaded 49022 existing records from primary storage. [2025-09-24T22:18:53.206772] [INFO ] [MAIN ] DEO: Loaded 49022 primary data records. [2025-09-24T22:18:53.326177] [DEBUG] [LOCAL ] DFH: Loaded 32733 existing records from primary storage. [2025-09-24T22:18:53.336585] [INFO ] [MAIN ] DFH: Loaded 32733 primary data records. [2025-09-24T22:18:53.946109] [DEBUG] [MAIN ] DEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:53.947402] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49022 primary records. [2025-09-24T22:18:53.947681] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-24T22:18:53.972668] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-24T22:18:53.972961] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-24T22:18:53.976035] [INFO ] [MAIN ] Derivative Progress: 494/2075 symbols completed. DEO took 1.0s. Estimated remaining: 10m 25s. Rate: 151.8 symbols/min [2025-09-24T22:18:53.988401] [DEBUG] [MAIN ] DFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:53.989208] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32733 primary records. [2025-09-24T22:18:53.989275] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-24T22:18:54.005059] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-24T22:18:54.005145] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-24T22:18:54.007363] [INFO ] [MAIN ] Derivative Progress: 495/2075 symbols completed. DFH took 0.9s. Estimated remaining: 10m 23s. Rate: 152.1 symbols/min [2025-09-24T22:18:54.008026] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:54.008574] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:54.008394] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:54.025392] [DEBUG] [LOCAL ] DFP: Loaded 11684 existing records from primary storage. [2025-09-24T22:18:54.031421] [INFO ] [MAIN ] DFP: Loaded 11684 primary data records. [2025-09-24T22:18:54.145850] [DEBUG] [LOCAL ] DFIN: Loaded 23295 existing records from primary storage. [2025-09-24T22:18:54.149349] [INFO ] [MAIN ] DFIN: Loaded 23295 primary data records. [2025-09-24T22:18:54.576568] [DEBUG] [LOCAL ] DG: Loaded 53299 existing records from primary storage. [2025-09-24T22:18:54.683982] [INFO ] [MAIN ] DG: Loaded 53299 primary data records. [2025-09-24T22:18:55.041897] [DEBUG] [MAIN ] DFP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:55.043392] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11684 primary records. [2025-09-24T22:18:55.043755] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-24T22:18:55.064190] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-09-24T22:18:55.077343] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-24T22:18:55.080571] [INFO ] [MAIN ] Derivative Progress: 496/2075 symbols completed. DFP took 1.1s. Estimated remaining: 10m 25s. Rate: 151.6 symbols/min [2025-09-24T22:18:55.081202] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:55.077869] [DEBUG] [MAIN ] DFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:55.082181] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23295 primary records. [2025-09-24T22:18:55.082398] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-24T22:18:55.104799] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-24T22:18:55.104942] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-24T22:18:55.106989] [INFO ] [MAIN ] Derivative Progress: 497/2075 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 23s. Rate: 151.9 symbols/min [2025-09-24T22:18:55.107665] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:55.121238] [DEBUG] [MAIN ] DG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:55.122358] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53299 primary records. [2025-09-24T22:18:55.122537] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-24T22:18:55.150480] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-24T22:18:55.155349] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-24T22:18:55.157754] [INFO ] [MAIN ] Derivative Progress: 498/2075 symbols completed. DG took 1.1s. Estimated remaining: 10m 22s. Rate: 152.1 symbols/min [2025-09-24T22:18:55.158173] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:55.168069] [DEBUG] [LOCAL ] DHF: Loaded 20496 existing records from primary storage. [2025-09-24T22:18:55.168504] [INFO ] [MAIN ] DHF: Loaded 20496 primary data records. [2025-09-24T22:18:55.243897] [DEBUG] [LOCAL ] DGX: Loaded 45219 existing records from primary storage. [2025-09-24T22:18:55.266564] [INFO ] [MAIN ] DGX: Loaded 45219 primary data records. [2025-09-24T22:18:55.741325] [DEBUG] [LOCAL ] DHR: Loaded 53359 existing records from primary storage. [2025-09-24T22:18:55.905814] [INFO ] [MAIN ] DHR: Loaded 53359 primary data records. [2025-09-24T22:18:56.249376] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:56.251362] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20496 primary records. [2025-09-24T22:18:56.251809] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-24T22:18:56.285373] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:56.288060] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 45219 primary records. [2025-09-24T22:18:56.288546] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-24T22:18:56.309240] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-09-24T22:18:56.311461] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-24T22:18:56.311841] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-24T22:18:56.309766] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-24T22:18:56.314685] [INFO ] [MAIN ] Derivative Progress: 499/2075 symbols completed. DHF took 1.2s. Estimated remaining: 10m 24s. Rate: 151.5 symbols/min [2025-09-24T22:18:56.315173] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:56.317859] [INFO ] [MAIN ] Derivative Progress: 500/2075 symbols completed. DGX took 1.2s. Estimated remaining: 10m 22s. Rate: 151.8 symbols/min [2025-09-24T22:18:56.318701] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:56.335434] [DEBUG] [MAIN ] DHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:56.340286] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53359 primary records. [2025-09-24T22:18:56.340580] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-24T22:18:56.365623] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-09-24T22:18:56.366402] [DEBUG] [LOCAL ] DHX: Loaded 13224 existing records from primary storage. [2025-09-24T22:18:56.366622] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-24T22:18:56.371614] [INFO ] [MAIN ] DHX: Loaded 13224 primary data records. [2025-09-24T22:18:56.377338] [DEBUG] [LOCAL ] DIAX: Loaded 12538 existing records from primary storage. [2025-09-24T22:18:56.387317] [INFO ] [MAIN ] Derivative Progress: 501/2075 symbols completed. DHR took 1.2s. Estimated remaining: 10m 21s. Rate: 152.1 symbols/min [2025-09-24T22:18:56.393069] [INFO ] [MAIN ] DIAX: Loaded 12538 primary data records. [2025-09-24T22:18:56.433404] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:57.098436] [DEBUG] [LOCAL ] DIN: Loaded 37275 existing records from primary storage. [2025-09-24T22:18:57.098880] [INFO ] [MAIN ] DIN: Loaded 37275 primary data records. [2025-09-24T22:18:57.510686] [DEBUG] [MAIN ] DHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:57.510323] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:57.512516] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13224 primary records. [2025-09-24T22:18:57.511815] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12538 primary records. [2025-09-24T22:18:57.513164] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-24T22:18:57.513090] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-24T22:18:57.547285] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-09-24T22:18:57.548051] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-24T22:18:57.550658] [INFO ] [MAIN ] Derivative Progress: 502/2075 symbols completed. DHX took 1.2s. Estimated remaining: 10m 23s. Rate: 151.5 symbols/min [2025-09-24T22:18:57.551626] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:57.553083] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-09-24T22:18:57.553417] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-24T22:18:57.556325] [INFO ] [MAIN ] Derivative Progress: 503/2075 symbols completed. DIAX took 1.2s. Estimated remaining: 10m 21s. Rate: 151.8 symbols/min [2025-09-24T22:18:57.557678] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:57.573875] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:57.574870] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37275 primary records. [2025-09-24T22:18:57.575042] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-24T22:18:57.593684] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-24T22:18:57.593895] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-24T22:18:57.598253] [INFO ] [MAIN ] Derivative Progress: 504/2075 symbols completed. DIN took 1.2s. Estimated remaining: 10m 20s. Rate: 152.1 symbols/min [2025-09-24T22:18:57.598583] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:57.663109] [DEBUG] [LOCAL ] DINO: Loaded 52958 existing records from primary storage. [2025-09-24T22:18:57.663419] [INFO ] [MAIN ] DINO: Loaded 52958 primary data records. [2025-09-24T22:18:57.805048] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-24T22:18:57.811059] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-24T22:18:57.899225] [DEBUG] [LOCAL ] DK: Loaded 49380 existing records from primary storage. [2025-09-24T22:18:58.068159] [INFO ] [MAIN ] DK: Loaded 49380 primary data records. [2025-09-24T22:18:58.793111] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:58.795007] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52958 primary records. [2025-09-24T22:18:58.795709] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-24T22:18:58.821213] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-24T22:18:58.821632] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-24T22:18:58.825671] [INFO ] [MAIN ] Derivative Progress: 505/2075 symbols completed. DINO took 1.3s. Estimated remaining: 10m 22s. Rate: 151.4 symbols/min [2025-09-24T22:18:58.826448] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:58.845282] [DEBUG] [MAIN ] DIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:58.846149] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-24T22:18:58.846372] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-24T22:18:58.888890] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-24T22:18:58.889009] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-24T22:18:58.891749] [INFO ] [MAIN ] Derivative Progress: 506/2075 symbols completed. DIS took 1.3s. Estimated remaining: 10m 21s. Rate: 151.7 symbols/min [2025-09-24T22:18:58.888015] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:58.892238] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:58.893820] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49380 primary records. [2025-09-24T22:18:58.894021] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-24T22:18:58.925038] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-09-24T22:18:58.925172] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-24T22:18:58.927738] [INFO ] [MAIN ] Derivative Progress: 507/2075 symbols completed. DK took 1.3s. Estimated remaining: 10m 19s. Rate: 152.0 symbols/min [2025-09-24T22:18:58.928162] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:18:58.947499] [DEBUG] [LOCAL ] DKS: Loaded 49904 existing records from primary storage. [2025-09-24T22:18:58.949121] [INFO ] [MAIN ] DKS: Loaded 49904 primary data records. [2025-09-24T22:18:59.032398] [DEBUG] [LOCAL ] DLNG: Loaded 6175 existing records from primary storage. [2025-09-24T22:18:59.049415] [INFO ] [MAIN ] DLNG: Loaded 6175 primary data records. [2025-09-24T22:18:59.269775] [DEBUG] [LOCAL ] DLB: Loaded 32152 existing records from primary storage. [2025-09-24T22:18:59.293711] [INFO ] [MAIN ] DLB: Loaded 32152 primary data records. [2025-09-24T22:18:59.968137] [DEBUG] [MAIN ] DKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:18:59.971137] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49904 primary records. [2025-09-24T22:18:59.972158] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-24T22:19:00.000505] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:00.005584] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-24T22:19:00.006911] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6175 primary records. [2025-09-24T22:19:00.009422] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-24T22:19:00.009482] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-24T22:19:00.013144] [INFO ] [MAIN ] Derivative Progress: 508/2075 symbols completed. DKS took 1.2s. Estimated remaining: 10m 21s. Rate: 151.4 symbols/min [2025-09-24T22:19:00.039910] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:00.041492] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32152 primary records. [2025-09-24T22:19:00.042678] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-24T22:19:00.043218] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-24T22:19:00.043701] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-24T22:19:00.046246] [INFO ] [MAIN ] Derivative Progress: 509/2075 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 19s. Rate: 151.7 symbols/min [2025-09-24T22:19:00.061968] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-09-24T22:19:00.062040] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-24T22:19:00.064449] [INFO ] [MAIN ] Derivative Progress: 510/2075 symbols completed. DLB took 1.2s. Estimated remaining: 10m 18s. Rate: 152.0 symbols/min [2025-09-24T22:19:00.065192] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:00.065269] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:00.065347] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:00.114385] [DEBUG] [LOCAL ] DLY: Loaded 19433 existing records from primary storage. [2025-09-24T22:19:00.114681] [INFO ] [MAIN ] DLY: Loaded 19433 primary data records. [2025-09-24T22:19:00.115156] [DEBUG] [LOCAL ] DLX: Loaded 28990 existing records from primary storage. [2025-09-24T22:19:00.115243] [INFO ] [MAIN ] DLX: Loaded 28990 primary data records. [2025-09-24T22:19:00.751868] [DEBUG] [LOCAL ] DLR: Loaded 51149 existing records from primary storage. [2025-09-24T22:19:00.806410] [INFO ] [MAIN ] DLR: Loaded 51149 primary data records. [2025-09-24T22:19:01.181242] [DEBUG] [MAIN ] DLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:01.182729] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19433 primary records. [2025-09-24T22:19:01.182886] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-24T22:19:01.181842] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:01.185810] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28990 primary records. [2025-09-24T22:19:01.194366] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-24T22:19:01.217730] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-24T22:19:01.219230] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-24T22:19:01.222036] [INFO ] [MAIN ] Derivative Progress: 511/2075 symbols completed. DLX took 1.2s. Estimated remaining: 10m 20s. Rate: 151.4 symbols/min [2025-09-24T22:19:01.222969] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:01.225607] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-24T22:19:01.226465] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-24T22:19:01.229170] [INFO ] [MAIN ] Derivative Progress: 512/2075 symbols completed. DLY took 1.2s. Estimated remaining: 10m 18s. Rate: 151.7 symbols/min [2025-09-24T22:19:01.232588] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:01.249966] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:01.249630] [DEBUG] [LOCAL ] DMA: Loaded 4525 existing records from primary storage. [2025-09-24T22:19:01.250163] [INFO ] [MAIN ] DMA: Loaded 4525 primary data records. [2025-09-24T22:19:01.250990] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 51149 primary records. [2025-09-24T22:19:01.272262] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-24T22:19:01.379495] [DEBUG] [LOCAL ] DMB: Loaded 10136 existing records from primary storage. [2025-09-24T22:19:01.384903] [INFO ] [MAIN ] DMB: Loaded 10136 primary data records. [2025-09-24T22:19:01.460737] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-24T22:19:01.516473] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-24T22:19:01.560420] [INFO ] [MAIN ] Derivative Progress: 513/2075 symbols completed. DLR took 1.5s. Estimated remaining: 10m 18s. Rate: 151.8 symbols/min [2025-09-24T22:19:01.711205] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:01.944860] [DEBUG] [LOCAL ] DMO: Loaded 9841 existing records from primary storage. [2025-09-24T22:19:01.946419] [INFO ] [MAIN ] DMO: Loaded 9841 primary data records. [2025-09-24T22:19:02.223063] [DEBUG] [MAIN ] DMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:02.355571] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4525 primary records. [2025-09-24T22:19:02.356723] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-24T22:19:02.383807] [DEBUG] [MAIN ] DMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:02.387013] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10136 primary records. [2025-09-24T22:19:02.388016] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-24T22:19:02.399163] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-09-24T22:19:02.408392] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-09-24T22:19:02.404303] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-24T22:19:02.408693] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-24T22:19:02.411020] [INFO ] [MAIN ] Derivative Progress: 514/2075 symbols completed. DMA took 1.2s. Estimated remaining: 10m 19s. Rate: 151.4 symbols/min [2025-09-24T22:19:02.415366] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:02.415715] [INFO ] [MAIN ] Derivative Progress: 515/2075 symbols completed. DMB took 1.2s. Estimated remaining: 10m 17s. Rate: 151.7 symbols/min [2025-09-24T22:19:02.416936] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:02.443528] [DEBUG] [MAIN ] DMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:02.444673] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9841 primary records. [2025-09-24T22:19:02.444856] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-24T22:19:02.484396] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-09-24T22:19:02.484717] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-24T22:19:02.487376] [INFO ] [MAIN ] Derivative Progress: 516/2075 symbols completed. DMO took 0.8s. Estimated remaining: 10m 16s. Rate: 152.0 symbols/min [2025-09-24T22:19:02.488622] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:02.516864] [DEBUG] [LOCAL ] DNP: Loaded 33331 existing records from primary storage. [2025-09-24T22:19:02.516042] [DEBUG] [LOCAL ] DNOW: Loaded 43493 existing records from primary storage. [2025-09-24T22:19:02.517021] [INFO ] [MAIN ] DNOW: Loaded 43493 primary data records. [2025-09-24T22:19:02.517215] [INFO ] [MAIN ] DNP: Loaded 33331 primary data records. [2025-09-24T22:19:03.175242] [DEBUG] [LOCAL ] DOCN: Loaded 50513 existing records from primary storage. [2025-09-24T22:19:03.190621] [INFO ] [MAIN ] DOCN: Loaded 50513 primary data records. [2025-09-24T22:19:03.560093] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:03.561445] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33331 primary records. [2025-09-24T22:19:03.562544] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-24T22:19:03.599490] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-09-24T22:19:03.599935] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:03.600173] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-24T22:19:03.603025] [INFO ] [MAIN ] Derivative Progress: 517/2075 symbols completed. DNP took 1.2s. Estimated remaining: 10m 17s. Rate: 151.4 symbols/min [2025-09-24T22:19:03.604017] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:03.605290] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43493 primary records. [2025-09-24T22:19:03.605912] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-24T22:19:03.630009] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-24T22:19:03.637876] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-24T22:19:03.645467] [INFO ] [MAIN ] Derivative Progress: 518/2075 symbols completed. DNOW took 1.2s. Estimated remaining: 10m 16s. Rate: 151.7 symbols/min [2025-09-24T22:19:03.646528] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:03.646271] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:03.647685] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50513 primary records. [2025-09-24T22:19:03.647903] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-24T22:19:03.664439] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-24T22:19:03.678442] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-24T22:19:03.681085] [INFO ] [MAIN ] Derivative Progress: 519/2075 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 14s. Rate: 151.9 symbols/min [2025-09-24T22:19:03.681543] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:03.705197] [DEBUG] [LOCAL ] DOCS: Loaded 51247 existing records from primary storage. [2025-09-24T22:19:03.705542] [INFO ] [MAIN ] DOCS: Loaded 51247 primary data records. [2025-09-24T22:19:03.876637] [DEBUG] [LOCAL ] DOUG: Loaded 34747 existing records from primary storage. [2025-09-24T22:19:03.897488] [INFO ] [MAIN ] DOUG: Loaded 34747 primary data records. [2025-09-24T22:19:03.898185] [DEBUG] [LOCAL ] DOLE: Loaded 37919 existing records from primary storage. [2025-09-24T22:19:03.956824] [INFO ] [MAIN ] DOLE: Loaded 37919 primary data records. [2025-09-24T22:19:04.788609] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:04.791107] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51247 primary records. [2025-09-24T22:19:04.791345] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-24T22:19:04.811567] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-09-24T22:19:04.811798] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-24T22:19:04.813776] [INFO ] [MAIN ] Derivative Progress: 520/2075 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 16s. Rate: 151.4 symbols/min [2025-09-24T22:19:04.814191] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:04.831840] [DEBUG] [MAIN ] DOLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:04.832609] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 37919 primary records. [2025-09-24T22:19:04.832985] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-24T22:19:04.861121] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:04.865984] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34747 primary records. [2025-09-24T22:19:04.866388] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-24T22:19:04.866672] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-24T22:19:04.866784] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-24T22:19:04.869426] [INFO ] [MAIN ] Derivative Progress: 521/2075 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 15s. Rate: 151.7 symbols/min [2025-09-24T22:19:04.879299] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:04.898415] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-24T22:19:04.898562] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-24T22:19:04.901241] [INFO ] [MAIN ] Derivative Progress: 522/2075 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 13s. Rate: 151.9 symbols/min [2025-09-24T22:19:04.901726] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:04.924868] [DEBUG] [LOCAL ] DOV: Loaded 45676 existing records from primary storage. [2025-09-24T22:19:04.925122] [INFO ] [MAIN ] DOV: Loaded 45676 primary data records. [2025-09-24T22:19:04.967859] [DEBUG] [LOCAL ] DPG: Loaded 13420 existing records from primary storage. [2025-09-24T22:19:04.996434] [INFO ] [MAIN ] DPG: Loaded 13420 primary data records. [2025-09-24T22:19:05.226733] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-24T22:19:05.281089] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-09-24T22:19:05.967866] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:05.968582] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:05.971442] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13420 primary records. [2025-09-24T22:19:05.972252] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45676 primary records. [2025-09-24T22:19:05.972557] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-24T22:19:05.972871] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-24T22:19:06.005287] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-24T22:19:06.006223] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-24T22:19:06.008773] [INFO ] [MAIN ] Derivative Progress: 523/2075 symbols completed. DPG took 1.1s. Estimated remaining: 10m 15s. Rate: 151.4 symbols/min [2025-09-24T22:19:06.016544] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-09-24T22:19:06.018950] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-24T22:19:06.022825] [INFO ] [MAIN ] Derivative Progress: 524/2075 symbols completed. DOV took 1.2s. Estimated remaining: 10m 14s. Rate: 151.7 symbols/min [2025-09-24T22:19:06.036280] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:06.037045] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-09-24T22:19:06.037112] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-24T22:19:06.053259] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-09-24T22:19:06.053326] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-24T22:19:06.055751] [INFO ] [MAIN ] Derivative Progress: 525/2075 symbols completed. DOW took 1.2s. Estimated remaining: 10m 12s. Rate: 151.9 symbols/min [2025-09-24T22:19:06.056838] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:06.056438] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:06.057502] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:06.128395] [DEBUG] [LOCAL ] DRD: Loaded 36744 existing records from primary storage. [2025-09-24T22:19:06.142726] [INFO ] [MAIN ] DRD: Loaded 36744 primary data records. [2025-09-24T22:19:06.148673] [DEBUG] [LOCAL ] DRH: Loaded 50463 existing records from primary storage. [2025-09-24T22:19:06.173262] [INFO ] [MAIN ] DRH: Loaded 50463 primary data records. [2025-09-24T22:19:06.356718] [DEBUG] [LOCAL ] DQ: Loaded 43139 existing records from primary storage. [2025-09-24T22:19:06.388741] [INFO ] [MAIN ] DQ: Loaded 43139 primary data records. [2025-09-24T22:19:07.264159] [DEBUG] [MAIN ] DRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:07.266565] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50463 primary records. [2025-09-24T22:19:07.265715] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:07.266705] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-24T22:19:07.268427] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36744 primary records. [2025-09-24T22:19:07.268560] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-24T22:19:07.297603] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-24T22:19:07.302631] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-24T22:19:07.305682] [INFO ] [MAIN ] Derivative Progress: 526/2075 symbols completed. DRH took 1.2s. Estimated remaining: 10m 14s. Rate: 151.3 symbols/min [2025-09-24T22:19:07.316519] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:07.316255] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-24T22:19:07.322006] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-24T22:19:07.322256] [DEBUG] [MAIN ] DQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:07.325910] [INFO ] [MAIN ] Derivative Progress: 527/2075 symbols completed. DRD took 1.3s. Estimated remaining: 10m 13s. Rate: 151.6 symbols/min [2025-09-24T22:19:07.323136] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43139 primary records. [2025-09-24T22:19:07.326841] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-24T22:19:07.326971] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:07.345035] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-09-24T22:19:07.345144] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-24T22:19:07.347977] [INFO ] [MAIN ] Derivative Progress: 528/2075 symbols completed. DQ took 1.3s. Estimated remaining: 10m 11s. Rate: 151.9 symbols/min [2025-09-24T22:19:07.348440] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:07.358761] [DEBUG] [LOCAL ] DRLL: Loaded 9645 existing records from primary storage. [2025-09-24T22:19:07.359122] [INFO ] [MAIN ] DRLL: Loaded 9645 primary data records. [2025-09-24T22:19:07.555051] [DEBUG] [LOCAL ] DRI: Loaded 47861 existing records from primary storage. [2025-09-24T22:19:07.585424] [INFO ] [MAIN ] DRI: Loaded 47861 primary data records. [2025-09-24T22:19:07.602221] [DEBUG] [LOCAL ] DSL: Loaded 28220 existing records from primary storage. [2025-09-24T22:19:07.623975] [INFO ] [MAIN ] DSL: Loaded 28220 primary data records. [2025-09-24T22:19:08.463025] [DEBUG] [MAIN ] DRLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:08.464596] [INFO ] [MAIN ] DRLL: Generated 1794 derivative records from 9645 primary records. [2025-09-24T22:19:08.465975] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-24T22:19:08.486252] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1794 records). [2025-09-24T22:19:08.486728] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-24T22:19:08.489296] [INFO ] [MAIN ] Derivative Progress: 529/2075 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 13s. Rate: 151.3 symbols/min [2025-09-24T22:19:08.489744] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:08.513164] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:08.519457] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28220 primary records. [2025-09-24T22:19:08.519688] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-24T22:19:08.549005] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:08.552189] [DEBUG] [LOCAL ] DSM: Loaded 15676 existing records from primary storage. [2025-09-24T22:19:08.556519] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-24T22:19:08.557466] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47861 primary records. [2025-09-24T22:19:08.557711] [INFO ] [MAIN ] DSM: Loaded 15676 primary data records. [2025-09-24T22:19:08.557638] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-24T22:19:08.575748] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-24T22:19:08.609874] [INFO ] [MAIN ] Derivative Progress: 530/2075 symbols completed. DSL took 1.3s. Estimated remaining: 10m 12s. Rate: 151.5 symbols/min [2025-09-24T22:19:08.669396] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:08.694578] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-24T22:19:08.724226] [DEBUG] [LOCAL ] DSMC: Loaded 1947 existing records from primary storage. [2025-09-24T22:19:08.721870] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-24T22:19:08.751851] [INFO ] [MAIN ] Derivative Progress: 531/2075 symbols completed. DRI took 1.4s. Estimated remaining: 10m 11s. Rate: 151.7 symbols/min [2025-09-24T22:19:08.780751] [INFO ] [MAIN ] DSMC: Loaded 1947 primary data records. [2025-09-24T22:19:08.784023] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:09.279863] [DEBUG] [LOCAL ] DSU: Loaded 22116 existing records from primary storage. [2025-09-24T22:19:09.280208] [INFO ] [MAIN ] DSU: Loaded 22116 primary data records. [2025-09-24T22:19:09.519247] [DEBUG] [MAIN ] DSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:09.632502] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 15676 primary records. [2025-09-24T22:19:09.633589] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-24T22:19:09.654966] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-09-24T22:19:09.655448] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-24T22:19:09.658805] [INFO ] [MAIN ] Derivative Progress: 532/2075 symbols completed. DSM took 1.2s. Estimated remaining: 10m 12s. Rate: 151.3 symbols/min [2025-09-24T22:19:09.659824] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:09.674131] [DEBUG] [MAIN ] DSMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:09.675088] [INFO ] [MAIN ] DSMC: Generated 1794 derivative records from 1947 primary records. [2025-09-24T22:19:09.676314] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-24T22:19:09.691818] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1794 records). [2025-09-24T22:19:09.692008] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-24T22:19:09.695616] [INFO ] [MAIN ] Derivative Progress: 533/2075 symbols completed. DSMC took 1.0s. Estimated remaining: 10m 10s. Rate: 151.6 symbols/min [2025-09-24T22:19:09.696040] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:09.721224] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:09.730500] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22116 primary records. [2025-09-24T22:19:09.731068] [DEBUG] [LOCAL ] DSX: Loaded 24351 existing records from primary storage. [2025-09-24T22:19:09.731265] [INFO ] [MAIN ] DSX: Loaded 24351 primary data records. [2025-09-24T22:19:09.731409] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-24T22:19:09.918899] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-24T22:19:09.955120] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-24T22:19:10.094043] [INFO ] [MAIN ] Derivative Progress: 534/2075 symbols completed. DSU took 1.3s. Estimated remaining: 10m 10s. Rate: 151.6 symbols/min [2025-09-24T22:19:10.096039] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:10.097540] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-09-24T22:19:10.097778] [INFO ] [MAIN ] DT: Loaded 52944 primary data records. [2025-09-24T22:19:10.461815] [DEBUG] [LOCAL ] DTM: Loaded 44408 existing records from primary storage. [2025-09-24T22:19:10.460302] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:10.463837] [INFO ] [MAIN ] DTM: Loaded 44408 primary data records. [2025-09-24T22:19:10.463553] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24351 primary records. [2025-09-24T22:19:10.464013] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-24T22:19:10.660691] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-24T22:19:10.819008] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-24T22:19:10.834894] [INFO ] [MAIN ] Derivative Progress: 535/2075 symbols completed. DSX took 1.2s. Estimated remaining: 10m 11s. Rate: 151.3 symbols/min [2025-09-24T22:19:10.843271] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:10.850818] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:10.851675] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52944 primary records. [2025-09-24T22:19:10.852001] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-24T22:19:10.875328] [DEBUG] [LOCAL ] DTW: Loaded 4875 existing records from primary storage. [2025-09-24T22:19:10.876471] [INFO ] [MAIN ] DTW: Loaded 4875 primary data records. [2025-09-24T22:19:10.878374] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-24T22:19:10.909818] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-24T22:19:10.945326] [INFO ] [MAIN ] Derivative Progress: 536/2075 symbols completed. DT took 1.2s. Estimated remaining: 10m 9s. Rate: 151.6 symbols/min [2025-09-24T22:19:10.957500] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:11.203906] [DEBUG] [MAIN ] DTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:11.205274] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44408 primary records. [2025-09-24T22:19:11.205632] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-24T22:19:11.224432] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-24T22:19:11.237795] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-24T22:19:11.241235] [INFO ] [MAIN ] Derivative Progress: 537/2075 symbols completed. DTM took 1.1s. Estimated remaining: 10m 9s. Rate: 151.6 symbols/min [2025-09-24T22:19:11.241834] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:11.265412] [DEBUG] [LOCAL ] DUKB: Loaded 6341 existing records from primary storage. [2025-09-24T22:19:11.266507] [DEBUG] [MAIN ] DTW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:19:11.281958] [INFO ] [MAIN ] DTW: Generated 1793 derivative records from 4875 primary records. [2025-09-24T22:19:11.281125] [INFO ] [MAIN ] DUKB: Loaded 6341 primary data records. [2025-09-24T22:19:11.283002] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-24T22:19:11.282929] [DEBUG] [LOCAL ] DUK: Loaded 53459 existing records from primary storage. [2025-09-24T22:19:11.305248] [INFO ] [MAIN ] DUK: Loaded 53459 primary data records. [2025-09-24T22:19:11.473219] [DEBUG] [LOCAL ] DTW: Derivative data saved (1793 records). [2025-09-24T22:19:11.473732] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-24T22:19:11.487938] [INFO ] [MAIN ] Derivative Progress: 538/2075 symbols completed. DTW took 0.6s. Estimated remaining: 10m 8s. Rate: 151.7 symbols/min [2025-09-24T22:19:11.943207] [DEBUG] [MAIN ] DUKB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:11.945800] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6341 primary records. [2025-09-24T22:19:11.946028] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-24T22:19:11.977981] [DEBUG] [MAIN ] DUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:11.982369] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53459 primary records. [2025-09-24T22:19:11.983446] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-24T22:19:11.983565] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-24T22:19:11.984403] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-24T22:19:11.987004] [INFO ] [MAIN ] Derivative Progress: 539/2075 symbols completed. DUKB took 0.7s. Estimated remaining: 10m 8s. Rate: 151.7 symbols/min [2025-09-24T22:19:12.003299] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-09-24T22:19:12.003376] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-24T22:19:12.006375] [INFO ] [MAIN ] Derivative Progress: 540/2075 symbols completed. DUK took 1.0s. Estimated remaining: 10m 6s. Rate: 151.9 symbols/min [2025-09-24T22:19:12.007265] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:12.007734] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:12.007620] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:12.122547] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-24T22:19:12.123697] [DEBUG] [LOCAL ] DV: Loaded 51274 existing records from primary storage. [2025-09-24T22:19:12.124317] [DEBUG] [LOCAL ] DVA: Loaded 41348 existing records from primary storage. [2025-09-24T22:19:12.124800] [INFO ] [MAIN ] DV: Loaded 51274 primary data records. [2025-09-24T22:19:12.124527] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-24T22:19:12.125155] [INFO ] [MAIN ] DVA: Loaded 41348 primary data records. [2025-09-24T22:19:13.130173] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:13.143047] [DEBUG] [MAIN ] DVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:13.143956] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-24T22:19:13.152348] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51274 primary records. [2025-09-24T22:19:13.152419] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-24T22:19:13.157795] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-24T22:19:13.158454] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:13.167720] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41348 primary records. [2025-09-24T22:19:13.176322] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-24T22:19:13.197403] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-24T22:19:13.199296] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-24T22:19:13.201935] [INFO ] [MAIN ] Derivative Progress: 541/2075 symbols completed. DV took 1.2s. Estimated remaining: 10m 8s. Rate: 151.4 symbols/min [2025-09-24T22:19:13.209183] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:13.212785] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-24T22:19:13.213082] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-24T22:19:13.215739] [INFO ] [MAIN ] Derivative Progress: 542/2075 symbols completed. DVA took 1.2s. Estimated remaining: 10m 7s. Rate: 151.6 symbols/min [2025-09-24T22:19:13.217055] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:13.218173] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-24T22:19:13.218294] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-24T22:19:13.221213] [INFO ] [MAIN ] Derivative Progress: 543/2075 symbols completed. DVN took 1.2s. Estimated remaining: 10m 5s. Rate: 151.9 symbols/min [2025-09-24T22:19:13.221824] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:13.289153] [DEBUG] [LOCAL ] DXYZ: Loaded 36652 existing records from primary storage. [2025-09-24T22:19:13.289422] [INFO ] [MAIN ] DXYZ: Loaded 36652 primary data records. [2025-09-24T22:19:13.418389] [DEBUG] [LOCAL ] DXC: Loaded 49682 existing records from primary storage. [2025-09-24T22:19:13.419497] [INFO ] [MAIN ] DXC: Loaded 49682 primary data records. [2025-09-24T22:19:13.419360] [DEBUG] [LOCAL ] DX: Loaded 52476 existing records from primary storage. [2025-09-24T22:19:13.423405] [INFO ] [MAIN ] DX: Loaded 52476 primary data records. [2025-09-24T22:19:14.320668] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:14.322509] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36652 primary records. [2025-09-24T22:19:14.322673] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-24T22:19:14.346684] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-24T22:19:14.372613] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-24T22:19:14.375835] [INFO ] [MAIN ] Derivative Progress: 544/2075 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 7s. Rate: 151.4 symbols/min [2025-09-24T22:19:14.373567] [DEBUG] [MAIN ] DX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:14.376260] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:14.377224] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52476 primary records. [2025-09-24T22:19:14.373978] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:14.378349] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-24T22:19:14.378259] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49682 primary records. [2025-09-24T22:19:14.378691] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-24T22:19:14.406377] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-24T22:19:14.409551] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-24T22:19:14.412000] [INFO ] [MAIN ] Derivative Progress: 545/2075 symbols completed. DX took 1.2s. Estimated remaining: 10m 5s. Rate: 151.6 symbols/min [2025-09-24T22:19:14.412934] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:14.419123] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-24T22:19:14.419293] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-24T22:19:14.421693] [INFO ] [MAIN ] Derivative Progress: 546/2075 symbols completed. DXC took 1.2s. Estimated remaining: 10m 4s. Rate: 151.9 symbols/min [2025-09-24T22:19:14.422162] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:14.446791] [DEBUG] [LOCAL ] DY: Loaded 29758 existing records from primary storage. [2025-09-24T22:19:14.447031] [INFO ] [MAIN ] DY: Loaded 29758 primary data records. [2025-09-24T22:19:14.637860] [DEBUG] [LOCAL ] E: Loaded 33384 existing records from primary storage. [2025-09-24T22:19:14.673466] [INFO ] [MAIN ] E: Loaded 33384 primary data records. [2025-09-24T22:19:14.811254] [DEBUG] [LOCAL ] EAF: Loaded 43750 existing records from primary storage. [2025-09-24T22:19:14.854768] [INFO ] [MAIN ] EAF: Loaded 43750 primary data records. [2025-09-24T22:19:15.511124] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:15.512049] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29758 primary records. [2025-09-24T22:19:15.512146] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-24T22:19:15.532561] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-24T22:19:15.534086] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-24T22:19:15.536304] [INFO ] [MAIN ] Derivative Progress: 547/2075 symbols completed. DY took 1.2s. Estimated remaining: 10m 6s. Rate: 151.4 symbols/min [2025-09-24T22:19:15.537998] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:15.556541] [DEBUG] [MAIN ] E: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:15.557478] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33384 primary records. [2025-09-24T22:19:15.560354] [DEBUG] [LOCAL ] EAI: Loaded 3961 existing records from primary storage. [2025-09-24T22:19:15.573301] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-24T22:19:15.573599] [DEBUG] [MAIN ] EAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:15.573237] [INFO ] [MAIN ] EAI: Loaded 3961 primary data records. [2025-09-24T22:19:15.575437] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 43750 primary records. [2025-09-24T22:19:15.596694] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-24T22:19:15.710448] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-24T22:19:15.715282] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-24T22:19:15.729361] [INFO ] [MAIN ] Derivative Progress: 548/2075 symbols completed. EAF took 1.3s. Estimated remaining: 10m 5s. Rate: 151.5 symbols/min [2025-09-24T22:19:15.740228] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:15.770144] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-24T22:19:15.910053] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-24T22:19:15.920629] [INFO ] [MAIN ] Derivative Progress: 549/2075 symbols completed. E took 1.5s. Estimated remaining: 10m 4s. Rate: 151.7 symbols/min [2025-09-24T22:19:15.921016] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:15.974206] [DEBUG] [LOCAL ] EARN: Loaded 30263 existing records from primary storage. [2025-09-24T22:19:15.974586] [INFO ] [MAIN ] EARN: Loaded 30263 primary data records. [2025-09-24T22:19:15.975238] [DEBUG] [MAIN ] EAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:16.000030] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3961 primary records. [2025-09-24T22:19:16.020817] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-24T22:19:16.143004] [DEBUG] [LOCAL ] EAT: Loaded 49810 existing records from primary storage. [2025-09-24T22:19:16.162607] [INFO ] [MAIN ] EAT: Loaded 49810 primary data records. [2025-09-24T22:19:16.246816] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-24T22:19:16.258994] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-24T22:19:16.411491] [INFO ] [MAIN ] Derivative Progress: 550/2075 symbols completed. EAI took 0.9s. Estimated remaining: 10m 4s. Rate: 151.6 symbols/min [2025-09-24T22:19:16.424136] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:16.667026] [DEBUG] [MAIN ] EARN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:16.667841] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 30263 primary records. [2025-09-24T22:19:16.668122] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-24T22:19:16.696090] [DEBUG] [LOCAL ] EB: Loaded 37674 existing records from primary storage. [2025-09-24T22:19:16.697695] [INFO ] [MAIN ] EB: Loaded 37674 primary data records. [2025-09-24T22:19:16.711283] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-24T22:19:16.744921] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-24T22:19:16.776542] [INFO ] [MAIN ] Derivative Progress: 551/2075 symbols completed. EARN took 1.0s. Estimated remaining: 10m 3s. Rate: 151.6 symbols/min [2025-09-24T22:19:16.789189] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:16.826584] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:16.844565] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49810 primary records. [2025-09-24T22:19:16.879556] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-24T22:19:17.094559] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-09-24T22:19:17.094808] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-24T22:19:17.097132] [INFO ] [MAIN ] Derivative Progress: 552/2075 symbols completed. EAT took 1.2s. Estimated remaining: 10m 2s. Rate: 151.7 symbols/min [2025-09-24T22:19:17.097721] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:17.160033] [DEBUG] [MAIN ] EB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:17.161361] [DEBUG] [LOCAL ] EBR: Loaded 43088 existing records from primary storage. [2025-09-24T22:19:17.161548] [INFO ] [MAIN ] EBR: Loaded 43088 primary data records. [2025-09-24T22:19:17.162623] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37674 primary records. [2025-09-24T22:19:17.193946] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-24T22:19:17.295541] [DEBUG] [LOCAL ] EC: Loaded 49335 existing records from primary storage. [2025-09-24T22:19:17.298684] [INFO ] [MAIN ] EC: Loaded 49335 primary data records. [2025-09-24T22:19:17.448258] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-24T22:19:17.482333] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-24T22:19:17.606942] [INFO ] [MAIN ] Derivative Progress: 553/2075 symbols completed. EB took 1.2s. Estimated remaining: 10m 2s. Rate: 151.6 symbols/min [2025-09-24T22:19:17.823459] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:17.824158] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43088 primary records. [2025-09-24T22:19:17.824304] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-24T22:19:17.841221] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-24T22:19:17.841975] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-24T22:19:17.844682] [INFO ] [MAIN ] Derivative Progress: 554/2075 symbols completed. EBR took 1.1s. Estimated remaining: 10m 2s. Rate: 151.7 symbols/min [2025-09-24T22:19:17.857331] [DEBUG] [MAIN ] EC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:17.857916] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49335 primary records. [2025-09-24T22:19:17.857977] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-24T22:19:17.872949] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-24T22:19:17.873008] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-24T22:19:17.875047] [INFO ] [MAIN ] Derivative Progress: 555/2075 symbols completed. EC took 0.8s. Estimated remaining: 10m 0s. Rate: 152.0 symbols/min [2025-09-24T22:19:17.875533] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:17.876032] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:17.875935] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:17.933277] [DEBUG] [LOCAL ] ECAT: Loaded 29712 existing records from primary storage. [2025-09-24T22:19:17.933446] [INFO ] [MAIN ] ECAT: Loaded 29712 primary data records. [2025-09-24T22:19:17.934016] [DEBUG] [LOCAL ] ECG: Loaded 34236 existing records from primary storage. [2025-09-24T22:19:17.934524] [INFO ] [MAIN ] ECG: Loaded 34236 primary data records. [2025-09-24T22:19:18.124220] [DEBUG] [LOCAL ] ECC: Loaded 43428 existing records from primary storage. [2025-09-24T22:19:18.132864] [INFO ] [MAIN ] ECC: Loaded 43428 primary data records. [2025-09-24T22:19:18.881333] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:18.880998] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:18.882197] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 34236 primary records. [2025-09-24T22:19:18.882898] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29712 primary records. [2025-09-24T22:19:18.883071] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-24T22:19:18.883943] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-24T22:19:18.911562] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-24T22:19:18.911693] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-24T22:19:18.914718] [INFO ] [MAIN ] Derivative Progress: 556/2075 symbols completed. ECAT took 1.0s. Estimated remaining: 10m 2s. Rate: 151.5 symbols/min [2025-09-24T22:19:18.915506] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:18.933066] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-24T22:19:18.933329] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-24T22:19:18.935890] [INFO ] [MAIN ] Derivative Progress: 557/2075 symbols completed. ECG took 1.1s. Estimated remaining: 10m 0s. Rate: 151.8 symbols/min [2025-09-24T22:19:18.933623] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:18.937025] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43428 primary records. [2025-09-24T22:19:18.937187] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-24T22:19:18.936241] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:18.954049] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-09-24T22:19:18.954195] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-24T22:19:18.956404] [INFO ] [MAIN ] Derivative Progress: 558/2075 symbols completed. ECC took 1.1s. Estimated remaining: 9m 59s. Rate: 152.0 symbols/min [2025-09-24T22:19:18.961164] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:18.970070] [DEBUG] [LOCAL ] ECO: Loaded 18536 existing records from primary storage. [2025-09-24T22:19:18.970188] [INFO ] [MAIN ] ECO: Loaded 18536 primary data records. [2025-09-24T22:19:19.205990] [DEBUG] [LOCAL ] ECL: Loaded 46760 existing records from primary storage. [2025-09-24T22:19:19.323691] [INFO ] [MAIN ] ECL: Loaded 46760 primary data records. [2025-09-24T22:19:19.365381] [DEBUG] [LOCAL ] ECVT: Loaded 42992 existing records from primary storage. [2025-09-24T22:19:19.383119] [INFO ] [MAIN ] ECVT: Loaded 42992 primary data records. [2025-09-24T22:19:19.972307] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:19.973333] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18536 primary records. [2025-09-24T22:19:19.973686] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-24T22:19:19.991760] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-24T22:19:19.992250] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-24T22:19:19.994704] [INFO ] [MAIN ] Derivative Progress: 559/2075 symbols completed. ECO took 1.1s. Estimated remaining: 10m 0s. Rate: 151.6 symbols/min [2025-09-24T22:19:19.995106] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:20.013819] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:20.021988] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46760 primary records. [2025-09-24T22:19:20.026685] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-24T22:19:20.027741] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:20.028514] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 42992 primary records. [2025-09-24T22:19:20.039437] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-24T22:19:20.051575] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-24T22:19:20.051866] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-24T22:19:20.060604] [INFO ] [MAIN ] Derivative Progress: 560/2075 symbols completed. ECL took 1.1s. Estimated remaining: 9m 59s. Rate: 151.8 symbols/min [2025-09-24T22:19:20.064438] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:20.077864] [DEBUG] [LOCAL ] EDD: Loaded 27081 existing records from primary storage. [2025-09-24T22:19:20.078719] [INFO ] [MAIN ] EDD: Loaded 27081 primary data records. [2025-09-24T22:19:20.079068] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-24T22:19:20.099723] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-24T22:19:20.120755] [INFO ] [MAIN ] Derivative Progress: 561/2075 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 57s. Rate: 152.0 symbols/min [2025-09-24T22:19:20.148471] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:20.176122] [DEBUG] [LOCAL ] EDF: Loaded 13507 existing records from primary storage. [2025-09-24T22:19:20.193930] [INFO ] [MAIN ] EDF: Loaded 13507 primary data records. [2025-09-24T22:19:20.387080] [DEBUG] [LOCAL ] EDN: Loaded 18143 existing records from primary storage. [2025-09-24T22:19:20.496350] [INFO ] [MAIN ] EDN: Loaded 18143 primary data records. [2025-09-24T22:19:21.084949] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:21.085894] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27081 primary records. [2025-09-24T22:19:21.086261] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-24T22:19:21.102776] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-24T22:19:21.103077] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-24T22:19:21.107380] [INFO ] [MAIN ] Derivative Progress: 562/2075 symbols completed. EDD took 1.1s. Estimated remaining: 9m 59s. Rate: 151.6 symbols/min [2025-09-24T22:19:21.108182] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:21.121334] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:21.122242] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13507 primary records. [2025-09-24T22:19:21.122475] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-24T22:19:21.154212] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:21.153403] [DEBUG] [LOCAL ] EEA: Loaded 2702 existing records from primary storage. [2025-09-24T22:19:21.154958] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18143 primary records. [2025-09-24T22:19:21.155681] [INFO ] [MAIN ] EEA: Loaded 2702 primary data records. [2025-09-24T22:19:21.156213] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-09-24T22:19:21.176953] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-24T22:19:21.167338] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-24T22:19:21.189542] [INFO ] [MAIN ] Derivative Progress: 563/2075 symbols completed. EDF took 1.1s. Estimated remaining: 9m 57s. Rate: 151.9 symbols/min [2025-09-24T22:19:21.200534] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:21.277395] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-24T22:19:21.283020] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-24T22:19:21.308148] [INFO ] [MAIN ] Derivative Progress: 564/2075 symbols completed. EDN took 1.2s. Estimated remaining: 9m 56s. Rate: 152.0 symbols/min [2025-09-24T22:19:21.331167] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:21.471800] [DEBUG] [LOCAL ] EEX: Loaded 11999 existing records from primary storage. [2025-09-24T22:19:21.481943] [INFO ] [MAIN ] EEX: Loaded 11999 primary data records. [2025-09-24T22:19:21.815657] [DEBUG] [LOCAL ] EFC: Loaded 46236 existing records from primary storage. [2025-09-24T22:19:21.816445] [INFO ] [MAIN ] EFC: Loaded 46236 primary data records. [2025-09-24T22:19:21.835883] [DEBUG] [MAIN ] EEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:21.868684] [INFO ] [MAIN ] EEA: Generated 1794 derivative records from 2702 primary records. [2025-09-24T22:19:21.908016] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-24T22:19:21.968564] [DEBUG] [LOCAL ] EEA: Derivative data saved (1794 records). [2025-09-24T22:19:21.979233] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-24T22:19:21.997165] [INFO ] [MAIN ] Derivative Progress: 565/2075 symbols completed. EEA took 0.9s. Estimated remaining: 9m 57s. Rate: 151.8 symbols/min [2025-09-24T22:19:22.006537] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:22.169197] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:22.170696] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 11999 primary records. [2025-09-24T22:19:22.170955] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-24T22:19:22.191911] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-24T22:19:22.197124] [DEBUG] [LOCAL ] EFR: Loaded 14270 existing records from primary storage. [2025-09-24T22:19:22.197343] [INFO ] [MAIN ] EFR: Loaded 14270 primary data records. [2025-09-24T22:19:22.197505] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-24T22:19:22.221184] [INFO ] [MAIN ] Derivative Progress: 566/2075 symbols completed. EEX took 1.0s. Estimated remaining: 9m 56s. Rate: 152.0 symbols/min [2025-09-24T22:19:22.243741] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:22.527167] [DEBUG] [MAIN ] EFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:22.528170] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46236 primary records. [2025-09-24T22:19:22.528322] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-24T22:19:22.559793] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-24T22:19:22.560936] [DEBUG] [LOCAL ] EFX: Loaded 44808 existing records from primary storage. [2025-09-24T22:19:22.560216] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-24T22:19:22.561168] [INFO ] [MAIN ] EFX: Loaded 44808 primary data records. [2025-09-24T22:19:22.563329] [INFO ] [MAIN ] Derivative Progress: 567/2075 symbols completed. EFC took 1.2s. Estimated remaining: 9m 55s. Rate: 152.0 symbols/min [2025-09-24T22:19:22.574739] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:22.933593] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:22.935421] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14270 primary records. [2025-09-24T22:19:22.935631] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-24T22:19:22.936334] [DEBUG] [LOCAL ] EFXT: Loaded 29316 existing records from primary storage. [2025-09-24T22:19:22.938000] [INFO ] [MAIN ] EFXT: Loaded 29316 primary data records. [2025-09-24T22:19:23.013476] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-09-24T22:19:23.028472] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-24T22:19:23.038076] [INFO ] [MAIN ] Derivative Progress: 568/2075 symbols completed. EFR took 1.0s. Estimated remaining: 9m 55s. Rate: 151.9 symbols/min [2025-09-24T22:19:23.251988] [DEBUG] [MAIN ] EFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:23.274425] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44808 primary records. [2025-09-24T22:19:23.275002] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-24T22:19:23.293419] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-24T22:19:23.293635] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-24T22:19:23.295910] [INFO ] [MAIN ] Derivative Progress: 569/2075 symbols completed. EFX took 1.1s. Estimated remaining: 9m 54s. Rate: 152.0 symbols/min [2025-09-24T22:19:23.315391] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:23.316036] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29316 primary records. [2025-09-24T22:19:23.316098] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-24T22:19:23.330919] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-24T22:19:23.330980] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-24T22:19:23.333945] [INFO ] [MAIN ] Derivative Progress: 570/2075 symbols completed. EFXT took 0.8s. Estimated remaining: 9m 53s. Rate: 152.3 symbols/min [2025-09-24T22:19:23.334582] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:23.334787] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:23.334510] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:23.388208] [DEBUG] [LOCAL ] EGY: Loaded 42252 existing records from primary storage. [2025-09-24T22:19:23.388493] [INFO ] [MAIN ] EGY: Loaded 42252 primary data records. [2025-09-24T22:19:23.508786] [DEBUG] [LOCAL ] EG: Loaded 28623 existing records from primary storage. [2025-09-24T22:19:23.525218] [DEBUG] [LOCAL ] EGP: Loaded 31184 existing records from primary storage. [2025-09-24T22:19:23.519592] [INFO ] [MAIN ] EG: Loaded 28623 primary data records. [2025-09-24T22:19:23.525359] [INFO ] [MAIN ] EGP: Loaded 31184 primary data records. [2025-09-24T22:19:24.357985] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:24.359178] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42252 primary records. [2025-09-24T22:19:24.359386] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-24T22:19:24.379899] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-24T22:19:24.380152] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-24T22:19:24.390126] [INFO ] [MAIN ] Derivative Progress: 571/2075 symbols completed. EGY took 1.1s. Estimated remaining: 9m 54s. Rate: 151.8 symbols/min [2025-09-24T22:19:24.395661] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:24.396568] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:24.397878] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 28623 primary records. [2025-09-24T22:19:24.398013] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-24T22:19:24.417866] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-09-24T22:19:24.418914] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-24T22:19:24.422546] [INFO ] [MAIN ] Derivative Progress: 572/2075 symbols completed. EG took 1.1s. Estimated remaining: 9m 53s. Rate: 152.1 symbols/min [2025-09-24T22:19:24.422881] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:24.444040] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:24.444843] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 31184 primary records. [2025-09-24T22:19:24.444983] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-24T22:19:24.468153] [DEBUG] [LOCAL ] EHAB: Loaded 29959 existing records from primary storage. [2025-09-24T22:19:24.468927] [INFO ] [MAIN ] EHAB: Loaded 29959 primary data records. [2025-09-24T22:19:24.584368] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-09-24T22:19:24.606207] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-24T22:19:24.636290] [INFO ] [MAIN ] Derivative Progress: 573/2075 symbols completed. EGP took 1.3s. Estimated remaining: 9m 52s. Rate: 152.2 symbols/min [2025-09-24T22:19:24.665017] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:24.824085] [DEBUG] [LOCAL ] EHC: Loaded 41408 existing records from primary storage. [2025-09-24T22:19:24.824378] [INFO ] [MAIN ] EHC: Loaded 41408 primary data records. [2025-09-24T22:19:25.019120] [DEBUG] [LOCAL ] EIC: Loaded 24078 existing records from primary storage. [2025-09-24T22:19:25.024960] [INFO ] [MAIN ] EIC: Loaded 24078 primary data records. [2025-09-24T22:19:25.493192] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:25.495925] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29959 primary records. [2025-09-24T22:19:25.496279] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-24T22:19:25.522256] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:25.523854] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41408 primary records. [2025-09-24T22:19:25.524378] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-24T22:19:25.543830] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-24T22:19:25.544444] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-24T22:19:25.546959] [INFO ] [MAIN ] Derivative Progress: 574/2075 symbols completed. EHC took 1.1s. Estimated remaining: 9m 53s. Rate: 151.8 symbols/min [2025-09-24T22:19:25.547638] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:25.547720] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-09-24T22:19:25.548071] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-24T22:19:25.550380] [INFO ] [MAIN ] Derivative Progress: 575/2075 symbols completed. EHAB took 1.2s. Estimated remaining: 9m 52s. Rate: 152.1 symbols/min [2025-09-24T22:19:25.550604] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:25.571027] [DEBUG] [MAIN ] EIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:25.577149] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 24078 primary records. [2025-09-24T22:19:25.577299] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-24T22:19:25.602226] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-24T22:19:25.602439] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-24T22:19:25.604844] [INFO ] [MAIN ] Derivative Progress: 576/2075 symbols completed. EIC took 0.9s. Estimated remaining: 9m 50s. Rate: 152.3 symbols/min [2025-09-24T22:19:25.599963] [DEBUG] [LOCAL ] EIG: Loaded 20314 existing records from primary storage. [2025-09-24T22:19:25.605034] [INFO ] [MAIN ] EIG: Loaded 20314 primary data records. [2025-09-24T22:19:25.605231] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:25.936350] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-09-24T22:19:25.936566] [INFO ] [MAIN ] EIX: Loaded 53339 primary data records. [2025-09-24T22:19:26.284897] [DEBUG] [LOCAL ] EL: Loaded 53403 existing records from primary storage. [2025-09-24T22:19:26.285293] [INFO ] [MAIN ] EL: Loaded 53403 primary data records. [2025-09-24T22:19:26.487854] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:26.583511] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20314 primary records. [2025-09-24T22:19:26.607554] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-24T22:19:26.642085] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-24T22:19:26.643067] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:26.644003] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53339 primary records. [2025-09-24T22:19:26.643294] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-24T22:19:26.644099] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-24T22:19:26.647160] [INFO ] [MAIN ] Derivative Progress: 577/2075 symbols completed. EIG took 1.1s. Estimated remaining: 9m 52s. Rate: 151.9 symbols/min [2025-09-24T22:19:26.648200] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:26.666688] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-09-24T22:19:26.666952] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-24T22:19:26.669191] [INFO ] [MAIN ] Derivative Progress: 578/2075 symbols completed. EIX took 1.1s. Estimated remaining: 9m 50s. Rate: 152.2 symbols/min [2025-09-24T22:19:26.669679] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:26.677515] [DEBUG] [LOCAL ] ELC: Loaded 3493 existing records from primary storage. [2025-09-24T22:19:26.690461] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:26.690172] [INFO ] [MAIN ] ELC: Loaded 3493 primary data records. [2025-09-24T22:19:26.702360] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53403 primary records. [2025-09-24T22:19:26.702552] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-24T22:19:26.822310] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-24T22:19:26.843384] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-24T22:19:26.865258] [INFO ] [MAIN ] Derivative Progress: 579/2075 symbols completed. EL took 1.3s. Estimated remaining: 9m 49s. Rate: 152.3 symbols/min [2025-09-24T22:19:26.917830] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:27.041578] [DEBUG] [LOCAL ] ELAN: Loaded 53207 existing records from primary storage. [2025-09-24T22:19:27.046980] [INFO ] [MAIN ] ELAN: Loaded 53207 primary data records. [2025-09-24T22:19:27.420525] [DEBUG] [LOCAL ] ELF: Loaded 52280 existing records from primary storage. [2025-09-24T22:19:27.428859] [INFO ] [MAIN ] ELF: Loaded 52280 primary data records. [2025-09-24T22:19:27.434874] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:27.473567] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3493 primary records. [2025-09-24T22:19:27.480836] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-24T22:19:27.586090] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-09-24T22:19:27.607254] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-24T22:19:27.610163] [INFO ] [MAIN ] Derivative Progress: 580/2075 symbols completed. ELC took 0.9s. Estimated remaining: 9m 50s. Rate: 152.1 symbols/min [2025-09-24T22:19:27.619791] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:27.804342] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:27.806078] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53207 primary records. [2025-09-24T22:19:27.806240] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-24T22:19:27.837307] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-24T22:19:27.837463] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-24T22:19:27.840237] [INFO ] [MAIN ] Derivative Progress: 581/2075 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 49s. Rate: 152.2 symbols/min [2025-09-24T22:19:27.840635] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:27.855629] [DEBUG] [LOCAL ] ELME: Loaded 39255 existing records from primary storage. [2025-09-24T22:19:27.856768] [INFO ] [MAIN ] ELME: Loaded 39255 primary data records. [2025-09-24T22:19:27.943068] [DEBUG] [MAIN ] ELF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:27.955570] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52280 primary records. [2025-09-24T22:19:27.971834] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-24T22:19:28.000860] [DEBUG] [LOCAL ] ELP: Loaded 25783 existing records from primary storage. [2025-09-24T22:19:28.021683] [INFO ] [MAIN ] ELP: Loaded 25783 primary data records. [2025-09-24T22:19:28.309365] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-24T22:19:28.314167] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-24T22:19:28.316778] [INFO ] [MAIN ] Derivative Progress: 582/2075 symbols completed. ELF took 1.4s. Estimated remaining: 9m 49s. Rate: 152.1 symbols/min [2025-09-24T22:19:28.317253] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:28.541808] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:28.542611] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39255 primary records. [2025-09-24T22:19:28.542844] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-24T22:19:28.572616] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-24T22:19:28.573693] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-24T22:19:28.577387] [INFO ] [MAIN ] Derivative Progress: 583/2075 symbols completed. ELME took 1.0s. Estimated remaining: 9m 48s. Rate: 152.2 symbols/min [2025-09-24T22:19:28.604926] [DEBUG] [LOCAL ] ELS: Loaded 49387 existing records from primary storage. [2025-09-24T22:19:28.606062] [INFO ] [MAIN ] ELS: Loaded 49387 primary data records. [2025-09-24T22:19:28.605971] [DEBUG] [MAIN ] ELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:28.622450] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25783 primary records. [2025-09-24T22:19:28.638575] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-24T22:19:28.773583] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-24T22:19:28.798806] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-24T22:19:28.804250] [INFO ] [MAIN ] Derivative Progress: 584/2075 symbols completed. ELP took 1.0s. Estimated remaining: 9m 47s. Rate: 152.3 symbols/min [2025-09-24T22:19:28.968248] [DEBUG] [MAIN ] ELS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:28.968900] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49387 primary records. [2025-09-24T22:19:28.968963] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-24T22:19:28.984590] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-09-24T22:19:28.984683] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-24T22:19:28.986731] [INFO ] [MAIN ] Derivative Progress: 585/2075 symbols completed. ELS took 0.7s. Estimated remaining: 9m 46s. Rate: 152.4 symbols/min [2025-09-24T22:19:28.987830] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:28.987626] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:28.987981] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:29.010686] [DEBUG] [LOCAL ] EMD: Loaded 21032 existing records from primary storage. [2025-09-24T22:19:29.018129] [INFO ] [MAIN ] EMD: Loaded 21032 primary data records. [2025-09-24T22:19:29.146214] [DEBUG] [LOCAL ] EME: Loaded 31647 existing records from primary storage. [2025-09-24T22:19:29.162607] [INFO ] [MAIN ] EME: Loaded 31647 primary data records. [2025-09-24T22:19:29.314697] [DEBUG] [LOCAL ] ELV: Loaded 50586 existing records from primary storage. [2025-09-24T22:19:29.339907] [INFO ] [MAIN ] ELV: Loaded 50586 primary data records. [2025-09-24T22:19:30.018811] [DEBUG] [MAIN ] EMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:30.021788] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21032 primary records. [2025-09-24T22:19:30.022968] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-24T22:19:30.049995] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:30.054336] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-09-24T22:19:30.055291] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31647 primary records. [2025-09-24T22:19:30.055515] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-24T22:19:30.057591] [INFO ] [MAIN ] Derivative Progress: 586/2075 symbols completed. EMD took 1.1s. Estimated remaining: 9m 48s. Rate: 152.0 symbols/min [2025-09-24T22:19:30.057834] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-24T22:19:30.059210] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:30.079969] [DEBUG] [LOCAL ] EMF: Loaded 3547 existing records from primary storage. [2025-09-24T22:19:30.080971] [INFO ] [MAIN ] EMF: Loaded 3547 primary data records. [2025-09-24T22:19:30.138267] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-09-24T22:19:30.155589] [DEBUG] [MAIN ] ELV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:30.164152] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-24T22:19:30.179502] [INFO ] [MAIN ] Derivative Progress: 587/2075 symbols completed. EME took 1.2s. Estimated remaining: 9m 47s. Rate: 152.2 symbols/min [2025-09-24T22:19:30.170197] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50586 primary records. [2025-09-24T22:19:30.190139] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-24T22:19:30.190283] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:30.426847] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-09-24T22:19:30.427440] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-24T22:19:30.430911] [INFO ] [MAIN ] Derivative Progress: 588/2075 symbols completed. ELV took 1.4s. Estimated remaining: 9m 46s. Rate: 152.3 symbols/min [2025-09-24T22:19:30.431740] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:30.473270] [DEBUG] [LOCAL ] EMO: Loaded 12415 existing records from primary storage. [2025-09-24T22:19:30.474199] [INFO ] [MAIN ] EMO: Loaded 12415 primary data records. [2025-09-24T22:19:30.472875] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:30.486848] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3547 primary records. [2025-09-24T22:19:30.499914] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-24T22:19:30.555707] [DEBUG] [LOCAL ] EMN: Loaded 50362 existing records from primary storage. [2025-09-24T22:19:30.582592] [INFO ] [MAIN ] EMN: Loaded 50362 primary data records. [2025-09-24T22:19:30.596084] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-24T22:19:30.596231] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-24T22:19:30.610984] [INFO ] [MAIN ] Derivative Progress: 589/2075 symbols completed. EMF took 0.6s. Estimated remaining: 9m 45s. Rate: 152.4 symbols/min [2025-09-24T22:19:30.650058] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:30.974969] [DEBUG] [LOCAL ] EMP: Loaded 3041 existing records from primary storage. [2025-09-24T22:19:31.019110] [INFO ] [MAIN ] EMP: Loaded 3041 primary data records. [2025-09-24T22:19:31.501062] [DEBUG] [MAIN ] EMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:31.502625] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12415 primary records. [2025-09-24T22:19:31.502917] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-24T22:19:31.531202] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-09-24T22:19:31.531719] [DEBUG] [MAIN ] EMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:31.531935] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-24T22:19:31.532820] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50362 primary records. [2025-09-24T22:19:31.534912] [INFO ] [MAIN ] Derivative Progress: 590/2075 symbols completed. EMO took 1.1s. Estimated remaining: 9m 46s. Rate: 152.1 symbols/min [2025-09-24T22:19:31.535039] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-24T22:19:31.535277] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:31.565726] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:19:31.567265] [INFO ] [MAIN ] EMP: Generated 1793 derivative records from 3041 primary records. [2025-09-24T22:19:31.568148] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-24T22:19:31.568211] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-24T22:19:31.568402] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-24T22:19:31.571121] [INFO ] [MAIN ] Derivative Progress: 591/2075 symbols completed. EMN took 1.4s. Estimated remaining: 9m 45s. Rate: 152.3 symbols/min [2025-09-24T22:19:31.571881] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:31.587384] [DEBUG] [LOCAL ] EMP: Derivative data saved (1793 records). [2025-09-24T22:19:31.590028] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-24T22:19:31.592945] [INFO ] [MAIN ] Derivative Progress: 592/2075 symbols completed. EMP took 1.0s. Estimated remaining: 9m 43s. Rate: 152.5 symbols/min [2025-09-24T22:19:31.593347] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:31.657049] [DEBUG] [LOCAL ] EMR: Loaded 53249 existing records from primary storage. [2025-09-24T22:19:31.667024] [INFO ] [MAIN ] EMR: Loaded 53249 primary data records. [2025-09-24T22:19:31.689828] [DEBUG] [LOCAL ] ENIC: Loaded 36528 existing records from primary storage. [2025-09-24T22:19:31.751634] [INFO ] [MAIN ] ENIC: Loaded 36528 primary data records. [2025-09-24T22:19:31.786534] [DEBUG] [LOCAL ] ENB: Loaded 53516 existing records from primary storage. [2025-09-24T22:19:31.786785] [INFO ] [MAIN ] ENB: Loaded 53516 primary data records. [2025-09-24T22:19:32.633582] [DEBUG] [MAIN ] EMR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:19:32.634819] [INFO ] [MAIN ] EMR: Generated 1793 derivative records from 53249 primary records. [2025-09-24T22:19:32.637427] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-24T22:19:32.651788] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:32.661052] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53516 primary records. [2025-09-24T22:19:32.663920] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-24T22:19:32.681426] [DEBUG] [LOCAL ] EMR: Derivative data saved (1793 records). [2025-09-24T22:19:32.681833] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-24T22:19:32.682136] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:32.695860] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36528 primary records. [2025-09-24T22:19:32.692298] [INFO ] [MAIN ] Derivative Progress: 593/2075 symbols completed. EMR took 1.2s. Estimated remaining: 9m 45s. Rate: 152.1 symbols/min [2025-09-24T22:19:32.696438] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-24T22:19:32.697127] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:32.716125] [DEBUG] [LOCAL ] ENO: Loaded 1940 existing records from primary storage. [2025-09-24T22:19:32.717246] [INFO ] [MAIN ] ENO: Loaded 1940 primary data records. [2025-09-24T22:19:32.751603] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-24T22:19:32.765254] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-09-24T22:19:32.785946] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-24T22:19:32.786028] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-24T22:19:32.800256] [INFO ] [MAIN ] Derivative Progress: 594/2075 symbols completed. ENIC took 1.2s. Estimated remaining: 9m 44s. Rate: 152.3 symbols/min [2025-09-24T22:19:32.807935] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:32.813160] [INFO ] [MAIN ] Derivative Progress: 595/2075 symbols completed. ENB took 1.2s. Estimated remaining: 9m 42s. Rate: 152.5 symbols/min [2025-09-24T22:19:32.828356] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:33.081486] [DEBUG] [LOCAL ] ENVA: Loaded 25656 existing records from primary storage. [2025-09-24T22:19:33.082348] [INFO ] [MAIN ] ENVA: Loaded 25656 primary data records. [2025-09-24T22:19:33.206305] [DEBUG] [LOCAL ] ENOV: Loaded 45200 existing records from primary storage. [2025-09-24T22:19:33.222164] [INFO ] [MAIN ] ENOV: Loaded 45200 primary data records. [2025-09-24T22:19:33.535285] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:33.560994] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1940 primary records. [2025-09-24T22:19:33.569798] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-24T22:19:33.737876] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-09-24T22:19:33.738377] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-24T22:19:33.740529] [INFO ] [MAIN ] Derivative Progress: 596/2075 symbols completed. ENO took 1.0s. Estimated remaining: 9m 43s. Rate: 152.2 symbols/min [2025-09-24T22:19:33.741416] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:33.760246] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:33.761208] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25656 primary records. [2025-09-24T22:19:33.761578] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-24T22:19:33.786551] [DEBUG] [LOCAL ] EOD: Loaded 13998 existing records from primary storage. [2025-09-24T22:19:33.789236] [INFO ] [MAIN ] EOD: Loaded 13998 primary data records. [2025-09-24T22:19:33.829595] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-09-24T22:19:33.867741] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-24T22:19:33.887391] [DEBUG] [MAIN ] ENOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:33.906713] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45200 primary records. [2025-09-24T22:19:33.881857] [INFO ] [MAIN ] Derivative Progress: 597/2075 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 42s. Rate: 152.3 symbols/min [2025-09-24T22:19:33.910243] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-24T22:19:33.910547] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:34.122603] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-24T22:19:34.123010] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-24T22:19:34.125840] [INFO ] [MAIN ] Derivative Progress: 598/2075 symbols completed. ENOV took 1.3s. Estimated remaining: 9m 41s. Rate: 152.4 symbols/min [2025-09-24T22:19:34.170782] [DEBUG] [MAIN ] EOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:34.171747] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 13998 primary records. [2025-09-24T22:19:34.171841] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-24T22:19:34.204403] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-24T22:19:34.205498] [INFO ] [MAIN ] EOG: Loaded 53341 primary data records. [2025-09-24T22:19:34.249837] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-24T22:19:34.282012] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-24T22:19:34.284467] [INFO ] [MAIN ] Derivative Progress: 599/2075 symbols completed. EOD took 0.5s. Estimated remaining: 9m 40s. Rate: 152.6 symbols/min [2025-09-24T22:19:34.517426] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:34.518118] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53341 primary records. [2025-09-24T22:19:34.518182] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-24T22:19:34.534335] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-24T22:19:34.534396] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-24T22:19:34.536350] [INFO ] [MAIN ] Derivative Progress: 600/2075 symbols completed. EOG took 0.6s. Estimated remaining: 9m 40s. Rate: 152.7 symbols/min [2025-09-24T22:19:34.536902] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:34.537143] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:34.537213] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:34.547704] [DEBUG] [LOCAL ] EOT: Loaded 6858 existing records from primary storage. [2025-09-24T22:19:34.547877] [INFO ] [MAIN ] EOT: Loaded 6858 primary data records. [2025-09-24T22:19:34.623595] [DEBUG] [LOCAL ] EOI: Loaded 10569 existing records from primary storage. [2025-09-24T22:19:34.657442] [DEBUG] [LOCAL ] EOS: Loaded 15341 existing records from primary storage. [2025-09-24T22:19:34.651301] [INFO ] [MAIN ] EOI: Loaded 10569 primary data records. [2025-09-24T22:19:34.668671] [INFO ] [MAIN ] EOS: Loaded 15341 primary data records. [2025-09-24T22:19:35.519547] [DEBUG] [MAIN ] EOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:35.520289] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6858 primary records. [2025-09-24T22:19:35.520409] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-24T22:19:35.541742] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-09-24T22:19:35.541969] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-24T22:19:35.556260] [INFO ] [MAIN ] Derivative Progress: 601/2075 symbols completed. EOT took 1.0s. Estimated remaining: 9m 41s. Rate: 152.3 symbols/min [2025-09-24T22:19:35.556962] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:35.557338] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:35.570320] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15341 primary records. [2025-09-24T22:19:35.570594] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-24T22:19:35.579355] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:35.580277] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10569 primary records. [2025-09-24T22:19:35.584080] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-24T22:19:35.602925] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-24T22:19:35.603481] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-24T22:19:35.606185] [INFO ] [MAIN ] Derivative Progress: 602/2075 symbols completed. EOI took 1.1s. Estimated remaining: 9m 40s. Rate: 152.5 symbols/min [2025-09-24T22:19:35.606735] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:35.614611] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-24T22:19:35.614811] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-24T22:19:35.617516] [INFO ] [MAIN ] Derivative Progress: 603/2075 symbols completed. EOS took 1.1s. Estimated remaining: 9m 38s. Rate: 152.7 symbols/min [2025-09-24T22:19:35.618064] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:35.629863] [DEBUG] [LOCAL ] EPAC: Loaded 27063 existing records from primary storage. [2025-09-24T22:19:35.630071] [INFO ] [MAIN ] EPAC: Loaded 27063 primary data records. [2025-09-24T22:19:35.975149] [DEBUG] [LOCAL ] EPAM: Loaded 39772 existing records from primary storage. [2025-09-24T22:19:35.976091] [INFO ] [MAIN ] EPAM: Loaded 39772 primary data records. [2025-09-24T22:19:35.975992] [DEBUG] [LOCAL ] EPC: Loaded 39852 existing records from primary storage. [2025-09-24T22:19:35.987761] [INFO ] [MAIN ] EPC: Loaded 39852 primary data records. [2025-09-24T22:19:36.663401] [DEBUG] [MAIN ] EPAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:36.664585] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 27063 primary records. [2025-09-24T22:19:36.664932] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-24T22:19:36.687214] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-24T22:19:36.688068] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-24T22:19:36.691465] [INFO ] [MAIN ] Derivative Progress: 604/2075 symbols completed. EPAC took 1.1s. Estimated remaining: 9m 40s. Rate: 152.3 symbols/min [2025-09-24T22:19:36.704542] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:36.704864] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:36.718774] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39852 primary records. [2025-09-24T22:19:36.719487] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-24T22:19:36.720336] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:36.721445] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39772 primary records. [2025-09-24T22:19:36.721794] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-24T22:19:36.755503] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-24T22:19:36.755962] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-24T22:19:36.758174] [INFO ] [MAIN ] Derivative Progress: 605/2075 symbols completed. EPC took 1.1s. Estimated remaining: 9m 38s. Rate: 152.5 symbols/min [2025-09-24T22:19:36.758858] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:36.759063] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-24T22:19:36.759400] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-24T22:19:36.761827] [INFO ] [MAIN ] Derivative Progress: 606/2075 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 37s. Rate: 152.8 symbols/min [2025-09-24T22:19:36.762202] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:36.802877] [DEBUG] [LOCAL ] EPD: Loaded 53615 existing records from primary storage. [2025-09-24T22:19:36.803134] [INFO ] [MAIN ] EPD: Loaded 53615 primary data records. [2025-09-24T22:19:37.034458] [DEBUG] [LOCAL ] EPR: Loaded 44181 existing records from primary storage. [2025-09-24T22:19:37.142915] [INFO ] [MAIN ] EPR: Loaded 44181 primary data records. [2025-09-24T22:19:37.185176] [DEBUG] [LOCAL ] EPRT: Loaded 48677 existing records from primary storage. [2025-09-24T22:19:37.191061] [INFO ] [MAIN ] EPRT: Loaded 48677 primary data records. [2025-09-24T22:19:37.796059] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:37.797286] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53615 primary records. [2025-09-24T22:19:37.797595] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-24T22:19:37.819304] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-24T22:19:37.820003] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-24T22:19:37.822919] [INFO ] [MAIN ] Derivative Progress: 607/2075 symbols completed. EPD took 1.1s. Estimated remaining: 9m 38s. Rate: 152.3 symbols/min [2025-09-24T22:19:37.823604] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:37.860241] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:37.872895] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48677 primary records. [2025-09-24T22:19:37.873800] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-24T22:19:37.873626] [DEBUG] [LOCAL ] EQBK: Loaded 10952 existing records from primary storage. [2025-09-24T22:19:37.874609] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:37.876709] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 44181 primary records. [2025-09-24T22:19:37.874725] [INFO ] [MAIN ] EQBK: Loaded 10952 primary data records. [2025-09-24T22:19:37.877162] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-24T22:19:37.936930] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-24T22:19:37.937342] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-24T22:19:37.939905] [INFO ] [MAIN ] Derivative Progress: 608/2075 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 37s. Rate: 152.5 symbols/min [2025-09-24T22:19:37.959669] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:38.096289] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-24T22:19:38.203472] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-24T22:19:38.215161] [INFO ] [MAIN ] Derivative Progress: 609/2075 symbols completed. EPR took 1.5s. Estimated remaining: 9m 36s. Rate: 152.6 symbols/min [2025-09-24T22:19:38.215806] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:38.268625] [DEBUG] [LOCAL ] EQH: Loaded 52662 existing records from primary storage. [2025-09-24T22:19:38.274335] [INFO ] [MAIN ] EQH: Loaded 52662 primary data records. [2025-09-24T22:19:38.286243] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:38.330622] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10952 primary records. [2025-09-24T22:19:38.351430] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-24T22:19:38.426761] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-09-24T22:19:38.432120] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-24T22:19:38.439897] [INFO ] [MAIN ] Derivative Progress: 610/2075 symbols completed. EQBK took 0.6s. Estimated remaining: 9m 36s. Rate: 152.7 symbols/min [2025-09-24T22:19:38.486186] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:38.514852] [DEBUG] [LOCAL ] EQNR: Loaded 53036 existing records from primary storage. [2025-09-24T22:19:38.635006] [INFO ] [MAIN ] EQNR: Loaded 53036 primary data records. [2025-09-24T22:19:39.045934] [DEBUG] [LOCAL ] EQR: Loaded 51420 existing records from primary storage. [2025-09-24T22:19:39.047458] [INFO ] [MAIN ] EQR: Loaded 51420 primary data records. [2025-09-24T22:19:39.189537] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:39.207752] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52662 primary records. [2025-09-24T22:19:39.213119] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-24T22:19:39.444009] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:39.444874] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-24T22:19:39.446157] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53036 primary records. [2025-09-24T22:19:39.446699] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-24T22:19:39.447528] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-24T22:19:39.451222] [INFO ] [MAIN ] Derivative Progress: 611/2075 symbols completed. EQH took 1.5s. Estimated remaining: 9m 37s. Rate: 152.3 symbols/min [2025-09-24T22:19:39.460380] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:39.469130] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-24T22:19:39.470164] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-24T22:19:39.473304] [INFO ] [MAIN ] Derivative Progress: 612/2075 symbols completed. EQNR took 1.3s. Estimated remaining: 9m 35s. Rate: 152.5 symbols/min [2025-09-24T22:19:39.473843] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:39.479985] [DEBUG] [LOCAL ] EQV: Loaded 2824 existing records from primary storage. [2025-09-24T22:19:39.480351] [INFO ] [MAIN ] EQV: Loaded 2824 primary data records. [2025-09-24T22:19:39.649273] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:39.666222] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51420 primary records. [2025-09-24T22:19:39.666320] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-24T22:19:39.877142] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-24T22:19:39.878130] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-24T22:19:39.937076] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-24T22:19:39.946408] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-24T22:19:39.960997] [INFO ] [MAIN ] Derivative Progress: 613/2075 symbols completed. EQR took 1.5s. Estimated remaining: 9m 35s. Rate: 152.5 symbols/min [2025-09-24T22:19:40.234020] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:40.235165] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2824 primary records. [2025-09-24T22:19:40.235498] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-24T22:19:40.251470] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-24T22:19:40.251562] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-24T22:19:40.253797] [INFO ] [MAIN ] Derivative Progress: 614/2075 symbols completed. EQV took 0.8s. Estimated remaining: 9m 35s. Rate: 152.5 symbols/min [2025-09-24T22:19:40.273776] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:40.274417] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-24T22:19:40.274478] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-24T22:19:40.297173] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-24T22:19:40.297318] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-24T22:19:40.300172] [INFO ] [MAIN ] Derivative Progress: 615/2075 symbols completed. EQT took 0.8s. Estimated remaining: 9m 33s. Rate: 152.8 symbols/min [2025-09-24T22:19:40.301144] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:40.301425] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:40.301608] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:40.390927] [DEBUG] [LOCAL ] ERO: Loaded 41197 existing records from primary storage. [2025-09-24T22:19:40.391186] [INFO ] [MAIN ] ERO: Loaded 41197 primary data records. [2025-09-24T22:19:40.392679] [DEBUG] [LOCAL ] ERJ: Loaded 50732 existing records from primary storage. [2025-09-24T22:19:40.398162] [INFO ] [MAIN ] ERJ: Loaded 50732 primary data records. [2025-09-24T22:19:40.613120] [DEBUG] [LOCAL ] ES: Loaded 52529 existing records from primary storage. [2025-09-24T22:19:40.632423] [INFO ] [MAIN ] ES: Loaded 52529 primary data records. [2025-09-24T22:19:41.428754] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:41.430802] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41197 primary records. [2025-09-24T22:19:41.431047] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-24T22:19:41.461119] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:41.463618] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-24T22:19:41.464688] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-24T22:19:41.466771] [INFO ] [MAIN ] Derivative Progress: 616/2075 symbols completed. ERO took 1.2s. Estimated remaining: 9m 35s. Rate: 152.3 symbols/min [2025-09-24T22:19:41.467447] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:41.468512] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50732 primary records. [2025-09-24T22:19:41.469164] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-24T22:19:41.491952] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:41.496764] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52529 primary records. [2025-09-24T22:19:41.496988] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-24T22:19:41.501453] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-24T22:19:41.501732] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-24T22:19:41.503866] [INFO ] [MAIN ] Derivative Progress: 617/2075 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 34s. Rate: 152.5 symbols/min [2025-09-24T22:19:41.505005] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:41.524492] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-24T22:19:41.535611] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-24T22:19:41.539269] [INFO ] [MAIN ] Derivative Progress: 618/2075 symbols completed. ES took 1.2s. Estimated remaining: 9m 32s. Rate: 152.7 symbols/min [2025-09-24T22:19:41.539793] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:41.548761] [DEBUG] [LOCAL ] ESE: Loaded 16588 existing records from primary storage. [2025-09-24T22:19:41.548906] [INFO ] [MAIN ] ESE: Loaded 16588 primary data records. [2025-09-24T22:19:41.604351] [DEBUG] [LOCAL ] ESAB: Loaded 26219 existing records from primary storage. [2025-09-24T22:19:41.625908] [INFO ] [MAIN ] ESAB: Loaded 26219 primary data records. [2025-09-24T22:19:42.212420] [DEBUG] [LOCAL ] ESI: Loaded 50831 existing records from primary storage. [2025-09-24T22:19:42.213503] [INFO ] [MAIN ] ESI: Loaded 50831 primary data records. [2025-09-24T22:19:42.552559] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:42.566583] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16588 primary records. [2025-09-24T22:19:42.566974] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-24T22:19:42.565878] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:42.568394] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26219 primary records. [2025-09-24T22:19:42.568910] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-24T22:19:42.597338] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-24T22:19:42.599445] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-24T22:19:42.602727] [INFO ] [MAIN ] Derivative Progress: 619/2075 symbols completed. ESE took 1.1s. Estimated remaining: 9m 34s. Rate: 152.3 symbols/min [2025-09-24T22:19:42.605016] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:42.607843] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-24T22:19:42.608076] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-24T22:19:42.611164] [INFO ] [MAIN ] Derivative Progress: 620/2075 symbols completed. ESAB took 1.1s. Estimated remaining: 9m 32s. Rate: 152.5 symbols/min [2025-09-24T22:19:42.624594] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:42.624959] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:42.626044] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50831 primary records. [2025-09-24T22:19:42.626585] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-24T22:19:42.643240] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-24T22:19:42.643360] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-24T22:19:42.645847] [INFO ] [MAIN ] Derivative Progress: 621/2075 symbols completed. ESI took 1.1s. Estimated remaining: 9m 31s. Rate: 152.8 symbols/min [2025-09-24T22:19:42.646395] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:42.700755] [DEBUG] [LOCAL ] ESS: Loaded 30038 existing records from primary storage. [2025-09-24T22:19:42.712448] [INFO ] [MAIN ] ESS: Loaded 30038 primary data records. [2025-09-24T22:19:42.753784] [DEBUG] [LOCAL ] ESNT: Loaded 38568 existing records from primary storage. [2025-09-24T22:19:42.784243] [INFO ] [MAIN ] ESNT: Loaded 38568 primary data records. [2025-09-24T22:19:42.865250] [DEBUG] [LOCAL ] ESRT: Loaded 46377 existing records from primary storage. [2025-09-24T22:19:42.882267] [INFO ] [MAIN ] ESRT: Loaded 46377 primary data records. [2025-09-24T22:19:43.750447] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:43.751337] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30038 primary records. [2025-09-24T22:19:43.751529] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-24T22:19:43.771972] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-24T22:19:43.779770] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-24T22:19:43.784758] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:43.785528] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38568 primary records. [2025-09-24T22:19:43.787464] [INFO ] [MAIN ] Derivative Progress: 622/2075 symbols completed. ESS took 1.1s. Estimated remaining: 9m 32s. Rate: 152.3 symbols/min [2025-09-24T22:19:43.787782] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:43.795392] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-24T22:19:43.801551] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:43.809413] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46377 primary records. [2025-09-24T22:19:43.813131] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-24T22:19:43.818027] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-24T22:19:43.818125] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-24T22:19:43.820538] [INFO ] [MAIN ] Derivative Progress: 623/2075 symbols completed. ESNT took 1.2s. Estimated remaining: 9m 31s. Rate: 152.5 symbols/min [2025-09-24T22:19:43.821065] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:43.838061] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-24T22:19:43.838354] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-24T22:19:43.840916] [INFO ] [MAIN ] Derivative Progress: 624/2075 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 30s. Rate: 152.8 symbols/min [2025-09-24T22:19:43.841361] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:43.866787] [DEBUG] [LOCAL ] ETB: Loaded 11967 existing records from primary storage. [2025-09-24T22:19:43.866936] [INFO ] [MAIN ] ETB: Loaded 11967 primary data records. [2025-09-24T22:19:44.011893] [DEBUG] [LOCAL ] ESTC: Loaded 50067 existing records from primary storage. [2025-09-24T22:19:44.033142] [INFO ] [MAIN ] ESTC: Loaded 50067 primary data records. [2025-09-24T22:19:44.184867] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-24T22:19:44.388449] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-09-24T22:19:45.208769] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:45.209958] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 11967 primary records. [2025-09-24T22:19:45.210205] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-24T22:19:45.234545] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-24T22:19:45.234725] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-24T22:19:45.236722] [INFO ] [MAIN ] Derivative Progress: 625/2075 symbols completed. ETB took 1.4s. Estimated remaining: 9m 32s. Rate: 152.1 symbols/min [2025-09-24T22:19:45.237406] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:45.294049] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:45.296046] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-09-24T22:19:45.295042] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:45.296290] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-24T22:19:45.297513] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50067 primary records. [2025-09-24T22:19:45.298191] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-24T22:19:45.338033] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-24T22:19:45.347980] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-24T22:19:45.347566] [DEBUG] [LOCAL ] ETD: Loaded 27360 existing records from primary storage. [2025-09-24T22:19:45.348362] [INFO ] [MAIN ] ETD: Loaded 27360 primary data records. [2025-09-24T22:19:45.348107] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-24T22:19:45.348444] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-24T22:19:45.350932] [INFO ] [MAIN ] Derivative Progress: 626/2075 symbols completed. ET took 1.5s. Estimated remaining: 9m 31s. Rate: 152.3 symbols/min [2025-09-24T22:19:45.354551] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:45.359995] [INFO ] [MAIN ] Derivative Progress: 627/2075 symbols completed. ESTC took 1.6s. Estimated remaining: 9m 30s. Rate: 152.5 symbols/min [2025-09-24T22:19:45.373258] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:45.529384] [DEBUG] [LOCAL ] ETG: Loaded 16563 existing records from primary storage. [2025-09-24T22:19:45.552742] [DEBUG] [LOCAL ] ETJ: Loaded 16647 existing records from primary storage. [2025-09-24T22:19:45.552963] [INFO ] [MAIN ] ETG: Loaded 16563 primary data records. [2025-09-24T22:19:45.578398] [INFO ] [MAIN ] ETJ: Loaded 16647 primary data records. [2025-09-24T22:19:46.402725] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:46.404052] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27360 primary records. [2025-09-24T22:19:46.404452] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-24T22:19:46.426927] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-24T22:19:46.428050] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-24T22:19:46.437712] [INFO ] [MAIN ] Derivative Progress: 628/2075 symbols completed. ETD took 1.2s. Estimated remaining: 9m 31s. Rate: 152.1 symbols/min [2025-09-24T22:19:46.444597] [DEBUG] [MAIN ] ETG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:46.445572] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16563 primary records. [2025-09-24T22:19:46.445788] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-24T22:19:46.465131] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:46.466205] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16647 primary records. [2025-09-24T22:19:46.466569] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-24T22:19:46.483581] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-24T22:19:46.494230] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-24T22:19:46.502563] [INFO ] [MAIN ] Derivative Progress: 629/2075 symbols completed. ETG took 1.1s. Estimated remaining: 9m 30s. Rate: 152.3 symbols/min [2025-09-24T22:19:46.508588] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-24T22:19:46.508729] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-24T22:19:46.512024] [INFO ] [MAIN ] Derivative Progress: 630/2075 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 28s. Rate: 152.6 symbols/min [2025-09-24T22:19:46.512732] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:46.513122] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:46.513045] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:46.523583] [DEBUG] [LOCAL ] ETO: Loaded 6493 existing records from primary storage. [2025-09-24T22:19:46.523973] [INFO ] [MAIN ] ETO: Loaded 6493 primary data records. [2025-09-24T22:19:46.894216] [DEBUG] [LOCAL ] ETN: Loaded 52834 existing records from primary storage. [2025-09-24T22:19:46.896608] [INFO ] [MAIN ] ETN: Loaded 52834 primary data records. [2025-09-24T22:19:46.930133] [DEBUG] [LOCAL ] ETR: Loaded 53223 existing records from primary storage. [2025-09-24T22:19:46.944247] [INFO ] [MAIN ] ETR: Loaded 53223 primary data records. [2025-09-24T22:19:47.563830] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:47.564864] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6493 primary records. [2025-09-24T22:19:47.565062] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-24T22:19:47.583088] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-24T22:19:47.583576] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-24T22:19:47.586228] [INFO ] [MAIN ] Derivative Progress: 631/2075 symbols completed. ETO took 1.1s. Estimated remaining: 9m 29s. Rate: 152.1 symbols/min [2025-09-24T22:19:47.586798] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:47.606443] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:47.607193] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52834 primary records. [2025-09-24T22:19:47.613082] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-24T22:19:47.643746] [DEBUG] [LOCAL ] ETV: Loaded 21358 existing records from primary storage. [2025-09-24T22:19:47.649345] [INFO ] [MAIN ] ETV: Loaded 21358 primary data records. [2025-09-24T22:19:47.649762] [DEBUG] [MAIN ] ETR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:47.662077] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53223 primary records. [2025-09-24T22:19:47.682552] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-24T22:19:47.762227] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-24T22:19:47.762138] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-24T22:19:47.774354] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-24T22:19:47.774466] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-24T22:19:47.781916] [INFO ] [MAIN ] Derivative Progress: 632/2075 symbols completed. ETN took 1.3s. Estimated remaining: 9m 29s. Rate: 152.3 symbols/min [2025-09-24T22:19:47.792447] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:47.792576] [INFO ] [MAIN ] Derivative Progress: 633/2075 symbols completed. ETR took 1.3s. Estimated remaining: 9m 27s. Rate: 152.5 symbols/min [2025-09-24T22:19:47.808249] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:47.988900] [DEBUG] [LOCAL ] ETX: Loaded 4965 existing records from primary storage. [2025-09-24T22:19:47.989278] [INFO ] [MAIN ] ETX: Loaded 4965 primary data records. [2025-09-24T22:19:48.115506] [DEBUG] [LOCAL ] ETW: Loaded 25028 existing records from primary storage. [2025-09-24T22:19:48.149602] [INFO ] [MAIN ] ETW: Loaded 25028 primary data records. [2025-09-24T22:19:48.459946] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:48.480430] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21358 primary records. [2025-09-24T22:19:48.489567] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-24T22:19:48.658596] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-24T22:19:48.658997] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-24T22:19:48.661894] [INFO ] [MAIN ] Derivative Progress: 634/2075 symbols completed. ETV took 1.1s. Estimated remaining: 9m 28s. Rate: 152.2 symbols/min [2025-09-24T22:19:48.662506] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:48.690684] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:48.691950] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 4965 primary records. [2025-09-24T22:19:48.692254] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-24T22:19:48.719504] [DEBUG] [LOCAL ] EVC: Loaded 19293 existing records from primary storage. [2025-09-24T22:19:48.719822] [INFO ] [MAIN ] EVC: Loaded 19293 primary data records. [2025-09-24T22:19:48.718904] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-09-24T22:19:48.720184] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-24T22:19:48.723351] [INFO ] [MAIN ] Derivative Progress: 635/2075 symbols completed. ETX took 0.9s. Estimated remaining: 9m 27s. Rate: 152.4 symbols/min [2025-09-24T22:19:48.767032] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:48.857002] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:48.914703] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25028 primary records. [2025-09-24T22:19:48.936689] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-24T22:19:49.063864] [DEBUG] [LOCAL ] EVEX: Loaded 29987 existing records from primary storage. [2025-09-24T22:19:49.071228] [INFO ] [MAIN ] EVEX: Loaded 29987 primary data records. [2025-09-24T22:19:49.176510] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-24T22:19:49.187632] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-24T22:19:49.190440] [INFO ] [MAIN ] Derivative Progress: 636/2075 symbols completed. ETW took 1.4s. Estimated remaining: 9m 27s. Rate: 152.4 symbols/min [2025-09-24T22:19:49.196832] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:49.450000] [DEBUG] [LOCAL ] EVF: Loaded 9239 existing records from primary storage. [2025-09-24T22:19:49.450541] [INFO ] [MAIN ] EVF: Loaded 9239 primary data records. [2025-09-24T22:19:49.667763] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:49.669266] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 19293 primary records. [2025-09-24T22:19:49.772704] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-24T22:19:49.808428] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-24T22:19:49.808929] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-24T22:19:49.812467] [INFO ] [MAIN ] Derivative Progress: 637/2075 symbols completed. EVC took 1.2s. Estimated remaining: 9m 27s. Rate: 152.2 symbols/min [2025-09-24T22:19:49.813384] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:49.834320] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:49.835514] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 29987 primary records. [2025-09-24T22:19:49.835687] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-24T22:19:49.847830] [DEBUG] [LOCAL ] EVG: Loaded 5816 existing records from primary storage. [2025-09-24T22:19:49.851725] [INFO ] [MAIN ] EVG: Loaded 5816 primary data records. [2025-09-24T22:19:49.978779] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-24T22:19:49.999755] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-24T22:19:50.050127] [INFO ] [MAIN ] Derivative Progress: 638/2075 symbols completed. EVEX took 1.3s. Estimated remaining: 9m 26s. Rate: 152.3 symbols/min [2025-09-24T22:19:50.072667] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:50.184292] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:50.195474] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9239 primary records. [2025-09-24T22:19:50.197428] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-24T22:19:50.214360] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-24T22:19:50.215014] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-24T22:19:50.217357] [INFO ] [MAIN ] Derivative Progress: 639/2075 symbols completed. EVF took 1.0s. Estimated remaining: 9m 25s. Rate: 152.5 symbols/min [2025-09-24T22:19:50.218104] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:50.234806] [DEBUG] [LOCAL ] EVN: Loaded 11052 existing records from primary storage. [2025-09-24T22:19:50.235127] [INFO ] [MAIN ] EVN: Loaded 11052 primary data records. [2025-09-24T22:19:50.271007] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:50.292722] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5816 primary records. [2025-09-24T22:19:50.305768] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-24T22:19:50.403373] [DEBUG] [LOCAL ] EVH: Loaded 49356 existing records from primary storage. [2025-09-24T22:19:50.401102] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-24T22:19:50.419056] [INFO ] [MAIN ] EVH: Loaded 49356 primary data records. [2025-09-24T22:19:50.424287] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-24T22:19:50.437294] [INFO ] [MAIN ] Derivative Progress: 640/2075 symbols completed. EVG took 0.6s. Estimated remaining: 9m 24s. Rate: 152.6 symbols/min [2025-09-24T22:19:50.470076] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:50.975542] [DEBUG] [LOCAL ] EVR: Loaded 35549 existing records from primary storage. [2025-09-24T22:19:50.976240] [INFO ] [MAIN ] EVR: Loaded 35549 primary data records. [2025-09-24T22:19:51.026418] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:51.034709] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11052 primary records. [2025-09-24T22:19:51.035734] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-24T22:19:51.139717] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:51.159998] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-24T22:19:51.175989] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49356 primary records. [2025-09-24T22:19:51.176259] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-24T22:19:51.185426] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-24T22:19:51.212177] [INFO ] [MAIN ] Derivative Progress: 641/2075 symbols completed. EVN took 1.0s. Estimated remaining: 9m 25s. Rate: 152.3 symbols/min [2025-09-24T22:19:51.228431] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:51.360227] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-24T22:19:51.361562] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-24T22:19:51.364169] [INFO ] [MAIN ] Derivative Progress: 642/2075 symbols completed. EVH took 1.2s. Estimated remaining: 9m 24s. Rate: 152.5 symbols/min [2025-09-24T22:19:51.369826] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:51.385742] [DEBUG] [LOCAL ] EVT: Loaded 17104 existing records from primary storage. [2025-09-24T22:19:51.386217] [INFO ] [MAIN ] EVT: Loaded 17104 primary data records. [2025-09-24T22:19:51.645483] [DEBUG] [LOCAL ] EVTL: Loaded 37386 existing records from primary storage. [2025-09-24T22:19:51.669347] [INFO ] [MAIN ] EVTL: Loaded 37386 primary data records. [2025-09-24T22:19:51.849780] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:19:51.864250] [INFO ] [MAIN ] EVR: Generated 1793 derivative records from 35549 primary records. [2025-09-24T22:19:51.892069] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-24T22:19:51.993792] [DEBUG] [LOCAL ] EVR: Derivative data saved (1793 records). [2025-09-24T22:19:51.996600] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-24T22:19:52.005353] [INFO ] [MAIN ] Derivative Progress: 643/2075 symbols completed. EVR took 1.5s. Estimated remaining: 9m 24s. Rate: 152.3 symbols/min [2025-09-24T22:19:52.165830] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:52.166754] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 17104 primary records. [2025-09-24T22:19:52.167081] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-24T22:19:52.187246] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-09-24T22:19:52.187531] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-24T22:19:52.202368] [INFO ] [MAIN ] Derivative Progress: 644/2075 symbols completed. EVT took 1.0s. Estimated remaining: 9m 23s. Rate: 152.4 symbols/min [2025-09-24T22:19:52.203120] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:52.203808] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 37386 primary records. [2025-09-24T22:19:52.203872] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-24T22:19:52.219122] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-24T22:19:52.219186] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-24T22:19:52.221523] [INFO ] [MAIN ] Derivative Progress: 645/2075 symbols completed. EVTL took 0.9s. Estimated remaining: 9m 22s. Rate: 152.7 symbols/min [2025-09-24T22:19:52.222439] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:52.222736] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:52.222842] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:52.261285] [DEBUG] [LOCAL ] EVTR: Loaded 23269 existing records from primary storage. [2025-09-24T22:19:52.272373] [INFO ] [MAIN ] EVTR: Loaded 23269 primary data records. [2025-09-24T22:19:52.305891] [DEBUG] [LOCAL ] EXG: Loaded 34232 existing records from primary storage. [2025-09-24T22:19:52.333196] [INFO ] [MAIN ] EXG: Loaded 34232 primary data records. [2025-09-24T22:19:52.561421] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-24T22:19:52.596101] [INFO ] [MAIN ] EW: Loaded 53396 primary data records. [2025-09-24T22:19:53.316547] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:19:53.319940] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 23269 primary records. [2025-09-24T22:19:53.320240] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-24T22:19:53.351976] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-09-24T22:19:53.352564] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:53.352740] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-24T22:19:53.355882] [INFO ] [MAIN ] Derivative Progress: 646/2075 symbols completed. EVTR took 1.1s. Estimated remaining: 9m 23s. Rate: 152.2 symbols/min [2025-09-24T22:19:53.353678] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34232 primary records. [2025-09-24T22:19:53.356147] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-24T22:19:53.364709] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:53.378966] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:53.382311] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53396 primary records. [2025-09-24T22:19:53.383631] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-24T22:19:53.386670] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-24T22:19:53.386868] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-24T22:19:53.390123] [INFO ] [MAIN ] Derivative Progress: 647/2075 symbols completed. EXG took 1.2s. Estimated remaining: 9m 22s. Rate: 152.4 symbols/min [2025-09-24T22:19:53.397779] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:53.408272] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-24T22:19:53.408426] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-24T22:19:53.410889] [INFO ] [MAIN ] Derivative Progress: 648/2075 symbols completed. EW took 1.2s. Estimated remaining: 9m 21s. Rate: 152.7 symbols/min [2025-09-24T22:19:53.411310] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:53.467020] [DEBUG] [LOCAL ] EXP: Loaded 29985 existing records from primary storage. [2025-09-24T22:19:53.480221] [INFO ] [MAIN ] EXP: Loaded 29985 primary data records. [2025-09-24T22:19:53.602474] [DEBUG] [LOCAL ] EXK: Loaded 53125 existing records from primary storage. [2025-09-24T22:19:53.623923] [INFO ] [MAIN ] EXK: Loaded 53125 primary data records. [2025-09-24T22:19:53.625676] [DEBUG] [LOCAL ] EXPD: Loaded 48123 existing records from primary storage. [2025-09-24T22:19:53.626241] [INFO ] [MAIN ] EXPD: Loaded 48123 primary data records. [2025-09-24T22:19:54.553140] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:54.554885] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29985 primary records. [2025-09-24T22:19:54.568371] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-24T22:19:54.569013] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:54.571532] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48123 primary records. [2025-09-24T22:19:54.572333] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-24T22:19:54.597722] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-24T22:19:54.597903] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-24T22:19:54.601205] [INFO ] [MAIN ] Derivative Progress: 649/2075 symbols completed. EXP took 1.2s. Estimated remaining: 9m 22s. Rate: 152.2 symbols/min [2025-09-24T22:19:54.604958] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:54.612844] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-24T22:19:54.612963] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-24T22:19:54.615774] [INFO ] [MAIN ] Derivative Progress: 650/2075 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 21s. Rate: 152.4 symbols/min [2025-09-24T22:19:54.616118] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:54.632237] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:54.633099] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53125 primary records. [2025-09-24T22:19:54.633242] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-24T22:19:54.655271] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-24T22:19:54.655438] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-24T22:19:54.658019] [INFO ] [MAIN ] Derivative Progress: 651/2075 symbols completed. EXK took 1.3s. Estimated remaining: 9m 20s. Rate: 152.6 symbols/min [2025-09-24T22:19:54.658393] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:54.707841] [DEBUG] [LOCAL ] EXR: Loaded 45492 existing records from primary storage. [2025-09-24T22:19:54.708018] [INFO ] [MAIN ] EXR: Loaded 45492 primary data records. [2025-09-24T22:19:54.891218] [DEBUG] [LOCAL ] FAF: Loaded 41902 existing records from primary storage. [2025-09-24T22:19:54.891962] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-24T22:19:54.892228] [INFO ] [MAIN ] FAF: Loaded 41902 primary data records. [2025-09-24T22:19:54.892158] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-24T22:19:55.784838] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:55.786408] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45492 primary records. [2025-09-24T22:19:55.786639] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-24T22:19:55.809919] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-24T22:19:55.811221] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-24T22:19:55.816187] [INFO ] [MAIN ] Derivative Progress: 652/2075 symbols completed. EXR took 1.2s. Estimated remaining: 9m 21s. Rate: 152.2 symbols/min [2025-09-24T22:19:55.816841] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:55.846101] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:55.846989] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:55.848290] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41902 primary records. [2025-09-24T22:19:55.849623] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-24T22:19:55.849870] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-24T22:19:55.849967] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-24T22:19:55.885142] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-24T22:19:55.884981] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-24T22:19:55.885446] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-24T22:19:55.885373] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-24T22:19:55.888811] [INFO ] [MAIN ] Derivative Progress: 653/2075 symbols completed. F took 1.3s. Estimated remaining: 9m 20s. Rate: 152.4 symbols/min [2025-09-24T22:19:55.891842] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:55.891993] [INFO ] [MAIN ] Derivative Progress: 654/2075 symbols completed. FAF took 1.2s. Estimated remaining: 9m 19s. Rate: 152.6 symbols/min [2025-09-24T22:19:55.892846] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:55.946125] [DEBUG] [LOCAL ] FBIN: Loaded 50395 existing records from primary storage. [2025-09-24T22:19:55.946358] [INFO ] [MAIN ] FBIN: Loaded 50395 primary data records. [2025-09-24T22:19:55.944954] [DEBUG] [LOCAL ] FBK: Loaded 25657 existing records from primary storage. [2025-09-24T22:19:55.946572] [INFO ] [MAIN ] FBK: Loaded 25657 primary data records. [2025-09-24T22:19:56.189338] [DEBUG] [LOCAL ] FBP: Loaded 46232 existing records from primary storage. [2025-09-24T22:19:56.215823] [INFO ] [MAIN ] FBP: Loaded 46232 primary data records. [2025-09-24T22:19:56.973480] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:56.986557] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25657 primary records. [2025-09-24T22:19:56.986688] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-24T22:19:56.988765] [DEBUG] [MAIN ] FBIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:56.996798] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50395 primary records. [2025-09-24T22:19:57.002465] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-24T22:19:57.005273] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-24T22:19:57.005799] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-24T22:19:57.008619] [INFO ] [MAIN ] Derivative Progress: 655/2075 symbols completed. FBK took 1.1s. Estimated remaining: 9m 20s. Rate: 152.2 symbols/min [2025-09-24T22:19:57.016107] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:57.042529] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:57.044020] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-24T22:19:57.044844] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46232 primary records. [2025-09-24T22:19:57.045073] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-24T22:19:57.047768] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-24T22:19:57.047575] [INFO ] [MAIN ] Derivative Progress: 656/2075 symbols completed. FBIN took 1.2s. Estimated remaining: 9m 19s. Rate: 152.4 symbols/min [2025-09-24T22:19:57.048357] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:57.081893] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-24T22:19:57.082170] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-24T22:19:57.084735] [INFO ] [MAIN ] Derivative Progress: 657/2075 symbols completed. FBP took 1.2s. Estimated remaining: 9m 18s. Rate: 152.6 symbols/min [2025-09-24T22:19:57.095743] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:57.096416] [DEBUG] [LOCAL ] FBRT: Loaded 34469 existing records from primary storage. [2025-09-24T22:19:57.102128] [INFO ] [MAIN ] FBRT: Loaded 34469 primary data records. [2025-09-24T22:19:57.113787] [DEBUG] [LOCAL ] FC: Loaded 15339 existing records from primary storage. [2025-09-24T22:19:57.139344] [INFO ] [MAIN ] FC: Loaded 15339 primary data records. [2025-09-24T22:19:57.511621] [DEBUG] [LOCAL ] FCF: Loaded 39725 existing records from primary storage. [2025-09-24T22:19:57.630870] [INFO ] [MAIN ] FCF: Loaded 39725 primary data records. [2025-09-24T22:19:58.165201] [DEBUG] [MAIN ] FC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:58.170618] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:58.171957] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34469 primary records. [2025-09-24T22:19:58.173396] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15339 primary records. [2025-09-24T22:19:58.173501] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-24T22:19:58.174947] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-24T22:19:58.208838] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-24T22:19:58.209741] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-24T22:19:58.213390] [INFO ] [MAIN ] Derivative Progress: 658/2075 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 19s. Rate: 152.2 symbols/min [2025-09-24T22:19:58.216615] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-24T22:19:58.218335] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-24T22:19:58.220578] [INFO ] [MAIN ] Derivative Progress: 659/2075 symbols completed. FC took 1.2s. Estimated remaining: 9m 18s. Rate: 152.4 symbols/min [2025-09-24T22:19:58.236591] [DEBUG] [MAIN ] FCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:58.237361] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39725 primary records. [2025-09-24T22:19:58.237427] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-24T22:19:58.254373] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-24T22:19:58.254533] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-24T22:19:58.257247] [INFO ] [MAIN ] Derivative Progress: 660/2075 symbols completed. FCF took 1.2s. Estimated remaining: 9m 16s. Rate: 152.6 symbols/min [2025-09-24T22:19:58.257923] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:58.258090] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:58.259161] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:58.276987] [DEBUG] [LOCAL ] FCT: Loaded 14369 existing records from primary storage. [2025-09-24T22:19:58.277231] [INFO ] [MAIN ] FCT: Loaded 14369 primary data records. [2025-09-24T22:19:58.435457] [DEBUG] [LOCAL ] FCN: Loaded 26239 existing records from primary storage. [2025-09-24T22:19:58.441469] [INFO ] [MAIN ] FCN: Loaded 26239 primary data records. [2025-09-24T22:19:58.447315] [DEBUG] [LOCAL ] FCPT: Loaded 37377 existing records from primary storage. [2025-09-24T22:19:58.462951] [INFO ] [MAIN ] FCPT: Loaded 37377 primary data records. [2025-09-24T22:19:59.289671] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:59.290786] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14369 primary records. [2025-09-24T22:19:59.291258] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-24T22:19:59.323256] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:59.337034] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26239 primary records. [2025-09-24T22:19:59.337464] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-24T22:19:59.339238] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:19:59.339845] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-24T22:19:59.340484] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37377 primary records. [2025-09-24T22:19:59.349216] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-24T22:19:59.347857] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-24T22:19:59.357661] [INFO ] [MAIN ] Derivative Progress: 661/2075 symbols completed. FCT took 1.1s. Estimated remaining: 9m 18s. Rate: 152.2 symbols/min [2025-09-24T22:19:59.358829] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-24T22:19:59.358990] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-24T22:19:59.362030] [INFO ] [MAIN ] Derivative Progress: 662/2075 symbols completed. FCN took 1.1s. Estimated remaining: 9m 16s. Rate: 152.4 symbols/min [2025-09-24T22:19:59.362453] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:59.370253] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:59.379283] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-24T22:19:59.379371] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-24T22:19:59.382103] [INFO ] [MAIN ] Derivative Progress: 663/2075 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 15s. Rate: 152.6 symbols/min [2025-09-24T22:19:59.382481] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:19:59.443813] [DEBUG] [LOCAL ] FDP: Loaded 30413 existing records from primary storage. [2025-09-24T22:19:59.444235] [DEBUG] [LOCAL ] FDS: Loaded 26227 existing records from primary storage. [2025-09-24T22:19:59.444427] [INFO ] [MAIN ] FDP: Loaded 30413 primary data records. [2025-09-24T22:19:59.444501] [INFO ] [MAIN ] FDS: Loaded 26227 primary data records. [2025-09-24T22:19:59.648265] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-24T22:19:59.681330] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-09-24T22:20:00.481459] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:00.484344] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30413 primary records. [2025-09-24T22:20:00.484964] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-24T22:20:00.512180] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:00.514398] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26227 primary records. [2025-09-24T22:20:00.515070] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-24T22:20:00.547381] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:00.548560] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-24T22:20:00.550176] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-09-24T22:20:00.549362] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-24T22:20:00.551122] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-24T22:20:00.551019] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-24T22:20:00.554600] [INFO ] [MAIN ] Derivative Progress: 664/2075 symbols completed. FDS took 1.2s. Estimated remaining: 9m 16s. Rate: 152.2 symbols/min [2025-09-24T22:20:00.555439] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-24T22:20:00.555812] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:00.565464] [INFO ] [MAIN ] Derivative Progress: 665/2075 symbols completed. FDP took 1.2s. Estimated remaining: 9m 15s. Rate: 152.4 symbols/min [2025-09-24T22:20:00.570435] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:00.575800] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-09-24T22:20:00.575897] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-24T22:20:00.578377] [INFO ] [MAIN ] Derivative Progress: 666/2075 symbols completed. FCX took 1.2s. Estimated remaining: 9m 14s. Rate: 152.6 symbols/min [2025-09-24T22:20:00.578743] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:00.650112] [DEBUG] [LOCAL ] FDX: Loaded 51612 existing records from primary storage. [2025-09-24T22:20:00.665136] [INFO ] [MAIN ] FDX: Loaded 51612 primary data records. [2025-09-24T22:20:00.687283] [DEBUG] [LOCAL ] FE: Loaded 53428 existing records from primary storage. [2025-09-24T22:20:00.710135] [INFO ] [MAIN ] FE: Loaded 53428 primary data records. [2025-09-24T22:20:00.847263] [DEBUG] [LOCAL ] FERG: Loaded 48996 existing records from primary storage. [2025-09-24T22:20:00.887763] [INFO ] [MAIN ] FERG: Loaded 48996 primary data records. [2025-09-24T22:20:01.704717] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:01.727243] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:01.728916] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53428 primary records. [2025-09-24T22:20:01.727704] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51612 primary records. [2025-09-24T22:20:01.729341] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-24T22:20:01.729264] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-24T22:20:01.778894] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-09-24T22:20:01.779972] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-24T22:20:01.783806] [INFO ] [MAIN ] Derivative Progress: 667/2075 symbols completed. FE took 1.2s. Estimated remaining: 9m 15s. Rate: 152.1 symbols/min [2025-09-24T22:20:01.785049] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-24T22:20:01.791225] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:01.790796] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-24T22:20:01.800003] [INFO ] [MAIN ] Derivative Progress: 668/2075 symbols completed. FDX took 1.2s. Estimated remaining: 9m 14s. Rate: 152.4 symbols/min [2025-09-24T22:20:01.807790] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:01.809220] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:01.810288] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48996 primary records. [2025-09-24T22:20:01.810448] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-24T22:20:01.837492] [DEBUG] [LOCAL ] FET: Loaded 12711 existing records from primary storage. [2025-09-24T22:20:01.838264] [INFO ] [MAIN ] FET: Loaded 12711 primary data records. [2025-09-24T22:20:01.887009] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-24T22:20:01.948849] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-24T22:20:01.943578] [DEBUG] [LOCAL ] FF: Loaded 25504 existing records from primary storage. [2025-09-24T22:20:01.962904] [INFO ] [MAIN ] Derivative Progress: 669/2075 symbols completed. FERG took 1.4s. Estimated remaining: 9m 13s. Rate: 152.5 symbols/min [2025-09-24T22:20:01.975386] [INFO ] [MAIN ] FF: Loaded 25504 primary data records. [2025-09-24T22:20:01.991666] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:02.233862] [DEBUG] [LOCAL ] FFA: Loaded 5680 existing records from primary storage. [2025-09-24T22:20:02.394523] [INFO ] [MAIN ] FFA: Loaded 5680 primary data records. [2025-09-24T22:20:02.991209] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:02.992480] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12711 primary records. [2025-09-24T22:20:02.993064] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-24T22:20:03.026403] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:03.028437] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25504 primary records. [2025-09-24T22:20:03.029425] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-24T22:20:03.030125] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-24T22:20:03.031073] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-24T22:20:03.033485] [INFO ] [MAIN ] Derivative Progress: 670/2075 symbols completed. FET took 1.2s. Estimated remaining: 9m 14s. Rate: 152.1 symbols/min [2025-09-24T22:20:03.041518] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:03.073885] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-24T22:20:03.074593] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:03.075392] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5680 primary records. [2025-09-24T22:20:03.075529] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-24T22:20:03.075607] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-24T22:20:03.078870] [INFO ] [MAIN ] Derivative Progress: 671/2075 symbols completed. FF took 1.3s. Estimated remaining: 9m 13s. Rate: 152.3 symbols/min [2025-09-24T22:20:03.080008] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:03.099169] [DEBUG] [LOCAL ] FFC: Loaded 16629 existing records from primary storage. [2025-09-24T22:20:03.101169] [INFO ] [MAIN ] FFC: Loaded 16629 primary data records. [2025-09-24T22:20:03.104191] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-09-24T22:20:03.143869] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-24T22:20:03.175002] [INFO ] [MAIN ] Derivative Progress: 672/2075 symbols completed. FFA took 1.2s. Estimated remaining: 9m 12s. Rate: 152.5 symbols/min [2025-09-24T22:20:03.214455] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:03.447010] [DEBUG] [LOCAL ] FFWM: Loaded 36155 existing records from primary storage. [2025-09-24T22:20:03.454050] [INFO ] [MAIN ] FFWM: Loaded 36155 primary data records. [2025-09-24T22:20:03.548092] [DEBUG] [LOCAL ] FG: Loaded 22540 existing records from primary storage. [2025-09-24T22:20:03.553620] [INFO ] [MAIN ] FG: Loaded 22540 primary data records. [2025-09-24T22:20:04.207965] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:04.211707] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16629 primary records. [2025-09-24T22:20:04.213099] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-24T22:20:04.257877] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-24T22:20:04.256996] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:04.258114] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-24T22:20:04.260986] [INFO ] [MAIN ] Derivative Progress: 673/2075 symbols completed. FFC took 1.2s. Estimated remaining: 9m 13s. Rate: 152.1 symbols/min [2025-09-24T22:20:04.262595] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 36155 primary records. [2025-09-24T22:20:04.262704] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-24T22:20:04.294341] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:04.295739] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22540 primary records. [2025-09-24T22:20:04.296122] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-24T22:20:04.315872] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-24T22:20:04.317093] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-24T22:20:04.317346] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-24T22:20:04.320156] [INFO ] [MAIN ] Derivative Progress: 674/2075 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 12s. Rate: 152.3 symbols/min [2025-09-24T22:20:04.320321] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-24T22:20:04.323353] [INFO ] [MAIN ] Derivative Progress: 675/2075 symbols completed. FG took 1.1s. Estimated remaining: 9m 11s. Rate: 152.5 symbols/min [2025-09-24T22:20:04.324161] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:04.324405] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:04.324010] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:04.332709] [DEBUG] [LOCAL ] FGN: Loaded 3883 existing records from primary storage. [2025-09-24T22:20:04.332848] [INFO ] [MAIN ] FGN: Loaded 3883 primary data records. [2025-09-24T22:20:04.688795] [DEBUG] [LOCAL ] FHI: Loaded 40739 existing records from primary storage. [2025-09-24T22:20:04.689532] [INFO ] [MAIN ] FHI: Loaded 40739 primary data records. [2025-09-24T22:20:04.821023] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-24T22:20:04.827350] [INFO ] [MAIN ] FHN: Loaded 53369 primary data records. [2025-09-24T22:20:05.357774] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:05.359396] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3883 primary records. [2025-09-24T22:20:05.359633] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-24T22:20:05.384312] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-24T22:20:05.385077] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-24T22:20:05.388829] [INFO ] [MAIN ] Derivative Progress: 676/2075 symbols completed. FGN took 1.1s. Estimated remaining: 9m 12s. Rate: 152.1 symbols/min [2025-09-24T22:20:05.392119] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:05.418444] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:05.427947] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40739 primary records. [2025-09-24T22:20:05.432471] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-24T22:20:05.434275] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:05.442473] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53369 primary records. [2025-09-24T22:20:05.447142] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-24T22:20:05.467682] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-24T22:20:05.468139] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-24T22:20:05.471212] [INFO ] [MAIN ] Derivative Progress: 677/2075 symbols completed. FHN took 1.1s. Estimated remaining: 9m 11s. Rate: 152.3 symbols/min [2025-09-24T22:20:05.471623] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:05.468612] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-24T22:20:05.471876] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-24T22:20:05.474801] [INFO ] [MAIN ] Derivative Progress: 678/2075 symbols completed. FHI took 1.2s. Estimated remaining: 9m 10s. Rate: 152.5 symbols/min [2025-09-24T22:20:05.489690] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:05.519159] [DEBUG] [LOCAL ] FI: Loaded 53505 existing records from primary storage. [2025-09-24T22:20:05.519370] [INFO ] [MAIN ] FI: Loaded 53505 primary data records. [2025-09-24T22:20:05.592923] [DEBUG] [LOCAL ] FICO: Loaded 20416 existing records from primary storage. [2025-09-24T22:20:05.610245] [INFO ] [MAIN ] FICO: Loaded 20416 primary data records. [2025-09-24T22:20:06.022006] [DEBUG] [LOCAL ] FIGS: Loaded 48918 existing records from primary storage. [2025-09-24T22:20:06.063205] [INFO ] [MAIN ] FIGS: Loaded 48918 primary data records. [2025-09-24T22:20:06.600963] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:06.602743] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53505 primary records. [2025-09-24T22:20:06.602933] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-24T22:20:06.623114] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-24T22:20:06.635411] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-24T22:20:06.636098] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:06.638129] [INFO ] [MAIN ] Derivative Progress: 679/2075 symbols completed. FI took 1.2s. Estimated remaining: 9m 11s. Rate: 152.1 symbols/min [2025-09-24T22:20:06.639011] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20416 primary records. [2025-09-24T22:20:06.639415] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:06.640217] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-24T22:20:06.657467] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-24T22:20:06.657679] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-24T22:20:06.660507] [INFO ] [MAIN ] Derivative Progress: 680/2075 symbols completed. FICO took 1.2s. Estimated remaining: 9m 10s. Rate: 152.3 symbols/min [2025-09-24T22:20:06.660958] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:06.680289] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:06.681186] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48918 primary records. [2025-09-24T22:20:06.685164] [DEBUG] [LOCAL ] FINS: Loaded 8240 existing records from primary storage. [2025-09-24T22:20:06.685344] [INFO ] [MAIN ] FINS: Loaded 8240 primary data records. [2025-09-24T22:20:06.685295] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-24T22:20:06.851021] [DEBUG] [LOCAL ] FIHL: Loaded 40300 existing records from primary storage. [2025-09-24T22:20:06.874051] [INFO ] [MAIN ] FIHL: Loaded 40300 primary data records. [2025-09-24T22:20:07.088699] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-24T22:20:07.105289] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-24T22:20:07.108788] [INFO ] [MAIN ] Derivative Progress: 681/2075 symbols completed. FIGS took 1.6s. Estimated remaining: 9m 9s. Rate: 152.3 symbols/min [2025-09-24T22:20:07.109429] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:07.383217] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:07.384177] [INFO ] [MAIN ] FINS: Generated 1793 derivative records from 8240 primary records. [2025-09-24T22:20:07.385067] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-24T22:20:07.415668] [DEBUG] [LOCAL ] FINS: Derivative data saved (1793 records). [2025-09-24T22:20:07.421555] [DEBUG] [LOCAL ] FINV: Loaded 45148 existing records from primary storage. [2025-09-24T22:20:07.420311] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-24T22:20:07.421704] [INFO ] [MAIN ] FINV: Loaded 45148 primary data records. [2025-09-24T22:20:07.424137] [INFO ] [MAIN ] Derivative Progress: 682/2075 symbols completed. FINS took 0.8s. Estimated remaining: 9m 9s. Rate: 152.3 symbols/min [2025-09-24T22:20:07.424789] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:07.766270] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:07.767257] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 40300 primary records. [2025-09-24T22:20:07.767545] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-24T22:20:07.804392] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-24T22:20:07.804699] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-24T22:20:07.808865] [DEBUG] [LOCAL ] FIS: Loaded 53365 existing records from primary storage. [2025-09-24T22:20:07.807724] [INFO ] [MAIN ] Derivative Progress: 683/2075 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 8s. Rate: 152.3 symbols/min [2025-09-24T22:20:07.810306] [INFO ] [MAIN ] FIS: Loaded 53365 primary data records. [2025-09-24T22:20:07.811029] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:08.137688] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:08.139178] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45148 primary records. [2025-09-24T22:20:08.139422] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-24T22:20:08.169826] [DEBUG] [LOCAL ] FIX: Loaded 30410 existing records from primary storage. [2025-09-24T22:20:08.168898] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-24T22:20:08.170148] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-24T22:20:08.172428] [INFO ] [MAIN ] Derivative Progress: 684/2075 symbols completed. FINV took 1.1s. Estimated remaining: 9m 8s. Rate: 152.3 symbols/min [2025-09-24T22:20:08.170070] [INFO ] [MAIN ] FIX: Loaded 30410 primary data records. [2025-09-24T22:20:08.174052] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:08.292171] [DEBUG] [LOCAL ] FLC: Loaded 5497 existing records from primary storage. [2025-09-24T22:20:08.297861] [INFO ] [MAIN ] FLC: Loaded 5497 primary data records. [2025-09-24T22:20:08.610629] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:08.707502] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53365 primary records. [2025-09-24T22:20:08.742751] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-24T22:20:08.915988] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-24T22:20:08.917190] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-24T22:20:08.920809] [INFO ] [MAIN ] Derivative Progress: 685/2075 symbols completed. FIS took 1.5s. Estimated remaining: 9m 8s. Rate: 152.1 symbols/min [2025-09-24T22:20:08.921395] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:08.942698] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:08.943603] [INFO ] [MAIN ] FIX: Generated 1793 derivative records from 30410 primary records. [2025-09-24T22:20:08.943777] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-24T22:20:08.973980] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:08.975284] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5497 primary records. [2025-09-24T22:20:08.975720] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-24T22:20:09.011319] [DEBUG] [LOCAL ] FIX: Derivative data saved (1793 records). [2025-09-24T22:20:09.013832] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-24T22:20:09.017126] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-24T22:20:09.016595] [INFO ] [MAIN ] Derivative Progress: 686/2075 symbols completed. FIX took 1.2s. Estimated remaining: 9m 7s. Rate: 152.3 symbols/min [2025-09-24T22:20:09.017505] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-24T22:20:09.021042] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:09.021325] [INFO ] [MAIN ] Derivative Progress: 687/2075 symbols completed. FLC took 0.8s. Estimated remaining: 9m 6s. Rate: 152.5 symbols/min [2025-09-24T22:20:09.022097] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:09.040793] [DEBUG] [LOCAL ] FLG: Loaded 53329 existing records from primary storage. [2025-09-24T22:20:09.041076] [INFO ] [MAIN ] FLG: Loaded 53329 primary data records. [2025-09-24T22:20:09.399396] [DEBUG] [LOCAL ] FLNG: Loaded 33996 existing records from primary storage. [2025-09-24T22:20:09.413847] [INFO ] [MAIN ] FLNG: Loaded 33996 primary data records. [2025-09-24T22:20:09.435586] [DEBUG] [LOCAL ] FLO: Loaded 51884 existing records from primary storage. [2025-09-24T22:20:09.451971] [INFO ] [MAIN ] FLO: Loaded 51884 primary data records. [2025-09-24T22:20:10.050000] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:10.051017] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53329 primary records. [2025-09-24T22:20:10.053773] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-24T22:20:10.077381] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-24T22:20:10.077689] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-24T22:20:10.080096] [INFO ] [MAIN ] Derivative Progress: 688/2075 symbols completed. FLG took 1.2s. Estimated remaining: 9m 7s. Rate: 152.1 symbols/min [2025-09-24T22:20:10.096481] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:10.097399] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51884 primary records. [2025-09-24T22:20:10.097573] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-24T22:20:10.110833] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:10.111724] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33996 primary records. [2025-09-24T22:20:10.118988] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-24T22:20:10.141125] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-24T22:20:10.141957] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-24T22:20:10.144899] [INFO ] [MAIN ] Derivative Progress: 689/2075 symbols completed. FLO took 1.1s. Estimated remaining: 9m 6s. Rate: 152.3 symbols/min [2025-09-24T22:20:10.146823] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-24T22:20:10.146890] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-24T22:20:10.149152] [INFO ] [MAIN ] Derivative Progress: 690/2075 symbols completed. FLNG took 1.1s. Estimated remaining: 9m 5s. Rate: 152.5 symbols/min [2025-09-24T22:20:10.149706] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:10.149995] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:10.149940] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:10.231417] [DEBUG] [LOCAL ] FLS: Loaded 50170 existing records from primary storage. [2025-09-24T22:20:10.232153] [INFO ] [MAIN ] FLS: Loaded 50170 primary data records. [2025-09-24T22:20:10.313614] [DEBUG] [LOCAL ] FLR: Loaded 53117 existing records from primary storage. [2025-09-24T22:20:10.344869] [INFO ] [MAIN ] FLR: Loaded 53117 primary data records. [2025-09-24T22:20:10.357076] [DEBUG] [LOCAL ] FLUT: Loaded 50862 existing records from primary storage. [2025-09-24T22:20:10.357260] [INFO ] [MAIN ] FLUT: Loaded 50862 primary data records. [2025-09-24T22:20:11.259893] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:11.262733] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50170 primary records. [2025-09-24T22:20:11.263017] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-24T22:20:11.305675] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-24T22:20:11.306302] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:11.320546] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-24T22:20:11.321774] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50862 primary records. [2025-09-24T22:20:11.324380] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-24T22:20:11.323838] [INFO ] [MAIN ] Derivative Progress: 691/2075 symbols completed. FLS took 1.2s. Estimated remaining: 9m 6s. Rate: 152.1 symbols/min [2025-09-24T22:20:11.324898] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:11.325832] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:11.326889] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53117 primary records. [2025-09-24T22:20:11.327068] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-24T22:20:11.358673] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-24T22:20:11.358889] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-24T22:20:11.361945] [INFO ] [MAIN ] Derivative Progress: 692/2075 symbols completed. FLUT took 1.2s. Estimated remaining: 9m 5s. Rate: 152.3 symbols/min [2025-09-24T22:20:11.362277] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:11.365530] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-09-24T22:20:11.365719] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-24T22:20:11.368864] [INFO ] [MAIN ] Derivative Progress: 693/2075 symbols completed. FLR took 1.2s. Estimated remaining: 9m 4s. Rate: 152.5 symbols/min [2025-09-24T22:20:11.369298] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:11.385923] [DEBUG] [LOCAL ] FMN: Loaded 6054 existing records from primary storage. [2025-09-24T22:20:11.386161] [INFO ] [MAIN ] FMN: Loaded 6054 primary data records. [2025-09-24T22:20:11.432524] [DEBUG] [LOCAL ] FLXR: Loaded 19909 existing records from primary storage. [2025-09-24T22:20:11.471738] [INFO ] [MAIN ] FLXR: Loaded 19909 primary data records. [2025-09-24T22:20:11.845885] [DEBUG] [LOCAL ] FMC: Loaded 51787 existing records from primary storage. [2025-09-24T22:20:11.846335] [INFO ] [MAIN ] FMC: Loaded 51787 primary data records. [2025-09-24T22:20:12.398850] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:12.400393] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 6054 primary records. [2025-09-24T22:20:12.400763] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-24T22:20:12.414627] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:12.421952] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 19909 primary records. [2025-09-24T22:20:12.425871] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-24T22:20:12.430827] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-24T22:20:12.442102] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-24T22:20:12.447612] [INFO ] [MAIN ] Derivative Progress: 694/2075 symbols completed. FMN took 1.1s. Estimated remaining: 9m 5s. Rate: 152.1 symbols/min [2025-09-24T22:20:12.449618] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-24T22:20:12.449782] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-24T22:20:12.452407] [INFO ] [MAIN ] Derivative Progress: 695/2075 symbols completed. FLXR took 1.1s. Estimated remaining: 9m 3s. Rate: 152.3 symbols/min [2025-09-24T22:20:12.452760] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:12.452956] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:12.465919] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:12.466827] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51787 primary records. [2025-09-24T22:20:12.466997] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-24T22:20:12.490279] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-24T22:20:12.490457] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-24T22:20:12.494126] [INFO ] [MAIN ] Derivative Progress: 696/2075 symbols completed. FMC took 1.1s. Estimated remaining: 9m 2s. Rate: 152.5 symbols/min [2025-09-24T22:20:12.496134] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:12.509766] [DEBUG] [LOCAL ] FMY: Loaded 1387 existing records from primary storage. [2025-09-24T22:20:12.509936] [INFO ] [MAIN ] FMY: Loaded 1387 primary data records. [2025-09-24T22:20:12.614444] [DEBUG] [LOCAL ] FMS: Loaded 30407 existing records from primary storage. [2025-09-24T22:20:12.631912] [INFO ] [MAIN ] FMS: Loaded 30407 primary data records. [2025-09-24T22:20:12.693947] [DEBUG] [LOCAL ] FMX: Loaded 40728 existing records from primary storage. [2025-09-24T22:20:12.784705] [INFO ] [MAIN ] FMX: Loaded 40728 primary data records. [2025-09-24T22:20:13.524052] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7735 incomplete bins [2025-09-24T22:20:13.525079] [INFO ] [MAIN ] FMY: Generated 1783 derivative records from 1387 primary records. [2025-09-24T22:20:13.525257] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-24T22:20:13.539604] [DEBUG] [LOCAL ] FMY: Derivative data saved (1783 records). [2025-09-24T22:20:13.540038] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-24T22:20:13.541908] [INFO ] [MAIN ] Derivative Progress: 697/2075 symbols completed. FMY took 1.0s. Estimated remaining: 9m 3s. Rate: 152.2 symbols/min [2025-09-24T22:20:13.542294] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:13.573182] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:13.572925] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:13.574111] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40728 primary records. [2025-09-24T22:20:13.574277] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-24T22:20:13.575348] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30407 primary records. [2025-09-24T22:20:13.575586] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-24T22:20:13.610067] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-24T22:20:13.612359] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-24T22:20:13.615134] [INFO ] [MAIN ] Derivative Progress: 698/2075 symbols completed. FMX took 1.2s. Estimated remaining: 9m 2s. Rate: 152.4 symbols/min [2025-09-24T22:20:13.616502] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:13.629625] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-24T22:20:13.629911] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-24T22:20:13.633294] [INFO ] [MAIN ] Derivative Progress: 699/2075 symbols completed. FMS took 1.2s. Estimated remaining: 9m 1s. Rate: 152.6 symbols/min [2025-09-24T22:20:13.633943] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:13.649883] [DEBUG] [LOCAL ] FN: Loaded 39355 existing records from primary storage. [2025-09-24T22:20:13.650044] [INFO ] [MAIN ] FN: Loaded 39355 primary data records. [2025-09-24T22:20:14.016774] [DEBUG] [LOCAL ] FNB: Loaded 52450 existing records from primary storage. [2025-09-24T22:20:14.017888] [INFO ] [MAIN ] FNB: Loaded 52450 primary data records. [2025-09-24T22:20:14.144451] [DEBUG] [LOCAL ] FND: Loaded 52143 existing records from primary storage. [2025-09-24T22:20:14.144744] [INFO ] [MAIN ] FND: Loaded 52143 primary data records. [2025-09-24T22:20:14.717912] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:14.719320] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 39355 primary records. [2025-09-24T22:20:14.719698] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-24T22:20:14.737196] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-24T22:20:14.737592] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-24T22:20:14.740065] [INFO ] [MAIN ] Derivative Progress: 700/2075 symbols completed. FN took 1.2s. Estimated remaining: 9m 2s. Rate: 152.2 symbols/min [2025-09-24T22:20:14.740464] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:14.758189] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:14.759021] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52450 primary records. [2025-09-24T22:20:14.759178] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-24T22:20:14.789320] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-24T22:20:14.794907] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-24T22:20:14.797097] [INFO ] [MAIN ] Derivative Progress: 701/2075 symbols completed. FNB took 1.2s. Estimated remaining: 9m 1s. Rate: 152.4 symbols/min [2025-09-24T22:20:14.794823] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:14.798185] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52143 primary records. [2025-09-24T22:20:14.798520] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-24T22:20:14.798445] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:14.826165] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-24T22:20:14.826334] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-24T22:20:14.829190] [INFO ] [MAIN ] Derivative Progress: 702/2075 symbols completed. FND took 1.2s. Estimated remaining: 8m 60s. Rate: 152.6 symbols/min [2025-09-24T22:20:14.829804] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:14.846383] [DEBUG] [LOCAL ] FNF: Loaded 49184 existing records from primary storage. [2025-09-24T22:20:14.848397] [INFO ] [MAIN ] FNF: Loaded 49184 primary data records. [2025-09-24T22:20:14.918927] [DEBUG] [LOCAL ] FOF: Loaded 8388 existing records from primary storage. [2025-09-24T22:20:14.941570] [INFO ] [MAIN ] FOF: Loaded 8388 primary data records. [2025-09-24T22:20:15.283802] [DEBUG] [LOCAL ] FNV: Loaded 46378 existing records from primary storage. [2025-09-24T22:20:15.306537] [INFO ] [MAIN ] FNV: Loaded 46378 primary data records. [2025-09-24T22:20:15.803971] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:15.804985] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49184 primary records. [2025-09-24T22:20:15.805097] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-24T22:20:15.836764] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:15.838740] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8388 primary records. [2025-09-24T22:20:15.839338] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-24T22:20:15.839696] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-24T22:20:15.839589] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-24T22:20:15.841765] [INFO ] [MAIN ] Derivative Progress: 703/2075 symbols completed. FNF took 1.1s. Estimated remaining: 9m 1s. Rate: 152.2 symbols/min [2025-09-24T22:20:15.859971] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-24T22:20:15.872185] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-24T22:20:15.874718] [INFO ] [MAIN ] Derivative Progress: 704/2075 symbols completed. FOF took 1.0s. Estimated remaining: 8m 60s. Rate: 152.4 symbols/min [2025-09-24T22:20:15.872503] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:15.875603] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46378 primary records. [2025-09-24T22:20:15.875740] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-24T22:20:15.890917] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-24T22:20:15.890977] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-24T22:20:15.893728] [INFO ] [MAIN ] Derivative Progress: 705/2075 symbols completed. FNV took 1.1s. Estimated remaining: 8m 59s. Rate: 152.6 symbols/min [2025-09-24T22:20:15.894375] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:15.894256] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:15.894931] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:15.919637] [DEBUG] [LOCAL ] FPF: Loaded 17660 existing records from primary storage. [2025-09-24T22:20:15.919802] [INFO ] [MAIN ] FPF: Loaded 17660 primary data records. [2025-09-24T22:20:16.027960] [DEBUG] [LOCAL ] FOR: Loaded 20132 existing records from primary storage. [2025-09-24T22:20:16.042695] [INFO ] [MAIN ] FOR: Loaded 20132 primary data records. [2025-09-24T22:20:16.399027] [DEBUG] [LOCAL ] FOUR: Loaded 49527 existing records from primary storage. [2025-09-24T22:20:16.452503] [INFO ] [MAIN ] FOUR: Loaded 49527 primary data records. [2025-09-24T22:20:16.937184] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:16.938742] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17660 primary records. [2025-09-24T22:20:16.938845] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-24T22:20:16.958730] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-24T22:20:16.959775] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-24T22:20:16.962196] [INFO ] [MAIN ] Derivative Progress: 706/2075 symbols completed. FPF took 1.1s. Estimated remaining: 8m 59s. Rate: 152.3 symbols/min [2025-09-24T22:20:16.962687] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:16.976193] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:16.977157] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 20132 primary records. [2025-09-24T22:20:16.977385] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-24T22:20:17.009559] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-24T22:20:17.021418] [DEBUG] [LOCAL ] FPH: Loaded 19649 existing records from primary storage. [2025-09-24T22:20:17.021526] [INFO ] [MAIN ] FPH: Loaded 19649 primary data records. [2025-09-24T22:20:17.021089] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:17.033357] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49527 primary records. [2025-09-24T22:20:17.021758] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-24T22:20:17.067526] [INFO ] [MAIN ] Derivative Progress: 707/2075 symbols completed. FOR took 1.2s. Estimated remaining: 8m 59s. Rate: 152.4 symbols/min [2025-09-24T22:20:17.042947] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-24T22:20:17.079898] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:17.140554] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-24T22:20:17.143981] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-24T22:20:17.146350] [INFO ] [MAIN ] Derivative Progress: 708/2075 symbols completed. FOUR took 1.3s. Estimated remaining: 8m 58s. Rate: 152.6 symbols/min [2025-09-24T22:20:17.162871] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:17.365446] [DEBUG] [LOCAL ] FPI: Loaded 31139 existing records from primary storage. [2025-09-24T22:20:17.366060] [INFO ] [MAIN ] FPI: Loaded 31139 primary data records. [2025-09-24T22:20:17.684355] [DEBUG] [LOCAL ] FR: Loaded 46558 existing records from primary storage. [2025-09-24T22:20:17.694072] [INFO ] [MAIN ] FR: Loaded 46558 primary data records. [2025-09-24T22:20:17.864837] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:17.896983] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19649 primary records. [2025-09-24T22:20:18.010348] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-24T22:20:18.040026] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-24T22:20:18.040807] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-24T22:20:18.043553] [INFO ] [MAIN ] Derivative Progress: 709/2075 symbols completed. FPH took 1.1s. Estimated remaining: 8m 58s. Rate: 152.3 symbols/min [2025-09-24T22:20:18.044303] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:18.062985] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:18.063874] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31139 primary records. [2025-09-24T22:20:18.064051] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-24T22:20:18.092689] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-24T22:20:18.093120] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-24T22:20:18.096860] [INFO ] [MAIN ] Derivative Progress: 710/2075 symbols completed. FPI took 1.0s. Estimated remaining: 8m 57s. Rate: 152.5 symbols/min [2025-09-24T22:20:18.093613] [DEBUG] [LOCAL ] FRA: Loaded 14534 existing records from primary storage. [2025-09-24T22:20:18.097326] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:18.097456] [INFO ] [MAIN ] FRA: Loaded 14534 primary data records. [2025-09-24T22:20:18.225494] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:18.237209] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46558 primary records. [2025-09-24T22:20:18.272679] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-24T22:20:18.273623] [DEBUG] [LOCAL ] FRGE: Loaded 18432 existing records from primary storage. [2025-09-24T22:20:18.282799] [INFO ] [MAIN ] FRGE: Loaded 18432 primary data records. [2025-09-24T22:20:18.551975] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-24T22:20:18.563059] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-24T22:20:18.596894] [INFO ] [MAIN ] Derivative Progress: 711/2075 symbols completed. FR took 1.4s. Estimated remaining: 8m 57s. Rate: 152.4 symbols/min [2025-09-24T22:20:18.616306] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:18.809098] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:18.810068] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14534 primary records. [2025-09-24T22:20:18.810250] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-24T22:20:18.842261] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-24T22:20:18.844911] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-24T22:20:18.847118] [INFO ] [MAIN ] Derivative Progress: 712/2075 symbols completed. FRA took 0.8s. Estimated remaining: 8m 56s. Rate: 152.5 symbols/min [2025-09-24T22:20:18.847618] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:18.862150] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:18.863074] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 18432 primary records. [2025-09-24T22:20:18.863279] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-24T22:20:18.892374] [DEBUG] [LOCAL ] FRO: Loaded 51855 existing records from primary storage. [2025-09-24T22:20:18.895823] [INFO ] [MAIN ] FRO: Loaded 51855 primary data records. [2025-09-24T22:20:18.896942] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-24T22:20:18.908252] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-24T22:20:18.937162] [INFO ] [MAIN ] Derivative Progress: 713/2075 symbols completed. FRGE took 0.8s. Estimated remaining: 8m 55s. Rate: 152.7 symbols/min [2025-09-24T22:20:18.956002] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:19.052120] [DEBUG] [LOCAL ] FRT: Loaded 42294 existing records from primary storage. [2025-09-24T22:20:19.064116] [INFO ] [MAIN ] FRT: Loaded 42294 primary data records. [2025-09-24T22:20:19.454932] [DEBUG] [LOCAL ] FSCO: Loaded 36964 existing records from primary storage. [2025-09-24T22:20:19.455310] [INFO ] [MAIN ] FSCO: Loaded 36964 primary data records. [2025-09-24T22:20:19.904479] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:19.906258] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51855 primary records. [2025-09-24T22:20:19.906486] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-24T22:20:19.929811] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-24T22:20:19.930238] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-24T22:20:19.947094] [INFO ] [MAIN ] Derivative Progress: 714/2075 symbols completed. FRO took 1.3s. Estimated remaining: 8m 56s. Rate: 152.3 symbols/min [2025-09-24T22:20:19.948425] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:19.948864] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:19.951099] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42294 primary records. [2025-09-24T22:20:19.951429] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-24T22:20:19.970224] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-24T22:20:19.970368] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-24T22:20:19.973026] [INFO ] [MAIN ] Derivative Progress: 715/2075 symbols completed. FRT took 1.1s. Estimated remaining: 8m 55s. Rate: 152.5 symbols/min [2025-09-24T22:20:19.973339] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:19.990165] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:19.990932] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 36964 primary records. [2025-09-24T22:20:19.991119] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-24T22:20:20.018386] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-24T22:20:20.018629] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-24T22:20:20.021072] [INFO ] [MAIN ] Derivative Progress: 716/2075 symbols completed. FSCO took 1.1s. Estimated remaining: 8m 54s. Rate: 152.7 symbols/min [2025-09-24T22:20:20.021507] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:20.059083] [DEBUG] [LOCAL ] FSK: Loaded 49410 existing records from primary storage. [2025-09-24T22:20:20.059811] [INFO ] [MAIN ] FSK: Loaded 49410 primary data records. [2025-09-24T22:20:20.165168] [DEBUG] [LOCAL ] FSLY: Loaded 51254 existing records from primary storage. [2025-09-24T22:20:20.190165] [INFO ] [MAIN ] FSLY: Loaded 51254 primary data records. [2025-09-24T22:20:20.399713] [DEBUG] [LOCAL ] FSM: Loaded 53287 existing records from primary storage. [2025-09-24T22:20:20.400123] [INFO ] [MAIN ] FSM: Loaded 53287 primary data records. [2025-09-24T22:20:21.099120] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:21.100389] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49410 primary records. [2025-09-24T22:20:21.100793] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-24T22:20:21.119449] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-24T22:20:21.121048] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-24T22:20:21.123399] [INFO ] [MAIN ] Derivative Progress: 717/2075 symbols completed. FSK took 1.2s. Estimated remaining: 8m 55s. Rate: 152.3 symbols/min [2025-09-24T22:20:21.136299] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:21.138436] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:21.139983] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51254 primary records. [2025-09-24T22:20:21.140808] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-24T22:20:21.165037] [DEBUG] [MAIN ] FSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:21.169165] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53287 primary records. [2025-09-24T22:20:21.170077] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-24T22:20:21.170149] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-24T22:20:21.170242] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-24T22:20:21.173272] [INFO ] [MAIN ] Derivative Progress: 718/2075 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 54s. Rate: 152.5 symbols/min [2025-09-24T22:20:21.197065] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-24T22:20:21.197216] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-24T22:20:21.199575] [INFO ] [MAIN ] Derivative Progress: 719/2075 symbols completed. FSM took 1.2s. Estimated remaining: 8m 53s. Rate: 152.7 symbols/min [2025-09-24T22:20:21.212213] [DEBUG] [LOCAL ] FSS: Loaded 34449 existing records from primary storage. [2025-09-24T22:20:21.212375] [INFO ] [MAIN ] FSS: Loaded 34449 primary data records. [2025-09-24T22:20:21.520333] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:21.521012] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34449 primary records. [2025-09-24T22:20:21.521078] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-24T22:20:21.536310] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-24T22:20:21.536377] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-24T22:20:21.538298] [INFO ] [MAIN ] Derivative Progress: 720/2075 symbols completed. FSS took 0.4s. Estimated remaining: 8m 52s. Rate: 152.8 symbols/min [2025-09-24T22:20:21.539270] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:21.539083] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:21.540090] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:21.550907] [DEBUG] [LOCAL ] FT: Loaded 6313 existing records from primary storage. [2025-09-24T22:20:21.551095] [INFO ] [MAIN ] FT: Loaded 6313 primary data records. [2025-09-24T22:20:21.643270] [DEBUG] [LOCAL ] FTHY: Loaded 11752 existing records from primary storage. [2025-09-24T22:20:21.665511] [INFO ] [MAIN ] FTHY: Loaded 11752 primary data records. [2025-09-24T22:20:22.200275] [DEBUG] [LOCAL ] FTI: Loaded 53304 existing records from primary storage. [2025-09-24T22:20:22.201715] [INFO ] [MAIN ] FTI: Loaded 53304 primary data records. [2025-09-24T22:20:22.585524] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:22.588925] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6313 primary records. [2025-09-24T22:20:22.589736] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-24T22:20:22.619328] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:22.620299] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-24T22:20:22.621105] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11752 primary records. [2025-09-24T22:20:22.621325] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-24T22:20:22.621435] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-24T22:20:22.623792] [INFO ] [MAIN ] Derivative Progress: 721/2075 symbols completed. FT took 1.1s. Estimated remaining: 8m 53s. Rate: 152.4 symbols/min [2025-09-24T22:20:22.624664] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:22.641842] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-24T22:20:22.642000] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-24T22:20:22.644403] [INFO ] [MAIN ] Derivative Progress: 722/2075 symbols completed. FTHY took 1.1s. Estimated remaining: 8m 52s. Rate: 152.6 symbols/min [2025-09-24T22:20:22.644857] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:22.661502] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:22.662350] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53304 primary records. [2025-09-24T22:20:22.662512] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-24T22:20:22.692283] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-24T22:20:22.692546] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-24T22:20:22.695257] [INFO ] [MAIN ] Derivative Progress: 723/2075 symbols completed. FTI took 1.2s. Estimated remaining: 8m 51s. Rate: 152.8 symbols/min [2025-09-24T22:20:22.705971] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:22.715112] [DEBUG] [LOCAL ] FTK: Loaded 32203 existing records from primary storage. [2025-09-24T22:20:22.715662] [INFO ] [MAIN ] FTK: Loaded 32203 primary data records. [2025-09-24T22:20:22.832700] [DEBUG] [LOCAL ] FTS: Loaded 42103 existing records from primary storage. [2025-09-24T22:20:22.843622] [INFO ] [MAIN ] FTS: Loaded 42103 primary data records. [2025-09-24T22:20:23.354395] [DEBUG] [LOCAL ] FTV: Loaded 52913 existing records from primary storage. [2025-09-24T22:20:23.368668] [INFO ] [MAIN ] FTV: Loaded 52913 primary data records. [2025-09-24T22:20:23.715846] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:23.716983] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32203 primary records. [2025-09-24T22:20:23.717296] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-24T22:20:23.735390] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-24T22:20:23.735859] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-24T22:20:23.738311] [INFO ] [MAIN ] Derivative Progress: 724/2075 symbols completed. FTK took 1.1s. Estimated remaining: 8m 52s. Rate: 152.4 symbols/min [2025-09-24T22:20:23.739506] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:23.759556] [DEBUG] [LOCAL ] FTWO: Loaded 1778 existing records from primary storage. [2025-09-24T22:20:23.760092] [INFO ] [MAIN ] FTWO: Loaded 1778 primary data records. [2025-09-24T22:20:23.759996] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:23.766183] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42103 primary records. [2025-09-24T22:20:23.784779] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-24T22:20:23.940728] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-24T22:20:23.956751] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-24T22:20:23.977603] [INFO ] [MAIN ] Derivative Progress: 725/2075 symbols completed. FTS took 1.3s. Estimated remaining: 8m 51s. Rate: 152.5 symbols/min [2025-09-24T22:20:24.002372] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:24.136426] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:24.137926] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52913 primary records. [2025-09-24T22:20:24.138188] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-24T22:20:24.157728] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-24T22:20:24.157921] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-24T22:20:24.159979] [INFO ] [MAIN ] Derivative Progress: 726/2075 symbols completed. FTV took 1.5s. Estimated remaining: 8m 50s. Rate: 152.6 symbols/min [2025-09-24T22:20:24.161602] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:24.182142] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:24.197224] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1778 primary records. [2025-09-24T22:20:24.198524] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-24T22:20:24.221468] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-24T22:20:24.236566] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-24T22:20:24.238878] [INFO ] [MAIN ] Derivative Progress: 727/2075 symbols completed. FTWO took 0.5s. Estimated remaining: 8m 49s. Rate: 152.8 symbols/min [2025-09-24T22:20:24.239185] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:24.240274] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-24T22:20:24.240627] [INFO ] [MAIN ] FUBO: Loaded 53700 primary data records. [2025-09-24T22:20:24.330205] [DEBUG] [LOCAL ] FUL: Loaded 32962 existing records from primary storage. [2025-09-24T22:20:24.346719] [INFO ] [MAIN ] FUL: Loaded 32962 primary data records. [2025-09-24T22:20:24.931492] [DEBUG] [LOCAL ] FUN: Loaded 51571 existing records from primary storage. [2025-09-24T22:20:24.931985] [INFO ] [MAIN ] FUN: Loaded 51571 primary data records. [2025-09-24T22:20:25.279827] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:25.281613] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53700 primary records. [2025-09-24T22:20:25.282118] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-24T22:20:25.316827] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:25.318402] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32962 primary records. [2025-09-24T22:20:25.319145] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-24T22:20:25.320693] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-24T22:20:25.321097] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-24T22:20:25.323185] [INFO ] [MAIN ] Derivative Progress: 728/2075 symbols completed. FUBO took 1.3s. Estimated remaining: 8m 50s. Rate: 152.4 symbols/min [2025-09-24T22:20:25.331336] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:25.344548] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-24T22:20:25.345639] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-24T22:20:25.348470] [INFO ] [MAIN ] Derivative Progress: 729/2075 symbols completed. FUL took 1.2s. Estimated remaining: 8m 49s. Rate: 152.6 symbols/min [2025-09-24T22:20:25.354297] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:25.367785] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:25.369099] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51571 primary records. [2025-09-24T22:20:25.369354] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-24T22:20:25.392023] [DEBUG] [LOCAL ] FVR: Loaded 22164 existing records from primary storage. [2025-09-24T22:20:25.393542] [INFO ] [MAIN ] FVR: Loaded 22164 primary data records. [2025-09-24T22:20:25.393786] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-24T22:20:25.405140] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-24T22:20:25.427456] [INFO ] [MAIN ] Derivative Progress: 730/2075 symbols completed. FUN took 1.2s. Estimated remaining: 8m 48s. Rate: 152.8 symbols/min [2025-09-24T22:20:25.452985] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:25.568925] [DEBUG] [LOCAL ] FXED: Loaded 1228 existing records from primary storage. [2025-09-24T22:20:25.600178] [INFO ] [MAIN ] FXED: Loaded 1228 primary data records. [2025-09-24T22:20:25.728859] [DEBUG] [LOCAL ] FVRR: Loaded 40192 existing records from primary storage. [2025-09-24T22:20:25.736459] [INFO ] [MAIN ] FVRR: Loaded 40192 primary data records. [2025-09-24T22:20:26.406883] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:26.408356] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 22164 primary records. [2025-09-24T22:20:26.408759] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-24T22:20:26.445940] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-09-24T22:20:26.446687] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-24T22:20:26.446566] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:26.447613] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1228 primary records. [2025-09-24T22:20:26.447865] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-24T22:20:26.451837] [INFO ] [MAIN ] Derivative Progress: 731/2075 symbols completed. FVR took 1.1s. Estimated remaining: 8m 49s. Rate: 152.4 symbols/min [2025-09-24T22:20:26.460753] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:26.469386] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-09-24T22:20:26.469522] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-24T22:20:26.479395] [INFO ] [MAIN ] Derivative Progress: 732/2075 symbols completed. FXED took 1.0s. Estimated remaining: 8m 48s. Rate: 152.6 symbols/min [2025-09-24T22:20:26.484750] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:26.485097] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:26.486528] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40192 primary records. [2025-09-24T22:20:26.486720] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-24T22:20:26.503794] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-24T22:20:26.503957] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-24T22:20:26.507292] [INFO ] [MAIN ] Derivative Progress: 733/2075 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 47s. Rate: 152.8 symbols/min [2025-09-24T22:20:26.540073] [DEBUG] [LOCAL ] GAB: Loaded 27984 existing records from primary storage. [2025-09-24T22:20:26.540230] [INFO ] [MAIN ] GAB: Loaded 27984 primary data records. [2025-09-24T22:20:26.698450] [DEBUG] [LOCAL ] G: Loaded 49791 existing records from primary storage. [2025-09-24T22:20:26.717036] [INFO ] [MAIN ] G: Loaded 49791 primary data records. [2025-09-24T22:20:27.239569] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:27.240853] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27984 primary records. [2025-09-24T22:20:27.241065] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-24T22:20:27.261896] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-24T22:20:27.262140] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-24T22:20:27.264800] [INFO ] [MAIN ] Derivative Progress: 734/2075 symbols completed. GAB took 0.8s. Estimated remaining: 8m 47s. Rate: 152.6 symbols/min [2025-09-24T22:20:27.278164] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:27.278954] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49791 primary records. [2025-09-24T22:20:27.279019] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-24T22:20:27.295011] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-24T22:20:27.295079] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-24T22:20:27.297779] [INFO ] [MAIN ] Derivative Progress: 735/2075 symbols completed. G took 0.8s. Estimated remaining: 8m 46s. Rate: 152.8 symbols/min [2025-09-24T22:20:27.298404] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:27.298852] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:27.299093] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:27.307795] [DEBUG] [LOCAL ] GAM: Loaded 4119 existing records from primary storage. [2025-09-24T22:20:27.307931] [INFO ] [MAIN ] GAM: Loaded 4119 primary data records. [2025-09-24T22:20:27.421167] [DEBUG] [LOCAL ] GBAB: Loaded 12998 existing records from primary storage. [2025-09-24T22:20:27.424622] [INFO ] [MAIN ] GBAB: Loaded 12998 primary data records. [2025-09-24T22:20:27.867598] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-24T22:20:27.992631] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-24T22:20:28.336532] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:28.338530] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4119 primary records. [2025-09-24T22:20:28.351627] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-24T22:20:28.352838] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:28.361290] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12998 primary records. [2025-09-24T22:20:28.362907] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-24T22:20:28.369533] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-24T22:20:28.369634] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-24T22:20:28.373413] [INFO ] [MAIN ] Derivative Progress: 736/2075 symbols completed. GAM took 1.1s. Estimated remaining: 8m 47s. Rate: 152.5 symbols/min [2025-09-24T22:20:28.374075] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:28.395053] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-24T22:20:28.395583] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-24T22:20:28.398058] [INFO ] [MAIN ] Derivative Progress: 737/2075 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 46s. Rate: 152.7 symbols/min [2025-09-24T22:20:28.398739] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:28.417849] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:28.418880] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-24T22:20:28.419046] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-24T22:20:28.462776] [DEBUG] [LOCAL ] GBCI: Loaded 40080 existing records from primary storage. [2025-09-24T22:20:28.463864] [INFO ] [MAIN ] GBCI: Loaded 40080 primary data records. [2025-09-24T22:20:28.463733] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-24T22:20:28.464251] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-24T22:20:28.467489] [INFO ] [MAIN ] Derivative Progress: 738/2075 symbols completed. GAP took 1.2s. Estimated remaining: 8m 45s. Rate: 152.8 symbols/min [2025-09-24T22:20:28.532966] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:28.623814] [DEBUG] [LOCAL ] GBTG: Loaded 40267 existing records from primary storage. [2025-09-24T22:20:28.655293] [INFO ] [MAIN ] GBTG: Loaded 40267 primary data records. [2025-09-24T22:20:28.988455] [DEBUG] [LOCAL ] GBX: Loaded 29165 existing records from primary storage. [2025-09-24T22:20:29.024430] [INFO ] [MAIN ] GBX: Loaded 29165 primary data records. [2025-09-24T22:20:29.537801] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:29.538841] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40080 primary records. [2025-09-24T22:20:29.539753] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-24T22:20:29.562946] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-24T22:20:29.563186] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-24T22:20:29.565607] [INFO ] [MAIN ] Derivative Progress: 739/2075 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 46s. Rate: 152.5 symbols/min [2025-09-24T22:20:29.578545] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:29.578911] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:29.581113] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40267 primary records. [2025-09-24T22:20:29.581381] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-24T22:20:29.608635] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-24T22:20:29.608999] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-24T22:20:29.623749] [INFO ] [MAIN ] Derivative Progress: 740/2075 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 45s. Rate: 152.6 symbols/min [2025-09-24T22:20:29.624490] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:29.625427] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29165 primary records. [2025-09-24T22:20:29.633880] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-24T22:20:29.633807] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:29.635265] [DEBUG] [LOCAL ] GCO: Loaded 25438 existing records from primary storage. [2025-09-24T22:20:29.642727] [INFO ] [MAIN ] GCO: Loaded 25438 primary data records. [2025-09-24T22:20:29.727549] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-24T22:20:29.768581] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-24T22:20:29.771719] [INFO ] [MAIN ] Derivative Progress: 741/2075 symbols completed. GBX took 1.2s. Estimated remaining: 8m 44s. Rate: 152.8 symbols/min [2025-09-24T22:20:29.782506] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:29.798557] [DEBUG] [LOCAL ] GCTS: Loaded 19844 existing records from primary storage. [2025-09-24T22:20:29.831742] [INFO ] [MAIN ] GCTS: Loaded 19844 primary data records. [2025-09-24T22:20:30.059481] [DEBUG] [LOCAL ] GCV: Loaded 7177 existing records from primary storage. [2025-09-24T22:20:30.077493] [INFO ] [MAIN ] GCV: Loaded 7177 primary data records. [2025-09-24T22:20:30.625800] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:30.627274] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 25438 primary records. [2025-09-24T22:20:30.627716] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-24T22:20:30.660963] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:30.662848] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19844 primary records. [2025-09-24T22:20:30.663258] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-24T22:20:30.663206] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-24T22:20:30.664189] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-24T22:20:30.666569] [INFO ] [MAIN ] Derivative Progress: 742/2075 symbols completed. GCO took 1.1s. Estimated remaining: 8m 44s. Rate: 152.5 symbols/min [2025-09-24T22:20:30.667166] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:30.685441] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-24T22:20:30.686688] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-24T22:20:30.690221] [INFO ] [MAIN ] Derivative Progress: 743/2075 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 43s. Rate: 152.7 symbols/min [2025-09-24T22:20:30.691424] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:30.704836] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:30.705692] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7177 primary records. [2025-09-24T22:20:30.705912] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-24T22:20:30.721959] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-24T22:20:30.722079] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-24T22:20:30.724594] [INFO ] [MAIN ] Derivative Progress: 744/2075 symbols completed. GCV took 0.9s. Estimated remaining: 8m 42s. Rate: 152.9 symbols/min [2025-09-24T22:20:30.735591] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:30.742146] [DEBUG] [LOCAL ] GDIV: Loaded 3686 existing records from primary storage. [2025-09-24T22:20:30.742387] [INFO ] [MAIN ] GDIV: Loaded 3686 primary data records. [2025-09-24T22:20:30.861825] [DEBUG] [LOCAL ] GD: Loaded 47267 existing records from primary storage. [2025-09-24T22:20:30.913809] [INFO ] [MAIN ] GD: Loaded 47267 primary data records. [2025-09-24T22:20:31.192290] [DEBUG] [LOCAL ] GDDY: Loaded 49705 existing records from primary storage. [2025-09-24T22:20:31.213103] [INFO ] [MAIN ] GDDY: Loaded 49705 primary data records. [2025-09-24T22:20:31.759832] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:31.760965] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3686 primary records. [2025-09-24T22:20:31.761153] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-24T22:20:31.783210] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-24T22:20:31.783404] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-24T22:20:31.798888] [INFO ] [MAIN ] Derivative Progress: 745/2075 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 43s. Rate: 152.5 symbols/min [2025-09-24T22:20:31.800094] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:31.801038] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47267 primary records. [2025-09-24T22:20:31.801684] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-24T22:20:31.802910] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:31.832746] [DEBUG] [LOCAL ] GDL: Loaded 2521 existing records from primary storage. [2025-09-24T22:20:31.839336] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:31.840445] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49705 primary records. [2025-09-24T22:20:31.839023] [INFO ] [MAIN ] GDL: Loaded 2521 primary data records. [2025-09-24T22:20:31.841066] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-24T22:20:31.894700] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-24T22:20:31.931136] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-24T22:20:31.939142] [INFO ] [MAIN ] Derivative Progress: 746/2075 symbols completed. GD took 1.3s. Estimated remaining: 8m 42s. Rate: 152.7 symbols/min [2025-09-24T22:20:31.944896] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:31.965002] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-24T22:20:31.965265] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-24T22:20:31.967778] [INFO ] [MAIN ] Derivative Progress: 747/2075 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 41s. Rate: 152.9 symbols/min [2025-09-24T22:20:31.968480] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:32.166430] [DEBUG] [LOCAL ] GDO: Loaded 6037 existing records from primary storage. [2025-09-24T22:20:32.166666] [INFO ] [MAIN ] GDO: Loaded 6037 primary data records. [2025-09-24T22:20:32.367510] [DEBUG] [LOCAL ] GDOT: Loaded 38669 existing records from primary storage. [2025-09-24T22:20:32.372923] [INFO ] [MAIN ] GDOT: Loaded 38669 primary data records. [2025-09-24T22:20:32.848824] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:32.849785] [INFO ] [MAIN ] GDL: Generated 1793 derivative records from 2521 primary records. [2025-09-24T22:20:32.849989] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-24T22:20:32.868597] [DEBUG] [LOCAL ] GDL: Derivative data saved (1793 records). [2025-09-24T22:20:32.869136] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-24T22:20:32.883784] [INFO ] [MAIN ] Derivative Progress: 748/2075 symbols completed. GDL took 1.1s. Estimated remaining: 8m 42s. Rate: 152.6 symbols/min [2025-09-24T22:20:32.884318] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:32.885298] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 6037 primary records. [2025-09-24T22:20:32.885697] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-24T22:20:32.901711] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-24T22:20:32.901892] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-24T22:20:32.904523] [INFO ] [MAIN ] Derivative Progress: 749/2075 symbols completed. GDO took 1.0s. Estimated remaining: 8m 41s. Rate: 152.8 symbols/min [2025-09-24T22:20:32.919867] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:32.920382] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38669 primary records. [2025-09-24T22:20:32.920440] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-24T22:20:32.935717] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-24T22:20:32.935792] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-24T22:20:32.938128] [INFO ] [MAIN ] Derivative Progress: 750/2075 symbols completed. GDOT took 1.0s. Estimated remaining: 8m 40s. Rate: 153.0 symbols/min [2025-09-24T22:20:32.938605] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:32.938771] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:32.938946] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:32.964316] [DEBUG] [LOCAL ] GDV: Loaded 19752 existing records from primary storage. [2025-09-24T22:20:32.970811] [INFO ] [MAIN ] GDV: Loaded 19752 primary data records. [2025-09-24T22:20:32.991924] [DEBUG] [LOCAL ] GEF: Loaded 20704 existing records from primary storage. [2025-09-24T22:20:33.025824] [INFO ] [MAIN ] GEF: Loaded 20704 primary data records. [2025-09-24T22:20:33.473827] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-24T22:20:33.587906] [INFO ] [MAIN ] GE: Loaded 53713 primary data records. [2025-09-24T22:20:33.912120] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:33.913273] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19752 primary records. [2025-09-24T22:20:33.913460] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-24T22:20:33.941748] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:33.943269] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20704 primary records. [2025-09-24T22:20:33.943770] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-24T22:20:33.943883] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-24T22:20:33.943930] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-24T22:20:33.946452] [INFO ] [MAIN ] Derivative Progress: 751/2075 symbols completed. GDV took 1.0s. Estimated remaining: 8m 40s. Rate: 152.6 symbols/min [2025-09-24T22:20:33.947755] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:33.963994] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-24T22:20:33.964324] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-24T22:20:33.966787] [INFO ] [MAIN ] Derivative Progress: 752/2075 symbols completed. GEF took 1.0s. Estimated remaining: 8m 39s. Rate: 152.8 symbols/min [2025-09-24T22:20:33.967597] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:33.982967] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:33.983812] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53713 primary records. [2025-09-24T22:20:33.983903] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-24T22:20:34.009890] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-24T22:20:34.010036] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-24T22:20:34.012542] [INFO ] [MAIN ] Derivative Progress: 753/2075 symbols completed. GE took 1.1s. Estimated remaining: 8m 38s. Rate: 153.0 symbols/min [2025-09-24T22:20:34.012852] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:34.024481] [DEBUG] [LOCAL ] GEL: Loaded 33914 existing records from primary storage. [2025-09-24T22:20:34.024707] [INFO ] [MAIN ] GEL: Loaded 33914 primary data records. [2025-09-24T22:20:34.233048] [DEBUG] [LOCAL ] GENI: Loaded 52912 existing records from primary storage. [2025-09-24T22:20:34.251506] [INFO ] [MAIN ] GENI: Loaded 52912 primary data records. [2025-09-24T22:20:34.492959] [DEBUG] [LOCAL ] GEO: Loaded 52106 existing records from primary storage. [2025-09-24T22:20:34.503957] [INFO ] [MAIN ] GEO: Loaded 52106 primary data records. [2025-09-24T22:20:35.048037] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:35.049136] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 33914 primary records. [2025-09-24T22:20:35.049324] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-24T22:20:35.070537] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-24T22:20:35.070795] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-24T22:20:35.073325] [INFO ] [MAIN ] Derivative Progress: 754/2075 symbols completed. GEL took 1.1s. Estimated remaining: 8m 39s. Rate: 152.7 symbols/min [2025-09-24T22:20:35.073727] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:35.086887] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:35.088022] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52912 primary records. [2025-09-24T22:20:35.088231] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-24T22:20:35.119875] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:35.120513] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-24T22:20:35.121288] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 52106 primary records. [2025-09-24T22:20:35.121478] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-24T22:20:35.121563] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-24T22:20:35.124711] [INFO ] [MAIN ] Derivative Progress: 755/2075 symbols completed. GENI took 1.2s. Estimated remaining: 8m 38s. Rate: 152.8 symbols/min [2025-09-24T22:20:35.135965] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:35.149777] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-24T22:20:35.149897] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-24T22:20:35.152525] [INFO ] [MAIN ] Derivative Progress: 756/2075 symbols completed. GEO took 1.1s. Estimated remaining: 8m 37s. Rate: 153.0 symbols/min [2025-09-24T22:20:35.152916] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:35.167493] [DEBUG] [LOCAL ] GES: Loaded 39989 existing records from primary storage. [2025-09-24T22:20:35.167765] [INFO ] [MAIN ] GES: Loaded 39989 primary data records. [2025-09-24T22:20:35.200842] [DEBUG] [LOCAL ] GF: Loaded 3202 existing records from primary storage. [2025-09-24T22:20:35.213237] [INFO ] [MAIN ] GF: Loaded 3202 primary data records. [2025-09-24T22:20:35.705915] [DEBUG] [LOCAL ] GEV: Loaded 53114 existing records from primary storage. [2025-09-24T22:20:35.786231] [INFO ] [MAIN ] GEV: Loaded 53114 primary data records. [2025-09-24T22:20:36.128185] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:36.129486] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 39989 primary records. [2025-09-24T22:20:36.128665] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:36.130330] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3202 primary records. [2025-09-24T22:20:36.129759] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-24T22:20:36.130763] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-24T22:20:36.161834] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-24T22:20:36.162679] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-24T22:20:36.165079] [INFO ] [MAIN ] Derivative Progress: 757/2075 symbols completed. GF took 1.0s. Estimated remaining: 8m 38s. Rate: 152.7 symbols/min [2025-09-24T22:20:36.165565] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:36.179207] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-24T22:20:36.179738] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:36.179329] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-24T22:20:36.183267] [INFO ] [MAIN ] Derivative Progress: 758/2075 symbols completed. GES took 1.1s. Estimated remaining: 8m 37s. Rate: 152.9 symbols/min [2025-09-24T22:20:36.183995] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:36.180443] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53114 primary records. [2025-09-24T22:20:36.184139] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-24T22:20:36.201638] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-24T22:20:36.201796] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-24T22:20:36.204249] [INFO ] [MAIN ] Derivative Progress: 759/2075 symbols completed. GEV took 1.1s. Estimated remaining: 8m 36s. Rate: 153.1 symbols/min [2025-09-24T22:20:36.204671] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:36.229179] [DEBUG] [LOCAL ] GFF: Loaded 30830 existing records from primary storage. [2025-09-24T22:20:36.229356] [INFO ] [MAIN ] GFF: Loaded 30830 primary data records. [2025-09-24T22:20:36.412396] [DEBUG] [LOCAL ] GFI: Loaded 53109 existing records from primary storage. [2025-09-24T22:20:36.579730] [INFO ] [MAIN ] GFI: Loaded 53109 primary data records. [2025-09-24T22:20:36.648286] [DEBUG] [LOCAL ] GFL: Loaded 48025 existing records from primary storage. [2025-09-24T22:20:36.684522] [INFO ] [MAIN ] GFL: Loaded 48025 primary data records. [2025-09-24T22:20:37.493409] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:37.527360] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30830 primary records. [2025-09-24T22:20:37.545378] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-24T22:20:37.596563] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:37.600113] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53109 primary records. [2025-09-24T22:20:37.602719] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-24T22:20:37.603077] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-24T22:20:37.606209] [INFO ] [MAIN ] Derivative Progress: 760/2075 symbols completed. GFF took 1.4s. Estimated remaining: 8m 37s. Rate: 152.6 symbols/min [2025-09-24T22:20:37.601267] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-24T22:20:37.608850] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:37.641407] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-24T22:20:37.642391] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-24T22:20:37.645708] [INFO ] [MAIN ] Derivative Progress: 761/2075 symbols completed. GFI took 1.5s. Estimated remaining: 8m 36s. Rate: 152.8 symbols/min [2025-09-24T22:20:37.646255] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:37.651320] [DEBUG] [LOCAL ] GFR: Loaded 8471 existing records from primary storage. [2025-09-24T22:20:37.652074] [INFO ] [MAIN ] GFR: Loaded 8471 primary data records. [2025-09-24T22:20:37.806887] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:37.824488] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 48025 primary records. [2025-09-24T22:20:37.868515] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-24T22:20:38.074423] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-24T22:20:38.092736] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-24T22:20:38.097774] [DEBUG] [LOCAL ] GGB: Loaded 51045 existing records from primary storage. [2025-09-24T22:20:38.095676] [INFO ] [MAIN ] Derivative Progress: 762/2075 symbols completed. GFL took 1.9s. Estimated remaining: 8m 36s. Rate: 152.7 symbols/min [2025-09-24T22:20:38.098605] [INFO ] [MAIN ] GGB: Loaded 51045 primary data records. [2025-09-24T22:20:38.099181] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:38.466883] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:38.483712] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8471 primary records. [2025-09-24T22:20:38.485206] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-24T22:20:38.486549] [DEBUG] [LOCAL ] GGG: Loaded 40958 existing records from primary storage. [2025-09-24T22:20:38.486936] [INFO ] [MAIN ] GGG: Loaded 40958 primary data records. [2025-09-24T22:20:38.608302] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-24T22:20:38.614346] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-24T22:20:38.616889] [INFO ] [MAIN ] Derivative Progress: 763/2075 symbols completed. GFR took 1.0s. Estimated remaining: 8m 36s. Rate: 152.7 symbols/min [2025-09-24T22:20:38.827142] [DEBUG] [MAIN ] GGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:38.827910] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51045 primary records. [2025-09-24T22:20:38.828065] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-24T22:20:38.846283] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-24T22:20:38.846406] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-24T22:20:38.848734] [INFO ] [MAIN ] Derivative Progress: 764/2075 symbols completed. GGB took 1.2s. Estimated remaining: 8m 35s. Rate: 152.7 symbols/min [2025-09-24T22:20:38.867801] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:38.868342] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40958 primary records. [2025-09-24T22:20:38.868402] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-24T22:20:38.883435] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-24T22:20:38.883494] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-24T22:20:38.885976] [INFO ] [MAIN ] Derivative Progress: 765/2075 symbols completed. GGG took 0.8s. Estimated remaining: 8m 34s. Rate: 152.9 symbols/min [2025-09-24T22:20:38.886475] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:38.886754] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:38.887160] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:38.894386] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-09-24T22:20:38.892559] [DEBUG] [LOCAL ] GHC: Loaded 2634 existing records from primary storage. [2025-09-24T22:20:38.894551] [INFO ] [MAIN ] GHC: Loaded 2634 primary data records. [2025-09-24T22:20:38.894628] [INFO ] [MAIN ] GGZ: Loaded 2437 primary data records. [2025-09-24T22:20:39.013094] [DEBUG] [LOCAL ] GGT: Loaded 14152 existing records from primary storage. [2025-09-24T22:20:39.057584] [INFO ] [MAIN ] GGT: Loaded 14152 primary data records. [2025-09-24T22:20:39.871179] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:39.872537] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2634 primary records. [2025-09-24T22:20:39.872749] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-24T22:20:39.899622] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:39.901094] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2437 primary records. [2025-09-24T22:20:39.901265] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-24T22:20:39.917361] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:39.918800] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14152 primary records. [2025-09-24T22:20:39.919289] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-09-24T22:20:39.925241] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-24T22:20:39.925943] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-24T22:20:39.933025] [INFO ] [MAIN ] Derivative Progress: 766/2075 symbols completed. GHC took 1.0s. Estimated remaining: 8m 35s. Rate: 152.6 symbols/min [2025-09-24T22:20:39.936862] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-24T22:20:39.944472] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-24T22:20:39.949190] [INFO ] [MAIN ] Derivative Progress: 767/2075 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 34s. Rate: 152.8 symbols/min [2025-09-24T22:20:39.949416] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:39.953570] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:39.960168] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-09-24T22:20:39.960420] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-24T22:20:39.963225] [DEBUG] [LOCAL ] GHG: Loaded 3194 existing records from primary storage. [2025-09-24T22:20:39.965924] [INFO ] [MAIN ] Derivative Progress: 768/2075 symbols completed. GGT took 1.1s. Estimated remaining: 8m 33s. Rate: 153.0 symbols/min [2025-09-24T22:20:39.968063] [INFO ] [MAIN ] GHG: Loaded 3194 primary data records. [2025-09-24T22:20:39.968441] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:40.037915] [DEBUG] [LOCAL ] GHI: Loaded 6853 existing records from primary storage. [2025-09-24T22:20:40.055144] [INFO ] [MAIN ] GHI: Loaded 6853 primary data records. [2025-09-24T22:20:40.110429] [DEBUG] [LOCAL ] GHLD: Loaded 4117 existing records from primary storage. [2025-09-24T22:20:40.122596] [INFO ] [MAIN ] GHLD: Loaded 4117 primary data records. [2025-09-24T22:20:40.993725] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:40.994459] [INFO ] [MAIN ] GHG: Generated 1793 derivative records from 3194 primary records. [2025-09-24T22:20:40.994734] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-24T22:20:41.027777] [DEBUG] [LOCAL ] GHG: Derivative data saved (1793 records). [2025-09-24T22:20:41.028491] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-24T22:20:41.028398] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:41.031009] [INFO ] [MAIN ] Derivative Progress: 769/2075 symbols completed. GHG took 1.1s. Estimated remaining: 8m 33s. Rate: 152.6 symbols/min [2025-09-24T22:20:41.038744] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:41.044255] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4117 primary records. [2025-09-24T22:20:41.044363] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-24T22:20:41.045014] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:41.046066] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6853 primary records. [2025-09-24T22:20:41.046521] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-24T22:20:41.076171] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-24T22:20:41.076599] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-24T22:20:41.079532] [INFO ] [MAIN ] Derivative Progress: 770/2075 symbols completed. GHI took 1.1s. Estimated remaining: 8m 32s. Rate: 152.8 symbols/min [2025-09-24T22:20:41.085574] [DEBUG] [LOCAL ] GHM: Loaded 14139 existing records from primary storage. [2025-09-24T22:20:41.086297] [INFO ] [MAIN ] GHM: Loaded 14139 primary data records. [2025-09-24T22:20:41.086136] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:41.132538] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-24T22:20:41.154483] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-24T22:20:41.169036] [INFO ] [MAIN ] Derivative Progress: 771/2075 symbols completed. GHLD took 1.2s. Estimated remaining: 8m 32s. Rate: 153.0 symbols/min [2025-09-24T22:20:41.174496] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:41.398669] [DEBUG] [LOCAL ] GHY: Loaded 20728 existing records from primary storage. [2025-09-24T22:20:41.406404] [INFO ] [MAIN ] GHY: Loaded 20728 primary data records. [2025-09-24T22:20:41.541458] [DEBUG] [LOCAL ] GIB: Loaded 32049 existing records from primary storage. [2025-09-24T22:20:41.568104] [INFO ] [MAIN ] GIB: Loaded 32049 primary data records. [2025-09-24T22:20:42.062458] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:42.063335] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14139 primary records. [2025-09-24T22:20:42.063404] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-24T22:20:42.081360] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-24T22:20:42.082303] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-24T22:20:42.085131] [INFO ] [MAIN ] Derivative Progress: 772/2075 symbols completed. GHM took 1.0s. Estimated remaining: 8m 32s. Rate: 152.7 symbols/min [2025-09-24T22:20:42.086535] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:42.102806] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:42.103727] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20728 primary records. [2025-09-24T22:20:42.103921] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-24T22:20:42.124699] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-24T22:20:42.124971] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-24T22:20:42.127708] [INFO ] [MAIN ] Derivative Progress: 773/2075 symbols completed. GHY took 1.0s. Estimated remaining: 8m 31s. Rate: 152.9 symbols/min [2025-09-24T22:20:42.128376] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:42.133703] [DEBUG] [LOCAL ] GIC: Loaded 13671 existing records from primary storage. [2025-09-24T22:20:42.134597] [INFO ] [MAIN ] GIC: Loaded 13671 primary data records. [2025-09-24T22:20:42.244017] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:42.261910] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32049 primary records. [2025-09-24T22:20:42.262087] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-24T22:20:42.487836] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-24T22:20:42.488684] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-24T22:20:42.491534] [INFO ] [MAIN ] Derivative Progress: 774/2075 symbols completed. GIB took 1.3s. Estimated remaining: 8m 31s. Rate: 152.9 symbols/min [2025-09-24T22:20:42.492877] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:42.509811] [DEBUG] [LOCAL ] GIL: Loaded 43210 existing records from primary storage. [2025-09-24T22:20:42.510062] [INFO ] [MAIN ] GIL: Loaded 43210 primary data records. [2025-09-24T22:20:42.895330] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:42.911270] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13671 primary records. [2025-09-24T22:20:42.913038] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-24T22:20:42.915332] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-24T22:20:42.915459] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-09-24T22:20:42.962605] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-24T22:20:42.995857] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-24T22:20:43.037675] [INFO ] [MAIN ] Derivative Progress: 775/2075 symbols completed. GIC took 1.0s. Estimated remaining: 8m 30s. Rate: 152.8 symbols/min [2025-09-24T22:20:43.038152] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:43.256293] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:43.257494] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43210 primary records. [2025-09-24T22:20:43.257864] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-24T22:20:43.299375] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-24T22:20:43.300596] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-24T22:20:43.303243] [INFO ] [MAIN ] Derivative Progress: 776/2075 symbols completed. GIL took 1.2s. Estimated remaining: 8m 30s. Rate: 152.9 symbols/min [2025-09-24T22:20:43.304915] [DEBUG] [LOCAL ] GKOS: Loaded 43007 existing records from primary storage. [2025-09-24T22:20:43.305183] [INFO ] [MAIN ] GKOS: Loaded 43007 primary data records. [2025-09-24T22:20:43.305011] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:43.638612] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:43.648311] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53675 primary records. [2025-09-24T22:20:43.648510] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-24T22:20:43.666558] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-24T22:20:43.679245] [DEBUG] [LOCAL ] GL: Loaded 37907 existing records from primary storage. [2025-09-24T22:20:43.678463] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-24T22:20:43.681581] [INFO ] [MAIN ] Derivative Progress: 777/2075 symbols completed. GIS took 1.2s. Estimated remaining: 8m 29s. Rate: 152.9 symbols/min [2025-09-24T22:20:43.681694] [INFO ] [MAIN ] GL: Loaded 37907 primary data records. [2025-09-24T22:20:43.693720] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:44.046920] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:44.049903] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 43007 primary records. [2025-09-24T22:20:44.050728] [DEBUG] [LOCAL ] GLOB: Loaded 47365 existing records from primary storage. [2025-09-24T22:20:44.050900] [INFO ] [MAIN ] GLOB: Loaded 47365 primary data records. [2025-09-24T22:20:44.052032] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-24T22:20:44.151781] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-24T22:20:44.174407] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-24T22:20:44.177684] [INFO ] [MAIN ] Derivative Progress: 778/2075 symbols completed. GKOS took 1.1s. Estimated remaining: 8m 29s. Rate: 152.8 symbols/min [2025-09-24T22:20:44.417623] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:44.419918] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37907 primary records. [2025-09-24T22:20:44.420369] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-24T22:20:44.443159] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-24T22:20:44.443576] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-24T22:20:44.446117] [INFO ] [MAIN ] Derivative Progress: 779/2075 symbols completed. GL took 1.1s. Estimated remaining: 8m 29s. Rate: 152.9 symbols/min [2025-09-24T22:20:44.463609] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:44.464322] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47365 primary records. [2025-09-24T22:20:44.464389] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-24T22:20:44.480249] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-24T22:20:44.480316] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-24T22:20:44.482745] [INFO ] [MAIN ] Derivative Progress: 780/2075 symbols completed. GLOB took 0.8s. Estimated remaining: 8m 28s. Rate: 153.1 symbols/min [2025-09-24T22:20:44.483870] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:44.483636] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:44.484901] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:44.502517] [DEBUG] [LOCAL ] GLP: Loaded 9463 existing records from primary storage. [2025-09-24T22:20:44.502704] [INFO ] [MAIN ] GLP: Loaded 9463 primary data records. [2025-09-24T22:20:44.871000] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-24T22:20:44.872291] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-24T22:20:44.894510] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-24T22:20:44.918360] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-24T22:20:45.603552] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:45.604870] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9463 primary records. [2025-09-24T22:20:45.605297] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-24T22:20:45.625453] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-24T22:20:45.626106] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-24T22:20:45.628854] [INFO ] [MAIN ] Derivative Progress: 781/2075 symbols completed. GLP took 1.1s. Estimated remaining: 8m 28s. Rate: 152.7 symbols/min [2025-09-24T22:20:45.629376] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:45.648764] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:45.649780] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-24T22:20:45.649960] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-24T22:20:45.671084] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:45.677733] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-24T22:20:45.683195] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-24T22:20:45.684908] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-24T22:20:45.685949] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-24T22:20:45.694987] [INFO ] [MAIN ] Derivative Progress: 782/2075 symbols completed. GLW took 1.2s. Estimated remaining: 8m 28s. Rate: 152.9 symbols/min [2025-09-24T22:20:45.699503] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:45.704675] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-24T22:20:45.704843] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-24T22:20:45.709079] [INFO ] [MAIN ] Derivative Progress: 783/2075 symbols completed. GM took 1.2s. Estimated remaining: 8m 27s. Rate: 153.0 symbols/min [2025-09-24T22:20:45.709493] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:45.760329] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-24T22:20:45.760639] [INFO ] [MAIN ] GME: Loaded 53761 primary data records. [2025-09-24T22:20:45.921208] [DEBUG] [LOCAL ] GMRE: Loaded 37754 existing records from primary storage. [2025-09-24T22:20:45.944715] [INFO ] [MAIN ] GMRE: Loaded 37754 primary data records. [2025-09-24T22:20:45.966108] [DEBUG] [LOCAL ] GMED: Loaded 48335 existing records from primary storage. [2025-09-24T22:20:46.021618] [INFO ] [MAIN ] GMED: Loaded 48335 primary data records. [2025-09-24T22:20:46.798675] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:46.799969] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53761 primary records. [2025-09-24T22:20:46.800360] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-24T22:20:46.833678] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:46.835749] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37754 primary records. [2025-09-24T22:20:46.836755] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-24T22:20:46.838369] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-24T22:20:46.839835] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-24T22:20:46.842954] [INFO ] [MAIN ] Derivative Progress: 784/2075 symbols completed. GME took 1.2s. Estimated remaining: 8m 27s. Rate: 152.7 symbols/min [2025-09-24T22:20:46.859372] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-24T22:20:46.859476] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:46.867365] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-24T22:20:46.873150] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:46.874188] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48335 primary records. [2025-09-24T22:20:46.876941] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-24T22:20:46.876791] [INFO ] [MAIN ] Derivative Progress: 785/2075 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 26s. Rate: 152.9 symbols/min [2025-09-24T22:20:46.878885] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:46.901329] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-24T22:20:46.901585] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-24T22:20:46.904345] [INFO ] [MAIN ] Derivative Progress: 786/2075 symbols completed. GMED took 1.2s. Estimated remaining: 8m 25s. Rate: 153.0 symbols/min [2025-09-24T22:20:46.904670] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:46.913115] [DEBUG] [LOCAL ] GNE: Loaded 17738 existing records from primary storage. [2025-09-24T22:20:46.913255] [INFO ] [MAIN ] GNE: Loaded 17738 primary data records. [2025-09-24T22:20:47.311485] [DEBUG] [LOCAL ] GNL: Loaded 47224 existing records from primary storage. [2025-09-24T22:20:47.312770] [INFO ] [MAIN ] GNL: Loaded 47224 primary data records. [2025-09-24T22:20:47.314154] [DEBUG] [LOCAL ] GNK: Loaded 40546 existing records from primary storage. [2025-09-24T22:20:47.314782] [INFO ] [MAIN ] GNK: Loaded 40546 primary data records. [2025-09-24T22:20:47.971284] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:47.973208] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17738 primary records. [2025-09-24T22:20:47.973424] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-24T22:20:47.996491] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-24T22:20:47.996844] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-24T22:20:47.999324] [INFO ] [MAIN ] Derivative Progress: 787/2075 symbols completed. GNE took 1.1s. Estimated remaining: 8m 26s. Rate: 152.7 symbols/min [2025-09-24T22:20:47.999930] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:48.018241] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:48.019269] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 47224 primary records. [2025-09-24T22:20:48.019738] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-24T22:20:48.039961] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-24T22:20:48.040372] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-24T22:20:48.042816] [INFO ] [MAIN ] Derivative Progress: 788/2075 symbols completed. GNL took 1.1s. Estimated remaining: 8m 25s. Rate: 152.9 symbols/min [2025-09-24T22:20:48.056495] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:48.055605] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:48.057605] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40546 primary records. [2025-09-24T22:20:48.057874] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-24T22:20:48.091436] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-24T22:20:48.091744] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-24T22:20:48.094282] [INFO ] [MAIN ] Derivative Progress: 789/2075 symbols completed. GNK took 1.2s. Estimated remaining: 8m 24s. Rate: 153.0 symbols/min [2025-09-24T22:20:48.094833] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:48.102762] [DEBUG] [LOCAL ] GNT: Loaded 8041 existing records from primary storage. [2025-09-24T22:20:48.102965] [INFO ] [MAIN ] GNT: Loaded 8041 primary data records. [2025-09-24T22:20:48.210107] [DEBUG] [LOCAL ] GNTY: Loaded 7230 existing records from primary storage. [2025-09-24T22:20:48.226835] [INFO ] [MAIN ] GNTY: Loaded 7230 primary data records. [2025-09-24T22:20:48.245330] [DEBUG] [LOCAL ] GNRC: Loaded 45192 existing records from primary storage. [2025-09-24T22:20:48.256700] [INFO ] [MAIN ] GNRC: Loaded 45192 primary data records. [2025-09-24T22:20:49.132621] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:49.133700] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8041 primary records. [2025-09-24T22:20:49.136178] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-24T22:20:49.158381] [DEBUG] [MAIN ] GNTY: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:49.162439] [INFO ] [MAIN ] GNTY: Generated 1793 derivative records from 7230 primary records. [2025-09-24T22:20:49.166309] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-24T22:20:49.166597] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-24T22:20:49.167670] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-24T22:20:49.171581] [INFO ] [MAIN ] Derivative Progress: 790/2075 symbols completed. GNT took 1.1s. Estimated remaining: 8m 25s. Rate: 152.7 symbols/min [2025-09-24T22:20:49.172980] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:49.197254] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:49.202243] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45192 primary records. [2025-09-24T22:20:49.201383] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1793 records). [2025-09-24T22:20:49.202393] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-24T22:20:49.203492] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-24T22:20:49.206054] [INFO ] [MAIN ] Derivative Progress: 791/2075 symbols completed. GNTY took 1.1s. Estimated remaining: 8m 24s. Rate: 152.9 symbols/min [2025-09-24T22:20:49.213901] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:49.225248] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-24T22:20:49.225503] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-24T22:20:49.228631] [INFO ] [MAIN ] Derivative Progress: 792/2075 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 23s. Rate: 153.0 symbols/min [2025-09-24T22:20:49.228995] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:49.291965] [DEBUG] [LOCAL ] GOF: Loaded 42829 existing records from primary storage. [2025-09-24T22:20:49.292575] [INFO ] [MAIN ] GOF: Loaded 42829 primary data records. [2025-09-24T22:20:49.397634] [DEBUG] [LOCAL ] GOLF: Loaded 31640 existing records from primary storage. [2025-09-24T22:20:49.420919] [DEBUG] [LOCAL ] GNW: Loaded 51325 existing records from primary storage. [2025-09-24T22:20:49.421364] [INFO ] [MAIN ] GOLF: Loaded 31640 primary data records. [2025-09-24T22:20:49.432057] [INFO ] [MAIN ] GNW: Loaded 51325 primary data records. [2025-09-24T22:20:50.249771] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:50.250486] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42829 primary records. [2025-09-24T22:20:50.250801] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-24T22:20:50.268049] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-24T22:20:50.268497] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-24T22:20:50.270668] [INFO ] [MAIN ] Derivative Progress: 793/2075 symbols completed. GOF took 1.1s. Estimated remaining: 8m 24s. Rate: 152.7 symbols/min [2025-09-24T22:20:50.288197] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:50.300456] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51325 primary records. [2025-09-24T22:20:50.300863] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-24T22:20:50.301131] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:50.302292] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31640 primary records. [2025-09-24T22:20:50.302532] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-24T22:20:50.325391] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-24T22:20:50.326366] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-24T22:20:50.328761] [INFO ] [MAIN ] Derivative Progress: 794/2075 symbols completed. GNW took 1.2s. Estimated remaining: 8m 23s. Rate: 152.9 symbols/min [2025-09-24T22:20:50.335445] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-24T22:20:50.335512] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-24T22:20:50.338143] [INFO ] [MAIN ] Derivative Progress: 795/2075 symbols completed. GOLF took 1.1s. Estimated remaining: 8m 22s. Rate: 153.1 symbols/min [2025-09-24T22:20:50.338958] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:50.339022] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:50.339101] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:50.396278] [DEBUG] [LOCAL ] GOTU: Loaded 38964 existing records from primary storage. [2025-09-24T22:20:50.396563] [INFO ] [MAIN ] GOTU: Loaded 38964 primary data records. [2025-09-24T22:20:50.527144] [DEBUG] [LOCAL ] GPC: Loaded 46651 existing records from primary storage. [2025-09-24T22:20:50.548558] [DEBUG] [LOCAL ] GOOS: Loaded 45448 existing records from primary storage. [2025-09-24T22:20:50.605938] [INFO ] [MAIN ] GOOS: Loaded 45448 primary data records. [2025-09-24T22:20:50.606109] [INFO ] [MAIN ] GPC: Loaded 46651 primary data records. [2025-09-24T22:20:51.418626] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:51.419810] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 38964 primary records. [2025-09-24T22:20:51.419964] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-24T22:20:51.439584] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-24T22:20:51.439975] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-24T22:20:51.441928] [INFO ] [MAIN ] Derivative Progress: 796/2075 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 22s. Rate: 152.7 symbols/min [2025-09-24T22:20:51.442756] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:51.480975] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:51.481709] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:51.482528] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45448 primary records. [2025-09-24T22:20:51.483231] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46651 primary records. [2025-09-24T22:20:51.483419] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-24T22:20:51.483996] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-24T22:20:51.498284] [DEBUG] [LOCAL ] GPI: Loaded 14850 existing records from primary storage. [2025-09-24T22:20:51.502525] [INFO ] [MAIN ] GPI: Loaded 14850 primary data records. [2025-09-24T22:20:51.610667] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-24T22:20:51.624864] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-24T22:20:51.631506] [INFO ] [MAIN ] Derivative Progress: 797/2075 symbols completed. GPC took 1.3s. Estimated remaining: 8m 22s. Rate: 152.8 symbols/min [2025-09-24T22:20:51.649025] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-24T22:20:51.643191] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:51.649168] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-24T22:20:51.656932] [INFO ] [MAIN ] Derivative Progress: 798/2075 symbols completed. GOOS took 1.3s. Estimated remaining: 8m 21s. Rate: 153.0 symbols/min [2025-09-24T22:20:51.715302] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:51.848354] [DEBUG] [LOCAL ] GPJA: Loaded 4086 existing records from primary storage. [2025-09-24T22:20:51.848527] [INFO ] [MAIN ] GPJA: Loaded 4086 primary data records. [2025-09-24T22:20:52.208055] [DEBUG] [LOCAL ] GPK: Loaded 52671 existing records from primary storage. [2025-09-24T22:20:52.206876] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:20:52.208324] [INFO ] [MAIN ] GPK: Loaded 52671 primary data records. [2025-09-24T22:20:52.209166] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14850 primary records. [2025-09-24T22:20:52.209454] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-24T22:20:52.292389] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-09-24T22:20:52.304741] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-24T22:20:52.312286] [INFO ] [MAIN ] Derivative Progress: 799/2075 symbols completed. GPI took 0.9s. Estimated remaining: 8m 21s. Rate: 152.9 symbols/min [2025-09-24T22:20:52.318448] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:52.559432] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:20:52.569061] [INFO ] [MAIN ] GPJA: Generated 1792 derivative records from 4086 primary records. [2025-09-24T22:20:52.569218] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-24T22:20:52.600332] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1792 records). [2025-09-24T22:20:52.599114] [DEBUG] [LOCAL ] GPMT: Loaded 26624 existing records from primary storage. [2025-09-24T22:20:52.600534] [INFO ] [MAIN ] GPMT: Loaded 26624 primary data records. [2025-09-24T22:20:52.600672] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-24T22:20:52.603695] [INFO ] [MAIN ] Derivative Progress: 800/2075 symbols completed. GPJA took 1.0s. Estimated remaining: 8m 20s. Rate: 152.9 symbols/min [2025-09-24T22:20:52.628186] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:52.974049] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:52.975289] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52671 primary records. [2025-09-24T22:20:52.976047] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-24T22:20:53.010885] [DEBUG] [LOCAL ] GPN: Loaded 52089 existing records from primary storage. [2025-09-24T22:20:53.011873] [INFO ] [MAIN ] GPN: Loaded 52089 primary data records. [2025-09-24T22:20:53.060551] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-24T22:20:53.066014] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-24T22:20:53.076330] [INFO ] [MAIN ] Derivative Progress: 801/2075 symbols completed. GPK took 1.4s. Estimated remaining: 8m 20s. Rate: 152.9 symbols/min [2025-09-24T22:20:53.100539] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:53.397471] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:53.399119] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26624 primary records. [2025-09-24T22:20:53.399337] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-24T22:20:53.426462] [DEBUG] [LOCAL ] GPOR: Loaded 22883 existing records from primary storage. [2025-09-24T22:20:53.428265] [INFO ] [MAIN ] GPOR: Loaded 22883 primary data records. [2025-09-24T22:20:53.429179] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-24T22:20:53.434626] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-24T22:20:53.448864] [INFO ] [MAIN ] Derivative Progress: 802/2075 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 20s. Rate: 152.9 symbols/min [2025-09-24T22:20:53.468169] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:53.787369] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:53.788889] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52089 primary records. [2025-09-24T22:20:53.790109] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-24T22:20:53.790008] [DEBUG] [LOCAL ] GPRK: Loaded 39123 existing records from primary storage. [2025-09-24T22:20:53.791425] [INFO ] [MAIN ] GPRK: Loaded 39123 primary data records. [2025-09-24T22:20:53.847053] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-24T22:20:53.854952] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-24T22:20:53.870051] [INFO ] [MAIN ] Derivative Progress: 803/2075 symbols completed. GPN took 1.3s. Estimated remaining: 8m 19s. Rate: 152.9 symbols/min [2025-09-24T22:20:53.893850] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:54.162569] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:54.163687] [DEBUG] [LOCAL ] GRBK: Loaded 26986 existing records from primary storage. [2025-09-24T22:20:54.163972] [INFO ] [MAIN ] GRBK: Loaded 26986 primary data records. [2025-09-24T22:20:54.164983] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 22883 primary records. [2025-09-24T22:20:54.165809] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-24T22:20:54.507889] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-24T22:20:54.517907] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-24T22:20:54.520614] [INFO ] [MAIN ] Derivative Progress: 804/2075 symbols completed. GPOR took 1.4s. Estimated remaining: 8m 19s. Rate: 152.8 symbols/min [2025-09-24T22:20:54.521016] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:54.548779] [DEBUG] [LOCAL ] GRC: Loaded 8920 existing records from primary storage. [2025-09-24T22:20:54.544264] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:54.549974] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39123 primary records. [2025-09-24T22:20:54.550097] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-24T22:20:54.549148] [INFO ] [MAIN ] GRC: Loaded 8920 primary data records. [2025-09-24T22:20:54.639223] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-24T22:20:54.646132] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-24T22:20:54.653808] [INFO ] [MAIN ] Derivative Progress: 805/2075 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 18s. Rate: 152.9 symbols/min [2025-09-24T22:20:54.659436] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:54.907020] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:54.908038] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26986 primary records. [2025-09-24T22:20:54.908141] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-24T22:20:54.924472] [DEBUG] [LOCAL ] GRDN: Loaded 19770 existing records from primary storage. [2025-09-24T22:20:54.929736] [INFO ] [MAIN ] GRDN: Loaded 19770 primary data records. [2025-09-24T22:20:55.046544] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-24T22:20:55.047143] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-24T22:20:55.055031] [INFO ] [MAIN ] Derivative Progress: 806/2075 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 18s. Rate: 152.9 symbols/min [2025-09-24T22:20:55.060620] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:55.317109] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:55.319609] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8920 primary records. [2025-09-24T22:20:55.320085] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-24T22:20:55.351616] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-24T22:20:55.352007] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-24T22:20:55.355068] [INFO ] [MAIN ] Derivative Progress: 807/2075 symbols completed. GRC took 0.8s. Estimated remaining: 8m 17s. Rate: 152.9 symbols/min [2025-09-24T22:20:55.355529] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:55.372886] [DEBUG] [LOCAL ] GRMN: Loaded 41352 existing records from primary storage. [2025-09-24T22:20:55.374613] [INFO ] [MAIN ] GRMN: Loaded 41352 primary data records. [2025-09-24T22:20:55.446584] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:55.464263] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 19770 primary records. [2025-09-24T22:20:55.471145] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-24T22:20:55.544498] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-24T22:20:55.560944] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-24T22:20:55.574979] [INFO ] [MAIN ] Derivative Progress: 808/2075 symbols completed. GRDN took 0.9s. Estimated remaining: 8m 17s. Rate: 153.0 symbols/min [2025-09-24T22:20:55.633781] [DEBUG] [LOCAL ] GRND: Loaded 49997 existing records from primary storage. [2025-09-24T22:20:55.746193] [INFO ] [MAIN ] GRND: Loaded 49997 primary data records. [2025-09-24T22:20:56.093228] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:56.094374] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41352 primary records. [2025-09-24T22:20:56.094490] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-24T22:20:56.113933] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-24T22:20:56.114198] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-24T22:20:56.116778] [INFO ] [MAIN ] Derivative Progress: 809/2075 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 17s. Rate: 152.9 symbols/min [2025-09-24T22:20:56.134149] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:56.134741] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49997 primary records. [2025-09-24T22:20:56.134805] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-24T22:20:56.150154] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-24T22:20:56.150213] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-24T22:20:56.152326] [INFO ] [MAIN ] Derivative Progress: 810/2075 symbols completed. GRND took 0.8s. Estimated remaining: 8m 16s. Rate: 153.1 symbols/min [2025-09-24T22:20:56.153189] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:56.153041] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:56.152863] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:56.162288] [DEBUG] [LOCAL ] GRX: Loaded 4477 existing records from primary storage. [2025-09-24T22:20:56.162417] [INFO ] [MAIN ] GRX: Loaded 4477 primary data records. [2025-09-24T22:20:56.235478] [DEBUG] [LOCAL ] GROV: Loaded 9051 existing records from primary storage. [2025-09-24T22:20:56.269025] [INFO ] [MAIN ] GROV: Loaded 9051 primary data records. [2025-09-24T22:20:56.472404] [DEBUG] [LOCAL ] GRNT: Loaded 33695 existing records from primary storage. [2025-09-24T22:20:56.607765] [INFO ] [MAIN ] GRNT: Loaded 33695 primary data records. [2025-09-24T22:20:57.191733] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:57.192700] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4477 primary records. [2025-09-24T22:20:57.200608] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-24T22:20:57.213951] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:57.219041] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9051 primary records. [2025-09-24T22:20:57.221474] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-24T22:20:57.223742] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-24T22:20:57.223996] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-24T22:20:57.227406] [INFO ] [MAIN ] Derivative Progress: 811/2075 symbols completed. GRX took 1.1s. Estimated remaining: 8m 16s. Rate: 152.8 symbols/min [2025-09-24T22:20:57.228706] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:57.245677] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-24T22:20:57.247232] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-24T22:20:57.249604] [INFO ] [MAIN ] Derivative Progress: 812/2075 symbols completed. GROV took 1.1s. Estimated remaining: 8m 15s. Rate: 153.0 symbols/min [2025-09-24T22:20:57.252289] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:57.273871] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:57.274898] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33695 primary records. [2025-09-24T22:20:57.275082] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-24T22:20:57.291112] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-24T22:20:57.291224] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-24T22:20:57.293637] [INFO ] [MAIN ] Derivative Progress: 813/2075 symbols completed. GRNT took 1.1s. Estimated remaining: 8m 14s. Rate: 153.1 symbols/min [2025-09-24T22:20:57.294073] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:57.352452] [DEBUG] [LOCAL ] GS: Loaded 52038 existing records from primary storage. [2025-09-24T22:20:57.353974] [INFO ] [MAIN ] GS: Loaded 52038 primary data records. [2025-09-24T22:20:57.354862] [DEBUG] [LOCAL ] GSBD: Loaded 39133 existing records from primary storage. [2025-09-24T22:20:57.390994] [INFO ] [MAIN ] GSBD: Loaded 39133 primary data records. [2025-09-24T22:20:57.760569] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-09-24T22:20:57.986318] [INFO ] [MAIN ] GSK: Loaded 53493 primary data records. [2025-09-24T22:20:58.346135] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:58.367190] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 52038 primary records. [2025-09-24T22:20:58.367309] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-24T22:20:58.368493] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:58.369797] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39133 primary records. [2025-09-24T22:20:58.370329] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-24T22:20:58.410244] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-24T22:20:58.412002] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-24T22:20:58.415075] [INFO ] [MAIN ] Derivative Progress: 814/2075 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 15s. Rate: 152.8 symbols/min [2025-09-24T22:20:58.411924] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-24T22:20:58.415434] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-24T22:20:58.417908] [INFO ] [MAIN ] Derivative Progress: 815/2075 symbols completed. GS took 1.2s. Estimated remaining: 8m 14s. Rate: 153.0 symbols/min [2025-09-24T22:20:58.418432] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:58.418189] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:58.436206] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:58.437050] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53493 primary records. [2025-09-24T22:20:58.437177] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-24T22:20:58.456208] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-24T22:20:58.456378] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-24T22:20:58.458828] [INFO ] [MAIN ] Derivative Progress: 816/2075 symbols completed. GSK took 1.2s. Estimated remaining: 8m 13s. Rate: 153.1 symbols/min [2025-09-24T22:20:58.459326] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:58.503628] [DEBUG] [LOCAL ] GSL: Loaded 33432 existing records from primary storage. [2025-09-24T22:20:58.517304] [INFO ] [MAIN ] GSL: Loaded 33432 primary data records. [2025-09-24T22:20:58.536516] [DEBUG] [LOCAL ] GTES: Loaded 50654 existing records from primary storage. [2025-09-24T22:20:58.561889] [INFO ] [MAIN ] GTES: Loaded 50654 primary data records. [2025-09-24T22:20:58.803134] [DEBUG] [LOCAL ] GTLS: Loaded 42900 existing records from primary storage. [2025-09-24T22:20:58.842152] [INFO ] [MAIN ] GTLS: Loaded 42900 primary data records. [2025-09-24T22:20:59.573216] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:59.574357] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50654 primary records. [2025-09-24T22:20:59.574936] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-24T22:20:59.597728] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:59.606487] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33432 primary records. [2025-09-24T22:20:59.607557] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-24T22:20:59.607840] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-24T22:20:59.610277] [INFO ] [MAIN ] Derivative Progress: 817/2075 symbols completed. GTES took 1.2s. Estimated remaining: 8m 14s. Rate: 152.8 symbols/min [2025-09-24T22:20:59.607676] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-24T22:20:59.610541] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:59.631601] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-24T22:20:59.632018] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-24T22:20:59.634129] [INFO ] [MAIN ] Derivative Progress: 818/2075 symbols completed. GSL took 1.2s. Estimated remaining: 8m 13s. Rate: 152.9 symbols/min [2025-09-24T22:20:59.642384] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:59.648315] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:20:59.649764] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42900 primary records. [2025-09-24T22:20:59.650099] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-24T22:20:59.685938] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-24T22:20:59.686321] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-24T22:20:59.689324] [INFO ] [MAIN ] Derivative Progress: 819/2075 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 12s. Rate: 153.1 symbols/min [2025-09-24T22:20:59.690022] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:20:59.719840] [DEBUG] [LOCAL ] GTN: Loaded 45696 existing records from primary storage. [2025-09-24T22:20:59.720410] [INFO ] [MAIN ] GTN: Loaded 45696 primary data records. [2025-09-24T22:20:59.773208] [DEBUG] [LOCAL ] GUG: Loaded 12013 existing records from primary storage. [2025-09-24T22:20:59.797902] [DEBUG] [LOCAL ] GTY: Loaded 30364 existing records from primary storage. [2025-09-24T22:20:59.812848] [INFO ] [MAIN ] GTY: Loaded 30364 primary data records. [2025-09-24T22:20:59.798036] [INFO ] [MAIN ] GUG: Loaded 12013 primary data records. [2025-09-24T22:21:00.729085] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:00.730071] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45696 primary records. [2025-09-24T22:21:00.730410] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-24T22:21:00.774055] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:00.780458] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-24T22:21:00.781371] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-24T22:21:00.781283] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30364 primary records. [2025-09-24T22:21:00.783857] [INFO ] [MAIN ] Derivative Progress: 820/2075 symbols completed. GTN took 1.2s. Estimated remaining: 8m 13s. Rate: 152.8 symbols/min [2025-09-24T22:21:00.781659] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-24T22:21:00.784864] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:00.786415] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12013 primary records. [2025-09-24T22:21:00.785418] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:00.795681] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-24T22:21:00.811750] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-24T22:21:00.813213] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-24T22:21:00.815902] [INFO ] [MAIN ] Derivative Progress: 821/2075 symbols completed. GTY took 1.2s. Estimated remaining: 8m 12s. Rate: 152.9 symbols/min [2025-09-24T22:21:00.823184] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-09-24T22:21:00.823314] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:00.823892] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-24T22:21:00.830879] [INFO ] [MAIN ] Derivative Progress: 822/2075 symbols completed. GUG took 1.1s. Estimated remaining: 8m 11s. Rate: 153.1 symbols/min [2025-09-24T22:21:00.831097] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:00.839963] [DEBUG] [LOCAL ] GUT: Loaded 15414 existing records from primary storage. [2025-09-24T22:21:00.840121] [INFO ] [MAIN ] GUT: Loaded 15414 primary data records. [2025-09-24T22:21:00.963211] [DEBUG] [LOCAL ] GWH: Loaded 15510 existing records from primary storage. [2025-09-24T22:21:00.974288] [INFO ] [MAIN ] GWH: Loaded 15510 primary data records. [2025-09-24T22:21:01.322508] [DEBUG] [LOCAL ] GVA: Loaded 33696 existing records from primary storage. [2025-09-24T22:21:01.338407] [INFO ] [MAIN ] GVA: Loaded 33696 primary data records. [2025-09-24T22:21:01.970115] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:01.972134] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15414 primary records. [2025-09-24T22:21:01.972626] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-24T22:21:01.994424] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-24T22:21:01.995030] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-24T22:21:01.997446] [INFO ] [MAIN ] Derivative Progress: 823/2075 symbols completed. GUT took 1.2s. Estimated remaining: 8m 12s. Rate: 152.8 symbols/min [2025-09-24T22:21:02.011101] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:02.011958] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15510 primary records. [2025-09-24T22:21:02.012825] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-24T22:21:02.039858] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:02.040756] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33696 primary records. [2025-09-24T22:21:02.042082] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-24T22:21:02.043172] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-24T22:21:02.043790] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-24T22:21:02.046342] [INFO ] [MAIN ] Derivative Progress: 824/2075 symbols completed. GWH took 1.2s. Estimated remaining: 8m 11s. Rate: 152.9 symbols/min [2025-09-24T22:21:02.061665] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-24T22:21:02.061793] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-24T22:21:02.064351] [INFO ] [MAIN ] Derivative Progress: 825/2075 symbols completed. GVA took 1.2s. Estimated remaining: 8m 10s. Rate: 153.1 symbols/min [2025-09-24T22:21:02.065104] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:02.064986] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:02.065218] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:02.089795] [DEBUG] [LOCAL ] GWW: Loaded 19844 existing records from primary storage. [2025-09-24T22:21:02.100096] [INFO ] [MAIN ] GWW: Loaded 19844 primary data records. [2025-09-24T22:21:02.259396] [DEBUG] [LOCAL ] GXO: Loaded 47561 existing records from primary storage. [2025-09-24T22:21:02.271033] [DEBUG] [LOCAL ] GWRE: Loaded 41025 existing records from primary storage. [2025-09-24T22:21:02.276345] [INFO ] [MAIN ] GXO: Loaded 47561 primary data records. [2025-09-24T22:21:02.281544] [INFO ] [MAIN ] GWRE: Loaded 41025 primary data records. [2025-09-24T22:21:03.169604] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:03.171183] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19844 primary records. [2025-09-24T22:21:03.171677] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-24T22:21:03.201524] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-24T22:21:03.209437] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:03.212328] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47561 primary records. [2025-09-24T22:21:03.207490] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-24T22:21:03.215068] [INFO ] [MAIN ] Derivative Progress: 826/2075 symbols completed. GWW took 1.2s. Estimated remaining: 8m 11s. Rate: 152.7 symbols/min [2025-09-24T22:21:03.215729] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:03.212603] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-24T22:21:03.243003] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:03.248040] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 41025 primary records. [2025-09-24T22:21:03.248288] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-24T22:21:03.250621] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-24T22:21:03.251173] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-24T22:21:03.253897] [INFO ] [MAIN ] Derivative Progress: 827/2075 symbols completed. GXO took 1.2s. Estimated remaining: 8m 10s. Rate: 152.9 symbols/min [2025-09-24T22:21:03.263351] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:03.261853] [DEBUG] [LOCAL ] GYLD: Loaded 1540 existing records from primary storage. [2025-09-24T22:21:03.266945] [INFO ] [MAIN ] GYLD: Loaded 1540 primary data records. [2025-09-24T22:21:03.347789] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-24T22:21:03.365874] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-24T22:21:03.395008] [INFO ] [MAIN ] Derivative Progress: 828/2075 symbols completed. GWRE took 1.3s. Estimated remaining: 8m 9s. Rate: 153.0 symbols/min [2025-09-24T22:21:03.457058] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:03.660528] [DEBUG] [LOCAL ] HAE: Loaded 39488 existing records from primary storage. [2025-09-24T22:21:03.660736] [INFO ] [MAIN ] HAE: Loaded 39488 primary data records. [2025-09-24T22:21:03.996796] [DEBUG] [LOCAL ] HAFN: Loaded 43545 existing records from primary storage. [2025-09-24T22:21:03.997456] [INFO ] [MAIN ] HAFN: Loaded 43545 primary data records. [2025-09-24T22:21:04.305778] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:21:04.320056] [INFO ] [MAIN ] GYLD: Generated 1792 derivative records from 1540 primary records. [2025-09-24T22:21:04.320294] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-24T22:21:04.339430] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1792 records). [2025-09-24T22:21:04.340514] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-24T22:21:04.343551] [INFO ] [MAIN ] Derivative Progress: 829/2075 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 9s. Rate: 152.8 symbols/min [2025-09-24T22:21:04.347342] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:04.363598] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:04.364353] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39488 primary records. [2025-09-24T22:21:04.364519] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-24T22:21:04.382131] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-24T22:21:04.383024] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-24T22:21:04.386195] [INFO ] [MAIN ] Derivative Progress: 830/2075 symbols completed. HAE took 1.1s. Estimated remaining: 8m 8s. Rate: 152.9 symbols/min [2025-09-24T22:21:04.386484] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:04.400111] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:04.400829] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43545 primary records. [2025-09-24T22:21:04.400959] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-24T22:21:04.417006] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-24T22:21:04.417075] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-24T22:21:04.419675] [INFO ] [MAIN ] Derivative Progress: 831/2075 symbols completed. HAFN took 1.0s. Estimated remaining: 8m 8s. Rate: 153.1 symbols/min [2025-09-24T22:21:04.419943] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:04.471192] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-24T22:21:04.471482] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-24T22:21:04.614244] [DEBUG] [LOCAL ] HASI: Loaded 47223 existing records from primary storage. [2025-09-24T22:21:04.636467] [INFO ] [MAIN ] HASI: Loaded 47223 primary data records. [2025-09-24T22:21:04.882444] [DEBUG] [LOCAL ] HAYW: Loaded 48718 existing records from primary storage. [2025-09-24T22:21:04.934427] [INFO ] [MAIN ] HAYW: Loaded 48718 primary data records. [2025-09-24T22:21:05.464445] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:05.465420] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-24T22:21:05.465925] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-24T22:21:05.498720] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:05.501317] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47223 primary records. [2025-09-24T22:21:05.501516] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-24T22:21:05.500504] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-24T22:21:05.510298] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-24T22:21:05.518301] [INFO ] [MAIN ] Derivative Progress: 832/2075 symbols completed. HAL took 1.2s. Estimated remaining: 8m 8s. Rate: 152.8 symbols/min [2025-09-24T22:21:05.519050] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:05.521999] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-24T22:21:05.523512] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-24T22:21:05.527005] [INFO ] [MAIN ] Derivative Progress: 833/2075 symbols completed. HASI took 1.1s. Estimated remaining: 8m 7s. Rate: 152.9 symbols/min [2025-09-24T22:21:05.528373] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:05.544468] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:05.545347] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48718 primary records. [2025-09-24T22:21:05.545512] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-24T22:21:05.550229] [DEBUG] [LOCAL ] HBB: Loaded 6870 existing records from primary storage. [2025-09-24T22:21:05.561391] [INFO ] [MAIN ] HBB: Loaded 6870 primary data records. [2025-09-24T22:21:05.602890] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-24T22:21:05.623102] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-24T22:21:05.640537] [INFO ] [MAIN ] Derivative Progress: 834/2075 symbols completed. HAYW took 1.2s. Estimated remaining: 8m 6s. Rate: 153.1 symbols/min [2025-09-24T22:21:05.653384] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:05.941369] [DEBUG] [LOCAL ] HBI: Loaded 53012 existing records from primary storage. [2025-09-24T22:21:05.942249] [INFO ] [MAIN ] HBI: Loaded 53012 primary data records. [2025-09-24T22:21:06.171208] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-09-24T22:21:06.279193] [INFO ] [MAIN ] HBM: Loaded 52903 primary data records. [2025-09-24T22:21:06.415282] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:06.419697] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6870 primary records. [2025-09-24T22:21:06.420072] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-24T22:21:06.610070] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-24T22:21:06.633191] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-24T22:21:06.635698] [INFO ] [MAIN ] Derivative Progress: 835/2075 symbols completed. HBB took 1.1s. Estimated remaining: 8m 7s. Rate: 152.8 symbols/min [2025-09-24T22:21:06.636406] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:06.657247] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:06.657977] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 53012 primary records. [2025-09-24T22:21:06.658157] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-24T22:21:06.675435] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-24T22:21:06.675848] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-24T22:21:06.678184] [INFO ] [MAIN ] Derivative Progress: 836/2075 symbols completed. HBI took 1.1s. Estimated remaining: 8m 6s. Rate: 153.0 symbols/min [2025-09-24T22:21:06.678438] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:06.694545] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:06.695328] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52903 primary records. [2025-09-24T22:21:06.705748] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-24T22:21:06.736050] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-24T22:21:06.736287] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-24T22:21:06.738937] [INFO ] [MAIN ] Derivative Progress: 837/2075 symbols completed. HBM took 1.1s. Estimated remaining: 8m 5s. Rate: 153.1 symbols/min [2025-09-24T22:21:06.739207] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:06.740612] [DEBUG] [LOCAL ] HCA: Loaded 47182 existing records from primary storage. [2025-09-24T22:21:06.741023] [INFO ] [MAIN ] HCA: Loaded 47182 primary data records. [2025-09-24T22:21:06.880440] [DEBUG] [LOCAL ] HCC: Loaded 45391 existing records from primary storage. [2025-09-24T22:21:06.906546] [DEBUG] [LOCAL ] HCI: Loaded 13906 existing records from primary storage. [2025-09-24T22:21:06.927228] [INFO ] [MAIN ] HCC: Loaded 45391 primary data records. [2025-09-24T22:21:06.947687] [INFO ] [MAIN ] HCI: Loaded 13906 primary data records. [2025-09-24T22:21:07.763854] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:07.765809] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 47182 primary records. [2025-09-24T22:21:07.766089] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-24T22:21:07.784574] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-24T22:21:07.784903] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-24T22:21:07.787286] [INFO ] [MAIN ] Derivative Progress: 838/2075 symbols completed. HCA took 1.2s. Estimated remaining: 8m 6s. Rate: 152.8 symbols/min [2025-09-24T22:21:07.805361] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:07.817510] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13906 primary records. [2025-09-24T22:21:07.817909] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-24T22:21:07.818145] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:07.818779] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45391 primary records. [2025-09-24T22:21:07.819198] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-24T22:21:07.847345] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-24T22:21:07.848620] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-24T22:21:07.849600] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-24T22:21:07.852377] [INFO ] [MAIN ] Derivative Progress: 839/2075 symbols completed. HCI took 1.1s. Estimated remaining: 8m 5s. Rate: 153.0 symbols/min [2025-09-24T22:21:07.852472] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-24T22:21:07.855142] [INFO ] [MAIN ] Derivative Progress: 840/2075 symbols completed. HCC took 1.2s. Estimated remaining: 8m 4s. Rate: 153.1 symbols/min [2025-09-24T22:21:07.856065] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:07.856273] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:07.856209] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:07.920673] [DEBUG] [LOCAL ] HE: Loaded 49192 existing records from primary storage. [2025-09-24T22:21:07.920895] [INFO ] [MAIN ] HE: Loaded 49192 primary data records. [2025-09-24T22:21:08.078892] [DEBUG] [LOCAL ] HDB: Loaded 51926 existing records from primary storage. [2025-09-24T22:21:08.114734] [INFO ] [MAIN ] HDB: Loaded 51926 primary data records. [2025-09-24T22:21:08.148727] [DEBUG] [LOCAL ] HD: Loaded 53515 existing records from primary storage. [2025-09-24T22:21:08.150799] [INFO ] [MAIN ] HD: Loaded 53515 primary data records. [2025-09-24T22:21:08.908187] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:08.910201] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49192 primary records. [2025-09-24T22:21:08.910526] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-24T22:21:08.927775] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-24T22:21:08.930220] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-24T22:21:08.933009] [INFO ] [MAIN ] Derivative Progress: 841/2075 symbols completed. HE took 1.1s. Estimated remaining: 8m 4s. Rate: 152.8 symbols/min [2025-09-24T22:21:08.933698] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:08.949436] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:08.950366] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51926 primary records. [2025-09-24T22:21:08.963095] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:08.963761] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53515 primary records. [2025-09-24T22:21:08.962510] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-24T22:21:08.964001] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-24T22:21:08.994664] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-24T22:21:08.996056] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-24T22:21:09.006069] [INFO ] [MAIN ] Derivative Progress: 842/2075 symbols completed. HDB took 1.2s. Estimated remaining: 8m 4s. Rate: 153.0 symbols/min [2025-09-24T22:21:09.007170] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:09.009289] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-24T22:21:09.009498] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-24T22:21:09.012256] [INFO ] [MAIN ] Derivative Progress: 843/2075 symbols completed. HD took 1.2s. Estimated remaining: 8m 3s. Rate: 153.1 symbols/min [2025-09-24T22:21:09.012783] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:09.026111] [DEBUG] [LOCAL ] HEI: Loaded 32518 existing records from primary storage. [2025-09-24T22:21:09.026389] [INFO ] [MAIN ] HEI: Loaded 32518 primary data records. [2025-09-24T22:21:09.073047] [DEBUG] [LOCAL ] HEQ: Loaded 6152 existing records from primary storage. [2025-09-24T22:21:09.110813] [INFO ] [MAIN ] HEQ: Loaded 6152 primary data records. [2025-09-24T22:21:09.545048] [DEBUG] [LOCAL ] HESM: Loaded 48169 existing records from primary storage. [2025-09-24T22:21:09.692105] [INFO ] [MAIN ] HESM: Loaded 48169 primary data records. [2025-09-24T22:21:10.033917] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:10.034702] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 32518 primary records. [2025-09-24T22:21:10.035380] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-24T22:21:10.054995] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-24T22:21:10.055482] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-24T22:21:10.058861] [INFO ] [MAIN ] Derivative Progress: 844/2075 symbols completed. HEI took 1.1s. Estimated remaining: 8m 3s. Rate: 152.8 symbols/min [2025-09-24T22:21:10.059189] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:10.076501] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:10.077698] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6152 primary records. [2025-09-24T22:21:10.077858] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-24T22:21:10.098330] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-24T22:21:10.106917] [DEBUG] [LOCAL ] HFRO: Loaded 17448 existing records from primary storage. [2025-09-24T22:21:10.104740] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-24T22:21:10.109727] [INFO ] [MAIN ] Derivative Progress: 845/2075 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 2s. Rate: 153.0 symbols/min [2025-09-24T22:21:10.110075] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:10.110334] [INFO ] [MAIN ] HFRO: Loaded 17448 primary data records. [2025-09-24T22:21:10.166479] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:10.203139] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48169 primary records. [2025-09-24T22:21:10.208447] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-24T22:21:10.235450] [DEBUG] [LOCAL ] HGER: Loaded 13138 existing records from primary storage. [2025-09-24T22:21:10.235568] [INFO ] [MAIN ] HGER: Loaded 13138 primary data records. [2025-09-24T22:21:10.369332] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-24T22:21:10.411866] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-24T22:21:10.434030] [INFO ] [MAIN ] Derivative Progress: 846/2075 symbols completed. HESM took 1.4s. Estimated remaining: 8m 2s. Rate: 153.0 symbols/min [2025-09-24T22:21:10.439961] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:10.762988] [DEBUG] [LOCAL ] HGLB: Loaded 9759 existing records from primary storage. [2025-09-24T22:21:10.763325] [INFO ] [MAIN ] HGLB: Loaded 9759 primary data records. [2025-09-24T22:21:11.097702] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:11.098695] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17448 primary records. [2025-09-24T22:21:11.099081] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-24T22:21:11.133848] [DEBUG] [MAIN ] HGER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:11.134351] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-24T22:21:11.134538] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-24T22:21:11.137733] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 13138 primary records. [2025-09-24T22:21:11.136724] [INFO ] [MAIN ] Derivative Progress: 847/2075 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 2s. Rate: 152.9 symbols/min [2025-09-24T22:21:11.139001] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:11.139460] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-24T22:21:11.157875] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-24T22:21:11.161374] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-24T22:21:11.164419] [INFO ] [MAIN ] Derivative Progress: 848/2075 symbols completed. HGER took 1.1s. Estimated remaining: 8m 1s. Rate: 153.1 symbols/min [2025-09-24T22:21:11.164798] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:11.174833] [DEBUG] [LOCAL ] HGTY: Loaded 13112 existing records from primary storage. [2025-09-24T22:21:11.175034] [INFO ] [MAIN ] HGTY: Loaded 13112 primary data records. [2025-09-24T22:21:11.251590] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:11.269589] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9759 primary records. [2025-09-24T22:21:11.291562] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-24T22:21:11.512213] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-24T22:21:11.526085] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-24T22:21:11.528609] [DEBUG] [LOCAL ] HGV: Loaded 46877 existing records from primary storage. [2025-09-24T22:21:11.531500] [INFO ] [MAIN ] Derivative Progress: 849/2075 symbols completed. HGLB took 1.1s. Estimated remaining: 8m 1s. Rate: 153.1 symbols/min [2025-09-24T22:21:11.532026] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:11.532305] [INFO ] [MAIN ] HGV: Loaded 46877 primary data records. [2025-09-24T22:21:11.920578] [DEBUG] [LOCAL ] HHH: Loaded 32641 existing records from primary storage. [2025-09-24T22:21:11.920893] [INFO ] [MAIN ] HHH: Loaded 32641 primary data records. [2025-09-24T22:21:11.957284] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:11.974590] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13112 primary records. [2025-09-24T22:21:11.982371] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-24T22:21:12.115730] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-09-24T22:21:12.147488] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-24T22:21:12.273589] [INFO ] [MAIN ] Derivative Progress: 850/2075 symbols completed. HGTY took 1.1s. Estimated remaining: 8m 1s. Rate: 152.9 symbols/min [2025-09-24T22:21:12.274118] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:12.296352] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:12.297243] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46877 primary records. [2025-09-24T22:21:12.297415] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-24T22:21:12.315133] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-24T22:21:12.323726] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-24T22:21:12.326603] [INFO ] [MAIN ] Derivative Progress: 851/2075 symbols completed. HGV took 1.2s. Estimated remaining: 7m 60s. Rate: 153.1 symbols/min [2025-09-24T22:21:12.327353] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:12.355283] [DEBUG] [LOCAL ] HI: Loaded 35136 existing records from primary storage. [2025-09-24T22:21:12.355839] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:12.356020] [INFO ] [MAIN ] HI: Loaded 35136 primary data records. [2025-09-24T22:21:12.356748] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32641 primary records. [2025-09-24T22:21:12.356925] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-24T22:21:12.475079] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-24T22:21:12.480869] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-24T22:21:12.483727] [INFO ] [MAIN ] Derivative Progress: 852/2075 symbols completed. HHH took 1.0s. Estimated remaining: 7m 59s. Rate: 153.2 symbols/min [2025-09-24T22:21:12.540846] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:12.701265] [DEBUG] [LOCAL ] HIG: Loaded 51237 existing records from primary storage. [2025-09-24T22:21:12.701467] [INFO ] [MAIN ] HIG: Loaded 51237 primary data records. [2025-09-24T22:21:13.029667] [DEBUG] [LOCAL ] HII: Loaded 35179 existing records from primary storage. [2025-09-24T22:21:13.030023] [INFO ] [MAIN ] HII: Loaded 35179 primary data records. [2025-09-24T22:21:13.087102] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:13.109219] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35136 primary records. [2025-09-24T22:21:13.125812] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-24T22:21:13.254514] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-24T22:21:13.256160] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-24T22:21:13.258744] [INFO ] [MAIN ] Derivative Progress: 853/2075 symbols completed. HI took 1.0s. Estimated remaining: 7m 59s. Rate: 153.0 symbols/min [2025-09-24T22:21:13.388360] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:13.389081] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51237 primary records. [2025-09-24T22:21:13.389243] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-24T22:21:13.407964] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-24T22:21:13.408091] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-24T22:21:13.410849] [INFO ] [MAIN ] Derivative Progress: 854/2075 symbols completed. HIG took 1.1s. Estimated remaining: 7m 58s. Rate: 153.1 symbols/min [2025-09-24T22:21:13.430186] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:13.430776] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 35179 primary records. [2025-09-24T22:21:13.430839] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-24T22:21:13.446025] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-24T22:21:13.446085] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-24T22:21:13.448404] [INFO ] [MAIN ] Derivative Progress: 855/2075 symbols completed. HII took 0.9s. Estimated remaining: 7m 58s. Rate: 153.3 symbols/min [2025-09-24T22:21:13.448961] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:13.449071] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:13.449114] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:13.477791] [DEBUG] [LOCAL ] HIO: Loaded 23601 existing records from primary storage. [2025-09-24T22:21:13.484972] [INFO ] [MAIN ] HIO: Loaded 23601 primary data records. [2025-09-24T22:21:13.490745] [DEBUG] [LOCAL ] HIPO: Loaded 22567 existing records from primary storage. [2025-09-24T22:21:13.502604] [INFO ] [MAIN ] HIPO: Loaded 22567 primary data records. [2025-09-24T22:21:13.816194] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-24T22:21:13.876545] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-24T22:21:14.520267] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:14.521526] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:14.521163] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23601 primary records. [2025-09-24T22:21:14.522294] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22567 primary records. [2025-09-24T22:21:14.522537] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-24T22:21:14.522881] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-24T22:21:14.567280] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:14.568320] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-24T22:21:14.568747] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-24T22:21:14.571986] [INFO ] [MAIN ] Derivative Progress: 856/2075 symbols completed. HIO took 1.1s. Estimated remaining: 7m 58s. Rate: 152.9 symbols/min [2025-09-24T22:21:14.573174] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-24T22:21:14.575068] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-24T22:21:14.574959] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-24T22:21:14.574220] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:14.575235] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-24T22:21:14.578436] [INFO ] [MAIN ] Derivative Progress: 857/2075 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 57s. Rate: 153.1 symbols/min [2025-09-24T22:21:14.590266] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:14.596505] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-24T22:21:14.596637] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-24T22:21:14.599358] [INFO ] [MAIN ] Derivative Progress: 858/2075 symbols completed. HIMS took 1.2s. Estimated remaining: 7m 56s. Rate: 153.3 symbols/min [2025-09-24T22:21:14.600019] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:14.620959] [DEBUG] [LOCAL ] HIX: Loaded 20343 existing records from primary storage. [2025-09-24T22:21:14.621112] [INFO ] [MAIN ] HIX: Loaded 20343 primary data records. [2025-09-24T22:21:14.747838] [DEBUG] [LOCAL ] HKD: Loaded 18353 existing records from primary storage. [2025-09-24T22:21:14.758746] [INFO ] [MAIN ] HKD: Loaded 18353 primary data records. [2025-09-24T22:21:14.884304] [DEBUG] [LOCAL ] HIW: Loaded 44709 existing records from primary storage. [2025-09-24T22:21:15.047829] [INFO ] [MAIN ] HIW: Loaded 44709 primary data records. [2025-09-24T22:21:15.637694] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:15.638554] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20343 primary records. [2025-09-24T22:21:15.638785] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-24T22:21:15.659515] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-24T22:21:15.659984] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-24T22:21:15.670360] [INFO ] [MAIN ] Derivative Progress: 859/2075 symbols completed. HIX took 1.1s. Estimated remaining: 7m 57s. Rate: 153.0 symbols/min [2025-09-24T22:21:15.675709] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:15.676060] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:15.676914] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18353 primary records. [2025-09-24T22:21:15.677376] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-24T22:21:15.694886] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-24T22:21:15.695115] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-24T22:21:15.699116] [INFO ] [MAIN ] Derivative Progress: 860/2075 symbols completed. HKD took 1.1s. Estimated remaining: 7m 56s. Rate: 153.1 symbols/min [2025-09-24T22:21:15.699558] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:15.715611] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:15.716585] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44709 primary records. [2025-09-24T22:21:15.716752] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-24T22:21:15.734930] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-24T22:21:15.735169] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-24T22:21:15.738250] [INFO ] [MAIN ] Derivative Progress: 861/2075 symbols completed. HIW took 1.2s. Estimated remaining: 7m 55s. Rate: 153.3 symbols/min [2025-09-24T22:21:15.738697] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:15.788108] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-24T22:21:15.788459] [INFO ] [MAIN ] HL: Loaded 53671 primary data records. [2025-09-24T22:21:15.853264] [DEBUG] [LOCAL ] HLF: Loaded 48699 existing records from primary storage. [2025-09-24T22:21:15.867091] [INFO ] [MAIN ] HLF: Loaded 48699 primary data records. [2025-09-24T22:21:16.047364] [DEBUG] [LOCAL ] HLI: Loaded 31188 existing records from primary storage. [2025-09-24T22:21:16.071351] [INFO ] [MAIN ] HLI: Loaded 31188 primary data records. [2025-09-24T22:21:16.816501] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:16.822190] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:16.823175] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53671 primary records. [2025-09-24T22:21:16.823514] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-24T22:21:16.824472] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48699 primary records. [2025-09-24T22:21:16.825486] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-24T22:21:16.858569] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-24T22:21:16.859192] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-24T22:21:16.871042] [INFO ] [MAIN ] Derivative Progress: 862/2075 symbols completed. HLF took 1.2s. Estimated remaining: 7m 56s. Rate: 153.0 symbols/min [2025-09-24T22:21:16.878414] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-24T22:21:16.877840] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:16.877461] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:16.878632] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-24T22:21:16.881629] [INFO ] [MAIN ] Derivative Progress: 863/2075 symbols completed. HL took 1.2s. Estimated remaining: 7m 55s. Rate: 153.1 symbols/min [2025-09-24T22:21:16.882809] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 31188 primary records. [2025-09-24T22:21:16.883329] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:16.883547] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-24T22:21:16.902581] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-24T22:21:16.902801] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-24T22:21:16.905873] [INFO ] [MAIN ] Derivative Progress: 864/2075 symbols completed. HLI took 1.2s. Estimated remaining: 7m 54s. Rate: 153.3 symbols/min [2025-09-24T22:21:16.906254] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:16.933031] [DEBUG] [LOCAL ] HLIO: Loaded 28212 existing records from primary storage. [2025-09-24T22:21:16.945318] [INFO ] [MAIN ] HLIO: Loaded 28212 primary data records. [2025-09-24T22:21:17.069707] [DEBUG] [LOCAL ] HLLY: Loaded 33404 existing records from primary storage. [2025-09-24T22:21:17.074147] [INFO ] [MAIN ] HLLY: Loaded 33404 primary data records. [2025-09-24T22:21:17.423251] [DEBUG] [LOCAL ] HLN: Loaded 53094 existing records from primary storage. [2025-09-24T22:21:17.442891] [INFO ] [MAIN ] HLN: Loaded 53094 primary data records. [2025-09-24T22:21:18.035942] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:18.038620] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28212 primary records. [2025-09-24T22:21:18.039973] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-24T22:21:18.078195] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:18.078312] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-24T22:21:18.079414] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33404 primary records. [2025-09-24T22:21:18.080308] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-24T22:21:18.080169] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-24T22:21:18.083287] [INFO ] [MAIN ] Derivative Progress: 865/2075 symbols completed. HLIO took 1.2s. Estimated remaining: 7m 55s. Rate: 152.9 symbols/min [2025-09-24T22:21:18.085070] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:18.107226] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-24T22:21:18.107376] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-24T22:21:18.110311] [INFO ] [MAIN ] Derivative Progress: 866/2075 symbols completed. HLLY took 1.2s. Estimated remaining: 7m 54s. Rate: 153.1 symbols/min [2025-09-24T22:21:18.110864] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:18.124594] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:18.125416] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53094 primary records. [2025-09-24T22:21:18.125741] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-24T22:21:18.143379] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-24T22:21:18.143577] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-24T22:21:18.146261] [INFO ] [MAIN ] Derivative Progress: 867/2075 symbols completed. HLN took 1.2s. Estimated remaining: 7m 53s. Rate: 153.3 symbols/min [2025-09-24T22:21:18.146624] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:18.197750] [DEBUG] [LOCAL ] HLT: Loaded 50720 existing records from primary storage. [2025-09-24T22:21:18.198084] [INFO ] [MAIN ] HLT: Loaded 50720 primary data records. [2025-09-24T22:21:18.333020] [DEBUG] [LOCAL ] HLX: Loaded 48031 existing records from primary storage. [2025-09-24T22:21:18.346424] [INFO ] [MAIN ] HLX: Loaded 48031 primary data records. [2025-09-24T22:21:18.507088] [DEBUG] [LOCAL ] HMC: Loaded 46818 existing records from primary storage. [2025-09-24T22:21:18.672448] [INFO ] [MAIN ] HMC: Loaded 46818 primary data records. [2025-09-24T22:21:19.241982] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:19.243294] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50720 primary records. [2025-09-24T22:21:19.243614] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-24T22:21:19.264580] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-24T22:21:19.265002] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-24T22:21:19.267476] [INFO ] [MAIN ] Derivative Progress: 868/2075 symbols completed. HLT took 1.2s. Estimated remaining: 7m 54s. Rate: 152.9 symbols/min [2025-09-24T22:21:19.280851] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:19.281753] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 48031 primary records. [2025-09-24T22:21:19.282015] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-24T22:21:19.312703] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:19.314218] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46818 primary records. [2025-09-24T22:21:19.314832] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-24T22:21:19.330061] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-24T22:21:19.333726] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-24T22:21:19.334193] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-24T22:21:19.337712] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-24T22:21:19.337519] [INFO ] [MAIN ] Derivative Progress: 869/2075 symbols completed. HLX took 1.2s. Estimated remaining: 7m 53s. Rate: 153.1 symbols/min [2025-09-24T22:21:19.340555] [INFO ] [MAIN ] Derivative Progress: 870/2075 symbols completed. HMC took 1.2s. Estimated remaining: 7m 52s. Rate: 153.3 symbols/min [2025-09-24T22:21:19.341372] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:19.341490] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:19.342478] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:19.387275] [DEBUG] [LOCAL ] HMN: Loaded 23386 existing records from primary storage. [2025-09-24T22:21:19.388105] [INFO ] [MAIN ] HMN: Loaded 23386 primary data records. [2025-09-24T22:21:19.387998] [DEBUG] [LOCAL ] HNI: Loaded 28817 existing records from primary storage. [2025-09-24T22:21:19.400471] [INFO ] [MAIN ] HNI: Loaded 28817 primary data records. [2025-09-24T22:21:19.788087] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-24T22:21:19.935983] [INFO ] [MAIN ] HMY: Loaded 53136 primary data records. [2025-09-24T22:21:20.472612] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:20.486336] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23386 primary records. [2025-09-24T22:21:20.487125] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:20.488371] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 28817 primary records. [2025-09-24T22:21:20.487496] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-24T22:21:20.488472] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-24T22:21:20.527368] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-24T22:21:20.528482] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-24T22:21:20.535015] [INFO ] [MAIN ] Derivative Progress: 871/2075 symbols completed. HNI took 1.2s. Estimated remaining: 7m 52s. Rate: 152.9 symbols/min [2025-09-24T22:21:20.532071] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-24T22:21:20.535282] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:20.535785] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-24T22:21:20.540229] [INFO ] [MAIN ] Derivative Progress: 872/2075 symbols completed. HMN took 1.2s. Estimated remaining: 7m 52s. Rate: 153.1 symbols/min [2025-09-24T22:21:20.542803] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:20.557086] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:20.557869] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53136 primary records. [2025-09-24T22:21:20.558032] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-24T22:21:20.575004] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-24T22:21:20.575075] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-24T22:21:20.578241] [INFO ] [MAIN ] Derivative Progress: 873/2075 symbols completed. HMY took 1.2s. Estimated remaining: 7m 51s. Rate: 153.2 symbols/min [2025-09-24T22:21:20.578580] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:20.624878] [DEBUG] [LOCAL ] HOMB: Loaded 43638 existing records from primary storage. [2025-09-24T22:21:20.625202] [INFO ] [MAIN ] HOMB: Loaded 43638 primary data records. [2025-09-24T22:21:20.768946] [DEBUG] [LOCAL ] HOG: Loaded 51232 existing records from primary storage. [2025-09-24T22:21:20.770817] [INFO ] [MAIN ] HOG: Loaded 51232 primary data records. [2025-09-24T22:21:20.792492] [DEBUG] [LOCAL ] HOUS: Loaded 44130 existing records from primary storage. [2025-09-24T22:21:20.812039] [INFO ] [MAIN ] HOUS: Loaded 44130 primary data records. [2025-09-24T22:21:21.638130] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:21.639225] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43638 primary records. [2025-09-24T22:21:21.639515] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-24T22:21:21.658302] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-24T22:21:21.660807] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-24T22:21:21.663929] [INFO ] [MAIN ] Derivative Progress: 874/2075 symbols completed. HOMB took 1.1s. Estimated remaining: 7m 51s. Rate: 152.9 symbols/min [2025-09-24T22:21:21.672050] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:21.679494] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:21.693105] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44130 primary records. [2025-09-24T22:21:21.693426] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-24T22:21:21.694442] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:21.695735] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51232 primary records. [2025-09-24T22:21:21.696013] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-24T22:21:21.730025] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-24T22:21:21.732695] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-24T22:21:21.743000] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-24T22:21:21.741357] [INFO ] [MAIN ] Derivative Progress: 875/2075 symbols completed. HOUS took 1.2s. Estimated remaining: 7m 50s. Rate: 153.1 symbols/min [2025-09-24T22:21:21.743191] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-24T22:21:21.741989] [DEBUG] [LOCAL ] HOV: Loaded 13773 existing records from primary storage. [2025-09-24T22:21:21.746395] [INFO ] [MAIN ] HOV: Loaded 13773 primary data records. [2025-09-24T22:21:21.751879] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:21.757993] [INFO ] [MAIN ] Derivative Progress: 876/2075 symbols completed. HOG took 1.2s. Estimated remaining: 7m 49s. Rate: 153.2 symbols/min [2025-09-24T22:21:21.784428] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:22.155209] [DEBUG] [LOCAL ] HP: Loaded 51587 existing records from primary storage. [2025-09-24T22:21:22.155437] [INFO ] [MAIN ] HP: Loaded 51587 primary data records. [2025-09-24T22:21:22.177825] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-24T22:21:22.213845] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-24T22:21:22.416388] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:22.435856] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13773 primary records. [2025-09-24T22:21:22.448096] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-24T22:21:22.693552] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-24T22:21:22.827817] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-24T22:21:22.831337] [INFO ] [MAIN ] Derivative Progress: 877/2075 symbols completed. HOV took 1.2s. Estimated remaining: 7m 50s. Rate: 152.9 symbols/min [2025-09-24T22:21:22.831988] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:22.845126] [DEBUG] [LOCAL ] HPF: Loaded 7289 existing records from primary storage. [2025-09-24T22:21:22.846598] [INFO ] [MAIN ] HPF: Loaded 7289 primary data records. [2025-09-24T22:21:22.990041] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:23.068503] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51587 primary records. [2025-09-24T22:21:23.069403] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-24T22:21:23.069328] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:23.179295] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-24T22:21:23.187955] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-24T22:21:23.214787] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-24T22:21:23.219454] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-24T22:21:23.224825] [INFO ] [MAIN ] Derivative Progress: 878/2075 symbols completed. HP took 1.5s. Estimated remaining: 7m 50s. Rate: 152.9 symbols/min [2025-09-24T22:21:23.227032] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-24T22:21:23.227367] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:23.227486] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-24T22:21:23.230988] [INFO ] [MAIN ] Derivative Progress: 879/2075 symbols completed. HPE took 1.4s. Estimated remaining: 7m 49s. Rate: 153.1 symbols/min [2025-09-24T22:21:23.231449] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:23.245138] [DEBUG] [LOCAL ] HPI: Loaded 10154 existing records from primary storage. [2025-09-24T22:21:23.245537] [INFO ] [MAIN ] HPI: Loaded 10154 primary data records. [2025-09-24T22:21:23.402945] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:23.440460] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7289 primary records. [2025-09-24T22:21:23.475274] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-24T22:21:23.628877] [DEBUG] [LOCAL ] HPP: Loaded 50831 existing records from primary storage. [2025-09-24T22:21:23.629054] [INFO ] [MAIN ] HPP: Loaded 50831 primary data records. [2025-09-24T22:21:23.630837] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-24T22:21:23.631453] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-24T22:21:23.634122] [INFO ] [MAIN ] Derivative Progress: 880/2075 symbols completed. HPF took 0.8s. Estimated remaining: 7m 48s. Rate: 153.1 symbols/min [2025-09-24T22:21:23.646928] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:23.990951] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:23.992942] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10154 primary records. [2025-09-24T22:21:23.993691] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-24T22:21:24.030983] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-24T22:21:24.032546] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-09-24T22:21:24.032277] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-24T22:21:24.044743] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-24T22:21:24.057124] [INFO ] [MAIN ] Derivative Progress: 881/2075 symbols completed. HPI took 0.8s. Estimated remaining: 7m 48s. Rate: 153.1 symbols/min [2025-09-24T22:21:24.080959] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:24.169993] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:24.209444] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50831 primary records. [2025-09-24T22:21:24.222344] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-24T22:21:24.271498] [DEBUG] [LOCAL ] HPS: Loaded 10153 existing records from primary storage. [2025-09-24T22:21:24.406854] [INFO ] [MAIN ] HPS: Loaded 10153 primary data records. [2025-09-24T22:21:24.501208] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-24T22:21:24.520466] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-24T22:21:24.542544] [INFO ] [MAIN ] Derivative Progress: 882/2075 symbols completed. HPP took 1.3s. Estimated remaining: 7m 48s. Rate: 153.0 symbols/min [2025-09-24T22:21:24.547983] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:24.775745] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:24.776550] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-09-24T22:21:24.777030] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-24T22:21:24.800828] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-24T22:21:24.801082] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-24T22:21:24.803724] [INFO ] [MAIN ] Derivative Progress: 883/2075 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 47s. Rate: 153.1 symbols/min [2025-09-24T22:21:24.813590] [DEBUG] [LOCAL ] HQH: Loaded 24925 existing records from primary storage. [2025-09-24T22:21:24.813792] [INFO ] [MAIN ] HQH: Loaded 24925 primary data records. [2025-09-24T22:21:24.999999] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:25.023491] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10153 primary records. [2025-09-24T22:21:25.137611] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-24T22:21:25.170149] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-24T22:21:25.170632] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-24T22:21:25.173902] [INFO ] [MAIN ] Derivative Progress: 884/2075 symbols completed. HPS took 1.1s. Estimated remaining: 7m 47s. Rate: 153.1 symbols/min [2025-09-24T22:21:25.191779] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:25.192479] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 24925 primary records. [2025-09-24T22:21:25.192544] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-24T22:21:25.208422] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-24T22:21:25.208548] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-24T22:21:25.211129] [INFO ] [MAIN ] Derivative Progress: 885/2075 symbols completed. HQH took 0.7s. Estimated remaining: 7m 46s. Rate: 153.3 symbols/min [2025-09-24T22:21:25.212009] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:25.211869] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:25.212727] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:25.231877] [DEBUG] [LOCAL ] HQL: Loaded 15812 existing records from primary storage. [2025-09-24T22:21:25.232466] [INFO ] [MAIN ] HQL: Loaded 15812 primary data records. [2025-09-24T22:21:25.587111] [DEBUG] [LOCAL ] HRB: Loaded 48582 existing records from primary storage. [2025-09-24T22:21:25.588820] [DEBUG] [LOCAL ] HR: Loaded 51962 existing records from primary storage. [2025-09-24T22:21:25.587332] [INFO ] [MAIN ] HRB: Loaded 48582 primary data records. [2025-09-24T22:21:25.589195] [INFO ] [MAIN ] HR: Loaded 51962 primary data records. [2025-09-24T22:21:26.276471] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:26.277934] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 15812 primary records. [2025-09-24T22:21:26.278202] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-24T22:21:26.302953] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-24T22:21:26.316391] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:26.316593] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-24T22:21:26.317338] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48582 primary records. [2025-09-24T22:21:26.320028] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-24T22:21:26.319951] [INFO ] [MAIN ] Derivative Progress: 886/2075 symbols completed. HQL took 1.1s. Estimated remaining: 7m 46s. Rate: 152.9 symbols/min [2025-09-24T22:21:26.329725] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:26.348826] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-24T22:21:26.353678] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-24T22:21:26.355684] [INFO ] [MAIN ] Derivative Progress: 887/2075 symbols completed. HRB took 1.1s. Estimated remaining: 7m 46s. Rate: 153.1 symbols/min [2025-09-24T22:21:26.355952] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:26.356694] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:26.357818] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51962 primary records. [2025-09-24T22:21:26.358020] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-24T22:21:26.375886] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-24T22:21:26.384996] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-24T22:21:26.387578] [INFO ] [MAIN ] Derivative Progress: 888/2075 symbols completed. HR took 1.2s. Estimated remaining: 7m 45s. Rate: 153.3 symbols/min [2025-09-24T22:21:26.388022] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:26.403379] [DEBUG] [LOCAL ] HRI: Loaded 33102 existing records from primary storage. [2025-09-24T22:21:26.403693] [INFO ] [MAIN ] HRI: Loaded 33102 primary data records. [2025-09-24T22:21:26.570709] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-24T22:21:26.587421] [INFO ] [MAIN ] HRL: Loaded 53088 primary data records. [2025-09-24T22:21:26.587250] [DEBUG] [LOCAL ] HRTG: Loaded 33109 existing records from primary storage. [2025-09-24T22:21:26.612096] [INFO ] [MAIN ] HRTG: Loaded 33109 primary data records. [2025-09-24T22:21:27.455434] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:27.456617] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 33102 primary records. [2025-09-24T22:21:27.457032] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-24T22:21:27.493453] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:27.495181] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-24T22:21:27.495392] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-24T22:21:27.498395] [INFO ] [MAIN ] Derivative Progress: 889/2075 symbols completed. HRI took 1.2s. Estimated remaining: 7m 45s. Rate: 152.9 symbols/min [2025-09-24T22:21:27.498799] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:27.499985] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33109 primary records. [2025-09-24T22:21:27.500394] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-24T22:21:27.526928] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:27.528606] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53088 primary records. [2025-09-24T22:21:27.528729] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-24T22:21:27.539322] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-24T22:21:27.543757] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-24T22:21:27.547840] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-24T22:21:27.550470] [INFO ] [MAIN ] Derivative Progress: 890/2075 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 44s. Rate: 153.1 symbols/min [2025-09-24T22:21:27.550749] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-24T22:21:27.553953] [INFO ] [MAIN ] Derivative Progress: 891/2075 symbols completed. HRL took 1.2s. Estimated remaining: 7m 44s. Rate: 153.3 symbols/min [2025-09-24T22:21:27.554399] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:27.554123] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:27.593331] [DEBUG] [LOCAL ] HSHP: Loaded 15569 existing records from primary storage. [2025-09-24T22:21:27.608427] [INFO ] [MAIN ] HSHP: Loaded 15569 primary data records. [2025-09-24T22:21:27.643309] [DEBUG] [LOCAL ] HSBC: Loaded 51123 existing records from primary storage. [2025-09-24T22:21:27.655971] [INFO ] [MAIN ] HSBC: Loaded 51123 primary data records. [2025-09-24T22:21:27.912100] [DEBUG] [LOCAL ] HSY: Loaded 50426 existing records from primary storage. [2025-09-24T22:21:27.948027] [INFO ] [MAIN ] HSY: Loaded 50426 primary data records. [2025-09-24T22:21:28.671103] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:28.672003] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:28.673508] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51123 primary records. [2025-09-24T22:21:28.672760] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15569 primary records. [2025-09-24T22:21:28.673625] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-24T22:21:28.673853] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-24T22:21:28.705347] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-24T22:21:28.708710] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-24T22:21:28.711216] [INFO ] [MAIN ] Derivative Progress: 892/2075 symbols completed. HSHP took 1.2s. Estimated remaining: 7m 44s. Rate: 152.9 symbols/min [2025-09-24T22:21:28.712746] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:28.712544] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-24T22:21:28.713500] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-24T22:21:28.716401] [INFO ] [MAIN ] Derivative Progress: 893/2075 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 43s. Rate: 153.1 symbols/min [2025-09-24T22:21:28.730191] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:28.730071] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:28.731127] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50426 primary records. [2025-09-24T22:21:28.731608] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-24T22:21:28.757767] [DEBUG] [LOCAL ] HTD: Loaded 13524 existing records from primary storage. [2025-09-24T22:21:28.758730] [INFO ] [MAIN ] HTD: Loaded 13524 primary data records. [2025-09-24T22:21:28.809769] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-24T22:21:28.844426] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-24T22:21:28.876903] [INFO ] [MAIN ] Derivative Progress: 894/2075 symbols completed. HSY took 1.3s. Estimated remaining: 7m 43s. Rate: 153.2 symbols/min [2025-09-24T22:21:28.898681] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:29.101842] [DEBUG] [LOCAL ] HTGC: Loaded 47557 existing records from primary storage. [2025-09-24T22:21:29.102682] [INFO ] [MAIN ] HTGC: Loaded 47557 primary data records. [2025-09-24T22:21:29.430103] [DEBUG] [LOCAL ] HTH: Loaded 32387 existing records from primary storage. [2025-09-24T22:21:29.430614] [INFO ] [MAIN ] HTH: Loaded 32387 primary data records. [2025-09-24T22:21:29.630180] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:29.744966] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13524 primary records. [2025-09-24T22:21:29.754447] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-24T22:21:29.775931] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-24T22:21:29.776467] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-24T22:21:29.779129] [INFO ] [MAIN ] Derivative Progress: 895/2075 symbols completed. HTD took 1.1s. Estimated remaining: 7m 43s. Rate: 153.0 symbols/min [2025-09-24T22:21:29.779854] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:29.799689] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:29.800758] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47557 primary records. [2025-09-24T22:21:29.800991] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-24T22:21:29.820600] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-24T22:21:29.821072] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-24T22:21:29.823499] [INFO ] [MAIN ] Derivative Progress: 896/2075 symbols completed. HTGC took 1.1s. Estimated remaining: 7m 42s. Rate: 153.1 symbols/min [2025-09-24T22:21:29.831386] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:29.846392] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:29.847184] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32387 primary records. [2025-09-24T22:21:29.847306] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-24T22:21:29.874965] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-24T22:21:29.875086] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-24T22:21:29.875930] [DEBUG] [LOCAL ] HUBB: Loaded 37168 existing records from primary storage. [2025-09-24T22:21:29.878590] [INFO ] [MAIN ] Derivative Progress: 897/2075 symbols completed. HTH took 1.0s. Estimated remaining: 7m 41s. Rate: 153.3 symbols/min [2025-09-24T22:21:29.879073] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:29.879286] [INFO ] [MAIN ] HUBB: Loaded 37168 primary data records. [2025-09-24T22:21:30.211956] [DEBUG] [LOCAL ] HUBS: Loaded 39485 existing records from primary storage. [2025-09-24T22:21:30.212373] [INFO ] [MAIN ] HUBS: Loaded 39485 primary data records. [2025-09-24T22:21:30.361231] [DEBUG] [LOCAL ] HUM: Loaded 48864 existing records from primary storage. [2025-09-24T22:21:30.362280] [INFO ] [MAIN ] HUM: Loaded 48864 primary data records. [2025-09-24T22:21:30.950877] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:30.952516] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 37168 primary records. [2025-09-24T22:21:30.952841] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-24T22:21:30.971781] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-24T22:21:30.972070] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-24T22:21:30.975104] [INFO ] [MAIN ] Derivative Progress: 898/2075 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 42s. Rate: 153.0 symbols/min [2025-09-24T22:21:30.993692] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:30.994398] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39485 primary records. [2025-09-24T22:21:30.994550] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-24T22:21:31.013260] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-24T22:21:31.013457] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-24T22:21:31.015936] [INFO ] [MAIN ] Derivative Progress: 899/2075 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 41s. Rate: 153.1 symbols/min [2025-09-24T22:21:31.028557] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:31.029165] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48864 primary records. [2025-09-24T22:21:31.029227] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-24T22:21:31.045116] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-24T22:21:31.045185] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-24T22:21:31.048040] [INFO ] [MAIN ] Derivative Progress: 900/2075 symbols completed. HUM took 1.2s. Estimated remaining: 7m 40s. Rate: 153.3 symbols/min [2025-09-24T22:21:31.048610] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:31.048851] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:31.049001] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:31.075086] [DEBUG] [LOCAL ] HVT: Loaded 16003 existing records from primary storage. [2025-09-24T22:21:31.084874] [INFO ] [MAIN ] HVT: Loaded 16003 primary data records. [2025-09-24T22:21:31.228370] [DEBUG] [LOCAL ] HUYA: Loaded 44413 existing records from primary storage. [2025-09-24T22:21:31.239419] [INFO ] [MAIN ] HUYA: Loaded 44413 primary data records. [2025-09-24T22:21:31.533945] [DEBUG] [LOCAL ] HUN: Loaded 53196 existing records from primary storage. [2025-09-24T22:21:31.569710] [INFO ] [MAIN ] HUN: Loaded 53196 primary data records. [2025-09-24T22:21:32.108121] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:32.109265] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 16003 primary records. [2025-09-24T22:21:32.111348] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-24T22:21:32.140451] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:32.143882] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44413 primary records. [2025-09-24T22:21:32.144513] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-24T22:21:32.146289] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-24T22:21:32.146670] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-24T22:21:32.156968] [INFO ] [MAIN ] Derivative Progress: 901/2075 symbols completed. HVT took 1.1s. Estimated remaining: 7m 41s. Rate: 153.0 symbols/min [2025-09-24T22:21:32.163816] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:32.165857] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-24T22:21:32.166241] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-24T22:21:32.168884] [INFO ] [MAIN ] Derivative Progress: 902/2075 symbols completed. HUYA took 1.1s. Estimated remaining: 7m 40s. Rate: 153.1 symbols/min [2025-09-24T22:21:32.169259] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:32.186454] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:32.187246] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53196 primary records. [2025-09-24T22:21:32.187360] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-24T22:21:32.205121] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-24T22:21:32.205278] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-24T22:21:32.207899] [INFO ] [MAIN ] Derivative Progress: 903/2075 symbols completed. HUN took 1.2s. Estimated remaining: 7m 39s. Rate: 153.3 symbols/min [2025-09-24T22:21:32.208335] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:32.245191] [DEBUG] [LOCAL ] HY: Loaded 10087 existing records from primary storage. [2025-09-24T22:21:32.245353] [INFO ] [MAIN ] HY: Loaded 10087 primary data records. [2025-09-24T22:21:32.379416] [DEBUG] [LOCAL ] HXL: Loaded 45976 existing records from primary storage. [2025-09-24T22:21:32.385188] [INFO ] [MAIN ] HXL: Loaded 45976 primary data records. [2025-09-24T22:21:32.407189] [DEBUG] [LOCAL ] HWM: Loaded 53011 existing records from primary storage. [2025-09-24T22:21:32.483176] [INFO ] [MAIN ] HWM: Loaded 53011 primary data records. [2025-09-24T22:21:33.267993] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:33.268943] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10087 primary records. [2025-09-24T22:21:33.269108] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-24T22:21:33.298575] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:33.299670] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45976 primary records. [2025-09-24T22:21:33.300066] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-24T22:21:33.322465] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-24T22:21:33.330702] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-24T22:21:33.332987] [INFO ] [MAIN ] Derivative Progress: 904/2075 symbols completed. HY took 1.1s. Estimated remaining: 7m 39s. Rate: 153.0 symbols/min [2025-09-24T22:21:33.337805] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-24T22:21:33.339016] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:33.339881] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 53011 primary records. [2025-09-24T22:21:33.338723] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-24T22:21:33.339143] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:33.342752] [INFO ] [MAIN ] Derivative Progress: 905/2075 symbols completed. HXL took 1.2s. Estimated remaining: 7m 38s. Rate: 153.1 symbols/min [2025-09-24T22:21:33.343090] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:33.340034] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-24T22:21:33.368840] [DEBUG] [LOCAL ] HYI: Loaded 8938 existing records from primary storage. [2025-09-24T22:21:33.369763] [INFO ] [MAIN ] HYI: Loaded 8938 primary data records. [2025-09-24T22:21:33.402319] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-24T22:21:33.402454] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-24T22:21:33.410612] [INFO ] [MAIN ] Derivative Progress: 906/2075 symbols completed. HWM took 1.2s. Estimated remaining: 7m 38s. Rate: 153.3 symbols/min [2025-09-24T22:21:33.452999] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:33.578523] [DEBUG] [LOCAL ] HYTR: Loaded 3166 existing records from primary storage. [2025-09-24T22:21:33.701725] [INFO ] [MAIN ] HYTR: Loaded 3166 primary data records. [2025-09-24T22:21:33.703783] [DEBUG] [LOCAL ] HYT: Loaded 33293 existing records from primary storage. [2025-09-24T22:21:33.737174] [INFO ] [MAIN ] HYT: Loaded 33293 primary data records. [2025-09-24T22:21:34.404174] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:34.406346] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 8938 primary records. [2025-09-24T22:21:34.406586] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-24T22:21:34.427247] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-24T22:21:34.428247] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-24T22:21:34.432372] [INFO ] [MAIN ] Derivative Progress: 907/2075 symbols completed. HYI took 1.1s. Estimated remaining: 7m 38s. Rate: 153.0 symbols/min [2025-09-24T22:21:34.433245] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:34.447224] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7731 incomplete bins [2025-09-24T22:21:34.447977] [INFO ] [MAIN ] HYTR: Generated 1787 derivative records from 3166 primary records. [2025-09-24T22:21:34.448185] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-24T22:21:34.478965] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1787 records). [2025-09-24T22:21:34.479712] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-24T22:21:34.482244] [INFO ] [MAIN ] Derivative Progress: 908/2075 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 37s. Rate: 153.1 symbols/min [2025-09-24T22:21:34.482565] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:34.479628] [DEBUG] [MAIN ] HYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:34.483904] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33293 primary records. [2025-09-24T22:21:34.493188] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-24T22:21:34.521387] [DEBUG] [LOCAL ] IAE: Loaded 5981 existing records from primary storage. [2025-09-24T22:21:34.524490] [INFO ] [MAIN ] IAE: Loaded 5981 primary data records. [2025-09-24T22:21:34.537303] [DEBUG] [LOCAL ] HZO: Loaded 29309 existing records from primary storage. [2025-09-24T22:21:34.547612] [INFO ] [MAIN ] HZO: Loaded 29309 primary data records. [2025-09-24T22:21:34.558333] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-24T22:21:34.558454] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-24T22:21:34.623324] [INFO ] [MAIN ] Derivative Progress: 909/2075 symbols completed. HYT took 1.3s. Estimated remaining: 7m 37s. Rate: 153.3 symbols/min [2025-09-24T22:21:34.665698] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:35.205193] [DEBUG] [LOCAL ] IAG: Loaded 53445 existing records from primary storage. [2025-09-24T22:21:35.205945] [INFO ] [MAIN ] IAG: Loaded 53445 primary data records. [2025-09-24T22:21:35.206477] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:35.207332] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 5981 primary records. [2025-09-24T22:21:35.212725] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-24T22:21:35.359490] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:35.366104] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29309 primary records. [2025-09-24T22:21:35.376729] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-24T22:21:35.410359] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-24T22:21:35.438607] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-24T22:21:35.449932] [INFO ] [MAIN ] Derivative Progress: 910/2075 symbols completed. IAE took 1.0s. Estimated remaining: 7m 37s. Rate: 153.1 symbols/min [2025-09-24T22:21:35.563021] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:35.564155] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-24T22:21:35.572684] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-24T22:21:35.576445] [INFO ] [MAIN ] Derivative Progress: 911/2075 symbols completed. HZO took 1.1s. Estimated remaining: 7m 36s. Rate: 153.2 symbols/min [2025-09-24T22:21:35.577478] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:35.638589] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:35.653569] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53445 primary records. [2025-09-24T22:21:35.653893] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-24T22:21:35.700424] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-24T22:21:35.701260] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-24T22:21:35.702607] [DEBUG] [LOCAL ] IBM: Loaded 53636 existing records from primary storage. [2025-09-24T22:21:35.704872] [INFO ] [MAIN ] Derivative Progress: 912/2075 symbols completed. IAG took 1.0s. Estimated remaining: 7m 35s. Rate: 153.3 symbols/min [2025-09-24T22:21:35.718752] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:35.705146] [INFO ] [MAIN ] IBM: Loaded 53636 primary data records. [2025-09-24T22:21:35.726245] [DEBUG] [LOCAL ] IBN: Loaded 52894 existing records from primary storage. [2025-09-24T22:21:35.744703] [INFO ] [MAIN ] IBN: Loaded 52894 primary data records. [2025-09-24T22:21:36.239671] [DEBUG] [LOCAL ] IBP: Loaded 29270 existing records from primary storage. [2025-09-24T22:21:36.408278] [INFO ] [MAIN ] IBP: Loaded 29270 primary data records. [2025-09-24T22:21:36.753443] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:36.754732] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52894 primary records. [2025-09-24T22:21:36.754865] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-24T22:21:36.775376] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:36.777584] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53636 primary records. [2025-09-24T22:21:36.781821] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-24T22:21:36.801547] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-24T22:21:36.802521] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-24T22:21:36.801787] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-24T22:21:36.804447] [INFO ] [MAIN ] Derivative Progress: 913/2075 symbols completed. IBM took 1.2s. Estimated remaining: 7m 36s. Rate: 153.0 symbols/min [2025-09-24T22:21:36.804731] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-24T22:21:36.806984] [INFO ] [MAIN ] Derivative Progress: 914/2075 symbols completed. IBN took 1.2s. Estimated remaining: 7m 35s. Rate: 153.2 symbols/min [2025-09-24T22:21:36.822740] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:36.823282] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29270 primary records. [2025-09-24T22:21:36.823342] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-24T22:21:36.838831] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-24T22:21:36.838902] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-24T22:21:36.841231] [INFO ] [MAIN ] Derivative Progress: 915/2075 symbols completed. IBP took 1.1s. Estimated remaining: 7m 34s. Rate: 153.3 symbols/min [2025-09-24T22:21:36.841898] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:36.841838] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:36.842086] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:36.899400] [DEBUG] [LOCAL ] IBTA: Loaded 37926 existing records from primary storage. [2025-09-24T22:21:36.914630] [DEBUG] [LOCAL ] ICL: Loaded 38635 existing records from primary storage. [2025-09-24T22:21:36.914013] [INFO ] [MAIN ] IBTA: Loaded 37926 primary data records. [2025-09-24T22:21:36.914919] [INFO ] [MAIN ] ICL: Loaded 38635 primary data records. [2025-09-24T22:21:37.119124] [DEBUG] [LOCAL ] ICE: Loaded 53025 existing records from primary storage. [2025-09-24T22:21:37.141526] [INFO ] [MAIN ] ICE: Loaded 53025 primary data records. [2025-09-24T22:21:37.907975] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:37.909546] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37926 primary records. [2025-09-24T22:21:37.910102] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-24T22:21:37.910007] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:37.918371] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38635 primary records. [2025-09-24T22:21:37.923341] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-24T22:21:37.924582] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:37.932499] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53025 primary records. [2025-09-24T22:21:37.934334] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-24T22:21:37.969416] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-24T22:21:37.970760] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-24T22:21:37.971402] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-24T22:21:37.971107] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-24T22:21:37.973892] [INFO ] [MAIN ] Derivative Progress: 916/2075 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 35s. Rate: 153.0 symbols/min [2025-09-24T22:21:37.976092] [INFO ] [MAIN ] Derivative Progress: 917/2075 symbols completed. ICL took 1.1s. Estimated remaining: 7m 34s. Rate: 153.2 symbols/min [2025-09-24T22:21:37.976348] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:37.976433] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:37.979007] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-24T22:21:37.979371] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-24T22:21:37.981901] [INFO ] [MAIN ] Derivative Progress: 918/2075 symbols completed. ICE took 1.1s. Estimated remaining: 7m 33s. Rate: 153.3 symbols/min [2025-09-24T22:21:37.982300] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:38.000007] [DEBUG] [LOCAL ] IDE: Loaded 8581 existing records from primary storage. [2025-09-24T22:21:38.000222] [INFO ] [MAIN ] IDE: Loaded 8581 primary data records. [2025-09-24T22:21:38.051419] [DEBUG] [LOCAL ] IDT: Loaded 17671 existing records from primary storage. [2025-09-24T22:21:38.074019] [INFO ] [MAIN ] IDT: Loaded 17671 primary data records. [2025-09-24T22:21:38.318161] [DEBUG] [LOCAL ] IDA: Loaded 31989 existing records from primary storage. [2025-09-24T22:21:38.345043] [INFO ] [MAIN ] IDA: Loaded 31989 primary data records. [2025-09-24T22:21:39.029484] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:39.030394] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8581 primary records. [2025-09-24T22:21:39.030572] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-24T22:21:39.063520] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:39.065093] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17671 primary records. [2025-09-24T22:21:39.065304] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-24T22:21:39.065611] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-24T22:21:39.066782] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-24T22:21:39.075801] [INFO ] [MAIN ] Derivative Progress: 919/2075 symbols completed. IDE took 1.1s. Estimated remaining: 7m 33s. Rate: 153.0 symbols/min [2025-09-24T22:21:39.076699] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:39.086506] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-24T22:21:39.087772] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-24T22:21:39.091129] [INFO ] [MAIN ] Derivative Progress: 920/2075 symbols completed. IDT took 1.1s. Estimated remaining: 7m 32s. Rate: 153.2 symbols/min [2025-09-24T22:21:39.092322] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:39.106400] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:39.107109] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 31989 primary records. [2025-09-24T22:21:39.107181] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-24T22:21:39.126922] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-24T22:21:39.127202] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-24T22:21:39.129803] [INFO ] [MAIN ] Derivative Progress: 921/2075 symbols completed. IDA took 1.2s. Estimated remaining: 7m 32s. Rate: 153.3 symbols/min [2025-09-24T22:21:39.130161] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:39.159120] [DEBUG] [LOCAL ] IFN: Loaded 18198 existing records from primary storage. [2025-09-24T22:21:39.159345] [INFO ] [MAIN ] IFN: Loaded 18198 primary data records. [2025-09-24T22:21:39.284745] [DEBUG] [LOCAL ] IEX: Loaded 38371 existing records from primary storage. [2025-09-24T22:21:39.314478] [INFO ] [MAIN ] IEX: Loaded 38371 primary data records. [2025-09-24T22:21:39.326008] [DEBUG] [LOCAL ] IFF: Loaded 50966 existing records from primary storage. [2025-09-24T22:21:39.347485] [INFO ] [MAIN ] IFF: Loaded 50966 primary data records. [2025-09-24T22:21:40.158321] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:40.159913] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18198 primary records. [2025-09-24T22:21:40.161115] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-24T22:21:40.180449] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-24T22:21:40.180805] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-24T22:21:40.182903] [INFO ] [MAIN ] Derivative Progress: 922/2075 symbols completed. IFN took 1.1s. Estimated remaining: 7m 32s. Rate: 153.1 symbols/min [2025-09-24T22:21:40.199672] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:40.197757] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:40.200820] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38371 primary records. [2025-09-24T22:21:40.201404] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-24T22:21:40.228951] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:40.230740] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50966 primary records. [2025-09-24T22:21:40.231861] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-24T22:21:40.257877] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-24T22:21:40.258360] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-24T22:21:40.260971] [INFO ] [MAIN ] Derivative Progress: 923/2075 symbols completed. IEX took 1.2s. Estimated remaining: 7m 31s. Rate: 153.2 symbols/min [2025-09-24T22:21:40.262906] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:40.278683] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-24T22:21:40.281916] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-24T22:21:40.286168] [INFO ] [MAIN ] Derivative Progress: 924/2075 symbols completed. IFF took 1.2s. Estimated remaining: 7m 30s. Rate: 153.3 symbols/min [2025-09-24T22:21:40.287586] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:40.287232] [DEBUG] [LOCAL ] IFS: Loaded 23056 existing records from primary storage. [2025-09-24T22:21:40.287938] [INFO ] [MAIN ] IFS: Loaded 23056 primary data records. [2025-09-24T22:21:40.298733] [DEBUG] [LOCAL ] IGA: Loaded 9680 existing records from primary storage. [2025-09-24T22:21:40.312731] [INFO ] [MAIN ] IGA: Loaded 9680 primary data records. [2025-09-24T22:21:40.527896] [DEBUG] [LOCAL ] IGD: Loaded 18929 existing records from primary storage. [2025-09-24T22:21:40.541067] [INFO ] [MAIN ] IGD: Loaded 18929 primary data records. [2025-09-24T22:21:41.319062] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:41.320388] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9680 primary records. [2025-09-24T22:21:41.322188] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-24T22:21:41.337012] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:41.349227] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 23056 primary records. [2025-09-24T22:21:41.352741] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-24T22:21:41.352923] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-24T22:21:41.352995] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-24T22:21:41.367464] [INFO ] [MAIN ] Derivative Progress: 925/2075 symbols completed. IGA took 1.1s. Estimated remaining: 7m 31s. Rate: 153.0 symbols/min [2025-09-24T22:21:41.369214] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:41.368849] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:41.370050] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 18929 primary records. [2025-09-24T22:21:41.370153] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-24T22:21:41.403289] [DEBUG] [LOCAL ] IGI: Loaded 3677 existing records from primary storage. [2025-09-24T22:21:41.403637] [INFO ] [MAIN ] IGI: Loaded 3677 primary data records. [2025-09-24T22:21:41.410674] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-24T22:21:41.418074] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-24T22:21:41.430321] [INFO ] [MAIN ] Derivative Progress: 926/2075 symbols completed. IFS took 1.2s. Estimated remaining: 7m 30s. Rate: 153.2 symbols/min [2025-09-24T22:21:41.465277] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:41.511279] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-24T22:21:41.514525] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-24T22:21:41.517348] [INFO ] [MAIN ] Derivative Progress: 927/2075 symbols completed. IGD took 1.2s. Estimated remaining: 7m 29s. Rate: 153.3 symbols/min [2025-09-24T22:21:41.523567] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:41.727540] [DEBUG] [LOCAL ] IH: Loaded 3416 existing records from primary storage. [2025-09-24T22:21:41.728316] [INFO ] [MAIN ] IH: Loaded 3416 primary data records. [2025-09-24T22:21:41.814020] [DEBUG] [LOCAL ] IGR: Loaded 30512 existing records from primary storage. [2025-09-24T22:21:41.846555] [INFO ] [MAIN ] IGR: Loaded 30512 primary data records. [2025-09-24T22:21:42.440208] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:42.442052] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3677 primary records. [2025-09-24T22:21:42.442371] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-24T22:21:42.460283] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-24T22:21:42.460925] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-24T22:21:42.463239] [INFO ] [MAIN ] Derivative Progress: 928/2075 symbols completed. IGI took 1.1s. Estimated remaining: 7m 30s. Rate: 153.1 symbols/min [2025-09-24T22:21:42.480377] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:42.481086] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3416 primary records. [2025-09-24T22:21:42.481233] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-24T22:21:42.497448] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-24T22:21:42.497613] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-24T22:21:42.499900] [INFO ] [MAIN ] Derivative Progress: 929/2075 symbols completed. IH took 1.0s. Estimated remaining: 7m 29s. Rate: 153.2 symbols/min [2025-09-24T22:21:42.512300] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:42.513048] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30512 primary records. [2025-09-24T22:21:42.513110] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-24T22:21:42.528116] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-24T22:21:42.528180] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-24T22:21:42.530967] [INFO ] [MAIN ] Derivative Progress: 930/2075 symbols completed. IGR took 1.1s. Estimated remaining: 7m 28s. Rate: 153.4 symbols/min [2025-09-24T22:21:42.531770] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:42.531615] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:42.531943] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:42.544222] [DEBUG] [LOCAL ] IHD: Loaded 7151 existing records from primary storage. [2025-09-24T22:21:42.544402] [INFO ] [MAIN ] IHD: Loaded 7151 primary data records. [2025-09-24T22:21:42.775340] [DEBUG] [LOCAL ] IHG: Loaded 24600 existing records from primary storage. [2025-09-24T22:21:42.776153] [DEBUG] [LOCAL ] IHS: Loaded 39058 existing records from primary storage. [2025-09-24T22:21:42.776392] [INFO ] [MAIN ] IHS: Loaded 39058 primary data records. [2025-09-24T22:21:42.776475] [INFO ] [MAIN ] IHG: Loaded 24600 primary data records. [2025-09-24T22:21:43.534150] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:43.535170] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7151 primary records. [2025-09-24T22:21:43.535626] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-24T22:21:43.551800] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-24T22:21:43.554735] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-24T22:21:43.557199] [INFO ] [MAIN ] Derivative Progress: 931/2075 symbols completed. IHD took 1.0s. Estimated remaining: 7m 28s. Rate: 153.1 symbols/min [2025-09-24T22:21:43.557787] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:43.573400] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:43.574390] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39058 primary records. [2025-09-24T22:21:43.582411] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-24T22:21:43.590003] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:43.598051] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24600 primary records. [2025-09-24T22:21:43.601998] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-24T22:21:43.607828] [DEBUG] [LOCAL ] IIF: Loaded 5750 existing records from primary storage. [2025-09-24T22:21:43.608390] [INFO ] [MAIN ] IIF: Loaded 5750 primary data records. [2025-09-24T22:21:43.659058] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-24T22:21:43.670422] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-24T22:21:43.678839] [INFO ] [MAIN ] Derivative Progress: 932/2075 symbols completed. IHS took 1.1s. Estimated remaining: 7m 28s. Rate: 153.2 symbols/min [2025-09-24T22:21:43.692737] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:43.705961] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-24T22:21:43.706177] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-24T22:21:43.714158] [INFO ] [MAIN ] Derivative Progress: 933/2075 symbols completed. IHG took 1.2s. Estimated remaining: 7m 27s. Rate: 153.4 symbols/min [2025-09-24T22:21:43.731756] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:43.972587] [DEBUG] [LOCAL ] IIIN: Loaded 16693 existing records from primary storage. [2025-09-24T22:21:43.972850] [INFO ] [MAIN ] IIIN: Loaded 16693 primary data records. [2025-09-24T22:21:44.047022] [DEBUG] [LOCAL ] IIM: Loaded 15907 existing records from primary storage. [2025-09-24T22:21:44.076303] [INFO ] [MAIN ] IIM: Loaded 15907 primary data records. [2025-09-24T22:21:44.660089] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:44.661555] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5750 primary records. [2025-09-24T22:21:44.661709] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-24T22:21:44.681442] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-24T22:21:44.681917] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-24T22:21:44.684603] [INFO ] [MAIN ] Derivative Progress: 934/2075 symbols completed. IIF took 1.1s. Estimated remaining: 7m 27s. Rate: 153.1 symbols/min [2025-09-24T22:21:44.685580] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:44.705391] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:44.706434] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16693 primary records. [2025-09-24T22:21:44.706540] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-24T22:21:44.724945] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-24T22:21:44.733965] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-24T22:21:44.737253] [INFO ] [MAIN ] Derivative Progress: 935/2075 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 26s. Rate: 153.3 symbols/min [2025-09-24T22:21:44.737987] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:44.764931] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:44.765854] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15907 primary records. [2025-09-24T22:21:44.766419] [DEBUG] [LOCAL ] IIPR: Loaded 29633 existing records from primary storage. [2025-09-24T22:21:44.766821] [INFO ] [MAIN ] IIPR: Loaded 29633 primary data records. [2025-09-24T22:21:44.766742] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-24T22:21:44.895168] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-24T22:21:44.895684] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-24T22:21:44.903439] [INFO ] [MAIN ] Derivative Progress: 936/2075 symbols completed. IIM took 1.2s. Estimated remaining: 7m 26s. Rate: 153.4 symbols/min [2025-09-24T22:21:44.924995] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:45.126262] [DEBUG] [LOCAL ] IMAX: Loaded 42759 existing records from primary storage. [2025-09-24T22:21:45.126599] [INFO ] [MAIN ] IMAX: Loaded 42759 primary data records. [2025-09-24T22:21:45.472764] [DEBUG] [LOCAL ] INFA: Loaded 49983 existing records from primary storage. [2025-09-24T22:21:45.473791] [INFO ] [MAIN ] INFA: Loaded 49983 primary data records. [2025-09-24T22:21:45.595046] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:45.616829] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29633 primary records. [2025-09-24T22:21:45.638252] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-24T22:21:45.818899] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-24T22:21:45.819674] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-24T22:21:45.822103] [INFO ] [MAIN ] Derivative Progress: 937/2075 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 26s. Rate: 153.2 symbols/min [2025-09-24T22:21:45.822514] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:45.837466] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:45.838440] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42759 primary records. [2025-09-24T22:21:45.838932] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-24T22:21:45.858768] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-24T22:21:45.859207] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-24T22:21:45.862328] [INFO ] [MAIN ] Derivative Progress: 938/2075 symbols completed. IMAX took 1.1s. Estimated remaining: 7m 25s. Rate: 153.3 symbols/min [2025-09-24T22:21:45.862902] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:45.879284] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:45.880075] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49983 primary records. [2025-09-24T22:21:45.880179] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-24T22:21:45.910463] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-24T22:21:45.911013] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-24T22:21:45.913328] [INFO ] [MAIN ] Derivative Progress: 939/2075 symbols completed. INFA took 1.0s. Estimated remaining: 7m 24s. Rate: 153.4 symbols/min [2025-09-24T22:21:45.913799] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:45.948217] [DEBUG] [LOCAL ] INFY: Loaded 53600 existing records from primary storage. [2025-09-24T22:21:45.948485] [INFO ] [MAIN ] INFY: Loaded 53600 primary data records. [2025-09-24T22:21:46.078249] [DEBUG] [LOCAL ] ING: Loaded 50795 existing records from primary storage. [2025-09-24T22:21:46.096043] [INFO ] [MAIN ] ING: Loaded 50795 primary data records. [2025-09-24T22:21:46.117073] [DEBUG] [LOCAL ] INGM: Loaded 28712 existing records from primary storage. [2025-09-24T22:21:46.117253] [INFO ] [MAIN ] INGM: Loaded 28712 primary data records. [2025-09-24T22:21:46.957397] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:46.958698] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53600 primary records. [2025-09-24T22:21:46.958929] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-24T22:21:46.978523] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-24T22:21:46.991272] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-24T22:21:46.993779] [INFO ] [MAIN ] Derivative Progress: 940/2075 symbols completed. INFY took 1.2s. Estimated remaining: 7m 25s. Rate: 153.2 symbols/min [2025-09-24T22:21:46.994049] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:46.994809] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:46.995539] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50795 primary records. [2025-09-24T22:21:46.996303] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-24T22:21:47.025475] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:47.026785] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28712 primary records. [2025-09-24T22:21:47.027144] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-24T22:21:47.053898] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-24T22:21:47.054196] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-24T22:21:47.057337] [INFO ] [MAIN ] Derivative Progress: 941/2075 symbols completed. INGM took 1.1s. Estimated remaining: 7m 24s. Rate: 153.3 symbols/min [2025-09-24T22:21:47.045111] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-24T22:21:47.057906] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:47.057675] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-24T22:21:47.060581] [INFO ] [MAIN ] Derivative Progress: 942/2075 symbols completed. ING took 1.2s. Estimated remaining: 7m 23s. Rate: 153.5 symbols/min [2025-09-24T22:21:47.061165] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:47.077794] [DEBUG] [LOCAL ] INGR: Loaded 33328 existing records from primary storage. [2025-09-24T22:21:47.078082] [INFO ] [MAIN ] INGR: Loaded 33328 primary data records. [2025-09-24T22:21:47.425009] [DEBUG] [LOCAL ] INSP: Loaded 36853 existing records from primary storage. [2025-09-24T22:21:47.425849] [INFO ] [MAIN ] INSP: Loaded 36853 primary data records. [2025-09-24T22:21:47.426453] [DEBUG] [LOCAL ] INN: Loaded 41927 existing records from primary storage. [2025-09-24T22:21:47.426610] [INFO ] [MAIN ] INN: Loaded 41927 primary data records. [2025-09-24T22:21:48.073296] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:48.074587] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33328 primary records. [2025-09-24T22:21:48.074802] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-24T22:21:48.094802] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-24T22:21:48.095681] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-24T22:21:48.098384] [INFO ] [MAIN ] Derivative Progress: 943/2075 symbols completed. INGR took 1.1s. Estimated remaining: 7m 23s. Rate: 153.2 symbols/min [2025-09-24T22:21:48.135203] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:48.137233] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36853 primary records. [2025-09-24T22:21:48.136289] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:48.137937] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41927 primary records. [2025-09-24T22:21:48.138026] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-24T22:21:48.138107] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-24T22:21:48.172464] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-24T22:21:48.173374] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-24T22:21:48.176249] [INFO ] [MAIN ] Derivative Progress: 944/2075 symbols completed. INN took 1.1s. Estimated remaining: 7m 23s. Rate: 153.3 symbols/min [2025-09-24T22:21:48.177800] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-24T22:21:48.178034] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-24T22:21:48.180492] [INFO ] [MAIN ] Derivative Progress: 945/2075 symbols completed. INSP took 1.1s. Estimated remaining: 7m 22s. Rate: 153.5 symbols/min [2025-09-24T22:21:48.181132] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:48.181264] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:48.181398] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:48.249588] [DEBUG] [LOCAL ] INVX: Loaded 28856 existing records from primary storage. [2025-09-24T22:21:48.249965] [INFO ] [MAIN ] INVX: Loaded 28856 primary data records. [2025-09-24T22:21:48.382948] [DEBUG] [LOCAL ] INSW: Loaded 40298 existing records from primary storage. [2025-09-24T22:21:48.383143] [INFO ] [MAIN ] INSW: Loaded 40298 primary data records. [2025-09-24T22:21:48.382177] [DEBUG] [LOCAL ] INVH: Loaded 53141 existing records from primary storage. [2025-09-24T22:21:48.458502] [INFO ] [MAIN ] INVH: Loaded 53141 primary data records. [2025-09-24T22:21:49.617360] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:49.618736] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 28856 primary records. [2025-09-24T22:21:49.619069] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-24T22:21:49.641191] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-24T22:21:49.642464] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-24T22:21:49.644944] [INFO ] [MAIN ] Derivative Progress: 946/2075 symbols completed. INVX took 1.5s. Estimated remaining: 7m 23s. Rate: 153.0 symbols/min [2025-09-24T22:21:49.646699] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:49.664684] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:49.678710] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40298 primary records. [2025-09-24T22:21:49.679122] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:49.679975] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53141 primary records. [2025-09-24T22:21:49.680196] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-24T22:21:49.680287] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-24T22:21:49.711699] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-24T22:21:49.713849] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-24T22:21:49.719530] [INFO ] [MAIN ] Derivative Progress: 947/2075 symbols completed. INSW took 1.5s. Estimated remaining: 7m 22s. Rate: 153.2 symbols/min [2025-09-24T22:21:49.719713] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-09-24T22:21:49.719988] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:49.720243] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-24T22:21:49.723736] [INFO ] [MAIN ] Derivative Progress: 948/2075 symbols completed. INVH took 1.5s. Estimated remaining: 7m 21s. Rate: 153.3 symbols/min [2025-09-24T22:21:49.724281] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:49.790838] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-24T22:21:49.805098] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-24T22:21:49.888762] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-24T22:21:49.912314] [INFO ] [MAIN ] IOT: Loaded 53470 primary data records. [2025-09-24T22:21:50.011255] [DEBUG] [LOCAL ] IP: Loaded 53315 existing records from primary storage. [2025-09-24T22:21:50.074209] [INFO ] [MAIN ] IP: Loaded 53315 primary data records. [2025-09-24T22:21:50.888697] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:50.890993] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-24T22:21:50.891112] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-24T22:21:50.919950] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:50.921339] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53470 primary records. [2025-09-24T22:21:50.921510] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-24T22:21:50.938102] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-24T22:21:50.938604] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-24T22:21:50.942065] [INFO ] [MAIN ] Derivative Progress: 949/2075 symbols completed. IONQ took 1.3s. Estimated remaining: 7m 22s. Rate: 153.0 symbols/min [2025-09-24T22:21:50.942878] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:50.957913] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:50.959169] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53315 primary records. [2025-09-24T22:21:50.959434] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-24T22:21:50.961048] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-24T22:21:50.961405] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-24T22:21:50.963986] [INFO ] [MAIN ] Derivative Progress: 950/2075 symbols completed. IOT took 1.2s. Estimated remaining: 7m 21s. Rate: 153.1 symbols/min [2025-09-24T22:21:50.964416] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:50.983092] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-24T22:21:50.983294] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-24T22:21:50.986271] [INFO ] [MAIN ] Derivative Progress: 951/2075 symbols completed. IP took 1.3s. Estimated remaining: 7m 20s. Rate: 153.3 symbols/min [2025-09-24T22:21:50.986740] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:51.010851] [DEBUG] [LOCAL ] IPI: Loaded 21297 existing records from primary storage. [2025-09-24T22:21:51.011106] [INFO ] [MAIN ] IPI: Loaded 21297 primary data records. [2025-09-24T22:21:51.115882] [DEBUG] [LOCAL ] IQI: Loaded 17974 existing records from primary storage. [2025-09-24T22:21:51.154481] [INFO ] [MAIN ] IQI: Loaded 17974 primary data records. [2025-09-24T22:21:51.198583] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-09-24T22:21:51.214253] [INFO ] [MAIN ] IPG: Loaded 53331 primary data records. [2025-09-24T22:21:52.017317] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:52.018371] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21297 primary records. [2025-09-24T22:21:52.018571] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-24T22:21:52.043227] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-24T22:21:52.073877] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:52.074001] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-24T22:21:52.077974] [INFO ] [MAIN ] Derivative Progress: 952/2075 symbols completed. IPI took 1.1s. Estimated remaining: 7m 20s. Rate: 153.0 symbols/min [2025-09-24T22:21:52.078692] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:52.079755] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17974 primary records. [2025-09-24T22:21:52.078826] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:52.080539] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53331 primary records. [2025-09-24T22:21:52.080800] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-24T22:21:52.080891] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-24T22:21:52.112042] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-24T22:21:52.113145] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-24T22:21:52.118278] [INFO ] [MAIN ] Derivative Progress: 953/2075 symbols completed. IQI took 1.1s. Estimated remaining: 7m 20s. Rate: 153.1 symbols/min [2025-09-24T22:21:52.119255] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:52.131132] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-24T22:21:52.131362] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-24T22:21:52.134308] [INFO ] [MAIN ] Derivative Progress: 954/2075 symbols completed. IPG took 1.2s. Estimated remaining: 7m 19s. Rate: 153.3 symbols/min [2025-09-24T22:21:52.134851] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:52.193355] [DEBUG] [LOCAL ] IR: Loaded 52697 existing records from primary storage. [2025-09-24T22:21:52.193501] [INFO ] [MAIN ] IR: Loaded 52697 primary data records. [2025-09-24T22:21:52.310700] [DEBUG] [LOCAL ] IQV: Loaded 50208 existing records from primary storage. [2025-09-24T22:21:52.331953] [INFO ] [MAIN ] IQV: Loaded 50208 primary data records. [2025-09-24T22:21:52.662121] [DEBUG] [LOCAL ] IRM: Loaded 49460 existing records from primary storage. [2025-09-24T22:21:52.668160] [INFO ] [MAIN ] IRM: Loaded 49460 primary data records. [2025-09-24T22:21:53.276087] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:53.277794] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52697 primary records. [2025-09-24T22:21:53.278206] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-24T22:21:53.312064] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:53.311604] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-24T22:21:53.312198] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-24T22:21:53.315378] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50208 primary records. [2025-09-24T22:21:53.314558] [INFO ] [MAIN ] Derivative Progress: 955/2075 symbols completed. IR took 1.2s. Estimated remaining: 7m 19s. Rate: 153.0 symbols/min [2025-09-24T22:21:53.315988] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:53.316066] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-24T22:21:53.334286] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-24T22:21:53.334565] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-24T22:21:53.336896] [INFO ] [MAIN ] Derivative Progress: 956/2075 symbols completed. IQV took 1.3s. Estimated remaining: 7m 18s. Rate: 153.1 symbols/min [2025-09-24T22:21:53.337454] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:53.361728] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:53.362749] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49460 primary records. [2025-09-24T22:21:53.362921] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-24T22:21:53.387046] [DEBUG] [LOCAL ] IRS: Loaded 21830 existing records from primary storage. [2025-09-24T22:21:53.387794] [INFO ] [MAIN ] IRS: Loaded 21830 primary data records. [2025-09-24T22:21:53.401717] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-24T22:21:53.429468] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-24T22:21:53.437308] [INFO ] [MAIN ] Derivative Progress: 957/2075 symbols completed. IRM took 1.3s. Estimated remaining: 7m 18s. Rate: 153.2 symbols/min [2025-09-24T22:21:53.481150] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:53.749820] [DEBUG] [LOCAL ] IRT: Loaded 50394 existing records from primary storage. [2025-09-24T22:21:53.750150] [INFO ] [MAIN ] IRT: Loaded 50394 primary data records. [2025-09-24T22:21:53.787528] [DEBUG] [LOCAL ] ISD: Loaded 15572 existing records from primary storage. [2025-09-24T22:21:53.812788] [INFO ] [MAIN ] ISD: Loaded 15572 primary data records. [2025-09-24T22:21:54.390535] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:54.391861] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21830 primary records. [2025-09-24T22:21:54.392076] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-24T22:21:54.409483] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-24T22:21:54.409997] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-24T22:21:54.412556] [INFO ] [MAIN ] Derivative Progress: 958/2075 symbols completed. IRS took 1.1s. Estimated remaining: 7m 18s. Rate: 153.0 symbols/min [2025-09-24T22:21:54.429415] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:54.430114] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50394 primary records. [2025-09-24T22:21:54.430295] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-24T22:21:54.460603] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:54.460422] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-24T22:21:54.461309] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15572 primary records. [2025-09-24T22:21:54.461355] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-24T22:21:54.463893] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-24T22:21:54.463822] [INFO ] [MAIN ] Derivative Progress: 959/2075 symbols completed. IRT took 1.1s. Estimated remaining: 7m 17s. Rate: 153.1 symbols/min [2025-09-24T22:21:54.480055] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-24T22:21:54.480171] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-24T22:21:54.482532] [INFO ] [MAIN ] Derivative Progress: 960/2075 symbols completed. ISD took 1.0s. Estimated remaining: 7m 16s. Rate: 153.3 symbols/min [2025-09-24T22:21:54.483327] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:54.483182] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:54.483435] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:54.535003] [DEBUG] [LOCAL ] ITGR: Loaded 31524 existing records from primary storage. [2025-09-24T22:21:54.544530] [INFO ] [MAIN ] ITGR: Loaded 31524 primary data records. [2025-09-24T22:21:54.581620] [DEBUG] [LOCAL ] ITT: Loaded 33096 existing records from primary storage. [2025-09-24T22:21:54.595739] [INFO ] [MAIN ] ITT: Loaded 33096 primary data records. [2025-09-24T22:21:54.654567] [DEBUG] [LOCAL ] IT: Loaded 41579 existing records from primary storage. [2025-09-24T22:21:54.691561] [INFO ] [MAIN ] IT: Loaded 41579 primary data records. [2025-09-24T22:21:55.523516] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:55.524252] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31524 primary records. [2025-09-24T22:21:55.524414] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-24T22:21:55.556964] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-24T22:21:55.557604] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:21:55.564975] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-24T22:21:55.572258] [INFO ] [MAIN ] Derivative Progress: 961/2075 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 17s. Rate: 153.0 symbols/min [2025-09-24T22:21:55.572833] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:55.570327] [INFO ] [MAIN ] IT: Generated 1793 derivative records from 41579 primary records. [2025-09-24T22:21:55.572974] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-24T22:21:55.573232] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:55.574780] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 33096 primary records. [2025-09-24T22:21:55.586142] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-24T22:21:55.591062] [DEBUG] [LOCAL ] IT: Derivative data saved (1793 records). [2025-09-24T22:21:55.591309] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-24T22:21:55.593244] [INFO ] [MAIN ] Derivative Progress: 962/2075 symbols completed. IT took 1.1s. Estimated remaining: 7m 16s. Rate: 153.2 symbols/min [2025-09-24T22:21:55.601666] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:55.608978] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-24T22:21:55.609165] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-24T22:21:55.612399] [INFO ] [MAIN ] Derivative Progress: 963/2075 symbols completed. ITT took 1.1s. Estimated remaining: 7m 15s. Rate: 153.3 symbols/min [2025-09-24T22:21:55.612980] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:55.678553] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-24T22:21:55.679292] [INFO ] [MAIN ] ITUB: Loaded 53304 primary data records. [2025-09-24T22:21:55.768995] [DEBUG] [LOCAL ] ITW: Loaded 46224 existing records from primary storage. [2025-09-24T22:21:55.798007] [DEBUG] [LOCAL ] IVR: Loaded 47862 existing records from primary storage. [2025-09-24T22:21:55.805436] [INFO ] [MAIN ] IVR: Loaded 47862 primary data records. [2025-09-24T22:21:55.805371] [INFO ] [MAIN ] ITW: Loaded 46224 primary data records. [2025-09-24T22:21:56.709720] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:56.711800] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53304 primary records. [2025-09-24T22:21:56.711965] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-24T22:21:56.731466] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-24T22:21:56.731619] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-24T22:21:56.734981] [INFO ] [MAIN ] Derivative Progress: 964/2075 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 16s. Rate: 153.0 symbols/min [2025-09-24T22:21:56.735575] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:56.754535] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:56.757014] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 46224 primary records. [2025-09-24T22:21:56.757154] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-24T22:21:56.787089] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:56.798360] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47862 primary records. [2025-09-24T22:21:56.798482] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-24T22:21:56.799136] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-24T22:21:56.799674] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-24T22:21:56.802411] [INFO ] [MAIN ] Derivative Progress: 965/2075 symbols completed. ITW took 1.2s. Estimated remaining: 7m 15s. Rate: 153.1 symbols/min [2025-09-24T22:21:56.803032] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:56.829311] [DEBUG] [LOCAL ] IVT: Loaded 30919 existing records from primary storage. [2025-09-24T22:21:56.830056] [INFO ] [MAIN ] IVT: Loaded 30919 primary data records. [2025-09-24T22:21:56.830923] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-24T22:21:56.844060] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-24T22:21:56.869916] [INFO ] [MAIN ] Derivative Progress: 966/2075 symbols completed. IVR took 1.3s. Estimated remaining: 7m 14s. Rate: 153.3 symbols/min [2025-09-24T22:21:56.908250] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:57.249492] [DEBUG] [LOCAL ] IVZ: Loaded 53136 existing records from primary storage. [2025-09-24T22:21:57.249834] [INFO ] [MAIN ] IVZ: Loaded 53136 primary data records. [2025-09-24T22:21:57.362812] [DEBUG] [LOCAL ] IX: Loaded 22617 existing records from primary storage. [2025-09-24T22:21:57.379574] [INFO ] [MAIN ] IX: Loaded 22617 primary data records. [2025-09-24T22:21:57.902591] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:57.905414] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30919 primary records. [2025-09-24T22:21:57.905975] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-24T22:21:57.924573] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-24T22:21:57.925186] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-24T22:21:57.928330] [INFO ] [MAIN ] Derivative Progress: 967/2075 symbols completed. IVT took 1.2s. Estimated remaining: 7m 14s. Rate: 153.0 symbols/min [2025-09-24T22:21:57.929430] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:57.946425] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:57.947577] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53136 primary records. [2025-09-24T22:21:57.947734] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-24T22:21:57.966511] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-24T22:21:57.968143] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-24T22:21:57.970317] [INFO ] [MAIN ] Derivative Progress: 968/2075 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 14s. Rate: 153.2 symbols/min [2025-09-24T22:21:57.970781] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:57.985197] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:57.986039] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22617 primary records. [2025-09-24T22:21:57.986148] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-24T22:21:58.013363] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-24T22:21:58.013536] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-24T22:21:58.015953] [INFO ] [MAIN ] Derivative Progress: 969/2075 symbols completed. IX took 1.1s. Estimated remaining: 7m 13s. Rate: 153.3 symbols/min [2025-09-24T22:21:58.016323] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:58.042391] [DEBUG] [LOCAL ] J: Loaded 40350 existing records from primary storage. [2025-09-24T22:21:58.042763] [INFO ] [MAIN ] J: Loaded 40350 primary data records. [2025-09-24T22:21:58.186273] [DEBUG] [LOCAL ] JBGS: Loaded 42470 existing records from primary storage. [2025-09-24T22:21:58.187283] [INFO ] [MAIN ] JBGS: Loaded 42470 primary data records. [2025-09-24T22:21:58.540880] [DEBUG] [LOCAL ] JBI: Loaded 43886 existing records from primary storage. [2025-09-24T22:21:58.546230] [INFO ] [MAIN ] JBI: Loaded 43886 primary data records. [2025-09-24T22:21:59.110485] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:59.124773] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40350 primary records. [2025-09-24T22:21:59.125905] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-24T22:21:59.127440] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:59.136535] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42470 primary records. [2025-09-24T22:21:59.136790] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-24T22:21:59.144901] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-24T22:21:59.145273] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-24T22:21:59.155443] [INFO ] [MAIN ] Derivative Progress: 970/2075 symbols completed. J took 1.2s. Estimated remaining: 7m 13s. Rate: 153.0 symbols/min [2025-09-24T22:21:59.156000] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:59.166349] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-24T22:21:59.166500] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-24T22:21:59.168913] [INFO ] [MAIN ] Derivative Progress: 971/2075 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 13s. Rate: 153.1 symbols/min [2025-09-24T22:21:59.169343] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:59.188922] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:21:59.189824] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43886 primary records. [2025-09-24T22:21:59.189978] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-24T22:21:59.213009] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-24T22:21:59.213303] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-24T22:21:59.216061] [INFO ] [MAIN ] Derivative Progress: 972/2075 symbols completed. JBI took 1.2s. Estimated remaining: 7m 12s. Rate: 153.3 symbols/min [2025-09-24T22:21:59.216433] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:21:59.252451] [DEBUG] [LOCAL ] JCE: Loaded 6457 existing records from primary storage. [2025-09-24T22:21:59.252664] [INFO ] [MAIN ] JCE: Loaded 6457 primary data records. [2025-09-24T22:21:59.253453] [DEBUG] [LOCAL ] JBND: Loaded 25512 existing records from primary storage. [2025-09-24T22:21:59.253548] [INFO ] [MAIN ] JBND: Loaded 25512 primary data records. [2025-09-24T22:21:59.500984] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-09-24T22:21:59.505566] [INFO ] [MAIN ] JBL: Loaded 48383 primary data records. [2025-09-24T22:22:00.306422] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:00.321140] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 25512 primary records. [2025-09-24T22:22:00.322105] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-24T22:22:00.321972] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:00.323723] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6457 primary records. [2025-09-24T22:22:00.323952] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-24T22:22:00.354676] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-24T22:22:00.357366] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-24T22:22:00.357042] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-24T22:22:00.359722] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-24T22:22:00.359616] [INFO ] [MAIN ] Derivative Progress: 973/2075 symbols completed. JBND took 1.2s. Estimated remaining: 7m 12s. Rate: 153.0 symbols/min [2025-09-24T22:22:00.364580] [INFO ] [MAIN ] Derivative Progress: 974/2075 symbols completed. JCE took 1.1s. Estimated remaining: 7m 11s. Rate: 153.1 symbols/min [2025-09-24T22:22:00.378990] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:00.379864] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48383 primary records. [2025-09-24T22:22:00.379931] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-24T22:22:00.395717] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-24T22:22:00.395818] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-24T22:22:00.398165] [INFO ] [MAIN ] Derivative Progress: 975/2075 symbols completed. JBL took 1.2s. Estimated remaining: 7m 11s. Rate: 153.3 symbols/min [2025-09-24T22:22:00.399241] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:00.399306] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:00.399444] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:00.482552] [DEBUG] [LOCAL ] JELD: Loaded 46167 existing records from primary storage. [2025-09-24T22:22:00.482905] [INFO ] [MAIN ] JELD: Loaded 46167 primary data records. [2025-09-24T22:22:00.616252] [DEBUG] [LOCAL ] JEF: Loaded 49996 existing records from primary storage. [2025-09-24T22:22:00.635325] [INFO ] [MAIN ] JEF: Loaded 49996 primary data records. [2025-09-24T22:22:00.652831] [DEBUG] [LOCAL ] JCI: Loaded 53547 existing records from primary storage. [2025-09-24T22:22:00.734508] [INFO ] [MAIN ] JCI: Loaded 53547 primary data records. [2025-09-24T22:22:01.560166] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:01.561355] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46167 primary records. [2025-09-24T22:22:01.561735] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-24T22:22:01.579148] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-24T22:22:01.579387] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-24T22:22:01.581226] [INFO ] [MAIN ] Derivative Progress: 976/2075 symbols completed. JELD took 1.2s. Estimated remaining: 7m 11s. Rate: 153.0 symbols/min [2025-09-24T22:22:01.581777] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:01.616149] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:01.616798] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:01.617762] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 49996 primary records. [2025-09-24T22:22:01.618569] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53547 primary records. [2025-09-24T22:22:01.618766] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-24T22:22:01.618871] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-24T22:22:01.624351] [DEBUG] [LOCAL ] JEQ: Loaded 9156 existing records from primary storage. [2025-09-24T22:22:01.625151] [INFO ] [MAIN ] JEQ: Loaded 9156 primary data records. [2025-09-24T22:22:01.702771] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-24T22:22:01.733949] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-24T22:22:01.741899] [INFO ] [MAIN ] Derivative Progress: 977/2075 symbols completed. JCI took 1.3s. Estimated remaining: 7m 10s. Rate: 153.1 symbols/min [2025-09-24T22:22:01.752997] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:01.772532] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-24T22:22:01.783512] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-24T22:22:01.786240] [INFO ] [MAIN ] Derivative Progress: 978/2075 symbols completed. JEF took 1.4s. Estimated remaining: 7m 10s. Rate: 153.2 symbols/min [2025-09-24T22:22:01.797707] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:02.021062] [DEBUG] [LOCAL ] JGH: Loaded 10954 existing records from primary storage. [2025-09-24T22:22:02.021299] [INFO ] [MAIN ] JGH: Loaded 10954 primary data records. [2025-09-24T22:22:02.129004] [DEBUG] [LOCAL ] JFR: Loaded 30352 existing records from primary storage. [2025-09-24T22:22:02.140697] [INFO ] [MAIN ] JFR: Loaded 30352 primary data records. [2025-09-24T22:22:02.693105] [DEBUG] [MAIN ] JEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:02.694511] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 9156 primary records. [2025-09-24T22:22:02.694626] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-24T22:22:02.712803] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-24T22:22:02.715732] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-24T22:22:02.718741] [INFO ] [MAIN ] Derivative Progress: 979/2075 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 10s. Rate: 153.0 symbols/min [2025-09-24T22:22:02.719663] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:02.733896] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:02.735002] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10954 primary records. [2025-09-24T22:22:02.735260] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-24T22:22:02.752634] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-24T22:22:02.754549] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-24T22:22:02.756880] [INFO ] [MAIN ] Derivative Progress: 980/2075 symbols completed. JGH took 1.0s. Estimated remaining: 7m 9s. Rate: 153.1 symbols/min [2025-09-24T22:22:02.757176] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:02.772037] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:02.772867] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30352 primary records. [2025-09-24T22:22:02.772933] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-24T22:22:02.791200] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-24T22:22:02.794405] [DEBUG] [LOCAL ] JHI: Loaded 3595 existing records from primary storage. [2025-09-24T22:22:02.804767] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-24T22:22:02.807541] [INFO ] [MAIN ] Derivative Progress: 981/2075 symbols completed. JFR took 1.1s. Estimated remaining: 7m 8s. Rate: 153.3 symbols/min [2025-09-24T22:22:02.804967] [INFO ] [MAIN ] JHI: Loaded 3595 primary data records. [2025-09-24T22:22:02.829824] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:02.954314] [DEBUG] [LOCAL ] JHG: Loaded 47903 existing records from primary storage. [2025-09-24T22:22:02.953120] [DEBUG] [LOCAL ] JHS: Loaded 2851 existing records from primary storage. [2025-09-24T22:22:02.959608] [INFO ] [MAIN ] JHG: Loaded 47903 primary data records. [2025-09-24T22:22:02.975211] [INFO ] [MAIN ] JHS: Loaded 2851 primary data records. [2025-09-24T22:22:03.860914] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:03.862545] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3595 primary records. [2025-09-24T22:22:03.862894] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-24T22:22:03.881609] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-24T22:22:03.881875] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-24T22:22:03.898469] [INFO ] [MAIN ] Derivative Progress: 982/2075 symbols completed. JHI took 1.1s. Estimated remaining: 7m 9s. Rate: 153.0 symbols/min [2025-09-24T22:22:03.899324] [DEBUG] [MAIN ] JHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:03.899828] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:03.909199] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47903 primary records. [2025-09-24T22:22:03.914690] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-24T22:22:03.914931] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:03.915868] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2851 primary records. [2025-09-24T22:22:03.916004] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-24T22:22:03.954725] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-24T22:22:03.952957] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-24T22:22:03.954893] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-24T22:22:03.954990] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-24T22:22:03.957677] [INFO ] [MAIN ] Derivative Progress: 983/2075 symbols completed. JHS took 1.1s. Estimated remaining: 7m 8s. Rate: 153.1 symbols/min [2025-09-24T22:22:03.957919] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:03.961292] [INFO ] [MAIN ] Derivative Progress: 984/2075 symbols completed. JHG took 1.2s. Estimated remaining: 7m 7s. Rate: 153.3 symbols/min [2025-09-24T22:22:03.961753] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:04.019998] [DEBUG] [LOCAL ] JILL: Loaded 16769 existing records from primary storage. [2025-09-24T22:22:04.020378] [INFO ] [MAIN ] JILL: Loaded 16769 primary data records. [2025-09-24T22:22:04.035013] [DEBUG] [LOCAL ] JHX: Loaded 50437 existing records from primary storage. [2025-09-24T22:22:04.070577] [INFO ] [MAIN ] JHX: Loaded 50437 primary data records. [2025-09-24T22:22:04.265787] [DEBUG] [LOCAL ] JKS: Loaded 40108 existing records from primary storage. [2025-09-24T22:22:04.275462] [INFO ] [MAIN ] JKS: Loaded 40108 primary data records. [2025-09-24T22:22:05.020581] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:05.035050] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16769 primary records. [2025-09-24T22:22:05.035373] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-24T22:22:05.036466] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:05.038575] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 50437 primary records. [2025-09-24T22:22:05.038783] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-24T22:22:05.076933] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:05.081205] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40108 primary records. [2025-09-24T22:22:05.081697] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-24T22:22:05.082009] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-24T22:22:05.082352] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-24T22:22:05.085742] [INFO ] [MAIN ] Derivative Progress: 985/2075 symbols completed. JHX took 1.2s. Estimated remaining: 7m 8s. Rate: 153.0 symbols/min [2025-09-24T22:22:05.086252] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:05.102578] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-24T22:22:05.103574] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-24T22:22:05.106517] [INFO ] [MAIN ] Derivative Progress: 986/2075 symbols completed. JILL took 1.1s. Estimated remaining: 7m 7s. Rate: 153.1 symbols/min [2025-09-24T22:22:05.106929] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:05.107017] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-24T22:22:05.107377] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-24T22:22:05.109827] [INFO ] [MAIN ] Derivative Progress: 987/2075 symbols completed. JKS took 1.1s. Estimated remaining: 7m 6s. Rate: 153.3 symbols/min [2025-09-24T22:22:05.110322] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:05.116679] [DEBUG] [LOCAL ] JLS: Loaded 4088 existing records from primary storage. [2025-09-24T22:22:05.116812] [INFO ] [MAIN ] JLS: Loaded 4088 primary data records. [2025-09-24T22:22:05.344682] [DEBUG] [LOCAL ] JLL: Loaded 32095 existing records from primary storage. [2025-09-24T22:22:05.467554] [INFO ] [MAIN ] JLL: Loaded 32095 primary data records. [2025-09-24T22:22:05.593430] [DEBUG] [LOCAL ] JMIA: Loaded 50508 existing records from primary storage. [2025-09-24T22:22:05.604748] [INFO ] [MAIN ] JMIA: Loaded 50508 primary data records. [2025-09-24T22:22:06.177280] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:06.178566] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4088 primary records. [2025-09-24T22:22:06.179115] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-24T22:22:06.199064] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-24T22:22:06.199527] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-24T22:22:06.203042] [INFO ] [MAIN ] Derivative Progress: 988/2075 symbols completed. JLS took 1.1s. Estimated remaining: 7m 6s. Rate: 153.0 symbols/min [2025-09-24T22:22:06.218904] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:06.219791] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 32095 primary records. [2025-09-24T22:22:06.219991] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-24T22:22:06.252119] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:06.252730] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-24T22:22:06.253475] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-24T22:22:06.256855] [INFO ] [MAIN ] Derivative Progress: 989/2075 symbols completed. JLL took 1.2s. Estimated remaining: 7m 6s. Rate: 153.1 symbols/min [2025-09-24T22:22:06.253410] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50508 primary records. [2025-09-24T22:22:06.256999] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-24T22:22:06.273689] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-24T22:22:06.273799] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-24T22:22:06.276775] [INFO ] [MAIN ] Derivative Progress: 990/2075 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 5s. Rate: 153.3 symbols/min [2025-09-24T22:22:06.277502] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:06.277664] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:06.277825] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:06.310682] [DEBUG] [LOCAL ] JOE: Loaded 24559 existing records from primary storage. [2025-09-24T22:22:06.310844] [INFO ] [MAIN ] JOE: Loaded 24559 primary data records. [2025-09-24T22:22:06.564405] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-24T22:22:06.669746] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-24T22:22:06.675893] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-24T22:22:06.697232] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-09-24T22:22:07.383136] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:07.384323] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24559 primary records. [2025-09-24T22:22:07.384697] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-24T22:22:07.404633] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-24T22:22:07.405864] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-24T22:22:07.408984] [INFO ] [MAIN ] Derivative Progress: 991/2075 symbols completed. JOE took 1.1s. Estimated remaining: 7m 5s. Rate: 153.0 symbols/min [2025-09-24T22:22:07.409520] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:07.423878] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:07.424875] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-09-24T22:22:07.425880] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-24T22:22:07.456986] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:07.458763] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-24T22:22:07.459923] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-24T22:22:07.460064] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-24T22:22:07.460157] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-24T22:22:07.463392] [INFO ] [MAIN ] Derivative Progress: 992/2075 symbols completed. JOBY took 1.2s. Estimated remaining: 7m 4s. Rate: 153.1 symbols/min [2025-09-24T22:22:07.483857] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:07.490273] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-24T22:22:07.501297] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-24T22:22:07.503691] [INFO ] [MAIN ] Derivative Progress: 993/2075 symbols completed. JNJ took 1.2s. Estimated remaining: 7m 4s. Rate: 153.3 symbols/min [2025-09-24T22:22:07.504086] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:07.505041] [DEBUG] [LOCAL ] JPC: Loaded 37066 existing records from primary storage. [2025-09-24T22:22:07.505670] [INFO ] [MAIN ] JPC: Loaded 37066 primary data records. [2025-09-24T22:22:07.837184] [DEBUG] [LOCAL ] JQC: Loaded 33645 existing records from primary storage. [2025-09-24T22:22:07.882559] [INFO ] [MAIN ] JQC: Loaded 33645 primary data records. [2025-09-24T22:22:07.937547] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-24T22:22:07.957951] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-24T22:22:08.549587] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:08.551700] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37066 primary records. [2025-09-24T22:22:08.551939] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-24T22:22:08.569840] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-24T22:22:08.570473] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-24T22:22:08.573074] [INFO ] [MAIN ] Derivative Progress: 994/2075 symbols completed. JPC took 1.2s. Estimated remaining: 7m 4s. Rate: 153.0 symbols/min [2025-09-24T22:22:08.573794] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:08.599081] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:08.600036] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33645 primary records. [2025-09-24T22:22:08.600411] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-24T22:22:08.617487] [DEBUG] [LOCAL ] JRI: Loaded 14901 existing records from primary storage. [2025-09-24T22:22:08.621453] [INFO ] [MAIN ] JRI: Loaded 14901 primary data records. [2025-09-24T22:22:08.678756] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-24T22:22:08.686710] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:08.721848] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-24T22:22:08.720837] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-24T22:22:08.722021] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-24T22:22:08.749109] [INFO ] [MAIN ] Derivative Progress: 995/2075 symbols completed. JQC took 1.2s. Estimated remaining: 7m 3s. Rate: 153.1 symbols/min [2025-09-24T22:22:08.755126] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:08.856034] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-24T22:22:08.986752] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-24T22:22:08.989152] [INFO ] [MAIN ] Derivative Progress: 996/2075 symbols completed. JPM took 1.5s. Estimated remaining: 7m 3s. Rate: 153.1 symbols/min [2025-09-24T22:22:08.994123] [DEBUG] [LOCAL ] JRS: Loaded 11089 existing records from primary storage. [2025-09-24T22:22:08.994414] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:08.994252] [INFO ] [MAIN ] JRS: Loaded 11089 primary data records. [2025-09-24T22:22:09.354753] [DEBUG] [LOCAL ] JXN: Loaded 45954 existing records from primary storage. [2025-09-24T22:22:09.354975] [INFO ] [MAIN ] JXN: Loaded 45954 primary data records. [2025-09-24T22:22:09.355772] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:09.388563] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 14901 primary records. [2025-09-24T22:22:09.406050] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-24T22:22:09.486119] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-24T22:22:09.501828] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-24T22:22:09.524608] [INFO ] [MAIN ] Derivative Progress: 997/2075 symbols completed. JRI took 1.0s. Estimated remaining: 7m 3s. Rate: 153.1 symbols/min [2025-09-24T22:22:09.542136] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:09.766052] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:09.767859] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11089 primary records. [2025-09-24T22:22:09.768352] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-24T22:22:09.787790] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-24T22:22:09.787961] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-24T22:22:09.790976] [INFO ] [MAIN ] Derivative Progress: 998/2075 symbols completed. JRS took 1.0s. Estimated remaining: 7m 2s. Rate: 153.1 symbols/min [2025-09-24T22:22:09.791743] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:09.820482] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:09.821266] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45954 primary records. [2025-09-24T22:22:09.821456] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-24T22:22:09.860450] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-24T22:22:09.861491] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-24T22:22:09.863817] [INFO ] [MAIN ] Derivative Progress: 999/2075 symbols completed. JXN took 0.9s. Estimated remaining: 7m 1s. Rate: 153.3 symbols/min [2025-09-24T22:22:09.864127] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:09.859623] [DEBUG] [LOCAL ] KAI: Loaded 13573 existing records from primary storage. [2025-09-24T22:22:09.865703] [DEBUG] [LOCAL ] K: Loaded 49862 existing records from primary storage. [2025-09-24T22:22:09.866015] [INFO ] [MAIN ] K: Loaded 49862 primary data records. [2025-09-24T22:22:09.865956] [INFO ] [MAIN ] KAI: Loaded 13573 primary data records. [2025-09-24T22:22:10.489118] [DEBUG] [LOCAL ] KAR: Loaded 39814 existing records from primary storage. [2025-09-24T22:22:10.490120] [INFO ] [MAIN ] KAR: Loaded 39814 primary data records. [2025-09-24T22:22:10.839520] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:10.845550] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13573 primary records. [2025-09-24T22:22:10.845665] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-24T22:22:10.850149] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:10.861257] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49862 primary records. [2025-09-24T22:22:10.865955] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-24T22:22:10.886623] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-24T22:22:10.887365] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-24T22:22:10.890388] [INFO ] [MAIN ] Derivative Progress: 1000/2075 symbols completed. K took 1.4s. Estimated remaining: 7m 2s. Rate: 153.0 symbols/min [2025-09-24T22:22:10.891268] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-24T22:22:10.891198] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:10.891500] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-24T22:22:10.894596] [INFO ] [MAIN ] Derivative Progress: 1001/2075 symbols completed. KAI took 1.1s. Estimated remaining: 7m 1s. Rate: 153.2 symbols/min [2025-09-24T22:22:10.896304] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:10.912470] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:10.913326] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39814 primary records. [2025-09-24T22:22:10.913460] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-24T22:22:10.941965] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-24T22:22:10.957966] [DEBUG] [LOCAL ] KBDC: Loaded 20843 existing records from primary storage. [2025-09-24T22:22:10.958205] [INFO ] [MAIN ] KBDC: Loaded 20843 primary data records. [2025-09-24T22:22:10.957557] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-24T22:22:10.958628] [DEBUG] [LOCAL ] KB: Loaded 24099 existing records from primary storage. [2025-09-24T22:22:10.962003] [INFO ] [MAIN ] KB: Loaded 24099 primary data records. [2025-09-24T22:22:10.961898] [INFO ] [MAIN ] Derivative Progress: 1002/2075 symbols completed. KAR took 1.1s. Estimated remaining: 7m 0s. Rate: 153.3 symbols/min [2025-09-24T22:22:11.018413] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:11.668003] [DEBUG] [LOCAL ] KBH: Loaded 48915 existing records from primary storage. [2025-09-24T22:22:11.668715] [INFO ] [MAIN ] KBH: Loaded 48915 primary data records. [2025-09-24T22:22:11.795967] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:11.801138] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 20843 primary records. [2025-09-24T22:22:11.801758] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-24T22:22:12.044831] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:12.046568] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24099 primary records. [2025-09-24T22:22:12.046761] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-24T22:22:12.064565] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-09-24T22:22:12.066003] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-24T22:22:12.068496] [INFO ] [MAIN ] Derivative Progress: 1003/2075 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 0s. Rate: 153.0 symbols/min [2025-09-24T22:22:12.075251] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-24T22:22:12.075385] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-24T22:22:12.078289] [INFO ] [MAIN ] Derivative Progress: 1004/2075 symbols completed. KB took 1.2s. Estimated remaining: 6m 60s. Rate: 153.2 symbols/min [2025-09-24T22:22:12.101157] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:12.102028] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48915 primary records. [2025-09-24T22:22:12.102111] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-24T22:22:12.119583] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-24T22:22:12.119781] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-24T22:22:12.122568] [INFO ] [MAIN ] Derivative Progress: 1005/2075 symbols completed. KBH took 1.1s. Estimated remaining: 6m 59s. Rate: 153.3 symbols/min [2025-09-24T22:22:12.123443] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:12.123367] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:12.124077] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:12.132724] [DEBUG] [LOCAL ] KEN: Loaded 4766 existing records from primary storage. [2025-09-24T22:22:12.132880] [INFO ] [MAIN ] KEN: Loaded 4766 primary data records. [2025-09-24T22:22:12.479798] [DEBUG] [LOCAL ] KBR: Loaded 48149 existing records from primary storage. [2025-09-24T22:22:12.481515] [INFO ] [MAIN ] KBR: Loaded 48149 primary data records. [2025-09-24T22:22:12.557468] [DEBUG] [LOCAL ] KD: Loaded 52290 existing records from primary storage. [2025-09-24T22:22:12.590731] [INFO ] [MAIN ] KD: Loaded 52290 primary data records. [2025-09-24T22:22:13.029203] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:13.037100] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4766 primary records. [2025-09-24T22:22:13.169117] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-24T22:22:13.191164] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-24T22:22:13.192035] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-24T22:22:13.194867] [INFO ] [MAIN ] Derivative Progress: 1006/2075 symbols completed. KEN took 1.1s. Estimated remaining: 6m 59s. Rate: 153.0 symbols/min [2025-09-24T22:22:13.195682] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:13.216695] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:13.217568] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48149 primary records. [2025-09-24T22:22:13.217789] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-24T22:22:13.244993] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-24T22:22:13.245477] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-24T22:22:13.248754] [INFO ] [MAIN ] Derivative Progress: 1007/2075 symbols completed. KBR took 1.1s. Estimated remaining: 6m 58s. Rate: 153.2 symbols/min [2025-09-24T22:22:13.249137] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:13.277967] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:13.280244] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52290 primary records. [2025-09-24T22:22:13.281031] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-24T22:22:13.280826] [DEBUG] [LOCAL ] KEP: Loaded 30642 existing records from primary storage. [2025-09-24T22:22:13.282131] [INFO ] [MAIN ] KEP: Loaded 30642 primary data records. [2025-09-24T22:22:13.419290] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-24T22:22:13.425040] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-24T22:22:13.449280] [INFO ] [MAIN ] Derivative Progress: 1008/2075 symbols completed. KD took 1.3s. Estimated remaining: 6m 58s. Rate: 153.2 symbols/min [2025-09-24T22:22:13.486950] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:13.519994] [DEBUG] [LOCAL ] KEX: Loaded 38021 existing records from primary storage. [2025-09-24T22:22:13.640568] [INFO ] [MAIN ] KEX: Loaded 38021 primary data records. [2025-09-24T22:22:14.038660] [DEBUG] [LOCAL ] KEYS: Loaded 43320 existing records from primary storage. [2025-09-24T22:22:14.039494] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:14.039572] [INFO ] [MAIN ] KEYS: Loaded 43320 primary data records. [2025-09-24T22:22:14.040444] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30642 primary records. [2025-09-24T22:22:14.040680] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-24T22:22:14.194194] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-24T22:22:14.204834] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-24T22:22:14.212297] [INFO ] [MAIN ] Derivative Progress: 1009/2075 symbols completed. KEP took 1.0s. Estimated remaining: 6m 58s. Rate: 153.1 symbols/min [2025-09-24T22:22:14.241839] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:14.400947] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:14.401828] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38021 primary records. [2025-09-24T22:22:14.402060] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-24T22:22:14.405582] [DEBUG] [LOCAL ] KF: Loaded 2470 existing records from primary storage. [2025-09-24T22:22:14.405744] [INFO ] [MAIN ] KF: Loaded 2470 primary data records. [2025-09-24T22:22:14.614279] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-24T22:22:14.653948] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-24T22:22:14.737346] [INFO ] [MAIN ] Derivative Progress: 1010/2075 symbols completed. KEX took 1.5s. Estimated remaining: 6m 58s. Rate: 153.0 symbols/min [2025-09-24T22:22:14.738268] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:14.758059] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:14.758903] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43320 primary records. [2025-09-24T22:22:14.765089] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-24T22:22:14.787752] [DEBUG] [LOCAL ] KFRC: Loaded 19440 existing records from primary storage. [2025-09-24T22:22:14.789715] [INFO ] [MAIN ] KFRC: Loaded 19440 primary data records. [2025-09-24T22:22:14.815595] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-24T22:22:14.849718] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-24T22:22:14.860024] [INFO ] [MAIN ] Derivative Progress: 1011/2075 symbols completed. KEYS took 1.4s. Estimated remaining: 6m 57s. Rate: 153.1 symbols/min [2025-09-24T22:22:14.867951] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:14.914058] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:14.929215] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2470 primary records. [2025-09-24T22:22:14.929381] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-24T22:22:15.036526] [DEBUG] [LOCAL ] KFS: Loaded 8319 existing records from primary storage. [2025-09-24T22:22:15.038722] [INFO ] [MAIN ] KFS: Loaded 8319 primary data records. [2025-09-24T22:22:15.039268] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-24T22:22:15.168376] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-24T22:22:15.171782] [INFO ] [MAIN ] Derivative Progress: 1012/2075 symbols completed. KF took 0.9s. Estimated remaining: 6m 56s. Rate: 153.2 symbols/min [2025-09-24T22:22:15.206604] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:15.520037] [DEBUG] [LOCAL ] KFY: Loaded 30608 existing records from primary storage. [2025-09-24T22:22:15.521009] [INFO ] [MAIN ] KFY: Loaded 30608 primary data records. [2025-09-24T22:22:15.889912] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:15.891023] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19440 primary records. [2025-09-24T22:22:15.891207] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-24T22:22:15.926350] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:15.927213] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8319 primary records. [2025-09-24T22:22:15.927302] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-24T22:22:15.929356] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-24T22:22:15.929914] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-24T22:22:15.932330] [INFO ] [MAIN ] Derivative Progress: 1013/2075 symbols completed. KFRC took 1.2s. Estimated remaining: 6m 56s. Rate: 153.0 symbols/min [2025-09-24T22:22:15.933839] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:15.950761] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-09-24T22:22:15.950869] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-24T22:22:15.953140] [INFO ] [MAIN ] Derivative Progress: 1014/2075 symbols completed. KFS took 1.1s. Estimated remaining: 6m 56s. Rate: 153.2 symbols/min [2025-09-24T22:22:15.953494] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:15.969905] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:15.970743] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30608 primary records. [2025-09-24T22:22:15.970905] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-24T22:22:15.988981] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-24T22:22:15.990112] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-24T22:22:15.992412] [INFO ] [MAIN ] Derivative Progress: 1015/2075 symbols completed. KFY took 0.8s. Estimated remaining: 6m 55s. Rate: 153.3 symbols/min [2025-09-24T22:22:15.992870] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:16.053205] [DEBUG] [LOCAL ] KGS: Loaded 45757 existing records from primary storage. [2025-09-24T22:22:16.053534] [INFO ] [MAIN ] KGS: Loaded 45757 primary data records. [2025-09-24T22:22:16.054323] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-24T22:22:16.075483] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-24T22:22:16.684556] [DEBUG] [LOCAL ] KIM: Loaded 53063 existing records from primary storage. [2025-09-24T22:22:16.698054] [INFO ] [MAIN ] KIM: Loaded 53063 primary data records. [2025-09-24T22:22:17.044970] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:17.050822] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45757 primary records. [2025-09-24T22:22:17.051070] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-24T22:22:17.052173] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:17.061556] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-24T22:22:17.067609] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-24T22:22:17.087236] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-24T22:22:17.089723] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-24T22:22:17.092412] [INFO ] [MAIN ] Derivative Progress: 1016/2075 symbols completed. KGS took 1.1s. Estimated remaining: 6m 55s. Rate: 153.0 symbols/min [2025-09-24T22:22:17.093156] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:17.107416] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-24T22:22:17.107989] [DEBUG] [MAIN ] KIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:17.108183] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-24T22:22:17.110726] [INFO ] [MAIN ] Derivative Progress: 1017/2075 symbols completed. KGC took 1.2s. Estimated remaining: 6m 54s. Rate: 153.2 symbols/min [2025-09-24T22:22:17.111840] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53063 primary records. [2025-09-24T22:22:17.112211] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-24T22:22:17.113267] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:17.130827] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-24T22:22:17.131204] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-24T22:22:17.133926] [INFO ] [MAIN ] Derivative Progress: 1018/2075 symbols completed. KIM took 1.1s. Estimated remaining: 6m 54s. Rate: 153.3 symbols/min [2025-09-24T22:22:17.152168] [DEBUG] [LOCAL ] KIO: Loaded 21295 existing records from primary storage. [2025-09-24T22:22:17.152505] [INFO ] [MAIN ] KIO: Loaded 21295 primary data records. [2025-09-24T22:22:17.523688] [DEBUG] [LOCAL ] KKR: Loaded 53501 existing records from primary storage. [2025-09-24T22:22:17.532176] [INFO ] [MAIN ] KKR: Loaded 53501 primary data records. [2025-09-24T22:22:17.897897] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:17.898852] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21295 primary records. [2025-09-24T22:22:17.898972] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-24T22:22:17.919082] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-24T22:22:17.919333] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-24T22:22:17.921896] [INFO ] [MAIN ] Derivative Progress: 1019/2075 symbols completed. KIO took 0.8s. Estimated remaining: 6m 54s. Rate: 153.2 symbols/min [2025-09-24T22:22:17.937800] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:17.938489] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53501 primary records. [2025-09-24T22:22:17.938550] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-24T22:22:17.954077] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-24T22:22:17.954143] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-24T22:22:17.956457] [INFO ] [MAIN ] Derivative Progress: 1020/2075 symbols completed. KKR took 0.8s. Estimated remaining: 6m 53s. Rate: 153.3 symbols/min [2025-09-24T22:22:17.957335] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:17.957228] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:17.957611] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:17.967082] [DEBUG] [LOCAL ] KKRS: Loaded 5740 existing records from primary storage. [2025-09-24T22:22:17.967325] [INFO ] [MAIN ] KKRS: Loaded 5740 primary data records. [2025-09-24T22:22:18.313420] [DEBUG] [LOCAL ] KLG: Loaded 41876 existing records from primary storage. [2025-09-24T22:22:18.312489] [DEBUG] [LOCAL ] KLC: Loaded 36523 existing records from primary storage. [2025-09-24T22:22:18.313703] [INFO ] [MAIN ] KLG: Loaded 41876 primary data records. [2025-09-24T22:22:18.313934] [INFO ] [MAIN ] KLC: Loaded 36523 primary data records. [2025-09-24T22:22:18.994538] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:18.995893] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5740 primary records. [2025-09-24T22:22:18.996824] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-24T22:22:19.015024] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-24T22:22:19.015443] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-24T22:22:19.018292] [INFO ] [MAIN ] Derivative Progress: 1021/2075 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 53s. Rate: 153.0 symbols/min [2025-09-24T22:22:19.018786] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:19.041066] [DEBUG] [MAIN ] KLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:19.042088] [INFO ] [MAIN ] KLG: Generated 1794 derivative records from 41876 primary records. [2025-09-24T22:22:19.042373] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-24T22:22:19.064369] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:19.069839] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36523 primary records. [2025-09-24T22:22:19.071133] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-24T22:22:19.082465] [DEBUG] [LOCAL ] KLG: Derivative data saved (1794 records). [2025-09-24T22:22:19.083490] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-24T22:22:19.090944] [INFO ] [MAIN ] Derivative Progress: 1022/2075 symbols completed. KLG took 1.1s. Estimated remaining: 6m 52s. Rate: 153.2 symbols/min [2025-09-24T22:22:19.092064] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:19.110129] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-24T22:22:19.110347] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-24T22:22:19.113022] [INFO ] [MAIN ] Derivative Progress: 1023/2075 symbols completed. KLC took 1.2s. Estimated remaining: 6m 52s. Rate: 153.3 symbols/min [2025-09-24T22:22:19.113496] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:19.116927] [DEBUG] [LOCAL ] KMPB: Loaded 3581 existing records from primary storage. [2025-09-24T22:22:19.117158] [INFO ] [MAIN ] KMPB: Loaded 3581 primary data records. [2025-09-24T22:22:19.225632] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-24T22:22:19.240900] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-24T22:22:19.667130] [DEBUG] [LOCAL ] KMPR: Loaded 38424 existing records from primary storage. [2025-09-24T22:22:19.778314] [INFO ] [MAIN ] KMPR: Loaded 38424 primary data records. [2025-09-24T22:22:20.155809] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:22:20.157569] [INFO ] [MAIN ] KMPB: Generated 1793 derivative records from 3581 primary records. [2025-09-24T22:22:20.157740] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-24T22:22:20.177975] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:20.182329] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-24T22:22:20.184799] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-24T22:22:20.187066] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1793 records). [2025-09-24T22:22:20.187311] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-24T22:22:20.200321] [INFO ] [MAIN ] Derivative Progress: 1024/2075 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 52s. Rate: 153.0 symbols/min [2025-09-24T22:22:20.202694] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:20.206143] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-24T22:22:20.206228] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-24T22:22:20.208946] [INFO ] [MAIN ] Derivative Progress: 1025/2075 symbols completed. KMI took 1.2s. Estimated remaining: 6m 51s. Rate: 153.2 symbols/min [2025-09-24T22:22:20.209335] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:20.226230] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:20.226997] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38424 primary records. [2025-09-24T22:22:20.227059] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-24T22:22:20.248113] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-24T22:22:20.248384] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-24T22:22:20.250761] [INFO ] [MAIN ] Derivative Progress: 1026/2075 symbols completed. KMPR took 1.1s. Estimated remaining: 6m 51s. Rate: 153.3 symbols/min [2025-09-24T22:22:20.251138] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:20.292983] [DEBUG] [LOCAL ] KMT: Loaded 43072 existing records from primary storage. [2025-09-24T22:22:20.293340] [INFO ] [MAIN ] KMT: Loaded 43072 primary data records. [2025-09-24T22:22:20.431818] [DEBUG] [LOCAL ] KMX: Loaded 53117 existing records from primary storage. [2025-09-24T22:22:20.448527] [INFO ] [MAIN ] KMX: Loaded 53117 primary data records. [2025-09-24T22:22:20.592895] [DEBUG] [LOCAL ] KN: Loaded 38876 existing records from primary storage. [2025-09-24T22:22:20.610025] [INFO ] [MAIN ] KN: Loaded 38876 primary data records. [2025-09-24T22:22:21.268858] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:21.269709] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43072 primary records. [2025-09-24T22:22:21.269985] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-24T22:22:21.299714] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:21.301784] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53117 primary records. [2025-09-24T22:22:21.302138] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-24T22:22:21.314939] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-24T22:22:21.315061] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-24T22:22:21.319755] [INFO ] [MAIN ] Derivative Progress: 1027/2075 symbols completed. KMT took 1.1s. Estimated remaining: 6m 51s. Rate: 153.1 symbols/min [2025-09-24T22:22:21.320419] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:21.335870] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:21.337341] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38876 primary records. [2025-09-24T22:22:21.338004] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-24T22:22:21.338841] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-24T22:22:21.339906] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-24T22:22:21.343038] [INFO ] [MAIN ] Derivative Progress: 1028/2075 symbols completed. KMX took 1.1s. Estimated remaining: 6m 50s. Rate: 153.2 symbols/min [2025-09-24T22:22:21.356063] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:21.361057] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-24T22:22:21.361220] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-24T22:22:21.364216] [INFO ] [MAIN ] Derivative Progress: 1029/2075 symbols completed. KN took 1.1s. Estimated remaining: 6m 49s. Rate: 153.3 symbols/min [2025-09-24T22:22:21.364621] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:21.373183] [DEBUG] [LOCAL ] KNOP: Loaded 9990 existing records from primary storage. [2025-09-24T22:22:21.373306] [INFO ] [MAIN ] KNOP: Loaded 9990 primary data records. [2025-09-24T22:22:21.513013] [DEBUG] [LOCAL ] KNSL: Loaded 18098 existing records from primary storage. [2025-09-24T22:22:21.541699] [INFO ] [MAIN ] KNSL: Loaded 18098 primary data records. [2025-09-24T22:22:21.679171] [DEBUG] [LOCAL ] KNF: Loaded 35874 existing records from primary storage. [2025-09-24T22:22:21.812742] [INFO ] [MAIN ] KNF: Loaded 35874 primary data records. [2025-09-24T22:22:22.392449] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:22.393400] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 9990 primary records. [2025-09-24T22:22:22.393579] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-24T22:22:22.410485] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-24T22:22:22.410693] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-24T22:22:22.413254] [INFO ] [MAIN ] Derivative Progress: 1030/2075 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 50s. Rate: 153.1 symbols/min [2025-09-24T22:22:22.413572] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:22.443922] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:22.443456] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:22.445272] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35874 primary records. [2025-09-24T22:22:22.445523] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-24T22:22:22.444684] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18098 primary records. [2025-09-24T22:22:22.446236] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-24T22:22:22.477067] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-24T22:22:22.477763] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-24T22:22:22.481444] [INFO ] [MAIN ] Derivative Progress: 1031/2075 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 49s. Rate: 153.2 symbols/min [2025-09-24T22:22:22.478831] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-24T22:22:22.491534] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:22.491821] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-24T22:22:22.494899] [INFO ] [MAIN ] Derivative Progress: 1032/2075 symbols completed. KNF took 1.2s. Estimated remaining: 6m 48s. Rate: 153.4 symbols/min [2025-09-24T22:22:22.495385] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:22.513442] [DEBUG] [LOCAL ] KNTK: Loaded 46087 existing records from primary storage. [2025-09-24T22:22:22.513723] [INFO ] [MAIN ] KNTK: Loaded 46087 primary data records. [2025-09-24T22:22:22.854395] [DEBUG] [LOCAL ] KODK: Loaded 43383 existing records from primary storage. [2025-09-24T22:22:22.854679] [INFO ] [MAIN ] KODK: Loaded 43383 primary data records. [2025-09-24T22:22:22.992269] [DEBUG] [LOCAL ] KNX: Loaded 52595 existing records from primary storage. [2025-09-24T22:22:23.023558] [INFO ] [MAIN ] KNX: Loaded 52595 primary data records. [2025-09-24T22:22:23.496246] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:23.498119] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46087 primary records. [2025-09-24T22:22:23.498397] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-24T22:22:23.520669] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-24T22:22:23.522674] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-24T22:22:23.525611] [INFO ] [MAIN ] Derivative Progress: 1033/2075 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 48s. Rate: 153.1 symbols/min [2025-09-24T22:22:23.539071] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:23.539742] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43383 primary records. [2025-09-24T22:22:23.539892] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-24T22:22:23.569134] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:23.570207] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52595 primary records. [2025-09-24T22:22:23.570486] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-24T22:22:23.570872] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-24T22:22:23.571273] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-24T22:22:23.573752] [INFO ] [MAIN ] Derivative Progress: 1034/2075 symbols completed. KODK took 1.1s. Estimated remaining: 6m 48s. Rate: 153.2 symbols/min [2025-09-24T22:22:23.588875] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-24T22:22:23.588937] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-24T22:22:23.591710] [INFO ] [MAIN ] Derivative Progress: 1035/2075 symbols completed. KNX took 1.1s. Estimated remaining: 6m 47s. Rate: 153.4 symbols/min [2025-09-24T22:22:23.592815] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:23.592763] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:23.592597] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:23.597764] [DEBUG] [LOCAL ] KORE: Loaded 1970 existing records from primary storage. [2025-09-24T22:22:23.597982] [INFO ] [MAIN ] KORE: Loaded 1970 primary data records. [2025-09-24T22:22:23.717931] [DEBUG] [LOCAL ] KOP: Loaded 17845 existing records from primary storage. [2025-09-24T22:22:23.742009] [INFO ] [MAIN ] KOP: Loaded 17845 primary data records. [2025-09-24T22:22:23.809726] [DEBUG] [LOCAL ] KOF: Loaded 25908 existing records from primary storage. [2025-09-24T22:22:23.986669] [INFO ] [MAIN ] KOF: Loaded 25908 primary data records. [2025-09-24T22:22:24.620788] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:24.621939] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 1970 primary records. [2025-09-24T22:22:24.622043] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-24T22:22:24.636705] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-09-24T22:22:24.636980] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-24T22:22:24.642587] [INFO ] [MAIN ] Derivative Progress: 1036/2075 symbols completed. KORE took 1.1s. Estimated remaining: 6m 47s. Rate: 153.1 symbols/min [2025-09-24T22:22:24.643187] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:24.656836] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:24.657535] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17845 primary records. [2025-09-24T22:22:24.657800] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-24T22:22:24.675141] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-24T22:22:24.675352] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-24T22:22:24.678006] [INFO ] [MAIN ] Derivative Progress: 1037/2075 symbols completed. KOP took 1.1s. Estimated remaining: 6m 46s. Rate: 153.3 symbols/min [2025-09-24T22:22:24.678500] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:24.695410] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:24.696270] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 25908 primary records. [2025-09-24T22:22:24.696400] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-24T22:22:24.727336] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-24T22:22:24.727598] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-24T22:22:24.730384] [INFO ] [MAIN ] Derivative Progress: 1038/2075 symbols completed. KOF took 1.1s. Estimated remaining: 6m 46s. Rate: 153.4 symbols/min [2025-09-24T22:22:24.730974] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:24.771796] [DEBUG] [LOCAL ] KOS: Loaded 53064 existing records from primary storage. [2025-09-24T22:22:24.772097] [INFO ] [MAIN ] KOS: Loaded 53064 primary data records. [2025-09-24T22:22:24.903816] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-24T22:22:24.931062] [INFO ] [MAIN ] KR: Loaded 53682 primary data records. [2025-09-24T22:22:25.131627] [DEBUG] [LOCAL ] KRC: Loaded 48389 existing records from primary storage. [2025-09-24T22:22:25.155942] [INFO ] [MAIN ] KRC: Loaded 48389 primary data records. [2025-09-24T22:22:25.738461] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:25.739532] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53064 primary records. [2025-09-24T22:22:25.739971] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-24T22:22:25.757739] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-24T22:22:25.758317] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-24T22:22:25.761218] [INFO ] [MAIN ] Derivative Progress: 1039/2075 symbols completed. KOS took 1.1s. Estimated remaining: 6m 46s. Rate: 153.2 symbols/min [2025-09-24T22:22:25.761757] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:25.781440] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:25.783723] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53682 primary records. [2025-09-24T22:22:25.784489] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-24T22:22:25.819102] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:25.820467] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48389 primary records. [2025-09-24T22:22:25.820912] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-24T22:22:25.838888] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-24T22:22:25.849617] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-24T22:22:25.852116] [INFO ] [MAIN ] Derivative Progress: 1040/2075 symbols completed. KR took 1.2s. Estimated remaining: 6m 45s. Rate: 153.3 symbols/min [2025-09-24T22:22:25.853764] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-24T22:22:25.852684] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:25.853949] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-24T22:22:25.856502] [INFO ] [MAIN ] Derivative Progress: 1041/2075 symbols completed. KRC took 1.1s. Estimated remaining: 6m 44s. Rate: 153.4 symbols/min [2025-09-24T22:22:25.857630] [DEBUG] [LOCAL ] KREF: Loaded 37132 existing records from primary storage. [2025-09-24T22:22:25.857983] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:25.858133] [INFO ] [MAIN ] KREF: Loaded 37132 primary data records. [2025-09-24T22:22:26.084062] [DEBUG] [LOCAL ] KRO: Loaded 26034 existing records from primary storage. [2025-09-24T22:22:26.089119] [INFO ] [MAIN ] KRO: Loaded 26034 primary data records. [2025-09-24T22:22:26.360292] [DEBUG] [LOCAL ] KRG: Loaded 49177 existing records from primary storage. [2025-09-24T22:22:26.381860] [INFO ] [MAIN ] KRG: Loaded 49177 primary data records. [2025-09-24T22:22:26.887536] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:26.888635] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37132 primary records. [2025-09-24T22:22:26.889355] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-24T22:22:26.929301] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:26.928718] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-24T22:22:26.929978] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-24T22:22:26.932637] [INFO ] [MAIN ] Derivative Progress: 1042/2075 symbols completed. KREF took 1.2s. Estimated remaining: 6m 45s. Rate: 153.2 symbols/min [2025-09-24T22:22:26.934222] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26034 primary records. [2025-09-24T22:22:26.933225] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:26.934564] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-24T22:22:26.972309] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:26.972004] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-24T22:22:26.972454] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-24T22:22:26.973271] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49177 primary records. [2025-09-24T22:22:26.976063] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-24T22:22:26.975985] [INFO ] [MAIN ] Derivative Progress: 1043/2075 symbols completed. KRO took 1.1s. Estimated remaining: 6m 44s. Rate: 153.3 symbols/min [2025-09-24T22:22:26.977121] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:27.004055] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-24T22:22:27.004191] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-24T22:22:27.006588] [INFO ] [MAIN ] Derivative Progress: 1044/2075 symbols completed. KRG took 1.2s. Estimated remaining: 6m 43s. Rate: 153.4 symbols/min [2025-09-24T22:22:27.006983] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:27.021065] [DEBUG] [LOCAL ] KRP: Loaded 37523 existing records from primary storage. [2025-09-24T22:22:27.021284] [INFO ] [MAIN ] KRP: Loaded 37523 primary data records. [2025-09-24T22:22:27.371159] [DEBUG] [LOCAL ] KSS: Loaded 53607 existing records from primary storage. [2025-09-24T22:22:27.371852] [INFO ] [MAIN ] KSS: Loaded 53607 primary data records. [2025-09-24T22:22:27.432129] [DEBUG] [LOCAL ] KT: Loaded 45678 existing records from primary storage. [2025-09-24T22:22:27.437991] [INFO ] [MAIN ] KT: Loaded 45678 primary data records. [2025-09-24T22:22:28.084549] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:28.086043] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37523 primary records. [2025-09-24T22:22:28.086270] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-24T22:22:28.121412] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:28.124415] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53607 primary records. [2025-09-24T22:22:28.124861] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-24T22:22:28.123155] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-24T22:22:28.126053] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-24T22:22:28.129028] [INFO ] [MAIN ] Derivative Progress: 1045/2075 symbols completed. KRP took 1.2s. Estimated remaining: 6m 44s. Rate: 153.2 symbols/min [2025-09-24T22:22:28.137412] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:28.161944] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:28.163822] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45678 primary records. [2025-09-24T22:22:28.164268] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-24T22:22:28.167430] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-24T22:22:28.174991] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-24T22:22:28.182083] [INFO ] [MAIN ] Derivative Progress: 1046/2075 symbols completed. KSS took 1.2s. Estimated remaining: 6m 43s. Rate: 153.3 symbols/min [2025-09-24T22:22:28.182900] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:28.188766] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-24T22:22:28.199698] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-24T22:22:28.202783] [INFO ] [MAIN ] Derivative Progress: 1047/2075 symbols completed. KT took 1.2s. Estimated remaining: 6m 42s. Rate: 153.4 symbols/min [2025-09-24T22:22:28.203236] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:28.216683] [DEBUG] [LOCAL ] KTF: Loaded 12966 existing records from primary storage. [2025-09-24T22:22:28.217742] [INFO ] [MAIN ] KTF: Loaded 12966 primary data records. [2025-09-24T22:22:28.288324] [DEBUG] [LOCAL ] KTB: Loaded 41077 existing records from primary storage. [2025-09-24T22:22:28.323745] [INFO ] [MAIN ] KTB: Loaded 41077 primary data records. [2025-09-24T22:22:28.633117] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-24T22:22:28.789849] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-24T22:22:29.289752] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:29.291331] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12966 primary records. [2025-09-24T22:22:29.291613] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-24T22:22:29.317896] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:29.322573] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41077 primary records. [2025-09-24T22:22:29.324919] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-24T22:22:29.326675] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-24T22:22:29.327095] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-24T22:22:29.329502] [INFO ] [MAIN ] Derivative Progress: 1048/2075 symbols completed. KTF took 1.1s. Estimated remaining: 6m 42s. Rate: 153.1 symbols/min [2025-09-24T22:22:29.348233] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-24T22:22:29.349204] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-24T22:22:29.352530] [INFO ] [MAIN ] Derivative Progress: 1049/2075 symbols completed. KTB took 1.2s. Estimated remaining: 6m 42s. Rate: 153.3 symbols/min [2025-09-24T22:22:29.365143] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:29.365776] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-24T22:22:29.365842] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-24T22:22:29.381348] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-24T22:22:29.381419] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-24T22:22:29.383851] [INFO ] [MAIN ] Derivative Progress: 1050/2075 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 41s. Rate: 153.4 symbols/min [2025-09-24T22:22:29.384757] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:29.384421] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:29.384690] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:29.407465] [DEBUG] [LOCAL ] KWR: Loaded 16760 existing records from primary storage. [2025-09-24T22:22:29.407680] [INFO ] [MAIN ] KWR: Loaded 16760 primary data records. [2025-09-24T22:22:29.611714] [DEBUG] [LOCAL ] KW: Loaded 40700 existing records from primary storage. [2025-09-24T22:22:29.642070] [INFO ] [MAIN ] KW: Loaded 40700 primary data records. [2025-09-24T22:22:29.822667] [DEBUG] [LOCAL ] KVYO: Loaded 49916 existing records from primary storage. [2025-09-24T22:22:29.848596] [INFO ] [MAIN ] KVYO: Loaded 49916 primary data records. [2025-09-24T22:22:30.493029] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:30.494464] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16760 primary records. [2025-09-24T22:22:30.494789] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-24T22:22:30.517249] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-24T22:22:30.517623] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-24T22:22:30.520277] [INFO ] [MAIN ] Derivative Progress: 1051/2075 symbols completed. KWR took 1.1s. Estimated remaining: 6m 41s. Rate: 153.1 symbols/min [2025-09-24T22:22:30.528703] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:30.534481] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:30.535329] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40700 primary records. [2025-09-24T22:22:30.535931] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-24T22:22:30.563829] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-24T22:22:30.577253] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-24T22:22:30.579810] [INFO ] [MAIN ] Derivative Progress: 1052/2075 symbols completed. KW took 1.2s. Estimated remaining: 6m 40s. Rate: 153.3 symbols/min [2025-09-24T22:22:30.569166] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:30.581166] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 49916 primary records. [2025-09-24T22:22:30.581282] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:30.581448] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-24T22:22:30.606452] [DEBUG] [LOCAL ] KYN: Loaded 30081 existing records from primary storage. [2025-09-24T22:22:30.607405] [INFO ] [MAIN ] KYN: Loaded 30081 primary data records. [2025-09-24T22:22:30.725399] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-24T22:22:30.725590] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-24T22:22:30.728528] [INFO ] [MAIN ] Derivative Progress: 1053/2075 symbols completed. KVYO took 1.3s. Estimated remaining: 6m 40s. Rate: 153.4 symbols/min [2025-09-24T22:22:30.734571] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:30.942183] [DEBUG] [LOCAL ] L: Loaded 40956 existing records from primary storage. [2025-09-24T22:22:30.942451] [INFO ] [MAIN ] L: Loaded 40956 primary data records. [2025-09-24T22:22:31.289375] [DEBUG] [LOCAL ] LAC: Loaded 52311 existing records from primary storage. [2025-09-24T22:22:31.290203] [INFO ] [MAIN ] LAC: Loaded 52311 primary data records. [2025-09-24T22:22:31.458675] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:31.501847] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30081 primary records. [2025-09-24T22:22:31.606967] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-24T22:22:31.647867] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-24T22:22:31.648463] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-24T22:22:31.656682] [INFO ] [MAIN ] Derivative Progress: 1054/2075 symbols completed. KYN took 1.1s. Estimated remaining: 6m 40s. Rate: 153.2 symbols/min [2025-09-24T22:22:31.669327] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:31.670928] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:31.672059] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40956 primary records. [2025-09-24T22:22:31.672268] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-24T22:22:31.698029] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-24T22:22:31.698172] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-24T22:22:31.701763] [INFO ] [MAIN ] Derivative Progress: 1055/2075 symbols completed. L took 1.1s. Estimated remaining: 6m 39s. Rate: 153.3 symbols/min [2025-09-24T22:22:31.702859] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:31.736525] [DEBUG] [LOCAL ] LAD: Loaded 23631 existing records from primary storage. [2025-09-24T22:22:31.736781] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:31.737691] [INFO ] [MAIN ] LAD: Loaded 23631 primary data records. [2025-09-24T22:22:31.737523] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52311 primary records. [2025-09-24T22:22:31.743020] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-24T22:22:31.889895] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-24T22:22:31.915431] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-24T22:22:31.966058] [INFO ] [MAIN ] Derivative Progress: 1056/2075 symbols completed. LAC took 1.2s. Estimated remaining: 6m 39s. Rate: 153.3 symbols/min [2025-09-24T22:22:31.967088] [DEBUG] [LOCAL ] LADR: Loaded 38668 existing records from primary storage. [2025-09-24T22:22:31.967215] [INFO ] [MAIN ] LADR: Loaded 38668 primary data records. [2025-09-24T22:22:32.080752] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:32.188423] [DEBUG] [LOCAL ] LANV: Loaded 2781 existing records from primary storage. [2025-09-24T22:22:32.267596] [INFO ] [MAIN ] LANV: Loaded 2781 primary data records. [2025-09-24T22:22:32.754957] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:32.756517] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23631 primary records. [2025-09-24T22:22:32.757959] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-24T22:22:32.776900] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-24T22:22:32.778035] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-24T22:22:32.780442] [INFO ] [MAIN ] Derivative Progress: 1057/2075 symbols completed. LAD took 1.1s. Estimated remaining: 6m 39s. Rate: 153.2 symbols/min [2025-09-24T22:22:32.781022] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:32.798278] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:32.799112] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38668 primary records. [2025-09-24T22:22:32.802941] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-24T22:22:32.822251] [DEBUG] [LOCAL ] LAW: Loaded 13939 existing records from primary storage. [2025-09-24T22:22:32.825367] [INFO ] [MAIN ] LAW: Loaded 13939 primary data records. [2025-09-24T22:22:32.839051] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-24T22:22:32.864739] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-24T22:22:32.875481] [INFO ] [MAIN ] Derivative Progress: 1058/2075 symbols completed. LADR took 1.2s. Estimated remaining: 6m 38s. Rate: 153.3 symbols/min [2025-09-24T22:22:32.933130] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:32.932887] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:22:32.950850] [INFO ] [MAIN ] LANV: Generated 1792 derivative records from 2781 primary records. [2025-09-24T22:22:32.951335] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-24T22:22:33.046484] [DEBUG] [LOCAL ] LANV: Derivative data saved (1792 records). [2025-09-24T22:22:33.152740] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-24T22:22:33.165791] [INFO ] [MAIN ] Derivative Progress: 1059/2075 symbols completed. LANV took 1.1s. Estimated remaining: 6m 38s. Rate: 153.3 symbols/min [2025-09-24T22:22:33.166374] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:33.210692] [DEBUG] [LOCAL ] LAZ: Loaded 45202 existing records from primary storage. [2025-09-24T22:22:33.224345] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:33.223990] [INFO ] [MAIN ] LAZ: Loaded 45202 primary data records. [2025-09-24T22:22:33.234221] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13939 primary records. [2025-09-24T22:22:33.234571] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-24T22:22:33.379082] [DEBUG] [LOCAL ] LB: Loaded 37678 existing records from primary storage. [2025-09-24T22:22:33.390882] [INFO ] [MAIN ] LB: Loaded 37678 primary data records. [2025-09-24T22:22:33.442868] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-24T22:22:33.494958] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-24T22:22:33.532471] [INFO ] [MAIN ] Derivative Progress: 1060/2075 symbols completed. LAW took 0.8s. Estimated remaining: 6m 37s. Rate: 153.3 symbols/min [2025-09-24T22:22:33.681250] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:33.937896] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:33.939541] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 45202 primary records. [2025-09-24T22:22:33.939852] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-24T22:22:33.991896] [DEBUG] [LOCAL ] LBRT: Loaded 52919 existing records from primary storage. [2025-09-24T22:22:33.992708] [INFO ] [MAIN ] LBRT: Loaded 52919 primary data records. [2025-09-24T22:22:33.992300] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:34.016254] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37678 primary records. [2025-09-24T22:22:34.033400] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-24T22:22:34.054807] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-24T22:22:34.070816] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-24T22:22:34.085864] [INFO ] [MAIN ] Derivative Progress: 1061/2075 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 37s. Rate: 153.3 symbols/min [2025-09-24T22:22:34.101295] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:34.137431] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-24T22:22:34.137634] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-24T22:22:34.145732] [INFO ] [MAIN ] Derivative Progress: 1062/2075 symbols completed. LB took 1.0s. Estimated remaining: 6m 36s. Rate: 153.4 symbols/min [2025-09-24T22:22:34.151142] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:34.404986] [DEBUG] [MAIN ] LBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:34.404606] [DEBUG] [LOCAL ] LCII: Loaded 28619 existing records from primary storage. [2025-09-24T22:22:34.419054] [INFO ] [MAIN ] LCII: Loaded 28619 primary data records. [2025-09-24T22:22:34.405974] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52919 primary records. [2025-09-24T22:22:34.459917] [DEBUG] [LOCAL ] LC: Loaded 47900 existing records from primary storage. [2025-09-24T22:22:34.467390] [INFO ] [MAIN ] LC: Loaded 47900 primary data records. [2025-09-24T22:22:34.467483] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-24T22:22:34.881932] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-24T22:22:34.919172] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-24T22:22:34.930518] [INFO ] [MAIN ] Derivative Progress: 1063/2075 symbols completed. LBRT took 1.4s. Estimated remaining: 6m 36s. Rate: 153.2 symbols/min [2025-09-24T22:22:35.101722] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:35.102529] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28619 primary records. [2025-09-24T22:22:35.102809] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-24T22:22:35.135090] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:35.135583] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-24T22:22:35.135696] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-24T22:22:35.136388] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47900 primary records. [2025-09-24T22:22:35.138967] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-24T22:22:35.138845] [INFO ] [MAIN ] Derivative Progress: 1064/2075 symbols completed. LCII took 1.0s. Estimated remaining: 6m 36s. Rate: 153.3 symbols/min [2025-09-24T22:22:35.155673] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-24T22:22:35.155743] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-24T22:22:35.158261] [INFO ] [MAIN ] Derivative Progress: 1065/2075 symbols completed. LC took 1.1s. Estimated remaining: 6m 35s. Rate: 153.5 symbols/min [2025-09-24T22:22:35.159060] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:35.158944] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:35.159187] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:35.176030] [DEBUG] [LOCAL ] LDP: Loaded 12957 existing records from primary storage. [2025-09-24T22:22:35.176292] [INFO ] [MAIN ] LDP: Loaded 12957 primary data records. [2025-09-24T22:22:35.529212] [DEBUG] [LOCAL ] LDOS: Loaded 45746 existing records from primary storage. [2025-09-24T22:22:35.530881] [INFO ] [MAIN ] LDOS: Loaded 45746 primary data records. [2025-09-24T22:22:35.530626] [DEBUG] [LOCAL ] LDI: Loaded 44007 existing records from primary storage. [2025-09-24T22:22:35.542759] [INFO ] [MAIN ] LDI: Loaded 44007 primary data records. [2025-09-24T22:22:36.246927] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:36.248499] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12957 primary records. [2025-09-24T22:22:36.248600] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-24T22:22:36.266406] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-24T22:22:36.266618] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-24T22:22:36.269244] [INFO ] [MAIN ] Derivative Progress: 1066/2075 symbols completed. LDP took 1.1s. Estimated remaining: 6m 35s. Rate: 153.2 symbols/min [2025-09-24T22:22:36.269608] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:36.286929] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:36.287674] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45746 primary records. [2025-09-24T22:22:36.288000] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-24T22:22:36.321162] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:36.322800] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44007 primary records. [2025-09-24T22:22:36.323330] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-24T22:22:36.324952] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-24T22:22:36.325342] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-24T22:22:36.335012] [INFO ] [MAIN ] Derivative Progress: 1067/2075 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 35s. Rate: 153.3 symbols/min [2025-09-24T22:22:36.336938] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:36.355044] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-24T22:22:36.355282] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-24T22:22:36.357946] [INFO ] [MAIN ] Derivative Progress: 1068/2075 symbols completed. LDI took 1.2s. Estimated remaining: 6m 34s. Rate: 153.4 symbols/min [2025-09-24T22:22:36.359102] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:36.372015] [DEBUG] [LOCAL ] LEA: Loaded 41801 existing records from primary storage. [2025-09-24T22:22:36.372229] [INFO ] [MAIN ] LEA: Loaded 41801 primary data records. [2025-09-24T22:22:36.721967] [DEBUG] [LOCAL ] LEG: Loaded 50384 existing records from primary storage. [2025-09-24T22:22:36.722858] [INFO ] [MAIN ] LEG: Loaded 50384 primary data records. [2025-09-24T22:22:36.835362] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-24T22:22:36.851874] [INFO ] [MAIN ] LEN: Loaded 53191 primary data records. [2025-09-24T22:22:37.374246] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:37.375464] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41801 primary records. [2025-09-24T22:22:37.376281] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-24T22:22:37.396056] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-24T22:22:37.396241] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-24T22:22:37.398604] [INFO ] [MAIN ] Derivative Progress: 1069/2075 symbols completed. LEA took 1.1s. Estimated remaining: 6m 34s. Rate: 153.2 symbols/min [2025-09-24T22:22:37.400087] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:37.424136] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:37.426114] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50384 primary records. [2025-09-24T22:22:37.433683] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-24T22:22:37.434390] [DEBUG] [LOCAL ] LEO: Loaded 17545 existing records from primary storage. [2025-09-24T22:22:37.434720] [INFO ] [MAIN ] LEO: Loaded 17545 primary data records. [2025-09-24T22:22:37.511047] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-24T22:22:37.524840] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:37.543034] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53191 primary records. [2025-09-24T22:22:37.533055] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-24T22:22:37.548391] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-24T22:22:37.562465] [INFO ] [MAIN ] Derivative Progress: 1070/2075 symbols completed. LEG took 1.2s. Estimated remaining: 6m 33s. Rate: 153.3 symbols/min [2025-09-24T22:22:37.588830] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:37.684052] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-24T22:22:37.691743] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-24T22:22:37.737079] [INFO ] [MAIN ] Derivative Progress: 1071/2075 symbols completed. LEN took 1.4s. Estimated remaining: 6m 33s. Rate: 153.4 symbols/min [2025-09-24T22:22:37.804087] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:37.848833] [DEBUG] [LOCAL ] LFT: Loaded 18087 existing records from primary storage. [2025-09-24T22:22:37.849118] [INFO ] [MAIN ] LFT: Loaded 18087 primary data records. [2025-09-24T22:22:37.874817] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:37.896305] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17545 primary records. [2025-09-24T22:22:37.896413] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-24T22:22:37.982462] [DEBUG] [LOCAL ] LEVI: Loaded 51549 existing records from primary storage. [2025-09-24T22:22:37.982670] [INFO ] [MAIN ] LEVI: Loaded 51549 primary data records. [2025-09-24T22:22:37.981261] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-24T22:22:37.996432] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-24T22:22:38.002176] [INFO ] [MAIN ] Derivative Progress: 1072/2075 symbols completed. LEO took 0.6s. Estimated remaining: 6m 32s. Rate: 153.4 symbols/min [2025-09-24T22:22:38.013844] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:38.359536] [DEBUG] [LOCAL ] LGI: Loaded 10017 existing records from primary storage. [2025-09-24T22:22:38.431263] [INFO ] [MAIN ] LGI: Loaded 10017 primary data records. [2025-09-24T22:22:38.937062] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:38.938632] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18087 primary records. [2025-09-24T22:22:38.938816] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-24T22:22:38.953423] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:38.955880] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51549 primary records. [2025-09-24T22:22:38.956905] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-24T22:22:38.992112] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-24T22:22:38.993288] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-24T22:22:38.994906] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-24T22:22:38.997399] [INFO ] [MAIN ] Derivative Progress: 1073/2075 symbols completed. LFT took 1.2s. Estimated remaining: 6m 32s. Rate: 153.2 symbols/min [2025-09-24T22:22:38.997889] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:38.997963] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-24T22:22:39.000691] [INFO ] [MAIN ] Derivative Progress: 1074/2075 symbols completed. LEVI took 1.4s. Estimated remaining: 6m 32s. Rate: 153.3 symbols/min [2025-09-24T22:22:39.001841] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:39.020639] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:39.021457] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10017 primary records. [2025-09-24T22:22:39.021549] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-24T22:22:39.042465] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-24T22:22:39.042786] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-24T22:22:39.045030] [INFO ] [MAIN ] Derivative Progress: 1075/2075 symbols completed. LGI took 1.0s. Estimated remaining: 6m 31s. Rate: 153.5 symbols/min [2025-09-24T22:22:39.045517] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:39.073172] [DEBUG] [LOCAL ] LH: Loaded 38227 existing records from primary storage. [2025-09-24T22:22:39.073394] [INFO ] [MAIN ] LH: Loaded 38227 primary data records. [2025-09-24T22:22:39.262661] [DEBUG] [LOCAL ] LHX: Loaded 48707 existing records from primary storage. [2025-09-24T22:22:39.262932] [INFO ] [MAIN ] LHX: Loaded 48707 primary data records. [2025-09-24T22:22:39.376966] [DEBUG] [LOCAL ] LII: Loaded 28324 existing records from primary storage. [2025-09-24T22:22:39.389095] [INFO ] [MAIN ] LII: Loaded 28324 primary data records. [2025-09-24T22:22:40.068240] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:40.069449] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 38227 primary records. [2025-09-24T22:22:40.069864] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-24T22:22:40.091507] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-24T22:22:40.092201] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-24T22:22:40.106792] [INFO ] [MAIN ] Derivative Progress: 1076/2075 symbols completed. LH took 1.1s. Estimated remaining: 6m 31s. Rate: 153.2 symbols/min [2025-09-24T22:22:40.108519] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:40.108936] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:40.111761] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48707 primary records. [2025-09-24T22:22:40.112020] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-24T22:22:40.133442] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:40.135284] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28324 primary records. [2025-09-24T22:22:40.138726] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-24T22:22:40.159542] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-24T22:22:40.159715] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-24T22:22:40.162173] [INFO ] [MAIN ] Derivative Progress: 1077/2075 symbols completed. LHX took 1.2s. Estimated remaining: 6m 31s. Rate: 153.3 symbols/min [2025-09-24T22:22:40.163103] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:40.166811] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-24T22:22:40.166979] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-24T22:22:40.169682] [INFO ] [MAIN ] Derivative Progress: 1078/2075 symbols completed. LII took 1.1s. Estimated remaining: 6m 30s. Rate: 153.5 symbols/min [2025-09-24T22:22:40.182839] [DEBUG] [LOCAL ] LITB: Loaded 4382 existing records from primary storage. [2025-09-24T22:22:40.183010] [INFO ] [MAIN ] LITB: Loaded 4382 primary data records. [2025-09-24T22:22:40.318565] [DEBUG] [LOCAL ] LION: Loaded 43248 existing records from primary storage. [2025-09-24T22:22:40.329679] [INFO ] [MAIN ] LION: Loaded 43248 primary data records. [2025-09-24T22:22:40.899920] [DEBUG] [MAIN ] LITB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:40.900775] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4382 primary records. [2025-09-24T22:22:40.900955] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-24T22:22:40.915740] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-24T22:22:40.915959] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-24T22:22:40.918224] [INFO ] [MAIN ] Derivative Progress: 1079/2075 symbols completed. LITB took 0.8s. Estimated remaining: 6m 30s. Rate: 153.3 symbols/min [2025-09-24T22:22:40.933475] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:40.934146] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 43248 primary records. [2025-09-24T22:22:40.934208] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-24T22:22:40.949197] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-24T22:22:40.949262] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-24T22:22:40.951624] [INFO ] [MAIN ] Derivative Progress: 1080/2075 symbols completed. LION took 0.8s. Estimated remaining: 6m 29s. Rate: 153.5 symbols/min [2025-09-24T22:22:40.952374] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:40.952584] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:40.952524] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:41.050501] [DEBUG] [LOCAL ] LMT: Loaded 49894 existing records from primary storage. [2025-09-24T22:22:41.052228] [INFO ] [MAIN ] LMT: Loaded 49894 primary data records. [2025-09-24T22:22:41.052103] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-09-24T22:22:41.070347] [INFO ] [MAIN ] LMND: Loaded 51874 primary data records. [2025-09-24T22:22:41.160813] [DEBUG] [LOCAL ] LLY: Loaded 53288 existing records from primary storage. [2025-09-24T22:22:41.214597] [INFO ] [MAIN ] LLY: Loaded 53288 primary data records. [2025-09-24T22:22:42.393835] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:42.397015] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49894 primary records. [2025-09-24T22:22:42.397450] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-24T22:22:42.396099] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:42.398980] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51874 primary records. [2025-09-24T22:22:42.400348] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-24T22:22:42.446786] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:42.448902] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53288 primary records. [2025-09-24T22:22:42.449241] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-24T22:22:42.450726] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-24T22:22:42.450222] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-24T22:22:42.450862] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-24T22:22:42.450673] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-24T22:22:42.453169] [INFO ] [MAIN ] Derivative Progress: 1081/2075 symbols completed. LMND took 1.5s. Estimated remaining: 6m 30s. Rate: 153.1 symbols/min [2025-09-24T22:22:42.455626] [INFO ] [MAIN ] Derivative Progress: 1082/2075 symbols completed. LMT took 1.5s. Estimated remaining: 6m 29s. Rate: 153.2 symbols/min [2025-09-24T22:22:42.457038] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:42.455445] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:42.482869] [DEBUG] [LOCAL ] LND: Loaded 4968 existing records from primary storage. [2025-09-24T22:22:42.483901] [INFO ] [MAIN ] LND: Loaded 4968 primary data records. [2025-09-24T22:22:42.507630] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-24T22:22:42.532317] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-24T22:22:42.566278] [INFO ] [MAIN ] Derivative Progress: 1083/2075 symbols completed. LLY took 1.6s. Estimated remaining: 6m 28s. Rate: 153.3 symbols/min [2025-09-24T22:22:42.583628] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:42.888414] [DEBUG] [LOCAL ] LNC: Loaded 51623 existing records from primary storage. [2025-09-24T22:22:42.888901] [INFO ] [MAIN ] LNC: Loaded 51623 primary data records. [2025-09-24T22:22:43.154699] [DEBUG] [LOCAL ] LNG: Loaded 51493 existing records from primary storage. [2025-09-24T22:22:43.225750] [INFO ] [MAIN ] LNG: Loaded 51493 primary data records. [2025-09-24T22:22:43.619729] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:43.634863] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4968 primary records. [2025-09-24T22:22:43.635425] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-24T22:22:43.652861] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-24T22:22:43.653316] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-24T22:22:43.655627] [INFO ] [MAIN ] Derivative Progress: 1084/2075 symbols completed. LND took 1.2s. Estimated remaining: 6m 28s. Rate: 153.1 symbols/min [2025-09-24T22:22:43.656677] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:43.676385] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:43.680861] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51623 primary records. [2025-09-24T22:22:43.681048] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-24T22:22:43.699285] [DEBUG] [LOCAL ] LNN: Loaded 11268 existing records from primary storage. [2025-09-24T22:22:43.699884] [INFO ] [MAIN ] LNN: Loaded 11268 primary data records. [2025-09-24T22:22:43.818457] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-24T22:22:43.846710] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-24T22:22:43.854194] [INFO ] [MAIN ] Derivative Progress: 1085/2075 symbols completed. LNC took 1.4s. Estimated remaining: 6m 28s. Rate: 153.1 symbols/min [2025-09-24T22:22:43.865268] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:43.923203] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:44.049199] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51493 primary records. [2025-09-24T22:22:44.049419] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-24T22:22:44.072812] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-24T22:22:44.073228] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-24T22:22:44.075990] [INFO ] [MAIN ] Derivative Progress: 1086/2075 symbols completed. LNG took 1.5s. Estimated remaining: 6m 27s. Rate: 153.2 symbols/min [2025-09-24T22:22:44.076559] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:44.107208] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:44.108214] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11268 primary records. [2025-09-24T22:22:44.122820] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-24T22:22:44.141710] [DEBUG] [LOCAL ] LOAR: Loaded 41692 existing records from primary storage. [2025-09-24T22:22:44.146874] [INFO ] [MAIN ] LOAR: Loaded 41692 primary data records. [2025-09-24T22:22:44.192611] [DEBUG] [LOCAL ] LOB: Loaded 27485 existing records from primary storage. [2025-09-24T22:22:44.211622] [INFO ] [MAIN ] LOB: Loaded 27485 primary data records. [2025-09-24T22:22:44.256982] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-24T22:22:44.272531] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-24T22:22:44.279963] [INFO ] [MAIN ] Derivative Progress: 1087/2075 symbols completed. LNN took 0.6s. Estimated remaining: 6m 27s. Rate: 153.3 symbols/min [2025-09-24T22:22:44.352303] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:44.600542] [DEBUG] [LOCAL ] LOCL: Loaded 3595 existing records from primary storage. [2025-09-24T22:22:44.642870] [INFO ] [MAIN ] LOCL: Loaded 3595 primary data records. [2025-09-24T22:22:45.203322] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:45.204349] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41692 primary records. [2025-09-24T22:22:45.204586] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-24T22:22:45.240989] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-24T22:22:45.241350] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:45.242248] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27485 primary records. [2025-09-24T22:22:45.242600] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-24T22:22:45.244928] [INFO ] [MAIN ] Derivative Progress: 1088/2075 symbols completed. LOAR took 1.4s. Estimated remaining: 6m 27s. Rate: 153.1 symbols/min [2025-09-24T22:22:45.242712] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-24T22:22:45.246137] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:45.267405] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-24T22:22:45.267802] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-24T22:22:45.284539] [INFO ] [MAIN ] Derivative Progress: 1089/2075 symbols completed. LOB took 1.2s. Estimated remaining: 6m 26s. Rate: 153.2 symbols/min [2025-09-24T22:22:45.285679] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:45.286019] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:45.286911] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3595 primary records. [2025-09-24T22:22:45.287106] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-24T22:22:45.317074] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-24T22:22:45.317234] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-24T22:22:45.319699] [INFO ] [MAIN ] Derivative Progress: 1090/2075 symbols completed. LOCL took 1.0s. Estimated remaining: 6m 25s. Rate: 153.3 symbols/min [2025-09-24T22:22:45.320194] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:45.339988] [DEBUG] [LOCAL ] LOMA: Loaded 31918 existing records from primary storage. [2025-09-24T22:22:45.340297] [INFO ] [MAIN ] LOMA: Loaded 31918 primary data records. [2025-09-24T22:22:45.608962] [DEBUG] [LOCAL ] LOW: Loaded 52958 existing records from primary storage. [2025-09-24T22:22:45.708471] [INFO ] [MAIN ] LOW: Loaded 52958 primary data records. [2025-09-24T22:22:45.755024] [DEBUG] [LOCAL ] LPG: Loaded 40053 existing records from primary storage. [2025-09-24T22:22:45.789789] [INFO ] [MAIN ] LPG: Loaded 40053 primary data records. [2025-09-24T22:22:46.372875] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:46.374303] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 31918 primary records. [2025-09-24T22:22:46.376355] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-24T22:22:46.415171] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:46.417565] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52958 primary records. [2025-09-24T22:22:46.417931] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-24T22:22:46.421375] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-24T22:22:46.421842] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-24T22:22:46.436581] [INFO ] [MAIN ] Derivative Progress: 1091/2075 symbols completed. LOMA took 1.2s. Estimated remaining: 6m 26s. Rate: 153.1 symbols/min [2025-09-24T22:22:46.441394] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:46.442080] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-24T22:22:46.443637] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-24T22:22:46.446063] [INFO ] [MAIN ] Derivative Progress: 1092/2075 symbols completed. LOW took 1.2s. Estimated remaining: 6m 25s. Rate: 153.2 symbols/min [2025-09-24T22:22:46.446889] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:46.465396] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:46.466519] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 40053 primary records. [2025-09-24T22:22:46.466782] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-24T22:22:46.505928] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-24T22:22:46.506616] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-24T22:22:46.509164] [INFO ] [MAIN ] Derivative Progress: 1093/2075 symbols completed. LPG took 1.2s. Estimated remaining: 6m 24s. Rate: 153.3 symbols/min [2025-09-24T22:22:46.506503] [DEBUG] [LOCAL ] LPL: Loaded 25786 existing records from primary storage. [2025-09-24T22:22:46.509807] [INFO ] [MAIN ] LPL: Loaded 25786 primary data records. [2025-09-24T22:22:46.667964] [DEBUG] [LOCAL ] LPX: Loaded 39704 existing records from primary storage. [2025-09-24T22:22:46.674078] [INFO ] [MAIN ] LPX: Loaded 39704 primary data records. [2025-09-24T22:22:47.275322] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:47.276344] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 25786 primary records. [2025-09-24T22:22:47.276545] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-24T22:22:47.294217] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-24T22:22:47.294354] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-24T22:22:47.296716] [INFO ] [MAIN ] Derivative Progress: 1094/2075 symbols completed. LPL took 0.9s. Estimated remaining: 6m 24s. Rate: 153.2 symbols/min [2025-09-24T22:22:47.313951] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:47.314571] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39704 primary records. [2025-09-24T22:22:47.314633] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-24T22:22:47.330335] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-24T22:22:47.330405] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-24T22:22:47.332896] [INFO ] [MAIN ] Derivative Progress: 1095/2075 symbols completed. LPX took 0.9s. Estimated remaining: 6m 24s. Rate: 153.3 symbols/min [2025-09-24T22:22:47.334011] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:47.334315] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:47.334167] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:47.391088] [DEBUG] [LOCAL ] LTC: Loaded 29980 existing records from primary storage. [2025-09-24T22:22:47.391238] [INFO ] [MAIN ] LTC: Loaded 29980 primary data records. [2025-09-24T22:22:47.514817] [DEBUG] [LOCAL ] LSPD: Loaded 43263 existing records from primary storage. [2025-09-24T22:22:47.533752] [INFO ] [MAIN ] LSPD: Loaded 43263 primary data records. [2025-09-24T22:22:47.534793] [DEBUG] [LOCAL ] LRN: Loaded 39954 existing records from primary storage. [2025-09-24T22:22:47.564256] [INFO ] [MAIN ] LRN: Loaded 39954 primary data records. [2025-09-24T22:22:48.457770] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:48.458714] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 29980 primary records. [2025-09-24T22:22:48.459193] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-24T22:22:48.482634] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-24T22:22:48.490861] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-24T22:22:48.497677] [INFO ] [MAIN ] Derivative Progress: 1096/2075 symbols completed. LTC took 1.2s. Estimated remaining: 6m 24s. Rate: 153.0 symbols/min [2025-09-24T22:22:48.498060] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:48.499261] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:48.499175] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39954 primary records. [2025-09-24T22:22:48.507586] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-24T22:22:48.514545] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:48.515603] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 43263 primary records. [2025-09-24T22:22:48.522983] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-24T22:22:48.531889] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-24T22:22:48.532241] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-24T22:22:48.534510] [INFO ] [MAIN ] Derivative Progress: 1097/2075 symbols completed. LRN took 1.2s. Estimated remaining: 6m 23s. Rate: 153.1 symbols/min [2025-09-24T22:22:48.542273] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:48.553834] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-24T22:22:48.554345] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-24T22:22:48.557027] [INFO ] [MAIN ] Derivative Progress: 1098/2075 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 22s. Rate: 153.3 symbols/min [2025-09-24T22:22:48.557377] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:48.615133] [DEBUG] [LOCAL ] LTH: Loaded 51869 existing records from primary storage. [2025-09-24T22:22:48.615472] [INFO ] [MAIN ] LTH: Loaded 51869 primary data records. [2025-09-24T22:22:48.616223] [DEBUG] [LOCAL ] LTM: Loaded 36299 existing records from primary storage. [2025-09-24T22:22:48.627905] [INFO ] [MAIN ] LTM: Loaded 36299 primary data records. [2025-09-24T22:22:49.023748] [DEBUG] [LOCAL ] LU: Loaded 48960 existing records from primary storage. [2025-09-24T22:22:49.052715] [INFO ] [MAIN ] LU: Loaded 48960 primary data records. [2025-09-24T22:22:49.650376] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:49.652185] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36299 primary records. [2025-09-24T22:22:49.653164] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-24T22:22:49.685126] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-24T22:22:49.683082] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:49.685534] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-24T22:22:49.686406] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51869 primary records. [2025-09-24T22:22:49.689007] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-24T22:22:49.688923] [INFO ] [MAIN ] Derivative Progress: 1099/2075 symbols completed. LTM took 1.1s. Estimated remaining: 6m 23s. Rate: 153.0 symbols/min [2025-09-24T22:22:49.690426] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:49.711186] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-24T22:22:49.711530] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-24T22:22:49.714104] [INFO ] [MAIN ] Derivative Progress: 1100/2075 symbols completed. LTH took 1.2s. Estimated remaining: 6m 22s. Rate: 153.1 symbols/min [2025-09-24T22:22:49.714782] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:49.729166] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:49.730147] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48960 primary records. [2025-09-24T22:22:49.730353] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-24T22:22:49.776579] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-24T22:22:49.776867] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-24T22:22:49.781092] [INFO ] [MAIN ] Derivative Progress: 1101/2075 symbols completed. LU took 1.2s. Estimated remaining: 6m 21s. Rate: 153.3 symbols/min [2025-09-24T22:22:49.781855] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:49.804450] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-24T22:22:49.804682] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-24T22:22:50.147500] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-24T22:22:50.161958] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-24T22:22:50.296881] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-24T22:22:50.309315] [INFO ] [MAIN ] LVS: Loaded 53564 primary data records. [2025-09-24T22:22:50.837031] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:50.852135] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-24T22:22:50.852780] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-24T22:22:50.870568] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-24T22:22:50.870831] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-24T22:22:50.873404] [INFO ] [MAIN ] Derivative Progress: 1102/2075 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 22s. Rate: 153.0 symbols/min [2025-09-24T22:22:50.873827] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:50.893627] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:50.895815] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-24T22:22:50.896146] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-24T22:22:50.922929] [DEBUG] [LOCAL ] LVWR: Loaded 17553 existing records from primary storage. [2025-09-24T22:22:50.924197] [INFO ] [MAIN ] LVWR: Loaded 17553 primary data records. [2025-09-24T22:22:50.925521] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-24T22:22:50.963278] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-24T22:22:50.984776] [INFO ] [MAIN ] Derivative Progress: 1103/2075 symbols completed. LUV took 1.3s. Estimated remaining: 6m 21s. Rate: 153.1 symbols/min [2025-09-24T22:22:51.006330] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:51.103944] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:51.136456] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53564 primary records. [2025-09-24T22:22:51.296105] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-24T22:22:51.344776] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-24T22:22:51.344936] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-24T22:22:51.347423] [INFO ] [MAIN ] Derivative Progress: 1104/2075 symbols completed. LVS took 1.6s. Estimated remaining: 6m 20s. Rate: 153.1 symbols/min [2025-09-24T22:22:51.347988] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:51.370146] [DEBUG] [LOCAL ] LW: Loaded 51165 existing records from primary storage. [2025-09-24T22:22:51.374805] [INFO ] [MAIN ] LW: Loaded 51165 primary data records. [2025-09-24T22:22:51.450827] [DEBUG] [LOCAL ] LXFR: Loaded 17085 existing records from primary storage. [2025-09-24T22:22:51.476072] [INFO ] [MAIN ] LXFR: Loaded 17085 primary data records. [2025-09-24T22:22:51.540085] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:51.553638] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17553 primary records. [2025-09-24T22:22:51.561226] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-24T22:22:51.906094] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-24T22:22:51.906714] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-24T22:22:51.908921] [INFO ] [MAIN ] Derivative Progress: 1105/2075 symbols completed. LVWR took 1.0s. Estimated remaining: 6m 20s. Rate: 153.1 symbols/min [2025-09-24T22:22:52.034004] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:52.066251] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:52.067394] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51165 primary records. [2025-09-24T22:22:52.068101] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-24T22:22:52.099737] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-24T22:22:52.114838] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:52.115671] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 17085 primary records. [2025-09-24T22:22:52.114445] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-24T22:22:52.118145] [INFO ] [MAIN ] Derivative Progress: 1106/2075 symbols completed. LW took 1.1s. Estimated remaining: 6m 20s. Rate: 153.1 symbols/min [2025-09-24T22:22:52.118590] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:52.118537] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-24T22:22:52.152553] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-24T22:22:52.152867] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-24T22:22:52.155323] [INFO ] [MAIN ] Derivative Progress: 1107/2075 symbols completed. LXFR took 0.8s. Estimated remaining: 6m 19s. Rate: 153.2 symbols/min [2025-09-24T22:22:52.156716] [DEBUG] [LOCAL ] LXP: Loaded 50657 existing records from primary storage. [2025-09-24T22:22:52.156967] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:52.157305] [INFO ] [MAIN ] LXP: Loaded 50657 primary data records. [2025-09-24T22:22:52.275528] [DEBUG] [LOCAL ] LXU: Loaded 32004 existing records from primary storage. [2025-09-24T22:22:52.297685] [INFO ] [MAIN ] LXU: Loaded 32004 primary data records. [2025-09-24T22:22:52.884055] [DEBUG] [LOCAL ] LYG: Loaded 52864 existing records from primary storage. [2025-09-24T22:22:52.884372] [INFO ] [MAIN ] LYG: Loaded 52864 primary data records. [2025-09-24T22:22:53.222567] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:53.223921] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50657 primary records. [2025-09-24T22:22:53.224295] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-24T22:22:53.262583] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:53.263913] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 32004 primary records. [2025-09-24T22:22:53.264131] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-24T22:22:53.263090] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-24T22:22:53.265399] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-24T22:22:53.269036] [INFO ] [MAIN ] Derivative Progress: 1108/2075 symbols completed. LXP took 1.2s. Estimated remaining: 6m 19s. Rate: 153.0 symbols/min [2025-09-24T22:22:53.285726] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-24T22:22:53.285913] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-24T22:22:53.288454] [INFO ] [MAIN ] Derivative Progress: 1109/2075 symbols completed. LXU took 1.2s. Estimated remaining: 6m 19s. Rate: 153.1 symbols/min [2025-09-24T22:22:53.305160] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:53.305873] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52864 primary records. [2025-09-24T22:22:53.305939] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-24T22:22:53.321826] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-24T22:22:53.321915] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-24T22:22:53.324092] [INFO ] [MAIN ] Derivative Progress: 1110/2075 symbols completed. LYG took 1.2s. Estimated remaining: 6m 18s. Rate: 153.2 symbols/min [2025-09-24T22:22:53.324720] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:53.325101] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:53.325015] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:53.340975] [DEBUG] [LOCAL ] LZM: Loaded 13587 existing records from primary storage. [2025-09-24T22:22:53.341089] [INFO ] [MAIN ] LZM: Loaded 13587 primary data records. [2025-09-24T22:22:53.567768] [DEBUG] [LOCAL ] LZB: Loaded 35569 existing records from primary storage. [2025-09-24T22:22:53.724538] [INFO ] [MAIN ] LZB: Loaded 35569 primary data records. [2025-09-24T22:22:53.741216] [DEBUG] [LOCAL ] LYV: Loaded 51163 existing records from primary storage. [2025-09-24T22:22:53.758716] [INFO ] [MAIN ] LYV: Loaded 51163 primary data records. [2025-09-24T22:22:54.415450] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:54.416767] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13587 primary records. [2025-09-24T22:22:54.417105] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-24T22:22:54.436588] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-24T22:22:54.437832] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-24T22:22:54.440664] [INFO ] [MAIN ] Derivative Progress: 1111/2075 symbols completed. LZM took 1.1s. Estimated remaining: 6m 18s. Rate: 153.0 symbols/min [2025-09-24T22:22:54.440964] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:54.454872] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:54.455836] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35569 primary records. [2025-09-24T22:22:54.455933] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-24T22:22:54.474871] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-24T22:22:54.475050] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-24T22:22:54.477225] [INFO ] [MAIN ] Derivative Progress: 1112/2075 symbols completed. LZB took 1.2s. Estimated remaining: 6m 17s. Rate: 153.1 symbols/min [2025-09-24T22:22:54.489984] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:54.490922] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:54.492247] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51163 primary records. [2025-09-24T22:22:54.492553] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-24T22:22:54.510750] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-24T22:22:54.510842] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-24T22:22:54.513371] [INFO ] [MAIN ] Derivative Progress: 1113/2075 symbols completed. LYV took 1.2s. Estimated remaining: 6m 17s. Rate: 153.2 symbols/min [2025-09-24T22:22:54.513819] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:54.565999] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-24T22:22:54.566242] [INFO ] [MAIN ] M: Loaded 53536 primary data records. [2025-09-24T22:22:54.715626] [DEBUG] [LOCAL ] MA: Loaded 52569 existing records from primary storage. [2025-09-24T22:22:54.732863] [INFO ] [MAIN ] MA: Loaded 52569 primary data records. [2025-09-24T22:22:54.823403] [DEBUG] [LOCAL ] MAA: Loaded 42807 existing records from primary storage. [2025-09-24T22:22:54.864431] [INFO ] [MAIN ] MAA: Loaded 42807 primary data records. [2025-09-24T22:22:55.704267] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:55.706205] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53536 primary records. [2025-09-24T22:22:55.706631] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-24T22:22:55.728396] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-24T22:22:55.728918] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-24T22:22:55.739794] [INFO ] [MAIN ] Derivative Progress: 1114/2075 symbols completed. M took 1.3s. Estimated remaining: 6m 17s. Rate: 153.0 symbols/min [2025-09-24T22:22:55.746629] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:55.746539] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:55.748820] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52569 primary records. [2025-09-24T22:22:55.749762] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-24T22:22:55.779522] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:55.781607] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-24T22:22:55.782899] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42807 primary records. [2025-09-24T22:22:55.781887] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-24T22:22:55.785624] [INFO ] [MAIN ] Derivative Progress: 1115/2075 symbols completed. MA took 1.3s. Estimated remaining: 6m 16s. Rate: 153.1 symbols/min [2025-09-24T22:22:55.786099] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-24T22:22:55.787009] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:55.806033] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-24T22:22:55.806202] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-24T22:22:55.808726] [INFO ] [MAIN ] Derivative Progress: 1116/2075 symbols completed. MAA took 1.3s. Estimated remaining: 6m 16s. Rate: 153.2 symbols/min [2025-09-24T22:22:55.809182] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:55.859752] [DEBUG] [LOCAL ] MAC: Loaded 49705 existing records from primary storage. [2025-09-24T22:22:55.860079] [INFO ] [MAIN ] MAC: Loaded 49705 primary data records. [2025-09-24T22:22:55.992116] [DEBUG] [LOCAL ] MAGN: Loaded 34933 existing records from primary storage. [2025-09-24T22:22:56.013216] [INFO ] [MAIN ] MAGN: Loaded 34933 primary data records. [2025-09-24T22:22:56.307030] [DEBUG] [LOCAL ] MAIN: Loaded 41379 existing records from primary storage. [2025-09-24T22:22:56.322258] [INFO ] [MAIN ] MAIN: Loaded 41379 primary data records. [2025-09-24T22:22:56.894181] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:56.895747] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49705 primary records. [2025-09-24T22:22:56.897455] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-24T22:22:56.918619] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-24T22:22:56.918949] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-24T22:22:56.921405] [INFO ] [MAIN ] Derivative Progress: 1117/2075 symbols completed. MAC took 1.2s. Estimated remaining: 6m 16s. Rate: 153.0 symbols/min [2025-09-24T22:22:56.922128] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:56.935962] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:56.939372] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34933 primary records. [2025-09-24T22:22:56.940009] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-24T22:22:56.970826] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:56.973088] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41379 primary records. [2025-09-24T22:22:56.972025] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-24T22:22:56.973350] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-24T22:22:56.973445] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-24T22:22:56.977518] [INFO ] [MAIN ] Derivative Progress: 1118/2075 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 15s. Rate: 153.1 symbols/min [2025-09-24T22:22:56.989339] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:56.997372] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-24T22:22:56.997586] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-24T22:22:57.000103] [INFO ] [MAIN ] Derivative Progress: 1119/2075 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 14s. Rate: 153.2 symbols/min [2025-09-24T22:22:57.000508] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:57.048818] [DEBUG] [LOCAL ] MAN: Loaded 43547 existing records from primary storage. [2025-09-24T22:22:57.049301] [DEBUG] [LOCAL ] MANU: Loaded 27119 existing records from primary storage. [2025-09-24T22:22:57.049684] [INFO ] [MAIN ] MANU: Loaded 27119 primary data records. [2025-09-24T22:22:57.049575] [INFO ] [MAIN ] MAN: Loaded 43547 primary data records. [2025-09-24T22:22:57.601862] [DEBUG] [LOCAL ] MAS: Loaded 52338 existing records from primary storage. [2025-09-24T22:22:57.765325] [INFO ] [MAIN ] MAS: Loaded 52338 primary data records. [2025-09-24T22:22:58.110108] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:58.111148] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27119 primary records. [2025-09-24T22:22:58.111754] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-24T22:22:58.133367] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:58.142006] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-24T22:22:58.142919] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43547 primary records. [2025-09-24T22:22:58.143447] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-24T22:22:58.143576] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-24T22:22:58.146701] [INFO ] [MAIN ] Derivative Progress: 1120/2075 symbols completed. MANU took 1.2s. Estimated remaining: 6m 15s. Rate: 152.9 symbols/min [2025-09-24T22:22:58.159040] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:58.179617] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-24T22:22:58.179969] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-24T22:22:58.182465] [INFO ] [MAIN ] Derivative Progress: 1121/2075 symbols completed. MAN took 1.3s. Estimated remaining: 6m 14s. Rate: 153.1 symbols/min [2025-09-24T22:22:58.183129] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:58.183029] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:58.184401] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52338 primary records. [2025-09-24T22:22:58.184774] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-24T22:22:58.202200] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-24T22:22:58.211106] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-24T22:22:58.213453] [INFO ] [MAIN ] Derivative Progress: 1122/2075 symbols completed. MAS took 1.2s. Estimated remaining: 6m 13s. Rate: 153.2 symbols/min [2025-09-24T22:22:58.213884] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:58.232328] [DEBUG] [LOCAL ] MATV: Loaded 37531 existing records from primary storage. [2025-09-24T22:22:58.232480] [INFO ] [MAIN ] MATV: Loaded 37531 primary data records. [2025-09-24T22:22:58.369693] [DEBUG] [LOCAL ] MATX: Loaded 31538 existing records from primary storage. [2025-09-24T22:22:58.394824] [INFO ] [MAIN ] MATX: Loaded 31538 primary data records. [2025-09-24T22:22:58.454178] [DEBUG] [LOCAL ] MAX: Loaded 30824 existing records from primary storage. [2025-09-24T22:22:58.475728] [INFO ] [MAIN ] MAX: Loaded 30824 primary data records. [2025-09-24T22:22:59.260662] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:59.261791] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 37531 primary records. [2025-09-24T22:22:59.262018] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-24T22:22:59.280699] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-24T22:22:59.281386] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-24T22:22:59.284548] [INFO ] [MAIN ] Derivative Progress: 1123/2075 symbols completed. MATV took 1.1s. Estimated remaining: 6m 13s. Rate: 152.9 symbols/min [2025-09-24T22:22:59.303482] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:59.305826] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31538 primary records. [2025-09-24T22:22:59.305997] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-24T22:22:59.332291] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:22:59.333512] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30824 primary records. [2025-09-24T22:22:59.334240] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-24T22:22:59.354531] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-24T22:22:59.354633] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-24T22:22:59.357545] [INFO ] [MAIN ] Derivative Progress: 1124/2075 symbols completed. MATX took 1.2s. Estimated remaining: 6m 13s. Rate: 153.1 symbols/min [2025-09-24T22:22:59.354460] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-24T22:22:59.357732] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-24T22:22:59.360467] [INFO ] [MAIN ] Derivative Progress: 1125/2075 symbols completed. MAX took 1.1s. Estimated remaining: 6m 12s. Rate: 153.2 symbols/min [2025-09-24T22:22:59.361486] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:59.361714] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:59.362343] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:22:59.395270] [DEBUG] [LOCAL ] MBI: Loaded 24678 existing records from primary storage. [2025-09-24T22:22:59.395580] [INFO ] [MAIN ] MBI: Loaded 24678 primary data records. [2025-09-24T22:22:59.639144] [DEBUG] [LOCAL ] MC: Loaded 44280 existing records from primary storage. [2025-09-24T22:22:59.632097] [DEBUG] [LOCAL ] MBC: Loaded 43095 existing records from primary storage. [2025-09-24T22:22:59.744639] [INFO ] [MAIN ] MC: Loaded 44280 primary data records. [2025-09-24T22:22:59.744551] [INFO ] [MAIN ] MBC: Loaded 43095 primary data records. [2025-09-24T22:23:00.472392] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:00.473712] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24678 primary records. [2025-09-24T22:23:00.473889] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-24T22:23:00.496438] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-24T22:23:00.497446] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-24T22:23:00.507799] [INFO ] [MAIN ] Derivative Progress: 1126/2075 symbols completed. MBI took 1.1s. Estimated remaining: 6m 12s. Rate: 152.9 symbols/min [2025-09-24T22:23:00.513161] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:00.513546] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:00.514327] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43095 primary records. [2025-09-24T22:23:00.515016] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-24T22:23:00.535959] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:00.538107] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44280 primary records. [2025-09-24T22:23:00.540941] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-24T22:23:00.569537] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-24T22:23:00.569946] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-24T22:23:00.568834] [DEBUG] [LOCAL ] MCB: Loaded 11686 existing records from primary storage. [2025-09-24T22:23:00.570188] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-24T22:23:00.570083] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-24T22:23:00.572615] [INFO ] [MAIN ] Derivative Progress: 1127/2075 symbols completed. MBC took 1.2s. Estimated remaining: 6m 12s. Rate: 153.0 symbols/min [2025-09-24T22:23:00.572769] [INFO ] [MAIN ] MCB: Loaded 11686 primary data records. [2025-09-24T22:23:00.575625] [INFO ] [MAIN ] Derivative Progress: 1128/2075 symbols completed. MC took 1.2s. Estimated remaining: 6m 11s. Rate: 153.2 symbols/min [2025-09-24T22:23:00.572994] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:00.591419] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:00.710822] [DEBUG] [LOCAL ] MCI: Loaded 6397 existing records from primary storage. [2025-09-24T22:23:00.745286] [INFO ] [MAIN ] MCI: Loaded 6397 primary data records. [2025-09-24T22:23:01.067369] [DEBUG] [LOCAL ] MCK: Loaded 39330 existing records from primary storage. [2025-09-24T22:23:01.084452] [INFO ] [MAIN ] MCK: Loaded 39330 primary data records. [2025-09-24T22:23:01.545710] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:01.547883] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11686 primary records. [2025-09-24T22:23:01.548328] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-24T22:23:01.570838] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-24T22:23:01.584741] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-24T22:23:01.587804] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:01.587355] [INFO ] [MAIN ] Derivative Progress: 1129/2075 symbols completed. MCB took 1.1s. Estimated remaining: 6m 11s. Rate: 153.0 symbols/min [2025-09-24T22:23:01.588485] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:01.589435] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6397 primary records. [2025-09-24T22:23:01.590126] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-24T22:23:01.627552] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:01.626973] [DEBUG] [LOCAL ] MCN: Loaded 8126 existing records from primary storage. [2025-09-24T22:23:01.628259] [INFO ] [MAIN ] MCN: Loaded 8126 primary data records. [2025-09-24T22:23:01.629126] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39330 primary records. [2025-09-24T22:23:01.640671] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-24T22:23:01.647841] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-24T22:23:01.695743] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-24T22:23:01.731850] [INFO ] [MAIN ] Derivative Progress: 1130/2075 symbols completed. MCI took 1.2s. Estimated remaining: 6m 10s. Rate: 153.1 symbols/min [2025-09-24T22:23:01.752345] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:01.752236] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-24T22:23:01.760670] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-24T22:23:01.763142] [INFO ] [MAIN ] Derivative Progress: 1131/2075 symbols completed. MCK took 1.2s. Estimated remaining: 6m 10s. Rate: 153.2 symbols/min [2025-09-24T22:23:01.774011] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:02.038950] [DEBUG] [LOCAL ] MCR: Loaded 8764 existing records from primary storage. [2025-09-24T22:23:02.039184] [INFO ] [MAIN ] MCR: Loaded 8764 primary data records. [2025-09-24T22:23:02.231810] [DEBUG] [LOCAL ] MCO: Loaded 39518 existing records from primary storage. [2025-09-24T22:23:02.266331] [INFO ] [MAIN ] MCO: Loaded 39518 primary data records. [2025-09-24T22:23:02.623128] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:02.646991] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8126 primary records. [2025-09-24T22:23:02.753635] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-24T22:23:02.798446] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-24T22:23:02.800044] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-24T22:23:02.802490] [INFO ] [MAIN ] Derivative Progress: 1132/2075 symbols completed. MCN took 1.2s. Estimated remaining: 6m 10s. Rate: 153.0 symbols/min [2025-09-24T22:23:02.802949] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:02.818133] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:02.819006] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8764 primary records. [2025-09-24T22:23:02.819237] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-24T22:23:02.844639] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-24T22:23:02.844810] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-24T22:23:02.853960] [INFO ] [MAIN ] Derivative Progress: 1133/2075 symbols completed. MCR took 1.1s. Estimated remaining: 6m 9s. Rate: 153.1 symbols/min [2025-09-24T22:23:02.869803] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:02.869504] [DEBUG] [LOCAL ] MCS: Loaded 21218 existing records from primary storage. [2025-09-24T22:23:02.870187] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:23:02.870251] [INFO ] [MAIN ] MCS: Loaded 21218 primary data records. [2025-09-24T22:23:02.871226] [INFO ] [MAIN ] MCO: Generated 1793 derivative records from 39518 primary records. [2025-09-24T22:23:02.876496] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-24T22:23:02.994557] [DEBUG] [LOCAL ] MCO: Derivative data saved (1793 records). [2025-09-24T22:23:02.995080] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-24T22:23:03.019532] [INFO ] [MAIN ] Derivative Progress: 1134/2075 symbols completed. MCO took 1.3s. Estimated remaining: 6m 9s. Rate: 153.1 symbols/min [2025-09-24T22:23:03.025431] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:03.214371] [DEBUG] [LOCAL ] MCY: Loaded 25078 existing records from primary storage. [2025-09-24T22:23:03.214742] [INFO ] [MAIN ] MCY: Loaded 25078 primary data records. [2025-09-24T22:23:03.461727] [DEBUG] [LOCAL ] MD: Loaded 38661 existing records from primary storage. [2025-09-24T22:23:03.549866] [INFO ] [MAIN ] MD: Loaded 38661 primary data records. [2025-09-24T22:23:03.971498] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:03.972743] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21218 primary records. [2025-09-24T22:23:03.972880] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-24T22:23:04.011299] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:04.011376] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-24T22:23:04.012292] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-24T22:23:04.012229] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 25078 primary records. [2025-09-24T22:23:04.012425] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-24T22:23:04.014632] [INFO ] [MAIN ] Derivative Progress: 1135/2075 symbols completed. MCS took 1.2s. Estimated remaining: 6m 9s. Rate: 152.9 symbols/min [2025-09-24T22:23:04.024053] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:04.038772] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-24T22:23:04.039058] [DEBUG] [LOCAL ] MDST: Loaded 5536 existing records from primary storage. [2025-09-24T22:23:04.040207] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-24T22:23:04.043588] [INFO ] [MAIN ] Derivative Progress: 1136/2075 symbols completed. MCY took 1.2s. Estimated remaining: 6m 8s. Rate: 153.1 symbols/min [2025-09-24T22:23:04.040266] [INFO ] [MAIN ] MDST: Loaded 5536 primary data records. [2025-09-24T22:23:04.076677] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:04.142025] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:04.154536] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38661 primary records. [2025-09-24T22:23:04.161841] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-24T22:23:04.391362] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-24T22:23:04.391570] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-24T22:23:04.394939] [INFO ] [MAIN ] Derivative Progress: 1137/2075 symbols completed. MD took 1.4s. Estimated remaining: 6m 8s. Rate: 153.1 symbols/min [2025-09-24T22:23:04.396131] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:04.435456] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-24T22:23:04.435915] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-24T22:23:04.652957] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:04.660385] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5536 primary records. [2025-09-24T22:23:04.660494] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-24T22:23:04.814287] [DEBUG] [LOCAL ] MDU: Loaded 47888 existing records from primary storage. [2025-09-24T22:23:04.816097] [INFO ] [MAIN ] MDU: Loaded 47888 primary data records. [2025-09-24T22:23:04.928195] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-09-24T22:23:04.928799] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-24T22:23:04.941804] [INFO ] [MAIN ] Derivative Progress: 1138/2075 symbols completed. MDST took 0.9s. Estimated remaining: 6m 7s. Rate: 153.0 symbols/min [2025-09-24T22:23:05.170247] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:05.171633] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-24T22:23:05.171934] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-24T22:23:05.191880] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-24T22:23:05.192265] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-24T22:23:05.195277] [INFO ] [MAIN ] Derivative Progress: 1139/2075 symbols completed. MDT took 1.1s. Estimated remaining: 6m 7s. Rate: 153.1 symbols/min [2025-09-24T22:23:05.214007] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:05.214785] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47888 primary records. [2025-09-24T22:23:05.214854] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-24T22:23:05.232052] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-24T22:23:05.232196] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-24T22:23:05.234602] [INFO ] [MAIN ] Derivative Progress: 1140/2075 symbols completed. MDU took 0.8s. Estimated remaining: 6m 6s. Rate: 153.2 symbols/min [2025-09-24T22:23:05.235586] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:05.235306] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:05.235661] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:05.250675] [DEBUG] [LOCAL ] MDV: Loaded 8649 existing records from primary storage. [2025-09-24T22:23:05.256731] [INFO ] [MAIN ] MDV: Loaded 8649 primary data records. [2025-09-24T22:23:05.312006] [DEBUG] [LOCAL ] MEC: Loaded 16379 existing records from primary storage. [2025-09-24T22:23:05.358168] [INFO ] [MAIN ] MEC: Loaded 16379 primary data records. [2025-09-24T22:23:05.391965] [DEBUG] [LOCAL ] MED: Loaded 21775 existing records from primary storage. [2025-09-24T22:23:05.442145] [INFO ] [MAIN ] MED: Loaded 21775 primary data records. [2025-09-24T22:23:06.414156] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:06.416512] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8649 primary records. [2025-09-24T22:23:06.416721] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-24T22:23:06.448599] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-24T22:23:06.456696] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-24T22:23:06.461736] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:23:06.465181] [INFO ] [MAIN ] MEC: Generated 1793 derivative records from 16379 primary records. [2025-09-24T22:23:06.464390] [INFO ] [MAIN ] Derivative Progress: 1141/2075 symbols completed. MDV took 1.2s. Estimated remaining: 6m 6s. Rate: 152.9 symbols/min [2025-09-24T22:23:06.465918] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-24T22:23:06.465666] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:06.466552] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:06.468260] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21775 primary records. [2025-09-24T22:23:06.480174] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-24T22:23:06.502194] [DEBUG] [LOCAL ] MEC: Derivative data saved (1793 records). [2025-09-24T22:23:06.503055] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-24T22:23:06.506064] [INFO ] [MAIN ] Derivative Progress: 1142/2075 symbols completed. MEC took 1.3s. Estimated remaining: 6m 6s. Rate: 153.0 symbols/min [2025-09-24T22:23:06.506851] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-24T22:23:06.515817] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:06.516035] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-24T22:23:06.518930] [INFO ] [MAIN ] Derivative Progress: 1143/2075 symbols completed. MED took 1.3s. Estimated remaining: 6m 5s. Rate: 153.2 symbols/min [2025-09-24T22:23:06.519568] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:06.539987] [DEBUG] [LOCAL ] MEG: Loaded 31972 existing records from primary storage. [2025-09-24T22:23:06.540274] [INFO ] [MAIN ] MEG: Loaded 31972 primary data records. [2025-09-24T22:23:06.680622] [DEBUG] [LOCAL ] MEGI: Loaded 20443 existing records from primary storage. [2025-09-24T22:23:06.686934] [INFO ] [MAIN ] MEGI: Loaded 20443 primary data records. [2025-09-24T22:23:06.947791] [DEBUG] [LOCAL ] MEI: Loaded 32456 existing records from primary storage. [2025-09-24T22:23:06.970024] [INFO ] [MAIN ] MEI: Loaded 32456 primary data records. [2025-09-24T22:23:07.591879] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:07.592941] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31972 primary records. [2025-09-24T22:23:07.593339] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-24T22:23:07.614078] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-24T22:23:07.615235] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-24T22:23:07.631729] [INFO ] [MAIN ] Derivative Progress: 1144/2075 symbols completed. MEG took 1.2s. Estimated remaining: 6m 5s. Rate: 152.9 symbols/min [2025-09-24T22:23:07.632241] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:07.632959] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:07.647627] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20443 primary records. [2025-09-24T22:23:07.646926] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:07.648304] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32456 primary records. [2025-09-24T22:23:07.648499] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-24T22:23:07.648382] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-24T22:23:07.673562] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-24T22:23:07.682941] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-24T22:23:07.691068] [INFO ] [MAIN ] Derivative Progress: 1145/2075 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 5s. Rate: 153.0 symbols/min [2025-09-24T22:23:07.687205] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-24T22:23:07.692191] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-24T22:23:07.692059] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:07.695147] [INFO ] [MAIN ] Derivative Progress: 1146/2075 symbols completed. MEI took 1.2s. Estimated remaining: 6m 4s. Rate: 153.2 symbols/min [2025-09-24T22:23:07.695578] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:07.705704] [DEBUG] [LOCAL ] MFAN: Loaded 4265 existing records from primary storage. [2025-09-24T22:23:07.705909] [INFO ] [MAIN ] MFAN: Loaded 4265 primary data records. [2025-09-24T22:23:07.925683] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-09-24T22:23:07.940401] [INFO ] [MAIN ] MET: Loaded 53316 primary data records. [2025-09-24T22:23:08.183501] [DEBUG] [LOCAL ] MFA: Loaded 45317 existing records from primary storage. [2025-09-24T22:23:08.188789] [INFO ] [MAIN ] MFA: Loaded 45317 primary data records. [2025-09-24T22:23:08.761095] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:08.762732] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4265 primary records. [2025-09-24T22:23:08.762949] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-24T22:23:08.780829] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-24T22:23:08.780968] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-24T22:23:08.783528] [INFO ] [MAIN ] Derivative Progress: 1147/2075 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 4s. Rate: 152.9 symbols/min [2025-09-24T22:23:08.784843] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:08.800529] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:08.801611] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53316 primary records. [2025-09-24T22:23:08.802906] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-24T22:23:08.815723] [DEBUG] [LOCAL ] MFAO: Loaded 3798 existing records from primary storage. [2025-09-24T22:23:08.822173] [INFO ] [MAIN ] MFAO: Loaded 3798 primary data records. [2025-09-24T22:23:08.824742] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-24T22:23:08.836921] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-24T22:23:08.839555] [INFO ] [MAIN ] Derivative Progress: 1148/2075 symbols completed. MET took 1.2s. Estimated remaining: 6m 3s. Rate: 153.0 symbols/min [2025-09-24T22:23:08.865216] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:08.920345] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:08.926792] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45317 primary records. [2025-09-24T22:23:08.948991] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-24T22:23:09.186997] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-24T22:23:09.187152] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-24T22:23:09.189760] [INFO ] [MAIN ] Derivative Progress: 1149/2075 symbols completed. MFA took 1.5s. Estimated remaining: 6m 3s. Rate: 153.0 symbols/min [2025-09-24T22:23:09.190694] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:09.231551] [DEBUG] [LOCAL ] MFC: Loaded 51300 existing records from primary storage. [2025-09-24T22:23:09.237494] [INFO ] [MAIN ] MFC: Loaded 51300 primary data records. [2025-09-24T22:23:09.237418] [DEBUG] [LOCAL ] MFM: Loaded 14184 existing records from primary storage. [2025-09-24T22:23:09.237703] [INFO ] [MAIN ] MFM: Loaded 14184 primary data records. [2025-09-24T22:23:09.475259] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-09-24T22:23:09.484503] [INFO ] [MAIN ] MFAO: Generated 1791 derivative records from 3798 primary records. [2025-09-24T22:23:09.489780] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-24T22:23:09.885254] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1791 records). [2025-09-24T22:23:09.885418] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-24T22:23:09.888421] [INFO ] [MAIN ] Derivative Progress: 1150/2075 symbols completed. MFAO took 1.1s. Estimated remaining: 6m 3s. Rate: 152.9 symbols/min [2025-09-24T22:23:09.889012] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:09.901296] [DEBUG] [LOCAL ] MFSG: Loaded 5158 existing records from primary storage. [2025-09-24T22:23:09.901634] [INFO ] [MAIN ] MFSG: Loaded 5158 primary data records. [2025-09-24T22:23:10.130796] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:10.308288] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51300 primary records. [2025-09-24T22:23:10.316600] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-24T22:23:10.321874] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:10.323313] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14184 primary records. [2025-09-24T22:23:10.324108] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-24T22:23:10.357327] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-24T22:23:10.358431] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-24T22:23:10.361267] [INFO ] [MAIN ] Derivative Progress: 1151/2075 symbols completed. MFC took 1.5s. Estimated remaining: 6m 3s. Rate: 152.9 symbols/min [2025-09-24T22:23:10.362987] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-24T22:23:10.363135] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-24T22:23:10.365637] [INFO ] [MAIN ] Derivative Progress: 1152/2075 symbols completed. MFM took 1.2s. Estimated remaining: 6m 2s. Rate: 153.0 symbols/min [2025-09-24T22:23:10.363250] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:10.366237] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:10.371743] [DEBUG] [LOCAL ] MFSV: Loaded 2435 existing records from primary storage. [2025-09-24T22:23:10.372023] [INFO ] [MAIN ] MFSV: Loaded 2435 primary data records. [2025-09-24T22:23:10.495784] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7730 incomplete bins [2025-09-24T22:23:10.464511] [DEBUG] [LOCAL ] MFSI: Loaded 11144 existing records from primary storage. [2025-09-24T22:23:10.496273] [INFO ] [MAIN ] MFSI: Loaded 11144 primary data records. [2025-09-24T22:23:10.497009] [INFO ] [MAIN ] MFSG: Generated 1788 derivative records from 5158 primary records. [2025-09-24T22:23:10.508360] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-24T22:23:10.693015] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1788 records). [2025-09-24T22:23:10.835215] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-24T22:23:10.865970] [INFO ] [MAIN ] Derivative Progress: 1153/2075 symbols completed. MFSG took 1.0s. Estimated remaining: 6m 2s. Rate: 153.0 symbols/min [2025-09-24T22:23:11.037675] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:23:11.038408] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2435 primary records. [2025-09-24T22:23:11.038578] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-24T22:23:11.066822] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:11.068016] [INFO ] [MAIN ] MFSI: Generated 1794 derivative records from 11144 primary records. [2025-09-24T22:23:11.068325] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-24T22:23:11.069210] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-09-24T22:23:11.069528] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-24T22:23:11.072026] [INFO ] [MAIN ] Derivative Progress: 1154/2075 symbols completed. MFSV took 0.7s. Estimated remaining: 6m 1s. Rate: 153.1 symbols/min [2025-09-24T22:23:11.087496] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1794 records). [2025-09-24T22:23:11.087570] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-24T22:23:11.090140] [INFO ] [MAIN ] Derivative Progress: 1155/2075 symbols completed. MFSI took 0.7s. Estimated remaining: 6m 0s. Rate: 153.2 symbols/min [2025-09-24T22:23:11.090937] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:11.090863] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:11.091048] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:11.098996] [DEBUG] [LOCAL ] MGF: Loaded 4107 existing records from primary storage. [2025-09-24T22:23:11.099176] [INFO ] [MAIN ] MGF: Loaded 4107 primary data records. [2025-09-24T22:23:11.217399] [DEBUG] [LOCAL ] MG: Loaded 16674 existing records from primary storage. [2025-09-24T22:23:11.240996] [INFO ] [MAIN ] MG: Loaded 16674 primary data records. [2025-09-24T22:23:11.601498] [DEBUG] [LOCAL ] MGA: Loaded 50648 existing records from primary storage. [2025-09-24T22:23:11.634500] [INFO ] [MAIN ] MGA: Loaded 50648 primary data records. [2025-09-24T22:23:12.116434] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:12.118177] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4107 primary records. [2025-09-24T22:23:12.118454] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-24T22:23:12.143922] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-24T22:23:12.152274] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-24T22:23:12.154809] [INFO ] [MAIN ] Derivative Progress: 1156/2075 symbols completed. MGF took 1.1s. Estimated remaining: 6m 0s. Rate: 153.0 symbols/min [2025-09-24T22:23:12.160177] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:12.161444] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:12.162320] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16674 primary records. [2025-09-24T22:23:12.162697] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-24T22:23:12.191528] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-24T22:23:12.196592] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-24T22:23:12.199780] [INFO ] [MAIN ] Derivative Progress: 1157/2075 symbols completed. MG took 1.1s. Estimated remaining: 5m 60s. Rate: 153.1 symbols/min [2025-09-24T22:23:12.200512] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:12.201697] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50648 primary records. [2025-09-24T22:23:12.202024] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:12.201960] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-24T22:23:12.222996] [DEBUG] [LOCAL ] MGR: Loaded 5627 existing records from primary storage. [2025-09-24T22:23:12.223697] [INFO ] [MAIN ] MGR: Loaded 5627 primary data records. [2025-09-24T22:23:12.320082] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-24T22:23:12.326391] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-24T22:23:12.339952] [INFO ] [MAIN ] Derivative Progress: 1158/2075 symbols completed. MGA took 1.2s. Estimated remaining: 5m 59s. Rate: 153.2 symbols/min [2025-09-24T22:23:12.351427] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:12.391196] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-09-24T22:23:12.472735] [INFO ] [MAIN ] MGM: Loaded 53608 primary data records. [2025-09-24T22:23:12.503851] [DEBUG] [LOCAL ] MGRB: Loaded 4080 existing records from primary storage. [2025-09-24T22:23:12.616603] [INFO ] [MAIN ] MGRB: Loaded 4080 primary data records. [2025-09-24T22:23:13.276623] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:13.277623] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5627 primary records. [2025-09-24T22:23:13.277914] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-24T22:23:13.300806] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-09-24T22:23:13.315388] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-24T22:23:13.320523] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:13.318580] [INFO ] [MAIN ] Derivative Progress: 1159/2075 symbols completed. MGR took 1.1s. Estimated remaining: 5m 59s. Rate: 153.0 symbols/min [2025-09-24T22:23:13.321735] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53608 primary records. [2025-09-24T22:23:13.321960] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-24T22:23:13.324501] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:13.355437] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:13.358606] [DEBUG] [LOCAL ] MGRD: Loaded 2214 existing records from primary storage. [2025-09-24T22:23:13.360283] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4080 primary records. [2025-09-24T22:23:13.359479] [INFO ] [MAIN ] MGRD: Loaded 2214 primary data records. [2025-09-24T22:23:13.360735] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-24T22:23:13.417424] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-24T22:23:13.439684] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-24T22:23:13.469003] [INFO ] [MAIN ] Derivative Progress: 1160/2075 symbols completed. MGM took 1.3s. Estimated remaining: 5m 59s. Rate: 153.1 symbols/min [2025-09-24T22:23:13.494959] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:13.589389] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-24T22:23:13.706636] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-24T22:23:13.725788] [INFO ] [MAIN ] Derivative Progress: 1161/2075 symbols completed. MGRB took 1.4s. Estimated remaining: 5m 58s. Rate: 153.1 symbols/min [2025-09-24T22:23:13.726122] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:13.722109] [DEBUG] [LOCAL ] MGRE: Loaded 6620 existing records from primary storage. [2025-09-24T22:23:13.726622] [INFO ] [MAIN ] MGRE: Loaded 6620 primary data records. [2025-09-24T22:23:14.110862] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:14.112196] [DEBUG] [LOCAL ] MGY: Loaded 52423 existing records from primary storage. [2025-09-24T22:23:14.113215] [INFO ] [MAIN ] MGY: Loaded 52423 primary data records. [2025-09-24T22:23:14.113073] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2214 primary records. [2025-09-24T22:23:14.113991] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-24T22:23:14.293940] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-24T22:23:14.316502] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-24T22:23:14.474581] [INFO ] [MAIN ] Derivative Progress: 1162/2075 symbols completed. MGRD took 1.2s. Estimated remaining: 5m 58s. Rate: 153.0 symbols/min [2025-09-24T22:23:14.484106] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:14.502609] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:14.503728] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6620 primary records. [2025-09-24T22:23:14.503865] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-24T22:23:14.525965] [DEBUG] [LOCAL ] MHD: Loaded 12114 existing records from primary storage. [2025-09-24T22:23:14.526701] [INFO ] [MAIN ] MHD: Loaded 12114 primary data records. [2025-09-24T22:23:14.606912] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-24T22:23:14.617531] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-24T22:23:14.633690] [INFO ] [MAIN ] Derivative Progress: 1163/2075 symbols completed. MGRE took 1.1s. Estimated remaining: 5m 58s. Rate: 153.1 symbols/min [2025-09-24T22:23:14.637498] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:14.853368] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:14.858901] [DEBUG] [LOCAL ] MHF: Loaded 8635 existing records from primary storage. [2025-09-24T22:23:14.854635] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52423 primary records. [2025-09-24T22:23:14.859057] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-24T22:23:14.859140] [INFO ] [MAIN ] MHF: Loaded 8635 primary data records. [2025-09-24T22:23:15.003954] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-24T22:23:15.019962] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-24T22:23:15.022894] [INFO ] [MAIN ] Derivative Progress: 1164/2075 symbols completed. MGY took 1.3s. Estimated remaining: 5m 57s. Rate: 153.1 symbols/min [2025-09-24T22:23:15.049434] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:15.236904] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:15.237743] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12114 primary records. [2025-09-24T22:23:15.237858] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-24T22:23:15.267760] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-24T22:23:15.267982] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-24T22:23:15.270606] [INFO ] [MAIN ] Derivative Progress: 1165/2075 symbols completed. MHD took 0.8s. Estimated remaining: 5m 57s. Rate: 153.1 symbols/min [2025-09-24T22:23:15.271194] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:15.291312] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:15.292547] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8635 primary records. [2025-09-24T22:23:15.308232] [DEBUG] [LOCAL ] MHN: Loaded 7802 existing records from primary storage. [2025-09-24T22:23:15.307988] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-24T22:23:15.309165] [DEBUG] [LOCAL ] MHK: Loaded 42535 existing records from primary storage. [2025-09-24T22:23:15.308348] [INFO ] [MAIN ] MHN: Loaded 7802 primary data records. [2025-09-24T22:23:15.332352] [INFO ] [MAIN ] MHK: Loaded 42535 primary data records. [2025-09-24T22:23:15.663680] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-24T22:23:15.942485] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-24T22:23:15.969078] [INFO ] [MAIN ] Derivative Progress: 1166/2075 symbols completed. MHF took 1.3s. Estimated remaining: 5m 56s. Rate: 153.0 symbols/min [2025-09-24T22:23:15.969992] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:16.001156] [DEBUG] [LOCAL ] MHO: Loaded 24357 existing records from primary storage. [2025-09-24T22:23:16.001681] [INFO ] [MAIN ] MHO: Loaded 24357 primary data records. [2025-09-24T22:23:16.080586] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:16.130140] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42535 primary records. [2025-09-24T22:23:16.146504] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-24T22:23:16.159322] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:16.199497] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7802 primary records. [2025-09-24T22:23:16.246522] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-24T22:23:16.447868] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-24T22:23:16.448344] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-24T22:23:16.451282] [INFO ] [MAIN ] Derivative Progress: 1167/2075 symbols completed. MHK took 1.4s. Estimated remaining: 5m 56s. Rate: 153.0 symbols/min [2025-09-24T22:23:16.453871] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:16.459715] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-24T22:23:16.460302] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-24T22:23:16.463218] [INFO ] [MAIN ] Derivative Progress: 1168/2075 symbols completed. MHN took 1.2s. Estimated remaining: 5m 55s. Rate: 153.1 symbols/min [2025-09-24T22:23:16.477190] [DEBUG] [LOCAL ] MIN: Loaded 13147 existing records from primary storage. [2025-09-24T22:23:16.477331] [INFO ] [MAIN ] MIN: Loaded 13147 primary data records. [2025-09-24T22:23:16.766182] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:16.810824] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24357 primary records. [2025-09-24T22:23:16.811530] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-24T22:23:16.833051] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-24T22:23:16.833200] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-24T22:23:16.835915] [INFO ] [MAIN ] Derivative Progress: 1169/2075 symbols completed. MHO took 0.9s. Estimated remaining: 5m 55s. Rate: 153.1 symbols/min [2025-09-24T22:23:16.854300] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:16.855088] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13147 primary records. [2025-09-24T22:23:16.855152] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-24T22:23:16.871280] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-24T22:23:16.871351] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-24T22:23:16.874217] [INFO ] [MAIN ] Derivative Progress: 1170/2075 symbols completed. MIN took 0.4s. Estimated remaining: 5m 54s. Rate: 153.2 symbols/min [2025-09-24T22:23:16.874980] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:16.875226] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:16.874940] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:16.881134] [DEBUG] [LOCAL ] MITP: Loaded 2428 existing records from primary storage. [2025-09-24T22:23:16.881343] [INFO ] [MAIN ] MITP: Loaded 2428 primary data records. [2025-09-24T22:23:17.028710] [DEBUG] [LOCAL ] MITT: Loaded 23064 existing records from primary storage. [2025-09-24T22:23:17.082285] [INFO ] [MAIN ] MITT: Loaded 23064 primary data records. [2025-09-24T22:23:17.384149] [DEBUG] [LOCAL ] MIR: Loaded 50842 existing records from primary storage. [2025-09-24T22:23:17.390616] [INFO ] [MAIN ] MIR: Loaded 50842 primary data records. [2025-09-24T22:23:17.921910] [DEBUG] [MAIN ] MITP: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:23:17.923927] [INFO ] [MAIN ] MITP: Generated 1792 derivative records from 2428 primary records. [2025-09-24T22:23:17.924311] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-24T22:23:17.953929] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:17.955242] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 23064 primary records. [2025-09-24T22:23:17.955952] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-24T22:23:17.965977] [DEBUG] [LOCAL ] MITP: Derivative data saved (1792 records). [2025-09-24T22:23:17.968832] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-24T22:23:17.971817] [INFO ] [MAIN ] Derivative Progress: 1171/2075 symbols completed. MITP took 1.1s. Estimated remaining: 5m 55s. Rate: 153.0 symbols/min [2025-09-24T22:23:17.972290] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:17.982739] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-24T22:23:17.986377] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-24T22:23:17.986754] [DEBUG] [LOCAL ] MIY: Loaded 6007 existing records from primary storage. [2025-09-24T22:23:18.002307] [INFO ] [MAIN ] MIY: Loaded 6007 primary data records. [2025-09-24T22:23:17.997378] [INFO ] [MAIN ] Derivative Progress: 1172/2075 symbols completed. MITT took 1.1s. Estimated remaining: 5m 54s. Rate: 153.1 symbols/min [2025-09-24T22:23:18.008134] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:18.008988] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50842 primary records. [2025-09-24T22:23:18.025799] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:18.037554] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-24T22:23:18.326218] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-24T22:23:18.335567] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-24T22:23:18.338135] [INFO ] [MAIN ] Derivative Progress: 1173/2075 symbols completed. MIR took 1.5s. Estimated remaining: 5m 53s. Rate: 153.1 symbols/min [2025-09-24T22:23:18.338696] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:18.386609] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:18.388200] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6007 primary records. [2025-09-24T22:23:18.388363] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-24T22:23:18.414160] [DEBUG] [LOCAL ] MKC: Loaded 52430 existing records from primary storage. [2025-09-24T22:23:18.425095] [INFO ] [MAIN ] MKC: Loaded 52430 primary data records. [2025-09-24T22:23:18.562561] [DEBUG] [LOCAL ] MKL: Loaded 34084 existing records from primary storage. [2025-09-24T22:23:18.564481] [INFO ] [MAIN ] MKL: Loaded 34084 primary data records. [2025-09-24T22:23:18.603597] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-24T22:23:18.656572] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-24T22:23:18.733801] [INFO ] [MAIN ] Derivative Progress: 1174/2075 symbols completed. MIY took 0.8s. Estimated remaining: 5m 53s. Rate: 153.1 symbols/min [2025-09-24T22:23:18.908439] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:19.191551] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:19.192953] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52430 primary records. [2025-09-24T22:23:19.193425] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-24T22:23:19.226243] [DEBUG] [LOCAL ] MLI: Loaded 43813 existing records from primary storage. [2025-09-24T22:23:19.229686] [INFO ] [MAIN ] MLI: Loaded 43813 primary data records. [2025-09-24T22:23:19.290949] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:19.315408] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34084 primary records. [2025-09-24T22:23:19.333715] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-24T22:23:19.328506] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-24T22:23:19.339058] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-24T22:23:19.361181] [INFO ] [MAIN ] Derivative Progress: 1175/2075 symbols completed. MKC took 1.3s. Estimated remaining: 5m 53s. Rate: 153.1 symbols/min [2025-09-24T22:23:19.367402] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:19.582877] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-24T22:23:19.583010] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-24T22:23:19.585475] [INFO ] [MAIN ] Derivative Progress: 1176/2075 symbols completed. MKL took 1.2s. Estimated remaining: 5m 52s. Rate: 153.1 symbols/min [2025-09-24T22:23:19.586397] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:19.623050] [DEBUG] [LOCAL ] MLM: Loaded 30687 existing records from primary storage. [2025-09-24T22:23:19.635739] [INFO ] [MAIN ] MLM: Loaded 30687 primary data records. [2025-09-24T22:23:19.635993] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:19.636838] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43813 primary records. [2025-09-24T22:23:19.642163] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-24T22:23:19.739860] [DEBUG] [LOCAL ] MLNK: Loaded 25614 existing records from primary storage. [2025-09-24T22:23:19.747533] [INFO ] [MAIN ] MLNK: Loaded 25614 primary data records. [2025-09-24T22:23:19.916868] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-24T22:23:19.972502] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-24T22:23:19.987853] [INFO ] [MAIN ] Derivative Progress: 1177/2075 symbols completed. MLI took 1.1s. Estimated remaining: 5m 52s. Rate: 153.1 symbols/min [2025-09-24T22:23:20.123505] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:20.216804] [DEBUG] [LOCAL ] MLP: Loaded 3093 existing records from primary storage. [2025-09-24T22:23:20.217277] [INFO ] [MAIN ] MLP: Loaded 3093 primary data records. [2025-09-24T22:23:20.718431] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:20.720308] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 30687 primary records. [2025-09-24T22:23:20.721082] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-24T22:23:20.746502] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-24T22:23:20.747029] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-24T22:23:20.757175] [INFO ] [MAIN ] Derivative Progress: 1178/2075 symbols completed. MLM took 1.4s. Estimated remaining: 5m 52s. Rate: 153.0 symbols/min [2025-09-24T22:23:20.763293] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:20.762990] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:20.764931] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25614 primary records. [2025-09-24T22:23:20.765165] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-24T22:23:20.801213] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-09-24T22:23:20.803315] [INFO ] [MAIN ] MLP: Generated 1791 derivative records from 3093 primary records. [2025-09-24T22:23:20.808895] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-24T22:23:20.809423] [DEBUG] [LOCAL ] MLR: Loaded 12828 existing records from primary storage. [2025-09-24T22:23:20.811973] [INFO ] [MAIN ] MLR: Loaded 12828 primary data records. [2025-09-24T22:23:20.819708] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-24T22:23:20.831193] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-24T22:23:20.864241] [INFO ] [MAIN ] Derivative Progress: 1179/2075 symbols completed. MLNK took 1.3s. Estimated remaining: 5m 51s. Rate: 153.1 symbols/min [2025-09-24T22:23:20.896284] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:20.966735] [DEBUG] [LOCAL ] MLP: Derivative data saved (1791 records). [2025-09-24T22:23:21.008480] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-24T22:23:21.033482] [INFO ] [MAIN ] Derivative Progress: 1180/2075 symbols completed. MLP took 0.9s. Estimated remaining: 5m 51s. Rate: 153.1 symbols/min [2025-09-24T22:23:21.147557] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:21.182017] [DEBUG] [LOCAL ] MMD: Loaded 11203 existing records from primary storage. [2025-09-24T22:23:21.182273] [INFO ] [MAIN ] MMD: Loaded 11203 primary data records. [2025-09-24T22:23:21.296101] [DEBUG] [LOCAL ] MMC: Loaded 51817 existing records from primary storage. [2025-09-24T22:23:21.333050] [INFO ] [MAIN ] MMC: Loaded 51817 primary data records. [2025-09-24T22:23:21.469508] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:21.530618] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12828 primary records. [2025-09-24T22:23:21.660144] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-24T22:23:21.919887] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-24T22:23:21.920244] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-24T22:23:21.922702] [INFO ] [MAIN ] Derivative Progress: 1181/2075 symbols completed. MLR took 1.2s. Estimated remaining: 5m 51s. Rate: 153.0 symbols/min [2025-09-24T22:23:21.923394] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:21.952564] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:21.953559] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11203 primary records. [2025-09-24T22:23:21.959168] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-24T22:23:21.959895] [DEBUG] [LOCAL ] MMI: Loaded 15306 existing records from primary storage. [2025-09-24T22:23:21.960625] [INFO ] [MAIN ] MMI: Loaded 15306 primary data records. [2025-09-24T22:23:22.107358] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:22.108720] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-24T22:23:22.108831] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-24T22:23:22.110948] [INFO ] [MAIN ] Derivative Progress: 1182/2075 symbols completed. MMD took 1.0s. Estimated remaining: 5m 50s. Rate: 153.1 symbols/min [2025-09-24T22:23:22.108622] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51817 primary records. [2025-09-24T22:23:22.111260] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:22.111754] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-24T22:23:22.330145] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-24T22:23:22.330824] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-24T22:23:22.334932] [INFO ] [MAIN ] Derivative Progress: 1183/2075 symbols completed. MMC took 1.4s. Estimated remaining: 5m 50s. Rate: 153.1 symbols/min [2025-09-24T22:23:22.370363] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:22.371114] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15306 primary records. [2025-09-24T22:23:22.371181] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-24T22:23:22.402510] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-24T22:23:22.402631] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-24T22:23:22.404941] [INFO ] [MAIN ] Derivative Progress: 1184/2075 symbols completed. MMI took 0.5s. Estimated remaining: 5m 49s. Rate: 153.2 symbols/min [2025-09-24T22:23:22.402428] [DEBUG] [LOCAL ] MMM: Loaded 53229 existing records from primary storage. [2025-09-24T22:23:22.405161] [INFO ] [MAIN ] MMM: Loaded 53229 primary data records. [2025-09-24T22:23:22.745535] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:22.746192] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53229 primary records. [2025-09-24T22:23:22.746257] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-24T22:23:22.762221] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-24T22:23:22.762286] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-24T22:23:22.764524] [INFO ] [MAIN ] Derivative Progress: 1185/2075 symbols completed. MMM took 0.7s. Estimated remaining: 5m 49s. Rate: 153.2 symbols/min [2025-09-24T22:23:22.765495] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:22.765373] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:22.765167] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:22.785370] [DEBUG] [LOCAL ] MMT: Loaded 10920 existing records from primary storage. [2025-09-24T22:23:22.785527] [INFO ] [MAIN ] MMT: Loaded 10920 primary data records. [2025-09-24T22:23:22.848131] [DEBUG] [LOCAL ] MMU: Loaded 16934 existing records from primary storage. [2025-09-24T22:23:22.869785] [INFO ] [MAIN ] MMU: Loaded 16934 primary data records. [2025-09-24T22:23:23.075052] [DEBUG] [LOCAL ] MMS: Loaded 33878 existing records from primary storage. [2025-09-24T22:23:23.130098] [INFO ] [MAIN ] MMS: Loaded 33878 primary data records. [2025-09-24T22:23:23.785123] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:23.785978] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:23.786991] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10920 primary records. [2025-09-24T22:23:23.787230] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-24T22:23:23.788021] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16934 primary records. [2025-09-24T22:23:23.788550] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-24T22:23:23.822531] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-24T22:23:23.823608] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-24T22:23:23.834051] [INFO ] [MAIN ] Derivative Progress: 1186/2075 symbols completed. MMT took 1.1s. Estimated remaining: 5m 49s. Rate: 153.0 symbols/min [2025-09-24T22:23:23.840353] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:23.840705] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:23.841198] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-24T22:23:23.842208] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33878 primary records. [2025-09-24T22:23:23.842495] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-24T22:23:23.843001] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-24T22:23:23.845699] [INFO ] [MAIN ] Derivative Progress: 1187/2075 symbols completed. MMU took 1.1s. Estimated remaining: 5m 48s. Rate: 153.1 symbols/min [2025-09-24T22:23:23.846737] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:23.863150] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-24T22:23:23.863346] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-24T22:23:23.865873] [INFO ] [MAIN ] Derivative Progress: 1188/2075 symbols completed. MMS took 1.1s. Estimated remaining: 5m 47s. Rate: 153.2 symbols/min [2025-09-24T22:23:23.866216] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:23.889738] [DEBUG] [LOCAL ] MNR: Loaded 24681 existing records from primary storage. [2025-09-24T22:23:23.890283] [INFO ] [MAIN ] MNR: Loaded 24681 primary data records. [2025-09-24T22:23:24.065273] [DEBUG] [LOCAL ] MNSO: Loaded 44333 existing records from primary storage. [2025-09-24T22:23:24.131137] [INFO ] [MAIN ] MNSO: Loaded 44333 primary data records. [2025-09-24T22:23:24.261810] [DEBUG] [LOCAL ] MOD: Loaded 45590 existing records from primary storage. [2025-09-24T22:23:24.302717] [INFO ] [MAIN ] MOD: Loaded 45590 primary data records. [2025-09-24T22:23:24.961234] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:24.962406] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24681 primary records. [2025-09-24T22:23:24.962582] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-24T22:23:24.982443] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-24T22:23:24.982726] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-24T22:23:24.988177] [INFO ] [MAIN ] Derivative Progress: 1189/2075 symbols completed. MNR took 1.1s. Estimated remaining: 5m 47s. Rate: 153.0 symbols/min [2025-09-24T22:23:24.989339] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:25.016261] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:25.017688] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44333 primary records. [2025-09-24T22:23:25.017864] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-24T22:23:25.016950] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:23:25.019054] [INFO ] [MAIN ] MOD: Generated 1793 derivative records from 45590 primary records. [2025-09-24T22:23:25.019165] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-24T22:23:25.049025] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-24T22:23:25.050293] [DEBUG] [LOCAL ] MOD: Derivative data saved (1793 records). [2025-09-24T22:23:25.050084] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-24T22:23:25.053899] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-24T22:23:25.053731] [INFO ] [MAIN ] Derivative Progress: 1190/2075 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 47s. Rate: 153.1 symbols/min [2025-09-24T22:23:25.056441] [INFO ] [MAIN ] Derivative Progress: 1191/2075 symbols completed. MOD took 1.2s. Estimated remaining: 5m 46s. Rate: 153.2 symbols/min [2025-09-24T22:23:25.056804] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:25.056578] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:25.100050] [DEBUG] [LOCAL ] MODG: Loaded 51602 existing records from primary storage. [2025-09-24T22:23:25.100325] [INFO ] [MAIN ] MODG: Loaded 51602 primary data records. [2025-09-24T22:23:25.287342] [DEBUG] [LOCAL ] MOH: Loaded 41754 existing records from primary storage. [2025-09-24T22:23:25.296753] [INFO ] [MAIN ] MOH: Loaded 41754 primary data records. [2025-09-24T22:23:25.538174] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-24T22:23:25.556753] [INFO ] [MAIN ] MOS: Loaded 53506 primary data records. [2025-09-24T22:23:26.082787] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:26.083786] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51602 primary records. [2025-09-24T22:23:26.084144] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-24T22:23:26.113633] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:26.115139] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41754 primary records. [2025-09-24T22:23:26.115253] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-24T22:23:26.127185] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-24T22:23:26.127400] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-24T22:23:26.131012] [INFO ] [MAIN ] Derivative Progress: 1192/2075 symbols completed. MODG took 1.1s. Estimated remaining: 5m 46s. Rate: 153.0 symbols/min [2025-09-24T22:23:26.136107] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:26.152838] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:26.154327] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53506 primary records. [2025-09-24T22:23:26.155193] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-24T22:23:26.156229] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-24T22:23:26.156924] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-24T22:23:26.166217] [INFO ] [MAIN ] Derivative Progress: 1193/2075 symbols completed. MOH took 1.1s. Estimated remaining: 5m 46s. Rate: 153.1 symbols/min [2025-09-24T22:23:26.170426] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:26.187408] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-24T22:23:26.188548] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-24T22:23:26.191496] [DEBUG] [LOCAL ] MOV: Loaded 22172 existing records from primary storage. [2025-09-24T22:23:26.190890] [INFO ] [MAIN ] Derivative Progress: 1194/2075 symbols completed. MOS took 1.1s. Estimated remaining: 5m 45s. Rate: 153.3 symbols/min [2025-09-24T22:23:26.191787] [INFO ] [MAIN ] MOV: Loaded 22172 primary data records. [2025-09-24T22:23:26.191938] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:26.313240] [DEBUG] [LOCAL ] MPA: Loaded 5208 existing records from primary storage. [2025-09-24T22:23:26.365716] [INFO ] [MAIN ] MPA: Loaded 5208 primary data records. [2025-09-24T22:23:26.642071] [DEBUG] [LOCAL ] MP: Loaded 53664 existing records from primary storage. [2025-09-24T22:23:26.652767] [INFO ] [MAIN ] MP: Loaded 53664 primary data records. [2025-09-24T22:23:27.210525] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:27.212300] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22172 primary records. [2025-09-24T22:23:27.212409] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-24T22:23:27.239556] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:27.240631] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5208 primary records. [2025-09-24T22:23:27.240987] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-24T22:23:27.261150] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-09-24T22:23:27.261445] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-24T22:23:27.273694] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-24T22:23:27.269181] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-24T22:23:27.276283] [INFO ] [MAIN ] Derivative Progress: 1195/2075 symbols completed. MPA took 1.1s. Estimated remaining: 5m 45s. Rate: 153.0 symbols/min [2025-09-24T22:23:27.278807] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:27.279207] [DEBUG] [MAIN ] MP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:27.280478] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53664 primary records. [2025-09-24T22:23:27.280740] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-24T22:23:27.279605] [INFO ] [MAIN ] Derivative Progress: 1196/2075 symbols completed. MOV took 1.1s. Estimated remaining: 5m 44s. Rate: 153.2 symbols/min [2025-09-24T22:23:27.281744] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:27.298848] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-24T22:23:27.299101] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-24T22:23:27.301849] [INFO ] [MAIN ] Derivative Progress: 1197/2075 symbols completed. MP took 1.1s. Estimated remaining: 5m 44s. Rate: 153.3 symbols/min [2025-09-24T22:23:27.302131] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:27.310297] [DEBUG] [LOCAL ] MPV: Loaded 5054 existing records from primary storage. [2025-09-24T22:23:27.310427] [INFO ] [MAIN ] MPV: Loaded 5054 primary data records. [2025-09-24T22:23:27.570622] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-09-24T22:23:27.672547] [INFO ] [MAIN ] MPLX: Loaded 50731 primary data records. [2025-09-24T22:23:27.659303] [DEBUG] [LOCAL ] MPC: Loaded 52122 existing records from primary storage. [2025-09-24T22:23:27.672792] [INFO ] [MAIN ] MPC: Loaded 52122 primary data records. [2025-09-24T22:23:28.311580] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:28.312548] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 5054 primary records. [2025-09-24T22:23:28.312706] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-24T22:23:28.333928] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-09-24T22:23:28.334505] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-24T22:23:28.337882] [INFO ] [MAIN ] Derivative Progress: 1198/2075 symbols completed. MPV took 1.0s. Estimated remaining: 5m 44s. Rate: 153.1 symbols/min [2025-09-24T22:23:28.352459] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:28.353270] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52122 primary records. [2025-09-24T22:23:28.353405] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-24T22:23:28.365459] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:28.366679] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50731 primary records. [2025-09-24T22:23:28.366921] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-24T22:23:28.396974] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-24T22:23:28.397675] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-24T22:23:28.397759] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-24T22:23:28.397822] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-24T22:23:28.400007] [INFO ] [MAIN ] Derivative Progress: 1199/2075 symbols completed. MPLX took 1.1s. Estimated remaining: 5m 43s. Rate: 153.2 symbols/min [2025-09-24T22:23:28.402563] [INFO ] [MAIN ] Derivative Progress: 1200/2075 symbols completed. MPC took 1.1s. Estimated remaining: 5m 42s. Rate: 153.3 symbols/min [2025-09-24T22:23:28.403298] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:28.403191] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:28.403248] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:28.410471] [DEBUG] [LOCAL ] MPX: Loaded 4165 existing records from primary storage. [2025-09-24T22:23:28.410639] [INFO ] [MAIN ] MPX: Loaded 4165 primary data records. [2025-09-24T22:23:28.507383] [DEBUG] [LOCAL ] MQT: Loaded 8446 existing records from primary storage. [2025-09-24T22:23:28.519176] [INFO ] [MAIN ] MQT: Loaded 8446 primary data records. [2025-09-24T22:23:28.971790] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-24T22:23:29.075525] [INFO ] [MAIN ] MPW: Loaded 53501 primary data records. [2025-09-24T22:23:29.413422] [DEBUG] [MAIN ] MPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:29.414598] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4165 primary records. [2025-09-24T22:23:29.414796] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-24T22:23:29.447796] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:29.448629] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8446 primary records. [2025-09-24T22:23:29.447413] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-24T22:23:29.449186] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-24T22:23:29.449730] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-24T22:23:29.452261] [INFO ] [MAIN ] Derivative Progress: 1201/2075 symbols completed. MPX took 1.0s. Estimated remaining: 5m 43s. Rate: 153.1 symbols/min [2025-09-24T22:23:29.459415] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:29.470586] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-24T22:23:29.470901] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-24T22:23:29.473089] [INFO ] [MAIN ] Derivative Progress: 1202/2075 symbols completed. MQT took 1.1s. Estimated remaining: 5m 42s. Rate: 153.2 symbols/min [2025-09-24T22:23:29.473668] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:29.505905] [DEBUG] [MAIN ] MPW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:29.505423] [DEBUG] [LOCAL ] MQY: Loaded 16761 existing records from primary storage. [2025-09-24T22:23:29.506124] [INFO ] [MAIN ] MQY: Loaded 16761 primary data records. [2025-09-24T22:23:29.512415] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53501 primary records. [2025-09-24T22:23:29.539789] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-24T22:23:29.729962] [DEBUG] [LOCAL ] MRC: Loaded 37590 existing records from primary storage. [2025-09-24T22:23:29.734507] [INFO ] [MAIN ] MRC: Loaded 37590 primary data records. [2025-09-24T22:23:29.923323] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-24T22:23:29.942074] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-24T22:23:29.944851] [INFO ] [MAIN ] Derivative Progress: 1203/2075 symbols completed. MPW took 1.5s. Estimated remaining: 5m 42s. Rate: 153.2 symbols/min [2025-09-24T22:23:29.956823] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:30.188861] [DEBUG] [MAIN ] MQY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:30.190238] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16761 primary records. [2025-09-24T22:23:30.190431] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-24T22:23:30.224967] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-24T22:23:30.225119] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-24T22:23:30.227498] [INFO ] [MAIN ] Derivative Progress: 1204/2075 symbols completed. MQY took 0.8s. Estimated remaining: 5m 41s. Rate: 153.2 symbols/min [2025-09-24T22:23:30.228080] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:30.245581] [DEBUG] [MAIN ] MRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:30.246684] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37590 primary records. [2025-09-24T22:23:30.246887] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-24T22:23:30.271545] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-24T22:23:30.272694] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-24T22:23:30.354538] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-24T22:23:30.371691] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-24T22:23:30.387798] [INFO ] [MAIN ] Derivative Progress: 1205/2075 symbols completed. MRC took 0.9s. Estimated remaining: 5m 41s. Rate: 153.3 symbols/min [2025-09-24T22:23:30.391852] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:30.652844] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-24T22:23:30.653116] [INFO ] [MAIN ] MS: Loaded 53693 primary data records. [2025-09-24T22:23:30.768591] [DEBUG] [LOCAL ] MSA: Loaded 18776 existing records from primary storage. [2025-09-24T22:23:30.772847] [INFO ] [MAIN ] MSA: Loaded 18776 primary data records. [2025-09-24T22:23:31.297562] [DEBUG] [MAIN ] MRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:31.299190] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-24T22:23:31.299415] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-24T22:23:31.324185] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-24T22:23:31.325193] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-24T22:23:31.327702] [INFO ] [MAIN ] Derivative Progress: 1206/2075 symbols completed. MRK took 1.4s. Estimated remaining: 5m 41s. Rate: 153.1 symbols/min [2025-09-24T22:23:31.328367] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:31.341892] [DEBUG] [MAIN ] MS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:31.342791] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53693 primary records. [2025-09-24T22:23:31.343030] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-24T22:23:31.361385] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-24T22:23:31.361524] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-24T22:23:31.363548] [INFO ] [MAIN ] Derivative Progress: 1207/2075 symbols completed. MS took 1.1s. Estimated remaining: 5m 40s. Rate: 153.2 symbols/min [2025-09-24T22:23:31.367633] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:31.369498] [DEBUG] [LOCAL ] MSB: Loaded 7829 existing records from primary storage. [2025-09-24T22:23:31.370242] [INFO ] [MAIN ] MSB: Loaded 7829 primary data records. [2025-09-24T22:23:31.442215] [DEBUG] [MAIN ] MSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:31.463499] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18776 primary records. [2025-09-24T22:23:31.479791] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-24T22:23:31.714091] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-24T22:23:31.714226] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-24T22:23:31.716715] [INFO ] [MAIN ] Derivative Progress: 1208/2075 symbols completed. MSA took 1.3s. Estimated remaining: 5m 39s. Rate: 153.2 symbols/min [2025-09-24T22:23:31.717187] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:31.732300] [DEBUG] [LOCAL ] MSCI: Loaded 34828 existing records from primary storage. [2025-09-24T22:23:31.733028] [INFO ] [MAIN ] MSCI: Loaded 34828 primary data records. [2025-09-24T22:23:31.845891] [DEBUG] [LOCAL ] MSD: Loaded 15558 existing records from primary storage. [2025-09-24T22:23:31.849900] [INFO ] [MAIN ] MSD: Loaded 15558 primary data records. [2025-09-24T22:23:32.364925] [DEBUG] [MAIN ] MSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:32.366457] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7829 primary records. [2025-09-24T22:23:32.366698] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-24T22:23:32.390842] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-24T22:23:32.391244] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-24T22:23:32.393508] [INFO ] [MAIN ] Derivative Progress: 1209/2075 symbols completed. MSB took 1.1s. Estimated remaining: 5m 39s. Rate: 153.1 symbols/min [2025-09-24T22:23:32.393934] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:32.412975] [DEBUG] [MAIN ] MSCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:32.413945] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34828 primary records. [2025-09-24T22:23:32.414125] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-24T22:23:32.446207] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:32.447354] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15558 primary records. [2025-09-24T22:23:32.447800] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-24T22:23:32.466364] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-24T22:23:32.469473] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-24T22:23:32.473623] [INFO ] [MAIN ] Derivative Progress: 1210/2075 symbols completed. MSCI took 1.1s. Estimated remaining: 5m 39s. Rate: 153.3 symbols/min [2025-09-24T22:23:32.476126] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:32.477433] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-24T22:23:32.477742] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-24T22:23:32.480204] [INFO ] [MAIN ] Derivative Progress: 1211/2075 symbols completed. MSD took 0.8s. Estimated remaining: 5m 38s. Rate: 153.4 symbols/min [2025-09-24T22:23:32.480897] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:32.496078] [DEBUG] [LOCAL ] MSDL: Loaded 38031 existing records from primary storage. [2025-09-24T22:23:32.496318] [INFO ] [MAIN ] MSDL: Loaded 38031 primary data records. [2025-09-24T22:23:32.621690] [DEBUG] [LOCAL ] MSGS: Loaded 16903 existing records from primary storage. [2025-09-24T22:23:32.628264] [INFO ] [MAIN ] MSGS: Loaded 16903 primary data records. [2025-09-24T22:23:32.723100] [DEBUG] [LOCAL ] MSGE: Loaded 27077 existing records from primary storage. [2025-09-24T22:23:32.782308] [INFO ] [MAIN ] MSGE: Loaded 27077 primary data records. [2025-09-24T22:23:33.507904] [DEBUG] [MAIN ] MSDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:33.508798] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38031 primary records. [2025-09-24T22:23:33.508982] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-24T22:23:33.541131] [DEBUG] [MAIN ] MSGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:33.543370] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 16903 primary records. [2025-09-24T22:23:33.543743] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-24T22:23:33.561602] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-24T22:23:33.562745] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-24T22:23:33.562820] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-24T22:23:33.582873] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-24T22:23:33.585158] [INFO ] [MAIN ] Derivative Progress: 1212/2075 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 38s. Rate: 153.1 symbols/min [2025-09-24T22:23:33.588151] [INFO ] [MAIN ] Derivative Progress: 1213/2075 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 37s. Rate: 153.3 symbols/min [2025-09-24T22:23:33.587782] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:33.589268] [DEBUG] [MAIN ] MSGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:33.590925] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 27077 primary records. [2025-09-24T22:23:33.591119] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-24T22:23:33.613560] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-24T22:23:33.613753] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-24T22:23:33.616254] [INFO ] [MAIN ] Derivative Progress: 1214/2075 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 37s. Rate: 153.4 symbols/min [2025-09-24T22:23:33.645105] [DEBUG] [LOCAL ] MSI: Loaded 40594 existing records from primary storage. [2025-09-24T22:23:33.645246] [INFO ] [MAIN ] MSI: Loaded 40594 primary data records. [2025-09-24T22:23:33.953778] [DEBUG] [MAIN ] MSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:33.954456] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40594 primary records. [2025-09-24T22:23:33.954518] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-24T22:23:33.971710] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-24T22:23:33.971852] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-24T22:23:33.974536] [INFO ] [MAIN ] Derivative Progress: 1215/2075 symbols completed. MSI took 0.4s. Estimated remaining: 5m 36s. Rate: 153.4 symbols/min [2025-09-24T22:23:33.975363] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:33.975823] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:33.976290] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:34.071488] [DEBUG] [LOCAL ] MSM: Loaded 35344 existing records from primary storage. [2025-09-24T22:23:34.073637] [INFO ] [MAIN ] MSM: Loaded 35344 primary data records. [2025-09-24T22:23:34.081749] [DEBUG] [LOCAL ] MTAL: Loaded 36387 existing records from primary storage. [2025-09-24T22:23:34.146055] [INFO ] [MAIN ] MTAL: Loaded 36387 primary data records. [2025-09-24T22:23:34.227027] [DEBUG] [LOCAL ] MT: Loaded 50682 existing records from primary storage. [2025-09-24T22:23:34.248528] [INFO ] [MAIN ] MT: Loaded 50682 primary data records. [2025-09-24T22:23:35.440536] [DEBUG] [MAIN ] MSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:35.441744] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35344 primary records. [2025-09-24T22:23:35.442074] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-24T22:23:35.463721] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-24T22:23:35.477346] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-24T22:23:35.480573] [INFO ] [MAIN ] Derivative Progress: 1216/2075 symbols completed. MSM took 1.5s. Estimated remaining: 5m 37s. Rate: 153.0 symbols/min [2025-09-24T22:23:35.481882] [DEBUG] [MAIN ] MTAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:35.483162] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36387 primary records. [2025-09-24T22:23:35.483686] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:35.496543] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-24T22:23:35.498526] [DEBUG] [MAIN ] MT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:35.500088] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50682 primary records. [2025-09-24T22:23:35.500400] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-24T22:23:35.532468] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-24T22:23:35.533524] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-24T22:23:35.538121] [INFO ] [MAIN ] Derivative Progress: 1217/2075 symbols completed. MTAL took 1.6s. Estimated remaining: 5m 36s. Rate: 153.1 symbols/min [2025-09-24T22:23:35.540370] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:35.547765] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-24T22:23:35.548183] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-24T22:23:35.550972] [INFO ] [MAIN ] Derivative Progress: 1218/2075 symbols completed. MT took 1.6s. Estimated remaining: 5m 35s. Rate: 153.3 symbols/min [2025-09-24T22:23:35.551412] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:35.567440] [DEBUG] [LOCAL ] MTD: Loaded 15171 existing records from primary storage. [2025-09-24T22:23:35.567634] [INFO ] [MAIN ] MTD: Loaded 15171 primary data records. [2025-09-24T22:23:35.756916] [DEBUG] [LOCAL ] MTB: Loaded 46971 existing records from primary storage. [2025-09-24T22:23:35.782377] [INFO ] [MAIN ] MTB: Loaded 46971 primary data records. [2025-09-24T22:23:36.073345] [DEBUG] [LOCAL ] MTDR: Loaded 51547 existing records from primary storage. [2025-09-24T22:23:36.084070] [INFO ] [MAIN ] MTDR: Loaded 51547 primary data records. [2025-09-24T22:23:36.630691] [DEBUG] [MAIN ] MTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:36.632235] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15171 primary records. [2025-09-24T22:23:36.632732] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-24T22:23:36.659543] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-24T22:23:36.667777] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-24T22:23:36.669860] [INFO ] [MAIN ] Derivative Progress: 1219/2075 symbols completed. MTD took 1.1s. Estimated remaining: 5m 36s. Rate: 153.0 symbols/min [2025-09-24T22:23:36.676377] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:36.676047] [DEBUG] [MAIN ] MTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:36.677881] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 46971 primary records. [2025-09-24T22:23:36.678215] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-24T22:23:36.697679] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-24T22:23:36.698687] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-24T22:23:36.702714] [INFO ] [MAIN ] Derivative Progress: 1220/2075 symbols completed. MTB took 1.2s. Estimated remaining: 5m 35s. Rate: 153.1 symbols/min [2025-09-24T22:23:36.703704] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:36.718617] [DEBUG] [MAIN ] MTDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:36.719516] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51547 primary records. [2025-09-24T22:23:36.719715] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-24T22:23:36.737403] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-24T22:23:36.737536] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-24T22:23:36.740034] [INFO ] [MAIN ] Derivative Progress: 1221/2075 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 34s. Rate: 153.3 symbols/min [2025-09-24T22:23:36.740428] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:36.806837] [DEBUG] [LOCAL ] MTG: Loaded 51372 existing records from primary storage. [2025-09-24T22:23:36.807070] [INFO ] [MAIN ] MTG: Loaded 51372 primary data records. [2025-09-24T22:23:36.808074] [DEBUG] [LOCAL ] MTH: Loaded 43867 existing records from primary storage. [2025-09-24T22:23:36.838636] [INFO ] [MAIN ] MTH: Loaded 43867 primary data records. [2025-09-24T22:23:37.024364] [DEBUG] [LOCAL ] MTN: Loaded 39051 existing records from primary storage. [2025-09-24T22:23:37.079992] [INFO ] [MAIN ] MTN: Loaded 39051 primary data records. [2025-09-24T22:23:37.917506] [DEBUG] [MAIN ] MTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:37.918512] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51372 primary records. [2025-09-24T22:23:37.918992] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-24T22:23:37.934017] [DEBUG] [MAIN ] MTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:37.948436] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43867 primary records. [2025-09-24T22:23:37.951918] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-24T22:23:37.952035] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-24T22:23:37.952096] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-24T22:23:37.953966] [INFO ] [MAIN ] Derivative Progress: 1222/2075 symbols completed. MTG took 1.3s. Estimated remaining: 5m 35s. Rate: 153.0 symbols/min [2025-09-24T22:23:37.962599] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:37.976730] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-24T22:23:37.977118] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-24T22:23:37.987940] [INFO ] [MAIN ] Derivative Progress: 1223/2075 symbols completed. MTH took 1.3s. Estimated remaining: 5m 34s. Rate: 153.1 symbols/min [2025-09-24T22:23:37.993925] [DEBUG] [MAIN ] MTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:37.995155] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39051 primary records. [2025-09-24T22:23:37.995213] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:37.995379] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-24T22:23:38.025453] [DEBUG] [LOCAL ] MTRN: Loaded 18116 existing records from primary storage. [2025-09-24T22:23:38.025981] [INFO ] [MAIN ] MTRN: Loaded 18116 primary data records. [2025-09-24T22:23:38.045693] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-24T22:23:38.078590] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-24T22:23:38.126903] [INFO ] [MAIN ] Derivative Progress: 1224/2075 symbols completed. MTN took 1.4s. Estimated remaining: 5m 33s. Rate: 153.2 symbols/min [2025-09-24T22:23:38.176513] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:38.178016] [DEBUG] [LOCAL ] MTUS: Loaded 28641 existing records from primary storage. [2025-09-24T22:23:38.193893] [INFO ] [MAIN ] MTUS: Loaded 28641 primary data records. [2025-09-24T22:23:38.626010] [DEBUG] [LOCAL ] MTW: Loaded 26513 existing records from primary storage. [2025-09-24T22:23:38.660293] [INFO ] [MAIN ] MTW: Loaded 26513 primary data records. [2025-09-24T22:23:39.138680] [DEBUG] [MAIN ] MTRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:39.140606] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18116 primary records. [2025-09-24T22:23:39.141140] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-24T22:23:39.163221] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-24T22:23:39.164575] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-24T22:23:39.166911] [INFO ] [MAIN ] Derivative Progress: 1225/2075 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 33s. Rate: 153.0 symbols/min [2025-09-24T22:23:39.168839] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:39.184976] [DEBUG] [MAIN ] MTUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:39.186264] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28641 primary records. [2025-09-24T22:23:39.186680] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-24T22:23:39.204249] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-24T22:23:39.204789] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-24T22:23:39.207331] [INFO ] [MAIN ] Derivative Progress: 1226/2075 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 33s. Rate: 153.1 symbols/min [2025-09-24T22:23:39.208017] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:39.234139] [DEBUG] [MAIN ] MTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:39.235087] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26513 primary records. [2025-09-24T22:23:39.244276] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-24T22:23:39.247458] [DEBUG] [LOCAL ] MTX: Loaded 22844 existing records from primary storage. [2025-09-24T22:23:39.247806] [INFO ] [MAIN ] MTX: Loaded 22844 primary data records. [2025-09-24T22:23:39.407682] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-24T22:23:39.423398] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-24T22:23:39.449496] [INFO ] [MAIN ] Derivative Progress: 1227/2075 symbols completed. MTW took 1.3s. Estimated remaining: 5m 32s. Rate: 153.1 symbols/min [2025-09-24T22:23:39.511322] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:39.510884] [DEBUG] [LOCAL ] MTZ: Loaded 43360 existing records from primary storage. [2025-09-24T22:23:39.550452] [INFO ] [MAIN ] MTZ: Loaded 43360 primary data records. [2025-09-24T22:23:39.790299] [DEBUG] [LOCAL ] MUA: Loaded 12246 existing records from primary storage. [2025-09-24T22:23:39.795789] [INFO ] [MAIN ] MUA: Loaded 12246 primary data records. [2025-09-24T22:23:40.343257] [DEBUG] [MAIN ] MTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:40.345636] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22844 primary records. [2025-09-24T22:23:40.346181] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-24T22:23:40.375100] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-24T22:23:40.376836] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-24T22:23:40.381064] [INFO ] [MAIN ] Derivative Progress: 1228/2075 symbols completed. MTX took 1.2s. Estimated remaining: 5m 32s. Rate: 153.0 symbols/min [2025-09-24T22:23:40.396455] [DEBUG] [MAIN ] MTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:40.397473] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43360 primary records. [2025-09-24T22:23:40.397707] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-24T22:23:40.417513] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-09-24T22:23:40.417764] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-24T22:23:40.420207] [INFO ] [MAIN ] Derivative Progress: 1229/2075 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 32s. Rate: 153.1 symbols/min [2025-09-24T22:23:40.433377] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:40.434037] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12246 primary records. [2025-09-24T22:23:40.434151] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-24T22:23:40.449677] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-24T22:23:40.449765] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-24T22:23:40.452306] [INFO ] [MAIN ] Derivative Progress: 1230/2075 symbols completed. MUA took 0.9s. Estimated remaining: 5m 31s. Rate: 153.2 symbols/min [2025-09-24T22:23:40.452980] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:40.453242] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:40.453287] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:40.467822] [DEBUG] [LOCAL ] MUE: Loaded 11992 existing records from primary storage. [2025-09-24T22:23:40.467997] [INFO ] [MAIN ] MUE: Loaded 11992 primary data records. [2025-09-24T22:23:40.660035] [DEBUG] [LOCAL ] MUC: Loaded 20230 existing records from primary storage. [2025-09-24T22:23:40.679961] [INFO ] [MAIN ] MUC: Loaded 20230 primary data records. [2025-09-24T22:23:40.872186] [DEBUG] [LOCAL ] MUFG: Loaded 52608 existing records from primary storage. [2025-09-24T22:23:40.925570] [INFO ] [MAIN ] MUFG: Loaded 52608 primary data records. [2025-09-24T22:23:41.541618] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:41.542976] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11992 primary records. [2025-09-24T22:23:41.543862] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-24T22:23:41.580886] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-24T22:23:41.580222] [DEBUG] [MAIN ] MUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:41.581836] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20230 primary records. [2025-09-24T22:23:41.581064] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-24T22:23:41.582036] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-24T22:23:41.584680] [INFO ] [MAIN ] Derivative Progress: 1231/2075 symbols completed. MUE took 1.1s. Estimated remaining: 5m 31s. Rate: 153.0 symbols/min [2025-09-24T22:23:41.585517] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:41.608147] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-24T22:23:41.612208] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-24T22:23:41.622268] [INFO ] [MAIN ] Derivative Progress: 1232/2075 symbols completed. MUC took 1.2s. Estimated remaining: 5m 30s. Rate: 153.1 symbols/min [2025-09-24T22:23:41.628146] [DEBUG] [MAIN ] MUFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:41.627839] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:41.628981] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52608 primary records. [2025-09-24T22:23:41.629445] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-24T22:23:41.644699] [DEBUG] [LOCAL ] MUJ: Loaded 13328 existing records from primary storage. [2025-09-24T22:23:41.649577] [INFO ] [MAIN ] MUJ: Loaded 13328 primary data records. [2025-09-24T22:23:41.652976] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-24T22:23:41.658291] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-24T22:23:41.660893] [INFO ] [MAIN ] Derivative Progress: 1233/2075 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 30s. Rate: 153.2 symbols/min [2025-09-24T22:23:41.661193] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:42.005997] [DEBUG] [LOCAL ] MUSA: Loaded 24915 existing records from primary storage. [2025-09-24T22:23:42.007036] [INFO ] [MAIN ] MUSA: Loaded 24915 primary data records. [2025-09-24T22:23:42.131157] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-24T22:23:42.135401] [INFO ] [MAIN ] MUR: Loaded 52929 primary data records. [2025-09-24T22:23:42.676250] [DEBUG] [MAIN ] MUJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:42.677679] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13328 primary records. [2025-09-24T22:23:42.678079] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-24T22:23:42.698237] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-24T22:23:42.699370] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-24T22:23:42.703570] [INFO ] [MAIN ] Derivative Progress: 1234/2075 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 30s. Rate: 153.0 symbols/min [2025-09-24T22:23:42.705003] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:42.719042] [DEBUG] [MAIN ] MUSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:42.719830] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24915 primary records. [2025-09-24T22:23:42.720010] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-24T22:23:42.739896] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-24T22:23:42.740800] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-24T22:23:42.743297] [INFO ] [MAIN ] Derivative Progress: 1235/2075 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 29s. Rate: 153.1 symbols/min [2025-09-24T22:23:42.743794] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:42.758166] [DEBUG] [MAIN ] MUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:42.758952] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52929 primary records. [2025-09-24T22:23:42.759102] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-24T22:23:42.792136] [DEBUG] [LOCAL ] MVF: Loaded 12751 existing records from primary storage. [2025-09-24T22:23:42.793212] [INFO ] [MAIN ] MVF: Loaded 12751 primary data records. [2025-09-24T22:23:42.862154] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-24T22:23:42.876948] [DEBUG] [LOCAL ] MUX: Loaded 42544 existing records from primary storage. [2025-09-24T22:23:42.889286] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-24T22:23:42.884106] [INFO ] [MAIN ] MUX: Loaded 42544 primary data records. [2025-09-24T22:23:42.891769] [INFO ] [MAIN ] Derivative Progress: 1236/2075 symbols completed. MUR took 1.3s. Estimated remaining: 5m 29s. Rate: 153.2 symbols/min [2025-09-24T22:23:42.913866] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:43.223387] [DEBUG] [LOCAL ] MVO: Loaded 9065 existing records from primary storage. [2025-09-24T22:23:43.229613] [INFO ] [MAIN ] MVO: Loaded 9065 primary data records. [2025-09-24T22:23:43.823469] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:43.824742] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12751 primary records. [2025-09-24T22:23:43.824847] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-24T22:23:43.843491] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-24T22:23:43.844012] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-24T22:23:43.848195] [INFO ] [MAIN ] Derivative Progress: 1237/2075 symbols completed. MVF took 1.1s. Estimated remaining: 5m 29s. Rate: 153.0 symbols/min [2025-09-24T22:23:43.848957] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:43.870246] [DEBUG] [MAIN ] MUX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:43.871167] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42544 primary records. [2025-09-24T22:23:43.871419] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-24T22:23:43.893959] [DEBUG] [LOCAL ] MVT: Loaded 10084 existing records from primary storage. [2025-09-24T22:23:43.894505] [INFO ] [MAIN ] MVT: Loaded 10084 primary data records. [2025-09-24T22:23:43.955798] [DEBUG] [MAIN ] MVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:43.978897] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 9065 primary records. [2025-09-24T22:23:43.991927] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-24T22:23:44.029430] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-24T22:23:44.032907] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-24T22:23:44.051440] [INFO ] [MAIN ] Derivative Progress: 1238/2075 symbols completed. MUX took 1.3s. Estimated remaining: 5m 28s. Rate: 153.1 symbols/min [2025-09-24T22:23:44.062695] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:44.122960] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-24T22:23:44.229904] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-24T22:23:44.241689] [INFO ] [MAIN ] Derivative Progress: 1239/2075 symbols completed. MVO took 1.3s. Estimated remaining: 5m 28s. Rate: 153.1 symbols/min [2025-09-24T22:23:44.242360] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:44.295411] [DEBUG] [LOCAL ] MX: Loaded 23108 existing records from primary storage. [2025-09-24T22:23:44.294706] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:44.296081] [INFO ] [MAIN ] MX: Loaded 23108 primary data records. [2025-09-24T22:23:44.297136] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10084 primary records. [2025-09-24T22:23:44.311826] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-24T22:23:44.390014] [DEBUG] [LOCAL ] MWA: Loaded 47050 existing records from primary storage. [2025-09-24T22:23:44.438243] [INFO ] [MAIN ] MWA: Loaded 47050 primary data records. [2025-09-24T22:23:44.741923] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-24T22:23:44.750892] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-24T22:23:44.759336] [INFO ] [MAIN ] Derivative Progress: 1240/2075 symbols completed. MVT took 0.9s. Estimated remaining: 5m 27s. Rate: 153.1 symbols/min [2025-09-24T22:23:44.781356] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:44.969521] [DEBUG] [LOCAL ] MXF: Loaded 5969 existing records from primary storage. [2025-09-24T22:23:44.970167] [INFO ] [MAIN ] MXF: Loaded 5969 primary data records. [2025-09-24T22:23:45.302628] [DEBUG] [MAIN ] MX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:45.303602] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 23108 primary records. [2025-09-24T22:23:45.303824] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-24T22:23:45.328285] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-24T22:23:45.328551] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-24T22:23:45.331026] [INFO ] [MAIN ] Derivative Progress: 1241/2075 symbols completed. MX took 1.1s. Estimated remaining: 5m 27s. Rate: 153.0 symbols/min [2025-09-24T22:23:45.344064] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:45.345064] [DEBUG] [MAIN ] MWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:45.347347] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 47050 primary records. [2025-09-24T22:23:45.347589] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-24T22:23:45.374877] [DEBUG] [LOCAL ] MYD: Loaded 13773 existing records from primary storage. [2025-09-24T22:23:45.376396] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-24T22:23:45.376616] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-24T22:23:45.380952] [INFO ] [MAIN ] MYD: Loaded 13773 primary data records. [2025-09-24T22:23:45.379917] [INFO ] [MAIN ] Derivative Progress: 1242/2075 symbols completed. MWA took 1.3s. Estimated remaining: 5m 26s. Rate: 153.1 symbols/min [2025-09-24T22:23:45.413141] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:45.482623] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:45.500497] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5969 primary records. [2025-09-24T22:23:45.506360] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-24T22:23:45.758177] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-24T22:23:45.758468] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-24T22:23:45.761233] [INFO ] [MAIN ] Derivative Progress: 1243/2075 symbols completed. MXF took 1.0s. Estimated remaining: 5m 26s. Rate: 153.1 symbols/min [2025-09-24T22:23:45.774182] [DEBUG] [LOCAL ] MYE: Loaded 25021 existing records from primary storage. [2025-09-24T22:23:45.774410] [INFO ] [MAIN ] MYE: Loaded 25021 primary data records. [2025-09-24T22:23:46.095148] [DEBUG] [MAIN ] MYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:46.104903] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13773 primary records. [2025-09-24T22:23:46.105071] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-24T22:23:46.126953] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-24T22:23:46.127205] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-24T22:23:46.129441] [INFO ] [MAIN ] Derivative Progress: 1244/2075 symbols completed. MYD took 0.8s. Estimated remaining: 5m 26s. Rate: 153.1 symbols/min [2025-09-24T22:23:46.147500] [DEBUG] [MAIN ] MYE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:46.148227] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 25021 primary records. [2025-09-24T22:23:46.148289] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-24T22:23:46.164352] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-24T22:23:46.164474] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-24T22:23:46.166947] [INFO ] [MAIN ] Derivative Progress: 1245/2075 symbols completed. MYE took 0.8s. Estimated remaining: 5m 25s. Rate: 153.3 symbols/min [2025-09-24T22:23:46.167625] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:46.168220] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:46.167954] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:46.188886] [DEBUG] [LOCAL ] MYN: Loaded 10238 existing records from primary storage. [2025-09-24T22:23:46.189237] [INFO ] [MAIN ] MYN: Loaded 10238 primary data records. [2025-09-24T22:23:46.245182] [DEBUG] [LOCAL ] MYI: Loaded 19328 existing records from primary storage. [2025-09-24T22:23:46.294073] [INFO ] [MAIN ] MYI: Loaded 19328 primary data records. [2025-09-24T22:23:46.437842] [DEBUG] [LOCAL ] NABL: Loaded 39814 existing records from primary storage. [2025-09-24T22:23:46.503927] [INFO ] [MAIN ] NABL: Loaded 39814 primary data records. [2025-09-24T22:23:47.214855] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:47.217041] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10238 primary records. [2025-09-24T22:23:47.217290] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-24T22:23:47.239924] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-24T22:23:47.250419] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-24T22:23:47.257102] [INFO ] [MAIN ] Derivative Progress: 1246/2075 symbols completed. MYN took 1.1s. Estimated remaining: 5m 25s. Rate: 153.0 symbols/min [2025-09-24T22:23:47.257550] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:47.271411] [DEBUG] [MAIN ] MYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:47.272507] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19328 primary records. [2025-09-24T22:23:47.272686] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-24T22:23:47.273812] [DEBUG] [MAIN ] NABL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:47.274783] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39814 primary records. [2025-09-24T22:23:47.274918] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-24T22:23:47.304135] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-24T22:23:47.309800] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-24T22:23:47.312630] [INFO ] [MAIN ] Derivative Progress: 1247/2075 symbols completed. MYI took 1.1s. Estimated remaining: 5m 24s. Rate: 153.1 symbols/min [2025-09-24T22:23:47.313193] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:47.327574] [DEBUG] [LOCAL ] NAC: Loaded 24631 existing records from primary storage. [2025-09-24T22:23:47.327730] [INFO ] [MAIN ] NAC: Loaded 24631 primary data records. [2025-09-24T22:23:47.327047] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-24T22:23:47.327927] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-24T22:23:47.361457] [INFO ] [MAIN ] Derivative Progress: 1248/2075 symbols completed. NABL took 1.2s. Estimated remaining: 5m 24s. Rate: 153.2 symbols/min [2025-09-24T22:23:47.411427] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:47.688732] [DEBUG] [LOCAL ] NAN: Loaded 9041 existing records from primary storage. [2025-09-24T22:23:47.689941] [DEBUG] [LOCAL ] NAD: Loaded 33965 existing records from primary storage. [2025-09-24T22:23:47.690081] [INFO ] [MAIN ] NAD: Loaded 33965 primary data records. [2025-09-24T22:23:47.690135] [INFO ] [MAIN ] NAN: Loaded 9041 primary data records. [2025-09-24T22:23:48.331472] [DEBUG] [MAIN ] NAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:48.332826] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24631 primary records. [2025-09-24T22:23:48.333121] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-24T22:23:48.353915] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-24T22:23:48.354403] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-24T22:23:48.357165] [INFO ] [MAIN ] Derivative Progress: 1249/2075 symbols completed. NAC took 1.1s. Estimated remaining: 5m 24s. Rate: 153.1 symbols/min [2025-09-24T22:23:48.357809] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:48.376071] [DEBUG] [MAIN ] NAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:48.376952] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33965 primary records. [2025-09-24T22:23:48.384842] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-24T22:23:48.390502] [DEBUG] [MAIN ] NAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:48.391193] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 9041 primary records. [2025-09-24T22:23:48.391514] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-24T22:23:48.420563] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-24T22:23:48.421427] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-24T22:23:48.424291] [INFO ] [MAIN ] Derivative Progress: 1250/2075 symbols completed. NAD took 1.1s. Estimated remaining: 5m 23s. Rate: 153.2 symbols/min [2025-09-24T22:23:48.425183] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:48.427413] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-24T22:23:48.427493] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-24T22:23:48.429989] [INFO ] [MAIN ] Derivative Progress: 1251/2075 symbols completed. NAN took 1.0s. Estimated remaining: 5m 23s. Rate: 153.3 symbols/min [2025-09-24T22:23:48.430452] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:48.446122] [DEBUG] [LOCAL ] NAZ: Loaded 2671 existing records from primary storage. [2025-09-24T22:23:48.446310] [INFO ] [MAIN ] NAZ: Loaded 2671 primary data records. [2025-09-24T22:23:48.577744] [DEBUG] [LOCAL ] NAT: Loaded 49103 existing records from primary storage. [2025-09-24T22:23:48.583866] [INFO ] [MAIN ] NAT: Loaded 49103 primary data records. [2025-09-24T22:23:48.768588] [DEBUG] [LOCAL ] NATL: Loaded 32862 existing records from primary storage. [2025-09-24T22:23:48.916867] [INFO ] [MAIN ] NATL: Loaded 32862 primary data records. [2025-09-24T22:23:49.516558] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:49.517627] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2671 primary records. [2025-09-24T22:23:49.517765] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-24T22:23:49.550637] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-24T22:23:49.551153] [DEBUG] [MAIN ] NAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:49.551985] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49103 primary records. [2025-09-24T22:23:49.552233] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-24T22:23:49.552331] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-24T22:23:49.555774] [INFO ] [MAIN ] Derivative Progress: 1252/2075 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 23s. Rate: 153.1 symbols/min [2025-09-24T22:23:49.569551] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:49.593996] [DEBUG] [MAIN ] NATL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:49.596236] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32862 primary records. [2025-09-24T22:23:49.601830] [DEBUG] [LOCAL ] NBB: Loaded 8877 existing records from primary storage. [2025-09-24T22:23:49.602015] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-24T22:23:49.601477] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-24T22:23:49.603023] [INFO ] [MAIN ] NBB: Loaded 8877 primary data records. [2025-09-24T22:23:49.603305] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-24T22:23:49.618920] [INFO ] [MAIN ] Derivative Progress: 1253/2075 symbols completed. NAT took 1.3s. Estimated remaining: 5m 22s. Rate: 153.2 symbols/min [2025-09-24T22:23:49.630540] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:49.663662] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-24T22:23:49.669274] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-24T22:23:49.690875] [INFO ] [MAIN ] Derivative Progress: 1254/2075 symbols completed. NATL took 1.3s. Estimated remaining: 5m 21s. Rate: 153.3 symbols/min [2025-09-24T22:23:49.698437] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:49.810854] [DEBUG] [LOCAL ] NBHC: Loaded 23172 existing records from primary storage. [2025-09-24T22:23:49.828506] [INFO ] [MAIN ] NBHC: Loaded 23172 primary data records. [2025-09-24T22:23:50.081573] [DEBUG] [LOCAL ] NBR: Loaded 34854 existing records from primary storage. [2025-09-24T22:23:50.092509] [INFO ] [MAIN ] NBR: Loaded 34854 primary data records. [2025-09-24T22:23:50.619051] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:50.620265] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8877 primary records. [2025-09-24T22:23:50.620661] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-24T22:23:50.643537] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-24T22:23:50.651400] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-24T22:23:50.658558] [INFO ] [MAIN ] Derivative Progress: 1255/2075 symbols completed. NBB took 1.1s. Estimated remaining: 5m 21s. Rate: 153.1 symbols/min [2025-09-24T22:23:50.659325] [DEBUG] [MAIN ] NBHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:50.659543] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:50.660461] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23172 primary records. [2025-09-24T22:23:50.660943] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-24T22:23:50.699668] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-24T22:23:50.700294] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-24T22:23:50.700199] [DEBUG] [MAIN ] NBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:50.704088] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34854 primary records. [2025-09-24T22:23:50.704193] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-24T22:23:50.703199] [INFO ] [MAIN ] Derivative Progress: 1256/2075 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 21s. Rate: 153.2 symbols/min [2025-09-24T22:23:50.704694] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:50.726445] [DEBUG] [LOCAL ] NBXG: Loaded 22519 existing records from primary storage. [2025-09-24T22:23:50.726613] [INFO ] [MAIN ] NBXG: Loaded 22519 primary data records. [2025-09-24T22:23:50.731522] [DEBUG] [LOCAL ] NC: Loaded 1909 existing records from primary storage. [2025-09-24T22:23:50.752817] [INFO ] [MAIN ] NC: Loaded 1909 primary data records. [2025-09-24T22:23:50.850340] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-24T22:23:50.862580] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-24T22:23:50.895968] [INFO ] [MAIN ] Derivative Progress: 1257/2075 symbols completed. NBR took 1.2s. Estimated remaining: 5m 20s. Rate: 153.2 symbols/min [2025-09-24T22:23:50.907672] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:51.253780] [DEBUG] [LOCAL ] NCA: Loaded 10054 existing records from primary storage. [2025-09-24T22:23:51.405556] [INFO ] [MAIN ] NCA: Loaded 10054 primary data records. [2025-09-24T22:23:51.775810] [DEBUG] [MAIN ] NBXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:51.778191] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22519 primary records. [2025-09-24T22:23:51.778514] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-24T22:23:51.806840] [DEBUG] [MAIN ] NC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:51.807937] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 1909 primary records. [2025-09-24T22:23:51.809565] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-24T22:23:51.826081] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-24T22:23:51.827738] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-24T22:23:51.831789] [INFO ] [MAIN ] Derivative Progress: 1258/2075 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 20s. Rate: 153.1 symbols/min [2025-09-24T22:23:51.834260] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-09-24T22:23:51.834420] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-24T22:23:51.837637] [INFO ] [MAIN ] Derivative Progress: 1259/2075 symbols completed. NC took 1.1s. Estimated remaining: 5m 20s. Rate: 153.2 symbols/min [2025-09-24T22:23:51.852735] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:51.853356] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10054 primary records. [2025-09-24T22:23:51.853418] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-24T22:23:51.868397] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-24T22:23:51.868489] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-24T22:23:51.871185] [INFO ] [MAIN ] Derivative Progress: 1260/2075 symbols completed. NCA took 1.0s. Estimated remaining: 5m 19s. Rate: 153.3 symbols/min [2025-09-24T22:23:51.871902] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:51.871986] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:51.872154] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:51.889482] [DEBUG] [LOCAL ] NCV: Loaded 13371 existing records from primary storage. [2025-09-24T22:23:51.889711] [INFO ] [MAIN ] NCV: Loaded 13371 primary data records. [2025-09-24T22:23:52.065869] [DEBUG] [LOCAL ] NCDL: Loaded 21524 existing records from primary storage. [2025-09-24T22:23:52.105439] [INFO ] [MAIN ] NCDL: Loaded 21524 primary data records. [2025-09-24T22:23:52.319880] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-24T22:23:52.337452] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-24T22:23:52.870994] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:52.885511] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13371 primary records. [2025-09-24T22:23:52.886157] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-24T22:23:52.910884] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-24T22:23:52.911125] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-24T22:23:52.914010] [INFO ] [MAIN ] Derivative Progress: 1261/2075 symbols completed. NCV took 1.0s. Estimated remaining: 5m 19s. Rate: 153.1 symbols/min [2025-09-24T22:23:52.914396] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:52.932105] [DEBUG] [MAIN ] NCDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:52.935982] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21524 primary records. [2025-09-24T22:23:52.936289] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-24T22:23:52.956323] [DEBUG] [LOCAL ] NCZ: Loaded 11770 existing records from primary storage. [2025-09-24T22:23:52.956744] [INFO ] [MAIN ] NCZ: Loaded 11770 primary data records. [2025-09-24T22:23:53.028779] [DEBUG] [MAIN ] NCLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:53.029797] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-24T22:23:53.042574] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-24T22:23:53.054855] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-24T22:23:53.090204] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-24T22:23:53.095706] [INFO ] [MAIN ] Derivative Progress: 1262/2075 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 18s. Rate: 153.2 symbols/min [2025-09-24T22:23:53.097211] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:53.284347] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-24T22:23:53.292953] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-24T22:23:53.295823] [INFO ] [MAIN ] Derivative Progress: 1263/2075 symbols completed. NCLH took 1.4s. Estimated remaining: 5m 18s. Rate: 153.2 symbols/min [2025-09-24T22:23:53.296192] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:53.311255] [DEBUG] [LOCAL ] NDMO: Loaded 16693 existing records from primary storage. [2025-09-24T22:23:53.311515] [INFO ] [MAIN ] NDMO: Loaded 16693 primary data records. [2025-09-24T22:23:53.681838] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:53.697206] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11770 primary records. [2025-09-24T22:23:53.697732] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-24T22:23:53.699869] [DEBUG] [LOCAL ] NE: Loaded 52384 existing records from primary storage. [2025-09-24T22:23:53.700236] [INFO ] [MAIN ] NE: Loaded 52384 primary data records. [2025-09-24T22:23:53.869865] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-24T22:23:53.901198] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-24T22:23:54.025311] [INFO ] [MAIN ] Derivative Progress: 1264/2075 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 18s. Rate: 153.1 symbols/min [2025-09-24T22:23:54.026117] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:54.040734] [DEBUG] [MAIN ] NDMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:54.041697] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16693 primary records. [2025-09-24T22:23:54.041934] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-24T22:23:54.062310] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-24T22:23:54.062463] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-24T22:23:54.065244] [INFO ] [MAIN ] Derivative Progress: 1265/2075 symbols completed. NDMO took 1.0s. Estimated remaining: 5m 17s. Rate: 153.2 symbols/min [2025-09-24T22:23:54.065842] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:54.092894] [DEBUG] [MAIN ] NE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:54.093675] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52384 primary records. [2025-09-24T22:23:54.094319] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-24T22:23:54.117908] [DEBUG] [LOCAL ] NEA: Loaded 35277 existing records from primary storage. [2025-09-24T22:23:54.118504] [INFO ] [MAIN ] NEA: Loaded 35277 primary data records. [2025-09-24T22:23:54.250260] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-24T22:23:54.292809] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-24T22:23:54.338756] [INFO ] [MAIN ] Derivative Progress: 1266/2075 symbols completed. NE took 1.0s. Estimated remaining: 5m 17s. Rate: 153.3 symbols/min [2025-09-24T22:23:54.345030] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:54.463197] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-24T22:23:54.464502] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-24T22:23:54.813783] [DEBUG] [MAIN ] NEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:54.814634] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35277 primary records. [2025-09-24T22:23:54.829172] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-24T22:23:54.831386] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-24T22:23:54.831734] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-24T22:23:54.952630] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-24T22:23:54.970142] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-24T22:23:54.983689] [INFO ] [MAIN ] Derivative Progress: 1267/2075 symbols completed. NEA took 1.0s. Estimated remaining: 5m 16s. Rate: 153.2 symbols/min [2025-09-24T22:23:55.014819] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:55.055624] [DEBUG] [MAIN ] NEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:55.172085] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-24T22:23:55.182012] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-24T22:23:55.204386] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-24T22:23:55.204678] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-24T22:23:55.207194] [INFO ] [MAIN ] Derivative Progress: 1268/2075 symbols completed. NEE took 1.1s. Estimated remaining: 5m 16s. Rate: 153.2 symbols/min [2025-09-24T22:23:55.208300] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:55.233695] [DEBUG] [LOCAL ] NEU: Loaded 8119 existing records from primary storage. [2025-09-24T22:23:55.234108] [INFO ] [MAIN ] NEU: Loaded 8119 primary data records. [2025-09-24T22:23:55.378926] [DEBUG] [LOCAL ] NET: Loaded 53059 existing records from primary storage. [2025-09-24T22:23:55.391029] [INFO ] [MAIN ] NET: Loaded 53059 primary data records. [2025-09-24T22:23:55.390907] [DEBUG] [MAIN ] NEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:55.392291] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-24T22:23:55.413727] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-24T22:23:55.829012] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-24T22:23:55.933702] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-24T22:23:55.950288] [INFO ] [MAIN ] Derivative Progress: 1269/2075 symbols completed. NEM took 1.6s. Estimated remaining: 5m 16s. Rate: 153.1 symbols/min [2025-09-24T22:23:55.950782] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:55.957828] [DEBUG] [LOCAL ] NEUE: Loaded 2237 existing records from primary storage. [2025-09-24T22:23:55.959090] [INFO ] [MAIN ] NEUE: Loaded 2237 primary data records. [2025-09-24T22:23:56.099825] [DEBUG] [MAIN ] NEU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:56.106917] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8119 primary records. [2025-09-24T22:23:56.122836] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-24T22:23:56.356444] [DEBUG] [MAIN ] NET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:56.356075] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-24T22:23:56.357431] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53059 primary records. [2025-09-24T22:23:56.358077] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-24T22:23:56.358009] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-24T22:23:56.360621] [INFO ] [MAIN ] Derivative Progress: 1270/2075 symbols completed. NEU took 1.2s. Estimated remaining: 5m 15s. Rate: 153.1 symbols/min [2025-09-24T22:23:56.361622] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:56.387158] [DEBUG] [LOCAL ] NEXA: Loaded 4133 existing records from primary storage. [2025-09-24T22:23:56.388700] [INFO ] [MAIN ] NEXA: Loaded 4133 primary data records. [2025-09-24T22:23:56.421627] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-24T22:23:56.446557] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-24T22:23:56.497741] [INFO ] [MAIN ] Derivative Progress: 1271/2075 symbols completed. NET took 1.5s. Estimated remaining: 5m 15s. Rate: 153.2 symbols/min [2025-09-24T22:23:56.503858] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:56.712341] [DEBUG] [MAIN ] NEUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:56.713237] [INFO ] [MAIN ] NEUE: Generated 1794 derivative records from 2237 primary records. [2025-09-24T22:23:56.713402] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-24T22:23:56.730284] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1794 records). [2025-09-24T22:23:56.730414] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-24T22:23:56.733170] [INFO ] [MAIN ] Derivative Progress: 1272/2075 symbols completed. NEUE took 0.8s. Estimated remaining: 5m 14s. Rate: 153.3 symbols/min [2025-09-24T22:23:56.733578] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:56.767858] [DEBUG] [LOCAL ] NFG: Loaded 38534 existing records from primary storage. [2025-09-24T22:23:56.769786] [INFO ] [MAIN ] NFG: Loaded 38534 primary data records. [2025-09-24T22:23:56.813147] [DEBUG] [LOCAL ] NFJ: Loaded 20212 existing records from primary storage. [2025-09-24T22:23:56.833177] [INFO ] [MAIN ] NFJ: Loaded 20212 primary data records. [2025-09-24T22:23:56.942771] [DEBUG] [MAIN ] NEXA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:23:56.964923] [INFO ] [MAIN ] NEXA: Generated 1793 derivative records from 4133 primary records. [2025-09-24T22:23:56.985901] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-24T22:23:57.336521] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1793 records). [2025-09-24T22:23:57.337546] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-24T22:23:57.340245] [INFO ] [MAIN ] Derivative Progress: 1273/2075 symbols completed. NEXA took 1.0s. Estimated remaining: 5m 14s. Rate: 153.2 symbols/min [2025-09-24T22:23:57.578383] [DEBUG] [MAIN ] NFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:57.579520] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38534 primary records. [2025-09-24T22:23:57.579906] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-24T22:23:57.600684] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-24T22:23:57.601987] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-24T22:23:57.604573] [INFO ] [MAIN ] Derivative Progress: 1274/2075 symbols completed. NFG took 1.1s. Estimated remaining: 5m 14s. Rate: 153.2 symbols/min [2025-09-24T22:23:57.621739] [DEBUG] [MAIN ] NFJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:57.622680] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20212 primary records. [2025-09-24T22:23:57.622755] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-24T22:23:57.640258] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-24T22:23:57.640369] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-24T22:23:57.643168] [INFO ] [MAIN ] Derivative Progress: 1275/2075 symbols completed. NFJ took 0.9s. Estimated remaining: 5m 13s. Rate: 153.3 symbols/min [2025-09-24T22:23:57.644050] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:57.644291] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:57.644859] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:57.660425] [DEBUG] [LOCAL ] NGS: Loaded 11534 existing records from primary storage. [2025-09-24T22:23:57.660712] [INFO ] [MAIN ] NGS: Loaded 11534 primary data records. [2025-09-24T22:23:57.894180] [DEBUG] [LOCAL ] NGL: Loaded 30421 existing records from primary storage. [2025-09-24T22:23:58.002413] [INFO ] [MAIN ] NGL: Loaded 30421 primary data records. [2025-09-24T22:23:58.002236] [DEBUG] [LOCAL ] NGG: Loaded 46191 existing records from primary storage. [2025-09-24T22:23:58.011471] [INFO ] [MAIN ] NGG: Loaded 46191 primary data records. [2025-09-24T22:23:58.663593] [DEBUG] [MAIN ] NGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:58.664543] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11534 primary records. [2025-09-24T22:23:58.665357] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-24T22:23:58.698804] [DEBUG] [MAIN ] NGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:58.699895] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-24T22:23:58.700805] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-24T22:23:58.700724] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46191 primary records. [2025-09-24T22:23:58.703556] [INFO ] [MAIN ] Derivative Progress: 1276/2075 symbols completed. NGS took 1.1s. Estimated remaining: 5m 13s. Rate: 153.1 symbols/min [2025-09-24T22:23:58.700961] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-24T22:23:58.704569] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:58.735070] [DEBUG] [MAIN ] NGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:58.736400] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30421 primary records. [2025-09-24T22:23:58.737060] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-24T22:23:58.744097] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-24T22:23:58.754979] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-24T22:23:58.757264] [INFO ] [MAIN ] Derivative Progress: 1277/2075 symbols completed. NGG took 1.1s. Estimated remaining: 5m 12s. Rate: 153.2 symbols/min [2025-09-24T22:23:58.757833] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:58.769117] [DEBUG] [LOCAL ] NGVC: Loaded 22321 existing records from primary storage. [2025-09-24T22:23:58.769341] [INFO ] [MAIN ] NGVC: Loaded 22321 primary data records. [2025-09-24T22:23:58.807118] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-24T22:23:58.858062] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-24T22:23:58.871578] [INFO ] [MAIN ] Derivative Progress: 1278/2075 symbols completed. NGL took 1.2s. Estimated remaining: 5m 12s. Rate: 153.3 symbols/min [2025-09-24T22:23:58.882978] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:58.918735] [DEBUG] [LOCAL ] NGVT: Loaded 24353 existing records from primary storage. [2025-09-24T22:23:58.952283] [INFO ] [MAIN ] NGVT: Loaded 24353 primary data records. [2025-09-24T22:23:59.260307] [DEBUG] [LOCAL ] NHI: Loaded 21990 existing records from primary storage. [2025-09-24T22:23:59.269706] [INFO ] [MAIN ] NHI: Loaded 21990 primary data records. [2025-09-24T22:23:59.783366] [DEBUG] [MAIN ] NGVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:59.784184] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22321 primary records. [2025-09-24T22:23:59.784747] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-24T22:23:59.809051] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-24T22:23:59.809673] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-24T22:23:59.811915] [INFO ] [MAIN ] Derivative Progress: 1279/2075 symbols completed. NGVC took 1.1s. Estimated remaining: 5m 12s. Rate: 153.2 symbols/min [2025-09-24T22:23:59.812602] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:23:59.830838] [DEBUG] [MAIN ] NGVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:59.832320] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24353 primary records. [2025-09-24T22:23:59.835046] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-24T22:23:59.868739] [DEBUG] [MAIN ] NHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:23:59.870189] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21990 primary records. [2025-09-24T22:23:59.867424] [DEBUG] [LOCAL ] NIC: Loaded 8889 existing records from primary storage. [2025-09-24T22:23:59.870686] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-24T22:23:59.870594] [INFO ] [MAIN ] NIC: Loaded 8889 primary data records. [2025-09-24T22:23:59.958746] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-24T22:23:59.983595] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-24T22:23:59.998241] [INFO ] [MAIN ] Derivative Progress: 1280/2075 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 11s. Rate: 153.2 symbols/min [2025-09-24T22:24:00.004609] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:00.077267] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-24T22:24:00.205124] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-24T22:24:00.208878] [INFO ] [MAIN ] Derivative Progress: 1281/2075 symbols completed. NHI took 1.3s. Estimated remaining: 5m 11s. Rate: 153.3 symbols/min [2025-09-24T22:24:00.209429] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:00.216074] [DEBUG] [LOCAL ] NIE: Loaded 11620 existing records from primary storage. [2025-09-24T22:24:00.216381] [INFO ] [MAIN ] NIE: Loaded 11620 primary data records. [2025-09-24T22:24:00.258621] [DEBUG] [LOCAL ] NIM: Loaded 4103 existing records from primary storage. [2025-09-24T22:24:00.303950] [INFO ] [MAIN ] NIM: Loaded 4103 primary data records. [2025-09-24T22:24:00.867269] [DEBUG] [MAIN ] NIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:00.869370] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8889 primary records. [2025-09-24T22:24:00.869995] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-24T22:24:00.891215] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-24T22:24:00.891484] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-24T22:24:00.894239] [INFO ] [MAIN ] Derivative Progress: 1282/2075 symbols completed. NIC took 1.1s. Estimated remaining: 5m 11s. Rate: 153.2 symbols/min [2025-09-24T22:24:00.894684] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:00.912304] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:00.913131] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11620 primary records. [2025-09-24T22:24:00.913455] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-24T22:24:00.952205] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:00.953633] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4103 primary records. [2025-09-24T22:24:00.954935] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-24T22:24:00.954690] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-24T22:24:00.955060] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-24T22:24:00.958003] [INFO ] [MAIN ] Derivative Progress: 1283/2075 symbols completed. NIE took 1.0s. Estimated remaining: 5m 10s. Rate: 153.3 symbols/min [2025-09-24T22:24:00.958809] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:00.981593] [DEBUG] [LOCAL ] NINE: Loaded 28346 existing records from primary storage. [2025-09-24T22:24:00.982268] [INFO ] [MAIN ] NINE: Loaded 28346 primary data records. [2025-09-24T22:24:01.041681] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-24T22:24:01.062079] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-24T22:24:01.089111] [INFO ] [MAIN ] Derivative Progress: 1284/2075 symbols completed. NIM took 0.9s. Estimated remaining: 5m 9s. Rate: 153.4 symbols/min [2025-09-24T22:24:01.099088] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:01.333114] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-24T22:24:01.334626] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-24T22:24:01.505462] [DEBUG] [LOCAL ] NJR: Loaded 38112 existing records from primary storage. [2025-09-24T22:24:01.507020] [INFO ] [MAIN ] NJR: Loaded 38112 primary data records. [2025-09-24T22:24:02.104754] [DEBUG] [MAIN ] NINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:02.106632] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28346 primary records. [2025-09-24T22:24:02.107587] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-24T22:24:02.151200] [DEBUG] [MAIN ] NIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:02.144589] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-24T22:24:02.152300] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-24T22:24:02.152197] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-24T22:24:02.152703] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-24T22:24:02.157372] [INFO ] [MAIN ] Derivative Progress: 1285/2075 symbols completed. NINE took 1.3s. Estimated remaining: 5m 9s. Rate: 153.2 symbols/min [2025-09-24T22:24:02.158974] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:02.196975] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-24T22:24:02.197562] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-24T22:24:02.200362] [INFO ] [MAIN ] Derivative Progress: 1286/2075 symbols completed. NIO took 1.2s. Estimated remaining: 5m 9s. Rate: 153.3 symbols/min [2025-09-24T22:24:02.197323] [DEBUG] [MAIN ] NJR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:02.201396] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38112 primary records. [2025-09-24T22:24:02.201612] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:02.201998] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-24T22:24:02.220441] [DEBUG] [LOCAL ] NKX: Loaded 13619 existing records from primary storage. [2025-09-24T22:24:02.223705] [INFO ] [MAIN ] NKX: Loaded 13619 primary data records. [2025-09-24T22:24:02.312579] [DEBUG] [LOCAL ] NLOP: Loaded 11843 existing records from primary storage. [2025-09-24T22:24:02.330315] [INFO ] [MAIN ] NLOP: Loaded 11843 primary data records. [2025-09-24T22:24:02.360060] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-24T22:24:02.378121] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-24T22:24:02.397941] [INFO ] [MAIN ] Derivative Progress: 1287/2075 symbols completed. NJR took 1.3s. Estimated remaining: 5m 8s. Rate: 153.3 symbols/min [2025-09-24T22:24:02.444772] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:02.919363] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:02.920149] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13619 primary records. [2025-09-24T22:24:02.920462] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-24T22:24:02.955294] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-24T22:24:02.956369] [INFO ] [MAIN ] NLY: Loaded 53581 primary data records. [2025-09-24T22:24:02.979027] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-24T22:24:02.990508] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-24T22:24:03.005589] [INFO ] [MAIN ] Derivative Progress: 1288/2075 symbols completed. NKX took 0.8s. Estimated remaining: 5m 8s. Rate: 153.3 symbols/min [2025-09-24T22:24:03.055121] [DEBUG] [MAIN ] NLOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:03.061057] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11843 primary records. [2025-09-24T22:24:03.072100] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-24T22:24:03.305189] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-24T22:24:03.305371] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-24T22:24:03.308576] [INFO ] [MAIN ] Derivative Progress: 1289/2075 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 8s. Rate: 153.3 symbols/min [2025-09-24T22:24:03.332421] [DEBUG] [MAIN ] NLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:03.333137] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53581 primary records. [2025-09-24T22:24:03.333216] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-24T22:24:03.349453] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-24T22:24:03.349530] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-24T22:24:03.351820] [INFO ] [MAIN ] Derivative Progress: 1290/2075 symbols completed. NLY took 0.9s. Estimated remaining: 5m 7s. Rate: 153.4 symbols/min [2025-09-24T22:24:03.353125] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:03.352776] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:03.352576] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:03.364731] [DEBUG] [LOCAL ] NMG: Loaded 7741 existing records from primary storage. [2025-09-24T22:24:03.365678] [INFO ] [MAIN ] NMG: Loaded 7741 primary data records. [2025-09-24T22:24:03.461117] [DEBUG] [LOCAL ] NMAI: Loaded 13047 existing records from primary storage. [2025-09-24T22:24:03.472077] [INFO ] [MAIN ] NMAI: Loaded 13047 primary data records. [2025-09-24T22:24:03.565534] [DEBUG] [LOCAL ] NMCO: Loaded 16552 existing records from primary storage. [2025-09-24T22:24:03.581100] [INFO ] [MAIN ] NMCO: Loaded 16552 primary data records. [2025-09-24T22:24:04.403297] [DEBUG] [MAIN ] NMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:04.413379] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 7741 primary records. [2025-09-24T22:24:04.413837] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-24T22:24:04.420675] [DEBUG] [MAIN ] NMAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:04.428854] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 13047 primary records. [2025-09-24T22:24:04.434029] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-24T22:24:04.454457] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-24T22:24:04.457486] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-24T22:24:04.460692] [INFO ] [MAIN ] Derivative Progress: 1291/2075 symbols completed. NMG took 1.1s. Estimated remaining: 5m 7s. Rate: 153.2 symbols/min [2025-09-24T22:24:04.462109] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:04.483593] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-24T22:24:04.485731] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-24T22:24:04.486146] [DEBUG] [MAIN ] NMCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:04.488906] [INFO ] [MAIN ] Derivative Progress: 1292/2075 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 7s. Rate: 153.3 symbols/min [2025-09-24T22:24:04.492425] [DEBUG] [LOCAL ] NMI: Loaded 4058 existing records from primary storage. [2025-09-24T22:24:04.492207] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:04.493843] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16552 primary records. [2025-09-24T22:24:04.492874] [INFO ] [MAIN ] NMI: Loaded 4058 primary data records. [2025-09-24T22:24:04.494176] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-24T22:24:04.627890] [DEBUG] [LOCAL ] NMM: Loaded 14317 existing records from primary storage. [2025-09-24T22:24:04.645082] [INFO ] [MAIN ] NMM: Loaded 14317 primary data records. [2025-09-24T22:24:04.656197] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-24T22:24:04.667867] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-24T22:24:04.785912] [INFO ] [MAIN ] Derivative Progress: 1293/2075 symbols completed. NMCO took 1.4s. Estimated remaining: 5m 6s. Rate: 153.3 symbols/min [2025-09-24T22:24:04.936562] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:05.175272] [DEBUG] [LOCAL ] NMR: Loaded 35034 existing records from primary storage. [2025-09-24T22:24:05.176949] [INFO ] [MAIN ] NMR: Loaded 35034 primary data records. [2025-09-24T22:24:05.269938] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:05.296297] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4058 primary records. [2025-09-24T22:24:05.296777] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-24T22:24:05.535078] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-24T22:24:05.535833] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-24T22:24:05.535755] [DEBUG] [MAIN ] NMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:05.536610] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14317 primary records. [2025-09-24T22:24:05.539339] [INFO ] [MAIN ] Derivative Progress: 1294/2075 symbols completed. NMI took 1.1s. Estimated remaining: 5m 6s. Rate: 153.2 symbols/min [2025-09-24T22:24:05.536793] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-24T22:24:05.540697] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:05.562173] [DEBUG] [LOCAL ] NMS: Loaded 2883 existing records from primary storage. [2025-09-24T22:24:05.563636] [INFO ] [MAIN ] NMS: Loaded 2883 primary data records. [2025-09-24T22:24:05.585868] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-24T22:24:05.586094] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-24T22:24:05.599315] [INFO ] [MAIN ] Derivative Progress: 1295/2075 symbols completed. NMM took 1.1s. Estimated remaining: 5m 5s. Rate: 153.3 symbols/min [2025-09-24T22:24:05.626144] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:05.694948] [DEBUG] [LOCAL ] NMT: Loaded 2853 existing records from primary storage. [2025-09-24T22:24:05.710716] [INFO ] [MAIN ] NMT: Loaded 2853 primary data records. [2025-09-24T22:24:06.126475] [DEBUG] [MAIN ] NMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:06.242806] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35034 primary records. [2025-09-24T22:24:06.243618] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-24T22:24:06.268126] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-24T22:24:06.269073] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-24T22:24:06.272095] [INFO ] [MAIN ] Derivative Progress: 1296/2075 symbols completed. NMR took 1.3s. Estimated remaining: 5m 5s. Rate: 153.2 symbols/min [2025-09-24T22:24:06.273495] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:06.290868] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:24:06.291737] [INFO ] [MAIN ] NMS: Generated 1792 derivative records from 2883 primary records. [2025-09-24T22:24:06.291836] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-24T22:24:06.326508] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:06.327879] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2853 primary records. [2025-09-24T22:24:06.328711] [DEBUG] [LOCAL ] NMS: Derivative data saved (1792 records). [2025-09-24T22:24:06.328221] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-24T22:24:06.329164] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-24T22:24:06.340724] [DEBUG] [LOCAL ] NMZ: Loaded 21602 existing records from primary storage. [2025-09-24T22:24:06.341106] [INFO ] [MAIN ] NMZ: Loaded 21602 primary data records. [2025-09-24T22:24:06.340158] [INFO ] [MAIN ] Derivative Progress: 1297/2075 symbols completed. NMS took 0.8s. Estimated remaining: 5m 4s. Rate: 153.3 symbols/min [2025-09-24T22:24:06.350963] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:06.463559] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-09-24T22:24:06.472665] [DEBUG] [LOCAL ] NNI: Loaded 9996 existing records from primary storage. [2025-09-24T22:24:06.473111] [INFO ] [MAIN ] NNI: Loaded 9996 primary data records. [2025-09-24T22:24:06.473046] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-24T22:24:06.496567] [INFO ] [MAIN ] Derivative Progress: 1298/2075 symbols completed. NMT took 0.9s. Estimated remaining: 5m 4s. Rate: 153.4 symbols/min [2025-09-24T22:24:06.538566] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:07.021851] [DEBUG] [LOCAL ] NNN: Loaded 48412 existing records from primary storage. [2025-09-24T22:24:07.022392] [INFO ] [MAIN ] NNN: Loaded 48412 primary data records. [2025-09-24T22:24:07.100921] [DEBUG] [MAIN ] NMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:07.119088] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21602 primary records. [2025-09-24T22:24:07.124803] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-24T22:24:07.389957] [DEBUG] [MAIN ] NNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:07.391344] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 9996 primary records. [2025-09-24T22:24:07.391466] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-24T22:24:07.408217] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-24T22:24:07.410246] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-24T22:24:07.414417] [INFO ] [MAIN ] Derivative Progress: 1299/2075 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 4s. Rate: 153.2 symbols/min [2025-09-24T22:24:07.415669] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:07.419276] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-24T22:24:07.419516] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-24T22:24:07.425182] [INFO ] [MAIN ] Derivative Progress: 1300/2075 symbols completed. NNI took 1.1s. Estimated remaining: 5m 3s. Rate: 153.3 symbols/min [2025-09-24T22:24:07.426185] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:07.434022] [DEBUG] [LOCAL ] NNY: Loaded 5703 existing records from primary storage. [2025-09-24T22:24:07.434271] [INFO ] [MAIN ] NNY: Loaded 5703 primary data records. [2025-09-24T22:24:07.551308] [DEBUG] [LOCAL ] NOA: Loaded 16255 existing records from primary storage. [2025-09-24T22:24:07.552023] [INFO ] [MAIN ] NOA: Loaded 16255 primary data records. [2025-09-24T22:24:07.758591] [DEBUG] [MAIN ] NNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:07.956423] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48412 primary records. [2025-09-24T22:24:07.968417] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-24T22:24:08.185326] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-24T22:24:08.186027] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-24T22:24:08.188545] [INFO ] [MAIN ] Derivative Progress: 1301/2075 symbols completed. NNN took 1.7s. Estimated remaining: 5m 3s. Rate: 153.2 symbols/min [2025-09-24T22:24:08.189353] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:08.219793] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:08.221449] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5703 primary records. [2025-09-24T22:24:08.221827] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-24T22:24:08.246231] [DEBUG] [LOCAL ] NOAH: Loaded 20175 existing records from primary storage. [2025-09-24T22:24:08.247103] [INFO ] [MAIN ] NOAH: Loaded 20175 primary data records. [2025-09-24T22:24:08.282400] [DEBUG] [MAIN ] NOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:08.307512] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16255 primary records. [2025-09-24T22:24:08.321252] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-24T22:24:08.331128] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-24T22:24:08.330904] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-24T22:24:08.358714] [INFO ] [MAIN ] Derivative Progress: 1302/2075 symbols completed. NNY took 0.9s. Estimated remaining: 5m 3s. Rate: 153.3 symbols/min [2025-09-24T22:24:08.366088] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:08.615670] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-24T22:24:08.615840] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-24T22:24:08.619407] [INFO ] [MAIN ] Derivative Progress: 1303/2075 symbols completed. NOA took 1.2s. Estimated remaining: 5m 2s. Rate: 153.3 symbols/min [2025-09-24T22:24:08.656883] [DEBUG] [LOCAL ] NOC: Loaded 42606 existing records from primary storage. [2025-09-24T22:24:08.657752] [INFO ] [MAIN ] NOC: Loaded 42606 primary data records. [2025-09-24T22:24:08.748556] [DEBUG] [MAIN ] NOAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:08.760392] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20175 primary records. [2025-09-24T22:24:08.776121] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-24T22:24:08.994508] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-24T22:24:08.994691] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-24T22:24:08.997363] [INFO ] [MAIN ] Derivative Progress: 1304/2075 symbols completed. NOAH took 0.8s. Estimated remaining: 5m 2s. Rate: 153.3 symbols/min [2025-09-24T22:24:09.020510] [DEBUG] [MAIN ] NOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:09.021169] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42606 primary records. [2025-09-24T22:24:09.021232] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-24T22:24:09.037125] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-24T22:24:09.037258] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-24T22:24:09.039912] [INFO ] [MAIN ] Derivative Progress: 1305/2075 symbols completed. NOC took 0.7s. Estimated remaining: 5m 1s. Rate: 153.4 symbols/min [2025-09-24T22:24:09.040806] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:09.041102] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:09.040979] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:09.119562] [DEBUG] [LOCAL ] NOMD: Loaded 41326 existing records from primary storage. [2025-09-24T22:24:09.136228] [INFO ] [MAIN ] NOMD: Loaded 41326 primary data records. [2025-09-24T22:24:09.172326] [DEBUG] [LOCAL ] NOK: Loaded 53620 existing records from primary storage. [2025-09-24T22:24:09.216034] [INFO ] [MAIN ] NOK: Loaded 53620 primary data records. [2025-09-24T22:24:09.317716] [DEBUG] [LOCAL ] NOG: Loaded 51167 existing records from primary storage. [2025-09-24T22:24:09.391772] [INFO ] [MAIN ] NOG: Loaded 51167 primary data records. [2025-09-24T22:24:10.169867] [DEBUG] [MAIN ] NOMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:10.171912] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41326 primary records. [2025-09-24T22:24:10.172125] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-24T22:24:10.201978] [DEBUG] [MAIN ] NOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:10.203805] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53620 primary records. [2025-09-24T22:24:10.203974] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-24T22:24:10.227599] [DEBUG] [MAIN ] NOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:10.232692] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51167 primary records. [2025-09-24T22:24:10.233031] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-24T22:24:10.233377] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-24T22:24:10.234041] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-24T22:24:10.236863] [INFO ] [MAIN ] Derivative Progress: 1306/2075 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 1s. Rate: 153.2 symbols/min [2025-09-24T22:24:10.238112] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:10.253090] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-24T22:24:10.253303] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-24T22:24:10.256709] [INFO ] [MAIN ] Derivative Progress: 1307/2075 symbols completed. NOK took 1.2s. Estimated remaining: 5m 1s. Rate: 153.3 symbols/min [2025-09-24T22:24:10.257214] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:10.261849] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-24T22:24:10.261931] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-24T22:24:10.264282] [INFO ] [MAIN ] Derivative Progress: 1308/2075 symbols completed. NOG took 1.2s. Estimated remaining: 4m 60s. Rate: 153.4 symbols/min [2025-09-24T22:24:10.264620] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:10.292209] [DEBUG] [LOCAL ] NPCT: Loaded 16797 existing records from primary storage. [2025-09-24T22:24:10.292346] [INFO ] [MAIN ] NPCT: Loaded 16797 primary data records. [2025-09-24T22:24:10.423895] [DEBUG] [LOCAL ] NOTE: Loaded 42812 existing records from primary storage. [2025-09-24T22:24:10.424092] [INFO ] [MAIN ] NOTE: Loaded 42812 primary data records. [2025-09-24T22:24:10.751681] [DEBUG] [LOCAL ] NOV: Loaded 53183 existing records from primary storage. [2025-09-24T22:24:10.765327] [INFO ] [MAIN ] NOV: Loaded 53183 primary data records. [2025-09-24T22:24:11.300066] [DEBUG] [MAIN ] NPCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:11.301993] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16797 primary records. [2025-09-24T22:24:11.302270] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-24T22:24:11.333071] [DEBUG] [MAIN ] NOTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:11.334502] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 42812 primary records. [2025-09-24T22:24:11.334864] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-24T22:24:11.347414] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-24T22:24:11.347759] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-24T22:24:11.351460] [INFO ] [MAIN ] Derivative Progress: 1309/2075 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 60s. Rate: 153.2 symbols/min [2025-09-24T22:24:11.352060] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:11.360302] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-24T22:24:11.360518] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-24T22:24:11.362902] [INFO ] [MAIN ] Derivative Progress: 1310/2075 symbols completed. NOTE took 1.1s. Estimated remaining: 4m 59s. Rate: 153.3 symbols/min [2025-09-24T22:24:11.373344] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:11.379604] [DEBUG] [MAIN ] NOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:11.380540] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53183 primary records. [2025-09-24T22:24:11.380698] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-24T22:24:11.387425] [DEBUG] [LOCAL ] NPFD: Loaded 9643 existing records from primary storage. [2025-09-24T22:24:11.387931] [INFO ] [MAIN ] NPFD: Loaded 9643 primary data records. [2025-09-24T22:24:11.493355] [DEBUG] [LOCAL ] NPK: Loaded 8028 existing records from primary storage. [2025-09-24T22:24:11.508081] [INFO ] [MAIN ] NPK: Loaded 8028 primary data records. [2025-09-24T22:24:11.588335] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-24T22:24:11.626747] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-24T22:24:11.666489] [INFO ] [MAIN ] Derivative Progress: 1311/2075 symbols completed. NOV took 1.4s. Estimated remaining: 4m 59s. Rate: 153.4 symbols/min [2025-09-24T22:24:11.699199] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:12.092511] [DEBUG] [LOCAL ] NPO: Loaded 12821 existing records from primary storage. [2025-09-24T22:24:12.093140] [INFO ] [MAIN ] NPO: Loaded 12821 primary data records. [2025-09-24T22:24:12.421078] [DEBUG] [MAIN ] NPFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:12.435545] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9643 primary records. [2025-09-24T22:24:12.436915] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-24T22:24:12.436831] [DEBUG] [MAIN ] NPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:12.439328] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8028 primary records. [2025-09-24T22:24:12.440001] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-24T22:24:12.476890] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-24T22:24:12.477318] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-24T22:24:12.480476] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-24T22:24:12.479850] [INFO ] [MAIN ] Derivative Progress: 1312/2075 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 59s. Rate: 153.2 symbols/min [2025-09-24T22:24:12.480868] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-24T22:24:12.484760] [INFO ] [MAIN ] Derivative Progress: 1313/2075 symbols completed. NPK took 1.1s. Estimated remaining: 4m 58s. Rate: 153.3 symbols/min [2025-09-24T22:24:12.484996] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:12.484568] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:12.504132] [DEBUG] [MAIN ] NPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:12.507154] [DEBUG] [LOCAL ] NPV: Loaded 5018 existing records from primary storage. [2025-09-24T22:24:12.507855] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12821 primary records. [2025-09-24T22:24:12.507961] [INFO ] [MAIN ] NPV: Loaded 5018 primary data records. [2025-09-24T22:24:12.528873] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-24T22:24:12.852385] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-24T22:24:12.853253] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-24T22:24:12.857103] [INFO ] [MAIN ] Derivative Progress: 1314/2075 symbols completed. NPO took 1.2s. Estimated remaining: 4m 58s. Rate: 153.4 symbols/min [2025-09-24T22:24:12.854308] [DEBUG] [LOCAL ] NPWR: Loaded 43218 existing records from primary storage. [2025-09-24T22:24:12.858221] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:12.858541] [INFO ] [MAIN ] NPWR: Loaded 43218 primary data records. [2025-09-24T22:24:13.005009] [DEBUG] [LOCAL ] NQP: Loaded 9317 existing records from primary storage. [2025-09-24T22:24:13.031401] [INFO ] [MAIN ] NQP: Loaded 9317 primary data records. [2025-09-24T22:24:13.549018] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:13.551142] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5018 primary records. [2025-09-24T22:24:13.551561] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-24T22:24:13.578242] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-09-24T22:24:13.578962] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-24T22:24:13.583109] [INFO ] [MAIN ] Derivative Progress: 1315/2075 symbols completed. NPV took 1.1s. Estimated remaining: 4m 58s. Rate: 153.3 symbols/min [2025-09-24T22:24:13.591302] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:13.597750] [DEBUG] [MAIN ] NPWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:13.599130] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43218 primary records. [2025-09-24T22:24:13.599332] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-24T22:24:13.632059] [DEBUG] [MAIN ] NQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:13.634181] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9317 primary records. [2025-09-24T22:24:13.634326] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-24T22:24:13.633413] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-24T22:24:13.634982] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-24T22:24:13.637945] [INFO ] [MAIN ] Derivative Progress: 1316/2075 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 57s. Rate: 153.4 symbols/min [2025-09-24T22:24:13.645374] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:13.670449] [DEBUG] [LOCAL ] NREF: Loaded 7845 existing records from primary storage. [2025-09-24T22:24:13.681751] [DEBUG] [LOCAL ] NRDY: Loaded 33011 existing records from primary storage. [2025-09-24T22:24:13.681961] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-24T22:24:13.682165] [INFO ] [MAIN ] NRDY: Loaded 33011 primary data records. [2025-09-24T22:24:13.681140] [INFO ] [MAIN ] NREF: Loaded 7845 primary data records. [2025-09-24T22:24:13.687558] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-24T22:24:13.728591] [INFO ] [MAIN ] Derivative Progress: 1317/2075 symbols completed. NQP took 0.9s. Estimated remaining: 4m 56s. Rate: 153.4 symbols/min [2025-09-24T22:24:13.788264] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:14.358668] [DEBUG] [LOCAL ] NRGV: Loaded 42987 existing records from primary storage. [2025-09-24T22:24:14.359309] [INFO ] [MAIN ] NRGV: Loaded 42987 primary data records. [2025-09-24T22:24:14.696309] [DEBUG] [MAIN ] NREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:14.696743] [DEBUG] [MAIN ] NRDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:14.706359] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7845 primary records. [2025-09-24T22:24:14.707335] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-24T22:24:14.707242] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 33011 primary records. [2025-09-24T22:24:14.708074] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-24T22:24:14.749046] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-24T22:24:14.749442] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-24T22:24:14.750111] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-24T22:24:14.753042] [INFO ] [MAIN ] Derivative Progress: 1318/2075 symbols completed. NREF took 1.1s. Estimated remaining: 4m 56s. Rate: 153.3 symbols/min [2025-09-24T22:24:14.750021] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-24T22:24:14.757015] [INFO ] [MAIN ] Derivative Progress: 1319/2075 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 56s. Rate: 153.4 symbols/min [2025-09-24T22:24:14.779458] [DEBUG] [MAIN ] NRGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:14.780203] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 42987 primary records. [2025-09-24T22:24:14.780266] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-24T22:24:14.796039] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-24T22:24:14.796105] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-24T22:24:14.798661] [INFO ] [MAIN ] Derivative Progress: 1320/2075 symbols completed. NRGV took 1.0s. Estimated remaining: 4m 55s. Rate: 153.5 symbols/min [2025-09-24T22:24:14.799678] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:14.799592] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:14.800266] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:14.812859] [DEBUG] [LOCAL ] NRT: Loaded 4882 existing records from primary storage. [2025-09-24T22:24:14.813119] [DEBUG] [LOCAL ] NRP: Loaded 4082 existing records from primary storage. [2025-09-24T22:24:14.813216] [INFO ] [MAIN ] NRT: Loaded 4882 primary data records. [2025-09-24T22:24:14.813366] [INFO ] [MAIN ] NRP: Loaded 4082 primary data records. [2025-09-24T22:24:14.997355] [DEBUG] [LOCAL ] NRK: Loaded 19685 existing records from primary storage. [2025-09-24T22:24:15.032033] [INFO ] [MAIN ] NRK: Loaded 19685 primary data records. [2025-09-24T22:24:15.855131] [DEBUG] [MAIN ] NRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:15.854753] [DEBUG] [MAIN ] NRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:15.857210] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4882 primary records. [2025-09-24T22:24:15.856183] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4082 primary records. [2025-09-24T22:24:15.857361] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-24T22:24:15.857669] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-24T22:24:15.900916] [DEBUG] [MAIN ] NRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:15.902964] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19685 primary records. [2025-09-24T22:24:15.903813] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-24T22:24:15.905603] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-24T22:24:15.906020] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-24T22:24:15.908340] [INFO ] [MAIN ] Derivative Progress: 1321/2075 symbols completed. NRP took 1.1s. Estimated remaining: 4m 55s. Rate: 153.3 symbols/min [2025-09-24T22:24:15.908581] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:15.909532] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-24T22:24:15.917426] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-24T22:24:15.921048] [INFO ] [MAIN ] Derivative Progress: 1322/2075 symbols completed. NRT took 1.1s. Estimated remaining: 4m 55s. Rate: 153.4 symbols/min [2025-09-24T22:24:15.924261] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:15.929667] [DEBUG] [LOCAL ] NRUC: Loaded 3096 existing records from primary storage. [2025-09-24T22:24:15.930287] [INFO ] [MAIN ] NRUC: Loaded 3096 primary data records. [2025-09-24T22:24:16.038722] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-24T22:24:16.038929] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-24T22:24:16.052683] [INFO ] [MAIN ] Derivative Progress: 1323/2075 symbols completed. NRK took 1.3s. Estimated remaining: 4m 54s. Rate: 153.4 symbols/min [2025-09-24T22:24:16.068735] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:16.266376] [DEBUG] [LOCAL ] NSA: Loaded 44875 existing records from primary storage. [2025-09-24T22:24:16.266829] [INFO ] [MAIN ] NSA: Loaded 44875 primary data records. [2025-09-24T22:24:16.425488] [DEBUG] [LOCAL ] NSP: Loaded 34932 existing records from primary storage. [2025-09-24T22:24:16.479056] [INFO ] [MAIN ] NSP: Loaded 34932 primary data records. [2025-09-24T22:24:16.740375] [DEBUG] [MAIN ] NRUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:16.788508] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3096 primary records. [2025-09-24T22:24:16.793519] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-24T22:24:16.945877] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-09-24T22:24:16.946119] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-24T22:24:16.949053] [INFO ] [MAIN ] Derivative Progress: 1324/2075 symbols completed. NRUC took 1.0s. Estimated remaining: 4m 54s. Rate: 153.3 symbols/min [2025-09-24T22:24:16.952682] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:16.967896] [DEBUG] [MAIN ] NSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:16.968830] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44875 primary records. [2025-09-24T22:24:16.969178] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-24T22:24:17.003723] [DEBUG] [LOCAL ] NTB: Loaded 20700 existing records from primary storage. [2025-09-24T22:24:17.017094] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-24T22:24:17.017331] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-24T22:24:17.017032] [INFO ] [MAIN ] NTB: Loaded 20700 primary data records. [2025-09-24T22:24:17.019880] [INFO ] [MAIN ] Derivative Progress: 1325/2075 symbols completed. NSA took 1.1s. Estimated remaining: 4m 53s. Rate: 153.4 symbols/min [2025-09-24T22:24:17.020451] [DEBUG] [MAIN ] NSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:17.025870] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:17.043851] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34932 primary records. [2025-09-24T22:24:17.059896] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-24T22:24:17.347327] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-24T22:24:17.347620] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-24T22:24:17.350690] [INFO ] [MAIN ] Derivative Progress: 1326/2075 symbols completed. NSP took 1.3s. Estimated remaining: 4m 53s. Rate: 153.4 symbols/min [2025-09-24T22:24:17.364108] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:17.388084] [DEBUG] [LOCAL ] NTR: Loaded 52579 existing records from primary storage. [2025-09-24T22:24:17.388540] [INFO ] [MAIN ] NTR: Loaded 52579 primary data records. [2025-09-24T22:24:17.530720] [DEBUG] [MAIN ] NTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:17.571821] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20700 primary records. [2025-09-24T22:24:17.618554] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-24T22:24:17.730171] [DEBUG] [LOCAL ] NTST: Loaded 43575 existing records from primary storage. [2025-09-24T22:24:17.740397] [INFO ] [MAIN ] NTST: Loaded 43575 primary data records. [2025-09-24T22:24:17.913763] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-24T22:24:17.919549] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-24T22:24:17.930927] [INFO ] [MAIN ] Derivative Progress: 1327/2075 symbols completed. NTB took 1.0s. Estimated remaining: 4m 53s. Rate: 153.4 symbols/min [2025-09-24T22:24:17.954315] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:18.129492] [DEBUG] [MAIN ] NTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:18.130595] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52579 primary records. [2025-09-24T22:24:18.130730] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-24T22:24:18.151120] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-24T22:24:18.151251] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-24T22:24:18.153867] [INFO ] [MAIN ] Derivative Progress: 1328/2075 symbols completed. NTR took 1.1s. Estimated remaining: 4m 52s. Rate: 153.4 symbols/min [2025-09-24T22:24:18.154246] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:18.184491] [DEBUG] [MAIN ] NTST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:18.185316] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43575 primary records. [2025-09-24T22:24:18.185428] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-24T22:24:18.218097] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-24T22:24:18.218266] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-24T22:24:18.220625] [INFO ] [MAIN ] Derivative Progress: 1329/2075 symbols completed. NTST took 0.9s. Estimated remaining: 4m 52s. Rate: 153.5 symbols/min [2025-09-24T22:24:18.220896] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:18.231230] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-24T22:24:18.231470] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-24T22:24:18.350330] [DEBUG] [LOCAL ] NUS: Loaded 36465 existing records from primary storage. [2025-09-24T22:24:18.350810] [INFO ] [MAIN ] NUS: Loaded 36465 primary data records. [2025-09-24T22:24:18.515370] [DEBUG] [LOCAL ] NUV: Loaded 23234 existing records from primary storage. [2025-09-24T22:24:18.637867] [INFO ] [MAIN ] NUV: Loaded 23234 primary data records. [2025-09-24T22:24:19.186679] [DEBUG] [MAIN ] NU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:19.190248] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-24T22:24:19.190480] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-24T22:24:19.218493] [DEBUG] [MAIN ] NUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:19.220987] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36465 primary records. [2025-09-24T22:24:19.221320] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-24T22:24:19.262907] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:19.264675] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23234 primary records. [2025-09-24T22:24:19.265554] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-24T22:24:19.267803] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-24T22:24:19.268993] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-24T22:24:19.269146] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-24T22:24:19.268920] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-24T22:24:19.279238] [INFO ] [MAIN ] Derivative Progress: 1330/2075 symbols completed. NUS took 1.1s. Estimated remaining: 4m 52s. Rate: 153.3 symbols/min [2025-09-24T22:24:19.287045] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:19.286376] [INFO ] [MAIN ] Derivative Progress: 1331/2075 symbols completed. NU took 1.3s. Estimated remaining: 4m 51s. Rate: 153.4 symbols/min [2025-09-24T22:24:19.288364] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:19.294912] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-24T22:24:19.295169] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-24T22:24:19.297760] [INFO ] [MAIN ] Derivative Progress: 1332/2075 symbols completed. NUV took 1.1s. Estimated remaining: 4m 50s. Rate: 153.5 symbols/min [2025-09-24T22:24:19.298116] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:19.302590] [DEBUG] [LOCAL ] NUW: Loaded 7437 existing records from primary storage. [2025-09-24T22:24:19.303313] [INFO ] [MAIN ] NUW: Loaded 7437 primary data records. [2025-09-24T22:24:19.492684] [DEBUG] [LOCAL ] NVG: Loaded 27288 existing records from primary storage. [2025-09-24T22:24:19.508177] [INFO ] [MAIN ] NVG: Loaded 27288 primary data records. [2025-09-24T22:24:19.706499] [DEBUG] [LOCAL ] NUVB: Loaded 51241 existing records from primary storage. [2025-09-24T22:24:19.727404] [INFO ] [MAIN ] NUVB: Loaded 51241 primary data records. [2025-09-24T22:24:20.360431] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:20.362370] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7437 primary records. [2025-09-24T22:24:20.362746] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-24T22:24:20.382844] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-24T22:24:20.383710] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-24T22:24:20.386944] [INFO ] [MAIN ] Derivative Progress: 1333/2075 symbols completed. NUW took 1.1s. Estimated remaining: 4m 50s. Rate: 153.3 symbols/min [2025-09-24T22:24:20.412853] [DEBUG] [MAIN ] NVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:20.413098] [DEBUG] [MAIN ] NUVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:20.414422] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51241 primary records. [2025-09-24T22:24:20.413860] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27288 primary records. [2025-09-24T22:24:20.414572] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-24T22:24:20.414664] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-24T22:24:20.445749] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-24T22:24:20.446353] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-24T22:24:20.448529] [INFO ] [MAIN ] Derivative Progress: 1334/2075 symbols completed. NVG took 1.2s. Estimated remaining: 4m 50s. Rate: 153.4 symbols/min [2025-09-24T22:24:20.446280] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-24T22:24:20.448686] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-24T22:24:20.451349] [INFO ] [MAIN ] Derivative Progress: 1335/2075 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 49s. Rate: 153.5 symbols/min [2025-09-24T22:24:20.451867] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:20.452093] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:20.452171] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:20.482600] [DEBUG] [LOCAL ] NVR: Loaded 19120 existing records from primary storage. [2025-09-24T22:24:20.482769] [INFO ] [MAIN ] NVR: Loaded 19120 primary data records. [2025-09-24T22:24:20.603306] [DEBUG] [LOCAL ] NVGS: Loaded 31109 existing records from primary storage. [2025-09-24T22:24:20.625340] [INFO ] [MAIN ] NVGS: Loaded 31109 primary data records. [2025-09-24T22:24:20.849239] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-24T22:24:20.963967] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-24T22:24:21.528882] [DEBUG] [MAIN ] NVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:24:21.543550] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 19120 primary records. [2025-09-24T22:24:21.543685] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-24T22:24:21.542840] [DEBUG] [MAIN ] NVGS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:24:21.545235] [INFO ] [MAIN ] NVGS: Generated 1793 derivative records from 31109 primary records. [2025-09-24T22:24:21.545714] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-24T22:24:21.582728] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-09-24T22:24:21.584283] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-24T22:24:21.586615] [INFO ] [MAIN ] Derivative Progress: 1336/2075 symbols completed. NVR took 1.1s. Estimated remaining: 4m 49s. Rate: 153.3 symbols/min [2025-09-24T22:24:21.584159] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1793 records). [2025-09-24T22:24:21.603496] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:21.592757] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-24T22:24:21.604622] [DEBUG] [MAIN ] NVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:21.606136] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-24T22:24:21.606421] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-24T22:24:21.609191] [INFO ] [MAIN ] Derivative Progress: 1337/2075 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 49s. Rate: 153.4 symbols/min [2025-09-24T22:24:21.611079] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:21.634270] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-24T22:24:21.634436] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-24T22:24:21.637164] [INFO ] [MAIN ] Derivative Progress: 1338/2075 symbols completed. NVO took 1.2s. Estimated remaining: 4m 48s. Rate: 153.5 symbols/min [2025-09-24T22:24:21.637610] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:21.665991] [DEBUG] [LOCAL ] NVRI: Loaded 38754 existing records from primary storage. [2025-09-24T22:24:21.680094] [INFO ] [MAIN ] NVRI: Loaded 38754 primary data records. [2025-09-24T22:24:21.825154] [DEBUG] [LOCAL ] NVS: Loaded 51610 existing records from primary storage. [2025-09-24T22:24:21.867529] [INFO ] [MAIN ] NVS: Loaded 51610 primary data records. [2025-09-24T22:24:22.090885] [DEBUG] [LOCAL ] NVST: Loaded 51623 existing records from primary storage. [2025-09-24T22:24:22.137830] [INFO ] [MAIN ] NVST: Loaded 51623 primary data records. [2025-09-24T22:24:22.721619] [DEBUG] [MAIN ] NVRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:22.722726] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38754 primary records. [2025-09-24T22:24:22.722907] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-24T22:24:22.745326] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-24T22:24:22.745633] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-24T22:24:22.748112] [INFO ] [MAIN ] Derivative Progress: 1339/2075 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 48s. Rate: 153.3 symbols/min [2025-09-24T22:24:22.748424] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:22.773035] [DEBUG] [MAIN ] NVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:22.773557] [DEBUG] [MAIN ] NVST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:22.774286] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51610 primary records. [2025-09-24T22:24:22.775008] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51623 primary records. [2025-09-24T22:24:22.775252] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-24T22:24:22.775155] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-24T22:24:22.807681] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-24T22:24:22.808362] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-24T22:24:22.811118] [INFO ] [MAIN ] Derivative Progress: 1340/2075 symbols completed. NVST took 1.2s. Estimated remaining: 4m 47s. Rate: 153.4 symbols/min [2025-09-24T22:24:22.811256] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-24T22:24:22.811627] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-24T22:24:22.811439] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:22.814539] [INFO ] [MAIN ] Derivative Progress: 1341/2075 symbols completed. NVS took 1.2s. Estimated remaining: 4m 47s. Rate: 153.5 symbols/min [2025-09-24T22:24:22.814832] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:22.859925] [DEBUG] [LOCAL ] NVT: Loaded 51587 existing records from primary storage. [2025-09-24T22:24:22.860191] [INFO ] [MAIN ] NVT: Loaded 51587 primary data records. [2025-09-24T22:24:22.949795] [DEBUG] [LOCAL ] NWN: Loaded 26910 existing records from primary storage. [2025-09-24T22:24:22.991111] [INFO ] [MAIN ] NWN: Loaded 26910 primary data records. [2025-09-24T22:24:23.309895] [DEBUG] [LOCAL ] NWG: Loaded 51589 existing records from primary storage. [2025-09-24T22:24:23.322080] [INFO ] [MAIN ] NWG: Loaded 51589 primary data records. [2025-09-24T22:24:23.868320] [DEBUG] [MAIN ] NVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:23.869742] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51587 primary records. [2025-09-24T22:24:23.870150] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-24T22:24:23.897254] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-24T22:24:23.898593] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-24T22:24:23.901431] [INFO ] [MAIN ] Derivative Progress: 1342/2075 symbols completed. NVT took 1.2s. Estimated remaining: 4m 47s. Rate: 153.3 symbols/min [2025-09-24T22:24:23.902130] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:23.919142] [DEBUG] [MAIN ] NWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:23.920445] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26910 primary records. [2025-09-24T22:24:23.928295] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-24T22:24:23.933958] [DEBUG] [MAIN ] NWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:23.935360] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51589 primary records. [2025-09-24T22:24:23.935745] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-24T22:24:23.976702] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-24T22:24:23.977738] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-24T22:24:23.978287] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-24T22:24:23.978596] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-24T22:24:23.981600] [INFO ] [MAIN ] Derivative Progress: 1343/2075 symbols completed. NWN took 1.2s. Estimated remaining: 4m 46s. Rate: 153.4 symbols/min [2025-09-24T22:24:23.984780] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:23.984668] [INFO ] [MAIN ] Derivative Progress: 1344/2075 symbols completed. NWG took 1.2s. Estimated remaining: 4m 46s. Rate: 153.5 symbols/min [2025-09-24T22:24:23.985302] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:23.999461] [DEBUG] [LOCAL ] NX: Loaded 33367 existing records from primary storage. [2025-09-24T22:24:23.999735] [INFO ] [MAIN ] NX: Loaded 33367 primary data records. [2025-09-24T22:24:24.062600] [DEBUG] [LOCAL ] NXC: Loaded 4227 existing records from primary storage. [2025-09-24T22:24:24.084422] [INFO ] [MAIN ] NXC: Loaded 4227 primary data records. [2025-09-24T22:24:24.159197] [DEBUG] [LOCAL ] NXDT: Loaded 16404 existing records from primary storage. [2025-09-24T22:24:24.209547] [INFO ] [MAIN ] NXDT: Loaded 16404 primary data records. [2025-09-24T22:24:25.063760] [DEBUG] [MAIN ] NX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:25.077357] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33367 primary records. [2025-09-24T22:24:25.078033] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-24T22:24:25.079423] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:25.087795] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4227 primary records. [2025-09-24T22:24:25.093093] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-24T22:24:25.124135] [DEBUG] [MAIN ] NXDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:25.125997] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16404 primary records. [2025-09-24T22:24:25.126549] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-24T22:24:25.129173] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-24T22:24:25.129541] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-24T22:24:25.139404] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-24T22:24:25.138886] [INFO ] [MAIN ] Derivative Progress: 1345/2075 symbols completed. NX took 1.2s. Estimated remaining: 4m 46s. Rate: 153.3 symbols/min [2025-09-24T22:24:25.140668] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:25.140823] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-24T22:24:25.146249] [INFO ] [MAIN ] Derivative Progress: 1346/2075 symbols completed. NXC took 1.2s. Estimated remaining: 4m 45s. Rate: 153.4 symbols/min [2025-09-24T22:24:25.147921] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:25.153329] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-24T22:24:25.153635] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-24T22:24:25.156408] [INFO ] [MAIN ] Derivative Progress: 1347/2075 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 45s. Rate: 153.5 symbols/min [2025-09-24T22:24:25.156843] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:25.166572] [DEBUG] [LOCAL ] NXG: Loaded 10450 existing records from primary storage. [2025-09-24T22:24:25.166798] [INFO ] [MAIN ] NXG: Loaded 10450 primary data records. [2025-09-24T22:24:25.290958] [DEBUG] [LOCAL ] NXJ: Loaded 14949 existing records from primary storage. [2025-09-24T22:24:25.304769] [INFO ] [MAIN ] NXJ: Loaded 14949 primary data records. [2025-09-24T22:24:25.636164] [DEBUG] [LOCAL ] NXE: Loaded 52985 existing records from primary storage. [2025-09-24T22:24:25.636518] [INFO ] [MAIN ] NXE: Loaded 52985 primary data records. [2025-09-24T22:24:26.231089] [DEBUG] [MAIN ] NXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:26.232369] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10450 primary records. [2025-09-24T22:24:26.244781] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-24T22:24:26.245218] [DEBUG] [MAIN ] NXJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:26.246717] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14949 primary records. [2025-09-24T22:24:26.246954] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-24T22:24:26.282450] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-24T22:24:26.283096] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-24T22:24:26.285670] [INFO ] [MAIN ] Derivative Progress: 1348/2075 symbols completed. NXJ took 1.1s. Estimated remaining: 4m 45s. Rate: 153.3 symbols/min [2025-09-24T22:24:26.299886] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-24T22:24:26.300266] [DEBUG] [MAIN ] NXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:26.300354] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-24T22:24:26.301257] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52985 primary records. [2025-09-24T22:24:26.303917] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-24T22:24:26.303821] [INFO ] [MAIN ] Derivative Progress: 1349/2075 symbols completed. NXG took 1.2s. Estimated remaining: 4m 44s. Rate: 153.4 symbols/min [2025-09-24T22:24:26.320099] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-24T22:24:26.320237] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-24T22:24:26.322921] [INFO ] [MAIN ] Derivative Progress: 1350/2075 symbols completed. NXE took 1.2s. Estimated remaining: 4m 43s. Rate: 153.5 symbols/min [2025-09-24T22:24:26.323760] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:26.323601] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:26.323989] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:26.330138] [DEBUG] [LOCAL ] NXN: Loaded 2363 existing records from primary storage. [2025-09-24T22:24:26.330306] [INFO ] [MAIN ] NXN: Loaded 2363 primary data records. [2025-09-24T22:24:26.426214] [DEBUG] [LOCAL ] NXP: Loaded 12326 existing records from primary storage. [2025-09-24T22:24:26.437357] [INFO ] [MAIN ] NXP: Loaded 12326 primary data records. [2025-09-24T22:24:26.535545] [DEBUG] [LOCAL ] NXRT: Loaded 19042 existing records from primary storage. [2025-09-24T22:24:26.561439] [INFO ] [MAIN ] NXRT: Loaded 19042 primary data records. [2025-09-24T22:24:27.591445] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:27.592609] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2363 primary records. [2025-09-24T22:24:27.594007] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-24T22:24:27.632801] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:27.636384] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12326 primary records. [2025-09-24T22:24:27.636630] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-24T22:24:27.636537] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-24T22:24:27.637553] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-24T22:24:27.640511] [INFO ] [MAIN ] Derivative Progress: 1351/2075 symbols completed. NXN took 1.3s. Estimated remaining: 4m 43s. Rate: 153.3 symbols/min [2025-09-24T22:24:27.640999] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:27.662130] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-24T22:24:27.662420] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-24T22:24:27.665357] [INFO ] [MAIN ] Derivative Progress: 1352/2075 symbols completed. NXP took 1.3s. Estimated remaining: 4m 43s. Rate: 153.4 symbols/min [2025-09-24T22:24:27.666030] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:27.684329] [DEBUG] [MAIN ] NXRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:27.685348] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 19042 primary records. [2025-09-24T22:24:27.685499] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-24T22:24:27.729399] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-24T22:24:27.729570] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-24T22:24:27.733263] [INFO ] [MAIN ] Derivative Progress: 1353/2075 symbols completed. NXRT took 1.4s. Estimated remaining: 4m 42s. Rate: 153.5 symbols/min [2025-09-24T22:24:27.734837] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:27.769153] [DEBUG] [LOCAL ] NYT: Loaded 49899 existing records from primary storage. [2025-09-24T22:24:27.769539] [INFO ] [MAIN ] NYT: Loaded 49899 primary data records. [2025-09-24T22:24:27.770286] [DEBUG] [LOCAL ] NZF: Loaded 29014 existing records from primary storage. [2025-09-24T22:24:27.770511] [INFO ] [MAIN ] NZF: Loaded 29014 primary data records. [2025-09-24T22:24:28.365903] [DEBUG] [LOCAL ] OBDC: Loaded 51654 existing records from primary storage. [2025-09-24T22:24:28.476686] [INFO ] [MAIN ] OBDC: Loaded 51654 primary data records. [2025-09-24T22:24:28.820431] [DEBUG] [MAIN ] NYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:28.821520] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49899 primary records. [2025-09-24T22:24:28.821943] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-24T22:24:28.836394] [DEBUG] [MAIN ] NZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:28.844444] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29014 primary records. [2025-09-24T22:24:28.848692] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-24T22:24:28.883699] [DEBUG] [MAIN ] OBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:28.885737] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51654 primary records. [2025-09-24T22:24:28.884744] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-24T22:24:28.887484] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-24T22:24:28.886910] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-24T22:24:28.888203] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-24T22:24:28.889076] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-24T22:24:28.891779] [INFO ] [MAIN ] Derivative Progress: 1354/2075 symbols completed. NYT took 1.3s. Estimated remaining: 4m 42s. Rate: 153.2 symbols/min [2025-09-24T22:24:28.894516] [INFO ] [MAIN ] Derivative Progress: 1355/2075 symbols completed. NZF took 1.2s. Estimated remaining: 4m 42s. Rate: 153.4 symbols/min [2025-09-24T22:24:28.894449] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:28.906241] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:28.914631] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-24T22:24:28.914749] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-24T22:24:28.917461] [INFO ] [MAIN ] Derivative Progress: 1356/2075 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 41s. Rate: 153.5 symbols/min [2025-09-24T22:24:28.922229] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:28.922104] [DEBUG] [LOCAL ] OCFT: Loaded 8892 existing records from primary storage. [2025-09-24T22:24:28.922754] [INFO ] [MAIN ] OCFT: Loaded 8892 primary data records. [2025-09-24T22:24:29.055896] [DEBUG] [LOCAL ] ODC: Loaded 8547 existing records from primary storage. [2025-09-24T22:24:29.094994] [INFO ] [MAIN ] ODC: Loaded 8547 primary data records. [2025-09-24T22:24:29.349871] [DEBUG] [LOCAL ] OC: Loaded 44705 existing records from primary storage. [2025-09-24T22:24:29.358496] [INFO ] [MAIN ] OC: Loaded 44705 primary data records. [2025-09-24T22:24:29.922686] [DEBUG] [MAIN ] OCFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:29.923986] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 8892 primary records. [2025-09-24T22:24:29.924435] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-24T22:24:29.944082] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-24T22:24:29.945077] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-24T22:24:29.947796] [INFO ] [MAIN ] Derivative Progress: 1357/2075 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 41s. Rate: 153.3 symbols/min [2025-09-24T22:24:29.948170] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:29.961604] [DEBUG] [MAIN ] ODC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:29.962424] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8547 primary records. [2025-09-24T22:24:29.963487] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-24T22:24:29.991621] [DEBUG] [MAIN ] OC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:29.993220] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44705 primary records. [2025-09-24T22:24:29.993325] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-24T22:24:30.014150] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-24T22:24:30.014723] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-24T22:24:30.017291] [INFO ] [MAIN ] Derivative Progress: 1358/2075 symbols completed. ODC took 1.1s. Estimated remaining: 4m 41s. Rate: 153.4 symbols/min [2025-09-24T22:24:30.018245] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:30.029770] [DEBUG] [LOCAL ] ODV: Loaded 25728 existing records from primary storage. [2025-09-24T22:24:30.030093] [INFO ] [MAIN ] ODV: Loaded 25728 primary data records. [2025-09-24T22:24:30.062984] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-24T22:24:30.087380] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-24T22:24:30.090489] [INFO ] [MAIN ] Derivative Progress: 1359/2075 symbols completed. OC took 1.2s. Estimated remaining: 4m 40s. Rate: 153.5 symbols/min [2025-09-24T22:24:30.098527] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:30.402170] [DEBUG] [LOCAL ] OEC: Loaded 37158 existing records from primary storage. [2025-09-24T22:24:30.402771] [DEBUG] [LOCAL ] OFG: Loaded 22099 existing records from primary storage. [2025-09-24T22:24:30.402986] [INFO ] [MAIN ] OEC: Loaded 37158 primary data records. [2025-09-24T22:24:30.403101] [INFO ] [MAIN ] OFG: Loaded 22099 primary data records. [2025-09-24T22:24:31.052559] [DEBUG] [MAIN ] ODV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:31.053436] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 25728 primary records. [2025-09-24T22:24:31.053582] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-24T22:24:31.077341] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-24T22:24:31.077584] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-24T22:24:31.080415] [INFO ] [MAIN ] Derivative Progress: 1360/2075 symbols completed. ODV took 1.1s. Estimated remaining: 4m 40s. Rate: 153.3 symbols/min [2025-09-24T22:24:31.080974] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:31.099963] [DEBUG] [MAIN ] OFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:31.108043] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 22099 primary records. [2025-09-24T22:24:31.113021] [DEBUG] [MAIN ] OEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:31.112782] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-24T22:24:31.113734] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37158 primary records. [2025-09-24T22:24:31.114674] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-24T22:24:31.143845] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-24T22:24:31.144560] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-24T22:24:31.147417] [INFO ] [MAIN ] Derivative Progress: 1361/2075 symbols completed. OEC took 1.1s. Estimated remaining: 4m 39s. Rate: 153.4 symbols/min [2025-09-24T22:24:31.147990] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:31.151017] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-24T22:24:31.151103] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-24T22:24:31.153404] [INFO ] [MAIN ] Derivative Progress: 1362/2075 symbols completed. OFG took 1.1s. Estimated remaining: 4m 39s. Rate: 153.5 symbols/min [2025-09-24T22:24:31.153679] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:31.206954] [DEBUG] [LOCAL ] OGN: Loaded 53116 existing records from primary storage. [2025-09-24T22:24:31.207265] [INFO ] [MAIN ] OGN: Loaded 53116 primary data records. [2025-09-24T22:24:31.338198] [DEBUG] [LOCAL ] OGS: Loaded 33933 existing records from primary storage. [2025-09-24T22:24:31.338385] [INFO ] [MAIN ] OGS: Loaded 33933 primary data records. [2025-09-24T22:24:31.647746] [DEBUG] [LOCAL ] OHI: Loaded 52100 existing records from primary storage. [2025-09-24T22:24:31.660685] [INFO ] [MAIN ] OHI: Loaded 52100 primary data records. [2025-09-24T22:24:32.212633] [DEBUG] [MAIN ] OGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:32.213903] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53116 primary records. [2025-09-24T22:24:32.214037] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-24T22:24:32.236157] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-24T22:24:32.236693] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-24T22:24:32.252968] [DEBUG] [MAIN ] OGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:32.254300] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 33933 primary records. [2025-09-24T22:24:32.252470] [INFO ] [MAIN ] Derivative Progress: 1363/2075 symbols completed. OGN took 1.2s. Estimated remaining: 4m 39s. Rate: 153.3 symbols/min [2025-09-24T22:24:32.254466] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-24T22:24:32.288595] [DEBUG] [MAIN ] OHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:32.288720] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-24T22:24:32.289771] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52100 primary records. [2025-09-24T22:24:32.289866] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-24T22:24:32.289002] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-24T22:24:32.292565] [INFO ] [MAIN ] Derivative Progress: 1364/2075 symbols completed. OGS took 1.1s. Estimated remaining: 4m 38s. Rate: 153.4 symbols/min [2025-09-24T22:24:32.309090] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-24T22:24:32.309159] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-24T22:24:32.313302] [INFO ] [MAIN ] Derivative Progress: 1365/2075 symbols completed. OHI took 1.2s. Estimated remaining: 4m 38s. Rate: 153.5 symbols/min [2025-09-24T22:24:32.314408] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:32.314577] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:32.314116] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:32.331913] [DEBUG] [LOCAL ] OIA: Loaded 14019 existing records from primary storage. [2025-09-24T22:24:32.332204] [INFO ] [MAIN ] OIA: Loaded 14019 primary data records. [2025-09-24T22:24:32.604082] [DEBUG] [LOCAL ] OII: Loaded 42843 existing records from primary storage. [2025-09-24T22:24:32.699820] [INFO ] [MAIN ] OII: Loaded 42843 primary data records. [2025-09-24T22:24:32.779944] [DEBUG] [LOCAL ] OI: Loaded 47344 existing records from primary storage. [2025-09-24T22:24:32.804386] [INFO ] [MAIN ] OI: Loaded 47344 primary data records. [2025-09-24T22:24:33.380945] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:33.382360] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 14019 primary records. [2025-09-24T22:24:33.382985] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-24T22:24:33.417565] [DEBUG] [MAIN ] OII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:33.418996] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 42843 primary records. [2025-09-24T22:24:33.419095] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-24T22:24:33.422343] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-24T22:24:33.434937] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-24T22:24:33.439856] [INFO ] [MAIN ] Derivative Progress: 1366/2075 symbols completed. OIA took 1.1s. Estimated remaining: 4m 38s. Rate: 153.3 symbols/min [2025-09-24T22:24:33.442040] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:33.441733] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-24T22:24:33.442394] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-24T22:24:33.444899] [INFO ] [MAIN ] Derivative Progress: 1367/2075 symbols completed. OII took 1.1s. Estimated remaining: 4m 37s. Rate: 153.4 symbols/min [2025-09-24T22:24:33.445142] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:33.462524] [DEBUG] [MAIN ] OI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:33.463412] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47344 primary records. [2025-09-24T22:24:33.463529] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-24T22:24:33.482426] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-24T22:24:33.492263] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-24T22:24:33.494902] [INFO ] [MAIN ] Derivative Progress: 1368/2075 symbols completed. OI took 1.2s. Estimated remaining: 4m 36s. Rate: 153.5 symbols/min [2025-09-24T22:24:33.495400] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:33.511799] [DEBUG] [LOCAL ] OIS: Loaded 40610 existing records from primary storage. [2025-09-24T22:24:33.512134] [INFO ] [MAIN ] OIS: Loaded 40610 primary data records. [2025-09-24T22:24:33.689596] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-24T22:24:33.744582] [INFO ] [MAIN ] OKE: Loaded 53536 primary data records. [2025-09-24T22:24:33.997144] [DEBUG] [LOCAL ] OLN: Loaded 51739 existing records from primary storage. [2025-09-24T22:24:34.003389] [INFO ] [MAIN ] OLN: Loaded 51739 primary data records. [2025-09-24T22:24:34.580185] [DEBUG] [MAIN ] OIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:34.581763] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40610 primary records. [2025-09-24T22:24:34.582096] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-24T22:24:34.602006] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-24T22:24:34.602266] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-24T22:24:34.605009] [INFO ] [MAIN ] Derivative Progress: 1369/2075 symbols completed. OIS took 1.2s. Estimated remaining: 4m 36s. Rate: 153.3 symbols/min [2025-09-24T22:24:34.605383] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:34.640631] [DEBUG] [MAIN ] OKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:34.641281] [DEBUG] [MAIN ] OLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:34.646045] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51739 primary records. [2025-09-24T22:24:34.647016] [DEBUG] [LOCAL ] OLP: Loaded 9752 existing records from primary storage. [2025-09-24T22:24:34.646756] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53536 primary records. [2025-09-24T22:24:34.647103] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-24T22:24:34.647392] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-24T22:24:34.647263] [INFO ] [MAIN ] OLP: Loaded 9752 primary data records. [2025-09-24T22:24:34.760878] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-24T22:24:34.767295] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-24T22:24:34.775803] [INFO ] [MAIN ] Derivative Progress: 1370/2075 symbols completed. OLN took 1.3s. Estimated remaining: 4m 36s. Rate: 153.3 symbols/min [2025-09-24T22:24:34.788979] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:34.795537] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-24T22:24:34.800867] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-24T22:24:34.812225] [INFO ] [MAIN ] Derivative Progress: 1371/2075 symbols completed. OKE took 1.4s. Estimated remaining: 4m 35s. Rate: 153.4 symbols/min [2025-09-24T22:24:34.877625] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:35.025069] [DEBUG] [MAIN ] OLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:35.036311] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9752 primary records. [2025-09-24T22:24:35.036394] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-24T22:24:35.064963] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-24T22:24:35.077395] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-24T22:24:35.080891] [INFO ] [MAIN ] Derivative Progress: 1372/2075 symbols completed. OLP took 0.5s. Estimated remaining: 4m 35s. Rate: 153.5 symbols/min [2025-09-24T22:24:35.082792] [DEBUG] [LOCAL ] OMF: Loaded 46213 existing records from primary storage. [2025-09-24T22:24:35.083281] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:35.083379] [INFO ] [MAIN ] OMF: Loaded 46213 primary data records. [2025-09-24T22:24:35.162988] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-09-24T22:24:35.180081] [INFO ] [MAIN ] OMC: Loaded 53292 primary data records. [2025-09-24T22:24:35.609692] [DEBUG] [LOCAL ] OMI: Loaded 45840 existing records from primary storage. [2025-09-24T22:24:35.609967] [INFO ] [MAIN ] OMI: Loaded 45840 primary data records. [2025-09-24T22:24:36.065444] [DEBUG] [MAIN ] OMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:36.078412] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53292 primary records. [2025-09-24T22:24:36.078525] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-24T22:24:36.079711] [DEBUG] [MAIN ] OMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:36.080516] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46213 primary records. [2025-09-24T22:24:36.089154] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-24T22:24:36.111820] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-24T22:24:36.113272] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-24T22:24:36.115442] [INFO ] [MAIN ] Derivative Progress: 1373/2075 symbols completed. OMF took 1.2s. Estimated remaining: 4m 35s. Rate: 153.3 symbols/min [2025-09-24T22:24:36.116788] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:36.119220] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-24T22:24:36.119324] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-24T22:24:36.122118] [INFO ] [MAIN ] Derivative Progress: 1374/2075 symbols completed. OMC took 1.3s. Estimated remaining: 4m 34s. Rate: 153.4 symbols/min [2025-09-24T22:24:36.122411] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:36.145209] [DEBUG] [MAIN ] OMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:36.145447] [DEBUG] [LOCAL ] ONIT: Loaded 7800 existing records from primary storage. [2025-09-24T22:24:36.146388] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45840 primary records. [2025-09-24T22:24:36.146460] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-24T22:24:36.145731] [INFO ] [MAIN ] ONIT: Loaded 7800 primary data records. [2025-09-24T22:24:36.290801] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-24T22:24:36.301320] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-24T22:24:36.303940] [INFO ] [MAIN ] Derivative Progress: 1375/2075 symbols completed. OMI took 1.2s. Estimated remaining: 4m 34s. Rate: 153.5 symbols/min [2025-09-24T22:24:36.331132] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:36.535001] [DEBUG] [LOCAL ] ONL: Loaded 31583 existing records from primary storage. [2025-09-24T22:24:36.535300] [INFO ] [MAIN ] ONL: Loaded 31583 primary data records. [2025-09-24T22:24:36.874070] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-09-24T22:24:36.874590] [INFO ] [MAIN ] ONON: Loaded 53612 primary data records. [2025-09-24T22:24:37.201212] [DEBUG] [MAIN ] ONIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:37.202103] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7800 primary records. [2025-09-24T22:24:37.202998] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-24T22:24:37.237267] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-24T22:24:37.237757] [DEBUG] [MAIN ] ONL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:37.238670] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-24T22:24:37.238890] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 31583 primary records. [2025-09-24T22:24:37.241023] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-24T22:24:37.240937] [INFO ] [MAIN ] Derivative Progress: 1376/2075 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 34s. Rate: 153.3 symbols/min [2025-09-24T22:24:37.241753] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:37.261841] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-24T22:24:37.262190] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-24T22:24:37.264923] [INFO ] [MAIN ] Derivative Progress: 1377/2075 symbols completed. ONL took 1.1s. Estimated remaining: 4m 33s. Rate: 153.4 symbols/min [2025-09-24T22:24:37.265218] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:37.283563] [DEBUG] [MAIN ] ONON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:37.284389] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53612 primary records. [2025-09-24T22:24:37.284560] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-24T22:24:37.307913] [DEBUG] [LOCAL ] ONTF: Loaded 22934 existing records from primary storage. [2025-09-24T22:24:37.308985] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-24T22:24:37.309049] [INFO ] [MAIN ] ONTF: Loaded 22934 primary data records. [2025-09-24T22:24:37.309190] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-24T22:24:37.311660] [INFO ] [MAIN ] Derivative Progress: 1378/2075 symbols completed. ONON took 1.0s. Estimated remaining: 4m 32s. Rate: 153.5 symbols/min [2025-09-24T22:24:37.647358] [DEBUG] [LOCAL ] ONTO: Loaded 46659 existing records from primary storage. [2025-09-24T22:24:37.647539] [INFO ] [MAIN ] ONTO: Loaded 46659 primary data records. [2025-09-24T22:24:37.975069] [DEBUG] [MAIN ] ONTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:37.975955] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22934 primary records. [2025-09-24T22:24:37.976290] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-24T22:24:37.995739] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-24T22:24:37.996007] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-24T22:24:37.998796] [INFO ] [MAIN ] Derivative Progress: 1379/2075 symbols completed. ONTF took 0.8s. Estimated remaining: 4m 32s. Rate: 153.4 symbols/min [2025-09-24T22:24:38.011774] [DEBUG] [MAIN ] ONTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:38.012369] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46659 primary records. [2025-09-24T22:24:38.012431] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-24T22:24:38.028177] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-24T22:24:38.028238] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-24T22:24:38.030724] [INFO ] [MAIN ] Derivative Progress: 1380/2075 symbols completed. ONTO took 0.8s. Estimated remaining: 4m 32s. Rate: 153.5 symbols/min [2025-09-24T22:24:38.031505] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:38.031429] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:38.031303] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:38.060460] [DEBUG] [LOCAL ] OOMA: Loaded 19065 existing records from primary storage. [2025-09-24T22:24:38.060708] [INFO ] [MAIN ] OOMA: Loaded 19065 primary data records. [2025-09-24T22:24:38.104984] [DEBUG] [LOCAL ] OPAD: Loaded 20033 existing records from primary storage. [2025-09-24T22:24:38.134595] [INFO ] [MAIN ] OPAD: Loaded 20033 primary data records. [2025-09-24T22:24:38.347561] [DEBUG] [LOCAL ] OPFI: Loaded 46589 existing records from primary storage. [2025-09-24T22:24:38.391590] [INFO ] [MAIN ] OPFI: Loaded 46589 primary data records. [2025-09-24T22:24:39.087257] [DEBUG] [MAIN ] OOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:39.090243] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 19065 primary records. [2025-09-24T22:24:39.090735] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-24T22:24:39.111516] [DEBUG] [MAIN ] OPAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:39.112248] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 20033 primary records. [2025-09-24T22:24:39.112412] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-24T22:24:39.133949] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-24T22:24:39.134868] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-24T22:24:39.137385] [INFO ] [MAIN ] Derivative Progress: 1381/2075 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 32s. Rate: 153.3 symbols/min [2025-09-24T22:24:39.138111] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:39.149954] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-24T22:24:39.154882] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-24T22:24:39.155140] [DEBUG] [MAIN ] OPFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:39.158993] [INFO ] [MAIN ] Derivative Progress: 1382/2075 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 31s. Rate: 153.4 symbols/min [2025-09-24T22:24:39.155932] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46589 primary records. [2025-09-24T22:24:39.159280] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:39.159536] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-24T22:24:39.177842] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-24T22:24:39.177991] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-24T22:24:39.180533] [INFO ] [MAIN ] Derivative Progress: 1383/2075 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 30s. Rate: 153.5 symbols/min [2025-09-24T22:24:39.180916] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:39.226306] [DEBUG] [LOCAL ] OR: Loaded 46062 existing records from primary storage. [2025-09-24T22:24:39.226493] [INFO ] [MAIN ] OR: Loaded 46062 primary data records. [2025-09-24T22:24:39.386847] [DEBUG] [LOCAL ] ORA: Loaded 32542 existing records from primary storage. [2025-09-24T22:24:39.405899] [INFO ] [MAIN ] ORA: Loaded 32542 primary data records. [2025-09-24T22:24:39.439896] [DEBUG] [LOCAL ] ORC: Loaded 52315 existing records from primary storage. [2025-09-24T22:24:39.585497] [INFO ] [MAIN ] ORC: Loaded 52315 primary data records. [2025-09-24T22:24:40.225697] [DEBUG] [MAIN ] OR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:40.227019] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46062 primary records. [2025-09-24T22:24:40.227362] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-24T22:24:40.247165] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-24T22:24:40.247460] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-24T22:24:40.249664] [INFO ] [MAIN ] Derivative Progress: 1384/2075 symbols completed. OR took 1.1s. Estimated remaining: 4m 30s. Rate: 153.3 symbols/min [2025-09-24T22:24:40.250487] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:40.281547] [DEBUG] [MAIN ] ORA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:40.282055] [DEBUG] [MAIN ] ORC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:40.283093] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52315 primary records. [2025-09-24T22:24:40.284062] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32542 primary records. [2025-09-24T22:24:40.284191] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-24T22:24:40.284318] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-24T22:24:40.320702] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-24T22:24:40.320911] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-24T22:24:40.325001] [INFO ] [MAIN ] Derivative Progress: 1385/2075 symbols completed. ORC took 1.1s. Estimated remaining: 4m 30s. Rate: 153.4 symbols/min [2025-09-24T22:24:40.326264] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:40.338213] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-24T22:24:40.338422] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-24T22:24:40.341983] [DEBUG] [LOCAL ] ORN: Loaded 31573 existing records from primary storage. [2025-09-24T22:24:40.341000] [INFO ] [MAIN ] Derivative Progress: 1386/2075 symbols completed. ORA took 1.2s. Estimated remaining: 4m 29s. Rate: 153.5 symbols/min [2025-09-24T22:24:40.342411] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:40.342545] [INFO ] [MAIN ] ORN: Loaded 31573 primary data records. [2025-09-24T22:24:40.758991] [DEBUG] [LOCAL ] OTIS: Loaded 52712 existing records from primary storage. [2025-09-24T22:24:40.759316] [INFO ] [MAIN ] OTIS: Loaded 52712 primary data records. [2025-09-24T22:24:40.798095] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-24T22:24:40.818368] [INFO ] [MAIN ] OSCR: Loaded 53722 primary data records. [2025-09-24T22:24:41.263759] [DEBUG] [MAIN ] ORN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:41.382037] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31573 primary records. [2025-09-24T22:24:41.383024] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-24T22:24:41.402522] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-24T22:24:41.403160] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-24T22:24:41.405603] [INFO ] [MAIN ] Derivative Progress: 1387/2075 symbols completed. ORN took 1.2s. Estimated remaining: 4m 29s. Rate: 153.4 symbols/min [2025-09-24T22:24:41.406632] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:41.428092] [DEBUG] [MAIN ] OTIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:41.429268] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52712 primary records. [2025-09-24T22:24:41.429477] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-24T22:24:41.461198] [DEBUG] [MAIN ] OSCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:41.462854] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53722 primary records. [2025-09-24T22:24:41.463404] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-24T22:24:41.465585] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-09-24T22:24:41.465949] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-24T22:24:41.468247] [INFO ] [MAIN ] Derivative Progress: 1388/2075 symbols completed. OTIS took 1.1s. Estimated remaining: 4m 29s. Rate: 153.4 symbols/min [2025-09-24T22:24:41.483315] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:41.483690] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-24T22:24:41.493944] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-24T22:24:41.497607] [INFO ] [MAIN ] Derivative Progress: 1389/2075 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 28s. Rate: 153.5 symbols/min [2025-09-24T22:24:41.498403] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:41.523630] [DEBUG] [LOCAL ] OUT: Loaded 48046 existing records from primary storage. [2025-09-24T22:24:41.524042] [INFO ] [MAIN ] OUT: Loaded 48046 primary data records. [2025-09-24T22:24:41.901440] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-24T22:24:41.901718] [INFO ] [MAIN ] OWL: Loaded 53555 primary data records. [2025-09-24T22:24:41.907990] [DEBUG] [LOCAL ] OVV: Loaded 53515 existing records from primary storage. [2025-09-24T22:24:41.924835] [INFO ] [MAIN ] OVV: Loaded 53515 primary data records. [2025-09-24T22:24:42.600239] [DEBUG] [MAIN ] OUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:42.601131] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 48046 primary records. [2025-09-24T22:24:42.601351] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-24T22:24:42.632692] [DEBUG] [MAIN ] OWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:42.634007] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53555 primary records. [2025-09-24T22:24:42.634541] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-24T22:24:42.645437] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-24T22:24:42.648279] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-24T22:24:42.650922] [INFO ] [MAIN ] Derivative Progress: 1390/2075 symbols completed. OUT took 1.2s. Estimated remaining: 4m 28s. Rate: 153.3 symbols/min [2025-09-24T22:24:42.652854] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:42.674138] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-24T22:24:42.674468] [DEBUG] [MAIN ] OVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:42.674776] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-24T22:24:42.675509] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53515 primary records. [2025-09-24T22:24:42.677835] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-24T22:24:42.677617] [INFO ] [MAIN ] Derivative Progress: 1391/2075 symbols completed. OWL took 1.2s. Estimated remaining: 4m 27s. Rate: 153.4 symbols/min [2025-09-24T22:24:42.679086] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:42.690631] [DEBUG] [LOCAL ] OWLT: Loaded 8978 existing records from primary storage. [2025-09-24T22:24:42.690850] [INFO ] [MAIN ] OWLT: Loaded 8978 primary data records. [2025-09-24T22:24:42.810822] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-24T22:24:42.832132] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-24T22:24:42.835105] [INFO ] [MAIN ] Derivative Progress: 1392/2075 symbols completed. OVV took 1.4s. Estimated remaining: 4m 27s. Rate: 153.5 symbols/min [2025-09-24T22:24:42.888767] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:43.038541] [DEBUG] [LOCAL ] PAC: Loaded 11566 existing records from primary storage. [2025-09-24T22:24:43.039868] [INFO ] [MAIN ] PAC: Loaded 11566 primary data records. [2025-09-24T22:24:43.156353] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-24T22:24:43.159850] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-24T22:24:43.568079] [DEBUG] [MAIN ] OWLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:43.569092] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8978 primary records. [2025-09-24T22:24:43.693085] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-24T22:24:43.726132] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-24T22:24:43.726472] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-24T22:24:43.728433] [INFO ] [MAIN ] Derivative Progress: 1393/2075 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 27s. Rate: 153.4 symbols/min [2025-09-24T22:24:43.751161] [DEBUG] [MAIN ] PAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:43.751999] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11566 primary records. [2025-09-24T22:24:43.752175] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-24T22:24:43.782450] [DEBUG] [MAIN ] PAAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:43.784056] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-24T22:24:43.784375] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-24T22:24:43.785137] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-09-24T22:24:43.785626] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-24T22:24:43.787856] [INFO ] [MAIN ] Derivative Progress: 1394/2075 symbols completed. PAC took 0.9s. Estimated remaining: 4m 26s. Rate: 153.5 symbols/min [2025-09-24T22:24:43.803465] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-24T22:24:43.803541] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-24T22:24:43.806321] [INFO ] [MAIN ] Derivative Progress: 1395/2075 symbols completed. PAAS took 1.1s. Estimated remaining: 4m 26s. Rate: 153.6 symbols/min [2025-09-24T22:24:43.807035] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:43.806862] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:43.807424] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:43.841793] [DEBUG] [LOCAL ] PAG: Loaded 21917 existing records from primary storage. [2025-09-24T22:24:43.841938] [INFO ] [MAIN ] PAG: Loaded 21917 primary data records. [2025-09-24T22:24:43.976557] [DEBUG] [LOCAL ] PACS: Loaded 34103 existing records from primary storage. [2025-09-24T22:24:43.977430] [INFO ] [MAIN ] PACS: Loaded 34103 primary data records. [2025-09-24T22:24:44.151686] [DEBUG] [LOCAL ] PAGS: Loaded 52679 existing records from primary storage. [2025-09-24T22:24:44.162334] [INFO ] [MAIN ] PAGS: Loaded 52679 primary data records. [2025-09-24T22:24:44.898553] [DEBUG] [MAIN ] PAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:44.899815] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21917 primary records. [2025-09-24T22:24:44.901016] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-24T22:24:44.933536] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-24T22:24:44.933753] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-24T22:24:44.935808] [INFO ] [MAIN ] Derivative Progress: 1396/2075 symbols completed. PAG took 1.1s. Estimated remaining: 4m 26s. Rate: 153.4 symbols/min [2025-09-24T22:24:44.933448] [DEBUG] [MAIN ] PACS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:44.937313] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:44.936905] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34103 primary records. [2025-09-24T22:24:44.937756] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-24T22:24:44.966468] [DEBUG] [LOCAL ] PAI: Loaded 2706 existing records from primary storage. [2025-09-24T22:24:44.972162] [INFO ] [MAIN ] PAI: Loaded 2706 primary data records. [2025-09-24T22:24:44.972518] [DEBUG] [MAIN ] PAGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:44.995459] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52679 primary records. [2025-09-24T22:24:45.011948] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-24T22:24:45.062361] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-24T22:24:45.087903] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-24T22:24:45.088190] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-24T22:24:45.088091] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-24T22:24:45.101759] [INFO ] [MAIN ] Derivative Progress: 1397/2075 symbols completed. PAGS took 1.3s. Estimated remaining: 4m 25s. Rate: 153.4 symbols/min [2025-09-24T22:24:45.105014] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:45.104892] [INFO ] [MAIN ] Derivative Progress: 1398/2075 symbols completed. PACS took 1.3s. Estimated remaining: 4m 25s. Rate: 153.5 symbols/min [2025-09-24T22:24:45.121583] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:45.332514] [DEBUG] [LOCAL ] PAM: Loaded 27952 existing records from primary storage. [2025-09-24T22:24:45.333019] [INFO ] [MAIN ] PAM: Loaded 27952 primary data records. [2025-09-24T22:24:45.440743] [DEBUG] [LOCAL ] PAR: Loaded 32612 existing records from primary storage. [2025-09-24T22:24:45.455604] [INFO ] [MAIN ] PAR: Loaded 32612 primary data records. [2025-09-24T22:24:45.545422] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:45.584595] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2706 primary records. [2025-09-24T22:24:45.640477] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-24T22:24:45.810227] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-24T22:24:45.827843] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-24T22:24:45.844145] [INFO ] [MAIN ] Derivative Progress: 1399/2075 symbols completed. PAI took 0.9s. Estimated remaining: 4m 24s. Rate: 153.4 symbols/min [2025-09-24T22:24:45.865096] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:46.031281] [DEBUG] [MAIN ] PAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:46.032222] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 27952 primary records. [2025-09-24T22:24:46.032318] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-24T22:24:46.063137] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-24T22:24:46.063310] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-24T22:24:46.065926] [INFO ] [MAIN ] Derivative Progress: 1400/2075 symbols completed. PAM took 1.0s. Estimated remaining: 4m 24s. Rate: 153.5 symbols/min [2025-09-24T22:24:46.067325] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:46.098329] [DEBUG] [LOCAL ] PARR: Loaded 48352 existing records from primary storage. [2025-09-24T22:24:46.098819] [INFO ] [MAIN ] PARR: Loaded 48352 primary data records. [2025-09-24T22:24:46.098725] [DEBUG] [MAIN ] PAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:46.100005] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32612 primary records. [2025-09-24T22:24:46.105378] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-24T22:24:46.327705] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-24T22:24:46.435278] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-24T22:24:46.443254] [INFO ] [MAIN ] Derivative Progress: 1401/2075 symbols completed. PAR took 1.3s. Estimated remaining: 4m 23s. Rate: 153.5 symbols/min [2025-09-24T22:24:46.452765] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:46.469982] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-24T22:24:46.470254] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-09-24T22:24:46.621268] [DEBUG] [LOCAL ] PAXS: Loaded 20964 existing records from primary storage. [2025-09-24T22:24:46.651522] [INFO ] [MAIN ] PAXS: Loaded 20964 primary data records. [2025-09-24T22:24:47.026380] [DEBUG] [MAIN ] PARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:47.053283] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48352 primary records. [2025-09-24T22:24:47.174345] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-24T22:24:47.200307] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-24T22:24:47.200581] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-24T22:24:47.202840] [INFO ] [MAIN ] Derivative Progress: 1402/2075 symbols completed. PARR took 1.3s. Estimated remaining: 4m 23s. Rate: 153.4 symbols/min [2025-09-24T22:24:47.203151] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:47.217210] [DEBUG] [MAIN ] PATH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:47.218261] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-09-24T22:24:47.218458] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-24T22:24:47.236313] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-24T22:24:47.240087] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-24T22:24:47.242141] [INFO ] [MAIN ] Derivative Progress: 1403/2075 symbols completed. PATH took 1.2s. Estimated remaining: 4m 23s. Rate: 153.5 symbols/min [2025-09-24T22:24:47.242687] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:47.256996] [DEBUG] [MAIN ] PAXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:47.257865] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 20964 primary records. [2025-09-24T22:24:47.257964] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-24T22:24:47.283591] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-24T22:24:47.294911] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-24T22:24:47.298493] [INFO ] [MAIN ] Derivative Progress: 1404/2075 symbols completed. PAXS took 0.8s. Estimated remaining: 4m 22s. Rate: 153.6 symbols/min [2025-09-24T22:24:47.295493] [DEBUG] [LOCAL ] PAY: Loaded 38400 existing records from primary storage. [2025-09-24T22:24:47.298884] [INFO ] [MAIN ] PAY: Loaded 38400 primary data records. [2025-09-24T22:24:47.299158] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:47.473615] [DEBUG] [LOCAL ] PAYC: Loaded 36272 existing records from primary storage. [2025-09-24T22:24:47.503075] [INFO ] [MAIN ] PAYC: Loaded 36272 primary data records. [2025-09-24T22:24:47.773818] [DEBUG] [LOCAL ] PB: Loaded 41367 existing records from primary storage. [2025-09-24T22:24:47.809674] [INFO ] [MAIN ] PB: Loaded 41367 primary data records. [2025-09-24T22:24:48.308793] [DEBUG] [MAIN ] PAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:48.310582] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38400 primary records. [2025-09-24T22:24:48.311020] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-24T22:24:48.348582] [DEBUG] [MAIN ] PAYC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:48.350163] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36272 primary records. [2025-09-24T22:24:48.350676] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-24T22:24:48.350548] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-24T22:24:48.350835] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-24T22:24:48.354107] [INFO ] [MAIN ] Derivative Progress: 1405/2075 symbols completed. PAY took 1.2s. Estimated remaining: 4m 22s. Rate: 153.4 symbols/min [2025-09-24T22:24:48.366137] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:48.371700] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-24T22:24:48.371963] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-24T22:24:48.374123] [INFO ] [MAIN ] Derivative Progress: 1406/2075 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 22s. Rate: 153.5 symbols/min [2025-09-24T22:24:48.374576] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:48.391507] [DEBUG] [MAIN ] PB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:48.392374] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41367 primary records. [2025-09-24T22:24:48.392542] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-24T22:24:48.409429] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-24T22:24:48.409553] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-24T22:24:48.412304] [INFO ] [MAIN ] Derivative Progress: 1407/2075 symbols completed. PB took 1.1s. Estimated remaining: 4m 21s. Rate: 153.6 symbols/min [2025-09-24T22:24:48.412702] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:48.468020] [DEBUG] [LOCAL ] PBA: Loaded 48938 existing records from primary storage. [2025-09-24T22:24:48.475903] [INFO ] [MAIN ] PBA: Loaded 48938 primary data records. [2025-09-24T22:24:48.569403] [DEBUG] [LOCAL ] PBF: Loaded 53090 existing records from primary storage. [2025-09-24T22:24:48.586421] [INFO ] [MAIN ] PBF: Loaded 53090 primary data records. [2025-09-24T22:24:48.653865] [DEBUG] [LOCAL ] PBH: Loaded 31589 existing records from primary storage. [2025-09-24T22:24:48.693980] [INFO ] [MAIN ] PBH: Loaded 31589 primary data records. [2025-09-24T22:24:49.523423] [DEBUG] [MAIN ] PBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:49.525693] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48938 primary records. [2025-09-24T22:24:49.525922] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-24T22:24:49.551187] [DEBUG] [MAIN ] PBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:49.552094] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53090 primary records. [2025-09-24T22:24:49.552263] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-24T22:24:49.570758] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-24T22:24:49.573541] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-24T22:24:49.575624] [INFO ] [MAIN ] Derivative Progress: 1408/2075 symbols completed. PBA took 1.2s. Estimated remaining: 4m 21s. Rate: 153.4 symbols/min [2025-09-24T22:24:49.585373] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-24T22:24:49.590501] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-24T22:24:49.593063] [INFO ] [MAIN ] Derivative Progress: 1409/2075 symbols completed. PBF took 1.2s. Estimated remaining: 4m 20s. Rate: 153.5 symbols/min [2025-09-24T22:24:49.593703] [DEBUG] [MAIN ] PBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:49.594544] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31589 primary records. [2025-09-24T22:24:49.594754] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-24T22:24:49.611815] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-24T22:24:49.611881] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-24T22:24:49.614437] [INFO ] [MAIN ] Derivative Progress: 1410/2075 symbols completed. PBH took 1.2s. Estimated remaining: 4m 20s. Rate: 153.6 symbols/min [2025-09-24T22:24:49.615341] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:49.615261] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:49.615636] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:49.635820] [DEBUG] [LOCAL ] PBT: Loaded 17360 existing records from primary storage. [2025-09-24T22:24:49.636154] [INFO ] [MAIN ] PBT: Loaded 17360 primary data records. [2025-09-24T22:24:49.991789] [DEBUG] [LOCAL ] PBI: Loaded 50024 existing records from primary storage. [2025-09-24T22:24:50.007949] [INFO ] [MAIN ] PBI: Loaded 50024 primary data records. [2025-09-24T22:24:50.014372] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-24T22:24:50.044025] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-09-24T22:24:50.664786] [DEBUG] [MAIN ] PBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:50.666589] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17360 primary records. [2025-09-24T22:24:50.666989] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-24T22:24:50.688065] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-24T22:24:50.688333] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-24T22:24:50.691304] [INFO ] [MAIN ] Derivative Progress: 1411/2075 symbols completed. PBT took 1.1s. Estimated remaining: 4m 20s. Rate: 153.4 symbols/min [2025-09-24T22:24:50.692599] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:50.715497] [DEBUG] [MAIN ] PBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:50.718532] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50024 primary records. [2025-09-24T22:24:50.722814] [DEBUG] [LOCAL ] PCF: Loaded 8630 existing records from primary storage. [2025-09-24T22:24:50.730827] [INFO ] [MAIN ] PCF: Loaded 8630 primary data records. [2025-09-24T22:24:50.730919] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-24T22:24:50.742471] [DEBUG] [MAIN ] PBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:50.786316] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53713 primary records. [2025-09-24T22:24:50.809281] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-24T22:24:50.905184] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-24T22:24:50.911928] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-24T22:24:50.912016] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-24T22:24:50.929502] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-24T22:24:50.929393] [INFO ] [MAIN ] Derivative Progress: 1412/2075 symbols completed. PBI took 1.3s. Estimated remaining: 4m 19s. Rate: 153.4 symbols/min [2025-09-24T22:24:50.949816] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:50.968901] [INFO ] [MAIN ] Derivative Progress: 1413/2075 symbols completed. PBR took 1.4s. Estimated remaining: 4m 19s. Rate: 153.5 symbols/min [2025-09-24T22:24:50.976048] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:51.136207] [DEBUG] [LOCAL ] PCM: Loaded 6803 existing records from primary storage. [2025-09-24T22:24:51.136351] [INFO ] [MAIN ] PCM: Loaded 6803 primary data records. [2025-09-24T22:24:51.462606] [DEBUG] [LOCAL ] PCN: Loaded 24313 existing records from primary storage. [2025-09-24T22:24:51.472376] [INFO ] [MAIN ] PCN: Loaded 24313 primary data records. [2025-09-24T22:24:51.798594] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:51.800046] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8630 primary records. [2025-09-24T22:24:51.800488] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-24T22:24:51.819263] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-24T22:24:51.822871] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-24T22:24:51.825482] [INFO ] [MAIN ] Derivative Progress: 1414/2075 symbols completed. PCF took 1.1s. Estimated remaining: 4m 19s. Rate: 153.4 symbols/min [2025-09-24T22:24:51.826145] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:51.841830] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:51.842892] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6803 primary records. [2025-09-24T22:24:51.843086] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-24T22:24:51.860128] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-24T22:24:51.860364] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-24T22:24:51.863061] [INFO ] [MAIN ] Derivative Progress: 1415/2075 symbols completed. PCM took 0.9s. Estimated remaining: 4m 18s. Rate: 153.5 symbols/min [2025-09-24T22:24:51.863588] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:51.886991] [DEBUG] [MAIN ] PCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:51.893531] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24313 primary records. [2025-09-24T22:24:51.893692] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-24T22:24:51.892753] [DEBUG] [LOCAL ] PCQ: Loaded 11972 existing records from primary storage. [2025-09-24T22:24:51.894688] [INFO ] [MAIN ] PCQ: Loaded 11972 primary data records. [2025-09-24T22:24:52.093612] [DEBUG] [LOCAL ] PCOR: Loaded 48193 existing records from primary storage. [2025-09-24T22:24:52.118363] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-24T22:24:52.143855] [INFO ] [MAIN ] PCOR: Loaded 48193 primary data records. [2025-09-24T22:24:52.252917] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-24T22:24:52.261054] [INFO ] [MAIN ] Derivative Progress: 1416/2075 symbols completed. PCN took 1.3s. Estimated remaining: 4m 18s. Rate: 153.5 symbols/min [2025-09-24T22:24:52.318856] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:52.650733] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:52.653542] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 11972 primary records. [2025-09-24T22:24:52.653766] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-24T22:24:52.655203] [DEBUG] [LOCAL ] PD: Loaded 47875 existing records from primary storage. [2025-09-24T22:24:52.657667] [INFO ] [MAIN ] PD: Loaded 47875 primary data records. [2025-09-24T22:24:52.678512] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-24T22:24:52.696341] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-24T22:24:52.710158] [INFO ] [MAIN ] Derivative Progress: 1417/2075 symbols completed. PCQ took 0.8s. Estimated remaining: 4m 17s. Rate: 153.5 symbols/min [2025-09-24T22:24:52.738446] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:52.877762] [DEBUG] [MAIN ] PCOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:52.899588] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48193 primary records. [2025-09-24T22:24:53.061838] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-24T22:24:53.094347] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-24T22:24:53.095624] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-24T22:24:53.111333] [INFO ] [MAIN ] Derivative Progress: 1418/2075 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 17s. Rate: 153.5 symbols/min [2025-09-24T22:24:53.111747] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:53.136439] [DEBUG] [LOCAL ] PDI: Loaded 50205 existing records from primary storage. [2025-09-24T22:24:53.136971] [INFO ] [MAIN ] PDI: Loaded 50205 primary data records. [2025-09-24T22:24:53.289637] [DEBUG] [MAIN ] PD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:53.331593] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47875 primary records. [2025-09-24T22:24:53.347699] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-24T22:24:53.389770] [DEBUG] [LOCAL ] PDM: Loaded 39873 existing records from primary storage. [2025-09-24T22:24:53.391542] [INFO ] [MAIN ] PDM: Loaded 39873 primary data records. [2025-09-24T22:24:53.617672] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-24T22:24:53.639190] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-24T22:24:53.641715] [INFO ] [MAIN ] Derivative Progress: 1419/2075 symbols completed. PD took 1.3s. Estimated remaining: 4m 17s. Rate: 153.4 symbols/min [2025-09-24T22:24:53.642052] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:53.903535] [DEBUG] [MAIN ] PDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:53.905100] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50205 primary records. [2025-09-24T22:24:53.905264] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-24T22:24:53.933433] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-24T22:24:53.933693] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-24T22:24:53.934609] [DEBUG] [LOCAL ] PDO: Loaded 31740 existing records from primary storage. [2025-09-24T22:24:53.935401] [INFO ] [MAIN ] PDO: Loaded 31740 primary data records. [2025-09-24T22:24:53.937887] [INFO ] [MAIN ] Derivative Progress: 1420/2075 symbols completed. PDI took 1.2s. Estimated remaining: 4m 16s. Rate: 153.5 symbols/min [2025-09-24T22:24:53.944462] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:54.166489] [DEBUG] [LOCAL ] PDS: Loaded 18126 existing records from primary storage. [2025-09-24T22:24:54.287998] [INFO ] [MAIN ] PDS: Loaded 18126 primary data records. [2025-09-24T22:24:54.337534] [DEBUG] [MAIN ] PDM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:54.377445] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39873 primary records. [2025-09-24T22:24:54.388393] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-24T22:24:54.657389] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-24T22:24:54.658734] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-24T22:24:54.661987] [INFO ] [MAIN ] Derivative Progress: 1421/2075 symbols completed. PDM took 1.6s. Estimated remaining: 4m 16s. Rate: 153.4 symbols/min [2025-09-24T22:24:54.663582] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:54.685170] [DEBUG] [MAIN ] PDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:54.686856] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31740 primary records. [2025-09-24T22:24:54.692770] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-24T22:24:54.715454] [DEBUG] [LOCAL ] PDT: Loaded 17234 existing records from primary storage. [2025-09-24T22:24:54.717165] [INFO ] [MAIN ] PDT: Loaded 17234 primary data records. [2025-09-24T22:24:54.830078] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-24T22:24:54.838287] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-24T22:24:54.846252] [INFO ] [MAIN ] Derivative Progress: 1422/2075 symbols completed. PDO took 1.2s. Estimated remaining: 4m 15s. Rate: 153.4 symbols/min [2025-09-24T22:24:54.861733] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:54.862339] [DEBUG] [MAIN ] PDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:54.927532] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 18126 primary records. [2025-09-24T22:24:55.061295] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-24T22:24:55.118917] [DEBUG] [LOCAL ] PDX: Loaded 14310 existing records from primary storage. [2025-09-24T22:24:55.119980] [INFO ] [MAIN ] PDX: Loaded 14310 primary data records. [2025-09-24T22:24:55.179200] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-24T22:24:55.209971] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-24T22:24:55.226034] [INFO ] [MAIN ] Derivative Progress: 1423/2075 symbols completed. PDS took 1.3s. Estimated remaining: 4m 15s. Rate: 153.4 symbols/min [2025-09-24T22:24:55.462828] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:55.464484] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17234 primary records. [2025-09-24T22:24:55.464620] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-24T22:24:55.483048] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-24T22:24:55.483245] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-24T22:24:55.485732] [INFO ] [MAIN ] Derivative Progress: 1424/2075 symbols completed. PDT took 0.8s. Estimated remaining: 4m 15s. Rate: 153.5 symbols/min [2025-09-24T22:24:55.503328] [DEBUG] [MAIN ] PDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:55.504184] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14310 primary records. [2025-09-24T22:24:55.504259] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-24T22:24:55.521079] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-24T22:24:55.521231] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-24T22:24:55.524527] [INFO ] [MAIN ] Derivative Progress: 1425/2075 symbols completed. PDX took 0.7s. Estimated remaining: 4m 14s. Rate: 153.6 symbols/min [2025-09-24T22:24:55.525442] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:55.525927] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:55.525692] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:55.541687] [DEBUG] [LOCAL ] PEO: Loaded 10831 existing records from primary storage. [2025-09-24T22:24:55.541988] [INFO ] [MAIN ] PEO: Loaded 10831 primary data records. [2025-09-24T22:24:55.761267] [DEBUG] [LOCAL ] PEN: Loaded 30504 existing records from primary storage. [2025-09-24T22:24:55.875731] [INFO ] [MAIN ] PEN: Loaded 30504 primary data records. [2025-09-24T22:24:55.948568] [DEBUG] [LOCAL ] PEB: Loaded 50706 existing records from primary storage. [2025-09-24T22:24:55.963891] [INFO ] [MAIN ] PEB: Loaded 50706 primary data records. [2025-09-24T22:24:56.547163] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:56.548518] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10831 primary records. [2025-09-24T22:24:56.548922] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-24T22:24:56.569364] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-24T22:24:56.570744] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-24T22:24:56.574228] [INFO ] [MAIN ] Derivative Progress: 1426/2075 symbols completed. PEO took 1.0s. Estimated remaining: 4m 14s. Rate: 153.4 symbols/min [2025-09-24T22:24:56.575256] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:56.592689] [DEBUG] [MAIN ] PEB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:56.594423] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50706 primary records. [2025-09-24T22:24:56.594621] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-24T22:24:56.621219] [DEBUG] [MAIN ] PEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:56.628075] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30504 primary records. [2025-09-24T22:24:56.634720] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-24T22:24:56.634889] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-24T22:24:56.635497] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-24T22:24:56.638374] [DEBUG] [LOCAL ] PERF: Loaded 14031 existing records from primary storage. [2025-09-24T22:24:56.638010] [INFO ] [MAIN ] Derivative Progress: 1427/2075 symbols completed. PEB took 1.1s. Estimated remaining: 4m 13s. Rate: 153.5 symbols/min [2025-09-24T22:24:56.638733] [INFO ] [MAIN ] PERF: Loaded 14031 primary data records. [2025-09-24T22:24:56.647256] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:56.759577] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-24T22:24:56.773506] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-24T22:24:56.778962] [DEBUG] [LOCAL ] PFD: Loaded 5133 existing records from primary storage. [2025-09-24T22:24:56.792021] [INFO ] [MAIN ] PFD: Loaded 5133 primary data records. [2025-09-24T22:24:56.786623] [INFO ] [MAIN ] Derivative Progress: 1428/2075 symbols completed. PEN took 1.3s. Estimated remaining: 4m 13s. Rate: 153.5 symbols/min [2025-09-24T22:24:56.792537] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:57.362627] [DEBUG] [LOCAL ] PFGC: Loaded 46955 existing records from primary storage. [2025-09-24T22:24:57.363112] [INFO ] [MAIN ] PFGC: Loaded 46955 primary data records. [2025-09-24T22:24:57.376017] [DEBUG] [MAIN ] PERF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:57.420623] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14031 primary records. [2025-09-24T22:24:57.432977] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-24T22:24:57.594186] [DEBUG] [MAIN ] PFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:57.596151] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5133 primary records. [2025-09-24T22:24:57.595311] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-24T22:24:57.596302] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-24T22:24:57.700975] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-24T22:24:57.727217] [INFO ] [MAIN ] Derivative Progress: 1429/2075 symbols completed. PERF took 1.2s. Estimated remaining: 4m 13s. Rate: 153.4 symbols/min [2025-09-24T22:24:57.729362] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:57.739538] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-24T22:24:57.743620] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-24T22:24:57.746253] [INFO ] [MAIN ] Derivative Progress: 1430/2075 symbols completed. PFD took 1.1s. Estimated remaining: 4m 12s. Rate: 153.5 symbols/min [2025-09-24T22:24:57.746547] [DEBUG] [LOCAL ] PFH: Loaded 6842 existing records from primary storage. [2025-09-24T22:24:57.747157] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:57.747471] [INFO ] [MAIN ] PFH: Loaded 6842 primary data records. [2025-09-24T22:24:57.877389] [DEBUG] [LOCAL ] PFL: Loaded 13824 existing records from primary storage. [2025-09-24T22:24:57.893438] [INFO ] [MAIN ] PFL: Loaded 13824 primary data records. [2025-09-24T22:24:57.998638] [DEBUG] [MAIN ] PFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:58.157603] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46955 primary records. [2025-09-24T22:24:58.169745] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-24T22:24:58.311482] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-24T22:24:58.421990] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-24T22:24:58.434206] [INFO ] [MAIN ] Derivative Progress: 1431/2075 symbols completed. PFGC took 1.6s. Estimated remaining: 4m 12s. Rate: 153.4 symbols/min [2025-09-24T22:24:58.435188] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:58.457753] [DEBUG] [MAIN ] PFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:58.458638] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6842 primary records. [2025-09-24T22:24:58.458871] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-24T22:24:58.478756] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-24T22:24:58.479097] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-24T22:24:58.482623] [INFO ] [MAIN ] Derivative Progress: 1432/2075 symbols completed. PFH took 0.8s. Estimated remaining: 4m 11s. Rate: 153.5 symbols/min [2025-09-24T22:24:58.483208] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:58.511737] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:58.512490] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13824 primary records. [2025-09-24T22:24:58.512627] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-24T22:24:58.547541] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-24T22:24:58.549089] [DEBUG] [LOCAL ] PFLT: Loaded 43621 existing records from primary storage. [2025-09-24T22:24:58.549637] [INFO ] [MAIN ] PFLT: Loaded 43621 primary data records. [2025-09-24T22:24:58.547789] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-24T22:24:58.591774] [DEBUG] [LOCAL ] PFN: Loaded 21637 existing records from primary storage. [2025-09-24T22:24:58.580688] [INFO ] [MAIN ] Derivative Progress: 1433/2075 symbols completed. PFL took 0.8s. Estimated remaining: 4m 11s. Rate: 153.6 symbols/min [2025-09-24T22:24:58.602505] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:58.607817] [INFO ] [MAIN ] PFN: Loaded 21637 primary data records. [2025-09-24T22:24:58.849671] [DEBUG] [LOCAL ] PFO: Loaded 5878 existing records from primary storage. [2025-09-24T22:24:58.877096] [INFO ] [MAIN ] PFO: Loaded 5878 primary data records. [2025-09-24T22:24:59.541277] [DEBUG] [MAIN ] PFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:59.553957] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43621 primary records. [2025-09-24T22:24:59.554474] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:59.554223] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-24T22:24:59.555348] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21637 primary records. [2025-09-24T22:24:59.556229] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-24T22:24:59.606839] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-24T22:24:59.607380] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:24:59.608137] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-24T22:24:59.609142] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-24T22:24:59.609053] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5878 primary records. [2025-09-24T22:24:59.609332] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-24T22:24:59.611671] [INFO ] [MAIN ] Derivative Progress: 1434/2075 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 11s. Rate: 153.4 symbols/min [2025-09-24T22:24:59.611799] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-24T22:24:59.615415] [INFO ] [MAIN ] Derivative Progress: 1435/2075 symbols completed. PFN took 1.1s. Estimated remaining: 4m 10s. Rate: 153.5 symbols/min [2025-09-24T22:24:59.612082] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:59.615794] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:59.632042] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-24T22:24:59.632121] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-24T22:24:59.634745] [INFO ] [MAIN ] Derivative Progress: 1436/2075 symbols completed. PFO took 1.0s. Estimated remaining: 4m 10s. Rate: 153.6 symbols/min [2025-09-24T22:24:59.635149] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:24:59.657088] [DEBUG] [LOCAL ] PGP: Loaded 5465 existing records from primary storage. [2025-09-24T22:24:59.657188] [INFO ] [MAIN ] PGP: Loaded 5465 primary data records. [2025-09-24T22:24:59.752636] [DEBUG] [LOCAL ] PFSI: Loaded 28903 existing records from primary storage. [2025-09-24T22:24:59.768630] [INFO ] [MAIN ] PFSI: Loaded 28903 primary data records. [2025-09-24T22:24:59.898740] [DEBUG] [LOCAL ] PFS: Loaded 35685 existing records from primary storage. [2025-09-24T22:24:59.951082] [INFO ] [MAIN ] PFS: Loaded 35685 primary data records. [2025-09-24T22:25:00.651404] [DEBUG] [MAIN ] PFSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:00.652281] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28903 primary records. [2025-09-24T22:25:00.650999] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:00.653073] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5465 primary records. [2025-09-24T22:25:00.653427] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-24T22:25:00.653256] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-24T22:25:00.698307] [DEBUG] [MAIN ] PFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:00.700456] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35685 primary records. [2025-09-24T22:25:00.701476] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-24T22:25:00.701572] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-24T22:25:00.703178] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-24T22:25:00.702021] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-24T22:25:00.706045] [INFO ] [MAIN ] Derivative Progress: 1437/2075 symbols completed. PFSI took 1.1s. Estimated remaining: 4m 10s. Rate: 153.4 symbols/min [2025-09-24T22:25:00.706175] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-24T22:25:00.713967] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:00.717246] [INFO ] [MAIN ] Derivative Progress: 1438/2075 symbols completed. PGP took 1.1s. Estimated remaining: 4m 9s. Rate: 153.5 symbols/min [2025-09-24T22:25:00.728154] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-24T22:25:00.728287] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-24T22:25:00.731051] [INFO ] [MAIN ] Derivative Progress: 1439/2075 symbols completed. PFS took 1.1s. Estimated remaining: 4m 8s. Rate: 153.6 symbols/min [2025-09-24T22:25:00.769292] [DEBUG] [LOCAL ] PGRE: Loaded 46473 existing records from primary storage. [2025-09-24T22:25:00.769510] [INFO ] [MAIN ] PGRE: Loaded 46473 primary data records. [2025-09-24T22:25:01.106433] [DEBUG] [MAIN ] PGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:01.107158] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46473 primary records. [2025-09-24T22:25:01.107225] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-24T22:25:01.122987] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-24T22:25:01.123091] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-24T22:25:01.125518] [INFO ] [MAIN ] Derivative Progress: 1440/2075 symbols completed. PGRE took 0.4s. Estimated remaining: 4m 8s. Rate: 153.6 symbols/min [2025-09-24T22:25:01.126084] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:01.126429] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:01.126258] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:01.138361] [DEBUG] [LOCAL ] PGZ: Loaded 5385 existing records from primary storage. [2025-09-24T22:25:01.138692] [INFO ] [MAIN ] PGZ: Loaded 5385 primary data records. [2025-09-24T22:25:01.197806] [DEBUG] [LOCAL ] PHD: Loaded 9775 existing records from primary storage. [2025-09-24T22:25:01.220224] [INFO ] [MAIN ] PHD: Loaded 9775 primary data records. [2025-09-24T22:25:01.481516] [DEBUG] [LOCAL ] PH: Loaded 38807 existing records from primary storage. [2025-09-24T22:25:01.497144] [INFO ] [MAIN ] PH: Loaded 38807 primary data records. [2025-09-24T22:25:02.183508] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:02.185019] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5385 primary records. [2025-09-24T22:25:02.185345] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-24T22:25:02.227008] [DEBUG] [MAIN ] PHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:02.228786] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-24T22:25:02.230383] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-24T22:25:02.229976] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 9775 primary records. [2025-09-24T22:25:02.233248] [INFO ] [MAIN ] Derivative Progress: 1441/2075 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 8s. Rate: 153.4 symbols/min [2025-09-24T22:25:02.233718] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:02.230752] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-24T22:25:02.268222] [DEBUG] [MAIN ] PH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:02.270605] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 38807 primary records. [2025-09-24T22:25:02.271042] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-24T22:25:02.272671] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-24T22:25:02.273295] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-24T22:25:02.283895] [INFO ] [MAIN ] Derivative Progress: 1442/2075 symbols completed. PHD took 1.2s. Estimated remaining: 4m 7s. Rate: 153.5 symbols/min [2025-09-24T22:25:02.289092] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:02.302623] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-24T22:25:02.302941] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-24T22:25:02.305675] [INFO ] [MAIN ] Derivative Progress: 1443/2075 symbols completed. PH took 1.2s. Estimated remaining: 4m 7s. Rate: 153.6 symbols/min [2025-09-24T22:25:02.306147] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:02.323020] [DEBUG] [LOCAL ] PHI: Loaded 14977 existing records from primary storage. [2025-09-24T22:25:02.323545] [INFO ] [MAIN ] PHI: Loaded 14977 primary data records. [2025-09-24T22:25:02.476812] [DEBUG] [LOCAL ] PHG: Loaded 46176 existing records from primary storage. [2025-09-24T22:25:02.501915] [INFO ] [MAIN ] PHG: Loaded 46176 primary data records. [2025-09-24T22:25:02.691412] [DEBUG] [LOCAL ] PHIN: Loaded 33111 existing records from primary storage. [2025-09-24T22:25:02.724223] [INFO ] [MAIN ] PHIN: Loaded 33111 primary data records. [2025-09-24T22:25:03.378440] [DEBUG] [MAIN ] PHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:03.380206] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14977 primary records. [2025-09-24T22:25:03.380688] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-24T22:25:03.402679] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-24T22:25:03.403243] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-24T22:25:03.406112] [INFO ] [MAIN ] Derivative Progress: 1444/2075 symbols completed. PHI took 1.1s. Estimated remaining: 4m 7s. Rate: 153.4 symbols/min [2025-09-24T22:25:03.406581] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:03.426994] [DEBUG] [MAIN ] PHIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:03.433611] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 33111 primary records. [2025-09-24T22:25:03.443896] [DEBUG] [MAIN ] PHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:03.444069] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-24T22:25:03.445019] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46176 primary records. [2025-09-24T22:25:03.445149] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-24T22:25:03.492321] [DEBUG] [LOCAL ] PHK: Loaded 26387 existing records from primary storage. [2025-09-24T22:25:03.493687] [INFO ] [MAIN ] PHK: Loaded 26387 primary data records. [2025-09-24T22:25:03.546688] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-24T22:25:03.560755] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-24T22:25:03.588682] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-24T22:25:03.602372] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-24T22:25:03.617047] [INFO ] [MAIN ] Derivative Progress: 1445/2075 symbols completed. PHIN took 1.3s. Estimated remaining: 4m 6s. Rate: 153.5 symbols/min [2025-09-24T22:25:03.620194] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:03.620085] [INFO ] [MAIN ] Derivative Progress: 1446/2075 symbols completed. PHG took 1.4s. Estimated remaining: 4m 6s. Rate: 153.6 symbols/min [2025-09-24T22:25:03.642422] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:03.856532] [DEBUG] [LOCAL ] PHT: Loaded 15601 existing records from primary storage. [2025-09-24T22:25:03.857075] [INFO ] [MAIN ] PHT: Loaded 15601 primary data records. [2025-09-24T22:25:03.965890] [DEBUG] [LOCAL ] PHR: Loaded 37469 existing records from primary storage. [2025-09-24T22:25:03.988599] [INFO ] [MAIN ] PHR: Loaded 37469 primary data records. [2025-09-24T22:25:04.539245] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:04.542720] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26387 primary records. [2025-09-24T22:25:04.544059] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-24T22:25:04.570568] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-24T22:25:04.572849] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-24T22:25:04.577846] [INFO ] [MAIN ] Derivative Progress: 1447/2075 symbols completed. PHK took 1.2s. Estimated remaining: 4m 6s. Rate: 153.4 symbols/min [2025-09-24T22:25:04.578598] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:04.593982] [DEBUG] [MAIN ] PHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:04.595465] [INFO ] [MAIN ] PHT: Generated 1794 derivative records from 15601 primary records. [2025-09-24T22:25:04.595578] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-24T22:25:04.628556] [DEBUG] [MAIN ] PHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:04.630152] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37469 primary records. [2025-09-24T22:25:04.629298] [DEBUG] [LOCAL ] PHT: Derivative data saved (1794 records). [2025-09-24T22:25:04.630245] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-24T22:25:04.630800] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-24T22:25:04.634009] [INFO ] [MAIN ] Derivative Progress: 1448/2075 symbols completed. PHT took 1.0s. Estimated remaining: 4m 5s. Rate: 153.5 symbols/min [2025-09-24T22:25:04.642785] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:04.652887] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-24T22:25:04.656614] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-24T22:25:04.659671] [INFO ] [MAIN ] Derivative Progress: 1449/2075 symbols completed. PHR took 1.0s. Estimated remaining: 4m 4s. Rate: 153.6 symbols/min [2025-09-24T22:25:04.660147] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:04.656914] [DEBUG] [LOCAL ] PIM: Loaded 4764 existing records from primary storage. [2025-09-24T22:25:04.660635] [INFO ] [MAIN ] PIM: Loaded 4764 primary data records. [2025-09-24T22:25:04.844253] [DEBUG] [LOCAL ] PII: Loaded 49159 existing records from primary storage. [2025-09-24T22:25:04.900281] [DEBUG] [LOCAL ] PINE: Loaded 14211 existing records from primary storage. [2025-09-24T22:25:04.906690] [INFO ] [MAIN ] PII: Loaded 49159 primary data records. [2025-09-24T22:25:04.906945] [INFO ] [MAIN ] PINE: Loaded 14211 primary data records. [2025-09-24T22:25:05.795286] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:05.796768] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4764 primary records. [2025-09-24T22:25:05.796963] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-24T22:25:05.820461] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-24T22:25:05.820788] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-24T22:25:05.824350] [INFO ] [MAIN ] Derivative Progress: 1450/2075 symbols completed. PIM took 1.2s. Estimated remaining: 4m 4s. Rate: 153.4 symbols/min [2025-09-24T22:25:05.826122] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:05.841614] [DEBUG] [MAIN ] PII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:05.855320] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49159 primary records. [2025-09-24T22:25:05.856126] [DEBUG] [MAIN ] PINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:05.856300] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-24T22:25:05.857707] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14211 primary records. [2025-09-24T22:25:05.858352] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-24T22:25:05.892434] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-24T22:25:05.891677] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-24T22:25:05.892624] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-24T22:25:05.892687] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-24T22:25:05.895379] [INFO ] [MAIN ] Derivative Progress: 1451/2075 symbols completed. PINE took 1.2s. Estimated remaining: 4m 4s. Rate: 153.5 symbols/min [2025-09-24T22:25:05.899203] [INFO ] [MAIN ] Derivative Progress: 1452/2075 symbols completed. PII took 1.3s. Estimated remaining: 4m 3s. Rate: 153.6 symbols/min [2025-09-24T22:25:05.899137] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:05.899587] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:05.931895] [DEBUG] [LOCAL ] PIPR: Loaded 15197 existing records from primary storage. [2025-09-24T22:25:05.932171] [INFO ] [MAIN ] PIPR: Loaded 15197 primary data records. [2025-09-24T22:25:05.991144] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-24T22:25:06.041431] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-24T22:25:06.041918] [DEBUG] [LOCAL ] PJT: Loaded 22399 existing records from primary storage. [2025-09-24T22:25:06.079323] [INFO ] [MAIN ] PJT: Loaded 22399 primary data records. [2025-09-24T22:25:06.975573] [DEBUG] [MAIN ] PIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:06.976589] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15197 primary records. [2025-09-24T22:25:06.977113] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-24T22:25:07.002141] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-24T22:25:07.010232] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-24T22:25:07.025167] [INFO ] [MAIN ] Derivative Progress: 1453/2075 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 3s. Rate: 153.4 symbols/min [2025-09-24T22:25:07.030872] [DEBUG] [MAIN ] PINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:07.032065] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-24T22:25:07.031196] [DEBUG] [MAIN ] PJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:07.032996] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 22399 primary records. [2025-09-24T22:25:07.032222] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-24T22:25:07.033132] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-24T22:25:07.066382] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-24T22:25:07.066032] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-24T22:25:07.066474] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-24T22:25:07.069522] [INFO ] [MAIN ] Derivative Progress: 1454/2075 symbols completed. PJT took 1.2s. Estimated remaining: 4m 3s. Rate: 153.5 symbols/min [2025-09-24T22:25:07.069793] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-24T22:25:07.072441] [INFO ] [MAIN ] Derivative Progress: 1455/2075 symbols completed. PINS took 1.2s. Estimated remaining: 4m 2s. Rate: 153.6 symbols/min [2025-09-24T22:25:07.073124] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:07.073394] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:07.073244] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:07.088515] [DEBUG] [LOCAL ] PKE: Loaded 12555 existing records from primary storage. [2025-09-24T22:25:07.088630] [INFO ] [MAIN ] PKE: Loaded 12555 primary data records. [2025-09-24T22:25:07.478565] [DEBUG] [LOCAL ] PKG: Loaded 39209 existing records from primary storage. [2025-09-24T22:25:07.494913] [INFO ] [MAIN ] PKG: Loaded 39209 primary data records. [2025-09-24T22:25:07.501016] [DEBUG] [LOCAL ] PK: Loaded 52860 existing records from primary storage. [2025-09-24T22:25:07.509158] [INFO ] [MAIN ] PK: Loaded 52860 primary data records. [2025-09-24T22:25:08.194090] [DEBUG] [MAIN ] PKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:08.195409] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12555 primary records. [2025-09-24T22:25:08.195612] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-24T22:25:08.231423] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-24T22:25:08.232284] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-24T22:25:08.232523] [DEBUG] [MAIN ] PK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:08.235832] [INFO ] [MAIN ] Derivative Progress: 1456/2075 symbols completed. PKE took 1.2s. Estimated remaining: 4m 2s. Rate: 153.4 symbols/min [2025-09-24T22:25:08.237076] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52860 primary records. [2025-09-24T22:25:08.238343] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:08.238132] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-24T22:25:08.268193] [DEBUG] [MAIN ] PKG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:08.270228] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39209 primary records. [2025-09-24T22:25:08.270885] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-24T22:25:08.286565] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-24T22:25:08.288247] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-24T22:25:08.290253] [INFO ] [MAIN ] Derivative Progress: 1457/2075 symbols completed. PK took 1.2s. Estimated remaining: 4m 2s. Rate: 153.5 symbols/min [2025-09-24T22:25:08.293889] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:08.305096] [DEBUG] [LOCAL ] PKST: Loaded 19242 existing records from primary storage. [2025-09-24T22:25:08.305531] [INFO ] [MAIN ] PKST: Loaded 19242 primary data records. [2025-09-24T22:25:08.390594] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-24T22:25:08.422694] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-24T22:25:08.441262] [INFO ] [MAIN ] Derivative Progress: 1458/2075 symbols completed. PKG took 1.4s. Estimated remaining: 4m 1s. Rate: 153.6 symbols/min [2025-09-24T22:25:08.441618] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:08.447531] [DEBUG] [LOCAL ] PKX: Loaded 24908 existing records from primary storage. [2025-09-24T22:25:08.454265] [INFO ] [MAIN ] PKX: Loaded 24908 primary data records. [2025-09-24T22:25:09.039875] [DEBUG] [LOCAL ] PL: Loaded 53114 existing records from primary storage. [2025-09-24T22:25:09.040485] [INFO ] [MAIN ] PL: Loaded 53114 primary data records. [2025-09-24T22:25:09.194427] [DEBUG] [MAIN ] PKST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:09.245825] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 19242 primary records. [2025-09-24T22:25:09.399491] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-24T22:25:09.435356] [DEBUG] [MAIN ] PKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:09.440931] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 24908 primary records. [2025-09-24T22:25:09.441283] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-24T22:25:09.464023] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-24T22:25:09.465461] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-24T22:25:09.468331] [INFO ] [MAIN ] Derivative Progress: 1459/2075 symbols completed. PKST took 1.2s. Estimated remaining: 4m 1s. Rate: 153.4 symbols/min [2025-09-24T22:25:09.465955] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-24T22:25:09.468904] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-24T22:25:09.469098] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:09.471984] [INFO ] [MAIN ] Derivative Progress: 1460/2075 symbols completed. PKX took 1.2s. Estimated remaining: 4m 0s. Rate: 153.5 symbols/min [2025-09-24T22:25:09.472356] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:09.492285] [DEBUG] [MAIN ] PL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:09.492998] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53114 primary records. [2025-09-24T22:25:09.493186] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-24T22:25:09.523506] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-24T22:25:09.523674] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-24T22:25:09.526073] [INFO ] [MAIN ] Derivative Progress: 1461/2075 symbols completed. PL took 1.1s. Estimated remaining: 3m 60s. Rate: 153.6 symbols/min [2025-09-24T22:25:09.526385] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:09.570103] [DEBUG] [LOCAL ] PLOW: Loaded 20546 existing records from primary storage. [2025-09-24T22:25:09.570272] [INFO ] [MAIN ] PLOW: Loaded 20546 primary data records. [2025-09-24T22:25:09.714353] [DEBUG] [LOCAL ] PLNT: Loaded 48440 existing records from primary storage. [2025-09-24T22:25:09.715613] [DEBUG] [LOCAL ] PLD: Loaded 53466 existing records from primary storage. [2025-09-24T22:25:09.726247] [INFO ] [MAIN ] PLNT: Loaded 48440 primary data records. [2025-09-24T22:25:09.721070] [INFO ] [MAIN ] PLD: Loaded 53466 primary data records. [2025-09-24T22:25:10.612372] [DEBUG] [MAIN ] PLOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:10.615999] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20546 primary records. [2025-09-24T22:25:10.616112] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-24T22:25:10.648391] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-24T22:25:10.643120] [DEBUG] [MAIN ] PLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:10.648636] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-24T22:25:10.651600] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53466 primary records. [2025-09-24T22:25:10.651746] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-24T22:25:10.650563] [INFO ] [MAIN ] Derivative Progress: 1462/2075 symbols completed. PLOW took 1.1s. Estimated remaining: 3m 60s. Rate: 153.4 symbols/min [2025-09-24T22:25:10.660589] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:10.673840] [DEBUG] [MAIN ] PLNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:10.678719] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48440 primary records. [2025-09-24T22:25:10.679594] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-24T22:25:10.697628] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-24T22:25:10.698434] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-24T22:25:10.701791] [INFO ] [MAIN ] Derivative Progress: 1463/2075 symbols completed. PLD took 1.2s. Estimated remaining: 3m 59s. Rate: 153.5 symbols/min [2025-09-24T22:25:10.702380] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:10.709593] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-09-24T22:25:10.709778] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-24T22:25:10.712592] [INFO ] [MAIN ] Derivative Progress: 1464/2075 symbols completed. PLNT took 1.2s. Estimated remaining: 3m 59s. Rate: 153.6 symbols/min [2025-09-24T22:25:10.713147] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:10.742055] [DEBUG] [LOCAL ] PLYM: Loaded 33329 existing records from primary storage. [2025-09-24T22:25:10.742306] [INFO ] [MAIN ] PLYM: Loaded 33329 primary data records. [2025-09-24T22:25:10.785814] [DEBUG] [LOCAL ] PMM: Loaded 10586 existing records from primary storage. [2025-09-24T22:25:10.785529] [DEBUG] [LOCAL ] PML: Loaded 20566 existing records from primary storage. [2025-09-24T22:25:10.786026] [INFO ] [MAIN ] PML: Loaded 20566 primary data records. [2025-09-24T22:25:10.786206] [INFO ] [MAIN ] PMM: Loaded 10586 primary data records. [2025-09-24T22:25:11.764164] [DEBUG] [MAIN ] PLYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:11.765817] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33329 primary records. [2025-09-24T22:25:11.766632] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-24T22:25:11.796776] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:11.809581] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20566 primary records. [2025-09-24T22:25:11.810616] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-24T22:25:11.811040] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:11.813336] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10586 primary records. [2025-09-24T22:25:11.813858] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-24T22:25:11.822843] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-24T22:25:11.822948] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-24T22:25:11.835827] [INFO ] [MAIN ] Derivative Progress: 1465/2075 symbols completed. PLYM took 1.2s. Estimated remaining: 3m 59s. Rate: 153.4 symbols/min [2025-09-24T22:25:11.839262] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:11.846723] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-24T22:25:11.846919] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-24T22:25:11.849959] [INFO ] [MAIN ] Derivative Progress: 1466/2075 symbols completed. PMM took 1.1s. Estimated remaining: 3m 58s. Rate: 153.5 symbols/min [2025-09-24T22:25:11.850952] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:11.856219] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-24T22:25:11.856317] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-24T22:25:11.859381] [INFO ] [MAIN ] Derivative Progress: 1467/2075 symbols completed. PML took 1.2s. Estimated remaining: 3m 58s. Rate: 153.6 symbols/min [2025-09-24T22:25:11.859708] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:11.864972] [DEBUG] [LOCAL ] PMO: Loaded 10360 existing records from primary storage. [2025-09-24T22:25:11.865148] [INFO ] [MAIN ] PMO: Loaded 10360 primary data records. [2025-09-24T22:25:11.974460] [DEBUG] [LOCAL ] PNI: Loaded 6684 existing records from primary storage. [2025-09-24T22:25:11.988363] [INFO ] [MAIN ] PNI: Loaded 6684 primary data records. [2025-09-24T22:25:12.346817] [DEBUG] [LOCAL ] PMT: Loaded 40293 existing records from primary storage. [2025-09-24T22:25:12.382284] [INFO ] [MAIN ] PMT: Loaded 40293 primary data records. [2025-09-24T22:25:12.864593] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:12.866353] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10360 primary records. [2025-09-24T22:25:12.866789] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-24T22:25:12.887593] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-24T22:25:12.888155] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-24T22:25:12.890505] [INFO ] [MAIN ] Derivative Progress: 1468/2075 symbols completed. PMO took 1.1s. Estimated remaining: 3m 57s. Rate: 153.4 symbols/min [2025-09-24T22:25:12.903271] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:12.904095] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6684 primary records. [2025-09-24T22:25:12.904251] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-24T22:25:12.933297] [DEBUG] [MAIN ] PMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:12.934432] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40293 primary records. [2025-09-24T22:25:12.934739] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-24T22:25:12.934847] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-24T22:25:12.937417] [INFO ] [MAIN ] Derivative Progress: 1469/2075 symbols completed. PNI took 1.1s. Estimated remaining: 3m 57s. Rate: 153.5 symbols/min [2025-09-24T22:25:12.937503] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-24T22:25:12.953528] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-24T22:25:12.953593] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-24T22:25:12.956133] [INFO ] [MAIN ] Derivative Progress: 1470/2075 symbols completed. PMT took 1.1s. Estimated remaining: 3m 56s. Rate: 153.6 symbols/min [2025-09-24T22:25:12.956845] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:12.956973] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:12.957064] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:12.990775] [DEBUG] [LOCAL ] PNNT: Loaded 32877 existing records from primary storage. [2025-09-24T22:25:12.991018] [INFO ] [MAIN ] PNNT: Loaded 32877 primary data records. [2025-09-24T22:25:13.148398] [DEBUG] [LOCAL ] POR: Loaded 47037 existing records from primary storage. [2025-09-24T22:25:13.154276] [INFO ] [MAIN ] POR: Loaded 47037 primary data records. [2025-09-24T22:25:13.160479] [DEBUG] [LOCAL ] PNW: Loaded 45836 existing records from primary storage. [2025-09-24T22:25:13.165934] [INFO ] [MAIN ] PNW: Loaded 45836 primary data records. [2025-09-24T22:25:14.066247] [DEBUG] [MAIN ] PNNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:14.068159] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32877 primary records. [2025-09-24T22:25:14.068431] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-24T22:25:14.100639] [DEBUG] [MAIN ] PNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:14.114136] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45836 primary records. [2025-09-24T22:25:14.115997] [DEBUG] [MAIN ] POR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:14.116944] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 47037 primary records. [2025-09-24T22:25:14.115674] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-24T22:25:14.117588] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-24T22:25:14.119048] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-24T22:25:14.119535] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-24T22:25:14.123136] [INFO ] [MAIN ] Derivative Progress: 1471/2075 symbols completed. PNNT took 1.2s. Estimated remaining: 3m 56s. Rate: 153.4 symbols/min [2025-09-24T22:25:14.143979] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:14.152774] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-24T22:25:14.153404] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-24T22:25:14.156343] [INFO ] [MAIN ] Derivative Progress: 1472/2075 symbols completed. PNW took 1.2s. Estimated remaining: 3m 56s. Rate: 153.5 symbols/min [2025-09-24T22:25:14.157151] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:14.165637] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-09-24T22:25:14.165853] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-24T22:25:14.168778] [INFO ] [MAIN ] Derivative Progress: 1473/2075 symbols completed. POR took 1.2s. Estimated remaining: 3m 55s. Rate: 153.6 symbols/min [2025-09-24T22:25:14.169208] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:14.209842] [DEBUG] [LOCAL ] PPT: Loaded 20056 existing records from primary storage. [2025-09-24T22:25:14.209986] [INFO ] [MAIN ] PPT: Loaded 20056 primary data records. [2025-09-24T22:25:14.351933] [DEBUG] [LOCAL ] POST: Loaded 38921 existing records from primary storage. [2025-09-24T22:25:14.366572] [INFO ] [MAIN ] POST: Loaded 38921 primary data records. [2025-09-24T22:25:14.394671] [DEBUG] [LOCAL ] PPG: Loaded 50693 existing records from primary storage. [2025-09-24T22:25:14.424723] [INFO ] [MAIN ] PPG: Loaded 50693 primary data records. [2025-09-24T22:25:15.288991] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:15.290944] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20056 primary records. [2025-09-24T22:25:15.291316] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-24T22:25:15.318289] [DEBUG] [MAIN ] POST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:15.320507] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38921 primary records. [2025-09-24T22:25:15.321112] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-24T22:25:15.335450] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-24T22:25:15.342962] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-24T22:25:15.342860] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-24T22:25:15.343142] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-24T22:25:15.353058] [INFO ] [MAIN ] Derivative Progress: 1474/2075 symbols completed. PPT took 1.2s. Estimated remaining: 3m 55s. Rate: 153.4 symbols/min [2025-09-24T22:25:15.361373] [DEBUG] [MAIN ] PPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:15.361456] [INFO ] [MAIN ] Derivative Progress: 1475/2075 symbols completed. POST took 1.2s. Estimated remaining: 3m 55s. Rate: 153.5 symbols/min [2025-09-24T22:25:15.362422] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50693 primary records. [2025-09-24T22:25:15.362785] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-24T22:25:15.362684] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:15.364064] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:15.381031] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-24T22:25:15.381341] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-24T22:25:15.384017] [INFO ] [MAIN ] Derivative Progress: 1476/2075 symbols completed. PPG took 1.2s. Estimated remaining: 3m 54s. Rate: 153.6 symbols/min [2025-09-24T22:25:15.384396] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:15.430348] [DEBUG] [LOCAL ] PRA: Loaded 34901 existing records from primary storage. [2025-09-24T22:25:15.430639] [INFO ] [MAIN ] PRA: Loaded 34901 primary data records. [2025-09-24T22:25:15.537899] [DEBUG] [LOCAL ] PRG: Loaded 30048 existing records from primary storage. [2025-09-24T22:25:15.580776] [INFO ] [MAIN ] PRG: Loaded 30048 primary data records. [2025-09-24T22:25:15.582246] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-24T22:25:15.603289] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-24T22:25:16.549187] [DEBUG] [MAIN ] PRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:16.550287] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34901 primary records. [2025-09-24T22:25:16.550634] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-24T22:25:16.586513] [DEBUG] [MAIN ] PRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:16.591136] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 30048 primary records. [2025-09-24T22:25:16.590555] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-24T22:25:16.592174] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-24T22:25:16.592279] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-24T22:25:16.595338] [INFO ] [MAIN ] Derivative Progress: 1477/2075 symbols completed. PRA took 1.2s. Estimated remaining: 3m 54s. Rate: 153.4 symbols/min [2025-09-24T22:25:16.595678] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:16.624120] [DEBUG] [MAIN ] PR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:16.627698] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-24T22:25:16.629429] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-24T22:25:16.631366] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-24T22:25:16.631773] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-24T22:25:16.643377] [INFO ] [MAIN ] Derivative Progress: 1478/2075 symbols completed. PRG took 1.3s. Estimated remaining: 3m 53s. Rate: 153.5 symbols/min [2025-09-24T22:25:16.645128] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:16.660799] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-24T22:25:16.660684] [DEBUG] [LOCAL ] PRH: Loaded 4870 existing records from primary storage. [2025-09-24T22:25:16.661042] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-24T22:25:16.664017] [INFO ] [MAIN ] PRH: Loaded 4870 primary data records. [2025-09-24T22:25:16.663835] [INFO ] [MAIN ] Derivative Progress: 1479/2075 symbols completed. PR took 1.3s. Estimated remaining: 3m 53s. Rate: 153.5 symbols/min [2025-09-24T22:25:16.682483] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:16.848677] [DEBUG] [LOCAL ] PRGO: Loaded 46894 existing records from primary storage. [2025-09-24T22:25:16.855582] [INFO ] [MAIN ] PRGO: Loaded 46894 primary data records. [2025-09-24T22:25:16.861349] [DEBUG] [LOCAL ] PRI: Loaded 18455 existing records from primary storage. [2025-09-24T22:25:16.872715] [INFO ] [MAIN ] PRI: Loaded 18455 primary data records. [2025-09-24T22:25:17.696213] [DEBUG] [MAIN ] PRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:17.698313] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4870 primary records. [2025-09-24T22:25:17.698777] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-24T22:25:17.725706] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-24T22:25:17.731871] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-24T22:25:17.731768] [DEBUG] [MAIN ] PRGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:17.734080] [INFO ] [MAIN ] Derivative Progress: 1480/2075 symbols completed. PRH took 1.1s. Estimated remaining: 3m 53s. Rate: 153.4 symbols/min [2025-09-24T22:25:17.735456] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46894 primary records. [2025-09-24T22:25:17.735827] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:17.736014] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-24T22:25:17.755438] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-24T22:25:17.755799] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-24T22:25:17.758590] [INFO ] [MAIN ] Derivative Progress: 1481/2075 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 52s. Rate: 153.5 symbols/min [2025-09-24T22:25:17.771113] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:17.771889] [DEBUG] [MAIN ] PRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:17.772527] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18455 primary records. [2025-09-24T22:25:17.772746] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-24T22:25:17.789027] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-24T22:25:17.789259] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-24T22:25:17.792003] [INFO ] [MAIN ] Derivative Progress: 1482/2075 symbols completed. PRI took 1.1s. Estimated remaining: 3m 52s. Rate: 153.6 symbols/min [2025-09-24T22:25:17.792312] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:17.822034] [DEBUG] [LOCAL ] PRIM: Loaded 44489 existing records from primary storage. [2025-09-24T22:25:17.822313] [INFO ] [MAIN ] PRIM: Loaded 44489 primary data records. [2025-09-24T22:25:17.924217] [DEBUG] [LOCAL ] PRLB: Loaded 20688 existing records from primary storage. [2025-09-24T22:25:17.934762] [INFO ] [MAIN ] PRLB: Loaded 20688 primary data records. [2025-09-24T22:25:18.067043] [DEBUG] [LOCAL ] PRKS: Loaded 42703 existing records from primary storage. [2025-09-24T22:25:18.117035] [INFO ] [MAIN ] PRKS: Loaded 42703 primary data records. [2025-09-24T22:25:18.831673] [DEBUG] [MAIN ] PRLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:18.832828] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20688 primary records. [2025-09-24T22:25:18.833172] [DEBUG] [MAIN ] PRIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:18.834215] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44489 primary records. [2025-09-24T22:25:18.833278] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-24T22:25:18.834491] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-24T22:25:18.853359] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-24T22:25:18.860845] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-24T22:25:18.864417] [INFO ] [MAIN ] Derivative Progress: 1483/2075 symbols completed. PRLB took 1.1s. Estimated remaining: 3m 52s. Rate: 153.4 symbols/min [2025-09-24T22:25:18.880972] [DEBUG] [MAIN ] PRKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:18.882367] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42703 primary records. [2025-09-24T22:25:18.882736] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-24T22:25:18.901634] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-24T22:25:18.902239] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-24T22:25:18.904506] [INFO ] [MAIN ] Derivative Progress: 1484/2075 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 51s. Rate: 153.5 symbols/min [2025-09-24T22:25:18.905413] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-24T22:25:18.905481] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-24T22:25:18.908381] [INFO ] [MAIN ] Derivative Progress: 1485/2075 symbols completed. PRKS took 1.1s. Estimated remaining: 3m 51s. Rate: 153.6 symbols/min [2025-09-24T22:25:18.909120] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:18.909027] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:18.909301] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:18.990973] [DEBUG] [LOCAL ] PRM: Loaded 44602 existing records from primary storage. [2025-09-24T22:25:18.992178] [INFO ] [MAIN ] PRM: Loaded 44602 primary data records. [2025-09-24T22:25:18.992969] [DEBUG] [LOCAL ] PRO: Loaded 37725 existing records from primary storage. [2025-09-24T22:25:19.019734] [INFO ] [MAIN ] PRO: Loaded 37725 primary data records. [2025-09-24T22:25:19.209123] [DEBUG] [LOCAL ] PRMB: Loaded 53167 existing records from primary storage. [2025-09-24T22:25:19.243769] [INFO ] [MAIN ] PRMB: Loaded 53167 primary data records. [2025-09-24T22:25:20.018560] [DEBUG] [MAIN ] PRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:20.020365] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44602 primary records. [2025-09-24T22:25:20.020553] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-24T22:25:20.045583] [DEBUG] [MAIN ] PRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:20.047782] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 37725 primary records. [2025-09-24T22:25:20.049004] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-24T22:25:20.060092] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-24T22:25:20.064017] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-24T22:25:20.072012] [INFO ] [MAIN ] Derivative Progress: 1486/2075 symbols completed. PRM took 1.2s. Estimated remaining: 3m 50s. Rate: 153.4 symbols/min [2025-09-24T22:25:20.072875] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-24T22:25:20.073018] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-24T22:25:20.073333] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:20.084699] [INFO ] [MAIN ] Derivative Progress: 1487/2075 symbols completed. PRO took 1.2s. Estimated remaining: 3m 50s. Rate: 153.5 symbols/min [2025-09-24T22:25:20.090092] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:20.091244] [DEBUG] [MAIN ] PRMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:20.105754] [DEBUG] [LOCAL ] PRT: Loaded 5333 existing records from primary storage. [2025-09-24T22:25:20.105972] [INFO ] [MAIN ] PRT: Loaded 5333 primary data records. [2025-09-24T22:25:20.092250] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53167 primary records. [2025-09-24T22:25:20.111342] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-24T22:25:20.297815] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-24T22:25:20.338504] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-24T22:25:20.466811] [INFO ] [MAIN ] Derivative Progress: 1488/2075 symbols completed. PRMB took 1.6s. Estimated remaining: 3m 49s. Rate: 153.5 symbols/min [2025-09-24T22:25:20.467998] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:20.492379] [DEBUG] [LOCAL ] PRU: Loaded 51465 existing records from primary storage. [2025-09-24T22:25:20.493081] [INFO ] [MAIN ] PRU: Loaded 51465 primary data records. [2025-09-24T22:25:20.829809] [DEBUG] [LOCAL ] PSA: Loaded 41843 existing records from primary storage. [2025-09-24T22:25:20.831038] [INFO ] [MAIN ] PSA: Loaded 41843 primary data records. [2025-09-24T22:25:20.934265] [DEBUG] [MAIN ] PRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:20.958602] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5333 primary records. [2025-09-24T22:25:20.958890] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-24T22:25:21.182057] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-24T22:25:21.182302] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-24T22:25:21.184466] [INFO ] [MAIN ] Derivative Progress: 1489/2075 symbols completed. PRT took 1.1s. Estimated remaining: 3m 49s. Rate: 153.4 symbols/min [2025-09-24T22:25:21.185841] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:21.203430] [DEBUG] [MAIN ] PRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:21.206331] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51465 primary records. [2025-09-24T22:25:21.206830] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-24T22:25:21.221550] [DEBUG] [LOCAL ] PSBD: Loaded 6921 existing records from primary storage. [2025-09-24T22:25:21.224418] [INFO ] [MAIN ] PSBD: Loaded 6921 primary data records. [2025-09-24T22:25:21.306072] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-24T22:25:21.340479] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-24T22:25:21.358060] [INFO ] [MAIN ] Derivative Progress: 1490/2075 symbols completed. PRU took 1.3s. Estimated remaining: 3m 49s. Rate: 153.4 symbols/min [2025-09-24T22:25:21.374794] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:21.568881] [DEBUG] [MAIN ] PSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:21.570266] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41843 primary records. [2025-09-24T22:25:21.570504] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-24T22:25:21.575388] [DEBUG] [LOCAL ] PSF: Loaded 6776 existing records from primary storage. [2025-09-24T22:25:21.583329] [INFO ] [MAIN ] PSF: Loaded 6776 primary data records. [2025-09-24T22:25:21.714084] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-24T22:25:21.714411] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-24T22:25:21.717197] [INFO ] [MAIN ] Derivative Progress: 1491/2075 symbols completed. PSA took 1.2s. Estimated remaining: 3m 48s. Rate: 153.5 symbols/min [2025-09-24T22:25:21.728445] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:21.995350] [DEBUG] [MAIN ] PSBD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:25:21.996476] [INFO ] [MAIN ] PSBD: Generated 1793 derivative records from 6921 primary records. [2025-09-24T22:25:21.997093] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-24T22:25:22.008808] [DEBUG] [LOCAL ] PSFE: Loaded 30406 existing records from primary storage. [2025-09-24T22:25:22.015819] [INFO ] [MAIN ] PSFE: Loaded 30406 primary data records. [2025-09-24T22:25:22.151274] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1793 records). [2025-09-24T22:25:22.203669] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-24T22:25:22.210800] [INFO ] [MAIN ] Derivative Progress: 1492/2075 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 48s. Rate: 153.4 symbols/min [2025-09-24T22:25:22.340090] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:22.341411] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:22.342314] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6776 primary records. [2025-09-24T22:25:22.342819] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-24T22:25:22.365201] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-24T22:25:22.365447] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-24T22:25:22.367981] [INFO ] [MAIN ] Derivative Progress: 1493/2075 symbols completed. PSF took 1.0s. Estimated remaining: 3m 48s. Rate: 153.5 symbols/min [2025-09-24T22:25:22.368368] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:22.402301] [DEBUG] [MAIN ] PSFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:22.403308] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30406 primary records. [2025-09-24T22:25:22.403500] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-24T22:25:22.441562] [DEBUG] [LOCAL ] PSN: Loaded 46194 existing records from primary storage. [2025-09-24T22:25:22.442855] [INFO ] [MAIN ] PSN: Loaded 46194 primary data records. [2025-09-24T22:25:22.525025] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-24T22:25:22.537496] [DEBUG] [LOCAL ] PSO: Loaded 37363 existing records from primary storage. [2025-09-24T22:25:22.542796] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-24T22:25:22.551332] [INFO ] [MAIN ] Derivative Progress: 1494/2075 symbols completed. PSFE took 0.8s. Estimated remaining: 3m 47s. Rate: 153.5 symbols/min [2025-09-24T22:25:22.559084] [INFO ] [MAIN ] PSO: Loaded 37363 primary data records. [2025-09-24T22:25:22.599489] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:23.096764] [DEBUG] [LOCAL ] PSQH: Loaded 34746 existing records from primary storage. [2025-09-24T22:25:23.098079] [INFO ] [MAIN ] PSQH: Loaded 34746 primary data records. [2025-09-24T22:25:23.431585] [DEBUG] [MAIN ] PSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:23.433686] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46194 primary records. [2025-09-24T22:25:23.433967] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-24T22:25:23.455210] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-24T22:25:23.455699] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-24T22:25:23.459022] [INFO ] [MAIN ] Derivative Progress: 1495/2075 symbols completed. PSN took 1.1s. Estimated remaining: 3m 47s. Rate: 153.4 symbols/min [2025-09-24T22:25:23.459607] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:23.473288] [DEBUG] [MAIN ] PSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:23.475927] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37363 primary records. [2025-09-24T22:25:23.476127] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-24T22:25:23.497632] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-24T22:25:23.500372] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-24T22:25:23.503116] [INFO ] [MAIN ] Derivative Progress: 1496/2075 symbols completed. PSO took 1.1s. Estimated remaining: 3m 46s. Rate: 153.5 symbols/min [2025-09-24T22:25:23.503515] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:23.517527] [DEBUG] [MAIN ] PSQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:23.518379] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34746 primary records. [2025-09-24T22:25:23.518534] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-24T22:25:23.559303] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-24T22:25:23.568033] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-24T22:25:23.567889] [DEBUG] [LOCAL ] PSTL: Loaded 20371 existing records from primary storage. [2025-09-24T22:25:23.570740] [INFO ] [MAIN ] Derivative Progress: 1497/2075 symbols completed. PSQH took 1.0s. Estimated remaining: 3m 46s. Rate: 153.6 symbols/min [2025-09-24T22:25:23.571400] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:23.571308] [INFO ] [MAIN ] PSTL: Loaded 20371 primary data records. [2025-09-24T22:25:23.626431] [DEBUG] [LOCAL ] PSTG: Loaded 52847 existing records from primary storage. [2025-09-24T22:25:23.665894] [INFO ] [MAIN ] PSTG: Loaded 52847 primary data records. [2025-09-24T22:25:24.307204] [DEBUG] [LOCAL ] PSX: Loaded 53132 existing records from primary storage. [2025-09-24T22:25:24.307883] [INFO ] [MAIN ] PSX: Loaded 53132 primary data records. [2025-09-24T22:25:24.660261] [DEBUG] [MAIN ] PSTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:24.662352] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20371 primary records. [2025-09-24T22:25:24.662452] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-24T22:25:24.695965] [DEBUG] [MAIN ] PSTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:24.695675] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-24T22:25:24.696133] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-24T22:25:24.699045] [INFO ] [MAIN ] Derivative Progress: 1498/2075 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 46s. Rate: 153.4 symbols/min [2025-09-24T22:25:24.697002] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52847 primary records. [2025-09-24T22:25:24.699635] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-24T22:25:24.718771] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-24T22:25:24.718929] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-24T22:25:24.721984] [INFO ] [MAIN ] Derivative Progress: 1499/2075 symbols completed. PSTG took 1.3s. Estimated remaining: 3m 45s. Rate: 153.5 symbols/min [2025-09-24T22:25:24.734603] [DEBUG] [MAIN ] PSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:24.735338] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53132 primary records. [2025-09-24T22:25:24.735401] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-24T22:25:24.751139] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-24T22:25:24.751227] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-24T22:25:24.753434] [INFO ] [MAIN ] Derivative Progress: 1500/2075 symbols completed. PSX took 1.2s. Estimated remaining: 3m 45s. Rate: 153.6 symbols/min [2025-09-24T22:25:24.754192] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:24.754260] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:24.754854] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:24.773622] [DEBUG] [LOCAL ] PTA: Loaded 15059 existing records from primary storage. [2025-09-24T22:25:24.773802] [INFO ] [MAIN ] PTA: Loaded 15059 primary data records. [2025-09-24T22:25:25.093526] [DEBUG] [LOCAL ] PTY: Loaded 37399 existing records from primary storage. [2025-09-24T22:25:25.120628] [INFO ] [MAIN ] PTY: Loaded 37399 primary data records. [2025-09-24T22:25:25.127221] [DEBUG] [LOCAL ] PUK: Loaded 44895 existing records from primary storage. [2025-09-24T22:25:25.133047] [INFO ] [MAIN ] PUK: Loaded 44895 primary data records. [2025-09-24T22:25:25.763791] [DEBUG] [MAIN ] PTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:25.764623] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 15059 primary records. [2025-09-24T22:25:25.764976] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-24T22:25:25.782341] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-24T22:25:25.784886] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-24T22:25:25.787429] [INFO ] [MAIN ] Derivative Progress: 1501/2075 symbols completed. PTA took 1.0s. Estimated remaining: 3m 44s. Rate: 153.4 symbols/min [2025-09-24T22:25:25.788005] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:25.803754] [DEBUG] [MAIN ] PTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:25.804546] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37399 primary records. [2025-09-24T22:25:25.804751] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-24T22:25:25.827521] [DEBUG] [MAIN ] PUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:25.831213] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44895 primary records. [2025-09-24T22:25:25.832246] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-24T22:25:25.836377] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-24T22:25:25.836856] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-24T22:25:25.839223] [INFO ] [MAIN ] Derivative Progress: 1502/2075 symbols completed. PTY took 1.1s. Estimated remaining: 3m 44s. Rate: 153.5 symbols/min [2025-09-24T22:25:25.839881] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:25.857383] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-24T22:25:25.857564] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-24T22:25:25.860076] [INFO ] [MAIN ] Derivative Progress: 1503/2075 symbols completed. PUK took 1.1s. Estimated remaining: 3m 43s. Rate: 153.6 symbols/min [2025-09-24T22:25:25.860468] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:25.880952] [DEBUG] [LOCAL ] PVL: Loaded 4745 existing records from primary storage. [2025-09-24T22:25:25.881131] [INFO ] [MAIN ] PVL: Loaded 4745 primary data records. [2025-09-24T22:25:26.032269] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-09-24T22:25:26.063339] [INFO ] [MAIN ] PUMP: Loaded 49434 primary data records. [2025-09-24T22:25:26.173871] [DEBUG] [LOCAL ] PVH: Loaded 50466 existing records from primary storage. [2025-09-24T22:25:26.337981] [INFO ] [MAIN ] PVH: Loaded 50466 primary data records. [2025-09-24T22:25:26.940596] [DEBUG] [MAIN ] PVL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:26.942123] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4745 primary records. [2025-09-24T22:25:26.942830] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-24T22:25:26.968353] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-24T22:25:26.969938] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-24T22:25:26.975396] [INFO ] [MAIN ] Derivative Progress: 1504/2075 symbols completed. PVL took 1.1s. Estimated remaining: 3m 43s. Rate: 153.4 symbols/min [2025-09-24T22:25:26.978034] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:27.005627] [DEBUG] [MAIN ] PVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:27.007522] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50466 primary records. [2025-09-24T22:25:27.007790] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-24T22:25:27.006602] [DEBUG] [MAIN ] PUMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:27.009316] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49434 primary records. [2025-09-24T22:25:27.010150] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-24T22:25:27.043959] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-24T22:25:27.044971] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-24T22:25:27.047673] [INFO ] [MAIN ] Derivative Progress: 1505/2075 symbols completed. PVH took 1.2s. Estimated remaining: 3m 43s. Rate: 153.5 symbols/min [2025-09-24T22:25:27.048441] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:27.049736] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-24T22:25:27.050397] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-24T22:25:27.053514] [INFO ] [MAIN ] Derivative Progress: 1506/2075 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 42s. Rate: 153.6 symbols/min [2025-09-24T22:25:27.054418] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:27.117545] [DEBUG] [LOCAL ] PWR: Loaded 47367 existing records from primary storage. [2025-09-24T22:25:27.117886] [INFO ] [MAIN ] PWR: Loaded 47367 primary data records. [2025-09-24T22:25:27.118500] [DEBUG] [LOCAL ] PX: Loaded 34711 existing records from primary storage. [2025-09-24T22:25:27.140087] [INFO ] [MAIN ] PX: Loaded 34711 primary data records. [2025-09-24T22:25:27.232065] [DEBUG] [LOCAL ] QD: Loaded 28012 existing records from primary storage. [2025-09-24T22:25:27.292253] [INFO ] [MAIN ] QD: Loaded 28012 primary data records. [2025-09-24T22:25:28.186247] [DEBUG] [MAIN ] PWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:28.188967] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47367 primary records. [2025-09-24T22:25:28.190765] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-24T22:25:28.218774] [DEBUG] [MAIN ] QD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:28.227786] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 28012 primary records. [2025-09-24T22:25:28.233943] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-24T22:25:28.234270] [DEBUG] [MAIN ] PX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:28.237266] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34711 primary records. [2025-09-24T22:25:28.244890] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-24T22:25:28.250467] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-24T22:25:28.250803] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-24T22:25:28.253739] [INFO ] [MAIN ] Derivative Progress: 1507/2075 symbols completed. PWR took 1.3s. Estimated remaining: 3m 42s. Rate: 153.4 symbols/min [2025-09-24T22:25:28.262360] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:28.274300] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-24T22:25:28.275311] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-24T22:25:28.276171] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-24T22:25:28.276343] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-24T22:25:28.278736] [INFO ] [MAIN ] Derivative Progress: 1508/2075 symbols completed. QD took 1.2s. Estimated remaining: 3m 42s. Rate: 153.5 symbols/min [2025-09-24T22:25:28.283080] [INFO ] [MAIN ] Derivative Progress: 1509/2075 symbols completed. PX took 1.2s. Estimated remaining: 3m 41s. Rate: 153.6 symbols/min [2025-09-24T22:25:28.283011] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:28.283585] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:28.329639] [DEBUG] [LOCAL ] QGEN: Loaded 49151 existing records from primary storage. [2025-09-24T22:25:28.330093] [INFO ] [MAIN ] QGEN: Loaded 49151 primary data records. [2025-09-24T22:25:28.569107] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-24T22:25:28.569379] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-24T22:25:28.798011] [DEBUG] [LOCAL ] QSR: Loaded 52405 existing records from primary storage. [2025-09-24T22:25:28.809426] [INFO ] [MAIN ] QSR: Loaded 52405 primary data records. [2025-09-24T22:25:29.345125] [DEBUG] [MAIN ] QGEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:29.346045] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49151 primary records. [2025-09-24T22:25:29.346563] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-24T22:25:29.369011] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-24T22:25:29.369319] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-24T22:25:29.371720] [INFO ] [MAIN ] Derivative Progress: 1510/2075 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 41s. Rate: 153.4 symbols/min [2025-09-24T22:25:29.387229] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:29.387706] [DEBUG] [MAIN ] QS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:29.389037] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-24T22:25:29.389270] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-24T22:25:29.410838] [DEBUG] [MAIN ] QSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:29.416147] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52405 primary records. [2025-09-24T22:25:29.416464] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-24T22:25:29.428033] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-24T22:25:29.433404] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-24T22:25:29.436417] [INFO ] [MAIN ] Derivative Progress: 1511/2075 symbols completed. QS took 1.2s. Estimated remaining: 3m 40s. Rate: 153.5 symbols/min [2025-09-24T22:25:29.439184] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:29.439111] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-24T22:25:29.439977] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-24T22:25:29.442801] [INFO ] [MAIN ] Derivative Progress: 1512/2075 symbols completed. QSR took 1.2s. Estimated remaining: 3m 40s. Rate: 153.6 symbols/min [2025-09-24T22:25:29.443197] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:29.463218] [DEBUG] [LOCAL ] QVCC: Loaded 8904 existing records from primary storage. [2025-09-24T22:25:29.463592] [INFO ] [MAIN ] QVCC: Loaded 8904 primary data records. [2025-09-24T22:25:29.563008] [DEBUG] [LOCAL ] QTWO: Loaded 39066 existing records from primary storage. [2025-09-24T22:25:29.568547] [INFO ] [MAIN ] QTWO: Loaded 39066 primary data records. [2025-09-24T22:25:29.626381] [DEBUG] [LOCAL ] QUAD: Loaded 23702 existing records from primary storage. [2025-09-24T22:25:29.656298] [INFO ] [MAIN ] QUAD: Loaded 23702 primary data records. [2025-09-24T22:25:30.510996] [DEBUG] [MAIN ] QVCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:30.513817] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8904 primary records. [2025-09-24T22:25:30.514180] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-24T22:25:30.542696] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-24T22:25:30.543132] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-24T22:25:30.546842] [INFO ] [MAIN ] Derivative Progress: 1513/2075 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 40s. Rate: 153.4 symbols/min [2025-09-24T22:25:30.547746] [DEBUG] [MAIN ] QTWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:30.548672] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39066 primary records. [2025-09-24T22:25:30.560784] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-24T22:25:30.561279] [DEBUG] [MAIN ] QUAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:30.562257] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23702 primary records. [2025-09-24T22:25:30.562526] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-24T22:25:30.590735] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-24T22:25:30.590841] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-24T22:25:30.593181] [INFO ] [MAIN ] Derivative Progress: 1514/2075 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 39s. Rate: 153.5 symbols/min [2025-09-24T22:25:30.595495] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-24T22:25:30.595562] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-24T22:25:30.598390] [INFO ] [MAIN ] Derivative Progress: 1515/2075 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 39s. Rate: 153.6 symbols/min [2025-09-24T22:25:30.598960] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:30.599272] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:30.599166] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:30.606474] [DEBUG] [LOCAL ] QVCD: Loaded 4480 existing records from primary storage. [2025-09-24T22:25:30.606629] [INFO ] [MAIN ] QVCD: Loaded 4480 primary data records. [2025-09-24T22:25:30.946665] [DEBUG] [LOCAL ] R: Loaded 29357 existing records from primary storage. [2025-09-24T22:25:30.947087] [INFO ] [MAIN ] R: Loaded 29357 primary data records. [2025-09-24T22:25:31.040037] [DEBUG] [LOCAL ] QXO: Loaded 53184 existing records from primary storage. [2025-09-24T22:25:31.064972] [INFO ] [MAIN ] QXO: Loaded 53184 primary data records. [2025-09-24T22:25:31.643575] [DEBUG] [MAIN ] QVCD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:25:31.646634] [INFO ] [MAIN ] QVCD: Generated 1793 derivative records from 4480 primary records. [2025-09-24T22:25:31.646823] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-24T22:25:31.665874] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1793 records). [2025-09-24T22:25:31.666167] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-24T22:25:31.668801] [INFO ] [MAIN ] Derivative Progress: 1516/2075 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 39s. Rate: 153.4 symbols/min [2025-09-24T22:25:31.669748] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:31.690488] [DEBUG] [MAIN ] R: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:31.691357] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29357 primary records. [2025-09-24T22:25:31.691682] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-24T22:25:31.727366] [DEBUG] [LOCAL ] RA: Loaded 21573 existing records from primary storage. [2025-09-24T22:25:31.728264] [INFO ] [MAIN ] RA: Loaded 21573 primary data records. [2025-09-24T22:25:31.730055] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-24T22:25:31.755377] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-24T22:25:31.790090] [INFO ] [MAIN ] Derivative Progress: 1517/2075 symbols completed. R took 1.2s. Estimated remaining: 3m 38s. Rate: 153.5 symbols/min [2025-09-24T22:25:31.787606] [DEBUG] [MAIN ] QXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:25:31.829429] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:31.829700] [INFO ] [MAIN ] QXO: Generated 1793 derivative records from 53184 primary records. [2025-09-24T22:25:31.851639] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-24T22:25:31.946635] [DEBUG] [LOCAL ] QXO: Derivative data saved (1793 records). [2025-09-24T22:25:31.946798] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-24T22:25:31.984031] [INFO ] [MAIN ] Derivative Progress: 1518/2075 symbols completed. QXO took 1.4s. Estimated remaining: 3m 38s. Rate: 153.5 symbols/min [2025-09-24T22:25:31.999895] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:32.091306] [DEBUG] [LOCAL ] RACE: Loaded 32896 existing records from primary storage. [2025-09-24T22:25:32.091566] [INFO ] [MAIN ] RACE: Loaded 32896 primary data records. [2025-09-24T22:25:32.258023] [DEBUG] [LOCAL ] RAMP: Loaded 37712 existing records from primary storage. [2025-09-24T22:25:32.280386] [INFO ] [MAIN ] RAMP: Loaded 37712 primary data records. [2025-09-24T22:25:32.383223] [DEBUG] [MAIN ] RA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:32.462274] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21573 primary records. [2025-09-24T22:25:32.534341] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-24T22:25:32.635019] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-24T22:25:32.641468] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-24T22:25:32.655288] [INFO ] [MAIN ] Derivative Progress: 1519/2075 symbols completed. RA took 1.0s. Estimated remaining: 3m 37s. Rate: 153.5 symbols/min [2025-09-24T22:25:32.656246] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:32.881293] [DEBUG] [MAIN ] RACE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:32.883875] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32896 primary records. [2025-09-24T22:25:32.884104] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-24T22:25:32.914831] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-24T22:25:32.914998] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-24T22:25:32.917717] [INFO ] [MAIN ] Derivative Progress: 1520/2075 symbols completed. RACE took 1.1s. Estimated remaining: 3m 37s. Rate: 153.5 symbols/min [2025-09-24T22:25:32.918448] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:32.936134] [DEBUG] [MAIN ] RAMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:32.937170] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37712 primary records. [2025-09-24T22:25:32.937294] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-24T22:25:32.977858] [DEBUG] [LOCAL ] RBA: Loaded 45942 existing records from primary storage. [2025-09-24T22:25:32.988485] [INFO ] [MAIN ] RBA: Loaded 45942 primary data records. [2025-09-24T22:25:32.988911] [DEBUG] [LOCAL ] RBC: Loaded 15155 existing records from primary storage. [2025-09-24T22:25:32.989028] [INFO ] [MAIN ] RBC: Loaded 15155 primary data records. [2025-09-24T22:25:32.988292] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-24T22:25:32.989455] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-24T22:25:33.025001] [INFO ] [MAIN ] Derivative Progress: 1521/2075 symbols completed. RAMP took 1.0s. Estimated remaining: 3m 36s. Rate: 153.6 symbols/min [2025-09-24T22:25:33.072037] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:33.210358] [DEBUG] [LOCAL ] RBOT: Loaded 5058 existing records from primary storage. [2025-09-24T22:25:33.226481] [INFO ] [MAIN ] RBOT: Loaded 5058 primary data records. [2025-09-24T22:25:33.991959] [DEBUG] [MAIN ] RBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:33.997461] [DEBUG] [MAIN ] RBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:33.998432] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 45942 primary records. [2025-09-24T22:25:33.999319] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15155 primary records. [2025-09-24T22:25:33.999564] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-24T22:25:34.000393] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-24T22:25:34.031412] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-24T22:25:34.033685] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-24T22:25:34.036356] [INFO ] [MAIN ] Derivative Progress: 1522/2075 symbols completed. RBA took 1.4s. Estimated remaining: 3m 36s. Rate: 153.4 symbols/min [2025-09-24T22:25:34.051766] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:34.051687] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-24T22:25:34.052449] [DEBUG] [MAIN ] RBOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:34.053638] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5058 primary records. [2025-09-24T22:25:34.052149] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-24T22:25:34.053848] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-24T22:25:34.057032] [INFO ] [MAIN ] Derivative Progress: 1523/2075 symbols completed. RBC took 1.1s. Estimated remaining: 3m 36s. Rate: 153.5 symbols/min [2025-09-24T22:25:34.065012] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:34.073325] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-24T22:25:34.073531] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-24T22:25:34.075992] [INFO ] [MAIN ] Derivative Progress: 1524/2075 symbols completed. RBOT took 1.0s. Estimated remaining: 3m 35s. Rate: 153.6 symbols/min [2025-09-24T22:25:34.076270] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:34.131329] [DEBUG] [LOCAL ] RBRK: Loaded 53117 existing records from primary storage. [2025-09-24T22:25:34.131717] [INFO ] [MAIN ] RBRK: Loaded 53117 primary data records. [2025-09-24T22:25:34.246950] [DEBUG] [LOCAL ] RC: Loaded 48997 existing records from primary storage. [2025-09-24T22:25:34.271511] [INFO ] [MAIN ] RC: Loaded 48997 primary data records. [2025-09-24T22:25:34.459896] [DEBUG] [LOCAL ] RCI: Loaded 48721 existing records from primary storage. [2025-09-24T22:25:34.645712] [INFO ] [MAIN ] RCI: Loaded 48721 primary data records. [2025-09-24T22:25:35.190359] [DEBUG] [MAIN ] RBRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:35.192422] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53117 primary records. [2025-09-24T22:25:35.192914] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-24T22:25:35.213143] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-24T22:25:35.213605] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-24T22:25:35.224678] [INFO ] [MAIN ] Derivative Progress: 1525/2075 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 35s. Rate: 153.4 symbols/min [2025-09-24T22:25:35.225190] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:35.231009] [DEBUG] [MAIN ] RC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:35.231894] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48997 primary records. [2025-09-24T22:25:35.232368] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-24T22:25:35.253661] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-24T22:25:35.254019] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-24T22:25:35.256757] [INFO ] [MAIN ] Derivative Progress: 1526/2075 symbols completed. RC took 1.2s. Estimated remaining: 3m 35s. Rate: 153.5 symbols/min [2025-09-24T22:25:35.265104] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:35.270911] [DEBUG] [MAIN ] RCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:35.277331] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48721 primary records. [2025-09-24T22:25:35.277402] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-24T22:25:35.276195] [DEBUG] [LOCAL ] RCS: Loaded 11437 existing records from primary storage. [2025-09-24T22:25:35.289985] [INFO ] [MAIN ] RCS: Loaded 11437 primary data records. [2025-09-24T22:25:35.299716] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-24T22:25:35.307301] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-24T22:25:35.320854] [INFO ] [MAIN ] Derivative Progress: 1527/2075 symbols completed. RCI took 1.2s. Estimated remaining: 3m 34s. Rate: 153.6 symbols/min [2025-09-24T22:25:35.321213] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:35.513700] [DEBUG] [LOCAL ] RCUS: Loaded 42690 existing records from primary storage. [2025-09-24T22:25:35.628105] [INFO ] [MAIN ] RCUS: Loaded 42690 primary data records. [2025-09-24T22:25:35.978327] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-24T22:25:35.978834] [INFO ] [MAIN ] RDDT: Loaded 53784 primary data records. [2025-09-24T22:25:36.306224] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:36.307284] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11437 primary records. [2025-09-24T22:25:36.307571] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-24T22:25:36.326364] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-24T22:25:36.327168] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-24T22:25:36.329210] [INFO ] [MAIN ] Derivative Progress: 1528/2075 symbols completed. RCS took 1.1s. Estimated remaining: 3m 34s. Rate: 153.4 symbols/min [2025-09-24T22:25:36.347089] [DEBUG] [MAIN ] RCUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:36.348002] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42690 primary records. [2025-09-24T22:25:36.348155] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-24T22:25:36.365002] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-24T22:25:36.365299] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-24T22:25:36.369013] [INFO ] [MAIN ] Derivative Progress: 1529/2075 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 33s. Rate: 153.5 symbols/min [2025-09-24T22:25:36.383606] [DEBUG] [MAIN ] RDDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:36.384249] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53784 primary records. [2025-09-24T22:25:36.384313] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-24T22:25:36.400057] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-24T22:25:36.400171] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-24T22:25:36.403860] [INFO ] [MAIN ] Derivative Progress: 1530/2075 symbols completed. RDDT took 1.1s. Estimated remaining: 3m 33s. Rate: 153.6 symbols/min [2025-09-24T22:25:36.404577] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:36.404759] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:36.404669] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:36.493102] [DEBUG] [LOCAL ] RDW: Loaded 52014 existing records from primary storage. [2025-09-24T22:25:36.494290] [INFO ] [MAIN ] RDW: Loaded 52014 primary data records. [2025-09-24T22:25:36.495007] [DEBUG] [LOCAL ] RDN: Loaded 45275 existing records from primary storage. [2025-09-24T22:25:36.533789] [INFO ] [MAIN ] RDN: Loaded 45275 primary data records. [2025-09-24T22:25:36.654783] [DEBUG] [LOCAL ] RDY: Loaded 46777 existing records from primary storage. [2025-09-24T22:25:36.687177] [INFO ] [MAIN ] RDY: Loaded 46777 primary data records. [2025-09-24T22:25:37.571149] [DEBUG] [MAIN ] RDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:37.585297] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52014 primary records. [2025-09-24T22:25:37.587554] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-24T22:25:37.589192] [DEBUG] [MAIN ] RDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:37.593742] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45275 primary records. [2025-09-24T22:25:37.594516] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-24T22:25:37.649763] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-24T22:25:37.649658] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-24T22:25:37.650877] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-24T22:25:37.653730] [INFO ] [MAIN ] Derivative Progress: 1531/2075 symbols completed. RDW took 1.2s. Estimated remaining: 3m 33s. Rate: 153.4 symbols/min [2025-09-24T22:25:37.650798] [DEBUG] [MAIN ] RDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:37.655224] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46777 primary records. [2025-09-24T22:25:37.651015] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-24T22:25:37.659489] [INFO ] [MAIN ] Derivative Progress: 1532/2075 symbols completed. RDN took 1.3s. Estimated remaining: 3m 32s. Rate: 153.5 symbols/min [2025-09-24T22:25:37.655729] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:37.660804] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-24T22:25:37.660124] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:37.690359] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-24T22:25:37.690733] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-24T22:25:37.694094] [INFO ] [MAIN ] Derivative Progress: 1533/2075 symbols completed. RDY took 1.3s. Estimated remaining: 3m 32s. Rate: 153.6 symbols/min [2025-09-24T22:25:37.694792] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:37.798205] [DEBUG] [LOCAL ] RERE: Loaded 41078 existing records from primary storage. [2025-09-24T22:25:37.798446] [INFO ] [MAIN ] RERE: Loaded 41078 primary data records. [2025-09-24T22:25:37.818750] [DEBUG] [LOCAL ] RELX: Loaded 47852 existing records from primary storage. [2025-09-24T22:25:37.895199] [INFO ] [MAIN ] RELX: Loaded 47852 primary data records. [2025-09-24T22:25:37.917384] [DEBUG] [LOCAL ] RES: Loaded 47504 existing records from primary storage. [2025-09-24T22:25:37.950343] [INFO ] [MAIN ] RES: Loaded 47504 primary data records. [2025-09-24T22:25:39.107451] [DEBUG] [MAIN ] RERE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:39.109973] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41078 primary records. [2025-09-24T22:25:39.110875] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-24T22:25:39.154832] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-24T22:25:39.155115] [DEBUG] [MAIN ] RES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:39.156282] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47504 primary records. [2025-09-24T22:25:39.156434] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-24T22:25:39.156706] [DEBUG] [MAIN ] RELX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:39.156371] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-24T22:25:39.159505] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47852 primary records. [2025-09-24T22:25:39.158461] [INFO ] [MAIN ] Derivative Progress: 1534/2075 symbols completed. RERE took 1.5s. Estimated remaining: 3m 32s. Rate: 153.3 symbols/min [2025-09-24T22:25:39.160564] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:39.160465] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-24T22:25:39.187075] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-24T22:25:39.187820] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-24T22:25:39.190610] [INFO ] [MAIN ] Derivative Progress: 1535/2075 symbols completed. RES took 1.5s. Estimated remaining: 3m 31s. Rate: 153.4 symbols/min [2025-09-24T22:25:39.192895] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:39.195142] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-24T22:25:39.195218] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-24T22:25:39.198034] [INFO ] [MAIN ] Derivative Progress: 1536/2075 symbols completed. RELX took 1.5s. Estimated remaining: 3m 31s. Rate: 153.5 symbols/min [2025-09-24T22:25:39.198456] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:39.213162] [DEBUG] [LOCAL ] REX: Loaded 13981 existing records from primary storage. [2025-09-24T22:25:39.213366] [INFO ] [MAIN ] REX: Loaded 13981 primary data records. [2025-09-24T22:25:39.361219] [DEBUG] [LOCAL ] REVG: Loaded 40955 existing records from primary storage. [2025-09-24T22:25:39.388468] [INFO ] [MAIN ] REVG: Loaded 40955 primary data records. [2025-09-24T22:25:39.747027] [DEBUG] [LOCAL ] REXR: Loaded 52081 existing records from primary storage. [2025-09-24T22:25:39.811970] [INFO ] [MAIN ] REXR: Loaded 52081 primary data records. [2025-09-24T22:25:40.198612] [DEBUG] [MAIN ] REX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:40.200198] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 13981 primary records. [2025-09-24T22:25:40.201551] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-24T22:25:40.220540] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-24T22:25:40.228687] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-24T22:25:40.237866] [INFO ] [MAIN ] Derivative Progress: 1537/2075 symbols completed. REX took 1.0s. Estimated remaining: 3m 31s. Rate: 153.3 symbols/min [2025-09-24T22:25:40.238625] [DEBUG] [MAIN ] REVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:40.239494] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40955 primary records. [2025-09-24T22:25:40.239835] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:40.239980] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-24T22:25:40.257428] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-24T22:25:40.257708] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-24T22:25:40.259957] [INFO ] [MAIN ] Derivative Progress: 1538/2075 symbols completed. REVG took 1.1s. Estimated remaining: 3m 30s. Rate: 153.4 symbols/min [2025-09-24T22:25:40.260377] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:40.278667] [DEBUG] [MAIN ] REXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:40.279451] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52081 primary records. [2025-09-24T22:25:40.279613] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-24T22:25:40.299020] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-24T22:25:40.299197] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-24T22:25:40.301674] [INFO ] [MAIN ] Derivative Progress: 1539/2075 symbols completed. REXR took 1.1s. Estimated remaining: 3m 30s. Rate: 153.5 symbols/min [2025-09-24T22:25:40.302035] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:40.347097] [DEBUG] [LOCAL ] REZI: Loaded 46856 existing records from primary storage. [2025-09-24T22:25:40.347377] [INFO ] [MAIN ] REZI: Loaded 46856 primary data records. [2025-09-24T22:25:40.407997] [DEBUG] [LOCAL ] RFI: Loaded 10465 existing records from primary storage. [2025-09-24T22:25:40.417024] [INFO ] [MAIN ] RFI: Loaded 10465 primary data records. [2025-09-24T22:25:40.536172] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-24T22:25:40.559273] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-24T22:25:41.444563] [DEBUG] [MAIN ] REZI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:41.445881] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46856 primary records. [2025-09-24T22:25:41.446224] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-24T22:25:41.477243] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:41.481846] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-24T22:25:41.481758] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10465 primary records. [2025-09-24T22:25:41.481993] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-24T22:25:41.482962] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-24T22:25:41.485690] [INFO ] [MAIN ] Derivative Progress: 1540/2075 symbols completed. REZI took 1.2s. Estimated remaining: 3m 29s. Rate: 153.3 symbols/min [2025-09-24T22:25:41.486065] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:41.503145] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-24T22:25:41.505147] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-24T22:25:41.508073] [INFO ] [MAIN ] Derivative Progress: 1541/2075 symbols completed. RFI took 1.2s. Estimated remaining: 3m 29s. Rate: 153.4 symbols/min [2025-09-24T22:25:41.510960] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:41.524474] [DEBUG] [MAIN ] RF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:41.531624] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-24T22:25:41.532040] [DEBUG] [LOCAL ] RFL: Loaded 10943 existing records from primary storage. [2025-09-24T22:25:41.532313] [INFO ] [MAIN ] RFL: Loaded 10943 primary data records. [2025-09-24T22:25:41.532459] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-24T22:25:41.595869] [DEBUG] [LOCAL ] RFM: Loaded 4154 existing records from primary storage. [2025-09-24T22:25:41.629539] [INFO ] [MAIN ] RFM: Loaded 4154 primary data records. [2025-09-24T22:25:41.676740] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-24T22:25:41.704720] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-24T22:25:41.707784] [INFO ] [MAIN ] Derivative Progress: 1542/2075 symbols completed. RF took 1.4s. Estimated remaining: 3m 28s. Rate: 153.4 symbols/min [2025-09-24T22:25:41.727121] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:42.016153] [DEBUG] [LOCAL ] RFMZ: Loaded 8713 existing records from primary storage. [2025-09-24T22:25:42.068999] [INFO ] [MAIN ] RFMZ: Loaded 8713 primary data records. [2025-09-24T22:25:42.541961] [DEBUG] [MAIN ] RFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:42.542998] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 10943 primary records. [2025-09-24T22:25:42.543162] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-24T22:25:42.562240] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-24T22:25:42.562534] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-24T22:25:42.583070] [INFO ] [MAIN ] Derivative Progress: 1543/2075 symbols completed. RFL took 1.1s. Estimated remaining: 3m 28s. Rate: 153.3 symbols/min [2025-09-24T22:25:42.584016] [DEBUG] [MAIN ] RFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:42.585346] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4154 primary records. [2025-09-24T22:25:42.585537] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-24T22:25:42.601821] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-24T22:25:42.602050] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-24T22:25:42.604993] [INFO ] [MAIN ] Derivative Progress: 1544/2075 symbols completed. RFM took 1.1s. Estimated remaining: 3m 28s. Rate: 153.4 symbols/min [2025-09-24T22:25:42.620883] [DEBUG] [MAIN ] RFMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:42.621437] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8713 primary records. [2025-09-24T22:25:42.621497] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-24T22:25:42.638914] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-24T22:25:42.638991] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-24T22:25:42.641437] [INFO ] [MAIN ] Derivative Progress: 1545/2075 symbols completed. RFMZ took 0.9s. Estimated remaining: 3m 27s. Rate: 153.5 symbols/min [2025-09-24T22:25:42.642088] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:42.642248] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:42.642385] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:42.648725] [DEBUG] [LOCAL ] RGT: Loaded 2858 existing records from primary storage. [2025-09-24T22:25:42.648866] [INFO ] [MAIN ] RGT: Loaded 2858 primary data records. [2025-09-24T22:25:42.785123] [DEBUG] [LOCAL ] RGR: Loaded 20396 existing records from primary storage. [2025-09-24T22:25:42.831931] [INFO ] [MAIN ] RGR: Loaded 20396 primary data records. [2025-09-24T22:25:43.019918] [DEBUG] [LOCAL ] RGA: Loaded 30123 existing records from primary storage. [2025-09-24T22:25:43.142430] [INFO ] [MAIN ] RGA: Loaded 30123 primary data records. [2025-09-24T22:25:43.722061] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:43.723610] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2858 primary records. [2025-09-24T22:25:43.723837] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-24T22:25:43.743793] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-24T22:25:43.743967] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-24T22:25:43.746428] [INFO ] [MAIN ] Derivative Progress: 1546/2075 symbols completed. RGT took 1.1s. Estimated remaining: 3m 27s. Rate: 153.3 symbols/min [2025-09-24T22:25:43.746921] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:43.760994] [DEBUG] [MAIN ] RGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:43.762013] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20396 primary records. [2025-09-24T22:25:43.762369] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-24T22:25:43.781551] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-24T22:25:43.781791] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-24T22:25:43.784417] [INFO ] [MAIN ] Derivative Progress: 1547/2075 symbols completed. RGR took 1.1s. Estimated remaining: 3m 27s. Rate: 153.4 symbols/min [2025-09-24T22:25:43.784921] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:43.798671] [DEBUG] [MAIN ] RGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:43.799582] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 30123 primary records. [2025-09-24T22:25:43.799842] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-24T22:25:43.818291] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-24T22:25:43.818594] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-24T22:25:43.821400] [INFO ] [MAIN ] Derivative Progress: 1548/2075 symbols completed. RGA took 1.2s. Estimated remaining: 3m 26s. Rate: 153.5 symbols/min [2025-09-24T22:25:43.821857] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:43.867383] [DEBUG] [LOCAL ] RH: Loaded 47654 existing records from primary storage. [2025-09-24T22:25:43.867686] [INFO ] [MAIN ] RH: Loaded 47654 primary data records. [2025-09-24T22:25:44.012213] [DEBUG] [LOCAL ] RHI: Loaded 49256 existing records from primary storage. [2025-09-24T22:25:44.034507] [INFO ] [MAIN ] RHI: Loaded 49256 primary data records. [2025-09-24T22:25:44.064454] [DEBUG] [LOCAL ] RHP: Loaded 41735 existing records from primary storage. [2025-09-24T22:25:44.091102] [INFO ] [MAIN ] RHP: Loaded 41735 primary data records. [2025-09-24T22:25:44.879311] [DEBUG] [MAIN ] RH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:44.880425] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47654 primary records. [2025-09-24T22:25:44.880858] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-24T22:25:44.900277] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-24T22:25:44.900840] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-24T22:25:44.902795] [INFO ] [MAIN ] Derivative Progress: 1549/2075 symbols completed. RH took 1.2s. Estimated remaining: 3m 26s. Rate: 153.3 symbols/min [2025-09-24T22:25:44.904857] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:44.921846] [DEBUG] [MAIN ] RHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:44.922776] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41735 primary records. [2025-09-24T22:25:44.922948] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-24T22:25:44.958496] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-24T22:25:44.959079] [DEBUG] [MAIN ] RHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:44.959282] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-24T22:25:44.960216] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49256 primary records. [2025-09-24T22:25:44.963158] [INFO ] [MAIN ] Derivative Progress: 1550/2075 symbols completed. RHP took 1.1s. Estimated remaining: 3m 25s. Rate: 153.4 symbols/min [2025-09-24T22:25:44.963386] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-24T22:25:44.963616] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:44.983204] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-24T22:25:44.983534] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-24T22:25:44.986489] [INFO ] [MAIN ] Derivative Progress: 1551/2075 symbols completed. RHI took 1.2s. Estimated remaining: 3m 25s. Rate: 153.5 symbols/min [2025-09-24T22:25:44.986990] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:45.057281] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-24T22:25:45.057730] [INFO ] [MAIN ] RIG: Loaded 53669 primary data records. [2025-09-24T22:25:45.199791] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-24T22:25:45.219412] [INFO ] [MAIN ] RIO: Loaded 53394 primary data records. [2025-09-24T22:25:45.364479] [DEBUG] [LOCAL ] RITM: Loaded 52819 existing records from primary storage. [2025-09-24T22:25:45.417320] [INFO ] [MAIN ] RITM: Loaded 52819 primary data records. [2025-09-24T22:25:46.128700] [DEBUG] [MAIN ] RIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:46.129793] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53669 primary records. [2025-09-24T22:25:46.130024] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-24T22:25:46.150186] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-24T22:25:46.151201] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-24T22:25:46.153358] [INFO ] [MAIN ] Derivative Progress: 1552/2075 symbols completed. RIG took 1.3s. Estimated remaining: 3m 25s. Rate: 153.3 symbols/min [2025-09-24T22:25:46.153862] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:46.168370] [DEBUG] [MAIN ] RIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:46.169373] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53394 primary records. [2025-09-24T22:25:46.169617] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-24T22:25:46.199565] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-24T22:25:46.209467] [DEBUG] [LOCAL ] RIV: Loaded 11965 existing records from primary storage. [2025-09-24T22:25:46.209801] [DEBUG] [MAIN ] RITM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:46.210637] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52819 primary records. [2025-09-24T22:25:46.210777] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-24T22:25:46.209874] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-24T22:25:46.214467] [INFO ] [MAIN ] RIV: Loaded 11965 primary data records. [2025-09-24T22:25:46.213639] [INFO ] [MAIN ] Derivative Progress: 1553/2075 symbols completed. RIO took 1.3s. Estimated remaining: 3m 24s. Rate: 153.4 symbols/min [2025-09-24T22:25:46.222361] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:46.270238] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-24T22:25:46.285736] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-24T22:25:46.310058] [INFO ] [MAIN ] Derivative Progress: 1554/2075 symbols completed. RITM took 1.3s. Estimated remaining: 3m 24s. Rate: 153.5 symbols/min [2025-09-24T22:25:46.329119] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:46.595311] [DEBUG] [LOCAL ] RJF: Loaded 47095 existing records from primary storage. [2025-09-24T22:25:46.595918] [INFO ] [MAIN ] RJF: Loaded 47095 primary data records. [2025-09-24T22:25:46.795208] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-24T22:25:46.813626] [DEBUG] [MAIN ] RIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:46.860192] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 11965 primary records. [2025-09-24T22:25:46.858811] [INFO ] [MAIN ] RKT: Loaded 53721 primary data records. [2025-09-24T22:25:46.980695] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-24T22:25:47.101396] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-24T22:25:47.122300] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-24T22:25:47.130331] [INFO ] [MAIN ] Derivative Progress: 1555/2075 symbols completed. RIV took 1.0s. Estimated remaining: 3m 23s. Rate: 153.4 symbols/min [2025-09-24T22:25:47.168452] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:47.392188] [DEBUG] [MAIN ] RJF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:47.394014] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47095 primary records. [2025-09-24T22:25:47.396073] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-24T22:25:47.414209] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-24T22:25:47.415133] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-24T22:25:47.417965] [INFO ] [MAIN ] Derivative Progress: 1556/2075 symbols completed. RJF took 1.2s. Estimated remaining: 3m 23s. Rate: 153.4 symbols/min [2025-09-24T22:25:47.418362] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:47.461483] [DEBUG] [LOCAL ] RL: Loaded 41521 existing records from primary storage. [2025-09-24T22:25:47.461913] [INFO ] [MAIN ] RL: Loaded 41521 primary data records. [2025-09-24T22:25:47.461821] [DEBUG] [MAIN ] RKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:47.462860] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53721 primary records. [2025-09-24T22:25:47.463095] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-24T22:25:47.570226] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-24T22:25:47.598360] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-24T22:25:47.604005] [INFO ] [MAIN ] Derivative Progress: 1557/2075 symbols completed. RKT took 1.3s. Estimated remaining: 3m 23s. Rate: 153.4 symbols/min [2025-09-24T22:25:47.625977] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:47.620550] [DEBUG] [LOCAL ] RLI: Loaded 33293 existing records from primary storage. [2025-09-24T22:25:47.631857] [INFO ] [MAIN ] RLI: Loaded 33293 primary data records. [2025-09-24T22:25:48.126633] [DEBUG] [LOCAL ] RLJ: Loaded 48235 existing records from primary storage. [2025-09-24T22:25:48.128234] [INFO ] [MAIN ] RLJ: Loaded 48235 primary data records. [2025-09-24T22:25:48.454911] [DEBUG] [MAIN ] RL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:25:48.456252] [INFO ] [MAIN ] RL: Generated 1793 derivative records from 41521 primary records. [2025-09-24T22:25:48.456524] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-24T22:25:48.493297] [DEBUG] [MAIN ] RLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:48.492928] [DEBUG] [LOCAL ] RL: Derivative data saved (1793 records). [2025-09-24T22:25:48.494448] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-24T22:25:48.494222] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33293 primary records. [2025-09-24T22:25:48.494592] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-24T22:25:48.497287] [INFO ] [MAIN ] Derivative Progress: 1558/2075 symbols completed. RL took 1.3s. Estimated remaining: 3m 22s. Rate: 153.3 symbols/min [2025-09-24T22:25:48.516188] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-24T22:25:48.516295] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-24T22:25:48.519140] [INFO ] [MAIN ] Derivative Progress: 1559/2075 symbols completed. RLI took 1.1s. Estimated remaining: 3m 22s. Rate: 153.4 symbols/min [2025-09-24T22:25:48.536866] [DEBUG] [MAIN ] RLJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:48.537461] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48235 primary records. [2025-09-24T22:25:48.537569] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-24T22:25:48.552941] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-24T22:25:48.553016] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-24T22:25:48.555539] [INFO ] [MAIN ] Derivative Progress: 1560/2075 symbols completed. RLJ took 0.9s. Estimated remaining: 3m 21s. Rate: 153.5 symbols/min [2025-09-24T22:25:48.556286] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:48.556546] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:48.557146] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:48.572140] [DEBUG] [LOCAL ] RM: Loaded 7664 existing records from primary storage. [2025-09-24T22:25:48.572418] [INFO ] [MAIN ] RM: Loaded 7664 primary data records. [2025-09-24T22:25:48.615809] [DEBUG] [LOCAL ] RLTY: Loaded 11089 existing records from primary storage. [2025-09-24T22:25:48.635994] [INFO ] [MAIN ] RLTY: Loaded 11089 primary data records. [2025-09-24T22:25:49.068720] [DEBUG] [LOCAL ] RLX: Loaded 48255 existing records from primary storage. [2025-09-24T22:25:49.090747] [INFO ] [MAIN ] RLX: Loaded 48255 primary data records. [2025-09-24T22:25:49.654011] [DEBUG] [MAIN ] RM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:49.657080] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7664 primary records. [2025-09-24T22:25:49.658528] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-24T22:25:49.688108] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-24T22:25:49.688302] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-24T22:25:49.688614] [DEBUG] [MAIN ] RLTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:49.691549] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11089 primary records. [2025-09-24T22:25:49.690770] [INFO ] [MAIN ] Derivative Progress: 1561/2075 symbols completed. RM took 1.1s. Estimated remaining: 3m 21s. Rate: 153.3 symbols/min [2025-09-24T22:25:49.691697] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-24T22:25:49.692463] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:49.712272] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-24T22:25:49.713296] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-24T22:25:49.716235] [INFO ] [MAIN ] Derivative Progress: 1562/2075 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 21s. Rate: 153.4 symbols/min [2025-09-24T22:25:49.716821] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:49.735479] [DEBUG] [MAIN ] RLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:49.736763] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48255 primary records. [2025-09-24T22:25:49.736945] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-24T22:25:49.759415] [DEBUG] [LOCAL ] RMAX: Loaded 21865 existing records from primary storage. [2025-09-24T22:25:49.760277] [INFO ] [MAIN ] RMAX: Loaded 21865 primary data records. [2025-09-24T22:25:49.841355] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-24T22:25:49.857864] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-24T22:25:49.881967] [INFO ] [MAIN ] Derivative Progress: 1563/2075 symbols completed. RLX took 1.3s. Estimated remaining: 3m 20s. Rate: 153.5 symbols/min [2025-09-24T22:25:49.882740] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:50.097039] [DEBUG] [LOCAL ] RMD: Loaded 42266 existing records from primary storage. [2025-09-24T22:25:50.097324] [DEBUG] [LOCAL ] RMI: Loaded 4690 existing records from primary storage. [2025-09-24T22:25:50.097603] [INFO ] [MAIN ] RMI: Loaded 4690 primary data records. [2025-09-24T22:25:50.097535] [INFO ] [MAIN ] RMD: Loaded 42266 primary data records. [2025-09-24T22:25:50.742379] [DEBUG] [MAIN ] RMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:50.744257] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21865 primary records. [2025-09-24T22:25:50.744463] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-24T22:25:50.765730] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-24T22:25:50.766258] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-24T22:25:50.768337] [INFO ] [MAIN ] Derivative Progress: 1564/2075 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 20s. Rate: 153.3 symbols/min [2025-09-24T22:25:50.769058] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:50.793382] [DEBUG] [MAIN ] RMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:50.806407] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 42266 primary records. [2025-09-24T22:25:50.807227] [DEBUG] [MAIN ] RMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:50.807296] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-24T22:25:50.813006] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4690 primary records. [2025-09-24T22:25:50.813365] [DEBUG] [LOCAL ] RMM: Loaded 10443 existing records from primary storage. [2025-09-24T22:25:50.813436] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-24T22:25:50.814381] [INFO ] [MAIN ] RMM: Loaded 10443 primary data records. [2025-09-24T22:25:50.897605] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-09-24T22:25:50.918791] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-24T22:25:50.927384] [INFO ] [MAIN ] Derivative Progress: 1565/2075 symbols completed. RMD took 1.2s. Estimated remaining: 3m 19s. Rate: 153.4 symbols/min [2025-09-24T22:25:50.943398] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:50.955186] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-09-24T22:25:50.955805] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-24T22:25:50.964050] [INFO ] [MAIN ] Derivative Progress: 1566/2075 symbols completed. RMI took 1.1s. Estimated remaining: 3m 19s. Rate: 153.5 symbols/min [2025-09-24T22:25:50.979960] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:51.068685] [DEBUG] [LOCAL ] RMMZ: Loaded 4845 existing records from primary storage. [2025-09-24T22:25:51.174843] [INFO ] [MAIN ] RMMZ: Loaded 4845 primary data records. [2025-09-24T22:25:51.309478] [DEBUG] [LOCAL ] RMT: Loaded 17504 existing records from primary storage. [2025-09-24T22:25:51.353796] [INFO ] [MAIN ] RMT: Loaded 17504 primary data records. [2025-09-24T22:25:51.880485] [DEBUG] [MAIN ] RMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:51.882039] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10443 primary records. [2025-09-24T22:25:51.882276] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-24T22:25:51.902044] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-24T22:25:51.902698] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-24T22:25:51.905052] [INFO ] [MAIN ] Derivative Progress: 1567/2075 symbols completed. RMM took 1.1s. Estimated remaining: 3m 19s. Rate: 153.3 symbols/min [2025-09-24T22:25:51.905359] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:51.927020] [DEBUG] [MAIN ] RMMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:51.928400] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4845 primary records. [2025-09-24T22:25:51.928621] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-24T22:25:51.948436] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-24T22:25:51.948808] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-24T22:25:51.951684] [INFO ] [MAIN ] Derivative Progress: 1568/2075 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 18s. Rate: 153.4 symbols/min [2025-09-24T22:25:51.952247] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:51.966451] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:51.967333] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17504 primary records. [2025-09-24T22:25:51.967455] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-24T22:25:52.013799] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-24T22:25:52.013979] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-24T22:25:52.014973] [DEBUG] [LOCAL ] RNG: Loaded 48144 existing records from primary storage. [2025-09-24T22:25:52.015119] [INFO ] [MAIN ] RNG: Loaded 48144 primary data records. [2025-09-24T22:25:52.017977] [INFO ] [MAIN ] Derivative Progress: 1569/2075 symbols completed. RMT took 1.0s. Estimated remaining: 3m 18s. Rate: 153.5 symbols/min [2025-09-24T22:25:52.018558] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:52.062048] [DEBUG] [LOCAL ] RNGR: Loaded 20444 existing records from primary storage. [2025-09-24T22:25:52.090092] [INFO ] [MAIN ] RNGR: Loaded 20444 primary data records. [2025-09-24T22:25:52.226851] [DEBUG] [LOCAL ] RNP: Loaded 15782 existing records from primary storage. [2025-09-24T22:25:52.270599] [INFO ] [MAIN ] RNP: Loaded 15782 primary data records. [2025-09-24T22:25:52.999672] [DEBUG] [MAIN ] RNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:53.001744] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48144 primary records. [2025-09-24T22:25:53.001922] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-24T22:25:53.040355] [DEBUG] [MAIN ] RNGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:53.044635] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20444 primary records. [2025-09-24T22:25:53.046164] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:53.045872] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-24T22:25:53.049365] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-24T22:25:53.051026] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15782 primary records. [2025-09-24T22:25:53.051172] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-24T22:25:53.051513] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-24T22:25:53.053708] [INFO ] [MAIN ] Derivative Progress: 1570/2075 symbols completed. RNG took 1.1s. Estimated remaining: 3m 18s. Rate: 153.3 symbols/min [2025-09-24T22:25:53.067683] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:53.071124] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-24T22:25:53.083020] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-24T22:25:53.087964] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-24T22:25:53.090891] [INFO ] [MAIN ] Derivative Progress: 1571/2075 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 17s. Rate: 153.4 symbols/min [2025-09-24T22:25:53.091078] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-24T22:25:53.094365] [INFO ] [MAIN ] Derivative Progress: 1572/2075 symbols completed. RNP took 1.1s. Estimated remaining: 3m 17s. Rate: 153.5 symbols/min [2025-09-24T22:25:53.094309] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:53.094666] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:53.120855] [DEBUG] [LOCAL ] ROG: Loaded 23151 existing records from primary storage. [2025-09-24T22:25:53.128796] [INFO ] [MAIN ] ROG: Loaded 23151 primary data records. [2025-09-24T22:25:53.270488] [DEBUG] [LOCAL ] RNST: Loaded 37138 existing records from primary storage. [2025-09-24T22:25:53.270037] [DEBUG] [LOCAL ] RNR: Loaded 34254 existing records from primary storage. [2025-09-24T22:25:53.281412] [INFO ] [MAIN ] RNR: Loaded 34254 primary data records. [2025-09-24T22:25:53.281312] [INFO ] [MAIN ] RNST: Loaded 37138 primary data records. [2025-09-24T22:25:54.169469] [DEBUG] [MAIN ] ROG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:54.170571] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23151 primary records. [2025-09-24T22:25:54.170783] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-24T22:25:54.189113] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-24T22:25:54.189474] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-24T22:25:54.191900] [INFO ] [MAIN ] Derivative Progress: 1573/2075 symbols completed. ROG took 1.1s. Estimated remaining: 3m 16s. Rate: 153.4 symbols/min [2025-09-24T22:25:54.222868] [DEBUG] [MAIN ] RNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:54.223075] [DEBUG] [MAIN ] RNST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:54.224123] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37138 primary records. [2025-09-24T22:25:54.224818] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-24T22:25:54.224758] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 34254 primary records. [2025-09-24T22:25:54.224909] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-24T22:25:54.260562] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-24T22:25:54.263109] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-24T22:25:54.263210] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-24T22:25:54.266127] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-24T22:25:54.266040] [INFO ] [MAIN ] Derivative Progress: 1574/2075 symbols completed. RNR took 1.2s. Estimated remaining: 3m 16s. Rate: 153.4 symbols/min [2025-09-24T22:25:54.268990] [INFO ] [MAIN ] Derivative Progress: 1575/2075 symbols completed. RNST took 1.2s. Estimated remaining: 3m 15s. Rate: 153.5 symbols/min [2025-09-24T22:25:54.269533] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:54.269734] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:54.269807] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:54.336001] [DEBUG] [LOCAL ] ROK: Loaded 43954 existing records from primary storage. [2025-09-24T22:25:54.336171] [INFO ] [MAIN ] ROK: Loaded 43954 primary data records. [2025-09-24T22:25:54.482370] [DEBUG] [LOCAL ] RPM: Loaded 41115 existing records from primary storage. [2025-09-24T22:25:54.504356] [DEBUG] [LOCAL ] ROL: Loaded 50266 existing records from primary storage. [2025-09-24T22:25:54.498436] [INFO ] [MAIN ] RPM: Loaded 41115 primary data records. [2025-09-24T22:25:54.523854] [INFO ] [MAIN ] ROL: Loaded 50266 primary data records. [2025-09-24T22:25:55.401885] [DEBUG] [MAIN ] ROK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:55.403754] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 43954 primary records. [2025-09-24T22:25:55.403957] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-24T22:25:55.423637] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-24T22:25:55.424256] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-24T22:25:55.426865] [INFO ] [MAIN ] Derivative Progress: 1576/2075 symbols completed. ROK took 1.2s. Estimated remaining: 3m 15s. Rate: 153.3 symbols/min [2025-09-24T22:25:55.432536] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:55.458726] [DEBUG] [MAIN ] ROL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:55.459952] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50266 primary records. [2025-09-24T22:25:55.459125] [DEBUG] [MAIN ] RPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:55.460082] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-24T22:25:55.461445] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41115 primary records. [2025-09-24T22:25:55.461821] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-24T22:25:55.493627] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-24T22:25:55.494065] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-24T22:25:55.496916] [INFO ] [MAIN ] Derivative Progress: 1577/2075 symbols completed. ROL took 1.2s. Estimated remaining: 3m 15s. Rate: 153.4 symbols/min [2025-09-24T22:25:55.500315] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:55.501616] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-24T22:25:55.502001] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-24T22:25:55.504799] [INFO ] [MAIN ] Derivative Progress: 1578/2075 symbols completed. RPM took 1.2s. Estimated remaining: 3m 14s. Rate: 153.5 symbols/min [2025-09-24T22:25:55.505251] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:55.513521] [DEBUG] [LOCAL ] RPT: Loaded 19599 existing records from primary storage. [2025-09-24T22:25:55.513840] [INFO ] [MAIN ] RPT: Loaded 19599 primary data records. [2025-09-24T22:25:55.839321] [DEBUG] [LOCAL ] RQI: Loaded 29112 existing records from primary storage. [2025-09-24T22:25:55.840134] [INFO ] [MAIN ] RQI: Loaded 29112 primary data records. [2025-09-24T22:25:55.933553] [DEBUG] [LOCAL ] RRX: Loaded 41153 existing records from primary storage. [2025-09-24T22:25:55.944496] [INFO ] [MAIN ] RRX: Loaded 41153 primary data records. [2025-09-24T22:25:56.473591] [DEBUG] [MAIN ] RPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:56.474384] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19599 primary records. [2025-09-24T22:25:56.474559] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-24T22:25:56.497393] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-09-24T22:25:56.497778] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-24T22:25:56.500186] [INFO ] [MAIN ] Derivative Progress: 1579/2075 symbols completed. RPT took 1.1s. Estimated remaining: 3m 14s. Rate: 153.4 symbols/min [2025-09-24T22:25:56.501142] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:56.518610] [DEBUG] [MAIN ] RQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:56.519571] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29112 primary records. [2025-09-24T22:25:56.519790] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-24T22:25:56.538863] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-24T22:25:56.545863] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-24T22:25:56.548525] [INFO ] [MAIN ] Derivative Progress: 1580/2075 symbols completed. RQI took 1.0s. Estimated remaining: 3m 14s. Rate: 153.4 symbols/min [2025-09-24T22:25:56.561615] [DEBUG] [MAIN ] RRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:56.562471] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41153 primary records. [2025-09-24T22:25:56.561741] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:56.562945] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-24T22:25:56.581073] [DEBUG] [LOCAL ] RS: Loaded 25544 existing records from primary storage. [2025-09-24T22:25:56.581254] [INFO ] [MAIN ] RS: Loaded 25544 primary data records. [2025-09-24T22:25:56.614022] [DEBUG] [LOCAL ] RSF: Loaded 4135 existing records from primary storage. [2025-09-24T22:25:56.628602] [INFO ] [MAIN ] RSF: Loaded 4135 primary data records. [2025-09-24T22:25:56.781624] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-24T22:25:56.805326] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-24T22:25:56.863488] [INFO ] [MAIN ] Derivative Progress: 1581/2075 symbols completed. RRX took 1.4s. Estimated remaining: 3m 13s. Rate: 153.5 symbols/min [2025-09-24T22:25:56.881979] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:57.277670] [DEBUG] [MAIN ] RS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:57.278875] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25544 primary records. [2025-09-24T22:25:57.279418] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-24T22:25:57.300991] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-24T22:25:57.301436] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-24T22:25:57.328636] [INFO ] [MAIN ] Derivative Progress: 1582/2075 symbols completed. RS took 0.8s. Estimated remaining: 3m 13s. Rate: 153.4 symbols/min [2025-09-24T22:25:57.331057] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:25:57.332113] [INFO ] [MAIN ] RSF: Generated 1793 derivative records from 4135 primary records. [2025-09-24T22:25:57.332263] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-24T22:25:57.331317] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:57.334223] [DEBUG] [LOCAL ] RSG: Loaded 47484 existing records from primary storage. [2025-09-24T22:25:57.334982] [INFO ] [MAIN ] RSG: Loaded 47484 primary data records. [2025-09-24T22:25:57.416906] [DEBUG] [LOCAL ] RSF: Derivative data saved (1793 records). [2025-09-24T22:25:57.440382] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-24T22:25:57.461948] [INFO ] [MAIN ] Derivative Progress: 1583/2075 symbols completed. RSF took 0.9s. Estimated remaining: 3m 12s. Rate: 153.5 symbols/min [2025-09-24T22:25:57.473327] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:57.713007] [DEBUG] [LOCAL ] RSI: Loaded 47050 existing records from primary storage. [2025-09-24T22:25:57.713909] [INFO ] [MAIN ] RSI: Loaded 47050 primary data records. [2025-09-24T22:25:57.880744] [DEBUG] [LOCAL ] RSKD: Loaded 33898 existing records from primary storage. [2025-09-24T22:25:57.880977] [INFO ] [MAIN ] RSKD: Loaded 33898 primary data records. [2025-09-24T22:25:58.377738] [DEBUG] [MAIN ] RSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:58.378945] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47484 primary records. [2025-09-24T22:25:58.379151] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-24T22:25:58.399851] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-24T22:25:58.400200] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-24T22:25:58.402395] [INFO ] [MAIN ] Derivative Progress: 1584/2075 symbols completed. RSG took 1.5s. Estimated remaining: 3m 12s. Rate: 153.4 symbols/min [2025-09-24T22:25:58.402862] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:58.421373] [DEBUG] [MAIN ] RSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:58.422159] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 47050 primary records. [2025-09-24T22:25:58.422357] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-24T22:25:58.439960] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-24T22:25:58.441007] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-24T22:25:58.444604] [INFO ] [MAIN ] Derivative Progress: 1585/2075 symbols completed. RSI took 1.1s. Estimated remaining: 3m 12s. Rate: 153.5 symbols/min [2025-09-24T22:25:58.445765] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:58.460822] [DEBUG] [MAIN ] RSKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:58.461674] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33898 primary records. [2025-09-24T22:25:58.461839] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-24T22:25:58.486673] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-24T22:25:58.486909] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-24T22:25:58.489717] [INFO ] [MAIN ] Derivative Progress: 1586/2075 symbols completed. RSKD took 1.0s. Estimated remaining: 3m 11s. Rate: 153.5 symbols/min [2025-09-24T22:25:58.490208] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:58.505541] [DEBUG] [LOCAL ] RTO: Loaded 40234 existing records from primary storage. [2025-09-24T22:25:58.505841] [INFO ] [MAIN ] RTO: Loaded 40234 primary data records. [2025-09-24T22:25:58.875829] [DEBUG] [LOCAL ] RTX: Loaded 53709 existing records from primary storage. [2025-09-24T22:25:58.877101] [INFO ] [MAIN ] RTX: Loaded 53709 primary data records. [2025-09-24T22:25:58.883168] [DEBUG] [LOCAL ] RVLV: Loaded 47826 existing records from primary storage. [2025-09-24T22:25:58.910818] [INFO ] [MAIN ] RVLV: Loaded 47826 primary data records. [2025-09-24T22:25:59.576395] [DEBUG] [MAIN ] RTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:59.577496] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40234 primary records. [2025-09-24T22:25:59.577997] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-24T22:25:59.611530] [DEBUG] [MAIN ] RTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:59.615167] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53709 primary records. [2025-09-24T22:25:59.616190] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-24T22:25:59.617430] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-24T22:25:59.617788] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-24T22:25:59.620157] [INFO ] [MAIN ] Derivative Progress: 1587/2075 symbols completed. RTO took 1.2s. Estimated remaining: 3m 11s. Rate: 153.4 symbols/min [2025-09-24T22:25:59.645839] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:25:59.646783] [DEBUG] [MAIN ] RVLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:25:59.648589] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47826 primary records. [2025-09-24T22:25:59.649352] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-24T22:25:59.663670] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-24T22:25:59.666680] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-24T22:25:59.669123] [INFO ] [MAIN ] Derivative Progress: 1588/2075 symbols completed. RTX took 1.2s. Estimated remaining: 3m 10s. Rate: 153.4 symbols/min [2025-09-24T22:25:59.670797] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-24T22:25:59.671208] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-24T22:25:59.673986] [INFO ] [MAIN ] Derivative Progress: 1589/2075 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 10s. Rate: 153.5 symbols/min [2025-09-24T22:25:59.696661] [DEBUG] [LOCAL ] RVT: Loaded 27074 existing records from primary storage. [2025-09-24T22:25:59.696826] [INFO ] [MAIN ] RVT: Loaded 27074 primary data records. [2025-09-24T22:26:00.011220] [DEBUG] [MAIN ] RVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:00.011900] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 27074 primary records. [2025-09-24T22:26:00.011965] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-24T22:26:00.027926] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-24T22:26:00.028005] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-24T22:26:00.030266] [INFO ] [MAIN ] Derivative Progress: 1590/2075 symbols completed. RVT took 0.4s. Estimated remaining: 3m 10s. Rate: 153.6 symbols/min [2025-09-24T22:26:00.031083] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:00.031209] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:00.031333] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:00.075333] [DEBUG] [LOCAL ] RWT: Loaded 40781 existing records from primary storage. [2025-09-24T22:26:00.086935] [INFO ] [MAIN ] RWT: Loaded 40781 primary data records. [2025-09-24T22:26:00.240144] [DEBUG] [LOCAL ] RVTY: Loaded 47533 existing records from primary storage. [2025-09-24T22:26:00.251885] [INFO ] [MAIN ] RVTY: Loaded 47533 primary data records. [2025-09-24T22:26:00.290447] [DEBUG] [LOCAL ] RXO: Loaded 47804 existing records from primary storage. [2025-09-24T22:26:00.326316] [INFO ] [MAIN ] RXO: Loaded 47804 primary data records. [2025-09-24T22:26:01.090146] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:01.091431] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40781 primary records. [2025-09-24T22:26:01.092088] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-24T22:26:01.111163] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-24T22:26:01.111537] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-24T22:26:01.113678] [INFO ] [MAIN ] Derivative Progress: 1591/2075 symbols completed. RWT took 1.1s. Estimated remaining: 3m 9s. Rate: 153.4 symbols/min [2025-09-24T22:26:01.114333] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:01.142897] [DEBUG] [MAIN ] RXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:01.148491] [DEBUG] [MAIN ] RVTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:01.150068] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47533 primary records. [2025-09-24T22:26:01.150162] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-24T22:26:01.149276] [INFO ] [MAIN ] RXO: Generated 1793 derivative records from 47804 primary records. [2025-09-24T22:26:01.150255] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-24T22:26:01.180664] [DEBUG] [LOCAL ] RXO: Derivative data saved (1793 records). [2025-09-24T22:26:01.180907] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-24T22:26:01.183752] [INFO ] [MAIN ] Derivative Progress: 1592/2075 symbols completed. RXO took 1.2s. Estimated remaining: 3m 9s. Rate: 153.5 symbols/min [2025-09-24T22:26:01.184344] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:01.186630] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-24T22:26:01.186909] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-24T22:26:01.189549] [INFO ] [MAIN ] Derivative Progress: 1593/2075 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 8s. Rate: 153.6 symbols/min [2025-09-24T22:26:01.189900] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:01.241128] [DEBUG] [LOCAL ] RY: Loaded 47905 existing records from primary storage. [2025-09-24T22:26:01.241462] [INFO ] [MAIN ] RY: Loaded 47905 primary data records. [2025-09-24T22:26:01.377371] [DEBUG] [LOCAL ] RYAM: Loaded 35165 existing records from primary storage. [2025-09-24T22:26:01.378102] [INFO ] [MAIN ] RYAM: Loaded 35165 primary data records. [2025-09-24T22:26:01.555686] [DEBUG] [LOCAL ] RYAN: Loaded 44204 existing records from primary storage. [2025-09-24T22:26:01.744611] [INFO ] [MAIN ] RYAN: Loaded 44204 primary data records. [2025-09-24T22:26:02.298906] [DEBUG] [MAIN ] RY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:02.302189] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47905 primary records. [2025-09-24T22:26:02.302497] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-24T22:26:02.329768] [DEBUG] [MAIN ] RYAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:02.333008] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35165 primary records. [2025-09-24T22:26:02.332300] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-24T22:26:02.333106] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-24T22:26:02.333405] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-24T22:26:02.344149] [INFO ] [MAIN ] Derivative Progress: 1594/2075 symbols completed. RY took 1.2s. Estimated remaining: 3m 8s. Rate: 153.4 symbols/min [2025-09-24T22:26:02.348134] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:02.366982] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:02.368051] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44204 primary records. [2025-09-24T22:26:02.368797] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-24T22:26:02.368861] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-24T22:26:02.369393] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-24T22:26:02.371876] [INFO ] [MAIN ] Derivative Progress: 1595/2075 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 8s. Rate: 153.5 symbols/min [2025-09-24T22:26:02.379672] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:02.392862] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-24T22:26:02.393107] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-24T22:26:02.395836] [INFO ] [MAIN ] Derivative Progress: 1596/2075 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 7s. Rate: 153.5 symbols/min [2025-09-24T22:26:02.396270] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:02.406849] [DEBUG] [LOCAL ] RYI: Loaded 21528 existing records from primary storage. [2025-09-24T22:26:02.407039] [INFO ] [MAIN ] RYI: Loaded 21528 primary data records. [2025-09-24T22:26:02.509319] [DEBUG] [LOCAL ] RZB: Loaded 6246 existing records from primary storage. [2025-09-24T22:26:02.520187] [INFO ] [MAIN ] RZB: Loaded 6246 primary data records. [2025-09-24T22:26:02.940770] [DEBUG] [LOCAL ] RYN: Loaded 45655 existing records from primary storage. [2025-09-24T22:26:03.051324] [INFO ] [MAIN ] RYN: Loaded 45655 primary data records. [2025-09-24T22:26:03.394862] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:03.407889] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21528 primary records. [2025-09-24T22:26:03.408323] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:03.408965] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6246 primary records. [2025-09-24T22:26:03.409069] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-24T22:26:03.410136] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-24T22:26:03.441288] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-24T22:26:03.441842] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-24T22:26:03.444425] [INFO ] [MAIN ] Derivative Progress: 1597/2075 symbols completed. RYI took 1.1s. Estimated remaining: 3m 7s. Rate: 153.4 symbols/min [2025-09-24T22:26:03.445071] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:03.446059] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-09-24T22:26:03.446206] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-24T22:26:03.448765] [INFO ] [MAIN ] Derivative Progress: 1598/2075 symbols completed. RZB took 1.1s. Estimated remaining: 3m 6s. Rate: 153.5 symbols/min [2025-09-24T22:26:03.449241] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:03.468332] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:03.469186] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45655 primary records. [2025-09-24T22:26:03.472582] [DEBUG] [LOCAL ] RZC: Loaded 6773 existing records from primary storage. [2025-09-24T22:26:03.472343] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-24T22:26:03.472846] [INFO ] [MAIN ] RZC: Loaded 6773 primary data records. [2025-09-24T22:26:03.733249] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-24T22:26:03.838697] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-24T22:26:03.874733] [INFO ] [MAIN ] Derivative Progress: 1599/2075 symbols completed. RYN took 1.5s. Estimated remaining: 3m 6s. Rate: 153.5 symbols/min [2025-09-24T22:26:03.875998] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:03.877281] [DEBUG] [LOCAL ] S: Loaded 53544 existing records from primary storage. [2025-09-24T22:26:03.878247] [INFO ] [MAIN ] S: Loaded 53544 primary data records. [2025-09-24T22:26:04.257041] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:04.258966] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6773 primary records. [2025-09-24T22:26:04.259282] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-24T22:26:04.260118] [DEBUG] [LOCAL ] SA: Loaded 43111 existing records from primary storage. [2025-09-24T22:26:04.261275] [INFO ] [MAIN ] SA: Loaded 43111 primary data records. [2025-09-24T22:26:04.423292] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-24T22:26:04.449197] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-24T22:26:04.592040] [INFO ] [MAIN ] Derivative Progress: 1600/2075 symbols completed. RZC took 1.1s. Estimated remaining: 3m 6s. Rate: 153.4 symbols/min [2025-09-24T22:26:04.606447] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:04.620546] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:04.622088] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53544 primary records. [2025-09-24T22:26:04.622245] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-24T22:26:04.641051] [DEBUG] [LOCAL ] SABA: Loaded 9195 existing records from primary storage. [2025-09-24T22:26:04.644066] [INFO ] [MAIN ] SABA: Loaded 9195 primary data records. [2025-09-24T22:26:04.760688] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-24T22:26:04.766969] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-24T22:26:04.780819] [INFO ] [MAIN ] Derivative Progress: 1601/2075 symbols completed. S took 1.3s. Estimated remaining: 3m 5s. Rate: 153.4 symbols/min [2025-09-24T22:26:04.806918] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:05.004617] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:05.006716] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43111 primary records. [2025-09-24T22:26:05.007387] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-24T22:26:05.040105] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-24T22:26:05.040398] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-24T22:26:05.043213] [INFO ] [MAIN ] Derivative Progress: 1602/2075 symbols completed. SA took 1.2s. Estimated remaining: 3m 5s. Rate: 153.5 symbols/min [2025-09-24T22:26:05.043810] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:05.058281] [DEBUG] [LOCAL ] SAFE: Loaded 30372 existing records from primary storage. [2025-09-24T22:26:05.058639] [INFO ] [MAIN ] SAFE: Loaded 30372 primary data records. [2025-09-24T22:26:05.105822] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:05.131768] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9195 primary records. [2025-09-24T22:26:05.141157] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-24T22:26:05.274369] [DEBUG] [LOCAL ] SAH: Loaded 22081 existing records from primary storage. [2025-09-24T22:26:05.304513] [INFO ] [MAIN ] SAH: Loaded 22081 primary data records. [2025-09-24T22:26:05.474869] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-24T22:26:05.504043] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-24T22:26:05.524421] [INFO ] [MAIN ] Derivative Progress: 1603/2075 symbols completed. SABA took 0.9s. Estimated remaining: 3m 5s. Rate: 153.4 symbols/min [2025-09-24T22:26:05.806500] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:05.807765] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30372 primary records. [2025-09-24T22:26:05.807947] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-24T22:26:05.826170] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-24T22:26:05.826507] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-24T22:26:05.828962] [INFO ] [MAIN ] Derivative Progress: 1604/2075 symbols completed. SAFE took 1.0s. Estimated remaining: 3m 4s. Rate: 153.5 symbols/min [2025-09-24T22:26:05.845243] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:05.846071] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22081 primary records. [2025-09-24T22:26:05.846134] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-24T22:26:05.861693] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-24T22:26:05.861762] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-24T22:26:05.864257] [INFO ] [MAIN ] Derivative Progress: 1605/2075 symbols completed. SAH took 0.8s. Estimated remaining: 3m 4s. Rate: 153.6 symbols/min [2025-09-24T22:26:05.864843] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:05.865087] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:05.865433] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:05.889036] [DEBUG] [LOCAL ] SAM: Loaded 21523 existing records from primary storage. [2025-09-24T22:26:05.889175] [INFO ] [MAIN ] SAM: Loaded 21523 primary data records. [2025-09-24T22:26:06.121512] [DEBUG] [LOCAL ] SAND: Loaded 51770 existing records from primary storage. [2025-09-24T22:26:06.243127] [INFO ] [MAIN ] SAND: Loaded 51770 primary data records. [2025-09-24T22:26:06.280427] [DEBUG] [LOCAL ] SAN: Loaded 53018 existing records from primary storage. [2025-09-24T22:26:06.302981] [INFO ] [MAIN ] SAN: Loaded 53018 primary data records. [2025-09-24T22:26:06.915190] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:06.916544] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21523 primary records. [2025-09-24T22:26:06.916797] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-24T22:26:06.952735] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-24T22:26:06.952615] [DEBUG] [MAIN ] SAND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:06.952920] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-24T22:26:06.955470] [INFO ] [MAIN ] Derivative Progress: 1606/2075 symbols completed. SAM took 1.1s. Estimated remaining: 3m 3s. Rate: 153.4 symbols/min [2025-09-24T22:26:06.955802] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:06.956794] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51770 primary records. [2025-09-24T22:26:06.956979] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-24T22:26:06.970427] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:06.978388] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 53018 primary records. [2025-09-24T22:26:06.982176] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-24T22:26:06.986493] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-24T22:26:06.986831] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-24T22:26:06.989211] [INFO ] [MAIN ] Derivative Progress: 1607/2075 symbols completed. SAND took 1.1s. Estimated remaining: 3m 3s. Rate: 153.5 symbols/min [2025-09-24T22:26:06.989471] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:07.007062] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-24T22:26:07.007208] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-24T22:26:07.009947] [INFO ] [MAIN ] Derivative Progress: 1608/2075 symbols completed. SAN took 1.1s. Estimated remaining: 3m 2s. Rate: 153.6 symbols/min [2025-09-24T22:26:07.014163] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:07.022052] [DEBUG] [LOCAL ] SAR: Loaded 16123 existing records from primary storage. [2025-09-24T22:26:07.022181] [INFO ] [MAIN ] SAR: Loaded 16123 primary data records. [2025-09-24T22:26:07.355116] [DEBUG] [LOCAL ] SAP: Loaded 50074 existing records from primary storage. [2025-09-24T22:26:07.368941] [INFO ] [MAIN ] SAP: Loaded 50074 primary data records. [2025-09-24T22:26:07.477041] [DEBUG] [LOCAL ] SARO: Loaded 48764 existing records from primary storage. [2025-09-24T22:26:07.513551] [INFO ] [MAIN ] SARO: Loaded 48764 primary data records. [2025-09-24T22:26:08.106402] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:08.107278] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16123 primary records. [2025-09-24T22:26:08.107485] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-24T22:26:08.131947] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-24T22:26:08.133370] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-24T22:26:08.136113] [INFO ] [MAIN ] Derivative Progress: 1609/2075 symbols completed. SAR took 1.1s. Estimated remaining: 3m 2s. Rate: 153.4 symbols/min [2025-09-24T22:26:08.139462] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:08.154393] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:08.155193] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50074 primary records. [2025-09-24T22:26:08.155312] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-24T22:26:08.184392] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:08.185826] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48764 primary records. [2025-09-24T22:26:08.186628] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-24T22:26:08.210706] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-24T22:26:08.212363] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-24T22:26:08.211864] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-24T22:26:08.224688] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-24T22:26:08.224540] [INFO ] [MAIN ] Derivative Progress: 1610/2075 symbols completed. SAP took 1.3s. Estimated remaining: 3m 2s. Rate: 153.5 symbols/min [2025-09-24T22:26:08.224990] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:08.228678] [DEBUG] [LOCAL ] SB: Loaded 33316 existing records from primary storage. [2025-09-24T22:26:08.227826] [INFO ] [MAIN ] Derivative Progress: 1611/2075 symbols completed. SARO took 1.2s. Estimated remaining: 3m 1s. Rate: 153.6 symbols/min [2025-09-24T22:26:08.229056] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:08.228955] [INFO ] [MAIN ] SB: Loaded 33316 primary data records. [2025-09-24T22:26:08.345458] [DEBUG] [LOCAL ] SBI: Loaded 7787 existing records from primary storage. [2025-09-24T22:26:08.345740] [INFO ] [MAIN ] SBI: Loaded 7787 primary data records. [2025-09-24T22:26:08.897108] [DEBUG] [LOCAL ] SBH: Loaded 49829 existing records from primary storage. [2025-09-24T22:26:08.898459] [INFO ] [MAIN ] SBH: Loaded 49829 primary data records. [2025-09-24T22:26:09.244959] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:09.248533] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33316 primary records. [2025-09-24T22:26:09.249574] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-24T22:26:09.277151] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:09.282432] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7787 primary records. [2025-09-24T22:26:09.283934] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-24T22:26:09.287863] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-24T22:26:09.288175] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-24T22:26:09.300016] [INFO ] [MAIN ] Derivative Progress: 1612/2075 symbols completed. SB took 1.2s. Estimated remaining: 3m 1s. Rate: 153.4 symbols/min [2025-09-24T22:26:09.306799] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:09.312510] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-24T22:26:09.312757] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-24T22:26:09.316008] [INFO ] [MAIN ] Derivative Progress: 1613/2075 symbols completed. SBI took 1.1s. Estimated remaining: 3m 1s. Rate: 153.5 symbols/min [2025-09-24T22:26:09.316983] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:09.336982] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:09.340300] [DEBUG] [LOCAL ] SBR: Loaded 7179 existing records from primary storage. [2025-09-24T22:26:09.340470] [INFO ] [MAIN ] SBR: Loaded 7179 primary data records. [2025-09-24T22:26:09.341248] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49829 primary records. [2025-09-24T22:26:09.352828] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-24T22:26:09.554445] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-24T22:26:09.666375] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-24T22:26:09.692086] [INFO ] [MAIN ] Derivative Progress: 1614/2075 symbols completed. SBH took 1.5s. Estimated remaining: 3m 0s. Rate: 153.5 symbols/min [2025-09-24T22:26:09.693440] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:09.694571] [DEBUG] [LOCAL ] SBS: Loaded 49512 existing records from primary storage. [2025-09-24T22:26:09.694809] [INFO ] [MAIN ] SBS: Loaded 49512 primary data records. [2025-09-24T22:26:09.839484] [DEBUG] [LOCAL ] SBSI: Loaded 14749 existing records from primary storage. [2025-09-24T22:26:09.864891] [INFO ] [MAIN ] SBSI: Loaded 14749 primary data records. [2025-09-24T22:26:10.222315] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:10.275084] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7179 primary records. [2025-09-24T22:26:10.280900] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-24T22:26:10.422608] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-24T22:26:10.424262] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-24T22:26:10.427066] [INFO ] [MAIN ] Derivative Progress: 1615/2075 symbols completed. SBR took 1.1s. Estimated remaining: 2m 60s. Rate: 153.4 symbols/min [2025-09-24T22:26:10.427890] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:10.444428] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:10.445436] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49512 primary records. [2025-09-24T22:26:10.445747] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-24T22:26:10.466710] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-24T22:26:10.479022] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-24T22:26:10.479436] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:10.482760] [INFO ] [MAIN ] Derivative Progress: 1616/2075 symbols completed. SBS took 1.2s. Estimated remaining: 2m 59s. Rate: 153.5 symbols/min [2025-09-24T22:26:10.480289] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14749 primary records. [2025-09-24T22:26:10.482998] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-24T22:26:10.484145] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:10.500436] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-24T22:26:10.500559] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-24T22:26:10.503287] [INFO ] [MAIN ] Derivative Progress: 1617/2075 symbols completed. SBSI took 0.8s. Estimated remaining: 2m 59s. Rate: 153.6 symbols/min [2025-09-24T22:26:10.503560] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:10.530416] [DEBUG] [LOCAL ] SCD: Loaded 12596 existing records from primary storage. [2025-09-24T22:26:10.530553] [INFO ] [MAIN ] SCD: Loaded 12596 primary data records. [2025-09-24T22:26:10.653528] [DEBUG] [LOCAL ] SBSW: Loaded 52965 existing records from primary storage. [2025-09-24T22:26:10.685362] [INFO ] [MAIN ] SBSW: Loaded 52965 primary data records. [2025-09-24T22:26:10.929868] [DEBUG] [LOCAL ] SCCO: Loaded 49388 existing records from primary storage. [2025-09-24T22:26:10.957257] [INFO ] [MAIN ] SCCO: Loaded 49388 primary data records. [2025-09-24T22:26:11.524139] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:11.525972] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12596 primary records. [2025-09-24T22:26:11.526559] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-24T22:26:11.549099] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-24T22:26:11.549463] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-24T22:26:11.551792] [INFO ] [MAIN ] Derivative Progress: 1618/2075 symbols completed. SCD took 1.0s. Estimated remaining: 2m 59s. Rate: 153.4 symbols/min [2025-09-24T22:26:11.565804] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:11.566668] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52965 primary records. [2025-09-24T22:26:11.566799] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-24T22:26:11.598079] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:11.599831] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49388 primary records. [2025-09-24T22:26:11.600192] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-24T22:26:11.601201] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-24T22:26:11.601313] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-24T22:26:11.604259] [INFO ] [MAIN ] Derivative Progress: 1619/2075 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 58s. Rate: 153.5 symbols/min [2025-09-24T22:26:11.619624] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-24T22:26:11.619723] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-24T22:26:11.622174] [INFO ] [MAIN ] Derivative Progress: 1620/2075 symbols completed. SCCO took 1.1s. Estimated remaining: 2m 58s. Rate: 153.6 symbols/min [2025-09-24T22:26:11.622895] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:11.623208] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:11.622843] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:11.643921] [DEBUG] [LOCAL ] SCL: Loaded 14862 existing records from primary storage. [2025-09-24T22:26:11.644068] [INFO ] [MAIN ] SCL: Loaded 14862 primary data records. [2025-09-24T22:26:11.937039] [DEBUG] [LOCAL ] SCI: Loaded 46671 existing records from primary storage. [2025-09-24T22:26:12.028264] [INFO ] [MAIN ] SCI: Loaded 46671 primary data records. [2025-09-24T22:26:12.042174] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-24T22:26:12.068556] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-09-24T22:26:12.659268] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:12.660284] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14862 primary records. [2025-09-24T22:26:12.660681] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-24T22:26:12.681084] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-24T22:26:12.682175] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-24T22:26:12.684868] [INFO ] [MAIN ] Derivative Progress: 1621/2075 symbols completed. SCL took 1.1s. Estimated remaining: 2m 58s. Rate: 153.4 symbols/min [2025-09-24T22:26:12.688684] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:12.715896] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:12.715560] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:12.716722] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46671 primary records. [2025-09-24T22:26:12.716825] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-24T22:26:12.717510] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-09-24T22:26:12.718307] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-24T22:26:12.752744] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-24T22:26:12.753318] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-24T22:26:12.756039] [INFO ] [MAIN ] Derivative Progress: 1622/2075 symbols completed. SCI took 1.1s. Estimated remaining: 2m 57s. Rate: 153.5 symbols/min [2025-09-24T22:26:12.756517] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:12.757533] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-09-24T22:26:12.757603] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-24T22:26:12.760096] [INFO ] [MAIN ] Derivative Progress: 1623/2075 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 57s. Rate: 153.6 symbols/min [2025-09-24T22:26:12.760905] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:12.768300] [DEBUG] [LOCAL ] SCM: Loaded 19803 existing records from primary storage. [2025-09-24T22:26:12.768476] [INFO ] [MAIN ] SCM: Loaded 19803 primary data records. [2025-09-24T22:26:13.104000] [DEBUG] [LOCAL ] SD: Loaded 28979 existing records from primary storage. [2025-09-24T22:26:13.116714] [INFO ] [MAIN ] SD: Loaded 28979 primary data records. [2025-09-24T22:26:13.128939] [DEBUG] [LOCAL ] SCS: Loaded 43120 existing records from primary storage. [2025-09-24T22:26:13.150309] [INFO ] [MAIN ] SCS: Loaded 43120 primary data records. [2025-09-24T22:26:13.811928] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:13.813228] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19803 primary records. [2025-09-24T22:26:13.813535] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-24T22:26:13.838673] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-24T22:26:13.842008] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-24T22:26:13.844713] [INFO ] [MAIN ] Derivative Progress: 1624/2075 symbols completed. SCM took 1.2s. Estimated remaining: 2m 56s. Rate: 153.4 symbols/min [2025-09-24T22:26:13.857337] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:13.870151] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:13.871098] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28979 primary records. [2025-09-24T22:26:13.871433] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:13.872535] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43120 primary records. [2025-09-24T22:26:13.872836] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-24T22:26:13.872688] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-24T22:26:13.905672] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-24T22:26:13.906361] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-24T22:26:13.909499] [INFO ] [MAIN ] Derivative Progress: 1625/2075 symbols completed. SCS took 1.2s. Estimated remaining: 2m 56s. Rate: 153.5 symbols/min [2025-09-24T22:26:13.910093] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:13.916405] [DEBUG] [LOCAL ] SDHC: Loaded 10459 existing records from primary storage. [2025-09-24T22:26:13.917234] [INFO ] [MAIN ] SDHC: Loaded 10459 primary data records. [2025-09-24T22:26:13.917146] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-24T22:26:13.917552] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-24T22:26:13.932230] [INFO ] [MAIN ] Derivative Progress: 1626/2075 symbols completed. SD took 1.2s. Estimated remaining: 2m 55s. Rate: 153.6 symbols/min [2025-09-24T22:26:13.952024] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:14.020472] [DEBUG] [LOCAL ] SDHY: Loaded 10565 existing records from primary storage. [2025-09-24T22:26:14.039050] [INFO ] [MAIN ] SDHY: Loaded 10565 primary data records. [2025-09-24T22:26:14.464301] [DEBUG] [LOCAL ] SDRL: Loaded 41884 existing records from primary storage. [2025-09-24T22:26:14.547954] [INFO ] [MAIN ] SDRL: Loaded 41884 primary data records. [2025-09-24T22:26:14.936706] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:14.938563] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10459 primary records. [2025-09-24T22:26:14.939909] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-24T22:26:14.971448] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:14.974142] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10565 primary records. [2025-09-24T22:26:14.974495] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-24T22:26:14.976511] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-24T22:26:14.976757] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-24T22:26:14.994877] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-24T22:26:14.995191] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-24T22:26:14.993540] [INFO ] [MAIN ] Derivative Progress: 1627/2075 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 55s. Rate: 153.4 symbols/min [2025-09-24T22:26:14.998069] [INFO ] [MAIN ] Derivative Progress: 1628/2075 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 55s. Rate: 153.5 symbols/min [2025-09-24T22:26:14.998486] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:14.998009] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:15.022066] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:15.023008] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41884 primary records. [2025-09-24T22:26:15.023178] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-24T22:26:15.030827] [DEBUG] [LOCAL ] SEG: Loaded 13754 existing records from primary storage. [2025-09-24T22:26:15.038452] [INFO ] [MAIN ] SEG: Loaded 13754 primary data records. [2025-09-24T22:26:15.187873] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-24T22:26:15.212339] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-24T22:26:15.215194] [INFO ] [MAIN ] Derivative Progress: 1629/2075 symbols completed. SDRL took 1.3s. Estimated remaining: 2m 54s. Rate: 153.6 symbols/min [2025-09-24T22:26:15.224359] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:15.385153] [DEBUG] [LOCAL ] SEE: Loaded 48341 existing records from primary storage. [2025-09-24T22:26:15.386009] [INFO ] [MAIN ] SEE: Loaded 48341 primary data records. [2025-09-24T22:26:15.745053] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:15.746075] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13754 primary records. [2025-09-24T22:26:15.747429] [DEBUG] [LOCAL ] SEI: Loaded 49645 existing records from primary storage. [2025-09-24T22:26:15.748084] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-24T22:26:15.748271] [INFO ] [MAIN ] SEI: Loaded 49645 primary data records. [2025-09-24T22:26:15.844917] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-24T22:26:15.850271] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-24T22:26:15.869121] [INFO ] [MAIN ] Derivative Progress: 1630/2075 symbols completed. SEG took 0.9s. Estimated remaining: 2m 54s. Rate: 153.5 symbols/min [2025-09-24T22:26:15.870225] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:16.110881] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:16.112186] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48341 primary records. [2025-09-24T22:26:16.112413] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-24T22:26:16.131052] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-24T22:26:16.131554] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-24T22:26:16.134285] [INFO ] [MAIN ] Derivative Progress: 1631/2075 symbols completed. SEE took 1.1s. Estimated remaining: 2m 54s. Rate: 153.5 symbols/min [2025-09-24T22:26:16.134552] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:16.179477] [DEBUG] [LOCAL ] SEM: Loaded 42940 existing records from primary storage. [2025-09-24T22:26:16.178411] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:16.180404] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49645 primary records. [2025-09-24T22:26:16.180574] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-24T22:26:16.180681] [INFO ] [MAIN ] SEM: Loaded 42940 primary data records. [2025-09-24T22:26:16.347848] [DEBUG] [LOCAL ] SEMR: Loaded 41586 existing records from primary storage. [2025-09-24T22:26:16.370423] [INFO ] [MAIN ] SEMR: Loaded 41586 primary data records. [2025-09-24T22:26:16.400483] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-24T22:26:16.420892] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-24T22:26:16.559707] [INFO ] [MAIN ] Derivative Progress: 1632/2075 symbols completed. SEI took 1.3s. Estimated remaining: 2m 53s. Rate: 153.5 symbols/min [2025-09-24T22:26:16.588903] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:16.880692] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:16.881517] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42940 primary records. [2025-09-24T22:26:16.882313] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-24T22:26:16.911145] [DEBUG] [LOCAL ] SES: Loaded 51552 existing records from primary storage. [2025-09-24T22:26:16.911946] [INFO ] [MAIN ] SES: Loaded 51552 primary data records. [2025-09-24T22:26:16.915173] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-24T22:26:16.915482] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-24T22:26:16.929290] [INFO ] [MAIN ] Derivative Progress: 1633/2075 symbols completed. SEM took 1.1s. Estimated remaining: 2m 53s. Rate: 153.5 symbols/min [2025-09-24T22:26:17.035236] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:17.041621] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41586 primary records. [2025-09-24T22:26:17.046856] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-24T22:26:17.136039] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-24T22:26:17.251330] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-24T22:26:17.254855] [INFO ] [MAIN ] Derivative Progress: 1634/2075 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 52s. Rate: 153.5 symbols/min [2025-09-24T22:26:17.281067] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:17.281733] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51552 primary records. [2025-09-24T22:26:17.281798] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-24T22:26:17.297502] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-24T22:26:17.297567] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-24T22:26:17.299863] [INFO ] [MAIN ] Derivative Progress: 1635/2075 symbols completed. SES took 0.7s. Estimated remaining: 2m 52s. Rate: 153.6 symbols/min [2025-09-24T22:26:17.300916] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:17.300775] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:17.300849] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:17.308943] [DEBUG] [LOCAL ] SFB: Loaded 3999 existing records from primary storage. [2025-09-24T22:26:17.309110] [INFO ] [MAIN ] SFB: Loaded 3999 primary data records. [2025-09-24T22:26:17.634986] [DEBUG] [LOCAL ] SFBS: Loaded 21272 existing records from primary storage. [2025-09-24T22:26:17.635733] [INFO ] [MAIN ] SFBS: Loaded 21272 primary data records. [2025-09-24T22:26:17.754868] [DEBUG] [LOCAL ] SF: Loaded 41759 existing records from primary storage. [2025-09-24T22:26:17.768518] [INFO ] [MAIN ] SF: Loaded 41759 primary data records. [2025-09-24T22:26:18.350054] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:18.351762] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 3999 primary records. [2025-09-24T22:26:18.352349] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-24T22:26:18.369269] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-24T22:26:18.370014] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-24T22:26:18.372826] [INFO ] [MAIN ] Derivative Progress: 1636/2075 symbols completed. SFB took 1.1s. Estimated remaining: 2m 52s. Rate: 153.5 symbols/min [2025-09-24T22:26:18.373195] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:18.392479] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:18.393277] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21272 primary records. [2025-09-24T22:26:18.393552] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-24T22:26:18.426746] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:18.427515] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41759 primary records. [2025-09-24T22:26:18.427714] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-24T22:26:18.426397] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-24T22:26:18.428412] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-24T22:26:18.430781] [INFO ] [MAIN ] Derivative Progress: 1637/2075 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 51s. Rate: 153.5 symbols/min [2025-09-24T22:26:18.431356] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:18.458773] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-24T22:26:18.470626] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-24T22:26:18.474225] [INFO ] [MAIN ] Derivative Progress: 1638/2075 symbols completed. SF took 1.2s. Estimated remaining: 2m 51s. Rate: 153.6 symbols/min [2025-09-24T22:26:18.475812] [DEBUG] [LOCAL ] SFL: Loaded 45305 existing records from primary storage. [2025-09-24T22:26:18.474618] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:18.476002] [INFO ] [MAIN ] SFL: Loaded 45305 primary data records. [2025-09-24T22:26:18.832345] [DEBUG] [LOCAL ] SG: Loaded 53448 existing records from primary storage. [2025-09-24T22:26:18.833280] [INFO ] [MAIN ] SG: Loaded 53448 primary data records. [2025-09-24T22:26:18.945580] [DEBUG] [LOCAL ] SGHC: Loaded 45708 existing records from primary storage. [2025-09-24T22:26:18.957307] [INFO ] [MAIN ] SGHC: Loaded 45708 primary data records. [2025-09-24T22:26:19.477244] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:19.480077] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45305 primary records. [2025-09-24T22:26:19.480424] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-24T22:26:19.500255] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-24T22:26:19.500558] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-24T22:26:19.503425] [INFO ] [MAIN ] Derivative Progress: 1639/2075 symbols completed. SFL took 1.1s. Estimated remaining: 2m 50s. Rate: 153.5 symbols/min [2025-09-24T22:26:19.503739] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:19.524837] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:19.526179] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53448 primary records. [2025-09-24T22:26:19.529625] [DEBUG] [LOCAL ] SGU: Loaded 6649 existing records from primary storage. [2025-09-24T22:26:19.529779] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-24T22:26:19.529858] [INFO ] [MAIN ] SGU: Loaded 6649 primary data records. [2025-09-24T22:26:19.688708] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:19.695172] [INFO ] [MAIN ] SGHC: Generated 1793 derivative records from 45708 primary records. [2025-09-24T22:26:19.695818] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-24T22:26:19.696425] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-24T22:26:19.696505] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-24T22:26:19.723067] [INFO ] [MAIN ] Derivative Progress: 1640/2075 symbols completed. SG took 1.3s. Estimated remaining: 2m 50s. Rate: 153.5 symbols/min [2025-09-24T22:26:19.922704] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:19.936769] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1793 records). [2025-09-24T22:26:19.937020] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-24T22:26:19.939832] [INFO ] [MAIN ] Derivative Progress: 1641/2075 symbols completed. SGHC took 1.5s. Estimated remaining: 2m 50s. Rate: 153.6 symbols/min [2025-09-24T22:26:19.940665] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:19.970956] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7729 incomplete bins [2025-09-24T22:26:19.971868] [INFO ] [MAIN ] SGU: Generated 1789 derivative records from 6649 primary records. [2025-09-24T22:26:19.971934] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-24T22:26:20.002048] [DEBUG] [LOCAL ] SHCO: Loaded 26028 existing records from primary storage. [2025-09-24T22:26:20.006292] [INFO ] [MAIN ] SHCO: Loaded 26028 primary data records. [2025-09-24T22:26:20.006151] [DEBUG] [LOCAL ] SGU: Derivative data saved (1789 records). [2025-09-24T22:26:20.011707] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-24T22:26:20.043734] [INFO ] [MAIN ] Derivative Progress: 1642/2075 symbols completed. SGU took 0.5s. Estimated remaining: 2m 49s. Rate: 153.6 symbols/min [2025-09-24T22:26:20.044163] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:20.137536] [DEBUG] [LOCAL ] SHAK: Loaded 49120 existing records from primary storage. [2025-09-24T22:26:20.143283] [INFO ] [MAIN ] SHAK: Loaded 49120 primary data records. [2025-09-24T22:26:20.692190] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-09-24T22:26:20.692501] [INFO ] [MAIN ] SHEL: Loaded 53671 primary data records. [2025-09-24T22:26:21.017912] [DEBUG] [MAIN ] SHCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:21.019422] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 26028 primary records. [2025-09-24T22:26:21.019869] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-24T22:26:21.040952] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-24T22:26:21.041410] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-24T22:26:21.043719] [INFO ] [MAIN ] Derivative Progress: 1643/2075 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 49s. Rate: 153.5 symbols/min [2025-09-24T22:26:21.056381] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:21.057579] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:21.058461] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49120 primary records. [2025-09-24T22:26:21.058784] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-24T22:26:21.090839] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:21.099893] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-24T22:26:21.100066] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-24T22:26:21.099387] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53671 primary records. [2025-09-24T22:26:21.100162] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-24T22:26:21.102297] [INFO ] [MAIN ] Derivative Progress: 1644/2075 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 48s. Rate: 153.6 symbols/min [2025-09-24T22:26:21.103046] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:21.126844] [DEBUG] [LOCAL ] SHG: Loaded 26963 existing records from primary storage. [2025-09-24T22:26:21.128273] [INFO ] [MAIN ] SHG: Loaded 26963 primary data records. [2025-09-24T22:26:21.239207] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-24T22:26:21.242896] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-24T22:26:21.245314] [INFO ] [MAIN ] Derivative Progress: 1645/2075 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 48s. Rate: 153.6 symbols/min [2025-09-24T22:26:21.251704] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:21.470381] [DEBUG] [LOCAL ] SHOC: Loaded 3716 existing records from primary storage. [2025-09-24T22:26:21.471497] [DEBUG] [LOCAL ] SHO: Loaded 49825 existing records from primary storage. [2025-09-24T22:26:21.470569] [INFO ] [MAIN ] SHOC: Loaded 3716 primary data records. [2025-09-24T22:26:21.483413] [INFO ] [MAIN ] SHO: Loaded 49825 primary data records. [2025-09-24T22:26:22.148826] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:22.149865] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26963 primary records. [2025-09-24T22:26:22.150581] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-24T22:26:22.168192] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-24T22:26:22.168401] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-24T22:26:22.170722] [INFO ] [MAIN ] Derivative Progress: 1646/2075 symbols completed. SHG took 1.1s. Estimated remaining: 2m 48s. Rate: 153.5 symbols/min [2025-09-24T22:26:22.172402] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:22.190410] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:22.191166] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3716 primary records. [2025-09-24T22:26:22.191397] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-24T22:26:22.207556] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-24T22:26:22.208623] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-24T22:26:22.211361] [INFO ] [MAIN ] Derivative Progress: 1647/2075 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 47s. Rate: 153.6 symbols/min [2025-09-24T22:26:22.211874] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:22.225358] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:22.226211] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49825 primary records. [2025-09-24T22:26:22.226340] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-24T22:26:22.253621] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-24T22:26:22.253805] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-24T22:26:22.256351] [INFO ] [MAIN ] Derivative Progress: 1648/2075 symbols completed. SHO took 1.2s. Estimated remaining: 2m 47s. Rate: 153.7 symbols/min [2025-09-24T22:26:22.272020] [DEBUG] [LOCAL ] SHW: Loaded 50451 existing records from primary storage. [2025-09-24T22:26:22.280604] [INFO ] [MAIN ] SHW: Loaded 50451 primary data records. [2025-09-24T22:26:22.420931] [DEBUG] [LOCAL ] SID: Loaded 42217 existing records from primary storage. [2025-09-24T22:26:22.444479] [INFO ] [MAIN ] SID: Loaded 42217 primary data records. [2025-09-24T22:26:22.921810] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:22.922617] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50451 primary records. [2025-09-24T22:26:22.923677] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-24T22:26:22.940724] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-24T22:26:22.940803] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-24T22:26:22.943046] [INFO ] [MAIN ] Derivative Progress: 1649/2075 symbols completed. SHW took 0.8s. Estimated remaining: 2m 46s. Rate: 153.6 symbols/min [2025-09-24T22:26:22.959544] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:22.960215] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42217 primary records. [2025-09-24T22:26:22.960279] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-24T22:26:22.975609] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-24T22:26:22.975701] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-24T22:26:22.978133] [INFO ] [MAIN ] Derivative Progress: 1650/2075 symbols completed. SID took 0.8s. Estimated remaining: 2m 46s. Rate: 153.7 symbols/min [2025-09-24T22:26:22.979071] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:22.979389] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:22.979312] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:23.004339] [DEBUG] [LOCAL ] SII: Loaded 23247 existing records from primary storage. [2025-09-24T22:26:23.011909] [INFO ] [MAIN ] SII: Loaded 23247 primary data records. [2025-09-24T22:26:23.145572] [DEBUG] [LOCAL ] SILA: Loaded 31333 existing records from primary storage. [2025-09-24T22:26:23.156568] [INFO ] [MAIN ] SILA: Loaded 31333 primary data records. [2025-09-24T22:26:23.300956] [DEBUG] [LOCAL ] SIG: Loaded 46524 existing records from primary storage. [2025-09-24T22:26:23.318261] [INFO ] [MAIN ] SIG: Loaded 46524 primary data records. [2025-09-24T22:26:24.030444] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:24.031439] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23247 primary records. [2025-09-24T22:26:24.032759] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-24T22:26:24.052172] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-24T22:26:24.053065] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-24T22:26:24.055425] [INFO ] [MAIN ] Derivative Progress: 1651/2075 symbols completed. SII took 1.1s. Estimated remaining: 2m 46s. Rate: 153.5 symbols/min [2025-09-24T22:26:24.056101] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:24.070888] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:24.072028] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31333 primary records. [2025-09-24T22:26:24.072225] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-24T22:26:24.090806] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-24T22:26:24.091714] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-24T22:26:24.094130] [INFO ] [MAIN ] Derivative Progress: 1652/2075 symbols completed. SILA took 1.1s. Estimated remaining: 2m 45s. Rate: 153.6 symbols/min [2025-09-24T22:26:24.094593] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:24.107499] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:24.108844] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46524 primary records. [2025-09-24T22:26:24.108909] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-24T22:26:24.135044] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-24T22:26:24.135179] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-24T22:26:24.137705] [INFO ] [MAIN ] Derivative Progress: 1653/2075 symbols completed. SIG took 1.2s. Estimated remaining: 2m 45s. Rate: 153.7 symbols/min [2025-09-24T22:26:24.138046] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:24.154924] [DEBUG] [LOCAL ] SITC: Loaded 41572 existing records from primary storage. [2025-09-24T22:26:24.155151] [INFO ] [MAIN ] SITC: Loaded 41572 primary data records. [2025-09-24T22:26:24.291446] [DEBUG] [LOCAL ] SITE: Loaded 35058 existing records from primary storage. [2025-09-24T22:26:24.297414] [INFO ] [MAIN ] SITE: Loaded 35058 primary data records. [2025-09-24T22:26:24.648263] [DEBUG] [LOCAL ] SJM: Loaded 50133 existing records from primary storage. [2025-09-24T22:26:24.708914] [INFO ] [MAIN ] SJM: Loaded 50133 primary data records. [2025-09-24T22:26:25.156342] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:25.157218] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41572 primary records. [2025-09-24T22:26:25.158316] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-24T22:26:25.189500] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:25.192690] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-24T22:26:25.193848] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35058 primary records. [2025-09-24T22:26:25.193019] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-24T22:26:25.196504] [INFO ] [MAIN ] Derivative Progress: 1654/2075 symbols completed. SITC took 1.1s. Estimated remaining: 2m 45s. Rate: 153.5 symbols/min [2025-09-24T22:26:25.197082] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:25.198149] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-24T22:26:25.227258] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:25.229092] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50133 primary records. [2025-09-24T22:26:25.229230] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-24T22:26:25.265615] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-24T22:26:25.258981] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-24T22:26:25.266874] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-24T22:26:25.266983] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-24T22:26:25.269510] [INFO ] [MAIN ] Derivative Progress: 1655/2075 symbols completed. SJM took 1.1s. Estimated remaining: 2m 44s. Rate: 153.6 symbols/min [2025-09-24T22:26:25.272251] [DEBUG] [LOCAL ] SJT: Loaded 22145 existing records from primary storage. [2025-09-24T22:26:25.272636] [INFO ] [MAIN ] SJT: Loaded 22145 primary data records. [2025-09-24T22:26:25.272877] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:25.272776] [INFO ] [MAIN ] Derivative Progress: 1656/2075 symbols completed. SITE took 1.2s. Estimated remaining: 2m 44s. Rate: 153.7 symbols/min [2025-09-24T22:26:25.285132] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:25.407699] [DEBUG] [LOCAL ] SKIL: Loaded 6336 existing records from primary storage. [2025-09-24T22:26:25.444229] [INFO ] [MAIN ] SKIL: Loaded 6336 primary data records. [2025-09-24T22:26:25.722213] [DEBUG] [LOCAL ] SKE: Loaded 35654 existing records from primary storage. [2025-09-24T22:26:25.723115] [INFO ] [MAIN ] SKE: Loaded 35654 primary data records. [2025-09-24T22:26:26.307772] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:26.309203] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22145 primary records. [2025-09-24T22:26:26.309351] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-24T22:26:26.333454] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-24T22:26:26.333681] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-24T22:26:26.336770] [INFO ] [MAIN ] Derivative Progress: 1657/2075 symbols completed. SJT took 1.1s. Estimated remaining: 2m 43s. Rate: 153.5 symbols/min [2025-09-24T22:26:26.345445] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:26.351034] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:26.352343] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6336 primary records. [2025-09-24T22:26:26.352674] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-24T22:26:26.392754] [DEBUG] [LOCAL ] SKLZ: Loaded 11946 existing records from primary storage. [2025-09-24T22:26:26.393493] [INFO ] [MAIN ] SKLZ: Loaded 11946 primary data records. [2025-09-24T22:26:26.394272] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-24T22:26:26.394407] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-24T22:26:26.393855] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:26.400496] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35654 primary records. [2025-09-24T22:26:26.409787] [INFO ] [MAIN ] Derivative Progress: 1658/2075 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 43s. Rate: 153.6 symbols/min [2025-09-24T22:26:26.430436] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-24T22:26:26.458403] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:26.754133] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-24T22:26:26.754427] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-24T22:26:26.757116] [INFO ] [MAIN ] Derivative Progress: 1659/2075 symbols completed. SKE took 1.5s. Estimated remaining: 2m 42s. Rate: 153.6 symbols/min [2025-09-24T22:26:26.769535] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:26.770731] [DEBUG] [LOCAL ] SKM: Loaded 35139 existing records from primary storage. [2025-09-24T22:26:26.772639] [INFO ] [MAIN ] SKM: Loaded 35139 primary data records. [2025-09-24T22:26:27.136972] [DEBUG] [LOCAL ] SKT: Loaded 42650 existing records from primary storage. [2025-09-24T22:26:27.135915] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:27.137173] [INFO ] [MAIN ] SKT: Loaded 42650 primary data records. [2025-09-24T22:26:27.138022] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11946 primary records. [2025-09-24T22:26:27.159335] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-24T22:26:27.272211] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-24T22:26:27.293947] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-24T22:26:27.311343] [INFO ] [MAIN ] Derivative Progress: 1660/2075 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 42s. Rate: 153.6 symbols/min [2025-09-24T22:26:27.348603] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:27.497580] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:27.499001] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35139 primary records. [2025-09-24T22:26:27.499268] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-24T22:26:27.529076] [DEBUG] [LOCAL ] SKYH: Loaded 16626 existing records from primary storage. [2025-09-24T22:26:27.531947] [INFO ] [MAIN ] SKYH: Loaded 16626 primary data records. [2025-09-24T22:26:27.545693] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-24T22:26:27.567691] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-24T22:26:27.584391] [INFO ] [MAIN ] Derivative Progress: 1661/2075 symbols completed. SKM took 1.1s. Estimated remaining: 2m 42s. Rate: 153.6 symbols/min [2025-09-24T22:26:27.610362] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:27.959301] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:27.960513] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42650 primary records. [2025-09-24T22:26:27.960697] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-24T22:26:27.996524] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-24T22:26:27.996887] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-24T22:26:27.999228] [INFO ] [MAIN ] Derivative Progress: 1662/2075 symbols completed. SKT took 1.2s. Estimated remaining: 2m 41s. Rate: 153.6 symbols/min [2025-09-24T22:26:27.999898] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:28.020051] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-24T22:26:28.020345] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-24T22:26:28.226276] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:28.233236] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16626 primary records. [2025-09-24T22:26:28.357270] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-24T22:26:28.371553] [DEBUG] [LOCAL ] SLF: Loaded 38957 existing records from primary storage. [2025-09-24T22:26:28.379957] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-24T22:26:28.380206] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-24T22:26:28.378624] [INFO ] [MAIN ] SLF: Loaded 38957 primary data records. [2025-09-24T22:26:28.388882] [INFO ] [MAIN ] Derivative Progress: 1663/2075 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 41s. Rate: 153.6 symbols/min [2025-09-24T22:26:28.707420] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:28.709105] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-24T22:26:28.709433] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-24T22:26:28.729438] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-24T22:26:28.729819] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-24T22:26:28.732177] [INFO ] [MAIN ] Derivative Progress: 1664/2075 symbols completed. SLB took 1.1s. Estimated remaining: 2m 41s. Rate: 153.6 symbols/min [2025-09-24T22:26:28.748462] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:28.749172] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38957 primary records. [2025-09-24T22:26:28.749238] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-24T22:26:28.764499] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-24T22:26:28.764581] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-24T22:26:28.767242] [INFO ] [MAIN ] Derivative Progress: 1665/2075 symbols completed. SLF took 0.8s. Estimated remaining: 2m 40s. Rate: 153.7 symbols/min [2025-09-24T22:26:28.768315] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:28.768601] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:28.768014] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:28.866231] [DEBUG] [LOCAL ] SLQT: Loaded 43866 existing records from primary storage. [2025-09-24T22:26:28.866529] [INFO ] [MAIN ] SLQT: Loaded 43866 primary data records. [2025-09-24T22:26:28.867129] [DEBUG] [LOCAL ] SLGN: Loaded 40337 existing records from primary storage. [2025-09-24T22:26:28.885807] [INFO ] [MAIN ] SLGN: Loaded 40337 primary data records. [2025-09-24T22:26:28.937106] [DEBUG] [LOCAL ] SLG: Loaded 45524 existing records from primary storage. [2025-09-24T22:26:28.973177] [INFO ] [MAIN ] SLG: Loaded 45524 primary data records. [2025-09-24T22:26:29.876822] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:29.884707] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40337 primary records. [2025-09-24T22:26:29.885065] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:29.885815] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-24T22:26:29.887932] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43866 primary records. [2025-09-24T22:26:29.888192] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-24T22:26:29.931787] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-24T22:26:29.938701] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-24T22:26:29.940876] [INFO ] [MAIN ] Derivative Progress: 1666/2075 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 40s. Rate: 153.5 symbols/min [2025-09-24T22:26:29.941692] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:29.938345] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:29.943442] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45524 primary records. [2025-09-24T22:26:29.944202] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-24T22:26:29.947307] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-24T22:26:29.954511] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-24T22:26:29.957412] [INFO ] [MAIN ] Derivative Progress: 1667/2075 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 39s. Rate: 153.6 symbols/min [2025-09-24T22:26:29.959144] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:29.971101] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-24T22:26:29.978996] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-24T22:26:29.982360] [INFO ] [MAIN ] Derivative Progress: 1668/2075 symbols completed. SLG took 1.2s. Estimated remaining: 2m 39s. Rate: 153.7 symbols/min [2025-09-24T22:26:29.982967] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:29.999891] [DEBUG] [LOCAL ] SLVM: Loaded 27971 existing records from primary storage. [2025-09-24T22:26:30.000216] [INFO ] [MAIN ] SLVM: Loaded 27971 primary data records. [2025-09-24T22:26:30.067416] [DEBUG] [LOCAL ] SMBK: Loaded 8254 existing records from primary storage. [2025-09-24T22:26:30.090262] [INFO ] [MAIN ] SMBK: Loaded 8254 primary data records. [2025-09-24T22:26:30.343708] [DEBUG] [LOCAL ] SM: Loaded 52313 existing records from primary storage. [2025-09-24T22:26:30.617594] [INFO ] [MAIN ] SM: Loaded 52313 primary data records. [2025-09-24T22:26:31.326033] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:31.328110] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27971 primary records. [2025-09-24T22:26:31.328198] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-24T22:26:31.350299] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-24T22:26:31.350607] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-24T22:26:31.352835] [INFO ] [MAIN ] Derivative Progress: 1669/2075 symbols completed. SLVM took 1.4s. Estimated remaining: 2m 39s. Rate: 153.4 symbols/min [2025-09-24T22:26:31.353397] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:31.374579] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:31.379151] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8254 primary records. [2025-09-24T22:26:31.379914] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-24T22:26:31.404170] [DEBUG] [LOCAL ] SMC: Loaded 11512 existing records from primary storage. [2025-09-24T22:26:31.405215] [INFO ] [MAIN ] SMC: Loaded 11512 primary data records. [2025-09-24T22:26:31.404964] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-24T22:26:31.405488] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-24T22:26:31.431500] [INFO ] [MAIN ] Derivative Progress: 1670/2075 symbols completed. SMBK took 1.4s. Estimated remaining: 2m 38s. Rate: 153.5 symbols/min [2025-09-24T22:26:31.441608] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:31.458355] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52313 primary records. [2025-09-24T22:26:31.468910] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-24T22:26:31.463720] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:31.636174] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-24T22:26:31.751044] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-24T22:26:31.767395] [INFO ] [MAIN ] Derivative Progress: 1671/2075 symbols completed. SM took 1.8s. Estimated remaining: 2m 38s. Rate: 153.5 symbols/min [2025-09-24T22:26:31.769013] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:31.813676] [DEBUG] [LOCAL ] SMFG: Loaded 48090 existing records from primary storage. [2025-09-24T22:26:31.814843] [INFO ] [MAIN ] SMFG: Loaded 48090 primary data records. [2025-09-24T22:26:31.910434] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:31.929273] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11512 primary records. [2025-09-24T22:26:31.946574] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-24T22:26:31.993185] [DEBUG] [LOCAL ] SMG: Loaded 43911 existing records from primary storage. [2025-09-24T22:26:31.998798] [INFO ] [MAIN ] SMG: Loaded 43911 primary data records. [2025-09-24T22:26:32.296515] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-24T22:26:32.343792] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-24T22:26:32.367447] [INFO ] [MAIN ] Derivative Progress: 1672/2075 symbols completed. SMC took 1.0s. Estimated remaining: 2m 38s. Rate: 153.5 symbols/min [2025-09-24T22:26:32.367800] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:32.540886] [DEBUG] [LOCAL ] SMHI: Loaded 13809 existing records from primary storage. [2025-09-24T22:26:32.541903] [INFO ] [MAIN ] SMHI: Loaded 13809 primary data records. [2025-09-24T22:26:32.670490] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:32.692292] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48090 primary records. [2025-09-24T22:26:32.692428] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-24T22:26:32.894864] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-24T22:26:32.896569] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-24T22:26:32.899495] [INFO ] [MAIN ] Derivative Progress: 1673/2075 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 37s. Rate: 153.4 symbols/min [2025-09-24T22:26:32.901222] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:32.915618] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:32.917326] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43911 primary records. [2025-09-24T22:26:32.917571] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-24T22:26:32.944737] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-24T22:26:32.944939] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-24T22:26:32.947377] [INFO ] [MAIN ] Derivative Progress: 1674/2075 symbols completed. SMG took 1.2s. Estimated remaining: 2m 37s. Rate: 153.5 symbols/min [2025-09-24T22:26:32.956467] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:32.957196] [DEBUG] [LOCAL ] SMP: Loaded 19784 existing records from primary storage. [2025-09-24T22:26:32.958013] [INFO ] [MAIN ] SMP: Loaded 19784 primary data records. [2025-09-24T22:26:33.088987] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:33.100385] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13809 primary records. [2025-09-24T22:26:33.106030] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-24T22:26:33.314606] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-24T22:26:33.315015] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-24T22:26:33.317452] [INFO ] [MAIN ] Derivative Progress: 1675/2075 symbols completed. SMHI took 0.9s. Estimated remaining: 2m 36s. Rate: 153.5 symbols/min [2025-09-24T22:26:33.331534] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:33.334425] [DEBUG] [LOCAL ] SMRT: Loaded 44219 existing records from primary storage. [2025-09-24T22:26:33.335235] [INFO ] [MAIN ] SMRT: Loaded 44219 primary data records. [2025-09-24T22:26:33.710530] [DEBUG] [LOCAL ] SMWB: Loaded 32775 existing records from primary storage. [2025-09-24T22:26:33.711775] [INFO ] [MAIN ] SMWB: Loaded 32775 primary data records. [2025-09-24T22:26:33.840927] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:33.841975] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19784 primary records. [2025-09-24T22:26:33.842590] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-24T22:26:33.964695] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-24T22:26:34.069610] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-24T22:26:34.085158] [INFO ] [MAIN ] Derivative Progress: 1676/2075 symbols completed. SMP took 1.2s. Estimated remaining: 2m 36s. Rate: 153.4 symbols/min [2025-09-24T22:26:34.086529] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:34.105241] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:34.106699] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44219 primary records. [2025-09-24T22:26:34.107067] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-24T22:26:34.124819] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-24T22:26:34.124969] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-24T22:26:34.127494] [INFO ] [MAIN ] Derivative Progress: 1677/2075 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 36s. Rate: 153.5 symbols/min [2025-09-24T22:26:34.128214] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:34.149117] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:34.149822] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32775 primary records. [2025-09-24T22:26:34.149931] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-24T22:26:34.184078] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-24T22:26:34.184202] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-24T22:26:34.187273] [INFO ] [MAIN ] Derivative Progress: 1678/2075 symbols completed. SMWB took 0.9s. Estimated remaining: 2m 35s. Rate: 153.6 symbols/min [2025-09-24T22:26:34.212486] [DEBUG] [LOCAL ] SNA: Loaded 26318 existing records from primary storage. [2025-09-24T22:26:34.213705] [INFO ] [MAIN ] SNA: Loaded 26318 primary data records. [2025-09-24T22:26:34.260157] [DEBUG] [LOCAL ] SN: Loaded 49791 existing records from primary storage. [2025-09-24T22:26:34.282743] [INFO ] [MAIN ] SN: Loaded 49791 primary data records. [2025-09-24T22:26:34.904523] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:34.905472] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49791 primary records. [2025-09-24T22:26:34.918127] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-24T22:26:34.918896] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:34.920212] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26318 primary records. [2025-09-24T22:26:34.920521] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-24T22:26:34.945501] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-24T22:26:34.945629] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-24T22:26:34.951001] [INFO ] [MAIN ] Derivative Progress: 1679/2075 symbols completed. SN took 0.9s. Estimated remaining: 2m 35s. Rate: 153.5 symbols/min [2025-09-24T22:26:34.955843] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-24T22:26:34.955964] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-24T22:26:34.958582] [INFO ] [MAIN ] Derivative Progress: 1680/2075 symbols completed. SNA took 0.8s. Estimated remaining: 2m 34s. Rate: 153.6 symbols/min [2025-09-24T22:26:34.959717] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:34.959921] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:34.960203] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:34.968341] [DEBUG] [LOCAL ] SNDA: Loaded 4672 existing records from primary storage. [2025-09-24T22:26:34.968515] [INFO ] [MAIN ] SNDA: Loaded 4672 primary data records. [2025-09-24T22:26:35.307829] [DEBUG] [LOCAL ] SNDR: Loaded 40714 existing records from primary storage. [2025-09-24T22:26:35.323982] [INFO ] [MAIN ] SNDR: Loaded 40714 primary data records. [2025-09-24T22:26:35.369494] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-24T22:26:35.396301] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-24T22:26:35.983277] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:35.985543] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4672 primary records. [2025-09-24T22:26:35.985857] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-24T22:26:36.007964] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-24T22:26:36.009410] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-24T22:26:36.013017] [INFO ] [MAIN ] Derivative Progress: 1681/2075 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 34s. Rate: 153.5 symbols/min [2025-09-24T22:26:36.013981] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:36.034002] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:36.035161] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40714 primary records. [2025-09-24T22:26:36.037935] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-24T22:26:36.065975] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:36.069977] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-24T22:26:36.068998] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-24T22:26:36.070075] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-24T22:26:36.070240] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-24T22:26:36.075584] [INFO ] [MAIN ] Derivative Progress: 1682/2075 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 34s. Rate: 153.5 symbols/min [2025-09-24T22:26:36.083361] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:36.104168] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-24T22:26:36.104431] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-24T22:26:36.106907] [INFO ] [MAIN ] Derivative Progress: 1683/2075 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 33s. Rate: 153.6 symbols/min [2025-09-24T22:26:36.107318] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:36.125208] [DEBUG] [LOCAL ] SNN: Loaded 44392 existing records from primary storage. [2025-09-24T22:26:36.125362] [INFO ] [MAIN ] SNN: Loaded 44392 primary data records. [2025-09-24T22:26:36.362180] [DEBUG] [LOCAL ] SNV: Loaded 48908 existing records from primary storage. [2025-09-24T22:26:36.362039] [DEBUG] [LOCAL ] SNX: Loaded 39794 existing records from primary storage. [2025-09-24T22:26:36.366574] [INFO ] [MAIN ] SNV: Loaded 48908 primary data records. [2025-09-24T22:26:36.366394] [INFO ] [MAIN ] SNX: Loaded 39794 primary data records. [2025-09-24T22:26:37.193225] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:37.194607] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44392 primary records. [2025-09-24T22:26:37.194907] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-24T22:26:37.214720] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-24T22:26:37.215467] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-24T22:26:37.217701] [INFO ] [MAIN ] Derivative Progress: 1684/2075 symbols completed. SNN took 1.2s. Estimated remaining: 2m 33s. Rate: 153.4 symbols/min [2025-09-24T22:26:37.219697] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:37.237015] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:37.238265] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39794 primary records. [2025-09-24T22:26:37.239438] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-24T22:26:37.272396] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:37.273846] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48908 primary records. [2025-09-24T22:26:37.274295] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-24T22:26:37.274872] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-24T22:26:37.276184] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-24T22:26:37.285836] [INFO ] [MAIN ] Derivative Progress: 1685/2075 symbols completed. SNX took 1.2s. Estimated remaining: 2m 32s. Rate: 153.5 symbols/min [2025-09-24T22:26:37.299184] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:37.304384] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-24T22:26:37.304471] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-24T22:26:37.306974] [INFO ] [MAIN ] Derivative Progress: 1686/2075 symbols completed. SNV took 1.2s. Estimated remaining: 2m 32s. Rate: 153.6 symbols/min [2025-09-24T22:26:37.307357] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:37.321221] [DEBUG] [LOCAL ] SOBO: Loaded 39598 existing records from primary storage. [2025-09-24T22:26:37.321544] [INFO ] [MAIN ] SOBO: Loaded 39598 primary data records. [2025-09-24T22:26:37.382140] [DEBUG] [LOCAL ] SOJC: Loaded 5058 existing records from primary storage. [2025-09-24T22:26:37.400160] [INFO ] [MAIN ] SOJC: Loaded 5058 primary data records. [2025-09-24T22:26:37.763018] [DEBUG] [LOCAL ] SOC: Loaded 50261 existing records from primary storage. [2025-09-24T22:26:37.872517] [INFO ] [MAIN ] SOC: Loaded 50261 primary data records. [2025-09-24T22:26:38.352242] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:38.353637] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5058 primary records. [2025-09-24T22:26:38.362670] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-24T22:26:38.368166] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:38.370549] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39598 primary records. [2025-09-24T22:26:38.370724] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-24T22:26:38.399115] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-24T22:26:38.399971] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-24T22:26:38.402757] [INFO ] [MAIN ] Derivative Progress: 1687/2075 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 32s. Rate: 153.4 symbols/min [2025-09-24T22:26:38.403671] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:38.415557] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-24T22:26:38.415905] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-24T22:26:38.418152] [INFO ] [MAIN ] Derivative Progress: 1688/2075 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 31s. Rate: 153.5 symbols/min [2025-09-24T22:26:38.418819] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:38.437023] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:38.437347] [DEBUG] [LOCAL ] SOJD: Loaded 12935 existing records from primary storage. [2025-09-24T22:26:38.438677] [INFO ] [MAIN ] SOJD: Loaded 12935 primary data records. [2025-09-24T22:26:38.438594] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50261 primary records. [2025-09-24T22:26:38.450362] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-24T22:26:38.552544] [DEBUG] [LOCAL ] SOJE: Loaded 9259 existing records from primary storage. [2025-09-24T22:26:38.566421] [INFO ] [MAIN ] SOJE: Loaded 9259 primary data records. [2025-09-24T22:26:38.861697] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-24T22:26:38.944030] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-24T22:26:38.946793] [INFO ] [MAIN ] Derivative Progress: 1689/2075 symbols completed. SOC took 1.6s. Estimated remaining: 2m 31s. Rate: 153.5 symbols/min [2025-09-24T22:26:38.947466] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:39.157474] [DEBUG] [LOCAL ] SOL: Loaded 13541 existing records from primary storage. [2025-09-24T22:26:39.158073] [INFO ] [MAIN ] SOL: Loaded 13541 primary data records. [2025-09-24T22:26:39.498329] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:39.500814] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12935 primary records. [2025-09-24T22:26:39.501017] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-24T22:26:39.530315] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:39.531830] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9259 primary records. [2025-09-24T22:26:39.533538] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-24T22:26:39.548372] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-24T22:26:39.548488] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-24T22:26:39.550496] [INFO ] [MAIN ] Derivative Progress: 1690/2075 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 31s. Rate: 153.4 symbols/min [2025-09-24T22:26:39.553296] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:39.556268] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-24T22:26:39.556487] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-24T22:26:39.559127] [INFO ] [MAIN ] Derivative Progress: 1691/2075 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 30s. Rate: 153.5 symbols/min [2025-09-24T22:26:39.559626] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:39.578525] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:39.579489] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13541 primary records. [2025-09-24T22:26:39.579679] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-24T22:26:39.610360] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-24T22:26:39.610550] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-24T22:26:39.613180] [INFO ] [MAIN ] Derivative Progress: 1692/2075 symbols completed. SOL took 0.7s. Estimated remaining: 2m 30s. Rate: 153.6 symbols/min [2025-09-24T22:26:39.613691] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:39.638130] [DEBUG] [LOCAL ] SOLV: Loaded 44090 existing records from primary storage. [2025-09-24T22:26:39.638355] [INFO ] [MAIN ] SOLV: Loaded 44090 primary data records. [2025-09-24T22:26:39.759316] [DEBUG] [LOCAL ] SON: Loaded 42894 existing records from primary storage. [2025-09-24T22:26:39.765060] [INFO ] [MAIN ] SON: Loaded 42894 primary data records. [2025-09-24T22:26:40.137249] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-24T22:26:40.169850] [INFO ] [MAIN ] SONY: Loaded 53357 primary data records. [2025-09-24T22:26:40.715203] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:40.716981] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44090 primary records. [2025-09-24T22:26:40.715846] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:40.718084] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42894 primary records. [2025-09-24T22:26:40.718217] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-24T22:26:40.719144] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-24T22:26:40.750911] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-24T22:26:40.751457] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-24T22:26:40.753745] [INFO ] [MAIN ] Derivative Progress: 1693/2075 symbols completed. SON took 1.2s. Estimated remaining: 2m 29s. Rate: 153.4 symbols/min [2025-09-24T22:26:40.757071] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-24T22:26:40.757196] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-24T22:26:40.759494] [INFO ] [MAIN ] Derivative Progress: 1694/2075 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 29s. Rate: 153.5 symbols/min [2025-09-24T22:26:40.774237] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:40.774837] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53357 primary records. [2025-09-24T22:26:40.774899] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-24T22:26:40.790687] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-24T22:26:40.790749] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-24T22:26:40.793102] [INFO ] [MAIN ] Derivative Progress: 1695/2075 symbols completed. SONY took 1.2s. Estimated remaining: 2m 28s. Rate: 153.6 symbols/min [2025-09-24T22:26:40.793629] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:40.793730] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:40.794063] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:40.800038] [DEBUG] [LOCAL ] SOR: Loaded 2920 existing records from primary storage. [2025-09-24T22:26:40.800160] [INFO ] [MAIN ] SOR: Loaded 2920 primary data records. [2025-09-24T22:26:40.895476] [DEBUG] [LOCAL ] SOS: Loaded 8068 existing records from primary storage. [2025-09-24T22:26:40.914424] [INFO ] [MAIN ] SOS: Loaded 8068 primary data records. [2025-09-24T22:26:41.154725] [DEBUG] [LOCAL ] SPB: Loaded 34229 existing records from primary storage. [2025-09-24T22:26:41.240235] [INFO ] [MAIN ] SPB: Loaded 34229 primary data records. [2025-09-24T22:26:41.792272] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:41.793314] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2920 primary records. [2025-09-24T22:26:41.793639] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-24T22:26:41.827397] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-24T22:26:41.828312] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-24T22:26:41.828034] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:41.830696] [INFO ] [MAIN ] Derivative Progress: 1696/2075 symbols completed. SOR took 1.0s. Estimated remaining: 2m 28s. Rate: 153.5 symbols/min [2025-09-24T22:26:41.831953] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 8068 primary records. [2025-09-24T22:26:41.832325] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-24T22:26:41.832464] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:41.856307] [DEBUG] [LOCAL ] SPE: Loaded 6374 existing records from primary storage. [2025-09-24T22:26:41.857357] [INFO ] [MAIN ] SPE: Loaded 6374 primary data records. [2025-09-24T22:26:41.865009] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-09-24T22:26:41.891050] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-24T22:26:41.890935] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:41.909044] [INFO ] [MAIN ] Derivative Progress: 1697/2075 symbols completed. SOS took 1.1s. Estimated remaining: 2m 28s. Rate: 153.5 symbols/min [2025-09-24T22:26:41.909301] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:41.910437] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34229 primary records. [2025-09-24T22:26:41.910717] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-24T22:26:42.197097] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-24T22:26:42.197480] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-24T22:26:42.200096] [INFO ] [MAIN ] Derivative Progress: 1698/2075 symbols completed. SPB took 1.4s. Estimated remaining: 2m 27s. Rate: 153.6 symbols/min [2025-09-24T22:26:42.200580] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:42.252872] [DEBUG] [LOCAL ] SPG: Loaded 50420 existing records from primary storage. [2025-09-24T22:26:42.253119] [INFO ] [MAIN ] SPG: Loaded 50420 primary data records. [2025-09-24T22:26:42.266190] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:42.301178] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6374 primary records. [2025-09-24T22:26:42.338768] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-24T22:26:42.449795] [DEBUG] [LOCAL ] SPGI: Loaded 45813 existing records from primary storage. [2025-09-24T22:26:42.450310] [INFO ] [MAIN ] SPGI: Loaded 45813 primary data records. [2025-09-24T22:26:42.466036] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-24T22:26:42.485605] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-24T22:26:42.534268] [INFO ] [MAIN ] Derivative Progress: 1699/2075 symbols completed. SPE took 0.7s. Estimated remaining: 2m 27s. Rate: 153.6 symbols/min [2025-09-24T22:26:42.560182] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:43.022062] [DEBUG] [LOCAL ] SPH: Loaded 18057 existing records from primary storage. [2025-09-24T22:26:43.022458] [INFO ] [MAIN ] SPH: Loaded 18057 primary data records. [2025-09-24T22:26:43.353618] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:43.355242] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50420 primary records. [2025-09-24T22:26:43.355661] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-24T22:26:43.382799] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:43.387997] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45813 primary records. [2025-09-24T22:26:43.388387] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-24T22:26:43.412874] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-24T22:26:43.413871] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-24T22:26:43.413748] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-24T22:26:43.416535] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-24T22:26:43.416290] [INFO ] [MAIN ] Derivative Progress: 1700/2075 symbols completed. SPG took 1.5s. Estimated remaining: 2m 27s. Rate: 153.5 symbols/min [2025-09-24T22:26:43.431772] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:43.431681] [INFO ] [MAIN ] Derivative Progress: 1701/2075 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 26s. Rate: 153.5 symbols/min [2025-09-24T22:26:43.432232] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:43.432570] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:43.433900] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 18057 primary records. [2025-09-24T22:26:43.434416] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-24T22:26:43.451673] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-24T22:26:43.451744] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-24T22:26:43.454112] [INFO ] [MAIN ] Derivative Progress: 1702/2075 symbols completed. SPH took 0.9s. Estimated remaining: 2m 26s. Rate: 153.6 symbols/min [2025-09-24T22:26:43.454366] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:43.463099] [DEBUG] [LOCAL ] SPMC: Loaded 5572 existing records from primary storage. [2025-09-24T22:26:43.472539] [INFO ] [MAIN ] SPMC: Loaded 5572 primary data records. [2025-09-24T22:26:43.612339] [DEBUG] [LOCAL ] SPIR: Loaded 37442 existing records from primary storage. [2025-09-24T22:26:43.634261] [INFO ] [MAIN ] SPIR: Loaded 37442 primary data records. [2025-09-24T22:26:43.675070] [DEBUG] [LOCAL ] SPHR: Loaded 40141 existing records from primary storage. [2025-09-24T22:26:43.719217] [INFO ] [MAIN ] SPHR: Loaded 40141 primary data records. [2025-09-24T22:26:44.463232] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:44.466080] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5572 primary records. [2025-09-24T22:26:44.466468] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-24T22:26:44.489468] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-09-24T22:26:44.491240] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-24T22:26:44.493545] [INFO ] [MAIN ] Derivative Progress: 1703/2075 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 25s. Rate: 153.5 symbols/min [2025-09-24T22:26:44.506456] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:44.507031] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:44.519869] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40141 primary records. [2025-09-24T22:26:44.520134] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-24T22:26:44.520438] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:44.522011] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37442 primary records. [2025-09-24T22:26:44.522174] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-24T22:26:44.554340] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-24T22:26:44.554255] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-24T22:26:44.554493] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-24T22:26:44.554580] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-24T22:26:44.557153] [INFO ] [MAIN ] Derivative Progress: 1704/2075 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 25s. Rate: 153.6 symbols/min [2025-09-24T22:26:44.566781] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:44.569926] [INFO ] [MAIN ] Derivative Progress: 1705/2075 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 24s. Rate: 153.6 symbols/min [2025-09-24T22:26:44.570621] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:44.587098] [DEBUG] [LOCAL ] SPNT: Loaded 34851 existing records from primary storage. [2025-09-24T22:26:44.587395] [INFO ] [MAIN ] SPNT: Loaded 34851 primary data records. [2025-09-24T22:26:44.825134] [DEBUG] [LOCAL ] SPR: Loaded 41233 existing records from primary storage. [2025-09-24T22:26:44.970859] [INFO ] [MAIN ] SPR: Loaded 41233 primary data records. [2025-09-24T22:26:44.987492] [DEBUG] [LOCAL ] SPOT: Loaded 50841 existing records from primary storage. [2025-09-24T22:26:45.021439] [INFO ] [MAIN ] SPOT: Loaded 50841 primary data records. [2025-09-24T22:26:45.648403] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:45.649412] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34851 primary records. [2025-09-24T22:26:45.649570] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-24T22:26:45.671459] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-24T22:26:45.672016] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-24T22:26:45.674762] [INFO ] [MAIN ] Derivative Progress: 1706/2075 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 24s. Rate: 153.5 symbols/min [2025-09-24T22:26:45.675309] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:45.710315] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:45.709993] [DEBUG] [MAIN ] SPOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:45.716552] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41233 primary records. [2025-09-24T22:26:45.715509] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50841 primary records. [2025-09-24T22:26:45.716719] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-24T22:26:45.716790] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-24T22:26:45.715875] [DEBUG] [LOCAL ] SPRU: Loaded 8468 existing records from primary storage. [2025-09-24T22:26:45.718337] [INFO ] [MAIN ] SPRU: Loaded 8468 primary data records. [2025-09-24T22:26:45.887768] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-24T22:26:45.893327] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-09-24T22:26:45.893578] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-24T22:26:45.893507] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-24T22:26:45.917361] [INFO ] [MAIN ] Derivative Progress: 1707/2075 symbols completed. SPOT took 1.4s. Estimated remaining: 2m 24s. Rate: 153.5 symbols/min [2025-09-24T22:26:45.919768] [INFO ] [MAIN ] Derivative Progress: 1708/2075 symbols completed. SPR took 1.3s. Estimated remaining: 2m 23s. Rate: 153.6 symbols/min [2025-09-24T22:26:45.920000] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:46.092848] [DEBUG] [LOCAL ] SPXC: Loaded 23370 existing records from primary storage. [2025-09-24T22:26:46.093230] [INFO ] [MAIN ] SPXC: Loaded 23370 primary data records. [2025-09-24T22:26:46.249916] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:46.276091] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8468 primary records. [2025-09-24T22:26:46.281995] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-24T22:26:46.444854] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-24T22:26:46.445438] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-24T22:26:46.447912] [INFO ] [MAIN ] Derivative Progress: 1709/2075 symbols completed. SPRU took 0.8s. Estimated remaining: 2m 23s. Rate: 153.6 symbols/min [2025-09-24T22:26:46.471468] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:46.472183] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23370 primary records. [2025-09-24T22:26:46.472248] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-24T22:26:46.488576] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-24T22:26:46.488702] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-24T22:26:46.491391] [INFO ] [MAIN ] Derivative Progress: 1710/2075 symbols completed. SPXC took 0.6s. Estimated remaining: 2m 23s. Rate: 153.6 symbols/min [2025-09-24T22:26:46.492233] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:46.492874] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:46.492545] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:46.506167] [DEBUG] [LOCAL ] SPXX: Loaded 8956 existing records from primary storage. [2025-09-24T22:26:46.506292] [INFO ] [MAIN ] SPXX: Loaded 8956 primary data records. [2025-09-24T22:26:46.643179] [DEBUG] [LOCAL ] SQNS: Loaded 26021 existing records from primary storage. [2025-09-24T22:26:46.655187] [INFO ] [MAIN ] SQNS: Loaded 26021 primary data records. [2025-09-24T22:26:46.888009] [DEBUG] [LOCAL ] SQM: Loaded 48535 existing records from primary storage. [2025-09-24T22:26:46.970061] [INFO ] [MAIN ] SQM: Loaded 48535 primary data records. [2025-09-24T22:26:47.613165] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:47.627366] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 8956 primary records. [2025-09-24T22:26:47.627868] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-24T22:26:47.629198] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:47.630674] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26021 primary records. [2025-09-24T22:26:47.642330] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-24T22:26:47.659782] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-24T22:26:47.660485] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-24T22:26:47.664628] [INFO ] [MAIN ] Derivative Progress: 1711/2075 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 22s. Rate: 153.5 symbols/min [2025-09-24T22:26:47.666255] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:47.669852] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-24T22:26:47.670165] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-24T22:26:47.672746] [INFO ] [MAIN ] Derivative Progress: 1712/2075 symbols completed. SPXX took 1.2s. Estimated remaining: 2m 22s. Rate: 153.6 symbols/min [2025-09-24T22:26:47.685920] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:47.686788] [DEBUG] [MAIN ] SQM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:47.687535] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48535 primary records. [2025-09-24T22:26:47.687820] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-24T22:26:47.704964] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-24T22:26:47.705197] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-24T22:26:47.708712] [INFO ] [MAIN ] Derivative Progress: 1713/2075 symbols completed. SQM took 1.2s. Estimated remaining: 2m 21s. Rate: 153.6 symbols/min [2025-09-24T22:26:47.711050] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:47.735975] [DEBUG] [LOCAL ] SR: Loaded 32905 existing records from primary storage. [2025-09-24T22:26:47.736223] [INFO ] [MAIN ] SR: Loaded 32905 primary data records. [2025-09-24T22:26:47.827344] [DEBUG] [LOCAL ] SREA: Loaded 10415 existing records from primary storage. [2025-09-24T22:26:47.850613] [INFO ] [MAIN ] SREA: Loaded 10415 primary data records. [2025-09-24T22:26:48.013169] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-24T22:26:48.078442] [INFO ] [MAIN ] SRE: Loaded 53426 primary data records. [2025-09-24T22:26:48.809212] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:48.810821] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32905 primary records. [2025-09-24T22:26:48.811041] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-24T22:26:48.842191] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:48.843743] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10415 primary records. [2025-09-24T22:26:48.843917] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-24T22:26:48.863674] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-24T22:26:48.871334] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-24T22:26:48.874588] [INFO ] [MAIN ] Derivative Progress: 1714/2075 symbols completed. SREA took 1.2s. Estimated remaining: 2m 21s. Rate: 153.5 symbols/min [2025-09-24T22:26:48.881081] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-24T22:26:48.881419] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:48.879875] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:48.882192] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53426 primary records. [2025-09-24T22:26:48.882388] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-24T22:26:48.882856] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-24T22:26:48.885156] [INFO ] [MAIN ] Derivative Progress: 1715/2075 symbols completed. SR took 1.2s. Estimated remaining: 2m 21s. Rate: 153.5 symbols/min [2025-09-24T22:26:48.885610] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:48.903066] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-09-24T22:26:48.903391] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-24T22:26:48.906078] [INFO ] [MAIN ] Derivative Progress: 1716/2075 symbols completed. SRE took 1.2s. Estimated remaining: 2m 20s. Rate: 153.6 symbols/min [2025-09-24T22:26:48.906479] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:48.918521] [DEBUG] [LOCAL ] SRG: Loaded 15666 existing records from primary storage. [2025-09-24T22:26:48.918682] [INFO ] [MAIN ] SRG: Loaded 15666 primary data records. [2025-09-24T22:26:49.107844] [DEBUG] [LOCAL ] SRI: Loaded 27500 existing records from primary storage. [2025-09-24T22:26:49.142831] [DEBUG] [LOCAL ] SRFM: Loaded 35731 existing records from primary storage. [2025-09-24T22:26:49.127275] [INFO ] [MAIN ] SRI: Loaded 27500 primary data records. [2025-09-24T22:26:49.145471] [INFO ] [MAIN ] SRFM: Loaded 35731 primary data records. [2025-09-24T22:26:49.945857] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:49.947238] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15666 primary records. [2025-09-24T22:26:49.947624] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-24T22:26:49.966600] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-24T22:26:49.966789] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-24T22:26:49.969003] [INFO ] [MAIN ] Derivative Progress: 1717/2075 symbols completed. SRG took 1.1s. Estimated remaining: 2m 20s. Rate: 153.5 symbols/min [2025-09-24T22:26:49.969593] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:49.987452] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:49.988267] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 35731 primary records. [2025-09-24T22:26:49.988499] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-24T22:26:50.010100] [DEBUG] [LOCAL ] SRV: Loaded 7538 existing records from primary storage. [2025-09-24T22:26:50.010884] [INFO ] [MAIN ] SRV: Loaded 7538 primary data records. [2025-09-24T22:26:50.068628] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:50.091202] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27500 primary records. [2025-09-24T22:26:50.103926] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-24T22:26:50.115120] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-24T22:26:50.121037] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-24T22:26:50.137764] [INFO ] [MAIN ] Derivative Progress: 1718/2075 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 20s. Rate: 153.5 symbols/min [2025-09-24T22:26:50.142764] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:50.229397] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-24T22:26:50.229728] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-24T22:26:50.337897] [INFO ] [MAIN ] Derivative Progress: 1719/2075 symbols completed. SRI took 1.4s. Estimated remaining: 2m 19s. Rate: 153.6 symbols/min [2025-09-24T22:26:50.346738] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:50.406699] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:50.407091] [DEBUG] [LOCAL ] SSD: Loaded 22290 existing records from primary storage. [2025-09-24T22:26:50.408180] [INFO ] [MAIN ] SSD: Loaded 22290 primary data records. [2025-09-24T22:26:50.408083] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7538 primary records. [2025-09-24T22:26:50.420703] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-24T22:26:50.409449] [DEBUG] [LOCAL ] SSB: Loaded 42863 existing records from primary storage. [2025-09-24T22:26:50.440809] [INFO ] [MAIN ] SSB: Loaded 42863 primary data records. [2025-09-24T22:26:50.926893] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-24T22:26:50.994178] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-24T22:26:51.099738] [INFO ] [MAIN ] Derivative Progress: 1720/2075 symbols completed. SRV took 1.1s. Estimated remaining: 2m 19s. Rate: 153.5 symbols/min [2025-09-24T22:26:51.102115] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:51.144937] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:51.146121] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22290 primary records. [2025-09-24T22:26:51.146386] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-24T22:26:51.168374] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:51.172876] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42863 primary records. [2025-09-24T22:26:51.173892] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-24T22:26:51.202687] [DEBUG] [LOCAL ] SSL: Loaded 41232 existing records from primary storage. [2025-09-24T22:26:51.203799] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-24T22:26:51.204200] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-24T22:26:51.207224] [INFO ] [MAIN ] Derivative Progress: 1721/2075 symbols completed. SSD took 0.9s. Estimated remaining: 2m 18s. Rate: 153.6 symbols/min [2025-09-24T22:26:51.204128] [INFO ] [MAIN ] SSL: Loaded 41232 primary data records. [2025-09-24T22:26:51.208138] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:51.287097] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-24T22:26:51.314164] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-24T22:26:51.320481] [INFO ] [MAIN ] Derivative Progress: 1722/2075 symbols completed. SSB took 1.2s. Estimated remaining: 2m 18s. Rate: 153.6 symbols/min [2025-09-24T22:26:51.347514] [DEBUG] [LOCAL ] SST: Loaded 12121 existing records from primary storage. [2025-09-24T22:26:51.366843] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:51.406722] [INFO ] [MAIN ] SST: Loaded 12121 primary data records. [2025-09-24T22:26:51.853578] [DEBUG] [LOCAL ] SSTK: Loaded 26511 existing records from primary storage. [2025-09-24T22:26:51.866960] [INFO ] [MAIN ] SSTK: Loaded 26511 primary data records. [2025-09-24T22:26:52.032820] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:52.049841] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41232 primary records. [2025-09-24T22:26:52.070710] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-24T22:26:52.214579] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-24T22:26:52.215637] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-24T22:26:52.219757] [INFO ] [MAIN ] Derivative Progress: 1723/2075 symbols completed. SSL took 1.1s. Estimated remaining: 2m 18s. Rate: 153.5 symbols/min [2025-09-24T22:26:52.233287] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:52.234070] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 12121 primary records. [2025-09-24T22:26:52.234252] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-24T22:26:52.265686] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-24T22:26:52.265935] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:52.266063] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-24T22:26:52.266873] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 26511 primary records. [2025-09-24T22:26:52.266965] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-24T22:26:52.269318] [INFO ] [MAIN ] Derivative Progress: 1724/2075 symbols completed. SST took 1.1s. Estimated remaining: 2m 17s. Rate: 153.6 symbols/min [2025-09-24T22:26:52.285466] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-24T22:26:52.285534] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-24T22:26:52.288300] [INFO ] [MAIN ] Derivative Progress: 1725/2075 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 17s. Rate: 153.7 symbols/min [2025-09-24T22:26:52.289168] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:52.289096] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:52.289964] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:52.310013] [DEBUG] [LOCAL ] STC: Loaded 17713 existing records from primary storage. [2025-09-24T22:26:52.310130] [INFO ] [MAIN ] STC: Loaded 17713 primary data records. [2025-09-24T22:26:52.653923] [DEBUG] [LOCAL ] STAG: Loaded 50028 existing records from primary storage. [2025-09-24T22:26:52.668050] [DEBUG] [LOCAL ] ST: Loaded 49776 existing records from primary storage. [2025-09-24T22:26:52.668886] [INFO ] [MAIN ] ST: Loaded 49776 primary data records. [2025-09-24T22:26:52.669066] [INFO ] [MAIN ] STAG: Loaded 50028 primary data records. [2025-09-24T22:26:53.334838] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:53.335926] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17713 primary records. [2025-09-24T22:26:53.336089] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-24T22:26:53.356549] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-24T22:26:53.356895] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-24T22:26:53.368405] [INFO ] [MAIN ] Derivative Progress: 1726/2075 symbols completed. STC took 1.1s. Estimated remaining: 2m 16s. Rate: 153.5 symbols/min [2025-09-24T22:26:53.374222] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:53.375001] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49776 primary records. [2025-09-24T22:26:53.375312] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:53.375117] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-24T22:26:53.396296] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:53.400885] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50028 primary records. [2025-09-24T22:26:53.401050] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-24T22:26:53.426786] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-24T22:26:53.435372] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-24T22:26:53.435245] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-24T22:26:53.435488] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-24T22:26:53.437599] [INFO ] [MAIN ] Derivative Progress: 1727/2075 symbols completed. ST took 1.1s. Estimated remaining: 2m 16s. Rate: 153.6 symbols/min [2025-09-24T22:26:53.441065] [INFO ] [MAIN ] Derivative Progress: 1728/2075 symbols completed. STAG took 1.2s. Estimated remaining: 2m 15s. Rate: 153.7 symbols/min [2025-09-24T22:26:53.441361] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:53.441308] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:53.455228] [DEBUG] [LOCAL ] STE: Loaded 35406 existing records from primary storage. [2025-09-24T22:26:53.455361] [INFO ] [MAIN ] STE: Loaded 35406 primary data records. [2025-09-24T22:26:53.622453] [DEBUG] [LOCAL ] STEL: Loaded 23631 existing records from primary storage. [2025-09-24T22:26:53.655747] [INFO ] [MAIN ] STEL: Loaded 23631 primary data records. [2025-09-24T22:26:53.694355] [DEBUG] [LOCAL ] STEM: Loaded 39861 existing records from primary storage. [2025-09-24T22:26:53.694493] [INFO ] [MAIN ] STEM: Loaded 39861 primary data records. [2025-09-24T22:26:54.412778] [DEBUG] [MAIN ] STE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:54.414232] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35406 primary records. [2025-09-24T22:26:54.414337] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-24T22:26:54.433630] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-24T22:26:54.434582] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-24T22:26:54.436689] [INFO ] [MAIN ] Derivative Progress: 1729/2075 symbols completed. STE took 1.1s. Estimated remaining: 2m 15s. Rate: 153.5 symbols/min [2025-09-24T22:26:54.438297] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:54.454628] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:54.467046] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23631 primary records. [2025-09-24T22:26:54.467193] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-24T22:26:54.467987] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:54.469164] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39861 primary records. [2025-09-24T22:26:54.476295] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-24T22:26:54.505217] [DEBUG] [LOCAL ] STEW: Loaded 16186 existing records from primary storage. [2025-09-24T22:26:54.506280] [INFO ] [MAIN ] STEW: Loaded 16186 primary data records. [2025-09-24T22:26:54.530130] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-24T22:26:54.547016] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-24T22:26:54.547118] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-24T22:26:54.556382] [INFO ] [MAIN ] Derivative Progress: 1730/2075 symbols completed. STEL took 1.1s. Estimated remaining: 2m 15s. Rate: 153.6 symbols/min [2025-09-24T22:26:54.554007] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-24T22:26:54.579294] [INFO ] [MAIN ] Derivative Progress: 1731/2075 symbols completed. STEM took 1.1s. Estimated remaining: 2m 14s. Rate: 153.7 symbols/min [2025-09-24T22:26:54.579589] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:54.579398] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:54.857883] [DEBUG] [LOCAL ] STK: Loaded 9399 existing records from primary storage. [2025-09-24T22:26:54.866539] [INFO ] [MAIN ] STK: Loaded 9399 primary data records. [2025-09-24T22:26:55.193131] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-09-24T22:26:55.202001] [INFO ] [MAIN ] STLA: Loaded 53542 primary data records. [2025-09-24T22:26:55.401434] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:55.503956] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16186 primary records. [2025-09-24T22:26:55.517246] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-24T22:26:55.535548] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-24T22:26:55.536560] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-24T22:26:55.538938] [INFO ] [MAIN ] Derivative Progress: 1732/2075 symbols completed. STEW took 1.1s. Estimated remaining: 2m 14s. Rate: 153.5 symbols/min [2025-09-24T22:26:55.539534] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:55.557700] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:55.558470] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9399 primary records. [2025-09-24T22:26:55.558764] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-24T22:26:55.577480] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-24T22:26:55.579140] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-24T22:26:55.581855] [INFO ] [MAIN ] Derivative Progress: 1733/2075 symbols completed. STK took 1.0s. Estimated remaining: 2m 14s. Rate: 153.6 symbols/min [2025-09-24T22:26:55.582500] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:55.596828] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:55.597529] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53542 primary records. [2025-09-24T22:26:55.597694] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-24T22:26:55.627622] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-09-24T22:26:55.627867] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-24T22:26:55.634589] [INFO ] [MAIN ] Derivative Progress: 1734/2075 symbols completed. STLA took 1.1s. Estimated remaining: 2m 13s. Rate: 153.7 symbols/min [2025-09-24T22:26:55.634964] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:55.646356] [DEBUG] [LOCAL ] STN: Loaded 23138 existing records from primary storage. [2025-09-24T22:26:55.661275] [INFO ] [MAIN ] STN: Loaded 23138 primary data records. [2025-09-24T22:26:55.693754] [DEBUG] [LOCAL ] STM: Loaded 53586 existing records from primary storage. [2025-09-24T22:26:55.718015] [INFO ] [MAIN ] STM: Loaded 53586 primary data records. [2025-09-24T22:26:56.048957] [DEBUG] [LOCAL ] STNG: Loaded 44045 existing records from primary storage. [2025-09-24T22:26:56.099704] [INFO ] [MAIN ] STNG: Loaded 44045 primary data records. [2025-09-24T22:26:56.618548] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:56.621347] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 23138 primary records. [2025-09-24T22:26:56.621812] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-24T22:26:56.648914] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:56.652309] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-24T22:26:56.653201] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53586 primary records. [2025-09-24T22:26:56.653273] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-24T22:26:56.653432] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-24T22:26:56.655739] [INFO ] [MAIN ] Derivative Progress: 1735/2075 symbols completed. STN took 1.1s. Estimated remaining: 2m 13s. Rate: 153.6 symbols/min [2025-09-24T22:26:56.656777] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:56.678671] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-24T22:26:56.680130] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-24T22:26:56.687345] [INFO ] [MAIN ] Derivative Progress: 1736/2075 symbols completed. STM took 1.1s. Estimated remaining: 2m 12s. Rate: 153.6 symbols/min [2025-09-24T22:26:56.687674] [DEBUG] [LOCAL ] STRV: Loaded 11574 existing records from primary storage. [2025-09-24T22:26:56.688420] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:56.701330] [INFO ] [MAIN ] STRV: Loaded 11574 primary data records. [2025-09-24T22:26:56.701243] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:56.702427] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 44045 primary records. [2025-09-24T22:26:56.723335] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-24T22:26:57.037875] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-24T22:26:57.046621] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-24T22:26:57.063607] [INFO ] [MAIN ] Derivative Progress: 1737/2075 symbols completed. STNG took 1.4s. Estimated remaining: 2m 12s. Rate: 153.6 symbols/min [2025-09-24T22:26:57.064800] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:57.086602] [DEBUG] [LOCAL ] STT: Loaded 51071 existing records from primary storage. [2025-09-24T22:26:57.087042] [INFO ] [MAIN ] STT: Loaded 51071 primary data records. [2025-09-24T22:26:57.205352] [DEBUG] [LOCAL ] STVN: Loaded 26260 existing records from primary storage. [2025-09-24T22:26:57.205846] [INFO ] [MAIN ] STVN: Loaded 26260 primary data records. [2025-09-24T22:26:57.518624] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:57.536254] [INFO ] [MAIN ] STRV: Generated 1794 derivative records from 11574 primary records. [2025-09-24T22:26:57.572635] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-24T22:26:57.743484] [DEBUG] [LOCAL ] STRV: Derivative data saved (1794 records). [2025-09-24T22:26:57.743853] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-24T22:26:57.746001] [INFO ] [MAIN ] Derivative Progress: 1738/2075 symbols completed. STRV took 1.1s. Estimated remaining: 2m 12s. Rate: 153.6 symbols/min [2025-09-24T22:26:57.771085] [DEBUG] [MAIN ] STT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:57.771799] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51071 primary records. [2025-09-24T22:26:57.771981] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-24T22:26:57.791019] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-09-24T22:26:57.803308] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-24T22:26:57.803218] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:57.806278] [INFO ] [MAIN ] Derivative Progress: 1739/2075 symbols completed. STT took 1.1s. Estimated remaining: 2m 11s. Rate: 153.7 symbols/min [2025-09-24T22:26:57.803956] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26260 primary records. [2025-09-24T22:26:57.806506] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-24T22:26:57.821532] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-24T22:26:57.821591] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-24T22:26:57.824336] [INFO ] [MAIN ] Derivative Progress: 1740/2075 symbols completed. STVN took 0.8s. Estimated remaining: 2m 11s. Rate: 153.7 symbols/min [2025-09-24T22:26:57.825035] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:57.824927] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:57.825215] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:57.832148] [DEBUG] [LOCAL ] STXD: Loaded 1320 existing records from primary storage. [2025-09-24T22:26:57.832013] [DEBUG] [LOCAL ] STXE: Loaded 2199 existing records from primary storage. [2025-09-24T22:26:57.832327] [INFO ] [MAIN ] STXD: Loaded 1320 primary data records. [2025-09-24T22:26:57.832432] [INFO ] [MAIN ] STXE: Loaded 2199 primary data records. [2025-09-24T22:26:58.467965] [DEBUG] [LOCAL ] STWD: Loaded 51894 existing records from primary storage. [2025-09-24T22:26:58.468905] [INFO ] [MAIN ] STWD: Loaded 51894 primary data records. [2025-09-24T22:26:58.839634] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:58.841956] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1320 primary records. [2025-09-24T22:26:58.842956] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-24T22:26:58.871335] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:58.872684] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2199 primary records. [2025-09-24T22:26:58.873081] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-24T22:26:58.875191] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-09-24T22:26:58.875414] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-24T22:26:58.883770] [INFO ] [MAIN ] Derivative Progress: 1741/2075 symbols completed. STXD took 1.1s. Estimated remaining: 2m 10s. Rate: 153.6 symbols/min [2025-09-24T22:26:58.884059] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:58.891662] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-24T22:26:58.892095] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-24T22:26:58.894826] [INFO ] [MAIN ] Derivative Progress: 1742/2075 symbols completed. STXE took 1.1s. Estimated remaining: 2m 10s. Rate: 153.7 symbols/min [2025-09-24T22:26:58.895565] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:58.902201] [DEBUG] [LOCAL ] STXG: Loaded 2586 existing records from primary storage. [2025-09-24T22:26:58.904137] [INFO ] [MAIN ] STXG: Loaded 2586 primary data records. [2025-09-24T22:26:58.904052] [DEBUG] [LOCAL ] STXK: Loaded 1513 existing records from primary storage. [2025-09-24T22:26:58.904278] [INFO ] [MAIN ] STXK: Loaded 1513 primary data records. [2025-09-24T22:26:58.972956] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:26:58.989110] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51894 primary records. [2025-09-24T22:26:59.003327] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-24T22:26:59.528958] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-24T22:26:59.538447] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-24T22:26:59.540923] [INFO ] [MAIN ] Derivative Progress: 1743/2075 symbols completed. STWD took 1.7s. Estimated remaining: 2m 10s. Rate: 153.6 symbols/min [2025-09-24T22:26:59.542882] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:59.550882] [DEBUG] [LOCAL ] STXT: Loaded 2566 existing records from primary storage. [2025-09-24T22:26:59.551694] [INFO ] [MAIN ] STXT: Loaded 2566 primary data records. [2025-09-24T22:26:59.875953] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:59.880302] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1513 primary records. [2025-09-24T22:26:59.880668] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-24T22:26:59.904946] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:26:59.909177] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-24T22:26:59.907455] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2586 primary records. [2025-09-24T22:26:59.909591] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-24T22:26:59.912787] [INFO ] [MAIN ] Derivative Progress: 1744/2075 symbols completed. STXK took 1.0s. Estimated remaining: 2m 9s. Rate: 153.6 symbols/min [2025-09-24T22:26:59.909887] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-24T22:26:59.914177] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:26:59.932500] [DEBUG] [LOCAL ] STXV: Loaded 1638 existing records from primary storage. [2025-09-24T22:26:59.932805] [INFO ] [MAIN ] STXV: Loaded 1638 primary data records. [2025-09-24T22:27:00.005894] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-24T22:27:00.037309] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-24T22:27:00.043242] [INFO ] [MAIN ] Derivative Progress: 1745/2075 symbols completed. STXG took 1.2s. Estimated remaining: 2m 9s. Rate: 153.7 symbols/min [2025-09-24T22:27:00.043706] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:00.140586] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:00.259871] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2566 primary records. [2025-09-24T22:27:00.260769] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-24T22:27:00.279061] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-24T22:27:00.279625] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-24T22:27:00.282077] [INFO ] [MAIN ] Derivative Progress: 1746/2075 symbols completed. STXT took 0.7s. Estimated remaining: 2m 8s. Rate: 153.7 symbols/min [2025-09-24T22:27:00.282336] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:00.323380] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:00.338384] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1638 primary records. [2025-09-24T22:27:00.338619] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-24T22:27:00.340367] [DEBUG] [LOCAL ] STZ: Loaded 52265 existing records from primary storage. [2025-09-24T22:27:00.340823] [INFO ] [MAIN ] STZ: Loaded 52265 primary data records. [2025-09-24T22:27:00.508248] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-24T22:27:00.542431] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-24T22:27:00.569665] [DEBUG] [LOCAL ] SU: Loaded 53457 existing records from primary storage. [2025-09-24T22:27:00.726905] [INFO ] [MAIN ] Derivative Progress: 1747/2075 symbols completed. STXV took 0.8s. Estimated remaining: 2m 8s. Rate: 153.7 symbols/min [2025-09-24T22:27:00.740499] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:00.741353] [INFO ] [MAIN ] SU: Loaded 53457 primary data records. [2025-09-24T22:27:01.091105] [DEBUG] [MAIN ] STZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:01.092102] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52265 primary records. [2025-09-24T22:27:01.092292] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-24T22:27:01.094470] [DEBUG] [LOCAL ] SUI: Loaded 41980 existing records from primary storage. [2025-09-24T22:27:01.102359] [INFO ] [MAIN ] SUI: Loaded 41980 primary data records. [2025-09-24T22:27:01.244153] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-24T22:27:01.254841] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-24T22:27:01.260281] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:01.268243] [INFO ] [MAIN ] Derivative Progress: 1748/2075 symbols completed. STZ took 1.2s. Estimated remaining: 2m 8s. Rate: 153.7 symbols/min [2025-09-24T22:27:01.261021] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53457 primary records. [2025-09-24T22:27:01.268524] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:01.295267] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-24T22:27:01.464926] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-24T22:27:01.465270] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-24T22:27:01.467914] [INFO ] [MAIN ] Derivative Progress: 1749/2075 symbols completed. SU took 1.2s. Estimated remaining: 2m 7s. Rate: 153.7 symbols/min [2025-09-24T22:27:01.468266] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:01.517441] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:01.518241] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41980 primary records. [2025-09-24T22:27:01.518458] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-24T22:27:01.543962] [DEBUG] [LOCAL ] SUN: Loaded 37364 existing records from primary storage. [2025-09-24T22:27:01.553810] [INFO ] [MAIN ] SUN: Loaded 37364 primary data records. [2025-09-24T22:27:01.692727] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-24T22:27:01.691812] [DEBUG] [LOCAL ] SUPV: Loaded 47192 existing records from primary storage. [2025-09-24T22:27:01.703787] [INFO ] [MAIN ] SUPV: Loaded 47192 primary data records. [2025-09-24T22:27:01.693354] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-24T22:27:01.711352] [INFO ] [MAIN ] Derivative Progress: 1750/2075 symbols completed. SUI took 1.0s. Estimated remaining: 2m 7s. Rate: 153.7 symbols/min [2025-09-24T22:27:01.738924] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:02.275347] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:02.277416] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37364 primary records. [2025-09-24T22:27:02.276537] [DEBUG] [LOCAL ] SUZ: Loaded 45789 existing records from primary storage. [2025-09-24T22:27:02.277883] [INFO ] [MAIN ] SUZ: Loaded 45789 primary data records. [2025-09-24T22:27:02.278295] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-24T22:27:02.432613] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-24T22:27:02.438717] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:02.450224] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47192 primary records. [2025-09-24T22:27:02.482696] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-24T22:27:02.477145] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-24T22:27:02.520286] [INFO ] [MAIN ] Derivative Progress: 1751/2075 symbols completed. SUN took 1.3s. Estimated remaining: 2m 7s. Rate: 153.6 symbols/min [2025-09-24T22:27:02.532339] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:02.662210] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-24T22:27:02.662389] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-24T22:27:02.665145] [INFO ] [MAIN ] Derivative Progress: 1752/2075 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 6s. Rate: 153.7 symbols/min [2025-09-24T22:27:02.665472] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:02.701754] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:02.702537] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45789 primary records. [2025-09-24T22:27:02.702765] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-24T22:27:02.720068] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-24T22:27:02.731932] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-24T22:27:02.734576] [INFO ] [MAIN ] Derivative Progress: 1753/2075 symbols completed. SUZ took 1.0s. Estimated remaining: 2m 6s. Rate: 153.8 symbols/min [2025-09-24T22:27:02.735773] [DEBUG] [LOCAL ] SVV: Loaded 39502 existing records from primary storage. [2025-09-24T22:27:02.735989] [INFO ] [MAIN ] SVV: Loaded 39502 primary data records. [2025-09-24T22:27:02.895621] [DEBUG] [LOCAL ] SW: Loaded 53161 existing records from primary storage. [2025-09-24T22:27:02.914129] [INFO ] [MAIN ] SW: Loaded 53161 primary data records. [2025-09-24T22:27:03.412992] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:03.413936] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39502 primary records. [2025-09-24T22:27:03.414019] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-24T22:27:03.442201] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:03.443677] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53161 primary records. [2025-09-24T22:27:03.443768] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-24T22:27:03.460389] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-24T22:27:03.460973] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-24T22:27:03.463505] [INFO ] [MAIN ] Derivative Progress: 1754/2075 symbols completed. SVV took 0.9s. Estimated remaining: 2m 5s. Rate: 153.7 symbols/min [2025-09-24T22:27:03.465205] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-24T22:27:03.465279] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-24T22:27:03.467798] [INFO ] [MAIN ] Derivative Progress: 1755/2075 symbols completed. SW took 0.8s. Estimated remaining: 2m 5s. Rate: 153.8 symbols/min [2025-09-24T22:27:03.468343] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:03.468669] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:03.468516] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:03.477476] [DEBUG] [LOCAL ] SWZ: Loaded 6023 existing records from primary storage. [2025-09-24T22:27:03.477692] [INFO ] [MAIN ] SWZ: Loaded 6023 primary data records. [2025-09-24T22:27:03.661221] [DEBUG] [LOCAL ] SWX: Loaded 31294 existing records from primary storage. [2025-09-24T22:27:03.706809] [INFO ] [MAIN ] SWX: Loaded 31294 primary data records. [2025-09-24T22:27:03.936466] [DEBUG] [LOCAL ] SWK: Loaded 52442 existing records from primary storage. [2025-09-24T22:27:03.950419] [INFO ] [MAIN ] SWK: Loaded 52442 primary data records. [2025-09-24T22:27:04.514064] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:04.516240] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6023 primary records. [2025-09-24T22:27:04.516391] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-24T22:27:04.534070] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-09-24T22:27:04.534923] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-24T22:27:04.537576] [INFO ] [MAIN ] Derivative Progress: 1756/2075 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 5s. Rate: 153.6 symbols/min [2025-09-24T22:27:04.538788] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:04.561839] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:04.562914] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31294 primary records. [2025-09-24T22:27:04.563240] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-24T22:27:04.606802] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:04.608847] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52442 primary records. [2025-09-24T22:27:04.609840] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-24T22:27:04.611402] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-24T22:27:04.619159] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-24T22:27:04.623259] [INFO ] [MAIN ] Derivative Progress: 1757/2075 symbols completed. SWX took 1.2s. Estimated remaining: 2m 4s. Rate: 153.7 symbols/min [2025-09-24T22:27:04.631347] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:04.631018] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-24T22:27:04.642936] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-24T22:27:04.646688] [INFO ] [MAIN ] Derivative Progress: 1758/2075 symbols completed. SWK took 1.2s. Estimated remaining: 2m 4s. Rate: 153.8 symbols/min [2025-09-24T22:27:04.647099] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:04.648401] [DEBUG] [LOCAL ] SXC: Loaded 41571 existing records from primary storage. [2025-09-24T22:27:04.648625] [INFO ] [MAIN ] SXC: Loaded 41571 primary data records. [2025-09-24T22:27:04.759715] [DEBUG] [LOCAL ] SXI: Loaded 11540 existing records from primary storage. [2025-09-24T22:27:04.770768] [INFO ] [MAIN ] SXI: Loaded 11540 primary data records. [2025-09-24T22:27:05.118096] [DEBUG] [LOCAL ] SXT: Loaded 29113 existing records from primary storage. [2025-09-24T22:27:05.130109] [INFO ] [MAIN ] SXT: Loaded 29113 primary data records. [2025-09-24T22:27:05.667425] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:05.668823] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41571 primary records. [2025-09-24T22:27:05.670236] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-24T22:27:05.689793] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-24T22:27:05.690934] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-24T22:27:05.693496] [INFO ] [MAIN ] Derivative Progress: 1759/2075 symbols completed. SXC took 1.2s. Estimated remaining: 2m 3s. Rate: 153.6 symbols/min [2025-09-24T22:27:05.694222] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:05.707982] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:05.710016] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11540 primary records. [2025-09-24T22:27:05.710350] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-24T22:27:05.743503] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:05.744917] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29113 primary records. [2025-09-24T22:27:05.745584] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-24T22:27:05.745811] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-24T22:27:05.746275] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-24T22:27:05.749224] [INFO ] [MAIN ] Derivative Progress: 1760/2075 symbols completed. SXI took 1.1s. Estimated remaining: 2m 3s. Rate: 153.7 symbols/min [2025-09-24T22:27:05.750018] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:05.781068] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-24T22:27:05.781328] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-24T22:27:05.783519] [INFO ] [MAIN ] Derivative Progress: 1761/2075 symbols completed. SXT took 1.1s. Estimated remaining: 2m 3s. Rate: 153.8 symbols/min [2025-09-24T22:27:05.784088] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:05.806344] [DEBUG] [LOCAL ] SYF: Loaded 53454 existing records from primary storage. [2025-09-24T22:27:05.806734] [INFO ] [MAIN ] SYF: Loaded 53454 primary data records. [2025-09-24T22:27:06.014958] [DEBUG] [LOCAL ] SYK: Loaded 47045 existing records from primary storage. [2025-09-24T22:27:06.037925] [INFO ] [MAIN ] SYK: Loaded 47045 primary data records. [2025-09-24T22:27:06.285511] [DEBUG] [LOCAL ] SYY: Loaded 53233 existing records from primary storage. [2025-09-24T22:27:06.296720] [INFO ] [MAIN ] SYY: Loaded 53233 primary data records. [2025-09-24T22:27:06.885414] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:06.887219] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53454 primary records. [2025-09-24T22:27:06.887439] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-24T22:27:06.905218] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-24T22:27:06.908628] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-24T22:27:06.912258] [INFO ] [MAIN ] Derivative Progress: 1762/2075 symbols completed. SYF took 1.2s. Estimated remaining: 2m 2s. Rate: 153.6 symbols/min [2025-09-24T22:27:06.913221] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:06.926692] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:06.928153] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 47045 primary records. [2025-09-24T22:27:06.928248] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-24T22:27:06.945466] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-24T22:27:06.945899] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-24T22:27:06.948162] [INFO ] [MAIN ] Derivative Progress: 1763/2075 symbols completed. SYK took 1.2s. Estimated remaining: 2m 2s. Rate: 153.7 symbols/min [2025-09-24T22:27:06.949187] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:06.965334] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:06.966192] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53233 primary records. [2025-09-24T22:27:06.966309] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-24T22:27:06.983598] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-24T22:27:06.983856] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-24T22:27:06.986172] [INFO ] [MAIN ] Derivative Progress: 1764/2075 symbols completed. SYY took 1.2s. Estimated remaining: 2m 1s. Rate: 153.8 symbols/min [2025-09-24T22:27:06.986618] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:07.036942] [DEBUG] [LOCAL ] TAC: Loaded 42852 existing records from primary storage. [2025-09-24T22:27:07.037305] [INFO ] [MAIN ] TAC: Loaded 42852 primary data records. [2025-09-24T22:27:07.141033] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-24T22:27:07.166201] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-24T22:27:07.271518] [DEBUG] [LOCAL ] TAK: Loaded 49852 existing records from primary storage. [2025-09-24T22:27:07.344725] [INFO ] [MAIN ] TAK: Loaded 49852 primary data records. [2025-09-24T22:27:08.036250] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:08.037577] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42852 primary records. [2025-09-24T22:27:08.038538] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-24T22:27:08.058349] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-24T22:27:08.058535] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-24T22:27:08.060634] [INFO ] [MAIN ] Derivative Progress: 1765/2075 symbols completed. TAC took 1.1s. Estimated remaining: 2m 1s. Rate: 153.6 symbols/min [2025-09-24T22:27:08.061200] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:08.074765] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:08.076004] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-24T22:27:08.076201] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-24T22:27:08.104983] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:08.106277] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49852 primary records. [2025-09-24T22:27:08.106638] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-24T22:27:08.123952] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-24T22:27:08.124059] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-24T22:27:08.127059] [INFO ] [MAIN ] Derivative Progress: 1766/2075 symbols completed. T took 1.2s. Estimated remaining: 2m 1s. Rate: 153.7 symbols/min [2025-09-24T22:27:08.127734] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:08.131949] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-24T22:27:08.145943] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-24T22:27:08.148664] [INFO ] [MAIN ] Derivative Progress: 1767/2075 symbols completed. TAK took 1.2s. Estimated remaining: 2m 0s. Rate: 153.8 symbols/min [2025-09-24T22:27:08.149141] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:08.174428] [DEBUG] [LOCAL ] TAL: Loaded 52104 existing records from primary storage. [2025-09-24T22:27:08.174808] [INFO ] [MAIN ] TAL: Loaded 52104 primary data records. [2025-09-24T22:27:08.413267] [DEBUG] [LOCAL ] TALO: Loaded 50834 existing records from primary storage. [2025-09-24T22:27:08.522333] [INFO ] [MAIN ] TALO: Loaded 50834 primary data records. [2025-09-24T22:27:08.582161] [DEBUG] [LOCAL ] TAP: Loaded 52874 existing records from primary storage. [2025-09-24T22:27:08.625931] [INFO ] [MAIN ] TAP: Loaded 52874 primary data records. [2025-09-24T22:27:09.286141] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:09.287484] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 52104 primary records. [2025-09-24T22:27:09.288108] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-24T22:27:09.306943] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-24T22:27:09.308423] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-24T22:27:09.311227] [INFO ] [MAIN ] Derivative Progress: 1768/2075 symbols completed. TAL took 1.3s. Estimated remaining: 1m 60s. Rate: 153.6 symbols/min [2025-09-24T22:27:09.341911] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:09.342803] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50834 primary records. [2025-09-24T22:27:09.342986] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-24T22:27:09.356625] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:09.357623] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52874 primary records. [2025-09-24T22:27:09.369162] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-24T22:27:09.384270] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-24T22:27:09.388540] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-24T22:27:09.390760] [INFO ] [MAIN ] Derivative Progress: 1769/2075 symbols completed. TALO took 1.3s. Estimated remaining: 1m 59s. Rate: 153.7 symbols/min [2025-09-24T22:27:09.395591] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-24T22:27:09.395761] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-24T22:27:09.398577] [INFO ] [MAIN ] Derivative Progress: 1770/2075 symbols completed. TAP took 1.2s. Estimated remaining: 1m 59s. Rate: 153.8 symbols/min [2025-09-24T22:27:09.399137] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:09.399283] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:09.399576] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:09.413212] [DEBUG] [LOCAL ] TBB: Loaded 11717 existing records from primary storage. [2025-09-24T22:27:09.413379] [INFO ] [MAIN ] TBB: Loaded 11717 primary data records. [2025-09-24T22:27:09.633472] [DEBUG] [LOCAL ] TBI: Loaded 22593 existing records from primary storage. [2025-09-24T22:27:09.736915] [INFO ] [MAIN ] TBI: Loaded 22593 primary data records. [2025-09-24T22:27:09.742840] [DEBUG] [LOCAL ] TBBB: Loaded 35683 existing records from primary storage. [2025-09-24T22:27:09.751767] [INFO ] [MAIN ] TBBB: Loaded 35683 primary data records. [2025-09-24T22:27:10.381435] [DEBUG] [MAIN ] TBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:10.382382] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11717 primary records. [2025-09-24T22:27:10.383224] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-24T22:27:10.401146] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-24T22:27:10.401409] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-24T22:27:10.403852] [INFO ] [MAIN ] Derivative Progress: 1771/2075 symbols completed. TBB took 1.0s. Estimated remaining: 1m 59s. Rate: 153.6 symbols/min [2025-09-24T22:27:10.404357] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:10.420625] [DEBUG] [LOCAL ] TBN: Loaded 2982 existing records from primary storage. [2025-09-24T22:27:10.426570] [INFO ] [MAIN ] TBN: Loaded 2982 primary data records. [2025-09-24T22:27:10.426440] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:10.449886] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35683 primary records. [2025-09-24T22:27:10.466772] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-24T22:27:10.561321] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:10.576523] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22593 primary records. [2025-09-24T22:27:10.581843] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-24T22:27:10.581764] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-24T22:27:10.581974] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-24T22:27:10.595314] [INFO ] [MAIN ] Derivative Progress: 1772/2075 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 58s. Rate: 153.7 symbols/min [2025-09-24T22:27:10.640298] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:10.790408] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-24T22:27:10.790548] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-24T22:27:10.793137] [INFO ] [MAIN ] Derivative Progress: 1773/2075 symbols completed. TBI took 1.4s. Estimated remaining: 1m 58s. Rate: 153.7 symbols/min [2025-09-24T22:27:10.793494] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:10.818597] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:27:10.819514] [INFO ] [MAIN ] TBN: Generated 1792 derivative records from 2982 primary records. [2025-09-24T22:27:10.819729] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-24T22:27:10.847983] [DEBUG] [LOCAL ] TBN: Derivative data saved (1792 records). [2025-09-24T22:27:10.848171] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-24T22:27:10.851562] [INFO ] [MAIN ] Derivative Progress: 1774/2075 symbols completed. TBN took 0.4s. Estimated remaining: 1m 57s. Rate: 153.8 symbols/min [2025-09-24T22:27:10.861147] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:10.878468] [DEBUG] [LOCAL ] TD: Loaded 52269 existing records from primary storage. [2025-09-24T22:27:10.878785] [INFO ] [MAIN ] TD: Loaded 52269 primary data records. [2025-09-24T22:27:11.009980] [DEBUG] [LOCAL ] TDC: Loaded 46847 existing records from primary storage. [2025-09-24T22:27:10.997426] [DEBUG] [LOCAL ] TDF: Loaded 6502 existing records from primary storage. [2025-09-24T22:27:11.010209] [INFO ] [MAIN ] TDC: Loaded 46847 primary data records. [2025-09-24T22:27:11.010561] [INFO ] [MAIN ] TDF: Loaded 6502 primary data records. [2025-09-24T22:27:11.911399] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:11.912232] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52269 primary records. [2025-09-24T22:27:11.912510] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-24T22:27:11.932628] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-24T22:27:11.932946] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-24T22:27:11.935723] [INFO ] [MAIN ] Derivative Progress: 1775/2075 symbols completed. TD took 1.3s. Estimated remaining: 1m 57s. Rate: 153.6 symbols/min [2025-09-24T22:27:11.943953] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:11.951584] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:11.952590] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6502 primary records. [2025-09-24T22:27:11.952774] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-24T22:27:11.978825] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:11.980875] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46847 primary records. [2025-09-24T22:27:11.981810] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-24T22:27:11.999278] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-24T22:27:12.002141] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-24T22:27:12.005953] [INFO ] [MAIN ] Derivative Progress: 1776/2075 symbols completed. TDF took 1.1s. Estimated remaining: 1m 57s. Rate: 153.7 symbols/min [2025-09-24T22:27:12.006728] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:12.018069] [DEBUG] [LOCAL ] TDG: Loaded 22048 existing records from primary storage. [2025-09-24T22:27:12.019111] [INFO ] [MAIN ] TDG: Loaded 22048 primary data records. [2025-09-24T22:27:12.020320] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-24T22:27:12.041420] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-24T22:27:12.060225] [INFO ] [MAIN ] Derivative Progress: 1777/2075 symbols completed. TDC took 1.3s. Estimated remaining: 1m 56s. Rate: 153.8 symbols/min [2025-09-24T22:27:12.102555] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:12.376913] [DEBUG] [LOCAL ] TDOC: Loaded 53345 existing records from primary storage. [2025-09-24T22:27:12.378306] [INFO ] [MAIN ] TDOC: Loaded 53345 primary data records. [2025-09-24T22:27:12.579379] [DEBUG] [LOCAL ] TDS: Loaded 42796 existing records from primary storage. [2025-09-24T22:27:12.598470] [INFO ] [MAIN ] TDS: Loaded 42796 primary data records. [2025-09-24T22:27:13.076575] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:13.092333] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22048 primary records. [2025-09-24T22:27:13.092514] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-24T22:27:13.111886] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-24T22:27:13.112281] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-24T22:27:13.114827] [INFO ] [MAIN ] Derivative Progress: 1778/2075 symbols completed. TDG took 1.2s. Estimated remaining: 1m 56s. Rate: 153.6 symbols/min [2025-09-24T22:27:13.115489] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:13.135365] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:13.136255] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53345 primary records. [2025-09-24T22:27:13.136624] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-24T22:27:13.154618] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-24T22:27:13.154974] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-24T22:27:13.158081] [INFO ] [MAIN ] Derivative Progress: 1779/2075 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 56s. Rate: 153.7 symbols/min [2025-09-24T22:27:13.160337] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:13.184733] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:13.185469] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42796 primary records. [2025-09-24T22:27:13.185541] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-24T22:27:13.218803] [DEBUG] [LOCAL ] TDW: Loaded 45409 existing records from primary storage. [2025-09-24T22:27:13.219436] [INFO ] [MAIN ] TDW: Loaded 45409 primary data records. [2025-09-24T22:27:13.260166] [DEBUG] [LOCAL ] TDY: Loaded 22668 existing records from primary storage. [2025-09-24T22:27:13.266022] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-24T22:27:13.266131] [INFO ] [MAIN ] TDY: Loaded 22668 primary data records. [2025-09-24T22:27:13.266319] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-24T22:27:13.268812] [INFO ] [MAIN ] Derivative Progress: 1780/2075 symbols completed. TDS took 1.2s. Estimated remaining: 1m 55s. Rate: 153.8 symbols/min [2025-09-24T22:27:13.345977] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:13.541549] [DEBUG] [LOCAL ] TEAF: Loaded 7370 existing records from primary storage. [2025-09-24T22:27:13.604949] [INFO ] [MAIN ] TEAF: Loaded 7370 primary data records. [2025-09-24T22:27:14.173665] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:14.174747] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45409 primary records. [2025-09-24T22:27:14.174923] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-24T22:27:14.195173] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:14.196920] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22668 primary records. [2025-09-24T22:27:14.199816] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-24T22:27:14.221453] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-24T22:27:14.221555] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-24T22:27:14.222363] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-24T22:27:14.222489] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-24T22:27:14.224796] [INFO ] [MAIN ] Derivative Progress: 1781/2075 symbols completed. TDW took 1.1s. Estimated remaining: 1m 55s. Rate: 153.6 symbols/min [2025-09-24T22:27:14.227485] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:14.227769] [INFO ] [MAIN ] Derivative Progress: 1782/2075 symbols completed. TDY took 1.1s. Estimated remaining: 1m 54s. Rate: 153.7 symbols/min [2025-09-24T22:27:14.228492] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:14.241712] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:14.242535] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7370 primary records. [2025-09-24T22:27:14.242672] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-24T22:27:14.258593] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-24T22:27:14.258795] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-24T22:27:14.261053] [INFO ] [MAIN ] Derivative Progress: 1783/2075 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 54s. Rate: 153.8 symbols/min [2025-09-24T22:27:14.290063] [DEBUG] [LOCAL ] TEF: Loaded 37326 existing records from primary storage. [2025-09-24T22:27:14.290282] [INFO ] [MAIN ] TEF: Loaded 37326 primary data records. [2025-09-24T22:27:14.466395] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-24T22:27:14.483554] [INFO ] [MAIN ] TECK: Loaded 53436 primary data records. [2025-09-24T22:27:14.946413] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:14.947192] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37326 primary records. [2025-09-24T22:27:14.947338] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-24T22:27:14.963826] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-24T22:27:14.964597] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-24T22:27:14.967662] [INFO ] [MAIN ] Derivative Progress: 1784/2075 symbols completed. TEF took 0.7s. Estimated remaining: 1m 54s. Rate: 153.7 symbols/min [2025-09-24T22:27:14.980340] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:14.980922] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53436 primary records. [2025-09-24T22:27:14.980983] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-24T22:27:14.995925] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-24T22:27:14.995985] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-24T22:27:14.998401] [INFO ] [MAIN ] Derivative Progress: 1785/2075 symbols completed. TECK took 0.8s. Estimated remaining: 1m 53s. Rate: 153.8 symbols/min [2025-09-24T22:27:14.999099] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:14.998897] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:14.999241] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:15.043168] [DEBUG] [LOCAL ] TEI: Loaded 20526 existing records from primary storage. [2025-09-24T22:27:15.043343] [INFO ] [MAIN ] TEI: Loaded 20526 primary data records. [2025-09-24T22:27:15.043909] [DEBUG] [LOCAL ] TEN: Loaded 31027 existing records from primary storage. [2025-09-24T22:27:15.065578] [INFO ] [MAIN ] TEN: Loaded 31027 primary data records. [2025-09-24T22:27:15.428006] [DEBUG] [LOCAL ] TEL: Loaded 51151 existing records from primary storage. [2025-09-24T22:27:15.459692] [INFO ] [MAIN ] TEL: Loaded 51151 primary data records. [2025-09-24T22:27:16.093155] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:16.096748] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20526 primary records. [2025-09-24T22:27:16.097394] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-24T22:27:16.123321] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:16.132584] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 31027 primary records. [2025-09-24T22:27:16.132735] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-24T22:27:16.133386] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-24T22:27:16.134314] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-24T22:27:16.144963] [INFO ] [MAIN ] Derivative Progress: 1786/2075 symbols completed. TEI took 1.1s. Estimated remaining: 1m 53s. Rate: 153.7 symbols/min [2025-09-24T22:27:16.154584] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-24T22:27:16.154804] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:16.155620] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-24T22:27:16.158363] [INFO ] [MAIN ] Derivative Progress: 1787/2075 symbols completed. TEN took 1.2s. Estimated remaining: 1m 52s. Rate: 153.7 symbols/min [2025-09-24T22:27:16.159217] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:16.206404] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:16.209706] [DEBUG] [LOCAL ] TEO: Loaded 21995 existing records from primary storage. [2025-09-24T22:27:16.209872] [INFO ] [MAIN ] TEO: Loaded 21995 primary data records. [2025-09-24T22:27:16.209041] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51151 primary records. [2025-09-24T22:27:16.210016] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-24T22:27:16.349574] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-24T22:27:16.356684] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-24T22:27:16.379551] [INFO ] [MAIN ] Derivative Progress: 1788/2075 symbols completed. TEL took 1.4s. Estimated remaining: 1m 52s. Rate: 153.8 symbols/min [2025-09-24T22:27:16.412156] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:16.453832] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-24T22:27:16.573125] [INFO ] [MAIN ] TEVA: Loaded 53633 primary data records. [2025-09-24T22:27:16.925964] [DEBUG] [LOCAL ] TEX: Loaded 44627 existing records from primary storage. [2025-09-24T22:27:16.927895] [INFO ] [MAIN ] TEX: Loaded 44627 primary data records. [2025-09-24T22:27:16.997119] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:17.028681] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 21995 primary records. [2025-09-24T22:27:17.033913] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-24T22:27:17.241171] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-24T22:27:17.327055] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-24T22:27:17.342179] [INFO ] [MAIN ] Derivative Progress: 1789/2075 symbols completed. TEO took 1.2s. Estimated remaining: 1m 52s. Rate: 153.6 symbols/min [2025-09-24T22:27:17.342598] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:17.344456] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53633 primary records. [2025-09-24T22:27:17.344625] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:17.344838] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-24T22:27:17.363779] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-24T22:27:17.363905] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-24T22:27:17.366704] [INFO ] [MAIN ] Derivative Progress: 1790/2075 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 51s. Rate: 153.7 symbols/min [2025-09-24T22:27:17.367142] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:17.388521] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:17.389356] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44627 primary records. [2025-09-24T22:27:17.389545] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-24T22:27:17.406352] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-24T22:27:17.406745] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-24T22:27:17.419234] [INFO ] [MAIN ] Derivative Progress: 1791/2075 symbols completed. TEX took 1.0s. Estimated remaining: 1m 51s. Rate: 153.8 symbols/min [2025-09-24T22:27:17.419735] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:17.473135] [DEBUG] [LOCAL ] TFII: Loaded 34270 existing records from primary storage. [2025-09-24T22:27:17.480617] [INFO ] [MAIN ] TFII: Loaded 34270 primary data records. [2025-09-24T22:27:17.481357] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-24T22:27:17.502458] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-24T22:27:17.636722] [DEBUG] [LOCAL ] TFIN: Loaded 23600 existing records from primary storage. [2025-09-24T22:27:17.672081] [INFO ] [MAIN ] TFIN: Loaded 23600 primary data records. [2025-09-24T22:27:18.457392] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:18.458512] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-24T22:27:18.466735] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-24T22:27:18.473836] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:18.474757] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 34270 primary records. [2025-09-24T22:27:18.497531] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-24T22:27:18.497668] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-24T22:27:18.485953] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-24T22:27:18.505279] [INFO ] [MAIN ] Derivative Progress: 1792/2075 symbols completed. TFC took 1.2s. Estimated remaining: 1m 51s. Rate: 153.7 symbols/min [2025-09-24T22:27:18.505672] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:18.507945] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:18.507350] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23600 primary records. [2025-09-24T22:27:18.522468] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-24T22:27:18.523762] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-24T22:27:18.524962] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-24T22:27:18.527805] [INFO ] [MAIN ] Derivative Progress: 1793/2075 symbols completed. TFII took 1.2s. Estimated remaining: 1m 50s. Rate: 153.7 symbols/min [2025-09-24T22:27:18.535374] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:18.544253] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-24T22:27:18.544455] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-24T22:27:18.547071] [INFO ] [MAIN ] Derivative Progress: 1794/2075 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 50s. Rate: 153.8 symbols/min [2025-09-24T22:27:18.547509] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:18.559809] [DEBUG] [LOCAL ] TG: Loaded 10495 existing records from primary storage. [2025-09-24T22:27:18.560013] [INFO ] [MAIN ] TG: Loaded 10495 primary data records. [2025-09-24T22:27:18.744561] [DEBUG] [LOCAL ] TFPM: Loaded 37385 existing records from primary storage. [2025-09-24T22:27:18.786876] [INFO ] [MAIN ] TFPM: Loaded 37385 primary data records. [2025-09-24T22:27:18.799365] [DEBUG] [LOCAL ] TFX: Loaded 37291 existing records from primary storage. [2025-09-24T22:27:18.953299] [INFO ] [MAIN ] TFX: Loaded 37291 primary data records. [2025-09-24T22:27:19.589529] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:19.590830] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10495 primary records. [2025-09-24T22:27:19.591196] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-24T22:27:19.610933] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-24T22:27:19.611894] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-24T22:27:19.614446] [INFO ] [MAIN ] Derivative Progress: 1795/2075 symbols completed. TG took 1.1s. Estimated remaining: 1m 49s. Rate: 153.7 symbols/min [2025-09-24T22:27:19.614997] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:19.631752] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:19.632721] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37385 primary records. [2025-09-24T22:27:19.632941] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-24T22:27:19.654540] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-24T22:27:19.662701] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-24T22:27:19.665532] [INFO ] [MAIN ] Derivative Progress: 1796/2075 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 49s. Rate: 153.7 symbols/min [2025-09-24T22:27:19.666246] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:19.679443] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:19.680346] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37291 primary records. [2025-09-24T22:27:19.680556] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-24T22:27:19.706819] [DEBUG] [LOCAL ] TGLS: Loaded 28289 existing records from primary storage. [2025-09-24T22:27:19.709435] [INFO ] [MAIN ] TGLS: Loaded 28289 primary data records. [2025-09-24T22:27:19.711023] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-24T22:27:19.711189] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-24T22:27:19.713956] [INFO ] [MAIN ] Derivative Progress: 1797/2075 symbols completed. TFX took 1.2s. Estimated remaining: 1m 48s. Rate: 153.8 symbols/min [2025-09-24T22:27:19.719500] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:20.004925] [DEBUG] [LOCAL ] TGNA: Loaded 48698 existing records from primary storage. [2025-09-24T22:27:20.053287] [INFO ] [MAIN ] TGNA: Loaded 48698 primary data records. [2025-09-24T22:27:20.175352] [DEBUG] [LOCAL ] TGS: Loaded 32486 existing records from primary storage. [2025-09-24T22:27:20.176639] [INFO ] [MAIN ] TGS: Loaded 32486 primary data records. [2025-09-24T22:27:20.740838] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:20.742042] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28289 primary records. [2025-09-24T22:27:20.742237] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-24T22:27:20.761566] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-24T22:27:20.762543] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-24T22:27:20.765533] [INFO ] [MAIN ] Derivative Progress: 1798/2075 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 48s. Rate: 153.7 symbols/min [2025-09-24T22:27:20.785480] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:20.786316] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48698 primary records. [2025-09-24T22:27:20.786475] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-24T22:27:20.818144] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:20.819360] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32486 primary records. [2025-09-24T22:27:20.819908] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-24T22:27:20.820560] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-24T22:27:20.820953] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-24T22:27:20.823512] [INFO ] [MAIN ] Derivative Progress: 1799/2075 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 48s. Rate: 153.7 symbols/min [2025-09-24T22:27:20.838729] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-24T22:27:20.838797] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-24T22:27:20.841452] [INFO ] [MAIN ] Derivative Progress: 1800/2075 symbols completed. TGS took 1.1s. Estimated remaining: 1m 47s. Rate: 153.8 symbols/min [2025-09-24T22:27:20.842157] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:20.842068] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:20.842214] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:20.868374] [DEBUG] [LOCAL ] THG: Loaded 21781 existing records from primary storage. [2025-09-24T22:27:20.868624] [INFO ] [MAIN ] THG: Loaded 21781 primary data records. [2025-09-24T22:27:21.112455] [DEBUG] [LOCAL ] THC: Loaded 48021 existing records from primary storage. [2025-09-24T22:27:21.275840] [INFO ] [MAIN ] THC: Loaded 48021 primary data records. [2025-09-24T22:27:21.319351] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-24T22:27:21.342791] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-24T22:27:21.935891] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:21.937046] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21781 primary records. [2025-09-24T22:27:21.938099] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-24T22:27:21.958410] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-24T22:27:21.958581] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-24T22:27:21.961483] [INFO ] [MAIN ] Derivative Progress: 1801/2075 symbols completed. THG took 1.1s. Estimated remaining: 1m 47s. Rate: 153.7 symbols/min [2025-09-24T22:27:21.962120] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:21.970301] [DEBUG] [LOCAL ] THIR: Loaded 2202 existing records from primary storage. [2025-09-24T22:27:21.970853] [INFO ] [MAIN ] THIR: Loaded 2202 primary data records. [2025-09-24T22:27:22.030634] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:22.058146] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 48021 primary records. [2025-09-24T22:27:22.076709] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-24T22:27:22.107496] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:22.108479] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-24T22:27:22.115934] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-24T22:27:22.197092] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-24T22:27:22.188274] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-24T22:27:22.197240] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-24T22:27:22.216820] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-24T22:27:22.216719] [INFO ] [MAIN ] Derivative Progress: 1802/2075 symbols completed. TGT took 1.4s. Estimated remaining: 1m 47s. Rate: 153.7 symbols/min [2025-09-24T22:27:22.344786] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:22.344966] [INFO ] [MAIN ] Derivative Progress: 1803/2075 symbols completed. THC took 1.5s. Estimated remaining: 1m 46s. Rate: 153.8 symbols/min [2025-09-24T22:27:22.345250] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:22.352552] [DEBUG] [LOCAL ] THLV: Loaded 1609 existing records from primary storage. [2025-09-24T22:27:22.352900] [INFO ] [MAIN ] THLV: Loaded 1609 primary data records. [2025-09-24T22:27:22.710266] [DEBUG] [LOCAL ] THO: Loaded 42345 existing records from primary storage. [2025-09-24T22:27:22.715686] [INFO ] [MAIN ] THO: Loaded 42345 primary data records. [2025-09-24T22:27:22.715607] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:22.716781] [INFO ] [MAIN ] THIR: Generated 1793 derivative records from 2202 primary records. [2025-09-24T22:27:22.717436] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-24T22:27:22.809970] [DEBUG] [LOCAL ] THIR: Derivative data saved (1793 records). [2025-09-24T22:27:22.810422] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-24T22:27:22.824480] [INFO ] [MAIN ] Derivative Progress: 1804/2075 symbols completed. THIR took 0.9s. Estimated remaining: 1m 46s. Rate: 153.7 symbols/min [2025-09-24T22:27:22.824974] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:23.074762] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-24T22:27:23.081240] [INFO ] [MAIN ] THLV: Generated 1792 derivative records from 1609 primary records. [2025-09-24T22:27:23.081379] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-24T22:27:23.095567] [DEBUG] [LOCAL ] THLV: Derivative data saved (1792 records). [2025-09-24T22:27:23.096807] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-24T22:27:23.099343] [INFO ] [MAIN ] Derivative Progress: 1805/2075 symbols completed. THLV took 0.8s. Estimated remaining: 1m 45s. Rate: 153.8 symbols/min [2025-09-24T22:27:23.100009] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:23.110907] [DEBUG] [LOCAL ] THQ: Loaded 24522 existing records from primary storage. [2025-09-24T22:27:23.111207] [INFO ] [MAIN ] THQ: Loaded 24522 primary data records. [2025-09-24T22:27:23.257621] [DEBUG] [LOCAL ] THR: Loaded 19903 existing records from primary storage. [2025-09-24T22:27:23.288528] [INFO ] [MAIN ] THR: Loaded 19903 primary data records. [2025-09-24T22:27:23.707285] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:23.769537] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42345 primary records. [2025-09-24T22:27:23.942917] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-24T22:27:23.985088] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-24T22:27:23.985834] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-24T22:27:23.994731] [INFO ] [MAIN ] Derivative Progress: 1806/2075 symbols completed. THO took 1.6s. Estimated remaining: 1m 45s. Rate: 153.6 symbols/min [2025-09-24T22:27:24.001789] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:24.027315] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:24.028866] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24522 primary records. [2025-09-24T22:27:24.029214] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-24T22:27:24.075184] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-24T22:27:24.075887] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-24T22:27:24.078511] [INFO ] [MAIN ] Derivative Progress: 1807/2075 symbols completed. THQ took 1.3s. Estimated remaining: 1m 45s. Rate: 153.7 symbols/min [2025-09-24T22:27:24.078881] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:24.083176] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:24.084846] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19903 primary records. [2025-09-24T22:27:24.085115] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-24T22:27:24.125118] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-24T22:27:24.125364] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-24T22:27:24.128893] [INFO ] [MAIN ] Derivative Progress: 1808/2075 symbols completed. THR took 1.0s. Estimated remaining: 1m 44s. Rate: 153.8 symbols/min [2025-09-24T22:27:24.135837] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:24.150025] [DEBUG] [LOCAL ] THW: Loaded 19134 existing records from primary storage. [2025-09-24T22:27:24.169347] [INFO ] [MAIN ] THW: Loaded 19134 primary data records. [2025-09-24T22:27:24.183502] [DEBUG] [LOCAL ] THS: Loaded 38007 existing records from primary storage. [2025-09-24T22:27:24.188989] [INFO ] [MAIN ] THS: Loaded 38007 primary data records. [2025-09-24T22:27:24.556082] [DEBUG] [LOCAL ] TIMB: Loaded 36658 existing records from primary storage. [2025-09-24T22:27:24.582469] [INFO ] [MAIN ] TIMB: Loaded 36658 primary data records. [2025-09-24T22:27:25.337704] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:25.350955] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19134 primary records. [2025-09-24T22:27:25.351382] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:25.351621] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-24T22:27:25.352274] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38007 primary records. [2025-09-24T22:27:25.352669] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-24T22:27:25.383788] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-24T22:27:25.387093] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-24T22:27:25.387315] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-24T22:27:25.390453] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-24T22:27:25.390354] [INFO ] [MAIN ] Derivative Progress: 1809/2075 symbols completed. THS took 1.4s. Estimated remaining: 1m 44s. Rate: 153.6 symbols/min [2025-09-24T22:27:25.395594] [INFO ] [MAIN ] Derivative Progress: 1810/2075 symbols completed. THW took 1.3s. Estimated remaining: 1m 43s. Rate: 153.7 symbols/min [2025-09-24T22:27:25.396416] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:25.396856] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:25.412912] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:25.413995] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36658 primary records. [2025-09-24T22:27:25.414178] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-24T22:27:25.430692] [DEBUG] [LOCAL ] TISI: Loaded 3787 existing records from primary storage. [2025-09-24T22:27:25.431466] [INFO ] [MAIN ] TISI: Loaded 3787 primary data records. [2025-09-24T22:27:25.554208] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-24T22:27:25.558174] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-24T22:27:25.560628] [INFO ] [MAIN ] Derivative Progress: 1811/2075 symbols completed. TIMB took 1.4s. Estimated remaining: 1m 43s. Rate: 153.7 symbols/min [2025-09-24T22:27:25.561303] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:25.577895] [DEBUG] [LOCAL ] TIXT: Loaded 31483 existing records from primary storage. [2025-09-24T22:27:25.588590] [INFO ] [MAIN ] TIXT: Loaded 31483 primary data records. [2025-09-24T22:27:26.158336] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-09-24T22:27:26.159228] [INFO ] [MAIN ] TJX: Loaded 53669 primary data records. [2025-09-24T22:27:26.159087] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:26.160303] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3787 primary records. [2025-09-24T22:27:26.165740] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-24T22:27:26.262217] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-24T22:27:26.298152] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-24T22:27:26.298552] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:26.301075] [INFO ] [MAIN ] Derivative Progress: 1812/2075 symbols completed. TISI took 0.9s. Estimated remaining: 1m 43s. Rate: 153.7 symbols/min [2025-09-24T22:27:26.302226] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:26.301979] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31483 primary records. [2025-09-24T22:27:26.308128] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-24T22:27:26.526012] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-24T22:27:26.526339] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-24T22:27:26.529366] [INFO ] [MAIN ] Derivative Progress: 1813/2075 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 42s. Rate: 153.7 symbols/min [2025-09-24T22:27:26.567231] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:26.568244] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53669 primary records. [2025-09-24T22:27:26.578529] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-24T22:27:26.581094] [DEBUG] [LOCAL ] TK: Loaded 39711 existing records from primary storage. [2025-09-24T22:27:26.581218] [INFO ] [MAIN ] TK: Loaded 39711 primary data records. [2025-09-24T22:27:26.690938] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-24T22:27:26.701476] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-24T22:27:26.703802] [INFO ] [MAIN ] Derivative Progress: 1814/2075 symbols completed. TJX took 1.1s. Estimated remaining: 1m 42s. Rate: 153.7 symbols/min [2025-09-24T22:27:26.910334] [DEBUG] [MAIN ] TK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:26.910968] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39711 primary records. [2025-09-24T22:27:26.911032] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-24T22:27:26.925819] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-24T22:27:26.925894] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-24T22:27:26.928261] [INFO ] [MAIN ] Derivative Progress: 1815/2075 symbols completed. TK took 0.6s. Estimated remaining: 1m 41s. Rate: 153.8 symbols/min [2025-09-24T22:27:26.929367] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:26.929258] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:26.929131] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:26.985266] [DEBUG] [LOCAL ] TKC: Loaded 38381 existing records from primary storage. [2025-09-24T22:27:26.996157] [INFO ] [MAIN ] TKC: Loaded 38381 primary data records. [2025-09-24T22:27:26.997840] [DEBUG] [LOCAL ] TKR: Loaded 40238 existing records from primary storage. [2025-09-24T22:27:27.028730] [INFO ] [MAIN ] TKR: Loaded 40238 primary data records. [2025-09-24T22:27:27.087719] [DEBUG] [LOCAL ] TKO: Loaded 44166 existing records from primary storage. [2025-09-24T22:27:27.153692] [INFO ] [MAIN ] TKO: Loaded 44166 primary data records. [2025-09-24T22:27:28.010477] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:28.013209] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40238 primary records. [2025-09-24T22:27:28.015028] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-24T22:27:28.045395] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-24T22:27:28.045581] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-24T22:27:28.055504] [INFO ] [MAIN ] Derivative Progress: 1816/2075 symbols completed. TKR took 1.1s. Estimated remaining: 1m 41s. Rate: 153.6 symbols/min [2025-09-24T22:27:28.043194] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:28.060901] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:28.061265] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:28.062300] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44166 primary records. [2025-09-24T22:27:28.063020] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38381 primary records. [2025-09-24T22:27:28.063412] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-24T22:27:28.063329] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-24T22:27:28.093514] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-24T22:27:28.094149] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-24T22:27:28.096949] [INFO ] [MAIN ] Derivative Progress: 1817/2075 symbols completed. TKC took 1.2s. Estimated remaining: 1m 41s. Rate: 153.7 symbols/min [2025-09-24T22:27:28.097770] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:28.101841] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-24T22:27:28.102006] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-24T22:27:28.104871] [INFO ] [MAIN ] Derivative Progress: 1818/2075 symbols completed. TKO took 1.2s. Estimated remaining: 1m 40s. Rate: 153.8 symbols/min [2025-09-24T22:27:28.105296] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:28.132775] [DEBUG] [LOCAL ] TLYS: Loaded 16973 existing records from primary storage. [2025-09-24T22:27:28.145227] [DEBUG] [LOCAL ] TLK: Loaded 39448 existing records from primary storage. [2025-09-24T22:27:28.145435] [INFO ] [MAIN ] TLK: Loaded 39448 primary data records. [2025-09-24T22:27:28.144680] [INFO ] [MAIN ] TLYS: Loaded 16973 primary data records. [2025-09-24T22:27:28.516339] [DEBUG] [LOCAL ] TM: Loaded 36600 existing records from primary storage. [2025-09-24T22:27:28.532714] [INFO ] [MAIN ] TM: Loaded 36600 primary data records. [2025-09-24T22:27:29.119171] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:29.132396] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39448 primary records. [2025-09-24T22:27:29.132696] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:29.133247] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-24T22:27:29.134520] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16973 primary records. [2025-09-24T22:27:29.135489] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-24T22:27:29.167813] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-24T22:27:29.168978] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-24T22:27:29.169212] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-24T22:27:29.169119] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-24T22:27:29.171376] [INFO ] [MAIN ] Derivative Progress: 1819/2075 symbols completed. TLK took 1.1s. Estimated remaining: 1m 40s. Rate: 153.6 symbols/min [2025-09-24T22:27:29.174588] [INFO ] [MAIN ] Derivative Progress: 1820/2075 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 40s. Rate: 153.7 symbols/min [2025-09-24T22:27:29.174725] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:29.175332] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:29.192808] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:29.193537] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36600 primary records. [2025-09-24T22:27:29.193676] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-24T22:27:29.211909] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-24T22:27:29.212175] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-24T22:27:29.218118] [INFO ] [MAIN ] Derivative Progress: 1821/2075 symbols completed. TM took 1.1s. Estimated remaining: 1m 39s. Rate: 153.8 symbols/min [2025-09-24T22:27:29.218420] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:29.262984] [DEBUG] [LOCAL ] TMHC: Loaded 45628 existing records from primary storage. [2025-09-24T22:27:29.263128] [INFO ] [MAIN ] TMHC: Loaded 45628 primary data records. [2025-09-24T22:27:29.382192] [DEBUG] [LOCAL ] TME: Loaded 53201 existing records from primary storage. [2025-09-24T22:27:29.382923] [INFO ] [MAIN ] TME: Loaded 53201 primary data records. [2025-09-24T22:27:29.719787] [DEBUG] [LOCAL ] TMO: Loaded 52330 existing records from primary storage. [2025-09-24T22:27:29.735992] [INFO ] [MAIN ] TMO: Loaded 52330 primary data records. [2025-09-24T22:27:30.299979] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:30.301882] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45628 primary records. [2025-09-24T22:27:30.302294] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-24T22:27:30.320118] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-24T22:27:30.321634] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-24T22:27:30.325009] [INFO ] [MAIN ] Derivative Progress: 1822/2075 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 39s. Rate: 153.6 symbols/min [2025-09-24T22:27:30.325510] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:30.339440] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:30.340698] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53201 primary records. [2025-09-24T22:27:30.340808] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-24T22:27:30.361276] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-24T22:27:30.361447] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-24T22:27:30.364029] [INFO ] [MAIN ] Derivative Progress: 1823/2075 symbols completed. TME took 1.2s. Estimated remaining: 1m 38s. Rate: 153.7 symbols/min [2025-09-24T22:27:30.380304] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:30.381474] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:30.382305] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52330 primary records. [2025-09-24T22:27:30.383026] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-24T22:27:30.389933] [DEBUG] [LOCAL ] TNC: Loaded 15142 existing records from primary storage. [2025-09-24T22:27:30.390396] [INFO ] [MAIN ] TNC: Loaded 15142 primary data records. [2025-09-24T22:27:30.438175] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-24T22:27:30.450468] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-24T22:27:30.453135] [INFO ] [MAIN ] Derivative Progress: 1824/2075 symbols completed. TMO took 1.2s. Estimated remaining: 1m 38s. Rate: 153.8 symbols/min [2025-09-24T22:27:30.475356] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:30.740866] [DEBUG] [LOCAL ] TNET: Loaded 28809 existing records from primary storage. [2025-09-24T22:27:30.741097] [INFO ] [MAIN ] TNET: Loaded 28809 primary data records. [2025-09-24T22:27:30.953304] [DEBUG] [LOCAL ] TNK: Loaded 35229 existing records from primary storage. [2025-09-24T22:27:31.015072] [INFO ] [MAIN ] TNK: Loaded 35229 primary data records. [2025-09-24T22:27:31.389000] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:31.389979] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 15142 primary records. [2025-09-24T22:27:31.390303] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-24T22:27:31.411445] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-24T22:27:31.412471] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-24T22:27:31.414724] [INFO ] [MAIN ] Derivative Progress: 1825/2075 symbols completed. TNC took 1.1s. Estimated remaining: 1m 38s. Rate: 153.6 symbols/min [2025-09-24T22:27:31.415121] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:31.429462] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:31.430387] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28809 primary records. [2025-09-24T22:27:31.430688] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-24T22:27:31.446783] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-24T22:27:31.446967] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-24T22:27:31.449842] [INFO ] [MAIN ] Derivative Progress: 1826/2075 symbols completed. TNET took 1.1s. Estimated remaining: 1m 37s. Rate: 153.7 symbols/min [2025-09-24T22:27:31.450372] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:31.468810] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:31.469584] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35229 primary records. [2025-09-24T22:27:31.469756] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-24T22:27:31.485914] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-24T22:27:31.485991] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-24T22:27:31.488335] [INFO ] [MAIN ] Derivative Progress: 1827/2075 symbols completed. TNK took 1.0s. Estimated remaining: 1m 37s. Rate: 153.8 symbols/min [2025-09-24T22:27:31.488966] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:31.517104] [DEBUG] [LOCAL ] TNL: Loaded 41895 existing records from primary storage. [2025-09-24T22:27:31.529589] [INFO ] [MAIN ] TNL: Loaded 41895 primary data records. [2025-09-24T22:27:31.658125] [DEBUG] [LOCAL ] TOL: Loaded 51079 existing records from primary storage. [2025-09-24T22:27:31.658723] [INFO ] [MAIN ] TOL: Loaded 51079 primary data records. [2025-09-24T22:27:32.042758] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-24T22:27:32.059683] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-24T22:27:32.560337] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:32.561234] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41895 primary records. [2025-09-24T22:27:32.561886] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-24T22:27:32.583481] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-24T22:27:32.583918] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-24T22:27:32.586347] [INFO ] [MAIN ] Derivative Progress: 1828/2075 symbols completed. TNL took 1.2s. Estimated remaining: 1m 36s. Rate: 153.6 symbols/min [2025-09-24T22:27:32.599316] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:32.600100] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 51079 primary records. [2025-09-24T22:27:32.600247] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-24T22:27:32.619079] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-24T22:27:32.631188] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-24T22:27:32.633969] [INFO ] [MAIN ] Derivative Progress: 1829/2075 symbols completed. TOL took 1.2s. Estimated remaining: 1m 36s. Rate: 153.7 symbols/min [2025-09-24T22:27:32.631461] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:32.634854] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-24T22:27:32.634936] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-24T22:27:32.650030] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-24T22:27:32.650089] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-24T22:27:32.653696] [INFO ] [MAIN ] Derivative Progress: 1830/2075 symbols completed. TOST took 1.2s. Estimated remaining: 1m 36s. Rate: 153.8 symbols/min [2025-09-24T22:27:32.654161] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:32.654354] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:32.654470] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:32.700146] [DEBUG] [LOCAL ] TPB: Loaded 24883 existing records from primary storage. [2025-09-24T22:27:32.700364] [INFO ] [MAIN ] TPB: Loaded 24883 primary data records. [2025-09-24T22:27:32.835585] [DEBUG] [LOCAL ] TPC: Loaded 38817 existing records from primary storage. [2025-09-24T22:27:32.852146] [INFO ] [MAIN ] TPC: Loaded 38817 primary data records. [2025-09-24T22:27:32.836507] [DEBUG] [LOCAL ] TPH: Loaded 45185 existing records from primary storage. [2025-09-24T22:27:32.857475] [INFO ] [MAIN ] TPH: Loaded 45185 primary data records. [2025-09-24T22:27:33.734169] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:33.735390] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 24883 primary records. [2025-09-24T22:27:33.739636] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-24T22:27:33.766261] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-24T22:27:33.781523] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-24T22:27:33.782250] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:33.785455] [INFO ] [MAIN ] Derivative Progress: 1831/2075 symbols completed. TPB took 1.1s. Estimated remaining: 1m 35s. Rate: 153.6 symbols/min [2025-09-24T22:27:33.787347] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38817 primary records. [2025-09-24T22:27:33.793290] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:33.793500] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-24T22:27:33.812431] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:33.829757] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-24T22:27:33.828556] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45185 primary records. [2025-09-24T22:27:33.829995] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-24T22:27:33.830074] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-24T22:27:33.835311] [INFO ] [MAIN ] Derivative Progress: 1832/2075 symbols completed. TPC took 1.2s. Estimated remaining: 1m 35s. Rate: 153.7 symbols/min [2025-09-24T22:27:33.846933] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:33.863139] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-24T22:27:33.863265] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-24T22:27:33.865931] [INFO ] [MAIN ] Derivative Progress: 1833/2075 symbols completed. TPH took 1.2s. Estimated remaining: 1m 34s. Rate: 153.8 symbols/min [2025-09-24T22:27:33.866279] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:33.862943] [DEBUG] [LOCAL ] TPL: Loaded 12393 existing records from primary storage. [2025-09-24T22:27:33.866477] [INFO ] [MAIN ] TPL: Loaded 12393 primary data records. [2025-09-24T22:27:34.209021] [DEBUG] [LOCAL ] TPVG: Loaded 27022 existing records from primary storage. [2025-09-24T22:27:34.209299] [INFO ] [MAIN ] TPVG: Loaded 27022 primary data records. [2025-09-24T22:27:34.336755] [DEBUG] [LOCAL ] TPR: Loaded 53477 existing records from primary storage. [2025-09-24T22:27:34.371235] [INFO ] [MAIN ] TPR: Loaded 53477 primary data records. [2025-09-24T22:27:34.871154] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:34.887766] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12393 primary records. [2025-09-24T22:27:34.887966] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-24T22:27:34.907681] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-24T22:27:34.908826] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-24T22:27:34.911428] [INFO ] [MAIN ] Derivative Progress: 1834/2075 symbols completed. TPL took 1.1s. Estimated remaining: 1m 34s. Rate: 153.7 symbols/min [2025-09-24T22:27:34.912422] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:34.937236] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:34.936941] [DEBUG] [LOCAL ] TPYP: Loaded 7880 existing records from primary storage. [2025-09-24T22:27:34.937583] [INFO ] [MAIN ] TPYP: Loaded 7880 primary data records. [2025-09-24T22:27:34.938363] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27022 primary records. [2025-09-24T22:27:34.949850] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-24T22:27:35.109968] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:35.120181] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53477 primary records. [2025-09-24T22:27:35.144361] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-24T22:27:35.264164] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-24T22:27:35.275499] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-24T22:27:35.277861] [INFO ] [MAIN ] Derivative Progress: 1835/2075 symbols completed. TPVG took 1.4s. Estimated remaining: 1m 34s. Rate: 153.7 symbols/min [2025-09-24T22:27:35.283258] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:35.283323] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-24T22:27:35.283456] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-24T22:27:35.288038] [INFO ] [MAIN ] Derivative Progress: 1836/2075 symbols completed. TPR took 1.4s. Estimated remaining: 1m 33s. Rate: 153.7 symbols/min [2025-09-24T22:27:35.288861] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:35.297711] [DEBUG] [LOCAL ] TPZ: Loaded 5035 existing records from primary storage. [2025-09-24T22:27:35.297845] [INFO ] [MAIN ] TPZ: Loaded 5035 primary data records. [2025-09-24T22:27:35.394861] [DEBUG] [LOCAL ] TR: Loaded 18276 existing records from primary storage. [2025-09-24T22:27:35.416028] [INFO ] [MAIN ] TR: Loaded 18276 primary data records. [2025-09-24T22:27:35.634168] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:35.760936] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7880 primary records. [2025-09-24T22:27:35.817278] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-24T22:27:36.022577] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-24T22:27:36.023076] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-24T22:27:36.025828] [INFO ] [MAIN ] Derivative Progress: 1837/2075 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 33s. Rate: 153.7 symbols/min [2025-09-24T22:27:36.029478] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:36.046079] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:36.046857] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 5035 primary records. [2025-09-24T22:27:36.047038] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-24T22:27:36.068624] [DEBUG] [LOCAL ] TRAK: Loaded 9304 existing records from primary storage. [2025-09-24T22:27:36.069935] [INFO ] [MAIN ] TRAK: Loaded 9304 primary data records. [2025-09-24T22:27:36.153728] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:36.154543] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18276 primary records. [2025-09-24T22:27:36.154692] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-24T22:27:36.171869] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-24T22:27:36.196199] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-24T22:27:36.202277] [INFO ] [MAIN ] Derivative Progress: 1838/2075 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 33s. Rate: 153.7 symbols/min [2025-09-24T22:27:36.209414] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:36.323188] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-24T22:27:36.409805] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-24T22:27:36.412471] [INFO ] [MAIN ] Derivative Progress: 1839/2075 symbols completed. TR took 1.1s. Estimated remaining: 1m 32s. Rate: 153.7 symbols/min [2025-09-24T22:27:36.412915] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:36.421915] [DEBUG] [LOCAL ] TRC: Loaded 16028 existing records from primary storage. [2025-09-24T22:27:36.422539] [INFO ] [MAIN ] TRC: Loaded 16028 primary data records. [2025-09-24T22:27:36.760419] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:36.762365] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9304 primary records. [2025-09-24T22:27:36.763203] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-24T22:27:36.779004] [DEBUG] [LOCAL ] TRGP: Loaded 50808 existing records from primary storage. [2025-09-24T22:27:36.779144] [INFO ] [MAIN ] TRGP: Loaded 50808 primary data records. [2025-09-24T22:27:36.941939] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-24T22:27:36.974698] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-24T22:27:37.100444] [INFO ] [MAIN ] Derivative Progress: 1840/2075 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 32s. Rate: 153.7 symbols/min [2025-09-24T22:27:37.101814] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:37.126257] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:37.127807] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 16028 primary records. [2025-09-24T22:27:37.127964] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-24T22:27:37.145912] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-24T22:27:37.146092] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-24T22:27:37.153451] [INFO ] [MAIN ] Derivative Progress: 1841/2075 symbols completed. TRC took 1.0s. Estimated remaining: 1m 31s. Rate: 153.8 symbols/min [2025-09-24T22:27:37.153871] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:37.183428] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:37.184196] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50808 primary records. [2025-09-24T22:27:37.184342] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-24T22:27:37.212331] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-24T22:27:37.213543] [DEBUG] [LOCAL ] TRN: Loaded 37380 existing records from primary storage. [2025-09-24T22:27:37.213978] [INFO ] [MAIN ] TRN: Loaded 37380 primary data records. [2025-09-24T22:27:37.213792] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-24T22:27:37.217007] [INFO ] [MAIN ] Derivative Progress: 1842/2075 symbols completed. TRGP took 0.8s. Estimated remaining: 1m 31s. Rate: 153.8 symbols/min [2025-09-24T22:27:37.217274] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:37.388981] [DEBUG] [LOCAL ] TRNO: Loaded 44052 existing records from primary storage. [2025-09-24T22:27:37.411439] [INFO ] [MAIN ] TRNO: Loaded 44052 primary data records. [2025-09-24T22:27:37.774637] [DEBUG] [LOCAL ] TROX: Loaded 51772 existing records from primary storage. [2025-09-24T22:27:37.920039] [INFO ] [MAIN ] TROX: Loaded 51772 primary data records. [2025-09-24T22:27:38.283745] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:38.286028] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37380 primary records. [2025-09-24T22:27:38.286584] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-24T22:27:38.321844] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-24T22:27:38.322284] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:38.322559] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-24T22:27:38.327547] [INFO ] [MAIN ] Derivative Progress: 1843/2075 symbols completed. TRN took 1.2s. Estimated remaining: 1m 31s. Rate: 153.7 symbols/min [2025-09-24T22:27:38.323597] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 44052 primary records. [2025-09-24T22:27:38.328543] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-24T22:27:38.347635] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-24T22:27:38.347835] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-24T22:27:38.352246] [INFO ] [MAIN ] Derivative Progress: 1844/2075 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 30s. Rate: 153.7 symbols/min [2025-09-24T22:27:38.364481] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:38.365104] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51772 primary records. [2025-09-24T22:27:38.365166] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-24T22:27:38.380108] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-24T22:27:38.380171] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-24T22:27:38.383064] [INFO ] [MAIN ] Derivative Progress: 1845/2075 symbols completed. TROX took 1.2s. Estimated remaining: 1m 30s. Rate: 153.8 symbols/min [2025-09-24T22:27:38.383892] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:38.384015] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:38.384735] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:38.425904] [DEBUG] [LOCAL ] TRTX: Loaded 37423 existing records from primary storage. [2025-09-24T22:27:38.426119] [INFO ] [MAIN ] TRTX: Loaded 37423 primary data records. [2025-09-24T22:27:38.594246] [DEBUG] [LOCAL ] TRP: Loaded 52118 existing records from primary storage. [2025-09-24T22:27:38.604872] [INFO ] [MAIN ] TRP: Loaded 52118 primary data records. [2025-09-24T22:27:38.826874] [DEBUG] [LOCAL ] TRU: Loaded 51194 existing records from primary storage. [2025-09-24T22:27:38.849140] [INFO ] [MAIN ] TRU: Loaded 51194 primary data records. [2025-09-24T22:27:39.432909] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:39.434348] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37423 primary records. [2025-09-24T22:27:39.434784] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-24T22:27:39.453770] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-24T22:27:39.453985] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-24T22:27:39.456887] [INFO ] [MAIN ] Derivative Progress: 1846/2075 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 29s. Rate: 153.7 symbols/min [2025-09-24T22:27:39.457515] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:39.474723] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:39.475611] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52118 primary records. [2025-09-24T22:27:39.475953] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-24T22:27:39.505078] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:39.506248] [INFO ] [MAIN ] TRU: Generated 1793 derivative records from 51194 primary records. [2025-09-24T22:27:39.506807] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-24T22:27:39.508516] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-24T22:27:39.508703] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-24T22:27:39.511124] [INFO ] [MAIN ] Derivative Progress: 1847/2075 symbols completed. TRP took 1.1s. Estimated remaining: 1m 29s. Rate: 153.8 symbols/min [2025-09-24T22:27:39.511691] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:39.539457] [DEBUG] [LOCAL ] TRU: Derivative data saved (1793 records). [2025-09-24T22:27:39.539632] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-24T22:27:39.542562] [INFO ] [MAIN ] Derivative Progress: 1848/2075 symbols completed. TRU took 1.2s. Estimated remaining: 1m 29s. Rate: 153.8 symbols/min [2025-09-24T22:27:39.543022] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:39.563934] [DEBUG] [LOCAL ] TRV: Loaded 48131 existing records from primary storage. [2025-09-24T22:27:39.564236] [INFO ] [MAIN ] TRV: Loaded 48131 primary data records. [2025-09-24T22:27:39.709003] [DEBUG] [LOCAL ] TSE: Loaded 28733 existing records from primary storage. [2025-09-24T22:27:39.709281] [INFO ] [MAIN ] TSE: Loaded 28733 primary data records. [2025-09-24T22:27:39.913782] [DEBUG] [LOCAL ] TS: Loaded 51662 existing records from primary storage. [2025-09-24T22:27:40.094107] [INFO ] [MAIN ] TS: Loaded 51662 primary data records. [2025-09-24T22:27:40.612122] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:40.613086] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 48131 primary records. [2025-09-24T22:27:40.613285] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-24T22:27:40.647979] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-24T22:27:40.647588] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:40.648110] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-24T22:27:40.650424] [INFO ] [MAIN ] Derivative Progress: 1849/2075 symbols completed. TRV took 1.2s. Estimated remaining: 1m 28s. Rate: 153.7 symbols/min [2025-09-24T22:27:40.650784] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:40.652516] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28733 primary records. [2025-09-24T22:27:40.653514] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-24T22:27:40.685995] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:40.690957] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51662 primary records. [2025-09-24T22:27:40.693128] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-24T22:27:40.694039] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-24T22:27:40.695047] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-24T22:27:40.699705] [DEBUG] [LOCAL ] TSI: Loaded 8034 existing records from primary storage. [2025-09-24T22:27:40.703011] [INFO ] [MAIN ] Derivative Progress: 1850/2075 symbols completed. TSE took 1.2s. Estimated remaining: 1m 28s. Rate: 153.7 symbols/min [2025-09-24T22:27:40.699859] [INFO ] [MAIN ] TSI: Loaded 8034 primary data records. [2025-09-24T22:27:40.732877] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:40.850346] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-24T22:27:40.880829] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-24T22:27:40.909842] [INFO ] [MAIN ] Derivative Progress: 1851/2075 symbols completed. TS took 1.4s. Estimated remaining: 1m 27s. Rate: 153.8 symbols/min [2025-09-24T22:27:40.915490] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:41.059156] [DEBUG] [LOCAL ] TSLX: Loaded 35254 existing records from primary storage. [2025-09-24T22:27:41.059716] [INFO ] [MAIN ] TSLX: Loaded 35254 primary data records. [2025-09-24T22:27:41.418658] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-24T22:27:41.423964] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-24T22:27:41.423898] [DEBUG] [MAIN ] TSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:41.424803] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8034 primary records. [2025-09-24T22:27:41.436206] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-24T22:27:41.524756] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-24T22:27:41.537037] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-24T22:27:41.547634] [INFO ] [MAIN ] Derivative Progress: 1852/2075 symbols completed. TSI took 0.9s. Estimated remaining: 1m 27s. Rate: 153.7 symbols/min [2025-09-24T22:27:41.552541] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:41.780255] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:41.781280] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35254 primary records. [2025-09-24T22:27:41.781377] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-24T22:27:41.803936] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-24T22:27:41.804430] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-24T22:27:41.807245] [INFO ] [MAIN ] Derivative Progress: 1853/2075 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 27s. Rate: 153.8 symbols/min [2025-09-24T22:27:41.807756] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:41.841725] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:41.842455] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-24T22:27:41.845034] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-24T22:27:41.863191] [DEBUG] [LOCAL ] TSQ: Loaded 12093 existing records from primary storage. [2025-09-24T22:27:41.864705] [INFO ] [MAIN ] TSQ: Loaded 12093 primary data records. [2025-09-24T22:27:41.940320] [DEBUG] [LOCAL ] TSN: Loaded 52869 existing records from primary storage. [2025-09-24T22:27:41.919853] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-24T22:27:41.949509] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-24T22:27:41.957031] [INFO ] [MAIN ] TSN: Loaded 52869 primary data records. [2025-09-24T22:27:41.951776] [INFO ] [MAIN ] Derivative Progress: 1854/2075 symbols completed. TSM took 1.0s. Estimated remaining: 1m 26s. Rate: 153.8 symbols/min [2025-09-24T22:27:42.010047] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:42.590459] [DEBUG] [LOCAL ] TT: Loaded 47821 existing records from primary storage. [2025-09-24T22:27:42.590840] [INFO ] [MAIN ] TT: Loaded 47821 primary data records. [2025-09-24T22:27:42.729026] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:42.735292] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12093 primary records. [2025-09-24T22:27:42.735681] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:42.752311] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52869 primary records. [2025-09-24T22:27:42.751464] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-24T22:27:42.762796] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-24T22:27:42.974637] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-24T22:27:42.976023] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-24T22:27:42.978549] [INFO ] [MAIN ] Derivative Progress: 1855/2075 symbols completed. TSN took 1.4s. Estimated remaining: 1m 26s. Rate: 153.7 symbols/min [2025-09-24T22:27:42.976143] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-24T22:27:42.979523] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-24T22:27:42.979745] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:42.982190] [INFO ] [MAIN ] Derivative Progress: 1856/2075 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 25s. Rate: 153.8 symbols/min [2025-09-24T22:27:42.982552] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:43.032337] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:27:43.033522] [INFO ] [MAIN ] TT: Generated 1793 derivative records from 47821 primary records. [2025-09-24T22:27:43.033795] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-24T22:27:43.064109] [DEBUG] [LOCAL ] TT: Derivative data saved (1793 records). [2025-09-24T22:27:43.064273] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-24T22:27:43.069344] [INFO ] [MAIN ] Derivative Progress: 1857/2075 symbols completed. TT took 1.1s. Estimated remaining: 1m 25s. Rate: 153.8 symbols/min [2025-09-24T22:27:43.069862] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:43.103084] [DEBUG] [LOCAL ] TTC: Loaded 42495 existing records from primary storage. [2025-09-24T22:27:43.103238] [INFO ] [MAIN ] TTC: Loaded 42495 primary data records. [2025-09-24T22:27:43.206430] [DEBUG] [LOCAL ] TTE: Loaded 51656 existing records from primary storage. [2025-09-24T22:27:43.225340] [INFO ] [MAIN ] TTE: Loaded 51656 primary data records. [2025-09-24T22:27:43.655083] [DEBUG] [LOCAL ] TTI: Loaded 45370 existing records from primary storage. [2025-09-24T22:27:43.759222] [INFO ] [MAIN ] TTI: Loaded 45370 primary data records. [2025-09-24T22:27:44.179799] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:44.181728] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42495 primary records. [2025-09-24T22:27:44.182633] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-24T22:27:44.201872] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-24T22:27:44.202778] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-24T22:27:44.205280] [INFO ] [MAIN ] Derivative Progress: 1858/2075 symbols completed. TTC took 1.2s. Estimated remaining: 1m 25s. Rate: 153.7 symbols/min [2025-09-24T22:27:44.219247] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:44.220124] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51656 primary records. [2025-09-24T22:27:44.220308] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-24T22:27:44.252432] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-24T22:27:44.252910] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-24T22:27:44.255273] [INFO ] [MAIN ] Derivative Progress: 1859/2075 symbols completed. TTE took 1.3s. Estimated remaining: 1m 24s. Rate: 153.7 symbols/min [2025-09-24T22:27:44.252786] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:44.256408] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45370 primary records. [2025-09-24T22:27:44.256488] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-24T22:27:44.273227] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-24T22:27:44.273337] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-24T22:27:44.276388] [INFO ] [MAIN ] Derivative Progress: 1860/2075 symbols completed. TTI took 1.2s. Estimated remaining: 1m 24s. Rate: 153.8 symbols/min [2025-09-24T22:27:44.277098] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:44.277304] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:44.277418] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:44.326333] [DEBUG] [LOCAL ] TUYA: Loaded 46557 existing records from primary storage. [2025-09-24T22:27:44.326489] [INFO ] [MAIN ] TUYA: Loaded 46557 primary data records. [2025-09-24T22:27:44.656928] [DEBUG] [LOCAL ] TU: Loaded 49905 existing records from primary storage. [2025-09-24T22:27:44.671694] [INFO ] [MAIN ] TU: Loaded 49905 primary data records. [2025-09-24T22:27:44.663605] [DEBUG] [LOCAL ] TV: Loaded 42983 existing records from primary storage. [2025-09-24T22:27:44.678426] [INFO ] [MAIN ] TV: Loaded 42983 primary data records. [2025-09-24T22:27:45.309531] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:45.310931] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46557 primary records. [2025-09-24T22:27:45.311340] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-24T22:27:45.333901] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-24T22:27:45.334249] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-24T22:27:45.338128] [INFO ] [MAIN ] Derivative Progress: 1861/2075 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 24s. Rate: 153.7 symbols/min [2025-09-24T22:27:45.339816] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:45.354174] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:45.367011] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49905 primary records. [2025-09-24T22:27:45.368380] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-24T22:27:45.369116] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:45.370324] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42983 primary records. [2025-09-24T22:27:45.370514] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-24T22:27:45.381914] [DEBUG] [LOCAL ] TVC: Loaded 3445 existing records from primary storage. [2025-09-24T22:27:45.398275] [INFO ] [MAIN ] TVC: Loaded 3445 primary data records. [2025-09-24T22:27:45.407114] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-24T22:27:45.407746] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-24T22:27:45.417793] [INFO ] [MAIN ] Derivative Progress: 1862/2075 symbols completed. TU took 1.1s. Estimated remaining: 1m 23s. Rate: 153.7 symbols/min [2025-09-24T22:27:45.436776] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:45.519786] [DEBUG] [LOCAL ] TVE: Loaded 2769 existing records from primary storage. [2025-09-24T22:27:45.521225] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-24T22:27:45.541945] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-24T22:27:45.542012] [INFO ] [MAIN ] TVE: Loaded 2769 primary data records. [2025-09-24T22:27:45.560989] [INFO ] [MAIN ] Derivative Progress: 1863/2075 symbols completed. TV took 1.3s. Estimated remaining: 1m 23s. Rate: 153.8 symbols/min [2025-09-24T22:27:45.647489] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:46.085328] [DEBUG] [LOCAL ] TWI: Loaded 34508 existing records from primary storage. [2025-09-24T22:27:46.085982] [INFO ] [MAIN ] TWI: Loaded 34508 primary data records. [2025-09-24T22:27:46.222346] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-09-24T22:27:46.241820] [INFO ] [MAIN ] TVC: Generated 1791 derivative records from 3445 primary records. [2025-09-24T22:27:46.256209] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-24T22:27:46.351357] [DEBUG] [LOCAL ] TVC: Derivative data saved (1791 records). [2025-09-24T22:27:46.471928] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-24T22:27:46.491548] [INFO ] [MAIN ] Derivative Progress: 1864/2075 symbols completed. TVC took 1.2s. Estimated remaining: 1m 22s. Rate: 153.7 symbols/min [2025-09-24T22:27:46.493227] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:46.494892] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:46.494451] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2769 primary records. [2025-09-24T22:27:46.495092] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-24T22:27:46.515281] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-09-24T22:27:46.515555] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-24T22:27:46.518102] [INFO ] [MAIN ] Derivative Progress: 1865/2075 symbols completed. TVE took 1.1s. Estimated remaining: 1m 22s. Rate: 153.8 symbols/min [2025-09-24T22:27:46.519860] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:46.530146] [DEBUG] [LOCAL ] TWN: Loaded 3209 existing records from primary storage. [2025-09-24T22:27:46.530497] [INFO ] [MAIN ] TWN: Loaded 3209 primary data records. [2025-09-24T22:27:46.758993] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:46.875293] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34508 primary records. [2025-09-24T22:27:46.876373] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-24T22:27:46.866362] [DEBUG] [LOCAL ] TWLO: Loaded 52722 existing records from primary storage. [2025-09-24T22:27:46.876994] [INFO ] [MAIN ] TWLO: Loaded 52722 primary data records. [2025-09-24T22:27:47.000632] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-24T22:27:47.006502] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-24T22:27:47.024825] [INFO ] [MAIN ] Derivative Progress: 1866/2075 symbols completed. TWI took 1.4s. Estimated remaining: 1m 22s. Rate: 153.7 symbols/min [2025-09-24T22:27:47.030229] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:47.240818] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:47.241996] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3209 primary records. [2025-09-24T22:27:47.242689] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-24T22:27:47.273626] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-24T22:27:47.273889] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-24T22:27:47.277171] [INFO ] [MAIN ] Derivative Progress: 1867/2075 symbols completed. TWN took 0.8s. Estimated remaining: 1m 21s. Rate: 153.8 symbols/min [2025-09-24T22:27:47.278502] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:47.316560] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:47.318569] [DEBUG] [LOCAL ] TWO: Loaded 48323 existing records from primary storage. [2025-09-24T22:27:47.317426] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52722 primary records. [2025-09-24T22:27:47.318870] [INFO ] [MAIN ] TWO: Loaded 48323 primary data records. [2025-09-24T22:27:47.318793] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-24T22:27:47.430394] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-24T22:27:47.458877] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-24T22:27:47.463550] [INFO ] [MAIN ] Derivative Progress: 1868/2075 symbols completed. TWLO took 1.0s. Estimated remaining: 1m 21s. Rate: 153.8 symbols/min [2025-09-24T22:27:47.464683] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:47.477114] [DEBUG] [LOCAL ] TX: Loaded 23676 existing records from primary storage. [2025-09-24T22:27:47.493561] [INFO ] [MAIN ] TX: Loaded 23676 primary data records. [2025-09-24T22:27:48.036789] [DEBUG] [LOCAL ] TXNM: Loaded 43846 existing records from primary storage. [2025-09-24T22:27:48.045756] [INFO ] [MAIN ] TXNM: Loaded 43846 primary data records. [2025-09-24T22:27:48.434999] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:48.436070] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48323 primary records. [2025-09-24T22:27:48.436278] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-24T22:27:48.471512] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:48.472693] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23676 primary records. [2025-09-24T22:27:48.473633] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-24T22:27:48.474293] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-24T22:27:48.476009] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-24T22:27:48.478576] [INFO ] [MAIN ] Derivative Progress: 1869/2075 symbols completed. TWO took 1.4s. Estimated remaining: 1m 20s. Rate: 153.7 symbols/min [2025-09-24T22:27:48.487957] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:48.498289] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-24T22:27:48.499150] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-24T22:27:48.502501] [INFO ] [MAIN ] Derivative Progress: 1870/2075 symbols completed. TX took 1.2s. Estimated remaining: 1m 20s. Rate: 153.7 symbols/min [2025-09-24T22:27:48.503076] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:48.522684] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:48.523519] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43846 primary records. [2025-09-24T22:27:48.523750] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-24T22:27:48.538982] [DEBUG] [LOCAL ] TXO: Loaded 18787 existing records from primary storage. [2025-09-24T22:27:48.543365] [INFO ] [MAIN ] TXO: Loaded 18787 primary data records. [2025-09-24T22:27:48.584317] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-24T22:27:48.584522] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-24T22:27:48.605425] [INFO ] [MAIN ] Derivative Progress: 1871/2075 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 20s. Rate: 153.8 symbols/min [2025-09-24T22:27:48.626019] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:48.752039] [DEBUG] [LOCAL ] TY: Loaded 7664 existing records from primary storage. [2025-09-24T22:27:48.865919] [INFO ] [MAIN ] TY: Loaded 7664 primary data records. [2025-09-24T22:27:48.974930] [DEBUG] [LOCAL ] TXT: Loaded 49729 existing records from primary storage. [2025-09-24T22:27:48.994033] [INFO ] [MAIN ] TXT: Loaded 49729 primary data records. [2025-09-24T22:27:49.556939] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:49.558388] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18787 primary records. [2025-09-24T22:27:49.558458] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-24T22:27:49.577732] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-24T22:27:49.577966] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-24T22:27:49.580444] [INFO ] [MAIN ] Derivative Progress: 1872/2075 symbols completed. TXO took 1.1s. Estimated remaining: 1m 19s. Rate: 153.7 symbols/min [2025-09-24T22:27:49.581505] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:49.601130] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:49.602262] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7664 primary records. [2025-09-24T22:27:49.602709] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-24T22:27:49.629879] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-24T22:27:49.630596] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-24T22:27:49.633253] [INFO ] [MAIN ] Derivative Progress: 1873/2075 symbols completed. TY took 1.0s. Estimated remaining: 1m 19s. Rate: 153.8 symbols/min [2025-09-24T22:27:49.630274] [DEBUG] [LOCAL ] TYG: Loaded 14210 existing records from primary storage. [2025-09-24T22:27:49.634781] [INFO ] [MAIN ] TYG: Loaded 14210 primary data records. [2025-09-24T22:27:49.739931] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:49.762320] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49729 primary records. [2025-09-24T22:27:49.762488] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-24T22:27:49.980572] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-24T22:27:49.981357] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-24T22:27:49.984022] [INFO ] [MAIN ] Derivative Progress: 1874/2075 symbols completed. TXT took 1.5s. Estimated remaining: 1m 18s. Rate: 153.8 symbols/min [2025-09-24T22:27:50.005739] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:50.006402] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14210 primary records. [2025-09-24T22:27:50.006467] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-24T22:27:50.021754] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-24T22:27:50.021813] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-24T22:27:50.024277] [INFO ] [MAIN ] Derivative Progress: 1875/2075 symbols completed. TYG took 0.4s. Estimated remaining: 1m 18s. Rate: 153.8 symbols/min [2025-09-24T22:27:50.025294] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:50.025532] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:50.025111] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:50.056337] [DEBUG] [LOCAL ] TYL: Loaded 22299 existing records from primary storage. [2025-09-24T22:27:50.056581] [INFO ] [MAIN ] TYL: Loaded 22299 primary data records. [2025-09-24T22:27:50.206132] [DEBUG] [LOCAL ] UA: Loaded 50422 existing records from primary storage. [2025-09-24T22:27:50.221809] [INFO ] [MAIN ] UA: Loaded 50422 primary data records. [2025-09-24T22:27:50.416980] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-24T22:27:50.556432] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-24T22:27:51.089610] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:51.090909] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22299 primary records. [2025-09-24T22:27:51.091501] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-24T22:27:51.126276] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-24T22:27:51.126609] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-24T22:27:51.130045] [INFO ] [MAIN ] Derivative Progress: 1876/2075 symbols completed. TYL took 1.1s. Estimated remaining: 1m 18s. Rate: 153.7 symbols/min [2025-09-24T22:27:51.130638] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:51.130796] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:51.131796] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50422 primary records. [2025-09-24T22:27:51.134168] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-24T22:27:51.156587] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:51.160235] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-24T22:27:51.161711] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-24T22:27:51.165138] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-24T22:27:51.165595] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-24T22:27:51.168270] [INFO ] [MAIN ] Derivative Progress: 1877/2075 symbols completed. UA took 1.1s. Estimated remaining: 1m 17s. Rate: 153.8 symbols/min [2025-09-24T22:27:51.176177] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:51.190809] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-24T22:27:51.190985] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-24T22:27:51.196685] [INFO ] [MAIN ] Derivative Progress: 1878/2075 symbols completed. U took 1.2s. Estimated remaining: 1m 17s. Rate: 153.8 symbols/min [2025-09-24T22:27:51.197192] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:51.196975] [DEBUG] [LOCAL ] UAN: Loaded 5445 existing records from primary storage. [2025-09-24T22:27:51.197855] [INFO ] [MAIN ] UAN: Loaded 5445 primary data records. [2025-09-24T22:27:51.411993] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-24T22:27:51.540567] [INFO ] [MAIN ] UAA: Loaded 53509 primary data records. [2025-09-24T22:27:51.660239] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-24T22:27:51.664800] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-24T22:27:52.258349] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:52.260486] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5445 primary records. [2025-09-24T22:27:52.261087] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-24T22:27:52.278583] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-24T22:27:52.280107] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-24T22:27:52.282513] [INFO ] [MAIN ] Derivative Progress: 1879/2075 symbols completed. UAN took 1.1s. Estimated remaining: 1m 17s. Rate: 153.7 symbols/min [2025-09-24T22:27:52.283256] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:52.301942] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:52.302866] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53509 primary records. [2025-09-24T22:27:52.303073] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-24T22:27:52.320271] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-24T22:27:52.321253] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-24T22:27:52.323775] [INFO ] [MAIN ] Derivative Progress: 1880/2075 symbols completed. UAA took 1.2s. Estimated remaining: 1m 16s. Rate: 153.8 symbols/min [2025-09-24T22:27:52.325591] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:52.339436] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:52.340368] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-24T22:27:52.340503] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-24T22:27:52.357740] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-24T22:27:52.358016] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-24T22:27:52.360502] [INFO ] [MAIN ] Derivative Progress: 1881/2075 symbols completed. UBER took 1.2s. Estimated remaining: 1m 16s. Rate: 153.8 symbols/min [2025-09-24T22:27:52.360942] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:52.412273] [DEBUG] [LOCAL ] UBS: Loaded 52439 existing records from primary storage. [2025-09-24T22:27:52.412540] [INFO ] [MAIN ] UBS: Loaded 52439 primary data records. [2025-09-24T22:27:52.544089] [DEBUG] [LOCAL ] UCB: Loaded 38057 existing records from primary storage. [2025-09-24T22:27:52.565607] [INFO ] [MAIN ] UCB: Loaded 38057 primary data records. [2025-09-24T22:27:52.681545] [DEBUG] [LOCAL ] UDR: Loaded 51792 existing records from primary storage. [2025-09-24T22:27:52.825580] [INFO ] [MAIN ] UDR: Loaded 51792 primary data records. [2025-09-24T22:27:53.401700] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:53.402798] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52439 primary records. [2025-09-24T22:27:53.403294] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-24T22:27:53.423956] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-24T22:27:53.424147] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-24T22:27:53.426384] [INFO ] [MAIN ] Derivative Progress: 1882/2075 symbols completed. UBS took 1.1s. Estimated remaining: 1m 15s. Rate: 153.7 symbols/min [2025-09-24T22:27:53.440016] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:53.439950] [DEBUG] [MAIN ] UCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:53.441489] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 38057 primary records. [2025-09-24T22:27:53.441777] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-24T22:27:53.458531] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-24T22:27:53.459711] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-24T22:27:53.462859] [INFO ] [MAIN ] Derivative Progress: 1883/2075 symbols completed. UCB took 1.1s. Estimated remaining: 1m 15s. Rate: 153.8 symbols/min [2025-09-24T22:27:53.463806] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:53.477445] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:53.478211] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51792 primary records. [2025-09-24T22:27:53.478368] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-24T22:27:53.498191] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-24T22:27:53.498519] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-24T22:27:53.501509] [INFO ] [MAIN ] Derivative Progress: 1884/2075 symbols completed. UDR took 1.1s. Estimated remaining: 1m 14s. Rate: 153.8 symbols/min [2025-09-24T22:27:53.502151] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:53.506817] [DEBUG] [LOCAL ] UFI: Loaded 8118 existing records from primary storage. [2025-09-24T22:27:53.506990] [INFO ] [MAIN ] UFI: Loaded 8118 primary data records. [2025-09-24T22:27:53.659624] [DEBUG] [LOCAL ] UE: Loaded 42956 existing records from primary storage. [2025-09-24T22:27:53.687923] [INFO ] [MAIN ] UE: Loaded 42956 primary data records. [2025-09-24T22:27:54.198099] [DEBUG] [LOCAL ] UGI: Loaded 50533 existing records from primary storage. [2025-09-24T22:27:54.211948] [INFO ] [MAIN ] UGI: Loaded 50533 primary data records. [2025-09-24T22:27:54.543553] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:54.545305] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8118 primary records. [2025-09-24T22:27:54.545596] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-24T22:27:54.567099] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-24T22:27:54.568329] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-24T22:27:54.583384] [INFO ] [MAIN ] Derivative Progress: 1885/2075 symbols completed. UFI took 1.1s. Estimated remaining: 1m 14s. Rate: 153.7 symbols/min [2025-09-24T22:27:54.583944] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:54.585038] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:54.584971] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42956 primary records. [2025-09-24T22:27:54.585594] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-24T22:27:54.603257] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-24T22:27:54.603429] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-24T22:27:54.606128] [INFO ] [MAIN ] Derivative Progress: 1886/2075 symbols completed. UE took 1.2s. Estimated remaining: 1m 14s. Rate: 153.8 symbols/min [2025-09-24T22:27:54.607437] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:54.622289] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:54.623086] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50533 primary records. [2025-09-24T22:27:54.623297] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-24T22:27:54.639241] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-24T22:27:54.639444] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-24T22:27:54.641862] [INFO ] [MAIN ] Derivative Progress: 1887/2075 symbols completed. UGI took 1.1s. Estimated remaining: 1m 13s. Rate: 153.9 symbols/min [2025-09-24T22:27:54.646681] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:54.664042] [DEBUG] [LOCAL ] UHAL: Loaded 16535 existing records from primary storage. [2025-09-24T22:27:54.664193] [INFO ] [MAIN ] UHAL: Loaded 16535 primary data records. [2025-09-24T22:27:54.787952] [DEBUG] [LOCAL ] UGP: Loaded 42635 existing records from primary storage. [2025-09-24T22:27:54.788262] [INFO ] [MAIN ] UGP: Loaded 42635 primary data records. [2025-09-24T22:27:55.124170] [DEBUG] [LOCAL ] UHS: Loaded 41126 existing records from primary storage. [2025-09-24T22:27:55.141319] [INFO ] [MAIN ] UHS: Loaded 41126 primary data records. [2025-09-24T22:27:55.671905] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:55.672833] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16535 primary records. [2025-09-24T22:27:55.673024] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-24T22:27:55.694668] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-24T22:27:55.695058] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-24T22:27:55.710729] [INFO ] [MAIN ] Derivative Progress: 1888/2075 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 13s. Rate: 153.7 symbols/min [2025-09-24T22:27:55.711975] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:55.713004] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42635 primary records. [2025-09-24T22:27:55.713303] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-24T22:27:55.730783] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-24T22:27:55.731853] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-24T22:27:55.735406] [INFO ] [MAIN ] Derivative Progress: 1889/2075 symbols completed. UGP took 1.2s. Estimated remaining: 1m 13s. Rate: 153.8 symbols/min [2025-09-24T22:27:55.748876] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:55.749505] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 41126 primary records. [2025-09-24T22:27:55.749608] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-24T22:27:55.765318] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-24T22:27:55.765378] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-24T22:27:55.767840] [INFO ] [MAIN ] Derivative Progress: 1890/2075 symbols completed. UHS took 1.1s. Estimated remaining: 1m 12s. Rate: 153.9 symbols/min [2025-09-24T22:27:55.768443] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:55.768935] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:55.768804] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:55.785556] [DEBUG] [LOCAL ] UHT: Loaded 9977 existing records from primary storage. [2025-09-24T22:27:55.785775] [INFO ] [MAIN ] UHT: Loaded 9977 primary data records. [2025-09-24T22:27:55.829028] [DEBUG] [LOCAL ] UI: Loaded 12758 existing records from primary storage. [2025-09-24T22:27:55.898957] [INFO ] [MAIN ] UI: Loaded 12758 primary data records. [2025-09-24T22:27:56.073971] [DEBUG] [LOCAL ] UIS: Loaded 37087 existing records from primary storage. [2025-09-24T22:27:56.109104] [INFO ] [MAIN ] UIS: Loaded 37087 primary data records. [2025-09-24T22:27:56.822744] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:56.823958] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9977 primary records. [2025-09-24T22:27:56.824311] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-24T22:27:56.853991] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:56.858203] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12758 primary records. [2025-09-24T22:27:56.861298] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-24T22:27:56.861096] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-24T22:27:56.861578] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-24T22:27:56.876794] [INFO ] [MAIN ] Derivative Progress: 1891/2075 symbols completed. UHT took 1.1s. Estimated remaining: 1m 12s. Rate: 153.7 symbols/min [2025-09-24T22:27:56.891879] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:56.893901] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-24T22:27:56.894319] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:56.894696] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-24T22:27:56.897460] [INFO ] [MAIN ] Derivative Progress: 1892/2075 symbols completed. UI took 1.1s. Estimated remaining: 1m 11s. Rate: 153.8 symbols/min [2025-09-24T22:27:56.898267] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37087 primary records. [2025-09-24T22:27:56.899033] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:56.898958] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-24T22:27:56.916215] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-24T22:27:56.916368] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-24T22:27:56.919146] [INFO ] [MAIN ] Derivative Progress: 1893/2075 symbols completed. UIS took 1.2s. Estimated remaining: 1m 11s. Rate: 153.9 symbols/min [2025-09-24T22:27:56.919432] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:56.965179] [DEBUG] [LOCAL ] ULS: Loaded 39304 existing records from primary storage. [2025-09-24T22:27:56.965494] [INFO ] [MAIN ] ULS: Loaded 39304 primary data records. [2025-09-24T22:27:57.114914] [DEBUG] [LOCAL ] UL: Loaded 53066 existing records from primary storage. [2025-09-24T22:27:57.156559] [INFO ] [MAIN ] UL: Loaded 53066 primary data records. [2025-09-24T22:27:57.209392] [DEBUG] [LOCAL ] UMC: Loaded 52717 existing records from primary storage. [2025-09-24T22:27:57.331077] [INFO ] [MAIN ] UMC: Loaded 52717 primary data records. [2025-09-24T22:27:57.977590] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:57.978539] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39304 primary records. [2025-09-24T22:27:57.978786] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-24T22:27:58.014037] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-24T22:27:58.014663] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:58.014872] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-24T22:27:58.017240] [INFO ] [MAIN ] Derivative Progress: 1894/2075 symbols completed. ULS took 1.1s. Estimated remaining: 1m 11s. Rate: 153.7 symbols/min [2025-09-24T22:27:58.018585] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:58.018123] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52717 primary records. [2025-09-24T22:27:58.031327] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-24T22:27:58.039904] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:58.048091] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53066 primary records. [2025-09-24T22:27:58.049232] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-24T22:27:58.049498] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-24T22:27:58.049430] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-24T22:27:58.052831] [INFO ] [MAIN ] Derivative Progress: 1895/2075 symbols completed. UMC took 1.1s. Estimated remaining: 1m 10s. Rate: 153.8 symbols/min [2025-09-24T22:27:58.060523] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:58.069733] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-24T22:27:58.069986] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-24T22:27:58.072728] [INFO ] [MAIN ] Derivative Progress: 1896/2075 symbols completed. UL took 1.2s. Estimated remaining: 1m 10s. Rate: 153.9 symbols/min [2025-09-24T22:27:58.073227] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:58.094041] [DEBUG] [LOCAL ] UNF: Loaded 11900 existing records from primary storage. [2025-09-24T22:27:58.094187] [INFO ] [MAIN ] UNF: Loaded 11900 primary data records. [2025-09-24T22:27:58.191371] [DEBUG] [LOCAL ] UMH: Loaded 33525 existing records from primary storage. [2025-09-24T22:27:58.208948] [INFO ] [MAIN ] UMH: Loaded 33525 primary data records. [2025-09-24T22:27:58.587080] [DEBUG] [LOCAL ] UNFI: Loaded 41833 existing records from primary storage. [2025-09-24T22:27:58.606154] [INFO ] [MAIN ] UNFI: Loaded 41833 primary data records. [2025-09-24T22:27:59.127591] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:59.141707] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11900 primary records. [2025-09-24T22:27:59.142244] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-24T22:27:59.143845] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:59.145991] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33525 primary records. [2025-09-24T22:27:59.146337] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-24T22:27:59.175922] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-24T22:27:59.179293] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-24T22:27:59.179626] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-24T22:27:59.179544] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-24T22:27:59.182014] [INFO ] [MAIN ] Derivative Progress: 1897/2075 symbols completed. UMH took 1.2s. Estimated remaining: 1m 9s. Rate: 153.7 symbols/min [2025-09-24T22:27:59.185195] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:59.184866] [INFO ] [MAIN ] Derivative Progress: 1898/2075 symbols completed. UNF took 1.1s. Estimated remaining: 1m 9s. Rate: 153.8 symbols/min [2025-09-24T22:27:59.186239] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:59.203261] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:27:59.204111] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41833 primary records. [2025-09-24T22:27:59.204251] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-24T22:27:59.224064] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-24T22:27:59.224226] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-24T22:27:59.226848] [INFO ] [MAIN ] Derivative Progress: 1899/2075 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 9s. Rate: 153.9 symbols/min [2025-09-24T22:27:59.227704] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:27:59.233979] [DEBUG] [LOCAL ] UNMA: Loaded 3596 existing records from primary storage. [2025-09-24T22:27:59.234153] [INFO ] [MAIN ] UNMA: Loaded 3596 primary data records. [2025-09-24T22:27:59.408161] [DEBUG] [LOCAL ] UNM: Loaded 48699 existing records from primary storage. [2025-09-24T22:27:59.429754] [INFO ] [MAIN ] UNM: Loaded 48699 primary data records. [2025-09-24T22:27:59.424502] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-24T22:27:59.440370] [INFO ] [MAIN ] UNH: Loaded 53794 primary data records. [2025-09-24T22:28:00.322519] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:00.323924] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3596 primary records. [2025-09-24T22:28:00.324151] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-24T22:28:00.340855] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-24T22:28:00.342586] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-24T22:28:00.344911] [INFO ] [MAIN ] Derivative Progress: 1900/2075 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 8s. Rate: 153.7 symbols/min [2025-09-24T22:28:00.348085] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:00.369387] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:00.375226] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53794 primary records. [2025-09-24T22:28:00.375675] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-24T22:28:00.375452] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:00.377529] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48699 primary records. [2025-09-24T22:28:00.384843] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-24T22:28:00.401363] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-24T22:28:00.405589] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-24T22:28:00.408294] [INFO ] [MAIN ] Derivative Progress: 1901/2075 symbols completed. UNH took 1.2s. Estimated remaining: 1m 8s. Rate: 153.8 symbols/min [2025-09-24T22:28:00.412598] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-24T22:28:00.412146] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:00.412728] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-24T22:28:00.415562] [INFO ] [MAIN ] Derivative Progress: 1902/2075 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 153.9 symbols/min [2025-09-24T22:28:00.416028] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:00.482143] [DEBUG] [LOCAL ] UNP: Loaded 53251 existing records from primary storage. [2025-09-24T22:28:00.482749] [INFO ] [MAIN ] UNP: Loaded 53251 primary data records. [2025-09-24T22:28:00.538777] [DEBUG] [LOCAL ] UP: Loaded 43090 existing records from primary storage. [2025-09-24T22:28:00.565805] [INFO ] [MAIN ] UP: Loaded 43090 primary data records. [2025-09-24T22:28:00.684887] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-24T22:28:00.708195] [INFO ] [MAIN ] UPS: Loaded 53710 primary data records. [2025-09-24T22:28:01.470808] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:01.472752] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53251 primary records. [2025-09-24T22:28:01.473112] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-24T22:28:01.519426] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:01.518829] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-24T22:28:01.520902] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53710 primary records. [2025-09-24T22:28:01.521049] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-24T22:28:01.523666] [INFO ] [MAIN ] Derivative Progress: 1903/2075 symbols completed. UNP took 1.2s. Estimated remaining: 1m 7s. Rate: 153.7 symbols/min [2025-09-24T22:28:01.523991] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-24T22:28:01.568525] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:01.575381] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43090 primary records. [2025-09-24T22:28:01.575482] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-24T22:28:01.574451] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-24T22:28:01.576448] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-24T22:28:01.580062] [INFO ] [MAIN ] Derivative Progress: 1904/2075 symbols completed. UPS took 1.2s. Estimated remaining: 1m 7s. Rate: 153.8 symbols/min [2025-09-24T22:28:01.595357] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-24T22:28:01.595463] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-24T22:28:01.597955] [INFO ] [MAIN ] Derivative Progress: 1905/2075 symbols completed. UP took 1.2s. Estimated remaining: 1m 6s. Rate: 153.9 symbols/min [2025-09-24T22:28:01.598853] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:01.598912] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:01.599554] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:01.637822] [DEBUG] [LOCAL ] USAC: Loaded 22802 existing records from primary storage. [2025-09-24T22:28:01.637966] [INFO ] [MAIN ] USAC: Loaded 22802 primary data records. [2025-09-24T22:28:01.841022] [DEBUG] [LOCAL ] USA: Loaded 35974 existing records from primary storage. [2025-09-24T22:28:01.866982] [DEBUG] [LOCAL ] URI: Loaded 36267 existing records from primary storage. [2025-09-24T22:28:01.872778] [INFO ] [MAIN ] USA: Loaded 35974 primary data records. [2025-09-24T22:28:01.872912] [INFO ] [MAIN ] URI: Loaded 36267 primary data records. [2025-09-24T22:28:02.665543] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:02.666867] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22802 primary records. [2025-09-24T22:28:02.668465] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-24T22:28:02.686501] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-24T22:28:02.686718] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-24T22:28:02.688581] [INFO ] [MAIN ] Derivative Progress: 1906/2075 symbols completed. USAC took 1.1s. Estimated remaining: 1m 6s. Rate: 153.7 symbols/min [2025-09-24T22:28:02.689166] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:02.723464] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:02.724936] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 36267 primary records. [2025-09-24T22:28:02.725318] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-24T22:28:02.725243] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:02.727106] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35974 primary records. [2025-09-24T22:28:02.734668] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-24T22:28:02.743691] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-24T22:28:02.751880] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-24T22:28:02.757239] [INFO ] [MAIN ] Derivative Progress: 1907/2075 symbols completed. URI took 1.2s. Estimated remaining: 1m 6s. Rate: 153.8 symbols/min [2025-09-24T22:28:02.757790] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:02.763529] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-24T22:28:02.763681] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-24T22:28:02.766378] [INFO ] [MAIN ] Derivative Progress: 1908/2075 symbols completed. USA took 1.2s. Estimated remaining: 1m 5s. Rate: 153.9 symbols/min [2025-09-24T22:28:02.766782] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:02.800550] [DEBUG] [LOCAL ] USNA: Loaded 18165 existing records from primary storage. [2025-09-24T22:28:02.815687] [INFO ] [MAIN ] USNA: Loaded 18165 primary data records. [2025-09-24T22:28:02.848149] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-24T22:28:02.896026] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-24T22:28:03.116029] [DEBUG] [LOCAL ] USFD: Loaded 51210 existing records from primary storage. [2025-09-24T22:28:03.135544] [INFO ] [MAIN ] USFD: Loaded 51210 primary data records. [2025-09-24T22:28:03.868891] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:03.869768] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18165 primary records. [2025-09-24T22:28:03.870024] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-24T22:28:03.903705] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:03.902843] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-24T22:28:03.904585] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-24T22:28:03.906891] [INFO ] [MAIN ] Derivative Progress: 1909/2075 symbols completed. USNA took 1.1s. Estimated remaining: 1m 5s. Rate: 153.7 symbols/min [2025-09-24T22:28:03.904516] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-24T22:28:03.909147] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:03.910321] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-24T22:28:03.942927] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-24T22:28:03.943788] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:03.944908] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51210 primary records. [2025-09-24T22:28:03.945020] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-24T22:28:03.947577] [INFO ] [MAIN ] Derivative Progress: 1910/2075 symbols completed. USB took 1.3s. Estimated remaining: 1m 4s. Rate: 153.8 symbols/min [2025-09-24T22:28:03.952432] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:03.952151] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-24T22:28:03.981728] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-24T22:28:03.981117] [DEBUG] [LOCAL ] USPH: Loaded 16566 existing records from primary storage. [2025-09-24T22:28:03.982037] [INFO ] [MAIN ] USPH: Loaded 16566 primary data records. [2025-09-24T22:28:03.981861] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-24T22:28:03.996583] [INFO ] [MAIN ] Derivative Progress: 1911/2075 symbols completed. USFD took 1.2s. Estimated remaining: 1m 4s. Rate: 153.9 symbols/min [2025-09-24T22:28:04.048316] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:04.305569] [DEBUG] [LOCAL ] UTF: Loaded 28610 existing records from primary storage. [2025-09-24T22:28:04.306009] [INFO ] [MAIN ] UTF: Loaded 28610 primary data records. [2025-09-24T22:28:04.464775] [DEBUG] [LOCAL ] UTI: Loaded 40510 existing records from primary storage. [2025-09-24T22:28:04.476130] [INFO ] [MAIN ] UTI: Loaded 40510 primary data records. [2025-09-24T22:28:05.028359] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:05.030282] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16566 primary records. [2025-09-24T22:28:05.030589] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-24T22:28:05.048404] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-24T22:28:05.048782] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-24T22:28:05.050920] [INFO ] [MAIN ] Derivative Progress: 1912/2075 symbols completed. USPH took 1.1s. Estimated remaining: 1m 4s. Rate: 153.7 symbols/min [2025-09-24T22:28:05.052519] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:05.069221] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:05.069994] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28610 primary records. [2025-09-24T22:28:05.073010] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-24T22:28:05.091247] [DEBUG] [LOCAL ] UTL: Loaded 11080 existing records from primary storage. [2025-09-24T22:28:05.091424] [INFO ] [MAIN ] UTL: Loaded 11080 primary data records. [2025-09-24T22:28:05.141514] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-24T22:28:05.154694] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-24T22:28:05.165814] [INFO ] [MAIN ] Derivative Progress: 1913/2075 symbols completed. UTF took 1.2s. Estimated remaining: 1m 3s. Rate: 153.8 symbols/min [2025-09-24T22:28:05.171281] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:05.230771] [DEBUG] [MAIN ] UTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:05.247197] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40510 primary records. [2025-09-24T22:28:05.247312] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-24T22:28:05.435396] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-24T22:28:05.435764] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-24T22:28:05.438356] [INFO ] [MAIN ] Derivative Progress: 1914/2075 symbols completed. UTI took 1.4s. Estimated remaining: 1m 3s. Rate: 153.8 symbols/min [2025-09-24T22:28:05.449264] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:05.470366] [DEBUG] [LOCAL ] UTZ: Loaded 44677 existing records from primary storage. [2025-09-24T22:28:05.477879] [INFO ] [MAIN ] UTZ: Loaded 44677 primary data records. [2025-09-24T22:28:05.533807] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:05.556347] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11080 primary records. [2025-09-24T22:28:05.563065] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-24T22:28:05.599755] [DEBUG] [LOCAL ] UVE: Loaded 21838 existing records from primary storage. [2025-09-24T22:28:05.613271] [INFO ] [MAIN ] UVE: Loaded 21838 primary data records. [2025-09-24T22:28:05.719837] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-24T22:28:05.754156] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-24T22:28:05.941042] [INFO ] [MAIN ] Derivative Progress: 1915/2075 symbols completed. UTL took 0.9s. Estimated remaining: 1m 2s. Rate: 153.8 symbols/min [2025-09-24T22:28:05.977885] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:06.184003] [DEBUG] [LOCAL ] UVV: Loaded 22401 existing records from primary storage. [2025-09-24T22:28:06.184505] [INFO ] [MAIN ] UVV: Loaded 22401 primary data records. [2025-09-24T22:28:06.299673] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:06.311744] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44677 primary records. [2025-09-24T22:28:06.319701] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-24T22:28:06.354393] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:06.388717] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21838 primary records. [2025-09-24T22:28:06.397519] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-24T22:28:06.423438] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-24T22:28:06.424001] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-24T22:28:06.426796] [INFO ] [MAIN ] Derivative Progress: 1916/2075 symbols completed. UTZ took 1.3s. Estimated remaining: 1m 2s. Rate: 153.8 symbols/min [2025-09-24T22:28:06.599794] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:06.600001] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-24T22:28:06.600597] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-24T22:28:06.603330] [INFO ] [MAIN ] Derivative Progress: 1917/2075 symbols completed. UVE took 1.2s. Estimated remaining: 1m 2s. Rate: 153.8 symbols/min [2025-09-24T22:28:06.603968] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:06.614853] [DEBUG] [LOCAL ] UZD: Loaded 6284 existing records from primary storage. [2025-09-24T22:28:06.615144] [INFO ] [MAIN ] UZD: Loaded 6284 primary data records. [2025-09-24T22:28:06.956262] [DEBUG] [LOCAL ] UWMC: Loaded 52739 existing records from primary storage. [2025-09-24T22:28:06.956807] [INFO ] [MAIN ] UWMC: Loaded 52739 primary data records. [2025-09-24T22:28:07.084178] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:07.088791] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22401 primary records. [2025-09-24T22:28:07.089030] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-24T22:28:07.315363] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-24T22:28:07.315960] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-24T22:28:07.318550] [INFO ] [MAIN ] Derivative Progress: 1918/2075 symbols completed. UVV took 1.4s. Estimated remaining: 1m 1s. Rate: 153.7 symbols/min [2025-09-24T22:28:07.336387] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:07.337293] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6284 primary records. [2025-09-24T22:28:07.337411] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-24T22:28:07.353358] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-09-24T22:28:07.353598] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-24T22:28:07.356124] [INFO ] [MAIN ] Derivative Progress: 1919/2075 symbols completed. UZD took 0.8s. Estimated remaining: 1m 1s. Rate: 153.8 symbols/min [2025-09-24T22:28:07.374116] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:07.374801] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52739 primary records. [2025-09-24T22:28:07.374864] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-24T22:28:07.390279] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-24T22:28:07.390357] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-24T22:28:07.393197] [INFO ] [MAIN ] Derivative Progress: 1920/2075 symbols completed. UWMC took 0.8s. Estimated remaining: 1m 0s. Rate: 153.9 symbols/min [2025-09-24T22:28:07.394154] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:07.393980] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:07.394393] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:07.406811] [DEBUG] [LOCAL ] UZF: Loaded 6458 existing records from primary storage. [2025-09-24T22:28:07.411204] [DEBUG] [LOCAL ] UZE: Loaded 7490 existing records from primary storage. [2025-09-24T22:28:07.410959] [INFO ] [MAIN ] UZF: Loaded 6458 primary data records. [2025-09-24T22:28:07.422669] [INFO ] [MAIN ] UZE: Loaded 7490 primary data records. [2025-09-24T22:28:08.077142] [DEBUG] [LOCAL ] V: Loaded 53762 existing records from primary storage. [2025-09-24T22:28:08.078477] [INFO ] [MAIN ] V: Loaded 53762 primary data records. [2025-09-24T22:28:08.433556] [DEBUG] [MAIN ] UZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:08.434015] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:08.436739] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6458 primary records. [2025-09-24T22:28:08.435515] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7490 primary records. [2025-09-24T22:28:08.437315] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-24T22:28:08.437700] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-24T22:28:08.461844] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-09-24T22:28:08.464395] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-24T22:28:08.467063] [INFO ] [MAIN ] Derivative Progress: 1921/2075 symbols completed. UZE took 1.1s. Estimated remaining: 1m 0s. Rate: 153.7 symbols/min [2025-09-24T22:28:08.470346] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:08.476439] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-24T22:28:08.476698] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-24T22:28:08.479200] [INFO ] [MAIN ] Derivative Progress: 1922/2075 symbols completed. UZF took 1.1s. Estimated remaining: 59.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:08.479734] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:08.498800] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:08.499672] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53762 primary records. [2025-09-24T22:28:08.499836] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-24T22:28:08.532455] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-24T22:28:08.532685] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-24T22:28:08.535457] [INFO ] [MAIN ] Derivative Progress: 1923/2075 symbols completed. V took 1.1s. Estimated remaining: 59.3s. Rate: 153.9 symbols/min [2025-09-24T22:28:08.535995] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:08.549322] [DEBUG] [LOCAL ] VAC: Loaded 34540 existing records from primary storage. [2025-09-24T22:28:08.549487] [INFO ] [MAIN ] VAC: Loaded 34540 primary data records. [2025-09-24T22:28:08.731372] [DEBUG] [LOCAL ] VAL: Loaded 50416 existing records from primary storage. [2025-09-24T22:28:08.770542] [INFO ] [MAIN ] VAL: Loaded 50416 primary data records. [2025-09-24T22:28:09.069559] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-24T22:28:09.070342] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-24T22:28:09.630471] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:09.632004] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34540 primary records. [2025-09-24T22:28:09.632681] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-24T22:28:09.650504] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-24T22:28:09.650931] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-24T22:28:09.653531] [INFO ] [MAIN ] Derivative Progress: 1924/2075 symbols completed. VAC took 1.2s. Estimated remaining: 58.9s. Rate: 153.7 symbols/min [2025-09-24T22:28:09.655114] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:09.674554] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:09.675522] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50416 primary records. [2025-09-24T22:28:09.676002] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-24T22:28:09.680262] [DEBUG] [LOCAL ] VATE: Loaded 5627 existing records from primary storage. [2025-09-24T22:28:09.680810] [INFO ] [MAIN ] VATE: Loaded 5627 primary data records. [2025-09-24T22:28:09.727310] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-24T22:28:09.727457] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-24T22:28:09.766754] [INFO ] [MAIN ] Derivative Progress: 1925/2075 symbols completed. VAL took 1.3s. Estimated remaining: 58.5s. Rate: 153.8 symbols/min [2025-09-24T22:28:09.805591] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:09.840507] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:09.876959] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-24T22:28:10.018276] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-24T22:28:10.031290] [DEBUG] [LOCAL ] VBF: Loaded 7071 existing records from primary storage. [2025-09-24T22:28:10.032354] [INFO ] [MAIN ] VBF: Loaded 7071 primary data records. [2025-09-24T22:28:10.171799] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-24T22:28:10.178035] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-24T22:28:10.191713] [INFO ] [MAIN ] Derivative Progress: 1926/2075 symbols completed. VALE took 1.7s. Estimated remaining: 58.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:10.197695] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:10.442048] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:10.449341] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5627 primary records. [2025-09-24T22:28:10.449451] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-24T22:28:10.450574] [DEBUG] [LOCAL ] VCV: Loaded 13464 existing records from primary storage. [2025-09-24T22:28:10.450915] [INFO ] [MAIN ] VCV: Loaded 13464 primary data records. [2025-09-24T22:28:10.504575] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-24T22:28:10.532783] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-24T22:28:10.535913] [INFO ] [MAIN ] Derivative Progress: 1927/2075 symbols completed. VATE took 0.9s. Estimated remaining: 57.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:10.560337] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:10.842277] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:10.843922] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7071 primary records. [2025-09-24T22:28:10.854603] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-24T22:28:10.872010] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-24T22:28:10.872210] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-24T22:28:10.875281] [INFO ] [MAIN ] Derivative Progress: 1928/2075 symbols completed. VBF took 1.1s. Estimated remaining: 57.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:10.875942] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:10.893964] [DEBUG] [LOCAL ] VEEV: Loaded 47121 existing records from primary storage. [2025-09-24T22:28:10.894322] [INFO ] [MAIN ] VEEV: Loaded 47121 primary data records. [2025-09-24T22:28:10.981505] [DEBUG] [LOCAL ] VEL: Loaded 13086 existing records from primary storage. [2025-09-24T22:28:10.991972] [INFO ] [MAIN ] VEL: Loaded 13086 primary data records. [2025-09-24T22:28:11.215951] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:11.336318] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13464 primary records. [2025-09-24T22:28:11.336960] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-24T22:28:11.436279] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-24T22:28:11.553601] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-24T22:28:11.556268] [INFO ] [MAIN ] Derivative Progress: 1929/2075 symbols completed. VCV took 1.4s. Estimated remaining: 57.0s. Rate: 153.7 symbols/min [2025-09-24T22:28:11.557304] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:11.584472] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:11.585439] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47121 primary records. [2025-09-24T22:28:11.585768] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-24T22:28:11.604781] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-24T22:28:11.604971] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-24T22:28:11.607393] [INFO ] [MAIN ] Derivative Progress: 1930/2075 symbols completed. VEEV took 1.1s. Estimated remaining: 56.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:11.615572] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:11.630639] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:11.631453] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 13086 primary records. [2025-09-24T22:28:11.631674] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-24T22:28:11.648476] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-09-24T22:28:11.648626] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-24T22:28:11.651764] [INFO ] [MAIN ] Derivative Progress: 1931/2075 symbols completed. VEL took 0.8s. Estimated remaining: 56.1s. Rate: 153.9 symbols/min [2025-09-24T22:28:11.652157] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:11.666943] [DEBUG] [LOCAL ] VET: Loaded 44066 existing records from primary storage. [2025-09-24T22:28:11.667174] [INFO ] [MAIN ] VET: Loaded 44066 primary data records. [2025-09-24T22:28:11.736313] [DEBUG] [LOCAL ] VGI: Loaded 5170 existing records from primary storage. [2025-09-24T22:28:11.763922] [INFO ] [MAIN ] VGI: Loaded 5170 primary data records. [2025-09-24T22:28:12.159469] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-24T22:28:12.178731] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-09-24T22:28:12.751389] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:12.753191] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44066 primary records. [2025-09-24T22:28:12.753843] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-24T22:28:12.774749] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-24T22:28:12.774986] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-24T22:28:12.791394] [INFO ] [MAIN ] Derivative Progress: 1932/2075 symbols completed. VET took 1.2s. Estimated remaining: 55.8s. Rate: 153.7 symbols/min [2025-09-24T22:28:12.792844] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:12.792559] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:12.794391] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5170 primary records. [2025-09-24T22:28:12.794608] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-24T22:28:12.810376] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-24T22:28:12.810634] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-24T22:28:12.813139] [INFO ] [MAIN ] Derivative Progress: 1933/2075 symbols completed. VGI took 1.2s. Estimated remaining: 55.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:12.834227] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:12.835102] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53610 primary records. [2025-09-24T22:28:12.835240] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-24T22:28:12.851391] [DEBUG] [LOCAL ] VGM: Loaded 18204 existing records from primary storage. [2025-09-24T22:28:12.858177] [INFO ] [MAIN ] VGM: Loaded 18204 primary data records. [2025-09-24T22:28:12.859291] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-24T22:28:12.909605] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-24T22:28:12.947084] [INFO ] [MAIN ] Derivative Progress: 1934/2075 symbols completed. VFC took 1.3s. Estimated remaining: 55.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:13.203792] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:13.204468] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18204 primary records. [2025-09-24T22:28:13.204533] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-24T22:28:13.219837] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-24T22:28:13.219928] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-24T22:28:13.222230] [INFO ] [MAIN ] Derivative Progress: 1935/2075 symbols completed. VGM took 0.4s. Estimated remaining: 54.6s. Rate: 153.9 symbols/min [2025-09-24T22:28:13.222983] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:13.222745] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:13.223399] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:13.229228] [DEBUG] [LOCAL ] VHI: Loaded 2880 existing records from primary storage. [2025-09-24T22:28:13.229601] [INFO ] [MAIN ] VHI: Loaded 2880 primary data records. [2025-09-24T22:28:13.590090] [DEBUG] [LOCAL ] VIK: Loaded 52500 existing records from primary storage. [2025-09-24T22:28:13.590739] [INFO ] [MAIN ] VIK: Loaded 52500 primary data records. [2025-09-24T22:28:13.712580] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-24T22:28:13.735693] [INFO ] [MAIN ] VICI: Loaded 53649 primary data records. [2025-09-24T22:28:14.099306] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:14.154302] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2880 primary records. [2025-09-24T22:28:14.272159] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-24T22:28:14.288677] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-09-24T22:28:14.288783] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-24T22:28:14.291237] [INFO ] [MAIN ] Derivative Progress: 1936/2075 symbols completed. VHI took 1.1s. Estimated remaining: 54.2s. Rate: 153.7 symbols/min [2025-09-24T22:28:14.291939] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:14.312975] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:14.314941] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52500 primary records. [2025-09-24T22:28:14.315131] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-24T22:28:14.333620] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-24T22:28:14.333955] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-24T22:28:14.335883] [INFO ] [MAIN ] Derivative Progress: 1937/2075 symbols completed. VIK took 1.1s. Estimated remaining: 53.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:14.336410] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:14.354391] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:14.368827] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53649 primary records. [2025-09-24T22:28:14.368900] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-24T22:28:14.385622] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-24T22:28:14.386475] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-24T22:28:14.389475] [INFO ] [MAIN ] Derivative Progress: 1938/2075 symbols completed. VICI took 1.2s. Estimated remaining: 53.4s. Rate: 153.9 symbols/min [2025-09-24T22:28:14.389942] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:14.405963] [DEBUG] [LOCAL ] VIPS: Loaded 51364 existing records from primary storage. [2025-09-24T22:28:14.406285] [INFO ] [MAIN ] VIPS: Loaded 51364 primary data records. [2025-09-24T22:28:14.736810] [DEBUG] [LOCAL ] VIRT: Loaded 46870 existing records from primary storage. [2025-09-24T22:28:14.746819] [INFO ] [MAIN ] VIRT: Loaded 46870 primary data records. [2025-09-24T22:28:14.835544] [DEBUG] [LOCAL ] VIST: Loaded 46010 existing records from primary storage. [2025-09-24T22:28:14.854130] [INFO ] [MAIN ] VIST: Loaded 46010 primary data records. [2025-09-24T22:28:15.454729] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:15.455702] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51364 primary records. [2025-09-24T22:28:15.456242] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-24T22:28:15.475820] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-24T22:28:15.476375] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-24T22:28:15.479259] [INFO ] [MAIN ] Derivative Progress: 1939/2075 symbols completed. VIPS took 1.2s. Estimated remaining: 53.1s. Rate: 153.7 symbols/min [2025-09-24T22:28:15.479940] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:15.502122] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:15.503335] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46870 primary records. [2025-09-24T22:28:15.503618] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-24T22:28:15.525150] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-24T22:28:15.536879] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-24T22:28:15.539389] [INFO ] [MAIN ] Derivative Progress: 1940/2075 symbols completed. VIRT took 1.2s. Estimated remaining: 52.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:15.552479] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:15.553461] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:15.554404] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46010 primary records. [2025-09-24T22:28:15.554905] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-24T22:28:15.586637] [DEBUG] [LOCAL ] VIV: Loaded 45175 existing records from primary storage. [2025-09-24T22:28:15.587248] [INFO ] [MAIN ] VIV: Loaded 45175 primary data records. [2025-09-24T22:28:15.588472] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-24T22:28:15.603669] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-24T22:28:15.606953] [INFO ] [MAIN ] Derivative Progress: 1941/2075 symbols completed. VIST took 1.2s. Estimated remaining: 52.3s. Rate: 153.9 symbols/min [2025-09-24T22:28:15.633314] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:15.673534] [DEBUG] [LOCAL ] VKQ: Loaded 17393 existing records from primary storage. [2025-09-24T22:28:15.691683] [INFO ] [MAIN ] VKQ: Loaded 17393 primary data records. [2025-09-24T22:28:16.130965] [DEBUG] [LOCAL ] VLN: Loaded 28530 existing records from primary storage. [2025-09-24T22:28:16.131440] [INFO ] [MAIN ] VLN: Loaded 28530 primary data records. [2025-09-24T22:28:16.914435] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:16.917026] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45175 primary records. [2025-09-24T22:28:16.918508] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-24T22:28:16.959211] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-24T22:28:16.965128] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-24T22:28:16.965050] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:16.968685] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17393 primary records. [2025-09-24T22:28:16.967420] [INFO ] [MAIN ] Derivative Progress: 1942/2075 symbols completed. VIV took 1.5s. Estimated remaining: 51.9s. Rate: 153.7 symbols/min [2025-09-24T22:28:16.969259] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:16.969124] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-24T22:28:16.991981] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-24T22:28:16.992384] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-24T22:28:16.994995] [INFO ] [MAIN ] Derivative Progress: 1943/2075 symbols completed. VKQ took 1.4s. Estimated remaining: 51.5s. Rate: 153.7 symbols/min [2025-09-24T22:28:16.995450] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:17.015281] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:17.016273] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28530 primary records. [2025-09-24T22:28:17.016473] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-24T22:28:17.037074] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-24T22:28:17.037297] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-24T22:28:17.040438] [INFO ] [MAIN ] Derivative Progress: 1944/2075 symbols completed. VLN took 1.4s. Estimated remaining: 51.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:17.041063] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:17.059681] [DEBUG] [LOCAL ] VLT: Loaded 4578 existing records from primary storage. [2025-09-24T22:28:17.059847] [INFO ] [MAIN ] VLT: Loaded 4578 primary data records. [2025-09-24T22:28:17.241518] [DEBUG] [LOCAL ] VLRS: Loaded 40700 existing records from primary storage. [2025-09-24T22:28:17.243072] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-24T22:28:17.248563] [INFO ] [MAIN ] VLO: Loaded 53088 primary data records. [2025-09-24T22:28:17.243182] [INFO ] [MAIN ] VLRS: Loaded 40700 primary data records. [2025-09-24T22:28:18.106678] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:18.107681] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4578 primary records. [2025-09-24T22:28:18.107978] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-24T22:28:18.126099] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-24T22:28:18.126332] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-24T22:28:18.128381] [INFO ] [MAIN ] Derivative Progress: 1945/2075 symbols completed. VLT took 1.1s. Estimated remaining: 50.8s. Rate: 153.7 symbols/min [2025-09-24T22:28:18.128633] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:18.142227] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:18.142989] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53088 primary records. [2025-09-24T22:28:18.143240] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-24T22:28:18.169617] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-24T22:28:18.174993] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-24T22:28:18.174940] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:18.178213] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40700 primary records. [2025-09-24T22:28:18.177430] [INFO ] [MAIN ] Derivative Progress: 1946/2075 symbols completed. VLO took 1.2s. Estimated remaining: 50.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:18.178372] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-24T22:28:18.178663] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:18.195431] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-24T22:28:18.195565] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-24T22:28:18.198373] [INFO ] [MAIN ] Derivative Progress: 1947/2075 symbols completed. VLRS took 1.2s. Estimated remaining: 49.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:18.198761] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:18.224892] [DEBUG] [LOCAL ] VMI: Loaded 15472 existing records from primary storage. [2025-09-24T22:28:18.225024] [INFO ] [MAIN ] VMI: Loaded 15472 primary data records. [2025-09-24T22:28:18.359172] [DEBUG] [LOCAL ] VLTO: Loaded 46007 existing records from primary storage. [2025-09-24T22:28:18.370813] [INFO ] [MAIN ] VLTO: Loaded 46007 primary data records. [2025-09-24T22:28:18.398106] [DEBUG] [LOCAL ] VMC: Loaded 43704 existing records from primary storage. [2025-09-24T22:28:18.409470] [INFO ] [MAIN ] VMC: Loaded 43704 primary data records. [2025-09-24T22:28:19.293686] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:19.295225] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15472 primary records. [2025-09-24T22:28:19.307978] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-24T22:28:19.309859] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:19.317774] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46007 primary records. [2025-09-24T22:28:19.321841] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-24T22:28:19.335129] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-09-24T22:28:19.340821] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-24T22:28:19.343067] [INFO ] [MAIN ] Derivative Progress: 1948/2075 symbols completed. VMI took 1.1s. Estimated remaining: 49.6s. Rate: 153.7 symbols/min [2025-09-24T22:28:19.346548] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-24T22:28:19.347737] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-24T22:28:19.350853] [INFO ] [MAIN ] Derivative Progress: 1949/2075 symbols completed. VLTO took 1.2s. Estimated remaining: 49.2s. Rate: 153.7 symbols/min [2025-09-24T22:28:19.363555] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:19.364145] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43704 primary records. [2025-09-24T22:28:19.364208] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-24T22:28:19.379514] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-24T22:28:19.379593] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-24T22:28:19.382451] [INFO ] [MAIN ] Derivative Progress: 1950/2075 symbols completed. VMC took 1.2s. Estimated remaining: 48.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:19.383314] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:19.383680] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:19.383865] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:19.394180] [DEBUG] [LOCAL ] VNCE: Loaded 7242 existing records from primary storage. [2025-09-24T22:28:19.394412] [INFO ] [MAIN ] VNCE: Loaded 7242 primary data records. [2025-09-24T22:28:19.754039] [DEBUG] [LOCAL ] VMO: Loaded 21024 existing records from primary storage. [2025-09-24T22:28:19.755254] [DEBUG] [LOCAL ] VNO: Loaded 48973 existing records from primary storage. [2025-09-24T22:28:19.755435] [INFO ] [MAIN ] VNO: Loaded 48973 primary data records. [2025-09-24T22:28:19.755509] [INFO ] [MAIN ] VMO: Loaded 21024 primary data records. [2025-09-24T22:28:20.399880] [DEBUG] [MAIN ] VNCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:20.400848] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 7242 primary records. [2025-09-24T22:28:20.400951] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-24T22:28:20.417949] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-24T22:28:20.418490] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-24T22:28:20.420934] [INFO ] [MAIN ] Derivative Progress: 1951/2075 symbols completed. VNCE took 1.0s. Estimated remaining: 48.4s. Rate: 153.7 symbols/min [2025-09-24T22:28:20.421544] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:20.455894] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:20.455570] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:20.456746] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21024 primary records. [2025-09-24T22:28:20.457366] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48973 primary records. [2025-09-24T22:28:20.457772] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-24T22:28:20.457542] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-24T22:28:20.486461] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-24T22:28:20.496067] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-24T22:28:20.499532] [INFO ] [MAIN ] Derivative Progress: 1952/2075 symbols completed. VNO took 1.1s. Estimated remaining: 48.0s. Rate: 153.7 symbols/min [2025-09-24T22:28:20.501048] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:20.504624] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-24T22:28:20.504803] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-24T22:28:20.507290] [INFO ] [MAIN ] Derivative Progress: 1953/2075 symbols completed. VMO took 1.1s. Estimated remaining: 47.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:20.510455] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:20.524521] [DEBUG] [LOCAL ] VNT: Loaded 43902 existing records from primary storage. [2025-09-24T22:28:20.528799] [DEBUG] [LOCAL ] VOC: Loaded 8934 existing records from primary storage. [2025-09-24T22:28:20.528896] [INFO ] [MAIN ] VNT: Loaded 43902 primary data records. [2025-09-24T22:28:20.528990] [INFO ] [MAIN ] VOC: Loaded 8934 primary data records. [2025-09-24T22:28:20.915994] [DEBUG] [LOCAL ] VOYA: Loaded 42801 existing records from primary storage. [2025-09-24T22:28:21.053991] [INFO ] [MAIN ] VOYA: Loaded 42801 primary data records. [2025-09-24T22:28:21.542951] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:21.545237] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8934 primary records. [2025-09-24T22:28:21.545420] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-24T22:28:21.573098] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:21.577235] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43902 primary records. [2025-09-24T22:28:21.577414] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-24T22:28:21.579777] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-24T22:28:21.580332] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-24T22:28:21.582899] [INFO ] [MAIN ] Derivative Progress: 1954/2075 symbols completed. VOC took 1.1s. Estimated remaining: 47.2s. Rate: 153.7 symbols/min [2025-09-24T22:28:21.583299] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:21.598840] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-24T22:28:21.599096] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-24T22:28:21.601821] [INFO ] [MAIN ] Derivative Progress: 1955/2075 symbols completed. VNT took 1.2s. Estimated remaining: 46.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:21.602445] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:21.628761] [DEBUG] [LOCAL ] VPV: Loaded 5372 existing records from primary storage. [2025-09-24T22:28:21.628533] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:21.629511] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42801 primary records. [2025-09-24T22:28:21.629605] [INFO ] [MAIN ] VPV: Loaded 5372 primary data records. [2025-09-24T22:28:21.629706] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-24T22:28:21.686833] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-24T22:28:21.715684] [DEBUG] [LOCAL ] VPG: Loaded 17215 existing records from primary storage. [2025-09-24T22:28:21.715881] [INFO ] [MAIN ] VPG: Loaded 17215 primary data records. [2025-09-24T22:28:21.715817] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-24T22:28:21.734774] [INFO ] [MAIN ] Derivative Progress: 1956/2075 symbols completed. VOYA took 1.2s. Estimated remaining: 46.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:21.746812] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:22.285306] [DEBUG] [LOCAL ] VRE: Loaded 34858 existing records from primary storage. [2025-09-24T22:28:22.287436] [INFO ] [MAIN ] VRE: Loaded 34858 primary data records. [2025-09-24T22:28:22.610052] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:22.624296] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:22.623411] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5372 primary records. [2025-09-24T22:28:22.625216] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-24T22:28:22.625144] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17215 primary records. [2025-09-24T22:28:22.625834] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-24T22:28:22.657908] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-24T22:28:22.658639] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-24T22:28:22.661506] [INFO ] [MAIN ] Derivative Progress: 1957/2075 symbols completed. VPG took 1.1s. Estimated remaining: 46.1s. Rate: 153.7 symbols/min [2025-09-24T22:28:22.662034] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:22.662756] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-24T22:28:22.663153] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-24T22:28:22.665490] [INFO ] [MAIN ] Derivative Progress: 1958/2075 symbols completed. VPV took 1.1s. Estimated remaining: 45.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:22.665843] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:22.678932] [DEBUG] [LOCAL ] VRTS: Loaded 9142 existing records from primary storage. [2025-09-24T22:28:22.679248] [INFO ] [MAIN ] VRTS: Loaded 9142 primary data records. [2025-09-24T22:28:22.826619] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:22.879402] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34858 primary records. [2025-09-24T22:28:22.879517] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-24T22:28:23.031495] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-24T22:28:23.032276] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-24T22:28:23.035929] [INFO ] [MAIN ] Derivative Progress: 1959/2075 symbols completed. VRE took 1.3s. Estimated remaining: 45.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:23.036815] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:23.055165] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-24T22:28:23.055420] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-24T22:28:23.439444] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:23.440556] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9142 primary records. [2025-09-24T22:28:23.441883] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-24T22:28:23.476855] [DEBUG] [LOCAL ] VSCO: Loaded 52822 existing records from primary storage. [2025-09-24T22:28:23.478116] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-09-24T22:28:23.477534] [INFO ] [MAIN ] VSCO: Loaded 52822 primary data records. [2025-09-24T22:28:23.478234] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-24T22:28:23.481006] [INFO ] [MAIN ] Derivative Progress: 1960/2075 symbols completed. VRTS took 0.8s. Estimated remaining: 44.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:23.540557] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:23.821286] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:23.823026] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-24T22:28:23.823377] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-24T22:28:23.854048] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-24T22:28:23.854509] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-24T22:28:23.857009] [INFO ] [MAIN ] Derivative Progress: 1961/2075 symbols completed. VRT took 1.2s. Estimated remaining: 44.5s. Rate: 153.8 symbols/min [2025-09-24T22:28:23.858263] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:23.878497] [DEBUG] [LOCAL ] VSH: Loaded 48566 existing records from primary storage. [2025-09-24T22:28:23.879081] [INFO ] [MAIN ] VSH: Loaded 48566 primary data records. [2025-09-24T22:28:24.109233] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:24.228845] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52822 primary records. [2025-09-24T22:28:24.228979] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-24T22:28:24.268490] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-24T22:28:24.268778] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-24T22:28:24.270689] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-24T22:28:24.272287] [INFO ] [MAIN ] VST: Loaded 53720 primary data records. [2025-09-24T22:28:24.274946] [INFO ] [MAIN ] Derivative Progress: 1962/2075 symbols completed. VSCO took 1.2s. Estimated remaining: 44.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:24.287033] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:24.621833] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:24.623803] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48566 primary records. [2025-09-24T22:28:24.624439] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-24T22:28:24.640486] [DEBUG] [LOCAL ] VSTS: Loaded 49050 existing records from primary storage. [2025-09-24T22:28:24.650973] [INFO ] [MAIN ] VSTS: Loaded 49050 primary data records. [2025-09-24T22:28:24.663609] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-24T22:28:24.693377] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-24T22:28:24.733255] [INFO ] [MAIN ] Derivative Progress: 1963/2075 symbols completed. VSH took 1.2s. Estimated remaining: 43.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:25.004379] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:25.005182] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53720 primary records. [2025-09-24T22:28:25.005310] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-24T22:28:25.022816] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-24T22:28:25.023408] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-24T22:28:25.026033] [INFO ] [MAIN ] Derivative Progress: 1964/2075 symbols completed. VST took 1.2s. Estimated remaining: 43.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:25.047664] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:25.048303] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49050 primary records. [2025-09-24T22:28:25.048368] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-24T22:28:25.064171] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-24T22:28:25.064260] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-24T22:28:25.066723] [INFO ] [MAIN ] Derivative Progress: 1965/2075 symbols completed. VSTS took 0.8s. Estimated remaining: 42.9s. Rate: 153.9 symbols/min [2025-09-24T22:28:25.067676] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:25.067794] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:25.067557] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:25.088931] [DEBUG] [LOCAL ] VTMX: Loaded 17530 existing records from primary storage. [2025-09-24T22:28:25.089066] [INFO ] [MAIN ] VTMX: Loaded 17530 primary data records. [2025-09-24T22:28:25.266670] [DEBUG] [LOCAL ] VTEX: Loaded 43395 existing records from primary storage. [2025-09-24T22:28:25.313254] [INFO ] [MAIN ] VTEX: Loaded 43395 primary data records. [2025-09-24T22:28:25.506521] [DEBUG] [LOCAL ] VTLE: Loaded 48611 existing records from primary storage. [2025-09-24T22:28:25.525091] [INFO ] [MAIN ] VTLE: Loaded 48611 primary data records. [2025-09-24T22:28:26.129671] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:26.130696] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17530 primary records. [2025-09-24T22:28:26.130881] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-24T22:28:26.151061] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-24T22:28:26.151374] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-24T22:28:26.154068] [INFO ] [MAIN ] Derivative Progress: 1966/2075 symbols completed. VTMX took 1.1s. Estimated remaining: 42.5s. Rate: 153.7 symbols/min [2025-09-24T22:28:26.154431] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:26.168256] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:26.169322] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43395 primary records. [2025-09-24T22:28:26.169499] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-24T22:28:26.190612] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-24T22:28:26.195317] [DEBUG] [LOCAL ] VTN: Loaded 7212 existing records from primary storage. [2025-09-24T22:28:26.195070] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-24T22:28:26.195539] [INFO ] [MAIN ] VTN: Loaded 7212 primary data records. [2025-09-24T22:28:26.197510] [INFO ] [MAIN ] Derivative Progress: 1967/2075 symbols completed. VTEX took 1.1s. Estimated remaining: 42.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:26.219786] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:26.291674] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:26.322851] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48611 primary records. [2025-09-24T22:28:26.353600] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-24T22:28:26.430905] [DEBUG] [LOCAL ] VTOL: Loaded 19720 existing records from primary storage. [2025-09-24T22:28:26.431320] [INFO ] [MAIN ] VTOL: Loaded 19720 primary data records. [2025-09-24T22:28:26.678031] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-24T22:28:26.689600] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-24T22:28:26.692689] [INFO ] [MAIN ] Derivative Progress: 1968/2075 symbols completed. VTLE took 1.6s. Estimated remaining: 41.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:26.698270] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:26.910302] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:26.911233] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7212 primary records. [2025-09-24T22:28:26.911501] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-24T22:28:26.943080] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-24T22:28:26.943191] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-24T22:28:26.945353] [INFO ] [MAIN ] Derivative Progress: 1969/2075 symbols completed. VTN took 0.8s. Estimated remaining: 41.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:26.945959] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:26.979510] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:26.980383] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19720 primary records. [2025-09-24T22:28:26.980526] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-24T22:28:26.981411] [DEBUG] [LOCAL ] VTR: Loaded 52846 existing records from primary storage. [2025-09-24T22:28:26.981884] [INFO ] [MAIN ] VTR: Loaded 52846 primary data records. [2025-09-24T22:28:27.046864] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-24T22:28:27.082571] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-24T22:28:27.098344] [INFO ] [MAIN ] Derivative Progress: 1970/2075 symbols completed. VTOL took 0.9s. Estimated remaining: 41.0s. Rate: 153.8 symbols/min [2025-09-24T22:28:27.120071] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:27.223702] [DEBUG] [LOCAL ] VTS: Loaded 30559 existing records from primary storage. [2025-09-24T22:28:27.230302] [INFO ] [MAIN ] VTS: Loaded 30559 primary data records. [2025-09-24T22:28:27.560903] [DEBUG] [LOCAL ] VVR: Loaded 30603 existing records from primary storage. [2025-09-24T22:28:27.615975] [INFO ] [MAIN ] VVR: Loaded 30603 primary data records. [2025-09-24T22:28:28.084349] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:28.085280] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52846 primary records. [2025-09-24T22:28:28.085382] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-24T22:28:28.104287] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-24T22:28:28.104805] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-24T22:28:28.107393] [INFO ] [MAIN ] Derivative Progress: 1971/2075 symbols completed. VTR took 1.4s. Estimated remaining: 40.6s. Rate: 153.7 symbols/min [2025-09-24T22:28:28.107977] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:28.127968] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:28.128963] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30559 primary records. [2025-09-24T22:28:28.129351] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-24T22:28:28.152822] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-24T22:28:28.171388] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-24T22:28:28.180161] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:28.181163] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 30603 primary records. [2025-09-24T22:28:28.181255] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-24T22:28:28.179590] [INFO ] [MAIN ] Derivative Progress: 1972/2075 symbols completed. VTS took 1.2s. Estimated remaining: 40.2s. Rate: 153.8 symbols/min [2025-09-24T22:28:28.182317] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:28.200676] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-24T22:28:28.215735] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-24T22:28:28.218493] [INFO ] [MAIN ] Derivative Progress: 1973/2075 symbols completed. VVR took 1.1s. Estimated remaining: 39.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:28.220220] [DEBUG] [LOCAL ] VVV: Loaded 50210 existing records from primary storage. [2025-09-24T22:28:28.220449] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:28.220572] [INFO ] [MAIN ] VVV: Loaded 50210 primary data records. [2025-09-24T22:28:28.351706] [DEBUG] [LOCAL ] VVX: Loaded 23347 existing records from primary storage. [2025-09-24T22:28:28.387774] [INFO ] [MAIN ] VVX: Loaded 23347 primary data records. [2025-09-24T22:28:28.679476] [DEBUG] [LOCAL ] VYX: Loaded 49030 existing records from primary storage. [2025-09-24T22:28:28.691308] [INFO ] [MAIN ] VYX: Loaded 49030 primary data records. [2025-09-24T22:28:29.260675] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:29.261876] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50210 primary records. [2025-09-24T22:28:29.262258] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-24T22:28:29.285591] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-24T22:28:29.286040] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-24T22:28:29.289812] [INFO ] [MAIN ] Derivative Progress: 1974/2075 symbols completed. VVV took 1.2s. Estimated remaining: 39.4s. Rate: 153.7 symbols/min [2025-09-24T22:28:29.290310] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:29.304157] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:29.305405] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23347 primary records. [2025-09-24T22:28:29.305808] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-24T22:28:29.327430] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-24T22:28:29.327730] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-24T22:28:29.330209] [INFO ] [MAIN ] Derivative Progress: 1975/2075 symbols completed. VVX took 1.1s. Estimated remaining: 39.0s. Rate: 153.8 symbols/min [2025-09-24T22:28:29.343498] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:29.344284] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:29.345347] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 49030 primary records. [2025-09-24T22:28:29.345963] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-24T22:28:29.364295] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-24T22:28:29.377921] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-24T22:28:29.380959] [INFO ] [MAIN ] Derivative Progress: 1976/2075 symbols completed. VYX took 1.2s. Estimated remaining: 38.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:29.381443] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:29.407281] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-24T22:28:29.407505] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-24T22:28:29.767668] [DEBUG] [LOCAL ] W: Loaded 53496 existing records from primary storage. [2025-09-24T22:28:29.788914] [INFO ] [MAIN ] W: Loaded 53496 primary data records. [2025-09-24T22:28:29.803097] [DEBUG] [LOCAL ] WAB: Loaded 44215 existing records from primary storage. [2025-09-24T22:28:29.835362] [INFO ] [MAIN ] WAB: Loaded 44215 primary data records. [2025-09-24T22:28:30.432190] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:30.433342] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-24T22:28:30.433815] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-24T22:28:30.451168] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-24T22:28:30.451359] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-24T22:28:30.454391] [INFO ] [MAIN ] Derivative Progress: 1977/2075 symbols completed. VZ took 1.2s. Estimated remaining: 38.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:30.455402] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:30.483795] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:30.489825] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53496 primary records. [2025-09-24T22:28:30.490118] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-24T22:28:30.490406] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:30.492198] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44215 primary records. [2025-09-24T22:28:30.492608] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-24T22:28:30.524864] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-24T22:28:30.525030] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-24T22:28:30.527888] [INFO ] [MAIN ] Derivative Progress: 1978/2075 symbols completed. WAB took 1.1s. Estimated remaining: 37.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:30.528375] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-24T22:28:30.528704] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-24T22:28:30.531078] [INFO ] [MAIN ] Derivative Progress: 1979/2075 symbols completed. W took 1.2s. Estimated remaining: 37.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:30.558759] [DEBUG] [LOCAL ] WAL: Loaded 45337 existing records from primary storage. [2025-09-24T22:28:30.558919] [INFO ] [MAIN ] WAL: Loaded 45337 primary data records. [2025-09-24T22:28:30.885010] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:30.885671] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45337 primary records. [2025-09-24T22:28:30.885739] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-24T22:28:30.901141] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-24T22:28:30.901250] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-24T22:28:30.903464] [INFO ] [MAIN ] Derivative Progress: 1980/2075 symbols completed. WAL took 0.4s. Estimated remaining: 37.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:30.904256] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:30.904461] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:30.904920] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:30.922519] [DEBUG] [LOCAL ] WBX: Loaded 12517 existing records from primary storage. [2025-09-24T22:28:30.922754] [INFO ] [MAIN ] WBX: Loaded 12517 primary data records. [2025-09-24T22:28:31.164900] [DEBUG] [LOCAL ] WAT: Loaded 35095 existing records from primary storage. [2025-09-24T22:28:31.165811] [DEBUG] [LOCAL ] WBS: Loaded 48737 existing records from primary storage. [2025-09-24T22:28:31.165945] [INFO ] [MAIN ] WAT: Loaded 35095 primary data records. [2025-09-24T22:28:31.166104] [INFO ] [MAIN ] WBS: Loaded 48737 primary data records. [2025-09-24T22:28:31.983824] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:31.986137] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 12517 primary records. [2025-09-24T22:28:31.986525] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-24T22:28:32.007316] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-24T22:28:32.008297] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-24T22:28:32.010715] [INFO ] [MAIN ] Derivative Progress: 1981/2075 symbols completed. WBX took 1.1s. Estimated remaining: 36.7s. Rate: 153.7 symbols/min [2025-09-24T22:28:32.011865] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:32.031438] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:32.034124] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35095 primary records. [2025-09-24T22:28:32.034221] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-24T22:28:32.064263] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-24T22:28:32.060165] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:32.064445] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-24T22:28:32.065530] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48737 primary records. [2025-09-24T22:28:32.068335] [INFO ] [MAIN ] Derivative Progress: 1982/2075 symbols completed. WAT took 1.2s. Estimated remaining: 36.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:32.068768] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-24T22:28:32.068871] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:32.096923] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-24T22:28:32.097130] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-24T22:28:32.099994] [INFO ] [MAIN ] Derivative Progress: 1983/2075 symbols completed. WBS took 1.2s. Estimated remaining: 35.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:32.100325] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:32.121218] [DEBUG] [LOCAL ] WCC: Loaded 39967 existing records from primary storage. [2025-09-24T22:28:32.121525] [INFO ] [MAIN ] WCC: Loaded 39967 primary data records. [2025-09-24T22:28:32.326946] [DEBUG] [LOCAL ] WD: Loaded 23422 existing records from primary storage. [2025-09-24T22:28:32.363673] [INFO ] [MAIN ] WD: Loaded 23422 primary data records. [2025-09-24T22:28:32.363546] [DEBUG] [LOCAL ] WCN: Loaded 48029 existing records from primary storage. [2025-09-24T22:28:32.370539] [INFO ] [MAIN ] WCN: Loaded 48029 primary data records. [2025-09-24T22:28:33.148467] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:33.149868] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39967 primary records. [2025-09-24T22:28:33.150085] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-24T22:28:33.169798] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-24T22:28:33.170350] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-24T22:28:33.172349] [INFO ] [MAIN ] Derivative Progress: 1984/2075 symbols completed. WCC took 1.2s. Estimated remaining: 35.5s. Rate: 153.7 symbols/min [2025-09-24T22:28:33.172741] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:33.191630] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:33.193597] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48029 primary records. [2025-09-24T22:28:33.193762] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-24T22:28:33.232248] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:33.231800] [DEBUG] [LOCAL ] WDH: Loaded 17223 existing records from primary storage. [2025-09-24T22:28:33.236787] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23422 primary records. [2025-09-24T22:28:33.232681] [INFO ] [MAIN ] WDH: Loaded 17223 primary data records. [2025-09-24T22:28:33.237625] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-24T22:28:33.237699] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-24T22:28:33.238018] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-24T22:28:33.293410] [INFO ] [MAIN ] Derivative Progress: 1985/2075 symbols completed. WCN took 1.2s. Estimated remaining: 35.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:33.325736] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:33.343259] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-24T22:28:33.343366] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-24T22:28:33.353213] [INFO ] [MAIN ] Derivative Progress: 1986/2075 symbols completed. WD took 1.3s. Estimated remaining: 34.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:33.364373] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:33.610746] [DEBUG] [LOCAL ] WDI: Loaded 21004 existing records from primary storage. [2025-09-24T22:28:33.611011] [INFO ] [MAIN ] WDI: Loaded 21004 primary data records. [2025-09-24T22:28:33.943068] [DEBUG] [LOCAL ] WDS: Loaded 43599 existing records from primary storage. [2025-09-24T22:28:33.956771] [INFO ] [MAIN ] WDS: Loaded 43599 primary data records. [2025-09-24T22:28:34.280827] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:34.283291] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17223 primary records. [2025-09-24T22:28:34.283679] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-24T22:28:34.301144] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-24T22:28:34.302507] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-24T22:28:34.305623] [INFO ] [MAIN ] Derivative Progress: 1987/2075 symbols completed. WDH took 1.1s. Estimated remaining: 34.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:34.305941] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:34.326951] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:34.327753] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21004 primary records. [2025-09-24T22:28:34.327993] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-24T22:28:34.332591] [DEBUG] [LOCAL ] WEA: Loaded 7343 existing records from primary storage. [2025-09-24T22:28:34.332948] [INFO ] [MAIN ] WEA: Loaded 7343 primary data records. [2025-09-24T22:28:34.416810] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-09-24T22:28:34.433223] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-24T22:28:34.452927] [INFO ] [MAIN ] Derivative Progress: 1988/2075 symbols completed. WDI took 1.1s. Estimated remaining: 33.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:34.455039] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:34.547908] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:34.659276] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43599 primary records. [2025-09-24T22:28:34.668493] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-24T22:28:34.686423] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-24T22:28:34.687176] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-24T22:28:34.690182] [INFO ] [MAIN ] Derivative Progress: 1989/2075 symbols completed. WDS took 1.3s. Estimated remaining: 33.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:34.691084] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:34.738545] [DEBUG] [LOCAL ] WEAV: Loaded 41969 existing records from primary storage. [2025-09-24T22:28:34.737577] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:34.739423] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7343 primary records. [2025-09-24T22:28:34.739570] [INFO ] [MAIN ] WEAV: Loaded 41969 primary data records. [2025-09-24T22:28:34.739714] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-24T22:28:34.871595] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-24T22:28:34.885595] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-24T22:28:34.898909] [INFO ] [MAIN ] Derivative Progress: 1990/2075 symbols completed. WEA took 0.6s. Estimated remaining: 33.2s. Rate: 153.8 symbols/min [2025-09-24T22:28:34.915558] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:34.993517] [DEBUG] [LOCAL ] WEC: Loaded 52208 existing records from primary storage. [2025-09-24T22:28:35.095617] [INFO ] [MAIN ] WEC: Loaded 52208 primary data records. [2025-09-24T22:28:35.458250] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:35.459209] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41969 primary records. [2025-09-24T22:28:35.460793] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-24T22:28:35.492756] [DEBUG] [LOCAL ] WELL: Loaded 52356 existing records from primary storage. [2025-09-24T22:28:35.493357] [INFO ] [MAIN ] WELL: Loaded 52356 primary data records. [2025-09-24T22:28:35.493842] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-24T22:28:35.494116] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-24T22:28:35.496248] [INFO ] [MAIN ] Derivative Progress: 1991/2075 symbols completed. WEAV took 1.0s. Estimated remaining: 32.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:35.513991] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:35.688426] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:35.710950] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52208 primary records. [2025-09-24T22:28:35.761292] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-24T22:28:35.890065] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-24T22:28:35.890282] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-24T22:28:35.893538] [INFO ] [MAIN ] Derivative Progress: 1992/2075 symbols completed. WEC took 1.2s. Estimated remaining: 32.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:35.894469] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:35.913025] [DEBUG] [LOCAL ] WES: Loaded 48003 existing records from primary storage. [2025-09-24T22:28:35.913246] [INFO ] [MAIN ] WES: Loaded 48003 primary data records. [2025-09-24T22:28:36.261800] [DEBUG] [LOCAL ] WEX: Loaded 35325 existing records from primary storage. [2025-09-24T22:28:36.262419] [INFO ] [MAIN ] WEX: Loaded 35325 primary data records. [2025-09-24T22:28:36.276262] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:36.277816] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52356 primary records. [2025-09-24T22:28:36.313418] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-24T22:28:36.411603] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-24T22:28:36.420304] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-24T22:28:36.422890] [INFO ] [MAIN ] Derivative Progress: 1993/2075 symbols completed. WELL took 1.5s. Estimated remaining: 32.0s. Rate: 153.8 symbols/min [2025-09-24T22:28:36.639515] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:36.640289] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48003 primary records. [2025-09-24T22:28:36.640441] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-24T22:28:36.658633] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-24T22:28:36.658919] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-24T22:28:36.661242] [INFO ] [MAIN ] Derivative Progress: 1994/2075 symbols completed. WES took 1.2s. Estimated remaining: 31.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:36.681754] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:36.682439] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 35325 primary records. [2025-09-24T22:28:36.682506] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-24T22:28:36.698366] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-24T22:28:36.698460] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-24T22:28:36.700725] [INFO ] [MAIN ] Derivative Progress: 1995/2075 symbols completed. WEX took 0.8s. Estimated remaining: 31.2s. Rate: 153.9 symbols/min [2025-09-24T22:28:36.701334] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:36.701474] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:36.702359] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:36.717670] [DEBUG] [LOCAL ] WF: Loaded 10830 existing records from primary storage. [2025-09-24T22:28:36.717869] [INFO ] [MAIN ] WF: Loaded 10830 primary data records. [2025-09-24T22:28:36.845103] [DEBUG] [LOCAL ] WFG: Loaded 24893 existing records from primary storage. [2025-09-24T22:28:36.845693] [INFO ] [MAIN ] WFG: Loaded 24893 primary data records. [2025-09-24T22:28:37.200553] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-24T22:28:37.206998] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-24T22:28:37.788386] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:37.789721] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10830 primary records. [2025-09-24T22:28:37.789957] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-24T22:28:37.809819] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-24T22:28:37.810070] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-24T22:28:37.812500] [INFO ] [MAIN ] Derivative Progress: 1996/2075 symbols completed. WF took 1.1s. Estimated remaining: 30.8s. Rate: 153.7 symbols/min [2025-09-24T22:28:37.826029] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:37.826708] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:37.827570] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24893 primary records. [2025-09-24T22:28:37.828106] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-24T22:28:37.844797] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-24T22:28:37.846053] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-24T22:28:37.849912] [INFO ] [MAIN ] Derivative Progress: 1997/2075 symbols completed. WFG took 1.1s. Estimated remaining: 30.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:37.850485] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:37.863671] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:37.864415] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-24T22:28:37.864572] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-24T22:28:37.881274] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-24T22:28:37.881485] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-24T22:28:37.884476] [INFO ] [MAIN ] Derivative Progress: 1998/2075 symbols completed. WFC took 1.2s. Estimated remaining: 30.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:37.895517] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:37.916415] [DEBUG] [LOCAL ] WGO: Loaded 39309 existing records from primary storage. [2025-09-24T22:28:37.916747] [INFO ] [MAIN ] WGO: Loaded 39309 primary data records. [2025-09-24T22:28:38.093472] [DEBUG] [LOCAL ] WH: Loaded 45708 existing records from primary storage. [2025-09-24T22:28:38.129700] [INFO ] [MAIN ] WH: Loaded 45708 primary data records. [2025-09-24T22:28:38.265122] [DEBUG] [LOCAL ] WHD: Loaded 40532 existing records from primary storage. [2025-09-24T22:28:38.307793] [INFO ] [MAIN ] WHD: Loaded 40532 primary data records. [2025-09-24T22:28:38.911372] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:38.913011] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39309 primary records. [2025-09-24T22:28:38.914003] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-24T22:28:38.932447] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-24T22:28:38.932677] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-24T22:28:38.935987] [INFO ] [MAIN ] Derivative Progress: 1999/2075 symbols completed. WGO took 1.1s. Estimated remaining: 29.7s. Rate: 153.7 symbols/min [2025-09-24T22:28:38.936713] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:38.946952] [DEBUG] [LOCAL ] WHG: Loaded 3384 existing records from primary storage. [2025-09-24T22:28:38.959898] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:38.960692] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40532 primary records. [2025-09-24T22:28:38.960791] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-24T22:28:38.959586] [INFO ] [MAIN ] WHG: Loaded 3384 primary data records. [2025-09-24T22:28:39.029953] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:39.049027] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45708 primary records. [2025-09-24T22:28:39.059693] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-24T22:28:39.191253] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-24T22:28:39.198832] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-24T22:28:39.198939] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-24T22:28:39.277110] [INFO ] [MAIN ] Derivative Progress: 2000/2075 symbols completed. WH took 1.4s. Estimated remaining: 29.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:39.321304] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:39.274707] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-24T22:28:39.324338] [INFO ] [MAIN ] Derivative Progress: 2001/2075 symbols completed. WHD took 1.4s. Estimated remaining: 28.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:39.324885] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:39.334798] [DEBUG] [LOCAL ] WIA: Loaded 4865 existing records from primary storage. [2025-09-24T22:28:39.334963] [INFO ] [MAIN ] WIA: Loaded 4865 primary data records. [2025-09-24T22:28:39.730173] [DEBUG] [LOCAL ] WHR: Loaded 48110 existing records from primary storage. [2025-09-24T22:28:39.731043] [INFO ] [MAIN ] WHR: Loaded 48110 primary data records. [2025-09-24T22:28:39.830363] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:28:39.855016] [INFO ] [MAIN ] WHG: Generated 1793 derivative records from 3384 primary records. [2025-09-24T22:28:39.906575] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-24T22:28:40.073249] [DEBUG] [LOCAL ] WHG: Derivative data saved (1793 records). [2025-09-24T22:28:40.074012] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-24T22:28:40.076382] [INFO ] [MAIN ] Derivative Progress: 2002/2075 symbols completed. WHG took 1.1s. Estimated remaining: 28.5s. Rate: 153.7 symbols/min [2025-09-24T22:28:40.076795] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:40.096944] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:40.098001] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4865 primary records. [2025-09-24T22:28:40.101160] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-24T22:28:40.113719] [DEBUG] [LOCAL ] WINN: Loaded 11834 existing records from primary storage. [2025-09-24T22:28:40.118154] [INFO ] [MAIN ] WINN: Loaded 11834 primary data records. [2025-09-24T22:28:40.191793] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-24T22:28:40.209079] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-24T22:28:40.228173] [INFO ] [MAIN ] Derivative Progress: 2003/2075 symbols completed. WIA took 0.9s. Estimated remaining: 28.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:40.231694] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:40.271390] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:40.303253] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48110 primary records. [2025-09-24T22:28:40.324902] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-24T22:28:40.474715] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-24T22:28:40.475306] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-24T22:28:40.478099] [INFO ] [MAIN ] Derivative Progress: 2004/2075 symbols completed. WHR took 1.2s. Estimated remaining: 27.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:40.479342] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:40.534420] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:28:40.535438] [DEBUG] [LOCAL ] WIT: Loaded 52291 existing records from primary storage. [2025-09-24T22:28:40.535624] [INFO ] [MAIN ] WIT: Loaded 52291 primary data records. [2025-09-24T22:28:40.548046] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11834 primary records. [2025-09-24T22:28:40.563275] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-24T22:28:40.608395] [DEBUG] [LOCAL ] WIW: Loaded 20625 existing records from primary storage. [2025-09-24T22:28:40.613672] [INFO ] [MAIN ] WIW: Loaded 20625 primary data records. [2025-09-24T22:28:40.650995] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-24T22:28:40.658510] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-24T22:28:40.683980] [INFO ] [MAIN ] Derivative Progress: 2005/2075 symbols completed. WINN took 0.6s. Estimated remaining: 27.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:40.699861] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:41.212775] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:41.214374] [DEBUG] [LOCAL ] WK: Loaded 36687 existing records from primary storage. [2025-09-24T22:28:41.215170] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52291 primary records. [2025-09-24T22:28:41.215360] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-24T22:28:41.215432] [INFO ] [MAIN ] WK: Loaded 36687 primary data records. [2025-09-24T22:28:41.368543] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-24T22:28:41.424673] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-24T22:28:41.428463] [INFO ] [MAIN ] Derivative Progress: 2006/2075 symbols completed. WIT took 1.2s. Estimated remaining: 26.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:41.429990] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:41.564809] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:41.566122] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20625 primary records. [2025-09-24T22:28:41.566335] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-24T22:28:41.587343] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-24T22:28:41.587798] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-24T22:28:41.590416] [INFO ] [MAIN ] Derivative Progress: 2007/2075 symbols completed. WIW took 1.1s. Estimated remaining: 26.5s. Rate: 153.8 symbols/min [2025-09-24T22:28:41.591280] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:41.634366] [DEBUG] [LOCAL ] WKC: Loaded 35109 existing records from primary storage. [2025-09-24T22:28:41.634893] [INFO ] [MAIN ] WKC: Loaded 35109 primary data records. [2025-09-24T22:28:41.634826] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:41.641020] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36687 primary records. [2025-09-24T22:28:41.672780] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-24T22:28:41.867576] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-24T22:28:41.903766] [DEBUG] [LOCAL ] WLK: Loaded 45404 existing records from primary storage. [2025-09-24T22:28:41.989794] [INFO ] [MAIN ] WLK: Loaded 45404 primary data records. [2025-09-24T22:28:41.989693] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-24T22:28:42.033232] [INFO ] [MAIN ] Derivative Progress: 2008/2075 symbols completed. WK took 1.3s. Estimated remaining: 26.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:42.383497] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:42.385180] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 35109 primary records. [2025-09-24T22:28:42.385453] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-24T22:28:42.404412] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-24T22:28:42.404689] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-24T22:28:42.407232] [INFO ] [MAIN ] Derivative Progress: 2009/2075 symbols completed. WKC took 1.0s. Estimated remaining: 25.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:42.425026] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:42.425755] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45404 primary records. [2025-09-24T22:28:42.425853] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-24T22:28:42.441331] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-24T22:28:42.441400] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-24T22:28:42.443831] [INFO ] [MAIN ] Derivative Progress: 2010/2075 symbols completed. WLK took 0.9s. Estimated remaining: 25.3s. Rate: 153.9 symbols/min [2025-09-24T22:28:42.444738] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:42.444554] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:42.444965] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:42.455722] [DEBUG] [LOCAL ] WLKP: Loaded 6685 existing records from primary storage. [2025-09-24T22:28:42.456154] [INFO ] [MAIN ] WLKP: Loaded 6685 primary data records. [2025-09-24T22:28:42.605206] [DEBUG] [LOCAL ] WLY: Loaded 30036 existing records from primary storage. [2025-09-24T22:28:42.630839] [INFO ] [MAIN ] WLY: Loaded 30036 primary data records. [2025-09-24T22:28:42.970126] [DEBUG] [LOCAL ] WM: Loaded 50956 existing records from primary storage. [2025-09-24T22:28:42.979499] [INFO ] [MAIN ] WM: Loaded 50956 primary data records. [2025-09-24T22:28:43.481400] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:43.482713] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6685 primary records. [2025-09-24T22:28:43.484901] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-24T22:28:43.512030] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:43.513517] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 30036 primary records. [2025-09-24T22:28:43.515250] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-24T22:28:43.518871] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-24T22:28:43.526110] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-24T22:28:43.535368] [INFO ] [MAIN ] Derivative Progress: 2011/2075 symbols completed. WLKP took 1.1s. Estimated remaining: 25.0s. Rate: 153.7 symbols/min [2025-09-24T22:28:43.536627] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:43.537411] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-24T22:28:43.538091] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-24T22:28:43.540722] [INFO ] [MAIN ] Derivative Progress: 2012/2075 symbols completed. WLY took 1.1s. Estimated remaining: 24.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:43.541223] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:43.557880] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:43.558671] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50956 primary records. [2025-09-24T22:28:43.558849] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-24T22:28:43.579247] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-24T22:28:43.579499] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-24T22:28:43.582990] [INFO ] [MAIN ] Derivative Progress: 2013/2075 symbols completed. WM took 1.1s. Estimated remaining: 24.2s. Rate: 153.9 symbols/min [2025-09-24T22:28:43.589167] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:43.589508] [DEBUG] [LOCAL ] WMK: Loaded 14531 existing records from primary storage. [2025-09-24T22:28:43.589731] [INFO ] [MAIN ] WMK: Loaded 14531 primary data records. [2025-09-24T22:28:43.977883] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-24T22:28:43.987501] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-24T22:28:44.098825] [DEBUG] [LOCAL ] WMS: Loaded 39665 existing records from primary storage. [2025-09-24T22:28:44.111382] [INFO ] [MAIN ] WMS: Loaded 39665 primary data records. [2025-09-24T22:28:44.645066] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:44.646222] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14531 primary records. [2025-09-24T22:28:44.646801] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-24T22:28:44.666406] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-24T22:28:44.666802] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-24T22:28:44.670178] [INFO ] [MAIN ] Derivative Progress: 2014/2075 symbols completed. WMK took 1.1s. Estimated remaining: 23.8s. Rate: 153.8 symbols/min [2025-09-24T22:28:44.670603] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:44.691455] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:44.692347] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-24T22:28:44.692523] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-24T22:28:44.711183] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-24T22:28:44.711487] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-24T22:28:44.713748] [INFO ] [MAIN ] Derivative Progress: 2015/2075 symbols completed. WMB took 1.2s. Estimated remaining: 23.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:44.716571] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:44.731690] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-24T22:28:44.732675] [INFO ] [MAIN ] WMS: Generated 1793 derivative records from 39665 primary records. [2025-09-24T22:28:44.732894] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-24T22:28:44.765036] [DEBUG] [LOCAL ] WMS: Derivative data saved (1793 records). [2025-09-24T22:28:44.765364] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-24T22:28:44.769424] [INFO ] [MAIN ] Derivative Progress: 2016/2075 symbols completed. WMS took 1.2s. Estimated remaining: 23.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:44.770040] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:44.802698] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-24T22:28:44.803011] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-24T22:28:44.934120] [DEBUG] [LOCAL ] WNC: Loaded 40028 existing records from primary storage. [2025-09-24T22:28:44.945252] [INFO ] [MAIN ] WNC: Loaded 40028 primary data records. [2025-09-24T22:28:45.223315] [DEBUG] [LOCAL ] WNS: Loaded 40001 existing records from primary storage. [2025-09-24T22:28:45.236282] [INFO ] [MAIN ] WNS: Loaded 40001 primary data records. [2025-09-24T22:28:45.876158] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:45.877246] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-24T22:28:45.877505] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-24T22:28:45.898110] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-24T22:28:45.898946] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-24T22:28:45.901434] [INFO ] [MAIN ] Derivative Progress: 2017/2075 symbols completed. WMT took 1.2s. Estimated remaining: 22.6s. Rate: 153.7 symbols/min [2025-09-24T22:28:45.902963] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:45.920757] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:45.923393] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 40028 primary records. [2025-09-24T22:28:45.924907] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-24T22:28:45.954951] [DEBUG] [MAIN ] WNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:45.957873] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-24T22:28:45.958268] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-24T22:28:45.959197] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40001 primary records. [2025-09-24T22:28:45.962582] [INFO ] [MAIN ] Derivative Progress: 2018/2075 symbols completed. WNC took 1.2s. Estimated remaining: 22.2s. Rate: 153.8 symbols/min [2025-09-24T22:28:45.963115] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:45.962699] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-24T22:28:45.995413] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-24T22:28:45.995689] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-24T22:28:45.998344] [INFO ] [MAIN ] Derivative Progress: 2019/2075 symbols completed. WNS took 1.2s. Estimated remaining: 21.8s. Rate: 153.9 symbols/min [2025-09-24T22:28:45.998938] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:46.025319] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-24T22:28:46.025575] [INFO ] [MAIN ] WOLF: Loaded 53532 primary data records. [2025-09-24T22:28:46.127354] [DEBUG] [LOCAL ] WOR: Loaded 24727 existing records from primary storage. [2025-09-24T22:28:46.146216] [INFO ] [MAIN ] WOR: Loaded 24727 primary data records. [2025-09-24T22:28:46.272137] [DEBUG] [LOCAL ] WOW: Loaded 30194 existing records from primary storage. [2025-09-24T22:28:46.280604] [INFO ] [MAIN ] WOW: Loaded 30194 primary data records. [2025-09-24T22:28:47.071332] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:47.071910] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:47.072691] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24727 primary records. [2025-09-24T22:28:47.072983] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-24T22:28:47.073570] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53532 primary records. [2025-09-24T22:28:47.074526] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-24T22:28:47.107145] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-24T22:28:47.107920] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-24T22:28:47.119470] [INFO ] [MAIN ] Derivative Progress: 2020/2075 symbols completed. WOR took 1.2s. Estimated remaining: 21.5s. Rate: 153.7 symbols/min [2025-09-24T22:28:47.125230] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:47.125992] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:47.127246] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30194 primary records. [2025-09-24T22:28:47.127995] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-24T22:28:47.129673] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-24T22:28:47.130213] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-24T22:28:47.132572] [INFO ] [MAIN ] Derivative Progress: 2021/2075 symbols completed. WOLF took 1.2s. Estimated remaining: 21.1s. Rate: 153.8 symbols/min [2025-09-24T22:28:47.140209] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:47.148795] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-24T22:28:47.148878] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-24T22:28:47.151401] [INFO ] [MAIN ] Derivative Progress: 2022/2075 symbols completed. WOW took 1.2s. Estimated remaining: 20.7s. Rate: 153.9 symbols/min [2025-09-24T22:28:47.151920] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:47.217370] [DEBUG] [LOCAL ] WPC: Loaded 48540 existing records from primary storage. [2025-09-24T22:28:47.230907] [INFO ] [MAIN ] WPC: Loaded 48540 primary data records. [2025-09-24T22:28:47.230808] [DEBUG] [LOCAL ] WPP: Loaded 33738 existing records from primary storage. [2025-09-24T22:28:47.231156] [INFO ] [MAIN ] WPP: Loaded 33738 primary data records. [2025-09-24T22:28:47.512502] [DEBUG] [LOCAL ] WPM: Loaded 52734 existing records from primary storage. [2025-09-24T22:28:47.549306] [INFO ] [MAIN ] WPM: Loaded 52734 primary data records. [2025-09-24T22:28:48.345864] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:48.359530] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48540 primary records. [2025-09-24T22:28:48.359806] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-24T22:28:48.362055] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:48.370042] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33738 primary records. [2025-09-24T22:28:48.370160] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-24T22:28:48.393012] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-24T22:28:48.393525] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-24T22:28:48.397100] [INFO ] [MAIN ] Derivative Progress: 2023/2075 symbols completed. WPP took 1.2s. Estimated remaining: 20.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:48.399880] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-24T22:28:48.400519] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-24T22:28:48.402723] [INFO ] [MAIN ] Derivative Progress: 2024/2075 symbols completed. WPC took 1.3s. Estimated remaining: 19.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:48.417142] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:48.417781] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52734 primary records. [2025-09-24T22:28:48.417843] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-24T22:28:48.433049] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-24T22:28:48.433108] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-24T22:28:48.435563] [INFO ] [MAIN ] Derivative Progress: 2025/2075 symbols completed. WPM took 1.3s. Estimated remaining: 19.5s. Rate: 153.9 symbols/min [2025-09-24T22:28:48.436459] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:48.436843] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:48.436961] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:48.480821] [DEBUG] [LOCAL ] WS: Loaded 23893 existing records from primary storage. [2025-09-24T22:28:48.481069] [INFO ] [MAIN ] WS: Loaded 23893 primary data records. [2025-09-24T22:28:48.592880] [DEBUG] [LOCAL ] WRB: Loaded 50554 existing records from primary storage. [2025-09-24T22:28:48.607898] [INFO ] [MAIN ] WRB: Loaded 50554 primary data records. [2025-09-24T22:28:48.828458] [DEBUG] [LOCAL ] WRBY: Loaded 50878 existing records from primary storage. [2025-09-24T22:28:48.832200] [INFO ] [MAIN ] WRBY: Loaded 50878 primary data records. [2025-09-24T22:28:49.512871] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:49.514010] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23893 primary records. [2025-09-24T22:28:49.515104] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-24T22:28:49.559542] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:49.559950] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:49.561199] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50878 primary records. [2025-09-24T22:28:49.562790] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-24T22:28:49.562363] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50554 primary records. [2025-09-24T22:28:49.562933] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-24T22:28:49.595078] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-24T22:28:49.598809] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-24T22:28:49.601850] [INFO ] [MAIN ] Derivative Progress: 2026/2075 symbols completed. WRBY took 1.2s. Estimated remaining: 19.1s. Rate: 153.7 symbols/min [2025-09-24T22:28:49.604620] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:49.604501] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-24T22:28:49.606130] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-24T22:28:49.610364] [INFO ] [MAIN ] Derivative Progress: 2027/2075 symbols completed. WS took 1.2s. Estimated remaining: 18.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:49.610494] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-24T22:28:49.611206] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:49.611132] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-24T22:28:49.615959] [INFO ] [MAIN ] Derivative Progress: 2028/2075 symbols completed. WRB took 1.2s. Estimated remaining: 18.3s. Rate: 153.9 symbols/min [2025-09-24T22:28:49.616867] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:49.648436] [DEBUG] [LOCAL ] WSO: Loaded 24693 existing records from primary storage. [2025-09-24T22:28:49.648633] [INFO ] [MAIN ] WSO: Loaded 24693 primary data records. [2025-09-24T22:28:49.796611] [DEBUG] [LOCAL ] WSR: Loaded 23275 existing records from primary storage. [2025-09-24T22:28:49.815907] [INFO ] [MAIN ] WSR: Loaded 23275 primary data records. [2025-09-24T22:28:49.877291] [DEBUG] [LOCAL ] WSM: Loaded 49858 existing records from primary storage. [2025-09-24T22:28:50.018015] [INFO ] [MAIN ] WSM: Loaded 49858 primary data records. [2025-09-24T22:28:50.678802] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:50.679775] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24693 primary records. [2025-09-24T22:28:50.680039] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-24T22:28:50.698292] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-24T22:28:50.698589] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-24T22:28:50.700855] [INFO ] [MAIN ] Derivative Progress: 2029/2075 symbols completed. WSO took 1.1s. Estimated remaining: 18.0s. Rate: 153.7 symbols/min [2025-09-24T22:28:50.701217] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:50.734379] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:50.734832] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:50.735775] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23275 primary records. [2025-09-24T22:28:50.736594] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49858 primary records. [2025-09-24T22:28:50.736847] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-24T22:28:50.736780] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-24T22:28:50.773825] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-24T22:28:50.774443] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-24T22:28:50.777104] [INFO ] [MAIN ] Derivative Progress: 2030/2075 symbols completed. WSM took 1.2s. Estimated remaining: 17.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:50.777711] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:50.790513] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-24T22:28:50.790822] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-24T22:28:50.793690] [INFO ] [MAIN ] Derivative Progress: 2031/2075 symbols completed. WSR took 1.2s. Estimated remaining: 17.2s. Rate: 153.9 symbols/min [2025-09-24T22:28:50.794101] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:50.809259] [DEBUG] [LOCAL ] WST: Loaded 37580 existing records from primary storage. [2025-09-24T22:28:50.809570] [INFO ] [MAIN ] WST: Loaded 37580 primary data records. [2025-09-24T22:28:51.153401] [DEBUG] [LOCAL ] WT: Loaded 47637 existing records from primary storage. [2025-09-24T22:28:51.167928] [INFO ] [MAIN ] WT: Loaded 47637 primary data records. [2025-09-24T22:28:51.286863] [DEBUG] [LOCAL ] WTI: Loaded 43754 existing records from primary storage. [2025-09-24T22:28:51.299007] [INFO ] [MAIN ] WTI: Loaded 43754 primary data records. [2025-09-24T22:28:51.839325] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:51.840327] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37580 primary records. [2025-09-24T22:28:51.840557] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-24T22:28:51.865119] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-24T22:28:51.878339] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-24T22:28:51.878270] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:51.879370] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47637 primary records. [2025-09-24T22:28:51.882229] [INFO ] [MAIN ] Derivative Progress: 2032/2075 symbols completed. WST took 1.2s. Estimated remaining: 16.8s. Rate: 153.7 symbols/min [2025-09-24T22:28:51.882759] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-24T22:28:51.883135] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:51.921204] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:51.923784] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-24T22:28:51.923990] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-24T22:28:51.923292] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43754 primary records. [2025-09-24T22:28:51.927324] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-24T22:28:51.927192] [INFO ] [MAIN ] Derivative Progress: 2033/2075 symbols completed. WT took 1.1s. Estimated remaining: 16.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:51.928838] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:51.947686] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-24T22:28:51.947872] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-24T22:28:51.950460] [INFO ] [MAIN ] Derivative Progress: 2034/2075 symbols completed. WTI took 1.2s. Estimated remaining: 16.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:51.950825] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:51.966209] [DEBUG] [LOCAL ] WTS: Loaded 18480 existing records from primary storage. [2025-09-24T22:28:51.980211] [INFO ] [MAIN ] WTS: Loaded 18480 primary data records. [2025-09-24T22:28:52.119054] [DEBUG] [LOCAL ] WTRG: Loaded 50931 existing records from primary storage. [2025-09-24T22:28:52.134732] [INFO ] [MAIN ] WTRG: Loaded 50931 primary data records. [2025-09-24T22:28:52.467719] [DEBUG] [LOCAL ] WTTR: Loaded 45054 existing records from primary storage. [2025-09-24T22:28:52.475704] [INFO ] [MAIN ] WTTR: Loaded 45054 primary data records. [2025-09-24T22:28:53.005347] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:53.007174] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18480 primary records. [2025-09-24T22:28:53.007828] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-24T22:28:53.042222] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:53.043615] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50931 primary records. [2025-09-24T22:28:53.044123] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-24T22:28:53.045757] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-24T22:28:53.046197] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-24T22:28:53.048677] [INFO ] [MAIN ] Derivative Progress: 2035/2075 symbols completed. WTS took 1.1s. Estimated remaining: 15.6s. Rate: 153.7 symbols/min [2025-09-24T22:28:53.056853] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:53.078815] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:53.080311] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 45054 primary records. [2025-09-24T22:28:53.080741] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-24T22:28:53.081853] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-24T22:28:53.082218] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-24T22:28:53.084903] [INFO ] [MAIN ] Derivative Progress: 2036/2075 symbols completed. WTRG took 1.2s. Estimated remaining: 15.2s. Rate: 153.8 symbols/min [2025-09-24T22:28:53.092427] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:53.105046] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-24T22:28:53.105147] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-24T22:28:53.107907] [INFO ] [MAIN ] Derivative Progress: 2037/2075 symbols completed. WTTR took 1.2s. Estimated remaining: 14.8s. Rate: 153.9 symbols/min [2025-09-24T22:28:53.108194] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:53.170511] [DEBUG] [LOCAL ] WU: Loaded 53453 existing records from primary storage. [2025-09-24T22:28:53.171304] [INFO ] [MAIN ] WU: Loaded 53453 primary data records. [2025-09-24T22:28:53.257248] [DEBUG] [LOCAL ] WWW: Loaded 49176 existing records from primary storage. [2025-09-24T22:28:53.279296] [INFO ] [MAIN ] WWW: Loaded 49176 primary data records. [2025-09-24T22:28:53.420824] [DEBUG] [LOCAL ] WY: Loaded 53119 existing records from primary storage. [2025-09-24T22:28:53.463884] [INFO ] [MAIN ] WY: Loaded 53119 primary data records. [2025-09-24T22:28:54.231484] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:54.232632] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53453 primary records. [2025-09-24T22:28:54.232927] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-24T22:28:54.252634] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-24T22:28:54.253187] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-24T22:28:54.259225] [INFO ] [MAIN ] Derivative Progress: 2038/2075 symbols completed. WU took 1.2s. Estimated remaining: 14.4s. Rate: 153.7 symbols/min [2025-09-24T22:28:54.288376] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:54.289678] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49176 primary records. [2025-09-24T22:28:54.288883] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:54.290543] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53119 primary records. [2025-09-24T22:28:54.289833] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-24T22:28:54.290714] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-24T22:28:54.319962] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-24T22:28:54.322141] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-24T22:28:54.324984] [INFO ] [MAIN ] Derivative Progress: 2039/2075 symbols completed. WWW took 1.2s. Estimated remaining: 14.0s. Rate: 153.8 symbols/min [2025-09-24T22:28:54.327370] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-24T22:28:54.327448] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-24T22:28:54.329928] [INFO ] [MAIN ] Derivative Progress: 2040/2075 symbols completed. WY took 1.2s. Estimated remaining: 13.6s. Rate: 153.8 symbols/min [2025-09-24T22:28:54.330564] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:54.330839] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:54.330762] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:54.364352] [DEBUG] [LOCAL ] XFLT: Loaded 29992 existing records from primary storage. [2025-09-24T22:28:54.364588] [INFO ] [MAIN ] XFLT: Loaded 29992 primary data records. [2025-09-24T22:28:54.631407] [DEBUG] [LOCAL ] XHR: Loaded 44125 existing records from primary storage. [2025-09-24T22:28:54.630785] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-24T22:28:54.739619] [INFO ] [MAIN ] XHR: Loaded 44125 primary data records. [2025-09-24T22:28:54.749124] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-24T22:28:55.397326] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:55.398362] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29992 primary records. [2025-09-24T22:28:55.398469] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-24T22:28:55.416440] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-24T22:28:55.416676] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-24T22:28:55.420083] [INFO ] [MAIN ] Derivative Progress: 2041/2075 symbols completed. XFLT took 1.1s. Estimated remaining: 13.3s. Rate: 153.7 symbols/min [2025-09-24T22:28:55.420745] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:55.440686] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:55.442096] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 44125 primary records. [2025-09-24T22:28:55.442341] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-24T22:28:55.466958] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:55.468292] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-24T22:28:55.468838] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-24T22:28:55.480514] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-24T22:28:55.481531] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-24T22:28:55.484433] [INFO ] [MAIN ] Derivative Progress: 2042/2075 symbols completed. XHR took 1.2s. Estimated remaining: 12.9s. Rate: 153.8 symbols/min [2025-09-24T22:28:55.493505] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:55.508835] [DEBUG] [LOCAL ] XPER: Loaded 29606 existing records from primary storage. [2025-09-24T22:28:55.509471] [INFO ] [MAIN ] XPER: Loaded 29606 primary data records. [2025-09-24T22:28:55.556806] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-24T22:28:55.569389] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-24T22:28:55.581727] [INFO ] [MAIN ] Derivative Progress: 2043/2075 symbols completed. XOM took 1.3s. Estimated remaining: 12.5s. Rate: 153.8 symbols/min [2025-09-24T22:28:55.604507] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:55.851961] [DEBUG] [LOCAL ] XPEV: Loaded 53639 existing records from primary storage. [2025-09-24T22:28:55.862428] [INFO ] [MAIN ] XPEV: Loaded 53639 primary data records. [2025-09-24T22:28:56.001240] [DEBUG] [LOCAL ] XPO: Loaded 48080 existing records from primary storage. [2025-09-24T22:28:56.011835] [INFO ] [MAIN ] XPO: Loaded 48080 primary data records. [2025-09-24T22:28:56.578610] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:56.595076] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29606 primary records. [2025-09-24T22:28:56.595432] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-24T22:28:56.620708] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-24T22:28:56.633565] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-24T22:28:56.636838] [INFO ] [MAIN ] Derivative Progress: 2044/2075 symbols completed. XPER took 1.2s. Estimated remaining: 12.1s. Rate: 153.7 symbols/min [2025-09-24T22:28:56.634453] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:56.637439] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:56.638580] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53639 primary records. [2025-09-24T22:28:56.639031] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-24T22:28:56.660839] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-24T22:28:56.660978] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-24T22:28:56.663628] [INFO ] [MAIN ] Derivative Progress: 2045/2075 symbols completed. XPEV took 1.2s. Estimated remaining: 11.7s. Rate: 153.8 symbols/min [2025-09-24T22:28:56.672013] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:56.677521] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:56.678784] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 48080 primary records. [2025-09-24T22:28:56.678960] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-24T22:28:56.707549] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-24T22:28:56.718998] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-24T22:28:56.721997] [INFO ] [MAIN ] Derivative Progress: 2046/2075 symbols completed. XPO took 1.1s. Estimated remaining: 11.3s. Rate: 153.8 symbols/min [2025-09-24T22:28:56.723213] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:56.722817] [DEBUG] [LOCAL ] XPOF: Loaded 38829 existing records from primary storage. [2025-09-24T22:28:56.723812] [INFO ] [MAIN ] XPOF: Loaded 38829 primary data records. [2025-09-24T22:28:57.059596] [DEBUG] [LOCAL ] XPRO: Loaded 45971 existing records from primary storage. [2025-09-24T22:28:57.059886] [INFO ] [MAIN ] XPRO: Loaded 45971 primary data records. [2025-09-24T22:28:57.126793] [DEBUG] [LOCAL ] XYF: Loaded 28209 existing records from primary storage. [2025-09-24T22:28:57.136884] [INFO ] [MAIN ] XYF: Loaded 28209 primary data records. [2025-09-24T22:28:57.707989] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:57.710513] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38829 primary records. [2025-09-24T22:28:57.710773] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-24T22:28:57.734202] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-24T22:28:57.735867] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-24T22:28:57.738853] [INFO ] [MAIN ] Derivative Progress: 2047/2075 symbols completed. XPOF took 1.1s. Estimated remaining: 10.9s. Rate: 153.7 symbols/min [2025-09-24T22:28:57.752583] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:57.754002] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:57.755158] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45971 primary records. [2025-09-24T22:28:57.763136] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-24T22:28:57.768890] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:57.770507] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28209 primary records. [2025-09-24T22:28:57.779038] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-24T22:28:57.812860] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-24T22:28:57.813691] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-24T22:28:57.816259] [INFO ] [MAIN ] Derivative Progress: 2048/2075 symbols completed. XPRO took 1.1s. Estimated remaining: 10.5s. Rate: 153.8 symbols/min [2025-09-24T22:28:57.817095] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-24T22:28:57.817201] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:57.817306] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-24T22:28:57.820093] [INFO ] [MAIN ] Derivative Progress: 2049/2075 symbols completed. XYF took 1.1s. Estimated remaining: 10.1s. Rate: 153.9 symbols/min [2025-09-24T22:28:57.820831] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:57.864452] [DEBUG] [LOCAL ] XYL: Loaded 48124 existing records from primary storage. [2025-09-24T22:28:57.864728] [INFO ] [MAIN ] XYL: Loaded 48124 primary data records. [2025-09-24T22:28:58.002407] [DEBUG] [LOCAL ] YALA: Loaded 37494 existing records from primary storage. [2025-09-24T22:28:58.009330] [INFO ] [MAIN ] YALA: Loaded 37494 primary data records. [2025-09-24T22:28:58.030598] [DEBUG] [LOCAL ] YELP: Loaded 45313 existing records from primary storage. [2025-09-24T22:28:58.074023] [INFO ] [MAIN ] YELP: Loaded 45313 primary data records. [2025-09-24T22:28:58.881132] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:58.882445] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 48124 primary records. [2025-09-24T22:28:58.882946] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-24T22:28:58.920921] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-24T22:28:58.921187] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-24T22:28:58.923535] [INFO ] [MAIN ] Derivative Progress: 2050/2075 symbols completed. XYL took 1.2s. Estimated remaining: 9.8s. Rate: 153.7 symbols/min [2025-09-24T22:28:58.931997] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:58.938207] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45313 primary records. [2025-09-24T22:28:58.938430] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-24T22:28:58.938342] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:58.939235] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:28:58.941322] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37494 primary records. [2025-09-24T22:28:58.952816] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-24T22:28:58.971426] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-24T22:28:58.972383] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-24T22:28:58.975482] [INFO ] [MAIN ] Derivative Progress: 2051/2075 symbols completed. YALA took 1.2s. Estimated remaining: 9.4s. Rate: 153.8 symbols/min [2025-09-24T22:28:58.976378] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:58.977598] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-24T22:28:58.977799] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-24T22:28:58.980978] [INFO ] [MAIN ] Derivative Progress: 2052/2075 symbols completed. YELP took 1.2s. Estimated remaining: 9.0s. Rate: 153.9 symbols/min [2025-09-24T22:28:58.981406] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:28:59.034281] [DEBUG] [LOCAL ] YETI: Loaded 52468 existing records from primary storage. [2025-09-24T22:28:59.034547] [INFO ] [MAIN ] YETI: Loaded 52468 primary data records. [2025-09-24T22:28:59.146885] [DEBUG] [LOCAL ] YEXT: Loaded 43265 existing records from primary storage. [2025-09-24T22:28:59.178038] [INFO ] [MAIN ] YEXT: Loaded 43265 primary data records. [2025-09-24T22:28:59.236930] [DEBUG] [LOCAL ] YMM: Loaded 52676 existing records from primary storage. [2025-09-24T22:28:59.249828] [INFO ] [MAIN ] YMM: Loaded 52676 primary data records. [2025-09-24T22:29:00.117067] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:00.117979] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:00.118838] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52468 primary records. [2025-09-24T22:29:00.122039] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43265 primary records. [2025-09-24T22:29:00.120024] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-24T22:29:00.122240] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-24T22:29:00.138302] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:00.150914] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52676 primary records. [2025-09-24T22:29:00.159916] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-24T22:29:00.186548] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-24T22:29:00.188421] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-24T22:29:00.190747] [INFO ] [MAIN ] Derivative Progress: 2053/2075 symbols completed. YETI took 1.3s. Estimated remaining: 8.6s. Rate: 153.7 symbols/min [2025-09-24T22:29:00.192348] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-24T22:29:00.192724] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-24T22:29:00.196284] [INFO ] [MAIN ] Derivative Progress: 2054/2075 symbols completed. YEXT took 1.2s. Estimated remaining: 8.2s. Rate: 153.8 symbols/min [2025-09-24T22:29:00.199332] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-24T22:29:00.199445] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-24T22:29:00.202921] [INFO ] [MAIN ] Derivative Progress: 2055/2075 symbols completed. YMM took 1.2s. Estimated remaining: 7.8s. Rate: 153.8 symbols/min [2025-09-24T22:29:00.203594] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:00.203789] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:00.203886] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:00.221374] [DEBUG] [LOCAL ] YRD: Loaded 12584 existing records from primary storage. [2025-09-24T22:29:00.221565] [INFO ] [MAIN ] YRD: Loaded 12584 primary data records. [2025-09-24T22:29:00.573153] [DEBUG] [LOCAL ] YPF: Loaded 50499 existing records from primary storage. [2025-09-24T22:29:00.573495] [INFO ] [MAIN ] YPF: Loaded 50499 primary data records. [2025-09-24T22:29:00.642299] [DEBUG] [LOCAL ] YOU: Loaded 49833 existing records from primary storage. [2025-09-24T22:29:00.664517] [INFO ] [MAIN ] YOU: Loaded 49833 primary data records. [2025-09-24T22:29:01.295539] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:01.296877] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12584 primary records. [2025-09-24T22:29:01.297115] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-24T22:29:01.315936] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-24T22:29:01.316240] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-24T22:29:01.318970] [INFO ] [MAIN ] Derivative Progress: 2056/2075 symbols completed. YRD took 1.1s. Estimated remaining: 7.4s. Rate: 153.7 symbols/min [2025-09-24T22:29:01.319382] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:01.338517] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:01.340556] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50499 primary records. [2025-09-24T22:29:01.341610] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-24T22:29:01.373526] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:01.380424] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49833 primary records. [2025-09-24T22:29:01.381911] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-24T22:29:01.380572] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-24T22:29:01.382662] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-24T22:29:01.385560] [INFO ] [MAIN ] Derivative Progress: 2057/2075 symbols completed. YPF took 1.2s. Estimated remaining: 7.0s. Rate: 153.8 symbols/min [2025-09-24T22:29:01.386058] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:01.409735] [DEBUG] [LOCAL ] YSG: Loaded 25192 existing records from primary storage. [2025-09-24T22:29:01.410603] [INFO ] [MAIN ] YSG: Loaded 25192 primary data records. [2025-09-24T22:29:01.509324] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-24T22:29:01.524294] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-24T22:29:01.530555] [INFO ] [MAIN ] Derivative Progress: 2058/2075 symbols completed. YOU took 1.3s. Estimated remaining: 6.6s. Rate: 153.8 symbols/min [2025-09-24T22:29:01.531162] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:01.767092] [DEBUG] [LOCAL ] YUM: Loaded 51236 existing records from primary storage. [2025-09-24T22:29:01.767390] [INFO ] [MAIN ] YUM: Loaded 51236 primary data records. [2025-09-24T22:29:02.103428] [DEBUG] [LOCAL ] YUMC: Loaded 52698 existing records from primary storage. [2025-09-24T22:29:02.106461] [INFO ] [MAIN ] YUMC: Loaded 52698 primary data records. [2025-09-24T22:29:02.201862] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:02.224961] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25192 primary records. [2025-09-24T22:29:02.225461] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-24T22:29:02.438562] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-09-24T22:29:02.439096] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-24T22:29:02.441594] [INFO ] [MAIN ] Derivative Progress: 2059/2075 symbols completed. YSG took 1.1s. Estimated remaining: 6.2s. Rate: 153.7 symbols/min [2025-09-24T22:29:02.442632] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:02.460720] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:02.462355] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51236 primary records. [2025-09-24T22:29:02.462633] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-24T22:29:02.489267] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-24T22:29:02.489622] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-24T22:29:02.492542] [INFO ] [MAIN ] Derivative Progress: 2060/2075 symbols completed. YUM took 1.1s. Estimated remaining: 5.9s. Rate: 153.8 symbols/min [2025-09-24T22:29:02.505660] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:02.506008] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:02.507048] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52698 primary records. [2025-09-24T22:29:02.507200] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-24T22:29:02.540688] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-24T22:29:02.540863] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-24T22:29:02.543362] [INFO ] [MAIN ] Derivative Progress: 2061/2075 symbols completed. YUMC took 1.0s. Estimated remaining: 5.5s. Rate: 153.8 symbols/min [2025-09-24T22:29:02.544347] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:02.566607] [DEBUG] [LOCAL ] ZEPP: Loaded 16916 existing records from primary storage. [2025-09-24T22:29:02.566844] [INFO ] [MAIN ] ZEPP: Loaded 16916 primary data records. [2025-09-24T22:29:02.579440] [DEBUG] [LOCAL ] ZBH: Loaded 51231 existing records from primary storage. [2025-09-24T22:29:02.606134] [INFO ] [MAIN ] ZBH: Loaded 51231 primary data records. [2025-09-24T22:29:03.251347] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-24T22:29:03.252722] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-24T22:29:03.596314] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:03.602534] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51231 primary records. [2025-09-24T22:29:03.601776] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:03.602686] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-24T22:29:03.604129] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 16916 primary records. [2025-09-24T22:29:03.605370] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-24T22:29:03.628454] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-24T22:29:03.629792] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-24T22:29:03.635283] [INFO ] [MAIN ] Derivative Progress: 2062/2075 symbols completed. ZBH took 1.2s. Estimated remaining: 5.1s. Rate: 153.7 symbols/min [2025-09-24T22:29:03.638693] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:03.640673] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-24T22:29:03.640748] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-24T22:29:03.643336] [INFO ] [MAIN ] Derivative Progress: 2063/2075 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.7s. Rate: 153.8 symbols/min [2025-09-24T22:29:03.643700] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:03.661912] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:03.662722] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-24T22:29:03.662831] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-24T22:29:03.706394] [DEBUG] [LOCAL ] ZH: Loaded 26784 existing records from primary storage. [2025-09-24T22:29:03.707277] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-24T22:29:03.707210] [INFO ] [MAIN ] ZH: Loaded 26784 primary data records. [2025-09-24T22:29:03.707558] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-24T22:29:03.747898] [INFO ] [MAIN ] Derivative Progress: 2064/2075 symbols completed. ZETA took 1.2s. Estimated remaining: 4.3s. Rate: 153.8 symbols/min [2025-09-24T22:29:03.775630] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:03.876043] [DEBUG] [LOCAL ] ZGN: Loaded 40828 existing records from primary storage. [2025-09-24T22:29:03.885131] [INFO ] [MAIN ] ZGN: Loaded 40828 primary data records. [2025-09-24T22:29:04.385922] [DEBUG] [LOCAL ] ZIM: Loaded 53525 existing records from primary storage. [2025-09-24T22:29:04.386178] [INFO ] [MAIN ] ZIM: Loaded 53525 primary data records. [2025-09-24T22:29:04.752730] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:04.753718] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26784 primary records. [2025-09-24T22:29:04.754023] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-24T22:29:04.789246] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-24T22:29:04.790365] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-24T22:29:04.790275] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:04.791222] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40828 primary records. [2025-09-24T22:29:04.793813] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-24T22:29:04.793502] [INFO ] [MAIN ] Derivative Progress: 2065/2075 symbols completed. ZH took 1.1s. Estimated remaining: 3.9s. Rate: 153.7 symbols/min [2025-09-24T22:29:04.794911] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:04.811169] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-24T22:29:04.811302] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-24T22:29:04.814100] [INFO ] [MAIN ] Derivative Progress: 2066/2075 symbols completed. ZGN took 1.2s. Estimated remaining: 3.5s. Rate: 153.8 symbols/min [2025-09-24T22:29:04.814611] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:04.831554] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:04.832266] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53525 primary records. [2025-09-24T22:29:04.832412] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-24T22:29:04.862548] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-24T22:29:04.862719] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-24T22:29:04.865634] [INFO ] [MAIN ] Derivative Progress: 2067/2075 symbols completed. ZIM took 1.1s. Estimated remaining: 3.1s. Rate: 153.8 symbols/min [2025-09-24T22:29:04.866016] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:04.908125] [DEBUG] [LOCAL ] ZKH: Loaded 8000 existing records from primary storage. [2025-09-24T22:29:04.903619] [DEBUG] [LOCAL ] ZIP: Loaded 44382 existing records from primary storage. [2025-09-24T22:29:04.908940] [DEBUG] [LOCAL ] ZK: Loaded 40087 existing records from primary storage. [2025-09-24T22:29:04.908354] [INFO ] [MAIN ] ZKH: Loaded 8000 primary data records. [2025-09-24T22:29:04.909223] [INFO ] [MAIN ] ZIP: Loaded 44382 primary data records. [2025-09-24T22:29:04.909131] [INFO ] [MAIN ] ZK: Loaded 40087 primary data records. [2025-09-24T22:29:05.862718] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:05.878526] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 40087 primary records. [2025-09-24T22:29:05.889134] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:05.890161] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44382 primary records. [2025-09-24T22:29:05.890483] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:05.891137] [INFO ] [MAIN ] ZKH: Generated 1794 derivative records from 8000 primary records. [2025-09-24T22:29:05.891321] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-24T22:29:05.891218] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-24T22:29:05.892425] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-24T22:29:05.920617] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-24T22:29:05.920976] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-24T22:29:05.929736] [INFO ] [MAIN ] Derivative Progress: 2068/2075 symbols completed. ZIP took 1.1s. Estimated remaining: 2.7s. Rate: 153.7 symbols/min [2025-09-24T22:29:05.940404] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-24T22:29:05.941033] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-24T22:29:05.944066] [INFO ] [MAIN ] Derivative Progress: 2069/2075 symbols completed. ZK took 1.1s. Estimated remaining: 2.3s. Rate: 153.8 symbols/min [2025-09-24T22:29:05.941555] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1794 records). [2025-09-24T22:29:05.944328] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-24T22:29:05.947367] [INFO ] [MAIN ] Derivative Progress: 2070/2075 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 153.9 symbols/min [2025-09-24T22:29:05.948237] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:05.948116] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:05.948313] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:05.966606] [DEBUG] [LOCAL ] ZTR: Loaded 16705 existing records from primary storage. [2025-09-24T22:29:05.966940] [INFO ] [MAIN ] ZTR: Loaded 16705 primary data records. [2025-09-24T22:29:06.309612] [DEBUG] [LOCAL ] ZTO: Loaded 49977 existing records from primary storage. [2025-09-24T22:29:06.325284] [INFO ] [MAIN ] ZTO: Loaded 49977 primary data records. [2025-09-24T22:29:06.371483] [DEBUG] [LOCAL ] ZTS: Loaded 53002 existing records from primary storage. [2025-09-24T22:29:06.393213] [INFO ] [MAIN ] ZTS: Loaded 53002 primary data records. [2025-09-24T22:29:07.033384] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:07.034755] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16705 primary records. [2025-09-24T22:29:07.035039] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-24T22:29:07.057990] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-24T22:29:07.058170] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-24T22:29:07.061218] [INFO ] [MAIN ] Derivative Progress: 2071/2075 symbols completed. ZTR took 1.1s. Estimated remaining: 1.6s. Rate: 153.7 symbols/min [2025-09-24T22:29:07.074115] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:07.075469] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:07.077948] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49977 primary records. [2025-09-24T22:29:07.078368] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-24T22:29:07.104395] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:07.105847] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53002 primary records. [2025-09-24T22:29:07.107796] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-24T22:29:07.117986] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-24T22:29:07.120772] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-24T22:29:07.126093] [INFO ] [MAIN ] Derivative Progress: 2072/2075 symbols completed. ZTO took 1.2s. Estimated remaining: 1.2s. Rate: 153.8 symbols/min [2025-09-24T22:29:07.128966] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-24T22:29:07.127523] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-24T22:29:07.137371] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-24T22:29:07.140844] [INFO ] [MAIN ] Derivative Progress: 2073/2075 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 153.9 symbols/min [2025-09-24T22:29:07.158262] [DEBUG] [LOCAL ] ZVIA: Loaded 35403 existing records from primary storage. [2025-09-24T22:29:07.158497] [INFO ] [MAIN ] ZVIA: Loaded 35403 primary data records. [2025-09-24T22:29:07.386085] [DEBUG] [LOCAL ] ZWS: Loaded 42484 existing records from primary storage. [2025-09-24T22:29:07.499095] [INFO ] [MAIN ] ZWS: Loaded 42484 primary data records. [2025-09-24T22:29:07.843964] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:07.845088] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35403 primary records. [2025-09-24T22:29:07.845237] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-24T22:29:07.863864] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-24T22:29:07.864124] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-24T22:29:07.866528] [INFO ] [MAIN ] Derivative Progress: 2074/2075 symbols completed. ZVIA took 0.8s. Estimated remaining: 0.4s. Rate: 153.8 symbols/min [2025-09-24T22:29:07.882629] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-24T22:29:07.883183] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42484 primary records. [2025-09-24T22:29:07.883242] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-24T22:29:07.898307] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-24T22:29:07.898367] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-24T22:29:07.900754] [INFO ] [MAIN ] Derivative Progress: 2075/2075 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 153.9 symbols/min [2025-09-24T22:29:07.902120] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 29s [2025-09-24T22:29:07.902274] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2075/2075 symbols) [2025-09-24T22:29:08.685047] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2075/2075 @ 100.00%)' [2025-09-24T22:29:08.686268] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-24T22:29:08.686518] [INFO ] [STATE ] Last completion updated: 2025-09-24T22:29:08.686347